Automated workpiece localization through CAD-based Point Cloud Registration (PCR) plays a key role in enabling adaptive robotic tasks, e.g., mapping toolpaths from a CAD model to the current workpiece location. However, existing approaches often lack the robustness required for full autonomy and need fine-tuning and operator intervention especially in the presence of corrupted data due to scene complexity, missing workpiece information, or sensor inaccuracies. These shortcomings are more evident when generalizing to the diversity of objects in highly variable scenarios such as in high-mix manufacturing. In this work, we address this problem by solving the CAD-to-workpiece alignment via a partial-to-partial PCR using 3D vision data from a deep learning and optimization standpoint. Our registration pipeline consists of three modules. First, we leverage pre-trained computer vision models to provide workpiece-agnostic segmentation. Then, a coarse imageguided alignment step is applied, followed by a novel registration architecture with joint global feature embedding and multi-head cross attention. Additionally, we introduce a novel gradient-based optimization method for fine point cloud registration. The quality of registration is primarily evaluated based on registration success rate, rotation, and translation accuracy via isotropic and anisotropic errors as well as runtime. The registration robustness is demonstrated through testing across three distinct datasets aimed to assess the proposed solution with 1) industrial object real-data, 2) diversity of industrial-looking objects through a proposed rule-based synthetic data generation engine with common point cloud corruptions, and 3) on an object-centric dataset standard for benchmarking in the point cloud research community. Our optimization-based method achieves a 99.8% success rate and significantly improves localization robustness compared to existing techniques, demonstrating its potential for real-world scenarios without parameter fine-tuning. Moreover, our proposed optimization-based strategy shows the ability to register partial overlapping point clouds from a coarse-to-fine manner without an initial guess. Our findings suggest that our pipeline, hybrid or purely optimization-based, shapes a step towards fully autonomous systems in manufacturing.
Keywords: