A Novel Approach to Steel Rivet Detection in Poorly Illuminated Steel Structural Environments

Publisher:
IEEE
Publication Type:
Conference Proceeding
Citation:
Control, Automation, Robotics and Vision (ICARCV), 2016 14th International Conference on, 2016, pp. ? - ? (6)
Issue Date:
2016-11-13
Full metadata record
Files in This Item:
Filename Description Size
PID4474481.pdfAccepted Manuscript version3.09 MB
Adobe PDF
It is becoming increasingly achievable for steel bridge structures, which are normally both inaccessible and hazardous for humans, to be inspected and maintained by autonomous robots. Steel bridges have been traditionally constructed by securing plate members together with rivets. However, rivets present a challenge for robots both in terms of cleaning and surface traversal. This paper presents a novel approach to RGBD image and point cloud analysis that enables rivets to be rapidly and robustly located using low cost, non-contact sensing devices that can be easily affixed to a robot. The approach performs classification based on: (a) high-intensity blobs in color images, (b) the non-linear perturbations in depth images, and (c) surface normal clusters in 3D point clouds. The predicted rivet locations from the three classifiers are combined using a probabilistic occupancy mapping technique. Experiments are conducted in several different lab and real-world steel bridge environments, where there is no external lighting infrastructure, and the sensors are attached to a mobile platform, i.e. a climbing inspection robot. The location of rivets within 2m of the robot can be robustly located within 10mm of their correct location. The state of voxels can be predicted with above 95% accuracy, in approximately 1 second per frame.
Please use this identifier to cite or link to this item: