Vision-Based Object Handling in Collaborative Robotics

  • Authors

    • Rahul Mehta Senior Software Engineer, Wipro Ltd, India Author

    DOI:

    https://doi.org/10.67228/30715725/IJIARE-2019PI5D1P

    Published 06-04-2019

  • Collaborative Robotics, Computer Vision, Object Manipulation, Visual Perception, Human–Robot Interaction

    Issue

    Vol. 2 No. 1 (2019)

    Section

    Articles

    How to Cite

    [1]
    R. Mehta, “Vision-Based Object Handling in Collaborative Robotics”, IJIARE, vol. 2, no. 1, pp. 01–14, Jun. 2019, doi: 10.67228/30715725/IJIARE-2019PI5D1P.

  • Abstract

    The use of collaborative robots (cobots) is slowly being implemented in human-to-robot workplaces owing to the flexibility, safety, and versatility. Object manipulation Object handle Object handle Vision handled objects, Vision-based object handling as an enabling technology has become a critical inhibition technology for cobots enabling them to perceive, identify, localize and further manipulate objects in dynamic and unstructured environments. Compared to the old-fashioned industrial robotic systems, which use pre-set paths and absolute positioning of the objects, the collaborative robotic systems have to work under uncertainty, different lighting regimes, obstructions and human interference. This paper will give a deep examination of the vision-based object manipulation through collaborative robotics with respect to perception pipelines, object detection and recognition, pose estimation, grasp planning, and real time control integration. A literature review is carried out to examine both classical and deep learning-based vision methods implemented in co-operation manipulation problems. The suggested methodology includes a stepwise vision-based object manipulation system that combines the use of RGB-D sensing, the convolutional neural net-based object identification, and visual servo control in executing a closed-loop object manipulation. The performance measures that are discussed include accuracy of detection, success rate of grasp and latency to perform the grasping action. Results of the experiment with typical collaborative tasks prove the efficiency of vision-based systems in enhancing the adaptability and safety. Lastly, the paper identifies the major issues, among them real-time limits, robustness, and human conscious perception and presents research directions in future towards intelligent, autonomous, and reliable collaborative robotic systems.

  • References

    [1] Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.

    [2] Canny, J. (1986). A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8(6), 679–698.

    [3] Besl, P. J., & McKay, N. D. (1992). A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2), 239–256.

    [4] Rusu, R. B., & Cousins, S. (2011). 3D is here: Point Cloud Library (PCL). IEEE International Conference on Robotics and Automation (ICRA), 1–4.

    [5] Dalal, N., & Triggs, B. (2005). Histograms of oriented gradients for human detection. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 886–893.

    [6] Vapnik, V. (1998). Statistical Learning Theory. Wiley-Interscience.

    [7] Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32.

    [8] Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems (NeurIPS), 1097–1105.

    [9] Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You only look once: Unified, real-time object detection. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 779–788.

    [10] Ren, S., He, K., Girshick, R., & Sun, J. (2015). Faster R-CNN: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems (NeurIPS), 91–99.

    [11] He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017). Mask R-CNN. IEEE International Conference on Computer Vision (ICCV), 2961–2969.

    [12] Tremblay, J., To, T., Sundaralingam, B., et al. (2018). Deep object pose estimation for semantic robotic grasping of household objects. Conference on Robot Learning (CoRL), 306–316.

    [13] Shotton, J., Fitzgibbon, A., Cook, M., et al. (2011). Real-time human pose recognition in parts from single depth images. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1297–1304.

    [14] Mainprice, J., Sisbot, E. A., Jaillet, L., et al. (2016). Planning human-aware motions using a sampling-based costmap planner. IEEE International Conference on Robotics and Automation (ICRA), 5012–5017.

    [15] Ajoudani, A., Zanchettin, A. M., Ivaldi, S., et al. (2018). Progress and prospects of the human–robot collaboration. Autonomous Robots, 42(5), 957–975.

  • Downloads

Similar Articles

11-20 of 79

You may also start an advanced similarity search for this article.