Enhancing autonomy in social robots through a real-time teleoperation system
Abstract
The utilization of socially assistive robots (SARs) has shown great potential in various applications. However, there are practical challenges that hinder their widespread adoption. Recent studies have explored the use of teleoperation systems as a solution to overcome these challenges by streamlining data collection and communication with SARs. This paper introduces a cloud-based teleoperation system for robotics that enables real-time control of the robot platform, allowing remote users to view video streams and manipulate the robot system. The proposed teleoperation system was implemented in a cloud environment and tested with two different social robot platforms. The experimental results demonstrate the system's quick response and stable communication performance, meeting the requirements for remote-controlled teleoperation. Consequently, employing the proposed mobile-based teleoperation system in social robot applications enhances operator productivity, expedites operations, and reduces task completion time.
Keywords
Full Text:
PDFReferences
1. Elfaki AO, Abduljabbar M, Ali L, et al. Revolutionizing Social Robotics: A Cloud-Based Framework for Enhancing the Intelligence and Autonomy of Social Robots. Robotics. 2023, 12(2): 48. doi: 10.3390/robotics12020048
2. Perez-Grau FJ, Ragel R, Caballero F, et al. Semi-autonomous teleoperation of UAVs in search and rescue scenarios. 2017 International Conference on Unmanned Aircraft Systems (ICUAS). Published online June 2017. doi: 10.1109/icuas.2017.7991349
3. Zhang D, Yang G, Khurshid RP. Haptic Teleoperation of UAVs Through Control Barrier Functions. IEEE Transactions on Haptics. 2020, 13(1): 109-115. doi: 10.1109/toh.2020.2966485
4. Courtois H, Aouf N, Ahiska K, et al. OAST: Obstacle Avoidance System for Teleoperation of UAVs. IEEE Transactions on Human-Machine Systems. 2022, 52(2): 157-168. doi: 10.1109/thms.2022.3142107
5. González C, Solanes JE, Muñoz A, et al. Advanced teleoperation and control system for industrial robots based on augmented virtuality and haptic feedback. Journal of Manufacturing Systems. 2021, 59: 283-298. doi: 10.1016/j.jmsy.2021.02.013
6. Solanes JE, Muñoz A, Gracia L, et al. Teleoperation of industrial robot manipulators based on augmented reality. The International Journal of Advanced Manufacturing Technology. 2020, 111(3-4): 1077-1097. doi: 10.1007/s00170-020-05997-1
7. Toquica JS, Benavides D, Motta JMST. Web Compliant Open Architecture For Teleoperation of Industrial Robots. 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE). Published online August 2019. doi: 10.1109/coase.2019.8842847
8. Cao HL, Van de Perre G, Kennedy J, et al. A personalized and platform-independent behavior control system for social robots in therapy: development and applications. IEEE Transactions on Cognitive and Developmental Systems. 2018, 11(3): 334-346.
9. Alotaibi M, Alnajjar F, Cappuccio M, et al. Efficacy of Emerging Technologies to Manage Childhood Obesity. Diabetes, Metabolic Syndrome and Obesity: Targets and Therapy. 2022, Volume 15: 1227-1244. doi: 10.2147/dmso.s357176
10. Salichs MA, Castro-González Á, Salichs E, et al. Mini: A New Social Robot for the Elderly. International Journal of Social Robotics. 2020, 12(6): 1231-1249. doi: 10.1007/s12369-020-00687-0
11. Khaksar SMS, Khosla R, Chu MT, et al. Service Innovation Using Social Robot to Reduce Social Vulnerability among Older People in Residential Care Facilities. Technological Forecasting and Social Change. 2016, 113: 438-453. doi: 10.1016/j.techfore.2016.07.009
12. Clark HH, Fischer K. On depicting social agents. Behavioral and Brain Sciences. 2023, 46. doi: 10.1017/s0140525x22002825
13. Alhmiedat T, Marei AM, Messoudi W, et al. A SLAM-Based Localization and Navigation System for Social Robots: The Pepper Robot Case. Machines. 2023, 11(2): 158. doi: 10.3390/machines11020158
14. Alhmiedat T, Alotaibi M. Employing Social Robots for Managing Diabetes Among Children: SARA. Wireless Personal Communications. 2023, 130(1): 449-468. doi: 10.1007/s11277-023-10293-8
15. Alhmiedat T, Alotaibi M. Design and Evaluation of a Personal Robot Playing a Self-Management for Children with Obesity. Electronics. 2022, 11(23): 4000. doi: 10.3390/electronics11234000
16. Opiyo S, Zhou J, Mwangi E, et al. A Review on Teleoperation of Mobile Ground Robots: Architecture and Situation Awareness. International Journal of Control, Automation and Systems. 2020, 19(3): 1384-1407. doi: 10.1007/s12555-019-0999-z
17. Moniruzzaman M, Rassau A, Chai D, et al. Teleoperation methods and enhancement techniques for mobile robots: A comprehensive survey. Robotics and Autonomous Systems. 2022, 150: 103973. doi: 10.1016/j.robot.2021.103973
18. Wu S, Chen Y. Remote robot control using intelligent hand-held devices. In: Proceedings of The Fourth International Conference on Computer and Information Technology, 2004. CIT '04; 16 September 2004; Wuhan, China. pp. 587-592.
19. Cho YC, Jeon JW. Remote robot control system based on DTMF of mobile phone. In: Proceedings of the 2008 6th IEEE International Conference on Industrial Informatics; 13-16 July 2008; Daejeon, Korea (South). pp. 1441-1446.
20. Ju D ying, Zhong R, Takahashi M. Development of Remote Control and Monitor System for Autonomous Mobile Robot Based on Virtural Cell Phone. Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007). Published online September 2007. doi: 10.1109/icicic.2007.264
21. Do HM, Mouser CJ, Gu Y, et al. An open platform telepresence robot with natural human interface. 2013 IEEE International Conference on Cyber Technology in Automation, Control and Intelligent Systems. Published online May 2013. doi: 10.1109/cyber.2013.6705424
22. Chenxi Z, ZhongHua M, Changxin H, et al. Remote Monitoring System of four-wheel Drive Robot based on Web and Cloud Platform. 2019 IEEE 4th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC). Published online December 2019. doi: 10.1109/iaeac47372.2019.8997696
23. Manzi A, Fiorini L, Limosani R, et al. Use Case Evaluation of a Cloud Robotics Teleoperation System (Short Paper). 2016 5th IEEE International Conference on Cloud Networking (Cloudnet). Published online October 2016. doi: 10.1109/cloudnet.2016.49
24. Kaarlela T, Arnarson H, Pitkäaho T, et al. Common Educational Teleoperation Platform for Robotics Utilizing Digital Twins. Machines. 2022, 10(7): 577. doi: 10.3390/machines10070577
25. Elbeleidy S, Rosen D, Liu D, et al. Analyzing Teleoperation Interface Usage of Robots in Therapy for Children with Autism. Interaction Design and Children. Published online June 24, 2021. doi: 10.1145/3459990.3460715
26. Glas DF, Kanda T, Ishiguro H, et al. Teleoperation of Multiple Social Robots. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans. 2012, 42(3): 530-544. doi: 10.1109/tsmca.2011.2164243
27. Song S, Baba J, Nakanishi J, et al. Teleoperated Robot Sells Toothbrush in a Shopping Mall: A Field Study. Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. Published online May 8, 2021. doi: 10.1145/3411763.3451754
28. Barbecho-Jimbo E, Vallejo-Ramírez D, Cobos-Torres JC, et al. Remote Operation of CeCi Social Robot. Robotics. 2023, 12(1): 19. doi: 10.3390/robotics12010019
29. Ma Y, Zhang Y, Wan J, et al. Robot and cloud-assisted multi-modal healthcare system. Cluster Computing. 2015, 18(3): 1295-1306. doi: 10.1007/s10586-015-0453-9
30. Ma Y, Xiao D, Li R, et al. Android-based intelligent mobile robot for indoor healthcare. 2015 17th International Conference on E-health Networking, Application & Services (HealthCom). Published online October 2015. doi: 10.1109/healthcom.2015.7454548
31. Zhou B, Chou W, Wu S. Remote control system of mobile robot based on cloud platform. 2017 2nd International Conference on Robotics and Automation Engineering (ICRAE). Published online December 2017. doi: 10.1109/icrae.2017.8291360
32. Laniel S, Letourneau D, Labbe M, et al. Enhancing a beam+ telepresence robot for remote home care applications. 2017 International Conference on Virtual Rehabilitation (ICVR). Published online June 2017. doi: 10.1109/icvr.2017.8007479
33. Sun D, Kiselev A, Liao Q, et al. A New Mixed-Reality-Based Teleoperation System for Telepresence and Maneuverability Enhancement. IEEE Transactions on Human-Machine Systems. 2020, 50(1): 55-67. doi: 10.1109/thms.2019.2960676
34. Li S, Jiang J, Ruppel P, et al. A Mobile Robot Hand-Arm Teleoperation System by Vision and IMU. 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Published online October 24, 2020. doi: 10.1109/iros45743.2020.9340738
35. Walker ME, Hedayati H, Szafir D. Robot Teleoperation with Augmented Reality Virtual Surrogates. 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). Published online March 2019. doi: 10.1109/hri.2019.8673306
36. Liang C, Liu C, Liu X, et al. Robot Teleoperation System Based on Mixed Reality. 2019 IEEE 4th International Conference on Advanced Robotics and Mechatronics (ICARM). Published online July 2019. doi: 10.1109/icarm.2019.8834302
37. Bodala IP, Churamani N, Gunes H. Teleoperated Robot Coaching for Mindfulness Training: A Longitudinal Study. 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN). Published online August 8, 2021. doi: 10.1109/ro-man50785.2021.9515371
38. Sukmana Y, Rosmansyah Y. The Use of Cloud Firestore for Handling Real-time Data Updates: An Empirical Study of Gamified Online Quiz. 2021 2nd International Conference on Electronics, Communications and Information Technology (CECIT). Published online December 2021. doi: 10.1109/cecit53797.2021.00220
39. Uğur NG, Turan AH. Mobile Applications Acceptance. International Journal of E-Adoption. 2019, 11(2): 13-30. doi: 10.4018/ijea.2019070102
40. Jankowski J, Grabowski A. Usability Evaluation of VR Interface for Mobile Robot Teleoperation. International Journal of Human-Computer Interaction. 2015, 31(12): 882-889. doi: 10.1080/10447318.2015.1039909
41. Elbeleidy S, Mott T, Liu D, et al. Practical Considerations for Deploying Robot Teleoperation in Therapy and Telehealth. 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). Published online August 29, 2022. doi: 10.1109/ro-man53752.2022.9900526
42. Westlund JMK, Breazeal C. Transparency, teleoperation, and children’s understanding of social robots. 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI). Published online March 2016. doi: 10.1109/hri.2016.7451888
DOI: https://doi.org/10.32629/jai.v7i4.1216
Refbacks
- There are currently no refbacks.
Copyright (c) 2024 Tareq Alhmiedat
License URL: https://creativecommons.org/licenses/by-nc/4.0/