banner

A novel human-to-robot interaction model based on transfer expert reinforcement learning with recurrent neural network

Mahendra Bhatu Gawali, Swapnali Sunil Gawali, Megharani Patil, Anand Khandare

Abstract


The control tasks related to interaction tracking are mainly limited in robot manipulators-based traditional applications. In this, the desired motivations are specified based on the trajectories and the desired positions. The robots are programmed by using the teach-and-playback method in such applications that are assumed to be more convenient. Moreover, the advancements in sensing and robotic methodologies fulfill the satisfactory requirements of more demanding tasks. Several instructions are provided for interacting robots with humans in order to perform a sequence of more difficult tasks. It does not require learning the motions, but it only requires learning the positions of the motions in such applications, and this position is learned by using the robot controller. The major aim of this research work is to develop a new Transfer Expert Reinforcement Learning (TERL) method to offer efficient interaction between humans and computers. In this developed model, Reinforcement Learning (RL) is utilized to observe the movement of the robotic arm. Then, robot movement is considered with the help of a deep learning approach named Recurrent Neural Network (RNN) along with inputs of kinematic movement. Finally, the proposed model achieves a superior rate than conventional approaches in human to human-to-robot interaction model.


Keywords


human to robot interaction model; skill transfer knowledge; transfer expert reinforcement learning; reinforcement learning; recurrent neural network

Full Text:

PDF

References


1. Deng Z, Guan H, Huang R, et al. Combining model-based Q-learning with structural knowledge transfer for robot skill learning. IEEE Transactions on Cognitive and Developmental Systems 2019; 11(1): 26–35. doi: 10.1109/TCDS.2017.2718938

2. Chen C, Wang Y, Gao ZT, et al. Intelligent learning model-based skill learning and strategy optimization in robot grinding and polishing. Science China Technological Sciences 2022; 65(9): 1957–1974. doi: 10.1007/s11431-022-2112-4

3. Kim J, Cauli N, Vicente P, et al. Cleaning tasks knowledge transfer between heterogeneous robots: A deep learning approach. Journal of Intelligent & Robotic Systems 2020; 98(1): 191–205. doi: 10.1007/s10846-019-01072-4

4. Camarillo-Abad HM, Sánchez JA, Starostenko O. An environment for motor skill transfer based on wearable haptic communication. Personal and Ubiquitous Computing 2021; 25(2): 411–435. doi: 10.1007/s00779-020-01425-z

5. Roveda L, Maskani J, Franceschi P, et al. Model-based reinforcement learning variable impedance control for human-robot collaboration. Journal of Intelligent & Robotic Systems 2020; 100(2): 417–433. doi: 10.1007/s10846-020-01183-3

6. Rozo L, Jiménez P, Torras C. A robot learning from demonstration framework to perform force-based manipulation tasks. Intelligent Service Robotics 2013; 6(1): 33–51. doi: 10.1007/s11370-012-0128-9

7. Kennedy J, Baxter P, Belpaeme T. Nonverbal immediacy as a characterisation of social behaviour for human-robot interaction. International Journal of Social Robotics 2017; 9(1): 109–128. doi: 10.1007/s12369-016-0378-3

8. Saha O, Dasgupta P, Woosley B. Real-time robot path planning from simple to complex obstacle patterns via transfer learning of options. Autonomous Robots 2019; 43(8): 2071–2093. doi: 10.1007/s10514-019-09852-5

9. Xia J, Huang D, Li Y, Qin N. Iterative learning of human partner’s desired trajectory for proactive human-robot collaboration. International Journal of Intelligent Robotics and Applications 2020; 4(2): 229–242. doi: 10.1007/s41315-020-00132-5

10. Martins GS, Santos L, Dias J. User-adaptive interaction in social robots: A survey focusing on non-physical interaction. International Journal of Social Robotics 2019; 11(1): 185–205. doi: 10.1007/s12369-018-0485-4

11. Matsas E, Vosniakos GC. Design of a virtual reality training system for human-robot collaboration in manufacturing tasks. International Journal on Interactive Design and Manufacturing 2017; 11(2): 139–153. doi: 10.1007/s12008-015-0259-2

12. Caccavale R, Saveriano M, Finzi A, Lee D. Kinesthetic teaching and attentional supervision of structured tasks in human-robot interaction. Autonomous Robots 2019; 43(5): 1291–1307. doi: 10.1007/s10514-018-9706-9

13. Lu Z, Wang N, Shi D. DMPs-based skill learning for redundant dual-arm robotic synchronized cooperative manipulation. Complex & Intelligent Systems 2022; 8(4): 2873–2882. doi: 10.1007/s40747-021-00429-3

14. Li Y, Qin F, Du S, et al. Vision-based imitation learning of needle reaching skill for robotic precision manipulation. Journal of Intelligent & Robotic Systems 2021; 101(1): 22. doi: 10.1007/s10846-020-01290-1

15. Nasr A, Bell S, McPhee J. Optimal design of active-passive shoulder exoskeletons: A computational modeling of human-robot interaction. Multibody System Dynamics 2023; 57(1): 73–106. doi: 10.1007/s11044-022-09855-8

16. Matsas E, Vosniakos GC. Design of a virtual reality training system for human-robot collaboration in manufacturing tasks. International Journal on Interactive Design and Manufacturing 2017; 11(2): 139–153. doi: 10.1007/s12008-015-0259-2

17. Caccavale R, Saveriano M, Finzi A, Lee D. Kinesthetic teaching and attentional supervision of structured tasks in human-robot interaction. Autonomous Robots 2019; 43(5): 1291–1307. doi: 10.1007/s10514-018-9706-9

18. Lu Z, Wang N, Shi D. DMPs-based skill learning for redundant dual-arm robotic synchronized cooperative manipulation. Complex & Intelligent Systems 2022; 8(4): 2873–2882. doi: 10.1007/s40747-021-00429-3

19. Gawali MB, Gawali SS. Development of improved coyote optimization with deep neural network for intelligent skill knowledge transfer for human to robot interaction. International Journal of Intelligent Robotics and Applications 2022; 6(2): 288–305. doi: 10.1007/s41315-022-00236-0

20. Nasr A, Bell S, McPhee J. Optimal design of active-passive shoulder exoskeletons: A computational modeling of human-robot interaction. Multibody System Dynamics 2023; 57(1): 73–106. doi: 10.1007/s11044-022-09855-8

21. Zhang T, Zeng Y, Pan R, et al. Brain-inspired active learning architecture for procedural knowledge understanding based on human-robot interaction. Cognitive Computation 2021; 13(2): 381–393. doi: 10.1007/s12559-020-09753-1

22. Gawali MB, Gawali SS. Optimized skill knowledge transfer model using hybrid chicken swarm plus deer hunting optimization for human to robot interaction. Knowledge-Based Systems 2021; 220: 106945. doi: 10.1016/j.knosys.2021.106945




DOI: https://doi.org/10.32629/jai.v7i2.1011

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Mahendra Bhatu Gawali, Swapnali Sunil Gawali, Megharani Patil, Anand Khandare

License URL: https://creativecommons.org/licenses/by-nc/4.0/