banner

Design of an affordable hybrid brain-computer interface to control robotic devices

Yih-Choung Yu, Haley Garrison, Brandon Smith, Ashley Goreshnik, Alexandria Battison, Lisa Gabel

Abstract


Brain-computer interfaces (BCIs) are devices that utilize neural activity as the foundation for an alternate method of communication or control of external devices. BCIs establish a connection between natural electrophysiological signals regularly occurring in the brain and desired computerized outputs. Instead of relying on natural neuromuscular outputs, BCIs produce artificial outputs, such as movements or navigation commands, capable of controlling robotic devices. The use of BCIs in robotic control holds significant promise for assisting individuals with motor disabilities in various applications, such as exploration, home assistance, or control of an electric wheelchair, thereby fostering greater independence in their daily activities. This paper presents the design of a hybrid BCI tailored for controlling a variety of robotic devices, including a quadcopter, wheeled robot, and wheelchair, by modifying the control scheme of the BCI. An inexpensive electroencephalogram (EEG) headset was employed to capture occipital alpha waves, frontal muscular artifacts, and gyroscope signals indicating head movements. These signals were wirelessly transmitted to a host computer, where signal processing algorithms were implemented to process the acquired signals and extract possible features to interpret the user’s intents as control commands to navigate robotic devices. The response speed and accuracy of the BCI design for robot navigation were recorded and analyzed to evaluate both the performance of the design and the effectiveness of user training. The results support the idea that this cost-effective BCI design can effectively control various robotic devices with minimal adjustments to the control scheme, thus reducing the need for major design changes and user training.


Keywords


hybrid BCI; asynchronous BCI; robot navigation; EEG signal processing

Full Text:

PDF

References


1. McFarland DJ, Wolpaw JR. Brain-computer interfaces for communication and control. Communications of the ACM. 2011; 54(5): 60-66. doi: 10.1145/1941487.1941506

2. Shih JJ, Krusienski DJ, Wolpaw JR. Brain-Computer Interfaces in Medicine. Mayo Clinic Proceedings. 2012; 87(3): 268-279. doi: 10.1016/j.mayocp.2011.12.008

3. Hehenberger L, Kobler RJ, Lopes-Dias C, et al. Long-Term Mutual Training for the CYBATHLON BCI Race with a Tetraplegic Pilot: A Case Study on Inter-Session Transfer and Intra-Session Adaptation. Frontiers in Human Neuroscience. 2021; 15. doi: 10.3389/fnhum.2021.635777

4. Xu B, Li W, Liu D, et al. Continuous Hybrid BCI Control for Robotic Arm Using Noninvasive Electroencephalogram, Computer Vision, and Eye Tracking. Mathematics. 2022; 10(4): 618. doi: 10.3390/math10040618

5. Bai X, Li M, Qi S, et al. A hybrid P300-SSVEP brain-computer interface speller with a frequency enhanced row and column paradigm. Frontiers in Neuroscience. 2023; 17. doi: 10.3389/fnins.2023.1133933

6. Robinson N, Mane R, Chouhan T, et al. Emerging trends in BCI-robotics for motor control and rehabilitation. Current Opinion in Biomedical Engineering. 2021; 20: 100354. doi: 10.1016/j.cobme.2021.100354

7. Li Z, Li B, Luo W, et al. Design and Implementation of P300 Brain-Controlled Wheelchair with a Developed Wireless DA Converter. International Journal of Computers & Technology. 2023; 23: 93-104. doi: 10.24297/ijct.v23i.9485

8. Sellers EW, Vaughan TM, Wolpaw JR. A brain-computer interface for long-term independent home use. Amyotrophic Lateral Sclerosis. 2010; 11(5): 449-455. doi: 10.3109/17482961003777470

9. Ai J, Meng J, Mai X, et al. BCI Control of a Robotic Arm Based on SSVEP With Moving Stimuli for Reach and Grasp Tasks. IEEE Journal of Biomedical and Health Informatics. 2023; 27(8): 3818-3829. doi: 10.1109/jbhi.2023.3277612

10. Yu YC, Garrison H, Battison A, et al. Control of a Quadcopter with Hybrid Brain-Computer Interface. 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC). Published online October 2019. doi: 10.1109/smc.2019.8914579

11. Chen W, Chen SK, Liu YH, et al. An Electric Wheelchair Manipulating System Using SSVEP-Based BCI System. Biosensors. 2022; 12(10): 772. doi: 10.3390/bios12100772

12. Yu Y, Liu Y, Jiang J, et al. An Asynchronous Control Paradigm Based on Sequential Motor Imagery and Its Application in Wheelchair Navigation. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2018; 26(12): 2367-2375. doi: 10.1109/tnsre.2018.2881215

13. Aljalal M, Djemal R, Ibrahim S. Robot Navigation Using a Brain Computer Interface Based on Motor Imagery. Journal of Medical and Biological Engineering. 2018; 39(4): 508-522. doi: 10.1007/s40846-018-0431-9

14. Yu YC, Smith B, Goreshnik A, et al. Design of an Affordable Brain-Computer Interface for Robot Navigation. 2019 14th IEEE Conference on Industrial Electronics and Applications (ICIEA). Published online June 2019. doi: 10.1109/iciea.2019.8833813

15. Corbit V, Gabel LA, Yu YC. Improving Mu Rhythm Brain-Computer Interface Performance by Providing Specific Instructions for Control. 2013 39th Annual Northeast Bioengineering Conference. Published online April 2013. doi: 10.1109/nebec.2013.166

16. Tran Y, Boord P, Middleton J, et al. Levels of brain wave activity (8–13 Hz) in persons with spinal cord injury. Spinal Cord. 2004; 42(2): 73-79. doi: 10.1038/sj.sc.3101543

17. Garrison H. Application of the Brain-Computer Interface to Robotics Control [Bachelor’s thesis]. Lafayette College; 2015.

18. Smith B. Design of a Wheelchair for Use with a Brain-Computer Interface [Bachelor’s thesis]. Lafayette College; 2017.

19. Goreshnik A. Accuracy and Reliability Study of Brain-Computer Interface Robot Navigation [Bachelor’s thesis]. Lafayette College; 2017.

20. 2010 ADA Standards for Accessible Design. Available online: https://www.ada.gov/law-and-regs/design-standards/2010-stds/ (accessed on 15 October 2016).




DOI: https://doi.org/10.32629/jai.v7i5.1578

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Yih-Choung Yu, Haley Garrison, Brandon Smith, Ashley Goreshnik, Alexandria Battison, Lisa Gabel

License URL: https://creativecommons.org/licenses/by-nc/4.0/