Reading the motor intention from brain activity within 100ms
Tokyo Institute of Technology
Researchers have developed a new technique to decode motor intention of humans from electroencephalography. This technique is motivated by the well documented ability of the brain to predict sensory outcomes of self-generated and imagined actions utilizing so called forward models. The method enabled, for the first time, nearly 90 percent single trial decoding accuracy across tested subjects, within 96 ms of the stimulation, with zero user training, and with no additional cognitive load on the users.
A collaborative study by researchers at Tokyo Institute of Technology has developed a new technique to decode motor intention of humans from Electroencephalography (EEG). This technique is motivated by the well documented ability of the brain to predict sensory outcomes of self-generated and imagined actions utilizing so called forward models. The method enabled for the first time, nearly 90% single trial decoding accuracy across tested subjects, within 96 ms of the stimulation, with zero user training, and with no additional cognitive load on the users.
The ultimate dream of brain computer interface (BCI) research is to develop an efficient connection between machines and the human brain, such that the machines may be used at will. For example, enabling an amputee to use a robot arm attached to him, just by thinking of it, as if it was his own arm. A big challenge for such a task is the deciphering of a human user's movement intention from his brain activity, while minimizing the user effort. While a plethora of methods have been suggested for this in the last two decades (1-2), they all require large effort in part of the human user- they either require extensive user training, work well with only a section of the users, or need to use a conspicuous stimulus, inducing additional attentional and cognitive loads on the users. In this study, Researchers from Tokyo Institute of Technology (Tokyo Tech), Le Centre national de la recherche scientifique (CNRS-France), AIST and Osaka University propose a new movement intention decoding philosophy and technique that overcomes all these issues while providing equally much better decoding performance.
The fundamental difference between the previous methods and what they propose is in what is decoded. All the previous methods decode what movement a user intends/imagines, either directly (as in the so called active BCI systems) or indirectly, by decoding what he is attending to (like the reactive BCI systems). Here the researchers propose to use a subliminal sensory stimulator with the Electroencephalography (EEG), and decode, not what movement a user intends/imagines, but to decode whether the movement he intends matches (or not) the sensory feedback sent to the user using the stimulator. Their proposal is motivated by the multitude of studies on so called Forward models in the brain; the neural circuitry implicated in predicting sensory outcomes of self-generated movements (3). The sensory prediction errors, between the forward model predictions and the actual sensory signals, are known to be fundamental for our sensory-motor abilities- for haptic perception (4), motor control (5), motor learning (6), and even inter-personal interactions (7-8) and the cognition of self (9). The researchers therefore hypothesized the predictions errors to have a large signature in EEG, and perturbing the prediction errors (using an external sensory stimulator) to be a promising way to decode movement intentions.
This proposal was tested in a binary simulated wheelchair task, in which users thought of turning their wheelchair either left or right. The researchers stimulated the user's vestibular system (as this is the dominant sensory feedback during turning), towards either the left or right direction, subliminally using a galvanic vestibular stimulator. They then decode for the presence of prediction errors (ie. whether or stimulation direction matches the direction the user imagines, or not) and consequently, as the direction of stimulation is known, the direction the user imagines. This procedure provides excellent single trial decoding accuracy (87.2% median) in all tested subjects, and within 96 ms of stimulation. These results were obtained with zero user training and with no additional cognitive load on the users, as the stimulation was subliminal.
This proposal promises to radically change how movement intention is decoded, due to several reasons. Primarily, because the method promises better decoding accuracies with no user training and without inducing additional cognitive loads on the users. Furthermore, the fact that the decoding can be done in less than 100 ms of the stimulation highlights its use for real-time decoding. Finally, this method is distinct from other methods utilizing ERP, ERD and ERN, showing that it can be used in parallel to current methods to improve their accuracy.
- Gowrishankar Ganesh, Keigo Nakamura, Supat Saetia, Alejandra Mejia Tobar, Eiichi Yoshida, Hideyuki Ando, Natsue Yoshimura, Yasuharu Koike. Utilizing sensory prediction errors for movement intention decoding: A new methodology. Science Advances, 2018; 4 (5): eaaq0183 DOI: 10.1126/sciadv.aaq0183