Exploiting multiple sensory modalities in brain-machine interfaces

Neural Netw. 2009 Nov;22(9):1224-34. doi: 10.1016/j.neunet.2009.05.006. Epub 2009 May 22.

Abstract

Recent improvements in cortically-controlled brain-machine interfaces (BMIs) have raised hopes that such technologies may improve the quality of life of severely motor-disabled patients. However, current generation BMIs do not perform up to their potential due to the neglect of the full range of sensory feedback in their strategies for training and control. Here we confirm that neurons in the primary motor cortex (MI) encode sensory information and demonstrate a significant heterogeneity in their responses with respect to the type of sensory modality available to the subject about a reaching task. We further show using mutual information and directional tuning analyses that the presence of multi-sensory feedback (i.e. vision and proprioception) during replay of movements evokes neural responses in MI that are almost indistinguishable from those responses measured during overt movement. Finally, we suggest how these playback-evoked responses may be used to improve BMI performance.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Action Potentials
  • Animals
  • Biomechanical Phenomena
  • Brain / physiology
  • Electrodes, Implanted
  • Evoked Potentials
  • Feedback, Physiological / physiology
  • Information Theory
  • Macaca mulatta
  • Male
  • Microelectrodes
  • Motor Activity / physiology*
  • Motor Cortex / physiology*
  • Neurons / physiology*
  • Proprioception / physiology*
  • Time Factors
  • User-Computer Interface*
  • Visual Perception / physiology*