电子科技大学：《神经信息学基础 The Basis of Neuroinformatics》研究生课程教学资源（课件讲稿）第6章 脑机接口 Brain-Computer Interfaces - BCI（6.4）Challenges & Future

目录 /966 ■ Several cases Microwire arrays Motor cortex General description Neurochip Injury site. where natural commands die How does BCI work? Muscle control chip What signals can be Wheelchair control used in BCI Challenges Future Backpack computer Nicolelis,2001 2

2  Several cases  General description  How does BCI work?  What signals can be used in BCI ?  Challenges & Future 目 录

Challenges /96 Noise interference Internal and external noises (noisy environment) Inter-/intra-subject variation Asynchronous operation Limited number of coded tasks. 3

3 Challenges  Noise interference Internal and external noises (noisy environment)  Inter-/intra-subject variation  Asynchronous operation  Limited number of coded tasks

不同的接口类型所获得的信号强度有很大差异 /986 Brain-penetrating microelectrodes LFP <1mV <200Hz Brain-surface electrodes SPIKES 5-500μV 0.1-7kHz EEG sensor 州 5-300μV EEG <100Hz ECoG 0.01-5mV <200Hz 4

4 不同的接口类型所获得的信号强度有很大差异

Challenge for asynchronous operation /966 MI PMd 96 Channels sample Rest Reach Hold Release Withdraw Grasp Rest (Visual cue) Event Light ON Light OFF Water Reward 手柄 平板 圆柱 圆环 (Y.Hao,et al,2012,CSB,Y.Hao,et al,2014,JNE 5 (浙江大学陈卫东提供)

5 M1 PMd 96 Channels sample Rest Reach Grasp Hold Release Withdraw Rest Event Light ON Light OFF Water Reward (Visual cue) (Y. Hao, et al, 2012, CSB, Y. Hao, et al, 2014, JNE ) （浙江大学陈卫东提供） Challenge for asynchronous operation

Challenge for SSVEP based BCI /966 4cm 3cm WATCH YO 8 2 3 回 The number of available stimulus frequencies is very limited !! 6

6 Challenge for SSVEP based BCI The number of available stimulus frequencies is very limited !!!

Multiple Frequencies Sequential Coding /986 Coding scheme for one target Epoch M Epoch 11..... One Coding Cycle N frequencies:NM targets Time-Frequency coding... Coding time for frequency T; Zhang,Xu et al.,Plos One,2012 7

7 Multiple Frequencies Sequential Coding N frequencies: NM targets Time-Frequency coding… Coding time for frequency Ti Coding scheme for one target Zhang, Xu et al., Plos One, 2012

Future /96 199 2000200220032004 2015 2008 2012 2006 rat monkey 人 Fom简单的运动T0闭环控制，人工反馈和认知控制 (浙江大学陈卫东提供) 8

8 rat monkey 1999 2000 2004 2012 2008 2006 2003 2015 2002 人 From 简单的运动 To 闭环控制，人工反馈和认知控制 Future （浙江大学陈卫东提供）

Future /956 Unimodal to multimodal Simultaneous monitoring of brain activity using several devices combining BCI with multimodal HCIs From unidirectional to bidirectional BCl From lab to factory From laboratory tests to practical trials in the noisy real world environment. Nursing and medical treatment 9

9 Future  Unimodal to multimodal Simultaneous monitoring of brain activity using several devices combining BCI with multimodal HCIs  From unidirectional to bidirectional BCI  From lab to factory From laboratory tests to practical trials in the noisy real world environment.  Nursing and medical treatment

Artificial feedback through intracortical /96 microstimulation (ICMS) a b Movement decoding Active Brain exploration task control Hand 10 mm control Upper arm Artificial igits tactile S1 encoding 5 mm d UAT RAT J.E.O'Doherty,M.a.Lebedev,P.J.Ifft,et al.,"Active tactile exploration using a brain- machine-brain interface,"Nature,vol.479,no.7372,pp.228-231,2011. 10

10 Artificial feedback through intracortical microstimulation (ICMS) J. E. O’Doherty, M. a. Lebedev, P. J. Ifft, et al., “Active tactile exploration using a brain– machine–brain interface,” Nature, vol. 479, no. 7372, pp. 228–231, 2011

Wireless BCIs-E.g.mobile BCI /96 Signal Processing Signal Digitized Feature Extraction Translation Acquisition Signal EEG Signals PC/Laptop Bluetooth 关Sy Wireless PDA A wearable Brain-Computer Interface,Master Thesis,Payam Aghaeipour,Nov 08. 11

11 Wireless BCIs—E.g. mobile BCI A wearable Brain-Computer Interface, Master Thesis, Payam Aghaeipour, Nov 08