brain-computer interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...non-invasive bcis...

23
Brain-Computer Interface 第三組 曾文昇 林紹軒 林書帆

Upload: others

Post on 07-Aug-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Brain-Computer Interface

第三組 曾文昇 林紹軒 林書帆

Page 2: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

After midterm ...

Stay in bed?

or

See our TA?

Page 3: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI
Page 4: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

In surrogateYou  can  control  your  surrogate  with  your  brain

Live  your  life  without  limita7on

You  see  what  they  see

You  feel  what  they  feel

Become  anyone  your  want  to  be

That’s  how  BCI  so  powerful!

Page 5: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

What is BCI ?

Brain–computer  interface

O@en  called  a  mind-­‐machine  interface  (MMI)  

A  direct  communica7on  pathway  between  the  brain  and  an  external  device

Page 6: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Architecture

Signal  Acquisi7on

Signal  Processing

Devices

Page 7: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Methods

Invasive  BCIs

Par7ally  invasive  BCIs    

Non-­‐invasive  BCIs

Page 8: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Invasive BCIs

Invasive  BCIs  are  implanted  directly  into  the  grey  maLer  of  the  brain  during  neurosurgery

Produce  the  highest  quality  signals  of  BCI  devices  but  are  prone  to  scar-­‐7ssue  build-­‐up

Page 9: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Partially Invasive BCIs

Implanted  inside  the  skull  but  rest  outside  the  brain  rather  than  within  the  grey  maLer

BeLer  resolu7on  signals  than  non-­‐invasive  BCIs  

Lower  risk  of  forming  scar-­‐7ssue  in  the  brain  than  fully  invasive  BCIs

Page 10: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Non-invasive BCIslower  resolu7on  signals

No  scar-­‐7ssue  problem

Electroencephalography(EEG)

Magnetoencephalography(MEG)  

Func7onal  magne7c  resonance  imaging(fMRI)

Page 11: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Research in BCI

Page 12: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Motion Control of Robot

Feedback  of  mind  control

Posi7on,  Speed,  accelera7on

Intelligent  processing

Environmental  Informa7on

Page 13: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Cognitive Research

So@  plaTorm

Facial  expressions

Head  mo7on

Page 14: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Intelligent Vehicle of Disability

Informa7on  fusion  technology

BCI

Blinking  control

GPS

Laser  radarSpeed

Page 15: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Mind Control

Monkey  operates  a  robo7c  arm  with  BCI

Controlling  a  robo7c  dog  with  BCI

A  man  operates  the  computer  with  his  EEG

Telephone

Page 16: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Monkey Eats Banana

Page 17: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Brain Loop

Page 18: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

BCI On the Go!

Page 19: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

US$300

Wireless

Detects  conscious  thoughts,  expressions  and  non-­‐conscious  emo7ons  based  on  electrical  signals

Can  be  controlled  with  our  thoughts,  expressions  and  emo7ons

Use  the  unit’s  facial  recogni7on  sensors  to  mimic  a  game  player's  facial  expressions  in  an  animated  avatar

First Commercial Interface

Page 20: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Thought-Controlled Car

Acquires  bioelectric  signals  from  the  driver  via  16  EEG  sensors  on  the  EPOC  neuroheadset

Drivers    first  learn  to  move  a  cube  back  and  forth  on  a  computer  screen  by  altering  their  thought  paLerns

Allow  passengers  to  assist  autonomous  cars  when  the  vehicles  are  unsure  of  which  road  to  take  at  an  intersec7on

Page 21: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Wheelchair

Display  a  matrix  of  several  op7ons  that  include  ac7ons  or  direc7ons

User  concentrates  on  the  op7on  desired  to  trigger

Page 22: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Say Goodbye to Touchscreen

Already  released,US$100

XWave  app  that  includes  a  number  of  exercises  aimed  at  training  your  brain

Levita7ng  a  ball  on  the  iDevice’s  screen  

Changing  a  color  based  on  the  relaxa7on  level  of  your  brain  

Training  your  brain  to  maximize  its  aLen7on  span

Page 23: Brain-Computer Interfacecc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral...Non-invasive BCIs *"/.)$).,"*#7"'$,0-'&*, J"$,%&)K7,,#.$=)"2*.6 N*.%()".'%.=1&*"-)&=1+BNNOC. Research in BCI

Q & A