iOS + Neuroscience

Brain-iPhone interfaces

Imagine

• Cocoa• Cocoa Touch• Cocoa Thought

Biology

Connectome

Open Worm Project

Neurointerfaces

Backyard Brain

Roboroach video

Transcranial direct current stimulation

Foc.Us• Enhance language and mathematical

ability, attention span, problem solving, memory, and coordination.

• accepted maximum 2 mA, usually 1 mA or less

• stimulation time - 20 minutes

• 10 minutes - effects lasting for up to an hour.

• 48 hours to a week before repeating the stimulation.

• Studies indicates SAFETY in a SINGLE session.

• No studies about long-term safety of repeated sessions of stimulation.

Foc.Us API- (void)peripheralDidWriteChracteristic:(CBCharacteristic *)characteristic

withPeripheral:(CBPeripheral *)peripheral

withError:(NSError *)error;

- (void)peripheralDidReadChracteristic:(CBCharacteristic *)characteristic

withPeripheral:(CBPeripheral *)peripheral

withError:(NSError *)error;

- (void)hardwareDidNotifyBehaviourOnCharacteristic:(CBCharacteristic *)characteristic

withPeripheral:(CBPeripheral *)peripheral

error:(NSError *)error;

http://www.foc.us/bluetoothhttps://github.com/FocusBluetooth/focus-bluetooth-ios/blob/master/CBDemo/ViewController.m

Foc.Us

Electroencephalography

δ <4 Gzslow-wave sleep,

some continuous-attention tasks

θ 4-7 Gz drowsiness,idling,

inhibition of elicited responses

α 7-14 Gz relaxed/reflecting,closing the eyes

β 15-30 Gz active thinking, focus, hi alert, anxious

γ 30-100 Gz cross-modal sensory processing,short-term memory matching of

recognized objects, sounds, or tactile sensations

μ 8-13 GzShows rest-state motor neurons,

mirror neurons activity(?)

σ 10-16 Gz Stage N2 sleep (consciousness shutdown)

MindWave Mobile by NeuroSky2 mind states:

- Attention (0 – 100).

- Meditation (0 – 100).

• Blinking and it’s “power”.- Contact with skin.- Signal quality.

1 electrode

$99.95

API- (void)dataReceived:(NSDictionary *)data {

if([data valueForKey:@"blinkStrength"])

if([data valueForKey:@"raw"]) {

if([data valueForKey:@"heartRate"])

if([data valueForKey:@"poorSignal"]) {

if([data valueForKey:@"respiration"]) {

if([data valueForKey:@"heartRateAverage"]) {

if([data valueForKey:@"heartRateAcceleration"]) {

if([data valueForKey:@"rawCount"]) {

if([data valueForKey:@"eSenseAttention"]){

eSenseValues.attention = [[data valueForKey:@"eSenseAttention"] intValue];

eSenseValues.meditation = [[data valueForKey:@"eSenseMeditation"] intValue];

eegValues.delta = [[data valueForKey:@"eegDelta"] intValue];

eegValues.theta = [[data valueForKey:@"eegTheta"] intValue];

eegValues.lowAlpha = [[data valueForKey:@"eegLowAlpha"] intValue];

eegValues.highAlpha = [[data valueForKey:@"eegHighAlpha"] intValue];

eegValues.lowBeta = [[data valueForKey:@"eegLowBeta"] intValue];

eegValues.highBeta = [[data valueForKey:@"eegHighBeta"] intValue];

eegValues.lowGamma = [[data valueForKey:@"eegLowGamma"] intValue];

eegValues.highGamma = [[data valueForKey:@"eegHighGamma"] intValue];

Reverse-engineering

Tools:• lipo• otool• Hopper Disassembler• MachOView

Results:• Spline interpolation• Spectral density

estimation • Fast Fourier transform• …

Applications

https://github.com/orbotix/Sphero-iOS-SDK

https://github.com/MariaStoica/MindSphero

+

BrainOSC

Converts data from ThinkGear's MindWave to OSC data

AdFenceMood and proximity based advertising using the

MindWave headset by NeuroSky and the Qualcomm Gimbal Proximity chip.

Melon

3 electrodes on the forehead.

Detects focus and meditation.

Detects sleep phases.$149.Uses NeuroSky’s chip.SDK will be available in

summer.

Muse by InteraXon

Muse

6 dry sensors$ 299Sleep, calmness,

attention.Has an iOS app.Native library will be

available “soon”. Right now: console,

sockets, protobuf.

Emotive EPOC

Emotive Insight

iOS SDK will be in summer.C++, really ?$ 229

APIstruct emokit_contact_quality {//values > 4000 are good

short F3, FC6, P7, T8, F7, F8, T7, P8, AF4, F4, AF3, O2, O1, FC5;

};

struct emokit_frame {

unsigned char counter; //loops from 0 to 128 (129 values)

int F3, FC6, P7, T8, F7, F8, T7, P8, AF4, F4, AF3, O2, O1, FC5; //raw data values

struct emokit_contact_quality cq;

char gyroX, gyroY;

unsigned char battery; //percentage of full charge, read on counter=128

};

API

Insight video

Emotive Insight

https://sites.google.com/a/emotiv.com/wiki/documentation

Additional Resources

http://www.openbci.com/ - opensource BCIhttp://personalneuro.com/about.htm - neuro

apps developmenthttp://neurogadget.com/ - bloghttp://www.neurogamingconf.com/ -

conference 2014http://en.wikipedia.org/wiki/Brain

%E2%80%93computer_interfacehttp://neuroscience.uth.tmc.edu/toc.htm

Additional Resources

http://wsyachina.narod.ru/biology/brain_17.html

http://wsyachina.narod.ru/medicine/drug_dependence.html

https://eyewire.org/signup

Thanks for your [[data valueForKey:@"eSenseAttention"]

intValue]