PROPOSAL FOR THE DEVELOPMENT OF

A MULTI MEDIA NEURO FEEDBACK SYSTEMFOR USE IN THERAPEUTIC ENVIRONMENTS

©THE MIND CONNECTION 2012

INTRODUCTION NEURO FEEDBACK THERAPY

• Based on the registration and feedback of brainwave signals. • Measured with a user friendly wireless 14 channel headset.

• Software analyzes the brainwaves and transforms them to sounds and visions.

• As an induction the sound and vision feedback influences the senses of the client.

• This multi media induction is composed to direct the attention of the client to a desired state.

The neuro feedback loop is closed and the client is training his attention to cure his condition.

HARDWARE connected to The Mind Connection software solutions (avaliable July 2012)

Specifications of the Neurosky Mindwave headsetWeight: 90g Sensor arm up: height: 225mm x width:155mm x depth: 92mm Sensor Arm down: height: 225mm x width:155mm x depth:165mmRate power: 30mW (max. 50mW)RF frequency: 2.420 - 2.471GHz RF max. power 6dBmRF data range: 250kbit/s RF range: 10m Packet loss of bytes via wireless: 5%UART Baudrate: 57,600 Baud Max. signal input range: 1mV pk-pk EEG Hardware filter range: 3Hz – 100Hz Resolution: 12 bits ADC Sampling rate: 512HzeSense calculation rate: 1 Hz

HARDWARE possible of getting connected to The Mind Connection software solutions

Specifications of the Holst Centre Research Project Headset include:

• Low-power (1 mW) multi-purpose sensor node • Wireless, low-power ECG patch • Body heat-powered EEG and pulse oximeter system • 2-, 6-, and 25-channel ExG systems • Wearable EMG belt • Wireless emotion monitoring system • BAN for sleep monitoring

HARDWARE

Number of channels 14 (plus CMS/DRL references, P3/P4 locations)Channel names (International 10-20 locations) AF3, F7, F3, FC5, T7, P7, O1, O2, P8, T8, FC6, ,F4, F8, AF4Sampling method Sequential sampling. Single ADCSampling rate 128 SPS (2048 Hz internal)Resolution 16 bits (14 bits effective) 1 LSB = 1.95μVBandwidth 0.2 - 45Hz, digital notch filters at 50Hz and 60HzFiltering Built in digital 5th order Sinc filterDynamic range (input referred) 256mVppCoupling mode AC coupledConnectivity Proprietary wireless, 2.4GHz bandPower LiPolyBattery life (typical) 12 hours

Specifications of the Emotiv Epoc headset

PRODUCT DESCRIPTION based on Emotiv Emoc

• The base of the software is a network that transforms the input of the brainwave signals of the headset into control signals for a multi channel sound engine and a real-time 3d-graphics engine.

• The measured brainwave signals are stored for statistic reproduction

• Neuro feedback training protocols can be created trough a separate therapy editor.

• The software can be encrypted to avoid software pirating

Network

SOFTWARE

SoundPlayer

3DEngineUser Interface

Edit ProtocolDEVELOPER

THERAPIST

Online Portal/

Data Storage

Protocol

Emotiv Headset

SOUND FEEDBACK

• A number of selectable sound channels can be linked to the selected training protocol.

• State Sound compositions can be created, saved, loaded and played trough the Project menu. For example the Gaia State Sound composition is made to induce a spectrum of nature sounds.

• There are 8 stereo sound channels available. Every channel has 4 brainwave controllable sound effects:Filter – Reverb – Flanger – Echo.

Screenshot of our actual State Sound application

SOUND FEEDBACK

The Mute buttons can be switched on and off to select one or more sound channels for feedback.

• Channel 0 responds to delta waves (campfire sounds)• Channel 1 responds to theta waves (wind sounds)• Channel 2 responds to alfa waves (water sounds)• Channel 3 responds to beta waves (cricket sounds)• Channel 4 responds to the train signal (bird sounds)• Channel 5 responds to the train signal (bell sounds)• Channel 6 produces a slow breathing sound.• Channel 7 produces an instruction voice.

3D GRAPHICS

Overview of the visual neurofeedback control parameters. Camera : Brainwave controlled multi directional camera animations.

Colors : Brainwave controlled red, green and blue mixer.

Shapes : Brainwave controlled décor and object animations.

Particles : Brainwave controlled particle system animations.

3D GRAPHICS• Screenshot of a 3D graphics scene from our actual State Vision

application

• A number of different scenes will be implemented in the final version of the software

USER INTERFACE

• Screen shot of the 3D graphics menu from our actual State Vision application

THE MIND CONNECTION

SOUND AND VISION NEUROFEEDBACK THERAPY

OPTIONS TO IMPLEMENT IN THE USER INTERFACE

• Protocol selection• Difficulty level setting• Sensor contact test• Start/Stop + Save/Load brainwave files

Example Sensor contact verification on User interface level

The Yellow dot indicates a poor signal connection The Red dot indicates a bad signal connection.

ANALYZE AFTER THERAPY SESSION

• Graphs

• Tables

• Text

• Database

• Compare with previous sessions

• User Data – client based personal data store

THERAPY DEVELOPER INTERFACE

• Dual screen setup possibility• Selectable 3D-scenes • Selectable audio channels• Select what to control in the 3d-scenes and in the audio feedback

Example windows from our State Monitor application

Creation of a number of protocols

Creation of control parameters:• Per sensor one or more frequency bands• Per frequency band: min freq, max freq, min level, max level,

optimal level, or dynamics (change size + -)• Per sensor artefact detection and repression

(muscle tension, eye movements, eye blinks)• Protocol decoding• Protocols for statistics feedback

DEVELOPER INTERFACE

Therapist Patient

Online portal

Advantages central data storage:

• Data analysis• Datamining• Statistics• Direct communication

patient <-> therapist• No fixed measure location

(measure at home)

DB

Network

SOFTWARE

SoundPlayer

3DEngineUser Interface

Edit ProtocolDEVELOPER

THERAPIST

Online Portal/Data

StorageProtocol

Emotiv Headset

THE MIND CONNECTION MULTIMEDIA PLATFORM

Processor

Bio signal input

Audio input

Manual input

3D Engine

Sound Engine

Plugins

Video input