A LABAN/Sensor-based Assistive System for Improving Rehab

Exercises

A LABAN/Sensor-based Assistive System for Improving Rehab

Exercises

Francisco TorresFrancisco Torres

4/2/2008 1Fjtorres

Outline of the TalkOutline of the TalkIntroduction to the ProblemsRelated work (Gait Analysis Lab; Related literature; HMTR project)Challenging Issues

Rehab Exercise Specification WSN-based Rehab TrackingSecurity/Privacy in Tele-Rehab Systems

Current Research ResultsEnhance Laban for RehabSoftware Architecture for WSN-based Rehab Tracking

Questions and Answers

Introduction to the ProblemsRelated work (Gait Analysis Lab; Related literature; HMTR project)Challenging Issues

Rehab Exercise Specification WSN-based Rehab TrackingSecurity/Privacy in Tele-Rehab Systems

Current Research ResultsEnhance Laban for RehabSoftware Architecture for WSN-based Rehab Tracking

Questions and Answers4/2/2008 2Fjtorres

Problems with Current RehabProblems with Current RehabImprecise Natural Language

SpecificationSingle arm shoulder flexion: Stand with your injured arm hanging down at your side. Keeping your elbow straight, bring your arm forward and up toward the ceiling. Hold this position for 5 seconds. Do 3 sets of 10. As this exercise becomes easier, add a weight..

Vague illustrations.Expensive Gait Lab EquipmentNo Low-cost tracking system for

in-home care and clinic demo/diagnosis.

Imprecise Natural Language Specification

Single arm shoulder flexion: Stand with your injured arm hanging down at your side. Keeping your elbow straight, bring your arm forward and up toward the ceiling. Hold this position for 5 seconds. Do 3 sets of 10. As this exercise becomes easier, add a weight..

Vague illustrations.Expensive Gait Lab EquipmentNo Low-cost tracking system for

in-home care and clinic demo/diagnosis.

HMTR for Rehab 4/2/2008

fjtorres 3

Related WorkRelated Work

HMTR for Rehab 4/2/2008

fjtorres 4

3/14/2008 visit

Rehab Exercise Specification ProblemRehab Exercise Specification Problem: Muscle group – hips

• Start standing with equal weight distributed between right and left legs• Place feet shoulder width apart• Keep torso upright, avoid bending at the waist• Slowly lower yourself by bending at the ankles, knees and hips• Return to standing

: Muscle group – hips

• Start standing with equal weight distributed between right and left legs• Place feet shoulder width apart• Keep torso upright, avoid bending at the waist• Slowly lower yourself by bending at the ankles, knees and hips• Return to standing

4/2/2008 Fjtorres 5

Is there a problem?Is there a problem?

What did he say?Interpretation.

Am I doing right or not?How complete/accurate is my exercise?

What did he say?Interpretation.

Am I doing right or not?How complete/accurate is my exercise?

4/2/2008 6Fjtorres

What is the difference between…?What is the difference between…?

Vs.

4/2/2008 7Fjtorres

Idea!!Idea!!What if we can have a friend that does a right interpretation of the exercise, and that knows if my exercise is right of wrong?

What if we can have a friend that does a right interpretation of the exercise, and that knows if my exercise is right of wrong?

4/2/2008 8Fjtorres

Facing the problemFacing the problemWe need to have a way to represent movements with the same meaning for everybody.

We need to have a way to represent movements with the same meaning for everybody.

4/2/2008 9Fjtorres

Challenging Issues in Improving RehabChallenging Issues in Improving Rehab

We need to be able to track those movements and to compare them against a model.

We need to be able to track those movements and to compare them against a model.

4/2/2008 10Fjtorres

LABANotationLABANotationA two-dimensional graphic notational system for recording movement of the human body.Rudolf Laban originated it.It was first published on 1928.Its main application is the recording of ballet/modern dance, physical therapy, and drama.There are three essential forms of movement description in LABANotation: Motif, Effort-Shape and Structural.

A two-dimensional graphic notational system for recording movement of the human body.Rudolf Laban originated it.It was first published on 1928.Its main application is the recording of ballet/modern dance, physical therapy, and drama.There are three essential forms of movement description in LABANotation: Motif, Effort-Shape and Structural.

4/2/2008 11Fjtorres

What is a LABANotation Score?What is a LABANotation Score?

4/2/2008 12Fjtorres

Symbol in LABANotationSymbol in LABANotation

4/2/2008 13Fjtorres

Review of LabanBodySignReview of LabanBodySign

HMTR for Rehab4/2/2008

14FJ/Chow

Recording/Editing MovementsRecording/Editing Movements

Traditionally, a choreologist trained in the use of dance notation systems (such as LABANotation) translates symbolic representation of movement for dancers to interpret and perform.

Traditionally, a choreologist trained in the use of dance notation systems (such as LABANotation) translates symbolic representation of movement for dancers to interpret and perform.

4/2/2008 15Fjtorres

Edit and Animate MovementEdit and Animate MovementMap that notation into computer readable

information, so we can play/demo with it.Map that notation into computer readable information, so we can play/demo with it.

4/2/2008 16Fjtorres

Laban Writer (OhioState; Mac only)

LabanDancer (Dance Notation Bureau)

ApplicationApplication

Eyetoy: motion detection technology consisting of a video camera that plugs into a Playstation 2 console.

Eyetoy: motion detection technology consisting of a video camera that plugs into a Playstation 2 console.

4/2/2008 17Fjtorres

Motion TrackingMotion TrackingWhat is Motion Tracking? (Wikipedia)

Motion capture, motion tracking, or mocap is a technique of digitally recording movements for entertainment, sports, and medical applications.

Motion Tracking SystemsWireless Sensor Based Motion Tracking

What is Motion Tracking? (Wikipedia)Motion capture, motion tracking, or mocap is a technique of digitally recording movements for entertainment, sports, and medical applications.

Motion Tracking SystemsWireless Sensor Based Motion Tracking

4/2/2008 18Fjtorres

MIT Cricket sensor board

on Mica2 mote

Mica2 mote

mica2dot

Need a Silver Bullet?Need a Silver Bullet?

Available ammunition-Current technology: Mechanical, Inertial, Acoustic, Magnetic,

Optical, and Radio and Microwave sensing.

4/2/2008 19Fjtorres

HMTR for Rehab ProjectHMTR for Rehab ProjectHMTR Wiki SiteUsing LABANotation for key exercises suggested by Dr. Carollo, Denver Children’s Hospital(check KeyExercisesLabanDescription.doc).Problems found with the use of LABANotation for describing key exercises(check KeyExercisesLabanDescription.doc).

HMTR Wiki SiteUsing LABANotation for key exercises suggested by Dr. Carollo, Denver Children’s Hospital(check KeyExercisesLabanDescription.doc).Problems found with the use of LABANotation for describing key exercises(check KeyExercisesLabanDescription.doc).

4/2/2008 20Fjtorres

Software ArchitectureSoftware Architecture

4/2/2008 21Fjtorres

Matching Movement ChallengesMatching Movement ChallengesGoal: Compare user’s movements (UM) with a

model (LM) specified using LABANotation for analysis/diagnosis or alert/guidance. But this comparison implies two constrains: time and space. How to line them up?Each person is unique in term body size/shapeHow to calibrate or convert to a canonical formExpecting a delay between the start of LM simulation, and the start of UM simulationHow to identify when the user begins his movements, and when he ends them?

User assisted gesture?Automatic recognition?Step-by-step?

Goal: Compare user’s movements (UM) with a model (LM) specified using LABANotation for analysis/diagnosis or alert/guidance. But this comparison implies two constrains: time and space. How to line them up?Each person is unique in term body size/shapeHow to calibrate or convert to a canonical formExpecting a delay between the start of LM simulation, and the start of UM simulationHow to identify when the user begins his movements, and when he ends them?

User assisted gesture?Automatic recognition?Step-by-step?

4/2/2008 22Fjtorres

Security/Privacy Problems in WSN based Assistive Rehab System

Security/Privacy Problems in WSN based Assistive Rehab System

How to protect the sensor data collected in the system?How to ensure security of system?

Protect against unauthorized exercise updateProtect the privacy of the patient data.Ensure the data integrity.

Common problems in Medical Research System such as our web-based NeuroGuide Project with Dr. Qualls.

How to protect the sensor data collected in the system?How to ensure security of system?

Protect against unauthorized exercise updateProtect the privacy of the patient data.Ensure the data integrity.

Common problems in Medical Research System such as our web-based NeuroGuide Project with Dr. Qualls.

4/2/2008 Fjtorres 23

PhD ProposalPhD ProposalWe have discovered some challenging issues in the above Human Motion Tracking and NeuroGuide projects.I am interested in developing theory, techniques and tools for supporting the secure communication systems. We will use these projects as test cases.Suggestions.

We have discovered some challenging issues in the above Human Motion Tracking and NeuroGuide projects.I am interested in developing theory, techniques and tools for supporting the secure communication systems. We will use these projects as test cases.Suggestions.

HMTR for Rehab 4/2/2008

fjtorres 24

Questions and AnswersQuestions and Answers

4/2/2008 25Fjtorres