tracklab: a solution for indoor and outdoor tracking and movement analysis

TrackLab: a solution for indoor and outdoor tracking and movement analysis

Hans Theuws Ben LokeAndrew J. Spink

AAL Forum 2015, Ghent, Belgium, 24 September 2015

TrackLab: a solution for indoor and outdoor tracking and movement analysis●Introduction●What is TrackLab?●Applications in AAL●Tools to integrate with●Collaboration projects

Content

Noldus Information Technology●Developer of innovative software, hardware and integrated solutions for behavioral research●Established in 1989●Headquarters in The Netherlands, 125 employees worldwide●Offices in France, Germany, Spain, Hungary, USA, China●Products used by > 7,000 organizations in 85 countries

Introduction: Company profile

Introduction: Core activities

Product development●Software applications●Hardware instruments and devicesSystem integration●Noldus software and hardware●Computer hardware●Video and multimedia components●Eye trackers and DAQ systems●Integrated behavior research labsServices●Training●Consulting●Measuring Behavior conferences

Introduction: Noldus InnovationWorks

● Research and innovation laboratory of Noldus Information Technology

● Cutting-edge technologies, novel concepts and product prototypes for innovative AAL solutions

● In collaboration with partners in industry and academia

● Innovation Themes:● Automated behavior recognition● Complex event processing and reasoning● Mobile sensing, tracking and user experience

measurement● Integrated systems and solutions

TrackLab: a solution for indoor and outdoor tracking and movement analysis●Introduction●What is TrackLab?●Applications in AAL●Tools to integrate with●Collaboration projects

Content

● End-to end solution for analysis and visualization of spatial behavior

● Interactive: Send out real-time events for integration with other solutions

● Works with any kind of sensor (GPS, RFID, UWB, WiFi, video, etc.)

TrackLab™ Indoor and outdoor movement tracking and analysis

TrackLab: indoor and outdoor tracking

Sensors● GPS in specialized sensors and smartphones● Ultra wide-band (Ubisense)● Network of stereo video sensors (EagleGrid)● Multi-camera video tracking (PeopleTracker)● Tracking data enhanced by accelerometers and

inertial sensorsMaps● OpenStreetMap for outdoor tracks● Calibrated bitmaps for indoor tracksMode● Live or offline

EagleEye

● Stereo camera sensors● Ceiling mounted ● No tags/markers needed● Identification: yes● Re-identification: no● Accuracy: +/- 50cm (depends on conditions)● Trackable area: app 13m2 at 3m camera height● Indoor tracking when wearing tags is not possible

Stereo camera sensors

Ubisense

● Ultra Wide Band● Wall mounted● Unique tag worn by test subject● Identification: yes● Re-identification: yes● Accuracy: 30cm in real life situations● Trackable area: 40x40m with 4 sensors● Indoor/outdoor tracking when using tags is

possible

UWB Sensors and tags

PeopleTracker

● Multiple video cameras● Under development ● No tag needed● Identification: yes● Re-identification: yes● Trackable area: depends on number of cameras● Tracking up to 10 people simultaneously

without markers or tags

Markerless people tracking

TrackLab™

Track multiple persons, inside or outside

TrackLab™

Define regions of interest on your own map

TrackLab™

Tracking with calibrated bitmap

TrackLab™

Track analysis (1)

TrackLab™

Track analysis (2)

TrackLab™

Movement Classification

Behavior detectionWho is doing what and where?

● Movement analysis based on speed (e.g. walking, running) or accelerometer data

● Detect mode of transportation (e.g. train, bus, bike, by foot)

TrackLab: a solution for indoor and outdoor tracking and movement analysis●Introduction●What is TrackLab?●Applications in AAL●Tools to integrate with●Collaboration projects

Content

Application examplesFor Ambient Assisted Living

● Assessing both positive and negative aspects of a person’s location and movement

● Monitor exercise taken by the subject, reports can be used to give feedback to patients and caregiver

● Integration with other software makes it possible to send an alarm signal to caregivers, for instance if an Alzheimer’s patient strays outside of the grounds of where they live

● Detect if a person hasn’t moved for a while, which can trigger an alarm

● Research tool in development of in-store navigation systems

● Navigation assistance● Personalized advice● Driven by tracking and behavior

detection software

Application examplesE-coaching apps for in-store navigation

Application examplesE-coaching apps: pilot study - 1

● Group of older subjects (average age 72) were asked to locate 15 products on a shopping list in a simulated shop

● Tracked with TrackLab software● Input ultra-wideband tracking system from Ubisense● The participants were given instructions for finding

recipe ingredients using 5 different navigational methods:

● No help● Voice guidance● Floor plan● Haptic feedback system● Navigational arrows on a smartphone

Application examplesE-coaching apps: pilot study - 1

● Analysis:● Path distance● Time until reaching food’s location● Meander until reaching food’s location● Time standing still

● Conclusion: ● Map easiest and most efficient manner to navigate● Build on familiar methods when designing new tools

Application examplesE-coaching apps: pilot study - 2

● Group of older subjects (60-80 years) make a shopping list with 8 products using the app

● Use the navigation section to walk to the store● Check home status before leaving● Do the groceries using the path the smartphone shows● Call taxi

Application examplesE-coaching apps: pilot study - 2

● Tracking using foot sensors

Application examplesE-coaching apps: pilot study - 2

● Results:● All participants would use a device if

it helps them● Suggestions by family members,

informal or professional caregivers appear less important

● Concerns: technical difficulty, privacy, safety

● People are willing to pay (€5-25 / month)

TrackLab: a solution for indoor and outdoor tracking and movement analysis●Introduction●What is TrackLab?●Applications in AAL●Tools to integrate with●Collaboration projects

Content

FaceReader®

Automatic analysis of facial expressions

● Detect basic emotion, head orientation, facial gestures● Real-time feedback about emotional state to other applications● Works with standard webcams, smartphones and tablets

Tactile feedbackUsing the Elitac Science Suit

Tactile displays● Vibration electronics integrated in wearable textile● For communication, alarming and conditioning● Wireless connection ● Controlled by TrackLab™

Applications● Navigation support● Real-time warnings● Geo-fencing

Background● Spin-off from University of Twente, Enschede, NL● Specialized in wireless sensor networking with main focus on

motion sensing

Motion sensing● Magnetic, Accelerometer and Gyroscope sensors● Applied in sports, healthcare and industrial sectors● Estimate orientation, velocity and displacement, rate of rotation

Motion sensingFrom Inertia Technology

TrackLab: a solution for indoor and outdoor tracking and movement analysis●Introduction●What is TrackLab?●Applications in AAL●Tools to integrate with●Collaboration projects

Content

AAL Projects

● Outdoor and indoor localization and mobility services for elderly people with sensory and cognitive impairments

● Website: www.emosion-project.eu ● Partners:

● Development of a virtual assistant (avatar) supporting elderly in their daily activities

● Website: www.cameli.eu ● Partners:

AAL Projects

● Workflow technologies for older nurses by supplying real-time context-aware tools for guiding them in their daily tasks

● Website: http://www.letitflow-project.com/● Partners:

AAL Projects

● Real-time response of a virtual assistant (avatar) to the emotional state of an elderly person

● Website: www.miraculous-life.eu ● Partners:

Other collaboration projects

● What tracking techniques are acceptable (accuracy/privacy)?

● Who will invest in large scale implementation?

Discussion

● Questions: h.theuws@noldus.nl

● Request a trial: http://www.noldus.com/innovationworks/products/tracklab

More information