capacitive sensing 3d-printed wristband for enriched hand...
TRANSCRIPT
![Page 1: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/1.jpg)
Capacitive Sensing 3D-printed Wristband forEnriched Hand Gesture Recognition
Hoang Truong, Phuc Nguyen, Anh Nguyen, Nam Bui, Tam Vu
University of Colorado Boulder
![Page 2: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/2.jpg)
2
Motivation for hand gesture recognition
+ User interacts more seamlessly + User does not need to click/drag/touch/press on his/her devices
![Page 3: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/3.jpg)
3
Criteria for hand gesture wearable devices
Support large number of gestures
Unobtrusive device
User friendly
Continuous and real-time tracking
Enable various applications
Low power(Battery Free)
Sensitive and reliable
sensing technique
Compact and simple
hardware-software
interface design
Gesture-based
Energy Harvesting
![Page 4: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/4.jpg)
4
Product Position Technique Disadvantages
GestureWrist Wristband Capacitive
sensor
No accuracy stated
Tomo Wristband Impedance
tomography
• Closed source
• High power
consumption
Backhand Back-hand Strain gauge
sensor
• Limited number of
hand gesture
• High power
consumption
Existing hand gesture recognition technologies
![Page 5: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/5.jpg)
5
Product Position Technique Cons
Myo
Armband EMG signal
• Inaccurate
• Re-calibrate every
time
Leap motion External Camera + IR
light
• Sensitive to noise
from external light
bulb, LEDs, white
objects
Wristflex Wrist Pressure
resistor
• Closed source
• High power
consumption
Existing hand gesture recognition technologies
![Page 6: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/6.jpg)
6
ProgressSupport large
number of gesture
Unobtrusive device
User friendly
Continuous and real-time tracking
Enable various applications
Low power(Battery Free)
• Special ADC design
• Efficient gesture-based
energy harvesting
Open source HW-SW design
HW-SW stack design
Wristband wearable design
Light-weight HW-SW stack
Extendable HW-SW design
and user defined gestures
![Page 7: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/7.jpg)
7
Hand gesture sensing platform
![Page 8: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/8.jpg)
8
Design concern & decision
+ Material+ Number of sensors+ Position of sensors
Support large number of gesture
Unobtrusive device
User friendly
Continuous and real-time tracking
Enable various applications
Low power
![Page 9: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/9.jpg)
9
Wiring Sensor placement Flex PCB
Prototype evolution
Design concern & decision
![Page 10: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/10.jpg)
10
TI MSP430FR5969
Support large number of gesture
Unobtrusive device
User friendly
Continuous and real-time tracking
Enable various applications
Low power
Design concern & decision
![Page 11: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/11.jpg)
11
CLI SVM Classification
Web UI, Spring framework
Design concern & decision
![Page 12: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/12.jpg)
12
Support large number of gesture
Unobtrusive device
User friendly
Continuous and real-time tracking
Enable various applications
Low power
Design concern & decision
![Page 13: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/13.jpg)
13
Design concern & decision
Support large number of gesture
Unobtrusive device
User friendly
Continuous and real-time tracking
Enable various applications
Low power
![Page 14: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/14.jpg)
14
Overall detection rate
![Page 15: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/15.jpg)
15
Confusion matrix
![Page 16: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/16.jpg)
16
Demo app
Tetris time
![Page 17: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/17.jpg)
17
Conclusion
❑We proposed a hand gesture recognition system utilizingcapacitive sensing technique.
❑We presented a wristband-form device augmented sensorarrays under the flexible circuit board.
❑We also provided a detail hardware and softwareinterface of the proposed system.
❑We envision that this technology can be easily integratedinto a smart wristband or a smartwatch through animplemented application (Tetris game).
![Page 18: Capacitive Sensing 3D-printed Wristband for Enriched Hand ...mnslab.org/hoangtruong/pubs/2017_WearSys_Wristband_slide.pdf · Capacitive Sensing 3D-printed Wristband for Enriched Hand](https://reader034.vdocuments.us/reader034/viewer/2022042622/5fa0270259d7b23fb1657793/html5/thumbnails/18.jpg)
Capacitive Sensing 3D-printed Wristband forEnriched Hand Gesture Recognition
Hoang Truong, Phuc Nguyen, Anh Nguyen, Nam Bui, Tam Vu
University of Colorado Boulder