real-time control of a multi-fingered robot hand using emg signals master’s thesis by luenin...
Post on 21-Dec-2015
223 views
TRANSCRIPT
![Page 1: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/1.jpg)
Real-Time Control of a Multi-Real-Time Control of a Multi-Fingered Robot Hand Using Fingered Robot Hand Using
EMG SignalsEMG SignalsMaster’s ThesisMaster’s Thesis
ByBy
Luenin BarriosLuenin Barrios
Supervisor: Marko VuskovicSupervisor: Marko Vuskovic
Department of Computer ScienceDepartment of Computer ScienceSan Diego State UniversitySan Diego State University
June 29, 2010June 29, 2010
SDSU
![Page 2: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/2.jpg)
OutlineOutline Introduction to ResearchIntroduction to Research Multi-Fingered Robot Hands and Multi-Fingered Robot Hands and
ProsthesesProstheses Measurement of EMG SignalsMeasurement of EMG Signals Feature Extraction and ClassificationFeature Extraction and Classification Synergy and Robot Control SystemSynergy and Robot Control System Hardware DescriptionHardware Description Implementation Implementation Observations and ResultsObservations and Results SummarySummary
SDSU
![Page 3: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/3.jpg)
IntroductionIntroduction Goal of Research:Goal of Research:
To implement a program that uses To implement a program that uses the EMG Classifier output to control the EMG Classifier output to control the grasp motions of the SDSU robot the grasp motions of the SDSU robot hand in real-timehand in real-time
Grasp modes: Grasp modes:
SDSU
Chris Miller Master’s Thesis 2008.
![Page 4: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/4.jpg)
Prosthetic Hands Prosthetic Hands OverviewOverview
Early ModelsEarly Models Restrictions and Restrictions and
LimitationsLimitations Degrees of FreedomDegrees of Freedom EMG Signal ControlEMG Signal Control
Otto Bock Grasp Pincher TAP Version 3 Prototype SDSU Robot Hand
SDSU
![Page 5: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/5.jpg)
Overall SchematicOverall Schematic
Prosthetic Hand
Controller
EMG Amplification
Device
A/D Converter
Classifier
Signal Processing
Time Sample Extraction
Feature Extraction
Transformation
Saksit Siriprayoonsak 2005
Chris Miller 2008
This Project
SDSU
![Page 6: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/6.jpg)
EMG SignalsEMG Signals ElectromyographyElectromyography EMG potentials: 50 μV and up to 20 to 30 mVEMG potentials: 50 μV and up to 20 to 30 mV
Source:www.univie.ac.at/cga/courses/be522/
emg/fiber.gif
SDSU
![Page 7: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/7.jpg)
Forearm Muscle Forearm Muscle AnatomyAnatomy
Chris Miller Master’s Thesis 2008
SDSU
![Page 8: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/8.jpg)
EMG Amplifier DeviceEMG Amplifier Device
Saksit Siriprayoonsak Saksit Siriprayoonsak 20052005
4 Bipolar Channels4 Bipolar Channels
1 Reference Channel1 Reference Channel
Surface ElectrodesSurface Electrodes
![Page 9: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/9.jpg)
EMG Amplifier Device EMG Amplifier Device Con’tdCon’td
SDSU
![Page 10: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/10.jpg)
EMG Classifier ProgramEMG Classifier ProgramSignal DetectionSignal Detection
Bonato MethodBonato Method Onset of Onset of
MovementMovement
SDSU
![Page 11: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/11.jpg)
ClassifierClassifierSignal ProcessingSignal Processing
Feature ExtractionFeature Extraction
Methods:Methods:
Waveform Length (Farry Waveform Length (Farry et alet al., ., 1996)1996)
Spectral Moments (Vuskovic Spectral Moments (Vuskovic et et alal., 2005)., 2005)
SDSU
![Page 12: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/12.jpg)
EMG Signal Processing EMG Signal Processing Feature Extraction Method Feature Extraction Method
11Waveform Length
SDSU
![Page 13: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/13.jpg)
EMG Signal ProcessingEMG Signal ProcessingFeature Extraction Method Feature Extraction Method
22 Spectral MomentsSpectral Moments
I-coefficientsI-coefficients
SDSU
![Page 14: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/14.jpg)
Feature ClassificationFeature Classification Mahalanobis Distance(Mahalanobis, 1936)Mahalanobis Distance(Mahalanobis, 1936)
Sample Feature Vector Sample Feature Vector SpaceSpace
SDSU
![Page 15: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/15.jpg)
Feature Log Feature Log TransformationTransformation
Box Cox Transformation (1964)Box Cox Transformation (1964)
SDSU
![Page 16: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/16.jpg)
Robot Joint Control Robot Joint Control SystemSystem
PID Controller and Actuator PID Controller and Actuator
SDSU
![Page 17: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/17.jpg)
Joint Control SystemJoint Control System Acutuator ModelAcutuator Model
SDSU
Variable Description Unit
Ra Terminal or Armature Resistance
3.38 Ohm
Ka Torque Constant 8.11 mNm/A
Jm Rotor Inertia 1.27 gcm2
Kg Gear Transmission Ratio - Thumb
Gear Transmission Ratio - Finger
1:261:19
Ga Driver Gain 1
Kb Speed or Proportionality Constant
1180 rpm/V
V0 Nominal Voltage 12 Volt
ω0 No Load Speed 13900 rpm
![Page 18: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/18.jpg)
Joint Control SystemJoint Control System
PID ControllerPID Controller
e = qmd - qm; // Get controller errorqmdot = (qm-qmold)/_Ts; // Get derivative of errorei = eiold + e * _Ts; // Get integral of erroru = _Kp*e - _Kv*qmdot + _Ki*ei; // Control lawqmold = qm;eiold = ei;
SDSU
![Page 19: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/19.jpg)
Synergetic MotionSynergetic Motion Synergetic MappingSynergetic Mapping
θθjj = = ffjj (m, D)(m, D) where where jj = 0, 1…5 and = 0, 1…5 and mm = = 1…4 1…4
Approximation Function (Vuskovic and Approximation Function (Vuskovic and Marjanski)Marjanski)
am,j = γm,jcm,j = αm,j
SDSU
![Page 20: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/20.jpg)
Synergetic TrainingSynergetic TrainingJoint Angle
θ1 (cm,1 + D1) = am,1 bm,1 - am,1 D1
SDSU
![Page 21: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/21.jpg)
Object Shapes and SizesObject Shapes and SizesSpherical Point
Cylindrical Lateral
![Page 22: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/22.jpg)
Calibration and TrainingCalibration and TrainingSDSU
Sample Training for Point Objects:
Sample Positions for Lateral, Cylindrical and Spherical
![Page 23: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/23.jpg)
Robot HardwareRobot Hardware
Servo To Go BoardServo To Go Board Signal Transition Signal Transition
BoxBox
SDSU
![Page 24: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/24.jpg)
Servo To Go Interface Servo To Go Interface BoardBoard
Encoder Input A/B signalEncoder Input A/B signal Analog Input/OutputAnalog Input/Output
SDSU
![Page 25: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/25.jpg)
Signal Transition BoxSignal Transition Box Central hub for signals/cablesCentral hub for signals/cables Relays information Relays information Example: Joint 0
P3 DAC 2 EnIn A 14 EnIn B 17
DB50 EnOut A 35 EnOut B 34
DB25 AnalogIn 2
SDSU
![Page 26: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/26.jpg)
EMG Robot HandEMG Robot Hand User Interface/Motion Command InterpreterUser Interface/Motion Command Interpreter Client/ServerClient/Server TCP/IPTCP/IP Real-time EMG/User CommandsReal-time EMG/User Commands Grasp modes: Cylindrical, Spherical, Point, LateralGrasp modes: Cylindrical, Spherical, Point, Lateral
SDSU
![Page 27: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/27.jpg)
EMG Robot Hand Cont’dEMG Robot Hand Cont’dExamples: Examples:
Command: g 0 45Command: g 0 45
Command: o 3 9
SDSU
![Page 28: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/28.jpg)
Overall Runtime Flow Overall Runtime Flow ChartChart
SDSU
![Page 29: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/29.jpg)
Overall Runtime Flow Chart Overall Runtime Flow Chart Cont’dCont’d
SDSU
![Page 30: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/30.jpg)
System ExecutionSystem Execution
Step 1
Step 2 Step 3
Step 4
SDSU
![Page 31: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/31.jpg)
SummarySummary Multi-fingered Robot Hands and EMG Multi-fingered Robot Hands and EMG
SignalsSignals Collection of EMG SignalsCollection of EMG Signals Feature Extraction and ClassificationFeature Extraction and Classification PID ControllerPID Controller Synergetic MotionSynergetic Motion Overall System Diagram and Transition BoxOverall System Diagram and Transition Box Real-time control of Robot Hand using EMGReal-time control of Robot Hand using EMG SignalsSignals
SDSU
![Page 32: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/32.jpg)
Conclusions/Future WorkConclusions/Future Work
Feasibility of EMG Signal for Hand Feasibility of EMG Signal for Hand ControlControl
Synergetic Grasp MotionsSynergetic Grasp Motions Classifier for real-time controlClassifier for real-time control Combine projects so they reside on Combine projects so they reside on
same machinesame machine Improve arm/amplifier device contactImprove arm/amplifier device contact Wireless electrodes/sensory networkWireless electrodes/sensory network Improve time delays in ClassifierImprove time delays in Classifier
![Page 33: Real-Time Control of a Multi-Fingered Robot Hand Using EMG Signals Master’s Thesis By Luenin Barrios Supervisor: Marko Vuskovic Department of Computer](https://reader036.vdocuments.us/reader036/viewer/2022062313/56649d565503460f94a3495c/html5/thumbnails/33.jpg)
Questions/Comments?Questions/Comments?
SDSU