1 a haptic multimedia handwriting learning system mohamad a. eid, mohamed mansour, abdulmotaleb h....
TRANSCRIPT
![Page 1: 1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the](https://reader035.vdocuments.us/reader035/viewer/2022062515/56649cb95503460f9497fa27/html5/thumbnails/1.jpg)
1
A Haptic Multimedia Handwriting Learning System
Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias
Emme '07: Proceedings of the international workshop on Educational multimedia and multimedia education
Speaker: Jacob.
![Page 2: 1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the](https://reader035.vdocuments.us/reader035/viewer/2022062515/56649cb95503460f9497fa27/html5/thumbnails/2.jpg)
2
Outline
Introduction Haptic Learning System Algorithms Conclusion
![Page 3: 1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the](https://reader035.vdocuments.us/reader035/viewer/2022062515/56649cb95503460f9497fa27/html5/thumbnails/3.jpg)
3
Introduction
Certain learning need physically interact. Handwriting, medical procedures, painting, sports, etc.
Handwriting is a complex daily life task that needs attention, memory and cognition, motor skills.
Haptics refers to the emerging that studies the sense of touch and human interaction via the sense touch.
The authors are using haptic-audio-visual playback for learning handwriting.
![Page 4: 1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the](https://reader035.vdocuments.us/reader035/viewer/2022062515/56649cb95503460f9497fa27/html5/thumbnails/4.jpg)
4
Haptic Learning System
![Page 5: 1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the](https://reader035.vdocuments.us/reader035/viewer/2022062515/56649cb95503460f9497fa27/html5/thumbnails/5.jpg)
5
The Language Repository
It contains study material, symbol images, pronunciation files and the haptic stimuli (position trajectory to draw character).
Contents are made visible to the outside world using an XML-based description.
![Page 6: 1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the](https://reader035.vdocuments.us/reader035/viewer/2022062515/56649cb95503460f9497fa27/html5/thumbnails/6.jpg)
6
The audio-visual player
Character symbol.
Pronunciation.
The students can review the character shape and sound as many times as they want.
![Page 7: 1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the](https://reader035.vdocuments.us/reader035/viewer/2022062515/56649cb95503460f9497fa27/html5/thumbnails/7.jpg)
7
The Haptic Player
Three modes of operationRecording mode: retrieving, filtering, and
storing the data sent from database.Full guidance playback mode: can be used
with beginners to lead them through the writing of the alphabets.
Partial guidance playback mode: check user’s movement and applies partial forces to correct the path.
![Page 8: 1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the](https://reader035.vdocuments.us/reader035/viewer/2022062515/56649cb95503460f9497fa27/html5/thumbnails/8.jpg)
8
GUI (Graphical User Interface)
![Page 9: 1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the](https://reader035.vdocuments.us/reader035/viewer/2022062515/56649cb95503460f9497fa27/html5/thumbnails/9.jpg)
9
Algorithm
Haptic Virtual Whiteboard.
Partial Guidance Playback.
Move-to-Departure Algorithm.
![Page 10: 1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the](https://reader035.vdocuments.us/reader035/viewer/2022062515/56649cb95503460f9497fa27/html5/thumbnails/10.jpg)
10
Haptic Virtual Whiteboard
The reaction force from the virtual whiteboard plane can be computed as:
X=position coordinates of the haptic device.Xp=plane position along the same direction.g and K=stiffness and elasticity of the virtual paper.
![Page 11: 1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the](https://reader035.vdocuments.us/reader035/viewer/2022062515/56649cb95503460f9497fa27/html5/thumbnails/11.jpg)
11
Partial Guidance Playback
The offset between the user’s startup position and the desired startup position eliminates translational errors.
While user is drawing, the result is computed along the paper plane using MSE (Mean Square Error).
Total accumulated error is calculated and compared to a threshold that reflects the level of guidance.
![Page 12: 1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the](https://reader035.vdocuments.us/reader035/viewer/2022062515/56649cb95503460f9497fa27/html5/thumbnails/12.jpg)
12
Partial Guidance Playback
(Xip, Yip)=current position (Xid, Yid)=Desired position coordinate. n=number of points from the startup point
up until the current point.
![Page 13: 1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the](https://reader035.vdocuments.us/reader035/viewer/2022062515/56649cb95503460f9497fa27/html5/thumbnails/13.jpg)
13
Move-to-Departure Algorithm
This algorithm makes the device more smoothly from its current position to the startup position of the stimulus.
![Page 14: 1 A Haptic Multimedia Handwriting Learning System Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias Emme '07: Proceedings of the](https://reader035.vdocuments.us/reader035/viewer/2022062515/56649cb95503460f9497fa27/html5/thumbnails/14.jpg)
14
Conclusions
Its very useful for Chinese, Thai, Japanese, Arab, Korea and the other countries which have their own character.
We have to write often to remember a new character. So keep writing.