![Page 1: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/1.jpg)
Beyond One-dollar Mouse: A Battery-free Device for 3D
Human-Computer Interaction via RFID Tags
Qiongzheng LinLei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang Li,Yunhao Liu
Tsinghua University,ChinaIIT,USA
![Page 2: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/2.jpg)
Outline
• Motivation
• System Design
• Evaluation and Implementation
• Conclusion
![Page 3: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/3.jpg)
Motivation
![Page 4: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/4.jpg)
1.1 Mouse
1968
1981
1982
1984
1996
2000
2003 …
In computing, a mouse is a pointing device that detects two-dimensional motion relative to a surface.
![Page 5: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/5.jpg)
1.2 3D Application
3D Human-Computer Interaction Devices
![Page 6: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/6.jpg)
1.3.1 Existing SystemsComputer vision based methods
Affected by Light
![Page 7: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/7.jpg)
1.3.2 Existing SystemsSensor based methods
Professional Equipment
![Page 8: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/8.jpg)
1.3.3 Existing SystemsWi-Fi based methods
Wi-Vi (Sigcomm’13)
Inverse synthetic aperture radar
(ISAR)
Left and right movement trend
E-eyes (MobiCom’14)Based on CSI
fingerprint
Tedious manual labor on
Fingerprint collection
Wiz (NSDI’15)
Based on distance measurement
FMCWProfessional Equipment
Body Level Action
![Page 9: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/9.jpg)
1.4 Objectives
![Page 10: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/10.jpg)
System Design
![Page 11: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/11.jpg)
2.1 System Architecture
![Page 12: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/12.jpg)
2.2 Definition of Ball State
S=
𝒪𝑥𝒪𝑦𝒪𝑧
Φ𝑧
Φx
Φ y
Problem: Tracking the Ball State
![Page 13: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/13.jpg)
2.3 Estimating Initial Ball State
𝜃=4𝜋
𝑑𝜆𝑚𝑜
𝑑2𝜋
![Page 14: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/14.jpg)
2.4 Tracing Ball StateΧ (t)=[𝒪 (t )Φ (t ) Δ𝒪 (t ) ΔΦ (t ) ]T
![Page 15: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/15.jpg)
2.5 Smoothing Ball State
Kalman Filter
• Compute
• Real-time, given data so far
Kalman Smoother
• Compute
• Post-processing, given all data
V.S.
Rauch-Tung-Striebel (RTS)
smoother
![Page 16: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/16.jpg)
Evaluation and Implementation
![Page 17: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/17.jpg)
3.1 System Implementation
We attach 12 tags on a cube and
embed the cube inside a plastic ball
We employ an ImpinJ Speedway
modelledR420 reader
We adopt Low Level Reader
Protocol (LLRP) tocommunicate with
the reader
We useLeapMotion to
capture the ground truth of Rotation
![Page 18: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/18.jpg)
3.2.1 Translation Accuracy
1.5cm
0.5cm
0.7cm
![Page 19: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/19.jpg)
3.2.2 Rotation Accuracy
1.8°
![Page 20: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/20.jpg)
3.3 Effect of Parameter
![Page 21: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/21.jpg)
3.3 Effect of Parameter
![Page 22: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/22.jpg)
3.3 Effect of Parameter
![Page 23: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/23.jpg)
3.3 Effect of Parameter
![Page 24: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/24.jpg)
Conclusion
![Page 25: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/25.jpg)
• We present an RFID-based device for human-computer interaction in 3D space
• Our key innovation is study on motion behaviors of a group of tags by using Extended Kalman Filter
• The implementation is based on purely COTS RFID products
Contributions
![Page 26: Beyond One-dollar Mouse: A Battery-free Device for 3D Human-Computer Interaction via RFID Tags Qiongzheng Lin Lei Yang,Yuxin Sun,Tianci Liu,Xiang-Yang](https://reader033.vdocuments.us/reader033/viewer/2022051214/56649e5d5503460f94b55a39/html5/thumbnails/26.jpg)
Thank You!