rfig sig04 presentation
TRANSCRIPT
![Page 1: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/1.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Ramesh Raskar, Paul Beardsley, Jeroen van Baar, Yao Wang,
Paul Dietz, Johnny Lee, Darren Leigh, Thomas Willwacher
Mitsubishi Electric Research Labs (MERL), Cambridge, MA
R F I R F I GG Lamps Lamps : : Interacting with a Self-describing World Interacting with a Self-describing World
via Photosensing Wireless Tags and via Photosensing Wireless Tags and ProjectorsProjectors
![Page 2: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/2.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Radio Frequency Identification Tags Radio Frequency Identification Tags (RFID)(RFID)
microchip
Antenna
No batteries,
Small size,
Cost few cents
![Page 3: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/3.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
WarehousingWarehousing
RoutingRouting
Library Library
Baggage
handling
Baggage
handling
CurrencyCurrency
Livestock trackingLivestock tracking
![Page 4: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/4.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Micro Controller
Memory Computer
READER
Micro Controller
Memory
Conventional Passive RFID
![Page 5: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/5.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Tagged Books in a LibraryTagged Books in a Library
Id List of books in RF range
No Precise Location Data Are books in sorted order ?Which book is upside down ?
![Page 6: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/6.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Where are boxes with Where are boxes with Products close to Expiry Date ?Products close to Expiry Date ?
![Page 7: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/7.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
READER
Micro Controller
RF Data
Memory
Conventional RFID
Computer
READER
Micro Controller
RF Data
Light
Memory
Photosensor
Computer
Conventional RF tag
Photo-sensing RF tag
![Page 8: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/8.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
READER
Projector Micro
Controller RF Data
Light
Memory
Photosensor
Computer
Photosensor ?
Compatible with RFID size and power needs
Projector ?
Directional transfer,AR with Image overlay
![Page 9: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/9.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
b. Tags respond with date and precise (x,y) pixel location, Projector beams ‘Ok’ at that location
b. Tags respond with date and precise (x,y) pixel location, Projector beams ‘Ok’ at that location
a. Photosensing RFID tagsare queried via RF
a. Photosensing RFID tagsare queried via RF
c. Multiple users can simultaneously work from a distance without RF collision
c. Multiple users can simultaneously work from a distance without RF collision
![Page 10: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/10.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
![Page 11: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/11.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
RFID
(Radio Frequency Identification)
RFIG
(Radio Frequency Id and Geometry)
![Page 12: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/12.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Prototype TagPrototype Tag
RF tag + photosensor
RF tag + photosensor
![Page 13: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/13.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
OutlineOutline
• Photosensing RF tags– Location sensing
• Geometric Operations– Multi-view analysis– Deformation
• Interactive Projection– Mouse-like interaction– Image stabilization
![Page 14: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/14.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
OutlineOutline
• Photosensing RF tags– Location sensing
• Geometric Operations– Multi-view analysis– Deformation
• Interactive Projection– Mouse-like interaction– Image stabilization
• Applications
![Page 15: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/15.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Pattern
MSB
Pattern
MSB
Pattern
MSB-1
Pattern
MSB-1
Pattern
LSB
Pattern
LSB
Projected Sequential Frames
•Handheld Projector beams binary coded stripes
•Tags decode temporal code
![Page 16: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/16.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Pattern
MSB
Pattern
MSB
Pattern
MSB-1
Pattern
MSB-1
Pattern
LSB
Pattern
LSB
Projected Sequential Frames
•Handheld Projector beams binary coded stripes
•Tags decode temporal code
![Page 17: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/17.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Pattern
MSB
Pattern
MSB
Pattern
MSB-1
Pattern
MSB-1
Pattern
LSB
Pattern
LSB
Projected Sequential Frames
•Handheld Projector beams binary coded stripes
•Tags decode temporal code
![Page 18: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/18.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Pattern
MSB
Pattern
MSB
Pattern
MSB-1
Pattern
MSB-1
Pattern
LSB
Pattern
LSB
Projected Sequential Frames
•Handheld Projector beams binary coded stripes
•Tags decode temporal code
![Page 19: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/19.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Pattern
MSB
Pattern
MSB
Pattern
MSB-1
Pattern
MSB-1
Pattern
LSB
Pattern
LSB
Projected Sequential Frames
•Handheld Projector beams binary coded stripes
•Tags decode temporal code
![Page 20: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/20.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Pattern
MSB
Pattern
MSB
Pattern
MSB-1
Pattern
MSB-1
Pattern
LSB
Pattern
LSB
For each tag
a. From light sequence, decode x and y coordinate
b. Transmit back to RF reader (Id, x, y)
For each tag
a. From light sequence, decode x and y coordinate
b. Transmit back to RF reader (Id, x, y)
00 11 11 00 00 X=12
X=12
![Page 21: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/21.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Visual feedback of 2D Visual feedback of 2D positionposition
a. Receive via RF {(x1,y1), (x2,y2), …} pixels
b. Illuminate those positions
a. Receive via RF {(x1,y1), (x2,y2), …} pixels
b. Illuminate those positions
![Page 22: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/22.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
LimitationsLimitations
• Line of sight~Surface patches~Multiple tags per object
• Ambient light~Modulated infrared
• Surface reflectance and shadows
![Page 23: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/23.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
OutlineOutline
• Photosensing RF tags– Location sensing
• Geometric Operations– Multi-view analysis– Deformation
• Interactive Projection– Mouse-like interaction– Image stabilization
• Applications
![Page 24: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/24.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Find 3D coordinatesFind 3D coordinates
a. Observe structured patterns via Camera
b. Triangulate cam/proj view
a. Observe structured patterns via Camera
b. Triangulate cam/proj view
![Page 25: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/25.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
3D from 2 Projector Views3D from 2 Projector Views(Structure from Motion)(Structure from Motion)
• Two+ unknown projector views• Correspondence is trivial• Applications
– Detect 3D deformations– Trajectory grouping
![Page 26: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/26.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Change Detection Change Detection without fixed camera, in any lighting conditionwithout fixed camera, in any lighting condition
Compare with new coordinates from a different
view
Record coordinates of tags from one view
Before After
![Page 27: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/27.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Texture AdaptationTexture Adaptation
![Page 28: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/28.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
OutlineOutline
• Photosensing RF tags– Location sensing
• Geometric Operations– Multi-view analysis– Deformation
• Interactive Projection– Desktop-like interaction– Image stabilization
• Applications
![Page 29: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/29.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Desktop-like InteractionDesktop-like Interaction
Selecting Selecting tagstags
![Page 30: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/30.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Support for handheld Support for handheld projectionprojection
![Page 31: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/31.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Mouse SimulationMouse Simulation
• Cursor follows handheld projector motion
• Pre-warped image remains stable
![Page 32: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/32.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Image Quasi-StabilizationImage Quasi-Stabilization
Eliminate hand jitter using inertial Eliminate hand jitter using inertial sensors+camerasensors+camera
![Page 33: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/33.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Absolute StabilizationAbsolute Stabilization
Image stays registered with world Image stays registered with world featuresfeatures
![Page 34: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/34.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Image StabilizationImage Stabilization
![Page 35: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/35.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Interactive ProjectionInteractive Projection
(Also in Emerging Technologies Booth)(Also in Emerging Technologies Booth)
![Page 36: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/36.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Adaptive ProjectionAdaptive Projection
‘‘Paste’ : Geometric and Photometric Paste’ : Geometric and Photometric compensationcompensation
![Page 37: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/37.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Prototype Handheld Prototype Handheld ProjectorProjector
![Page 38: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/38.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Related WorkRelated Work• Smart objects
– Smart-its– FindIT Flashlight (Ma and Paradiso 2002)
• Location sensing – Multiple readers, large antennas– Olivetti Active Badge, Xerox PARCtab (Want 1995)
• Interaction and Display– Augmented Reality– Projector-based AR, Shaderlamps
(Raskar 1998, Underkoffler 1999, Pinhanez 2001)
– Handheld projector (Raskar 2003)
![Page 39: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/39.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
ApplicationsApplications
• Single Tags– Authoring for AR, Store augmentation: display per
object
• Multiple tags on objects– 3D Pose– Packing and placement strategy– Robot navigation
• Interaction between tagged objects– History of geometric interaction– Orientation mismatch
• Distributed tags– Deformation– Interpolated values for temperature sensors
![Page 40: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/40.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
AcknowledgementsAcknowledgements
• MERL– Cliff Forlines– Joe Marks, – Dick Waters, Kent Wittenburg– Vlad Branzoi– Rebecca Xiong, Debbi van Baar
• Mitsubishi Electric, Japan– Mamuro Kato, – Keiichi Shiotani
![Page 41: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/41.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Interacting with a Self-Describing WorldInteracting with a Self-Describing World
• Hybrid optical and RF communication– Photosensing Wireless Tags + Projector illumination
• Geometric Analysis– Location, Selection,
Augmentation At a distance
• Interactive Projection– Desktop like interaction– Stabilized images
• RFIG Applications beyond logistics– Identity, Geometry, History, Annotation
www.MERL.com
![Page 42: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/42.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Find tag location using
handheld Projector
Find tag location using
handheld Projector
Photosensing
Wireless Tags
Photosensing
Wireless Tags
Many geometric ops Many geometric ops
R F I R F I R F I DR F I D
Interactive stabilized projection
Interactive stabilized projection
(Radio Frequency Id & (Radio Frequency Id & GeometryGeometry))GG
![Page 43: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/43.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
(End of Presentation)(End of Presentation)
![Page 44: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/44.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Towards Passive RFIDTowards Passive RFID• Photosensor
– Most compatible with passive batteryless RFID– Power: near zero power for sensing– Size: Each photocell is tens of micrometer (smaller than RFID
which are about 500 micrometer)– Very low cost, can be built with silicon of RFID microchip– RFID+Photosensor can be size of grain of rice– RFIG tag is ‘visible’ to projector but not to humans– Current prototype uses battery because passive tags are difficult
to program
• Other possibilities– Adding a light emitting diode (LED)
• Requires on board power• Size has to be considerably large• Size and power requirements are high
![Page 45: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/45.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Future DirectionsFuture Directions
• Sophisticated tags• Light modulation
• Handheld projector
![Page 46: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/46.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Comparison with Bar-codesComparison with Bar-codes
• RFID– Barcodes take up more space– Long bit sequences– Multiple tags can be simultaneously read– Read distance is high
• RFIG– Multiple barcodes per object is cumbersome– Difficult to attach sensor (e.g. temperature)
![Page 47: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/47.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Locate Tags Precisely using a Locate Tags Precisely using a handheld scanner/projectorhandheld scanner/projector
•Handheld device
•Eliminates multiple RF readers for triangulation or large antennas
•Projector indicates location of tag
Illuminate tags with binary coded stripes with projector
![Page 48: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/48.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Photosensor added to RFID tags
Hybrid communication via RF and via light
Solve 3 main issues with conventional RFIDs
1. Locate tags precisely
2. Select a subset of tags for operation
3. Long distance operation without collision
Applications beyond inventory management
1. Warehouse: locate objects for specific queries
2. Training and maintenance: interactive augmented reality
3. Surveillance: keep trail of object locations
![Page 49: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/49.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
2. Select subset of tags for operation2. Select subset of tags for operation
Advantages
•Only tags which are illuminated respond to queries
•No RF collision between multiple tags
•Projector also use as a display to indicate result of operation
Technique
•Illuminate subset of tags with flashlight or projector
3. Long distance operation without RF collision3. Long distance operation without RF collision
![Page 50: Rfig Sig04 Presentation](https://reader038.vdocuments.us/reader038/viewer/2022110307/55583774d8b42acb078b4937/html5/thumbnails/50.jpg)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Interactive ProjectionInteractive Projection
• Desktop like interaction– Cursor follows use motion– Center pixel is the pointer– Rest of the image is stabilized– Selection
• Image stabilization– Absolute: camera and inertial sensor– Relative: world markers
• Copy-paste– Camera captures texture during ‘copy’– Projection after geometric/photometric adaptation