sixthsense: rfid-based enterprise intelligence
DESCRIPTION
SixthSense: RFID-based Enterprise Intelligence. Lenin Ravindranath, Venkat Padmanabhan (MSR India) Piyush Agrawal (IIT Kanpur). RFID. Radio Frequency Identification Components RFID Reader with Antennas Tags (Active and Passive) Electromagnetic waves induce current Tag responds - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/1.jpg)
SixthSense:RFID-based Enterprise
Intelligence
Lenin Ravindranath, Venkat Padmanabhan (MSR India)
Piyush Agrawal (IIT Kanpur)
![Page 2: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/2.jpg)
RFID Radio Frequency Identification Components
RFID Reader with Antennas Tags (Active and Passive)
Electromagnetic waves induce current Tag responds
Globally unique ID Data
UHF (865-956 MHz) Range – up to 7m
Applications Tracking, Inventory, Supply Chain, Authentication, … Novel Research Applications
![Page 3: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/3.jpg)
Motivating Scenario
Lenin missed an object in the
conference room – 2nd floor Scientia
![Page 4: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/4.jpg)
SixthSense Goal Making people, objects and workspaces, the first class
citizens of the enterprise computing
Components Use RFID to capture the rich interaction between
people and their surroundings Combine with other enterprise systems/sensors to
make automated inferences Enable Useful Services
![Page 5: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/5.jpg)
Setting
People and objects tagged
Camera
Calendar
Presence
RFID Antennas
![Page 6: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/6.jpg)
Assumptions Widespread coverage of RFID readers in the workspace Users are free to pick up new tags and affix them to
objects Can put multiple tags on an object
No dependence on cataloging Cataloging is an overhead
TagID Entity Antenna Workspace Error Prone Tags are fragile – may have to be replaced Readers/Antenna could be moved
Start with an undifferentiated mass of tags and infer everything
Lenin missed an object in the
conference room – 2nd floor Scientia
13548234 – Ant 115574523 – Ant 113548234 – Ant 615574523 – Ant 1
![Page 7: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/7.jpg)
Architecture
People and objects tagged
Camera
Calendar
Presence
RFID Antennas
SixthSense
![Page 8: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/8.jpg)
SixthSense
SixthSense
Automated Inference Platform
Programming Model Applications
![Page 9: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/9.jpg)
Inference Engine Person-Object Differentiation Object Ownership Inference Zone Identification Person Identification Person-Object Interaction
![Page 10: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/10.jpg)
Person-Object Differentiation
People can move on their own Objects move only when carried by a person
Co-movement based heuristic Relative Movement (RM)
Zone 1 Zone 2 Zone 3
![Page 11: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/11.jpg)
Object Ownership Inference Co-Presence
Calculate the amount of time the object is concurrently present in the same zone as a person
Owner is the person with which the object is co-present the most and greater than a threshold
![Page 12: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/12.jpg)
Person Identification
1
xyz abc
1
2
Workspace Entrance
Event
Log-in event
Coincidence count
1xyz
1
time
t1
t2
1
![Page 13: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/13.jpg)
Object Interaction (only in zones of interest) Intra zone Identify interaction in zones of interest
A person lifted an object A person turned the orientation an object
Signal Strength of tag varies Change in distance Change in orientation Contact
Monitor variation in RSSI
![Page 14: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/14.jpg)
Object Interaction Sample the RSSI of each object tag every 200ms Sliding 4-second wide window
Difference between the 10th percentile and 90th percentile of the RSSI
Object is said to be interacted - If the difference > threshold
Minimizing spurious detections Use multiple antennas
![Page 15: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/15.jpg)
Object Interaction
Antenna 1
Antenna 2
Interacted
Interacted
![Page 16: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/16.jpg)
Ensuring Privacy Enterprise will deploy and manage the system
Expose appropriate set of information Trust - Analogous to the enterprise e-mail system
Defend against rogue readers Relabeling approach [A. Juels, 2006]
EPC code rewritten at random times SixthSense will be aware of the mapping
between the old and new tag IDs
![Page 17: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/17.jpg)
Implementation
Simulator(Trace Generation)
Experimental Setup(Real-time feed)
![Page 18: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/18.jpg)
Experimental Setup
![Page 19: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/19.jpg)
Results Inter-zone movement detection
Object Reliability (1m) Reliability (2m)Badge on belt clip 100% 96%Small box in hand 94% 88%
Object Interaction
Testbed deployment To make correct inferences
Average inter-zone movements needed – 4 Average log-ins required - 3
Distance between antennas
Detection time
1.5m 2.39s2m 3.4s
2.5m 5.03s
![Page 20: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/20.jpg)
Simulation Probabilistic model to generate artificial traces Simulated
Inter-zone movement (walk) People carrying multiple objects Log-in events Untagged people
Zone 1 Zone 2 Zone 3
![Page 21: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/21.jpg)
Results Person-object differentiation Person Identification Varying average walk length Effects of untagged people
![Page 22: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/22.jpg)
Person-Object differentiation and ownership
20 people, 100 tags, probability of walk – 0.1, walk length - 5
![Page 23: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/23.jpg)
Person Identification
10% of users entering workspace simultaneously
![Page 24: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/24.jpg)
Programming Model Callbacks
InterZoneMovementEvent (tagID, startZone, endZone, Time)
ObjectInteractedEvent(tadID, Zone, Time) Lookups
GetTagList() GetPersonTags() GetOwnedObjects(tagID) GetTagType(tagID) GetTagOwner(tagID) GetPersonTagIdentity(tagID) GetZoneType(zone) GetTagsInZone(zone) GetTagWorkspaceZone(tagID) GetCurrentTagZone(tagID) GetCalendarEntry(ID, Time)
![Page 25: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/25.jpg)
Example Misplaced Object Alert
personTags = GetPersonTags()For each ownerTagID in personTags
ObjTags = GetOwnedObject(ownerTagID)OwnerZone = GetCurrentTagZone(ownerTagId)OwnerWorkspace = GetTagWorkspaceZone(ownerTagId)For each obj in ObjTags
objZone = GetCurrentTagZone(ownerTagId)if (objZone != OwnerZone && objZone !=
OwnerWorkspace)Raise Alert
![Page 26: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/26.jpg)
Applications Annotated video Semi-automated image catalog Misplaced object alert Automatic conference room booking
![Page 27: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/27.jpg)
Annotating video with physical events Events
Inter-zone movements Object Interaction
Tag video feed with events Person X interacted an object Y
Rich video database Support rich queries
Give me all videos where Person A interacted with Object B
Application: Integrate with enterprise security camera system
![Page 28: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/28.jpg)
Semi-automated Image catalog TagIDs are not user friendly Catalog tagID with its Image
User picks up an object Shows before the camera and takes a photo Automatic cataloging (TagID, Image)
![Page 29: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/29.jpg)
Annotating video with physical events
![Page 30: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/30.jpg)
Related Work Localization
LANDMARC Indoor Location Sensing Using Active RFID
Sherlock (UMass) Automatically locating objects for humans
Ferret (UMass) RFID Localization for Pervasive Multimedia
Platform Cascadia (UWashington)
Specifying, detecting and managing RFID events
Object Interaction I sense a disturbance in the force (Intel Research, Seattle)
Unobtrusive detection of Interactions with RFID-tagged Objects
With other sensors Fusion of RFID and Computer Vision (MSR)
![Page 31: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/31.jpg)
Summary SixthSense
Enterprise Setting People and Objects tagged RFID with other enterprise sensors
Components Automated Inference Platform Applications
http://research.microsoft.com/research/mns/projects/SixthSense/
Questions?
![Page 32: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/32.jpg)
Backup
![Page 33: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/33.jpg)
Semi-Automated Image Catalog TagID-Image Cataloging
User picks up a tagged object Hold it in front of the camera Clicks a picture Automatically identify the tagID of the object
![Page 34: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/34.jpg)
SixthSense SystemInference Engine, Database, Applications
RFID Reader
RFID Antennas
Calendar Data Presence Data
ApplicationsQueries
![Page 35: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/35.jpg)
Industry Tracking, Inventory, Supply Chain, Authentication
Research Measurements Improving reliability, security Localization RFID + Computer Vision Interaction detection RFID + other sensors
RFID Applications
![Page 36: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/36.jpg)
Person-Object Differentiation People can move on their own Objects move only when carried by a person
Co-movement based heuristic For every tag T, find co-movement tag set {T1, T2..Tn}
m – total inter-zone movement of T mi – total inter-zone movement of Ti ci – amount of co-movement exhibited by Ti with T
Declare the tag with the highest RM as person Eliminate this tags movements Repeat the algorithm till RM is positive Tags with negative RM are objects
![Page 37: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/37.jpg)
Zone Identification Individual workspace
If there is one person predominantly present in a zone Workspace of that person
Shared workspace If no one person is predominantly present in a zone Length of time from a person entry to exit < threshold
Reserved shared workspace Length of time people are present > threshold Common meeting entries in their calendars
Common areas Any space that is not classified as one of the above
![Page 38: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/38.jpg)
Challenges – Improving Reliability Multi-tagging scheme
Affix multiple tags in different orientation Increases the probability that atleast one of the tags being
detected
Automatic Inference Initially assume all tags belong to one giant super object
Fully connected graph When two tags are detected simultaneously in different
zones Tags belong to different objects Delete edges between them
Connected components Set of tags attached to the same object
![Page 39: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/39.jpg)
Evaluation – with untagged people
![Page 40: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/40.jpg)
Automatic Conference Room Booking Conference Room Zone is automatically
identified Reserved Space
Automatically book conference room If it is not reserved And bunch of people go into the conference room And spend say 5 minutes
![Page 41: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/41.jpg)
Discussion Privacy
Deployed and managed by enterprise Limited access to users Relabeling approach
Economic Feasibility Passive Tags are cheap Prices are RFID readers expected to drop (Intel
R1000) Health Implications
Transmitted RF power (up to 2W) is well within safe limits
this question will undoubtedly continue to receive much attention and study
![Page 42: SixthSense: RFID-based Enterprise Intelligence](https://reader036.vdocuments.us/reader036/viewer/2022062501/56816384550346895dd46a74/html5/thumbnails/42.jpg)