Gary Chan

Professor, Department of Computer Science and Engineering

The Hong Kong University of Science and Technology

1

2

3

Outdoor Global Positioning System (GPS)

Based on satellites Successful outdoor Location-Based Services (LBS) Widely commercialized

− Navigation, places of interest, hotels, parks, etc.

4

Indoor Location-Based Services (LBS)

Even larger market: more than 70% of our time is spent indoors Don Dodge, developer advocate at Google

Many indoor LBS with important business applications or lucrative commercial potentials

5

Indoor LBS Mall, super-mart and shopping booths

Help customers to find shops

Location-based recommendations, advertisement and marketing

Behavior shaping, etc.

Airport: Help tourists to find their departure gates after check-in

transit flights from one gate to another

shop while waiting for flights

Social applications: finding nearby people

Enables O2O (online-to-offline) services

Track assets or people

6

Three Kinds of Location Queries

Localization: Where am I?

Tracking: Where am I over time?

Navigation: How can I go from Point A to Point B?

User experience depends largely on the accuracy of the localization technique!

7

Challenges of Indoor GPS

Global Positioning System (GPS) simply does not work indoor! − Line-of-sight not easily achievable indoor

Complicated indoor environment leads to complex signal fading, shadowing and interference

High requirements − High accuracy (~5m) − Computationally light-weighted − Memory efficient − Cost-effective to deploy − Privacy, etc.

8

Application Venues

Malls are the most mapped venues around the world

Airports come second

Growing works on advertising and analytics to target customers in these venues

Commerce 79%

Airports 13%

Other 8%

4th Qtr 0%

9

10

Turning Research to Deployment Trials: The Golden Triangle

Government − ITC LSCM − Innovation and Technology

Funds (ITF)

Technology Transfer Center, Department and School of Engineering at HKUST − Advices and support on

contractual agreements − R&D facilities and human

resources

Industry sponsors and collaborators − Funding, technical support,

trial sites, equipment, etc

Tech.

Transfer

Wherami

11

Wherami: Indoor Localization Project Based on Wi-Fi Signals Supported by ITC LSCM and industries Smart guide on smart-phones

− Beyond just “digital map”

How can I get there? What’s interesting going on around me? Are any good promotions being offered

around me? Are my friends around me? …

12

Use of Wi-Fi Localization Pervasive deployment

In HKUST atrium, we can detect more than 400 AP hot spots (HKUST 2013-08-08)

The dominant localization technology by 2015

Easy and cost-effective to deploy

(source: ABI research indoor location report) Wi-Fi (Possily

combined with sensor

fusion, Cell or other) 75%

Bluetooth 4.0 15%

Other (LED...)

10%

13

Fingerprint Concept

Each person has a unique fingerprint

− Stored in a database

Given a fingerprint

− Match it to the database

− Find the person

14

Each Position Has a Unique Wi-Fi Fingerprint

Site Survey to Collect Fingerprints

User Location Calculation

Research Challenge: Measurement Noise

Integration with Other Signals

INS (inertial navigation system) − Gyroscope, accelerometer, etc.

Barometer

Bluetooth

iBeacon

RFID

Ultrasound

Etc.

19

Beacon 1 Beacon 2

Beacon 4

Beacon 3

Wherami: Technology Features Research driven Low cost, easy and fast to deploy

− Based on WiFi fingerprinting − Non-intrusive and transparent to existing WiFi

infrastructure

Accurate and low computation Low site survey cost

− Adaptive to signal changes

“No string attached” − Based on solely Android clients, no additional wearing tags

Ready to be integrated into other applications − Location API is provided

20

Efficient 3-D Routing Algorithm

Level 2

Level 1 Start

End 3D environment

21

Region Constraint in Digital Map

22

Shopping Mart or Superstore

Large area with many aisles

Aim for better shopping experience − For hot limited-time offers

− For shoppers with shopping lists

− Location-based promotions

Targeted advertisement (preference analysis)

23

Shopping Mall

24

Hospital and Elderly Home

25

26

Location-based Guide in Museum

27

Where is the check-in counter for Hong Kong Airline? The closest restaurant?

How to get to Gate 24? Push-based ads: there is a

discount in the coffee shop nearby!

Hong Kong International Airport

28

HKIA trials

29

Checkin asile K, J, H

Gate 20~26

Meeting Hall

Trials in HKIA

30

Fingerprint Collection and Analysis

31

Demonstration

32

Cyberport Trial

33

Trial area: 1. The Arcade – whole

building 2. Cyberport 1 – floor L 3. Cyberport 2 – floor L 4. Cyperport 3 – floor L3

and L4

34

Cyberport Trial

Navigation through the Arcade What are the restaurant nearby? What’s around me (panoramic

view)? Where is the cinema? Sale! Sale! Sale!

HKUST Campus

35

Trial area: 1. Academic Building 2. Lee Shau Kee Business

Building 3. Institute of Advanced

Study Building

HKUST Deployment

36

Wherami App -- Available on GooglePlay

Wherami HKUST

Wherami Cyberport

37

38

Navigation Content Search Localization

Visit us at:

http://mwnet.cse.ust.hk/wherami

39