universal real-time navigational...

49
Universal Real-time Navigational Assistance March 22, 2007

Upload: others

Post on 23-Apr-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

UniversalReal-timeNavigationalAssistance

March 22, 2007

Page 2: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Project Motivation• Originally proposed by Roberto Manduchi:

“Design and prototype a small Bluetooth transmitter that can be used to broadcast information to anyone carrying a Bluetooth cell phone.”

• “Transmitters could be embedded in critical locations, such as at a bus stop, at a traffic intersection, or near a building entrance, in order to provide useful information to visually impaired (as well as sighted) individuals.”

Page 3: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Existing Solutions• Problems

• Infrared communication• Bulky receiver• Expensive• No expandability• Difficult to use

Talking Signs: Infrared wireless technologyhttp://www.talkingsigns.com/

Bluetooth-based pedestrian GPShttp://www.senderogroup.com/

Page 4: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Our ConceptA typical intersection withcrosswalks and traffic lights

• Bluetooth transceivers installed at each of the four corners atop pedestrian counters.

• Information including traffic light status and street name information is relayed to Bluetooth-capable mobile phones

Page 5: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Demo Layout

Page 6: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

System Architecture• NavCon

• Altera Cyclone II FPGA core

• Interfaces with ASC/3 traffic controller and Bluetooth transceivers (modules)

Page 7: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

System Architecture• Econolite ASC/3-

2100 traffic controller

Page 8: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

System Architecture• NavCon main

board

Page 9: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

System Architecture• Bluetooth

modules with custom antennas

Page 10: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

System Architecture• Bluetooth

transmission to nearby mobile phones running our PedNav software

Page 11: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Physical System

NavCon PCB and Bluetooth PCB’s

Page 12: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Hardware• Field-Programmable Gate Array

• Nios II soft-processor running the µClinux operating system

• Non-volatile Flash memory• Store µClinux OS and programs

• Input/Output• Ethernet to ASC/3 traffic controller• RS-422 over CAT 5e to Bluetooth

modules

http://en.wikipedia.org/wiki/Image:Cat5.jpg

http://www.altium.com/

Page 13: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Power Distribution

Page 14: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Power Distribution

Page 15: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Power Distribution

Page 16: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Power Distribution

Page 17: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Power Distribution

Page 18: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Power Distribution

Page 19: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Power Distribution

Page 20: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Power Budget

PART NAME PART MODELVOLTAGE

(V) CURRENT (mA) POWER (mW)

FPGA EPC2C8 3.3, 1.2 200 660

SDRAM MT48LC4M32B2P-6 3.3 160 528

SERIAL FLASH EPCS64N 3.3 15 49.5

ETHERNET LAN LAN91C111 3.3 140 462

RS-422 ADM3490 3.3 8.8 (4) 116

CLOCK BUFFER CDCV304 3.3 0.005 0.0165

BLUETOOTH MODULE OEMSPA333 3.3 200 (4) 2640

TOTAL 1350 4455.5165

Page 21: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Protocol Flow

NavCon PCBASC/3 Traffic Controller

Bluetooth PCB

PedNav running on phone

(SNMP to PedNav Protocol)

NTCIP using SNMP over

Ethernet

Bluetooth transmissionat 2.4 GHz

RS-422trans-

mission

Page 22: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Antenna Design• Nec-Win Pro for antenna

simulation• Ground plane Yagi

antenna• Provides directionality

• Minimize overlap by creating a dead zone between multiple transmitters

Page 23: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Software ArchitectureNavCon

Third-party libraries

Linux kernelsubsystems

Linux kernel

Hardware Layer

Page 24: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Software ArchitectureNavCon

Third-party libraries

Linux kernelsubsystems

Linux kernel

Hardware Layer

Page 25: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Software ArchitectureNavCon

Third-party libraries

Linux kernelsubsystems

Linux kernel

Hardware Layer

Page 26: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Software ArchitectureNavCon

Third-party libraries

Linux kernelsubsystems

Linux kernel

Hardware Layer

Page 27: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Software ArchitectureNavCon

Third-party libraries

Linux kernelsubsystems

Linux kernel

Hardware Layer

Page 28: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Software ArchitectureNavCon

Third-party libraries

Linux kernelsubsystems

Linux kernel

Hardware Layer

Page 29: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Software ArchitectureNavCon

Third-party libraries

Linux kernelsubsystems

Linux kernel

Hardware Layer

Page 30: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Software ArchitectureNavCon

Third-party libraries

Linux kernelsubsystems

Linux kernel

Hardware Layer

Page 31: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Software ArchitectureNavCon

Third-party libraries

Linux kernelsubsystems

Linux kernel

Hardware Layer

Page 32: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Software ArchitectureNavCon

Third-party libraries

Linux kernelsubsystems

Linux kernel

Hardware Layer

Page 33: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Software ArchitectureNavCon

Third-party libraries

Linux kernelsubsystems

Linux kernel

Hardware Layer

Page 34: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Software ArchitectureNavCon

Third-party libraries

Linux kernelsubsystems

Linux kernel

Hardware Layer

Page 35: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Software ArchitectureNavCon

Third-party libraries

Linux kernelsubsystems

Linux kernel

Hardware Layer

Page 36: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

NavCon Software ArchitectureNavCon

Third-party libraries

Linux kernelsubsystems

Linux kernel

Hardware Layer

Page 37: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Security Considerations• Bluetooth guarantees data integrity but

not authenticity• We do not need encryption• We need to know who to trust – use

certificates!• Certificate Authority – some trusted

organization (eg. City of Santa Cruz)• Intersection claiming to be Mission &

Bay – how to verify?• Request it to send its certificate• Check that it is signed by a trusted CA

• PedNav bundled with a set of trusted certificates• On a new connection, the security certificate

is requested and verified to make sure the intersection is authorized

http://www.nokia.com/nseries/

Page 38: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

PedNav Protocol

Page 39: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

PedNav• Java 2 Micro Edition (J2ME) application that runs on

nearly all modern (> 2003) phones supporting Bluetooth

• Target user audience requires careful consideration of user input and feedback—GUI is nice but will not really benefit the user

• Input: Left/Right/Up/Down/Center buttons, numbers on keypad

• Output: spoken text• Real-time streaming of pre-recorded audio files from

NavCon• Playback of pre-recorded audio files stored on the phone• Dynamic messages using text-to-speech (TTS)

••

Page 40: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

User Interface Usability

AlertConnection Made

Welcome Message

General AnnouncementLocation, Street Names,

etc.

More General InformationLeft/Right, Nearby Services,

etc.

Traffic Light Information

Left Crosswalk Right Crosswalk

IdleDisconnectedNo Speech

• Common buttons• B1 – more details• B2 – repeat message• B3 – go back up in the

menu• B4 – ignore this message

• Button-based voice-guided hierarchical menu provides geographically relevant information

• Like an automated answering service, but less annoying (no more “listen carefully because the menu options have changed”)

Page 41: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Time SpentURNA Hours

Page 42: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

System CostPART NAME PART MODEL MANUFACTURER # OF UNIT COST

FPGA EPC2C8 ALTERA 1 100*

SDRAMMT48LC4M32B2P-

6 MICRON TECH. 1 11.42

SERIAL FLASH EPCS64N ALTERA 1 5*

ETHERNET LAN CONTR. LAN91C111 SMSC 1 24

RS-422 ADM3490ANALOG

DEVICES 8 23.6

CLOCK BUFFER CDCV304 TEXAS INTR. 1 2.36

BLUETOOTH MODULE OEMSPA333 CONNECT BLUE 4 460

MISC. CAPS, RES, …. ……… 200 68.62*

TOTAL 217 695* approximate

Page 43: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Correspondence

EMAIL ADDRESSES CENSORED

Page 44: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Reply Statistics

0 50 100 150 200 250 300

Cities

E-mails wrote

Cities responded

Responded withoffers

E-m

ails

Page 45: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Mounting Solution

Page 46: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Future Expansion

• Install anywhere!• Bus stop• Shopping mall• Bathroom• School• Subway

Page 47: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Thank You• BELS staff – Dave and SuperDave• Joel from OpenSPARC• Chuck from SkyNet• Matt & Cameron from AEGIS• Karen from BEEDL• Professor Petersen• Cyrus Bazeghi and Wentai Liu• All of our sponsors

Page 48: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Our Sponsors• Professor Roberto Manduchi

• http://www.soe.ucsc.edu/~manduchi/

• Econolite Control Products, Inc.• http://www.econolite.com/

• Altera Corporation• http://www.altera.com/

• Gelcore• http://www.gelcore.com/

• connectBlue• http://www.connectblue.se/

Page 49: Universal Real-time Navigational Assistanceurna.projects.unoc.net/media/urna_123b_final_project... · 2007-03-24 · Jack Baskin School of Engineering CMPE 123B | Winter 2007 Project

Jack Baskin School of EngineeringCMPE 123B | Winter 2007

Questions?

http://urna.projects.unoc.net/