virtual new york city: project design capstone project, spring 2005 professor: zhigang zhu students:...
Post on 22-Dec-2015
215 views
TRANSCRIPT
![Page 1: Virtual New York City: Project Design Capstone Project, Spring 2005 Professor: Zhigang Zhu Students: Peter Giang Robert Hill Edgardo Molina Krishnan Ram](https://reader033.vdocuments.us/reader033/viewer/2022042717/56649d775503460f94a598be/html5/thumbnails/1.jpg)
Virtual New York City:
Project DesignCapstone Project, Spring 2005
Professor: Zhigang ZhuStudents: Peter Giang
Robert Hill Edgardo Molina
Krishnan Ram Emmanuel Velasco
![Page 2: Virtual New York City: Project Design Capstone Project, Spring 2005 Professor: Zhigang Zhu Students: Peter Giang Robert Hill Edgardo Molina Krishnan Ram](https://reader033.vdocuments.us/reader033/viewer/2022042717/56649d775503460f94a598be/html5/thumbnails/2.jpg)
Background of Virtual NYC Objective
Our project will accomplish two of our goals; to give traffic analysis of New York City and provide users newer, more interesting method of human-computer interaction with New York City.
Our program will include a 3-dimensional version of a New York City map that will allow users to navigate through the city using a keyboard and mouse. This gives users an advantage of virtually seeing New York, without having to physically be there.
![Page 3: Virtual New York City: Project Design Capstone Project, Spring 2005 Professor: Zhigang Zhu Students: Peter Giang Robert Hill Edgardo Molina Krishnan Ram](https://reader033.vdocuments.us/reader033/viewer/2022042717/56649d775503460f94a598be/html5/thumbnails/3.jpg)
Background of Virtual NYC Objective
Our project will demonstrate how we can use existing computer vision technologies to improve human-computer interaction. We hope the project will be a basis for many other future projects done by other groups.
![Page 4: Virtual New York City: Project Design Capstone Project, Spring 2005 Professor: Zhigang Zhu Students: Peter Giang Robert Hill Edgardo Molina Krishnan Ram](https://reader033.vdocuments.us/reader033/viewer/2022042717/56649d775503460f94a598be/html5/thumbnails/4.jpg)
Original Augmented NYC ProjectAugmentedNYC Features
AVI VideoFile Playing
TextureMapping
Camera (not shown)
![Page 5: Virtual New York City: Project Design Capstone Project, Spring 2005 Professor: Zhigang Zhu Students: Peter Giang Robert Hill Edgardo Molina Krishnan Ram](https://reader033.vdocuments.us/reader033/viewer/2022042717/56649d775503460f94a598be/html5/thumbnails/5.jpg)
Our Virtual NYC ProjectVirtualNYC Features
TextureMapping
AVI VideoFile Playing
Camera (not shown)
3D Models
Hotspots(not yet implemented)
Information Panel
![Page 6: Virtual New York City: Project Design Capstone Project, Spring 2005 Professor: Zhigang Zhu Students: Peter Giang Robert Hill Edgardo Molina Krishnan Ram](https://reader033.vdocuments.us/reader033/viewer/2022042717/56649d775503460f94a598be/html5/thumbnails/6.jpg)
AugmentedNYC to VirtualNYC GUI
AugmentedNYC uses the Microsoft Foundation Classes (MFC). We ported AugmentedNYC to VirtualNYC using the QT library.
Reasons we decided on QT: Cross-platform Easier to code More readable
![Page 7: Virtual New York City: Project Design Capstone Project, Spring 2005 Professor: Zhigang Zhu Students: Peter Giang Robert Hill Edgardo Molina Krishnan Ram](https://reader033.vdocuments.us/reader033/viewer/2022042717/56649d775503460f94a598be/html5/thumbnails/7.jpg)
AugmentedNYC to VirtualNYC GUI
Information Panel Info tab contains information
about hotspots on the map. Video tab contains information
on all of the videos located on the map.
Editor tab will allow us to add more hotspots and videos.
![Page 8: Virtual New York City: Project Design Capstone Project, Spring 2005 Professor: Zhigang Zhu Students: Peter Giang Robert Hill Edgardo Molina Krishnan Ram](https://reader033.vdocuments.us/reader033/viewer/2022042717/56649d775503460f94a598be/html5/thumbnails/8.jpg)
AugmentedNYC to VirtualNYC Video
We load an AVI file on and display it on the map.
Using computer vision techniques, we plan to extract each individual objects (cars) in a video and simulate traffic on the map.
![Page 9: Virtual New York City: Project Design Capstone Project, Spring 2005 Professor: Zhigang Zhu Students: Peter Giang Robert Hill Edgardo Molina Krishnan Ram](https://reader033.vdocuments.us/reader033/viewer/2022042717/56649d775503460f94a598be/html5/thumbnails/9.jpg)
VirtualNYC 3-Dimensional Map
2D to 3D
![Page 10: Virtual New York City: Project Design Capstone Project, Spring 2005 Professor: Zhigang Zhu Students: Peter Giang Robert Hill Edgardo Molina Krishnan Ram](https://reader033.vdocuments.us/reader033/viewer/2022042717/56649d775503460f94a598be/html5/thumbnails/10.jpg)
VirtualNYC 3-Dimensional Map
To create a virtual New York City, we place the user in a 3-dimensional world.
To give the user the feeling of 3-dimensional, we also add 3D buildings. Eventually we will add texture to the buildings, giving the buildings a more realistic look.
![Page 11: Virtual New York City: Project Design Capstone Project, Spring 2005 Professor: Zhigang Zhu Students: Peter Giang Robert Hill Edgardo Molina Krishnan Ram](https://reader033.vdocuments.us/reader033/viewer/2022042717/56649d775503460f94a598be/html5/thumbnails/11.jpg)
VirtualNYC Hotspots
For landmarks on the map, we have what we call hotspots. Clicking on these hotspots will give more information in the info panel. This feature is currently being developed.
Example:Clicking on CCNY displays information on the info panel.Clicking on the URL launches the user’s browser and displaysthe CCNY website.
![Page 12: Virtual New York City: Project Design Capstone Project, Spring 2005 Professor: Zhigang Zhu Students: Peter Giang Robert Hill Edgardo Molina Krishnan Ram](https://reader033.vdocuments.us/reader033/viewer/2022042717/56649d775503460f94a598be/html5/thumbnails/12.jpg)
Work in Progress Work on the applications performance
Memory usage / texture management Make the 3D rendering faster
Work on the interface Make it useful / intuitive Better Avatars / Icons
Make it run on at least one other platform Main obstacle is Video Libraries
Incorporate video analysis Segmentation and Background subtraction
![Page 13: Virtual New York City: Project Design Capstone Project, Spring 2005 Professor: Zhigang Zhu Students: Peter Giang Robert Hill Edgardo Molina Krishnan Ram](https://reader033.vdocuments.us/reader033/viewer/2022042717/56649d775503460f94a598be/html5/thumbnails/13.jpg)
Future Developments Satellite/Aerial Imagery (ala Google/Keyhole) Smarter video processing
Live streaming registered feeds Algorithms for Traffic Prediction
GPS information
![Page 14: Virtual New York City: Project Design Capstone Project, Spring 2005 Professor: Zhigang Zhu Students: Peter Giang Robert Hill Edgardo Molina Krishnan Ram](https://reader033.vdocuments.us/reader033/viewer/2022042717/56649d775503460f94a598be/html5/thumbnails/14.jpg)
Future Developments Real 3D terrain data
Captured through LIDAR 3D building / interior /
landmark data Captured through laser range
scanning systems Create fuller virtual tourism
experience