![Page 1: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/1.jpg)
Airbnb Scraping
Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu
CS 4624 Multimedia, Hypertext, and Information AccessInstructor: Fox, Edward A.Virginia Tech, Blacksburg, VA 24061, May 9, 2020
![Page 2: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/2.jpg)
Outline
● Background
● Work Completed
● Data
● Timeline
● Visualization
● Website
● Testing and Assessment
● The Future
● Acknowledgements/References
![Page 3: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/3.jpg)
Background
- Impact of Airbnb on local residents
- Lower the price of short rentals
- Transient occupancy tax
![Page 4: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/4.jpg)
Where We Come In
- Our job is to scrape data from Airbnb
- Starting with open-source code
- Visualize data for future research
![Page 5: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/5.jpg)
Completed
● Tableau -> Python with pyechart.
○ Static maps and dynamic graphs.
● Data collection.
○ Expanded script.
○ Docker.
● Websites done. Some designs have been changed.
○ Can select different regions.
● Collected data for Austria, now collecting data for rural Virginia.
![Page 6: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/6.jpg)
Review Data
![Page 7: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/7.jpg)
Listing Data
![Page 8: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/8.jpg)
Calendar Data
![Page 9: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/9.jpg)
Old Code Up
Code mostly working
Website Up
Think of automation
Map & Charts
Data Collecting
Visualization on Website
Data Collecting
Old Code Understood
<- Currently
![Page 10: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/10.jpg)
Visualizations
![Page 11: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/11.jpg)
Geomap
A geographic graph
for the room types
distribution in
Austria
Austria
![Page 12: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/12.jpg)
Geomap – Montgomery Co.
![Page 13: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/13.jpg)
An interactive stacked bar chart for the representation of room types, prices, and timeline
An interactive pie chart of room types
![Page 14: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/14.jpg)
The relationship between reviews
and prices
People vs. How many properties
they own
.
![Page 15: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/15.jpg)
A WordCloud map for
the reviews from the
users for Montgomery
County
NLTK, Stop Words,
Word Frequency
![Page 16: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/16.jpg)
Website
- List
- Switch between different county and countries
- Display visualizations
![Page 17: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/17.jpg)
Website
- Old design
![Page 18: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/18.jpg)
Website
- New Design
![Page 19: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/19.jpg)
Website
![Page 20: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/20.jpg)
Website
![Page 21: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/21.jpg)
Testing and Assessment
- User interviews
- Benchmark testing
- Surveys
![Page 22: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/22.jpg)
Lessons Learned
![Page 23: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/23.jpg)
Ideas for the Future
- Make the website more visually appealing
- Dynamic and interactive maps
- More visualizations
- Collect data on other regions
![Page 24: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/24.jpg)
Acknowledgements
Clients:
Dr. Florian Zach
![Page 25: Airbnb Scraping - vtechworks.lib.vt.edu · Airbnb Scraping Vinh Pham, Alex Nikolov, Alan Huang, Sabrina Wang, Han Liu CS 4624 Multimedia, Hypertext, and Information Access Instructor:](https://reader035.vdocuments.us/reader035/viewer/2022063023/5fee933b70a58e047b50d9c9/html5/thumbnails/25.jpg)
Questions?