![Page 1: Joe Acanfora, Briana Crabb, Jeff Morris Website · 2020. 1. 30. · Joe Acanfora, Briana Crabb, Jeff Morris CS 4624 Multimedia and Hypertext - a Capstone May 5, 2015 Virginia Tech](https://reader035.vdocuments.us/reader035/viewer/2022063017/5fd9b506d8223c1b9c549f03/html5/thumbnails/1.jpg)
News Event Detection Website
Joe Acanfora, Briana Crabb, Jeff Morris
CS 4624 Multimedia and Hypertext - a CapstoneMay 5, 2015
Virginia Tech College of Engineering Department of Computer Science
Dr. Edward A. Fox
![Page 2: Joe Acanfora, Briana Crabb, Jeff Morris Website · 2020. 1. 30. · Joe Acanfora, Briana Crabb, Jeff Morris CS 4624 Multimedia and Hypertext - a Capstone May 5, 2015 Virginia Tech](https://reader035.vdocuments.us/reader035/viewer/2022063017/5fd9b506d8223c1b9c549f03/html5/thumbnails/2.jpg)
Overview 1. Project Purpose and Background 2. Twitter crawling script 3. Web crawling script 4. Reporting Service
![Page 3: Joe Acanfora, Briana Crabb, Jeff Morris Website · 2020. 1. 30. · Joe Acanfora, Briana Crabb, Jeff Morris CS 4624 Multimedia and Hypertext - a Capstone May 5, 2015 Virginia Tech](https://reader035.vdocuments.us/reader035/viewer/2022063017/5fd9b506d8223c1b9c549f03/html5/thumbnails/3.jpg)
Project BackgroundThe digital archive is a database to collect large amounts of articles about large events and to summarize those events.
Event Summary
![Page 4: Joe Acanfora, Briana Crabb, Jeff Morris Website · 2020. 1. 30. · Joe Acanfora, Briana Crabb, Jeff Morris CS 4624 Multimedia and Hypertext - a Capstone May 5, 2015 Virginia Tech](https://reader035.vdocuments.us/reader035/viewer/2022063017/5fd9b506d8223c1b9c549f03/html5/thumbnails/4.jpg)
Project Purpose The overall objective of this project was to build a website front end to help the client automate the web archiving process for their big data doctorate research.
![Page 5: Joe Acanfora, Briana Crabb, Jeff Morris Website · 2020. 1. 30. · Joe Acanfora, Briana Crabb, Jeff Morris CS 4624 Multimedia and Hypertext - a Capstone May 5, 2015 Virginia Tech](https://reader035.vdocuments.us/reader035/viewer/2022063017/5fd9b506d8223c1b9c549f03/html5/thumbnails/5.jpg)
A Quick Walk Through
![Page 6: Joe Acanfora, Briana Crabb, Jeff Morris Website · 2020. 1. 30. · Joe Acanfora, Briana Crabb, Jeff Morris CS 4624 Multimedia and Hypertext - a Capstone May 5, 2015 Virginia Tech](https://reader035.vdocuments.us/reader035/viewer/2022063017/5fd9b506d8223c1b9c549f03/html5/thumbnails/6.jpg)
http://babs.dlib.vt.edu/twitter/index2.php
![Page 7: Joe Acanfora, Briana Crabb, Jeff Morris Website · 2020. 1. 30. · Joe Acanfora, Briana Crabb, Jeff Morris CS 4624 Multimedia and Hypertext - a Capstone May 5, 2015 Virginia Tech](https://reader035.vdocuments.us/reader035/viewer/2022063017/5fd9b506d8223c1b9c549f03/html5/thumbnails/7.jpg)
input data
![Page 8: Joe Acanfora, Briana Crabb, Jeff Morris Website · 2020. 1. 30. · Joe Acanfora, Briana Crabb, Jeff Morris CS 4624 Multimedia and Hypertext - a Capstone May 5, 2015 Virginia Tech](https://reader035.vdocuments.us/reader035/viewer/2022063017/5fd9b506d8223c1b9c549f03/html5/thumbnails/8.jpg)
Brings us to yourtwapper
![Page 9: Joe Acanfora, Briana Crabb, Jeff Morris Website · 2020. 1. 30. · Joe Acanfora, Briana Crabb, Jeff Morris CS 4624 Multimedia and Hypertext - a Capstone May 5, 2015 Virginia Tech](https://reader035.vdocuments.us/reader035/viewer/2022063017/5fd9b506d8223c1b9c549f03/html5/thumbnails/9.jpg)
some of the previous twitter searches we have done
![Page 10: Joe Acanfora, Briana Crabb, Jeff Morris Website · 2020. 1. 30. · Joe Acanfora, Briana Crabb, Jeff Morris CS 4624 Multimedia and Hypertext - a Capstone May 5, 2015 Virginia Tech](https://reader035.vdocuments.us/reader035/viewer/2022063017/5fd9b506d8223c1b9c549f03/html5/thumbnails/10.jpg)
focused crawler output
![Page 11: Joe Acanfora, Briana Crabb, Jeff Morris Website · 2020. 1. 30. · Joe Acanfora, Briana Crabb, Jeff Morris CS 4624 Multimedia and Hypertext - a Capstone May 5, 2015 Virginia Tech](https://reader035.vdocuments.us/reader035/viewer/2022063017/5fd9b506d8223c1b9c549f03/html5/thumbnails/11.jpg)
HTML email sent upon completion
![Page 12: Joe Acanfora, Briana Crabb, Jeff Morris Website · 2020. 1. 30. · Joe Acanfora, Briana Crabb, Jeff Morris CS 4624 Multimedia and Hypertext - a Capstone May 5, 2015 Virginia Tech](https://reader035.vdocuments.us/reader035/viewer/2022063017/5fd9b506d8223c1b9c549f03/html5/thumbnails/12.jpg)
Cloud9/Bluehost● Blocking of PHP Functions● Lack of SSH
Calling PHP Scripts non locallyCalling Python Scripts from Flask
Problems Faced
![Page 13: Joe Acanfora, Briana Crabb, Jeff Morris Website · 2020. 1. 30. · Joe Acanfora, Briana Crabb, Jeff Morris CS 4624 Multimedia and Hypertext - a Capstone May 5, 2015 Virginia Tech](https://reader035.vdocuments.us/reader035/viewer/2022063017/5fd9b506d8223c1b9c549f03/html5/thumbnails/13.jpg)
Acknowledgements
Mohamed Magdy Gharib Farag
● project sponsor ● [email protected]
PhD. Edward A. Fox
● class professor ● [email protected]
Sunshin Lee ● extra resource ● [email protected]