how we spiked the hbs water supply with solr
TRANSCRIPT
![Page 1: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/1.jpg)
Copyright © President & Fellows of Harvard College
How we spiked the HBS water supply with Solr
Ravi Mynampaty
![Page 2: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/2.jpg)
About Ravi
A little Search Hacker In Training
![Page 3: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/3.jpg)
What’s this session about?
![Page 4: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/4.jpg)
Agenda
● Roadmap● Architecture● Demo!
![Page 5: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/5.jpg)
2012
![Page 6: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/6.jpg)
![Page 7: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/7.jpg)
![Page 8: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/8.jpg)
![Page 9: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/9.jpg)
![Page 10: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/10.jpg)
Search Engine: The Candidates
![Page 11: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/11.jpg)
Biz and Technical Requirements
![Page 12: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/12.jpg)
Built some prototypes
![Page 13: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/13.jpg)
A prophecy fulfilled...
![Page 14: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/14.jpg)
![Page 15: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/15.jpg)
Index Replication
![Page 16: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/16.jpg)
Data Ingestion 1: Crawl pages
![Page 17: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/17.jpg)
Data Ingestion 2: Solr XML Export
![Page 18: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/18.jpg)
Data Ingestion 3: Java Loader
![Page 19: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/19.jpg)
Data Ingestion 3: Java Loader
![Page 20: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/20.jpg)
2013
![Page 21: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/21.jpg)
![Page 22: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/22.jpg)
2014
![Page 23: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/23.jpg)
2014: Dealing with dirty data
![Page 24: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/24.jpg)
![Page 25: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/25.jpg)
Dirty data: Biz Rules Module
![Page 26: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/26.jpg)
2014: Solr-powered Geolocation
![Page 27: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/27.jpg)
2014: Exed Program Finder
![Page 28: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/28.jpg)
2014: Exed Program Finder Chinese
![Page 29: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/29.jpg)
2014: ISC Site
![Page 30: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/30.jpg)
2015
![Page 31: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/31.jpg)
2015: One search box to rule them all
![Page 32: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/32.jpg)
2015
![Page 33: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/33.jpg)
2015: Improve Infrastructure
![Page 34: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/34.jpg)
2015: SolrCloud
![Page 35: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/35.jpg)
2015: Empower the developer
![Page 36: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/36.jpg)
![Page 37: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/37.jpg)
2015: Eliminate crawl pages
![Page 38: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/38.jpg)
2015: HBS site-wide search w/Solr
Retire Ultraseek :o(
![Page 39: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/39.jpg)
2016: Eliminate FAST
![Page 40: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/40.jpg)
● DR● Intranet Search● People search● Solr as an aggregator● ...and many more
2016
![Page 41: How we spiked the HBS water supply with Solr](https://reader030.vdocuments.us/reader030/viewer/2022020314/58ed38f31a28ab98528b45f1/html5/thumbnails/41.jpg)
Demo!
● Alumni● WK● Dev Dashboard