mining the “deep web” - bates information servicesreluctant-entrepreneur.com the “deep web”...
TRANSCRIPT
![Page 1: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/1.jpg)
Reluctant-Entrepreneur.com
Mining the “DeepWeb”
Mary Ellen BatesReluctant–Entrepreneur.comAugust 16, 2017
![Page 2: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/2.jpg)
Reluctant-Entrepreneur.com
What’s the “Dark Web”?
Accessible only through anonymousnetworks
Black-market content (drugs, hackingsoftware, porn)Free-speech forumsDrop-sites for leaks
6
![Page 3: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/3.jpg)
Reluctant-Entrepreneur.com
Search engines are blocked by…
8
![Page 4: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/4.jpg)
Reluctant-Entrepreneur.com
The “Deep Web” is…
Info that search engines can’t easilyfind, get into or read
DatabasesImages, multimedia, statisticsBooks, articlesFacebook and other social media*
*tomorrow at 10:15
9
![Page 5: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/5.jpg)
Reluctant-Entrepreneur.com
Deep Web strategies
Look for the next lead, not The Answer
Treat it as a treasure huntWatch for clues, lists of resources
Build your own “library” of sources
10
![Page 6: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/6.jpg)
Reluctant-Entrepreneur.com
Horticultural resources
plants.usda.gov
garden.org
catalog.extension.org
11
![Page 7: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/7.jpg)
Reluctant-Entrepreneur.com
Business resources
SCORE.org
SBA.gov
inc.com/grow
Pixabay.com (free images)
13
![Page 8: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/8.jpg)
Reluctant-Entrepreneur.com
Finding deep web content
Use search engines for leads:Keywords (database OR dataset ORarchive)Keywords (portal OR resources OR“online tool”)
15
![Page 9: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/9.jpg)
Reluctant-Entrepreneur.com
Finding deep web content
Start with one known source (ass’n,agency, non-profit, library, etc.)
Then find their links to other resources
Look for mentions OF that sitee.g. “consumerhort.org”
16
![Page 10: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/10.jpg)
Reluctant-Entrepreneur.com
Find “similar” sites
SimilarSites.comBased on content, link analysis, userbehavior, etc.Use to find other good sites
17
![Page 11: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/11.jpg)
Reluctant-Entrepreneur.com
We librarians
Librarians build “libguides”Road map for better research on a topicLoaded with deep web links
inurl:libguides ("garden center" ORgardening OR horticulture)
19
![Page 12: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/12.jpg)
Reluctant-Entrepreneur.com
Libraries have deep web!
Stick around for “HiddenDatabases: Accessing PricelessMarket Research… WithoutSpending a Dime”
21
![Page 13: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/13.jpg)
Reluctant-Entrepreneur.com
Insights from other shows
ID relevant conferences("garden show" OR "horticulturalshow") trends
Be sure to limit the search to this yearThen….
22
![Page 14: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/14.jpg)
Reluctant-Entrepreneur.com
Insights from other shows
Find the web site for that showScan workshops, keynotesLook up those speakers, see theirweb pages
23
![Page 15: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/15.jpg)
Reluctant-Entrepreneur.com
Insights from expen$ive reports
ID the title of a useful report
Google mentions of that report andthe word trends
"according to the 2017 NationalGardening Survey" trends
24
![Page 16: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/16.jpg)
Reluctant-Entrepreneur.com
Has a page disappeared?
Try the Wayback Machine(archive.org)
Copies of the page over time
25
![Page 17: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/17.jpg)
26
![Page 18: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/18.jpg)
Reluctant-Entrepreneur.com
Has a page disappeared?
Try the Google cached copyCopy the URL into Google’s search boxClick the next to the link
27
![Page 19: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/19.jpg)
28
![Page 20: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/20.jpg)
Reluctant-Entrepreneur.com
The Deep Web = 2nd pageof Google search results
Go deeper!
Change your settings to 100 results
30
![Page 21: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/21.jpg)
31
![Page 22: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/22.jpg)
Reluctant-Entrepreneur.com
“Hidden” search results
Use Millionshort.com to see otherresults
“Long-tail” search engineEliminates the most popular sitesFind obscure and less-commercialsites
32
![Page 23: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/23.jpg)
33
![Page 24: Mining the “Deep Web” - Bates Information ServicesReluctant-Entrepreneur.com The “Deep Web” is… Info that search engines can’t easily find, get into or read Databases Images,](https://reader034.vdocuments.us/reader034/viewer/2022042203/5ea49420d94f8d492d036f06/html5/thumbnails/24.jpg)
Reluctant-Entrepreneur.com
Slide deck is at
Reluctant–Entrepreneur.com/extras(or just text me)
Mary Ellen Bates+1 303 772 [email protected]: @mebs
34