specialist tools for tackling the hidden web · 5/21/2006 · 21 may 2006 karen blakeman 3 what is...
TRANSCRIPT
![Page 1: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/1.jpg)
121 May 2006 Karen Blakeman www.rba.co.uk
Inforum 2006, Prague
Specialist Tools for Tackling theHidden Web
Karen BlakemanRBA Information Services
![Page 2: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/2.jpg)
221 May 2006 Karen Blakeman www.rba.co.uk
We have a problem
Web(Yahoo – 20 billion!)NewsPicturesVideoVideoAudio, podcasts
Formatted filesBlogsDiscussion boardsDatabasesBooksLearned journalsPre-prints etc. etc. etc.
![Page 3: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/3.jpg)
321 May 2006 Karen Blakeman www.rba.co.uk
What is the hidden web ?
− Sometimes called the invisible web, the deep web, the dark web
− Information that is not easy to find− may be there but not covered by Google et al. or
buried near the bottom of the results list− The massive web− The poorly ranked web − The unindexed web− The password protected web
![Page 4: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/4.jpg)
421 May 2006 Karen Blakeman www.rba.co.uk
General search techniques
− The massive web− what do you do with 9,726,780 results?
− most relevant may be near the bottom− imagine what you would like to appear in your ideal
document and include those words in your search− ask or partially answer your question in your search
− how fast can a hippopotamus run− a hippopotamus can run at
− use the advanced search− use alternative search terms or synonyms
![Page 5: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/5.jpg)
521 May 2006 Karen Blakeman www.rba.co.uk
![Page 6: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/6.jpg)
621 May 2006 Karen Blakeman www.rba.co.uk
The Google Sinker
− Named by Phil Bradley− Also works in Yahoo and Exalead− Repeat the most important words in your search
− beer market share belgium czech− beer market share belgium czech czech− beer market share belgium czech czech czech − beer market share belgium belgium czech czech czech− All give different results and change the order
![Page 7: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/7.jpg)
721 May 2006 Karen Blakeman www.rba.co.uk
Use a different search engine
− Different coverage− Different types of information
− news, image, video, blog search, audio etc. − Sort your results in a different order
− Yahoo - search.yahoo.com− ASK - www.ask.com− Exalead - www.exalead.com− MSN - search.msn.com
− ranking.thumbshots.com to compare results
![Page 8: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/8.jpg)
821 May 2006 Karen Blakeman www.rba.co.uk
![Page 9: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/9.jpg)
921 May 2006 Karen Blakeman www.rba.co.uk
![Page 10: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/10.jpg)
1021 May 2006 Karen Blakeman www.rba.co.uk
![Page 11: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/11.jpg)
1121 May 2006 Karen Blakeman www.rba.co.uk
Think “type of information”
− Statistics− official national statistics offices− www.library.auckland.ac.nz/subjects/stats/offstats/− www.nationmaster.com
− Information on companies− Official company registries− www.rba.co.uk/sources/registers.htm
− Peer reviewed articles− Scirus, Google Scholar (?), Windows Academic
Live, PubMed, priced databases – STN, Thomson, Proquest, Alacra .............
![Page 12: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/12.jpg)
1221 May 2006 Karen Blakeman www.rba.co.uk
Evaluated subject listings and portals
− Lists of sites assessed and evaluated by people knowledgeable in that subject
− Often include links to databases and resources not easily found by the search engines
− BUBL − www.bubl.ac.uk
![Page 13: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/13.jpg)
1321 May 2006 Karen Blakeman www.rba.co.uk
![Page 14: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/14.jpg)
1421 May 2006 Karen Blakeman www.rba.co.uk
![Page 15: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/15.jpg)
1521 May 2006 Karen Blakeman www.rba.co.uk
Evaluated subject listings and portals
− Lists of sites assessed and evaluated by people knowledgeable in that subject
− Often include links to databases and resources not easily found by the search engines
− BUBL − www.bubl.ac.uk
− Aerade, EEVL, Biome, Sosig etc.− listed in Pinakes− www.hw.ac.uk/libwww/irn/pinakes/pinakes.html
![Page 16: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/16.jpg)
1621 May 2006 Karen Blakeman www.rba.co.uk
![Page 17: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/17.jpg)
1721 May 2006 Karen Blakeman www.rba.co.uk
Evaluated subject listings and portals
− Lists of sites assessed and evaluated by people knowledgeable in that subject
− Often include links to databases and resources not easily found by the search engines
− BUBL − www.bubl.ac.uk
− Aerade, EEVL, Biome, Sosig etc.− listed in Pinakes− www.hw.ac.uk/libwww/irn/pinakes/oinakes.html
− Alacrawiki spotlights for industry sector information− www.alacrawiki.com
![Page 18: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/18.jpg)
1821 May 2006 Karen Blakeman www.rba.co.uk
![Page 19: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/19.jpg)
1921 May 2006 Karen Blakeman www.rba.co.uk
Use the right bit of the search engine
− Try out the alternative tabs and links on the search engine screen, for example news, images, video, audio, blogsearch
− Use specialist search tools− Technorati, Blogpulse, Google Blogsearch for blogs
and RSS− Morguefile, FreeFoto, Flickr – Creative Commons,
commons.wikimedia.org for images− Yahoo Video, Blinkx.TV for TV and radio interviews,
corporate promotions, monitoring competitors' advertisements
![Page 20: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/20.jpg)
2021 May 2006 Karen Blakeman www.rba.co.uk
![Page 21: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/21.jpg)
2121 May 2006 Karen Blakeman www.rba.co.uk
![Page 22: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/22.jpg)
2221 May 2006 Karen Blakeman www.rba.co.uk
How to find specialist search tools
− GoshMe− www.goshme.com
− Trovando− www.trovando.it
![Page 23: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/23.jpg)
2321 May 2006 Karen Blakeman www.rba.co.uk
![Page 24: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/24.jpg)
2421 May 2006 Karen Blakeman www.rba.co.uk
![Page 25: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/25.jpg)
2521 May 2006 Karen Blakeman www.rba.co.uk
RBA
![Page 26: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/26.jpg)
2621 May 2006 Karen Blakeman www.rba.co.uk
RBA
![Page 27: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/27.jpg)
2721 May 2006 Karen Blakeman www.rba.co.uk
RBA
![Page 28: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/28.jpg)
2821 May 2006 Karen Blakeman www.rba.co.uk
RBA
![Page 29: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/29.jpg)
2921 May 2006 Karen Blakeman www.rba.co.uk
RBA
![Page 30: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/30.jpg)
3021 May 2006 Karen Blakeman www.rba.co.uk
In summary...
− Use advanced search options to bring relevant documents further up your results lists
− Use a different search engine− Use the media-type areas of the search engine
such as images, video, blog or try a specialist tool − Try an evaluated subject listing− Think “type of information” - that will guide you to
the most appropriate resource
![Page 31: Specialist Tools for Tackling the Hidden Web · 5/21/2006 · 21 May 2006 Karen Blakeman 3 What is the hidden web ? − Sometimes called the invisible web, the deep web, the dark](https://reader036.vdocuments.us/reader036/viewer/2022071016/5fcf25aa9f9f985f6a104f42/html5/thumbnails/31.jpg)
3121 May 2006 Karen Blakeman www.rba.co.uk
Karen BlakemanRBA Information ServicesTel: +44 118 947 [email protected]/rss/blog.htm