a. frank multimedia multimedia/video search. 2 a. frank contents multimedia (mm) and...
Post on 21-Dec-2015
225 views
TRANSCRIPT
![Page 1: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/1.jpg)
A. Frank
Multimedia
Multimedia/Video Search
![Page 2: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/2.jpg)
A. Frank2
Contents
• Multimedia (MM) and search/retrieval
• Text-based MM search in General SEs
• Text-based MM search in Vertical SEs
• Tag-based MM search
• Content-based MM search
![Page 3: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/3.jpg)
A. Frank3
Multimedia Resources
• ,Pictures, Photos, Maps תמונות – Graphics, Animations
• Audio, Sounds – שמע
• Music, MP3 –מוסיקה
• Radio, Podcasts, Speeches – הקלטות
• Video, Flash, Vlogs –חוזי
• Movies, TV – סרטים
![Page 4: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/4.jpg)
A. Frank4
MM Search & Information Retrieval (MMIR)
• Search & information retrieval of multimedia objects is hard!!• Using SEs to find relevant, quality MM objects can be difficult
and frustrating. • Sample query: find a movie that has a large mouse chasing a
Persian cat with twins watching from above?• Common MM search is text-based; object text can be
derived from:– caption of the MM object – text surrounding the MM object– filenames of MM object and the containing page– manual/automatic annotations
• Recently, tag-based MM search is effective (social computing).• However, long due, content-based MM search on the Web
is forthcoming.
![Page 5: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/5.jpg)
A. Frank5
Contents
• Multimedia (MM) and search/retrieval
• Text-based MM search in General SEs
• Text-based MM search in Vertical SEs
• Tag-based MM search
• Content-based MM search
![Page 6: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/6.jpg)
A. Frank6
Multimedia: Google
![Page 7: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/7.jpg)
A. Frank7
Multimedia: Google
![Page 8: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/8.jpg)
A. Frank8
Multimedia: Yahoo
![Page 9: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/9.jpg)
A. Frank9
Yahoo Audio Search
![Page 10: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/10.jpg)
A. Frank10
![Page 11: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/11.jpg)
A. Frank11
AOL Video Search
![Page 12: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/12.jpg)
A. Frank12
Multimedia: MSN Live
![Page 13: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/13.jpg)
A. Frank13
MSN Live
![Page 14: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/14.jpg)
A. Frank14
MSN Live Search
![Page 15: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/15.jpg)
A. Frank15
AltaVista Multimedia Search
![Page 16: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/16.jpg)
A. Frank16
Contents
• Multimedia (MM) and search/retrieval
• Text-based MM search in General SEs
• Text-based MM search in Vertical SEs
• Tag-based MM search
• Content-based MM search
![Page 17: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/17.jpg)
A. Frank17
Images: Picsearch
![Page 18: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/18.jpg)
A. Frank18
Picsearch Advanced Interface
![Page 19: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/19.jpg)
A. Frank19
Audio: FindSounds
![Page 20: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/20.jpg)
A. Frank20
Types of Sounds
![Page 21: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/21.jpg)
A. Frank21
Video: SearchVideo
![Page 22: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/22.jpg)
A. Frank22
Video: Clipblast!
• Organizes and makes the video Web relevant, fast and simple to navigate.
• Video Search and Navigation technology makes it easy to search, browse and personalize the video that viewers want, when they want it.
• Crawls the entire Web for all video content available, indexing more video content providers than any other video search engine.
• Largest video distribution platform ever.
![Page 23: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/23.jpg)
A. Frank23
Video: Clipblast
![Page 24: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/24.jpg)
A. Frank24
Multimedia: Flurl
![Page 25: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/25.jpg)
A. Frank25
Flurl list of sites
![Page 26: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/26.jpg)
A. Frank26
Contents
• Multimedia (MM) and search/retrieval
• Text-based MM search in General SEs
• Text-based MM search in Vertical SEs
• Tag-based MM search
• Content-based MM search
![Page 27: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/27.jpg)
A. Frank27
Flickr
![Page 28: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/28.jpg)
A. Frank28
Flickr
![Page 29: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/29.jpg)
A. Frank29
Flickr
![Page 30: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/30.jpg)
A. Frank30
Image/Maps: Panoramio
![Page 31: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/31.jpg)
A. Frank31
Image/Maps: Panoramio
![Page 32: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/32.jpg)
A. Frank32
Image/Maps: Panoramio
![Page 33: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/33.jpg)
A. Frank33
Video: YouTube
![Page 34: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/34.jpg)
A. Frank34
Keotag Meta-SE
![Page 35: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/35.jpg)
A. Frank35
Keotag Meta-SE
![Page 36: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/36.jpg)
A. Frank36
Contents
• Multimedia (MM) and search/retrieval
• Text-based MM search in General SEs
• Text-based MM search in Vertical SEs
• Tag-based MM search
• Content-based MM search
![Page 37: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/37.jpg)
A. Frank37
“Content-based“ Image Search/Retrieval
• “Content based” image DB or Web site(s) that contain a large number of images.
• Image analysis techniques used to describe images by their extracted visual features such as color, texture, shape and orientation.
• These objects can be represented by sets of image features and then compared with the sets extracted from other images.
• Feature sets are described by their statistics, and the computer searches for statistically likely matches.
• Queries can be formulated in terms of visual features or by similarity options.
![Page 38: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/38.jpg)
A. Frank38
Image: Squid
• Has about 1100 images of marine creatures in its database.
• Each image shows one distinct species on a uniform background.
• Every image is processed to recover the boundary contour, which is then represented by three global shape parameters and the maxima of the curvature zero-crossing contours in its Curvature Scale Space (CSS) image.
![Page 39: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/39.jpg)
A. Frank39
Images: Squid
![Page 40: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/40.jpg)
A. Frank40
Images: Squid
![Page 41: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/41.jpg)
A. Frank41
Images: Squid
![Page 42: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/42.jpg)
A. Frank42
Images: Squid
![Page 43: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/43.jpg)
A. Frank43
Image: retriever
• Experimental service which lets you search and explore in a selection of Flickr images by drawing a rough sketch.
• Matches the most pronounced shapes and slabs of colors.
• The results are usually fairly good, sometimes even stunning,
• But it doesn't do object/face recognition of any kind, so if drawing an outline sketch of a chair, it almost certainly won't get you one back.
![Page 44: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/44.jpg)
A. Frank44
Images: retriever
![Page 45: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/45.jpg)
A. Frank45
Images: retriever
![Page 46: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/46.jpg)
A. Frank46
Images: retriever
![Page 47: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/47.jpg)
A. Frank47
MelodyHound
![Page 48: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/48.jpg)
A. Frank48
MelodyHound
![Page 49: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/49.jpg)
A. Frank49
MelodyHound
![Page 50: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/50.jpg)
A. Frank50
MelodyHound
![Page 51: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/51.jpg)
A. Frank51
Musipedia
![Page 52: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/52.jpg)
A. Frank52
Audio: MusiPedia
![Page 53: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/53.jpg)
A. Frank53
Music: Musipedia
![Page 54: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/54.jpg)
A. Frank54
Musipedia or Web Search?
![Page 55: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/55.jpg)
A. Frank55
Video: Blinkx
• World's largest and most advanced video search engine.
• Use of visual analysis and speech recognition to better understand rich media content.
• Advanced image and audio analysis techniques are used to automatically extract information about a video in real time and to create a rich index about the video content.
• Automatically and implicitly conducts searches based on the content being viewed by each individual user.
• With the advent of blinkx TV, users can now search and access news, movie trailers, popular multimedia segments and other video formats on demand.
![Page 56: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/56.jpg)
A. Frank56
Video: Blinkx
![Page 57: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/57.jpg)
A. Frank57
Video: Blinkx
![Page 58: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/58.jpg)
A. Frank58
Blinkx TV Architecture
![Page 59: A. Frank Multimedia Multimedia/Video Search. 2 A. Frank Contents Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM](https://reader030.vdocuments.us/reader030/viewer/2022033103/56649d565503460f94a34733/html5/thumbnails/59.jpg)
A. Frank59
References
• Kate Greene, Better, More Accurate Image Search, Technology Review, April 9, 2007, http://www.technologyreview.com/Infotech/18501/
• Kate Greene, Surfing TV on the Internet, Technology Review, April 18, 2007, http://www.technologyreview.com/Infotech/18545/
• Amit Agarwal, 10 Interesting Things You Can Do with YouTube or Google Videos, Digital Inspiration (Blog), July 27, 2006, http://labnol.blogspot.com/2006/07/10-interesting-things-you-can-do-with.html