real-time query-by-image video search system...500 video clips per day 1m keyframes indexed 7’’...

1

Real-time Query-by-Image Video Search System Andre Araujo, David Chen, Peter Vajda and Bernd Girod Department of Electrical Engineering, Stanford University, USA http:// videosearch.stanford.edu User Interaction Image-based Search of Videos Display Results Extract Key Frames Generate SURF Features Generate REVV Signatures Video Index Discover Trending Images Clip #1 Clip #2 Find Frame Matches Sort by Popularity Image query Video database matches Image querying Playing from matching keyframe System Architecture Video clips Index Video Clips Query Database Generate SURF Features Generate REVV Signatures Fast REVV comparisons + RANSAC News Videos Recording Story Segmentation Previous work (Daneshi et al, 2013) 59 TV + YouTube channels 500 Video clips per day 1M Keyframes indexed 7’’ Average query latency 3’ Average clip duration Statistics Search System Video database News videos : search event footage using photos Online education : search lectures using slides Brand monitoring : search TV/YouTube using product or logo images Image query Contribution: Real-time online system that searches large database of videos using image queries

Upload: others

Post on 21-Sep-2020

0 views

Category:

Documents

0 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: Real-time Query-by-Image Video Search System...500 Video clips per day 1M Keyframes indexed 7’’ Average query latency 3’ Average clip duration Statistics! Search System’ Video

Real-time Query-by-Image Video Search System!Andre Araujo, David Chen, Peter Vajda and Bernd Girod!

Department of Electrical Engineering, Stanford University, USA!http://videosearch.stanford.edu!

User Interaction

Image-based Search of Videos!

Display Results

Extract Key Frames

Generate SURF

Features

Generate REVV

Signatures

Video Index

Discover Trending Images

Clip #1

Clip #2

Find Frame Matches

Sort by Popularity

Image query

Video database matches

Image querying

Playing from matching keyframe

System Architecture!Video clips

Index Video Clips

Query Database Generate

SURF Features

Generate REVV

Signatures

Fast REVV comparisons + RANSAC

News Videos Recording

Story Segmentation Website

Previous work (Daneshi et al, 2013)

59 TV + YouTube

channels

500 Video clips per day

1M

Keyframes indexed

7’’

Average query latency

3’

Average clip duration

Statistics!

Search System

Video database

ü  News videos: search event footage using photos ü  Online education: search lectures using slides ü  Brand monitoring: search TV/YouTube using

product or logo images

Image query

Contribution: Real-time online system that searches large database of videos using image queries

Category-specific video summarization - Inria · relate to the video’s story [6], the user’s preferences, the query context [4], or user attention [9]. A video is either summed

Tesla Master Deck · 2020-01-29 · DeepStream SDK Decoding NVIDIA METROPOLIS Intelligent Video Analytics for Smart Cities RETRAIN WITH NEW DATA` QUERY VIDEO FEED Frames detecting

Research on Dynamic-Average-Gray-Scale-Based Video ... · Research on Dynamic-Average-Gray-Scale-Based Video Segmentation Algorithm Zhangping Hu School of Computer, Chongqing University

How Good Are Query Optimizers, Really? · the most important query optimization problem, we designed the queries to have between 3 and 16 joins, with an average of 8 joins per query

Supplementary Information - University of MichiganSupplementary Tables Table S1.Average TM-score RNA, average RMSD, average Coverage (number of aligned residues divided by query structure

Rethinking the Bottom-Up Framework for Query-based Video ... · Rethinking the Bottom-Up Framework for Query-based Video Localization Long Chen,1 Chujie Lu,1 Siliang Tang,1yJun Xiao,1

I have a Dream - IARIA · „I have a Dream“ ... [Tata, Lohman] builds SQL aggregates using keyword query like: Mark Twain average image width results in a SQL query derived from

Pattern Recognition Methods in Image and Video Databases: … · 2017. 8. 25. · video) databases starts from the way the queries are specified. While standard- ized query languages

Video Ad CPM Display Ad CPM $0 $25 $50 Source: Bain/IAB Benchmarking Study 2008 Average CPM Marketers love video! Video commands

Video Lens: Rapid Playback and Exploration of Large Video Collections and Associated ... · 2016-02-12 · into a single query, limiting the expressiveness of the result-ing clip

Video Fingerprinting: Features for Duplicate and Similar Video Detection and Query- based Video Retrieval Anindya Sarkar, Pratim Ghosh, Emily Moxley and

Textbook Query Optimization 2. Textbook Query Optimization · Textbook Query Optimization Logical Query Optimization Optimization Phases Textbook query optimization steps: 1.translate

GIFT: A GEOSPATIAL IMAGE AND VIDEO FILTERING TOOL …2.3.1. Logical Operations Module The Logical Operations Module 1) receives query requests from applications, where a query request

Last week … Lecture 12: Video Representation, zFrame …cs9519/lecture_notes_06/L12_COMP... · 2006. 10. 19. · Lecture 12: Video Representation, Summarisation, and Query Dr Jing

Subquery. Subquery or Inner query or Nested query A subquery is a query within another query. The outer query is called as main query and The inner query

Facebook page “Likes” this month reached 1,515, … Honolulu...Video Performance In This Post Minutes Viewed Unique Viewers Video Views 10-Second Views Video Average Watch Time

Deepgreen DB for Video Discovery Brief · Deepgreen DB for Video Discovery Big Data meets AI Enabled Video Analysis •Standard SQL Query on video and image files •On demand inferencing

QUERY OPTIMIZATION AND QUERY PROCESSING

TELLING YOUR BRAND STORIES THROUGH VIDEO · WATCH VIDEO CONTENT ON TWITTER 82% OF TWITTER USERS And are 25% more likely to discover video first vs. the average consumer Source | Video

XN3000T / XN5000T / XN7000T / XN8000T Series · 2018-02-28 · DVD video will on average take under a minute. High-efficient: 4K Video Editing The XCubeNAS fulfils storage and video

A Survey of Top-k Query Processing Techniques in …samir/498/topk.pdfA Survey of Top-k Query Processing Techniques in Relational Database Systems ¢ 3 Video Database Color Histogram

Table of Contents Meeting Farmer McDonald Introduction to the Four Seasons Video All Four Seasons Videos Georgia’s Average Seasonal Temperatures Map Average

faculty.business.wsu.edu€¦ · Web view2016/10/16 · There are 50 bicycles with above average sales process.Look at the WHERE clause. It is its own query (called the inner query)

Introduction to Database Systems CSE 444...Query Evaluation Steps Parse & Check Query Decide how best to answer query: query optimization Query Execution SQL query 3 Return Results

In this activity, we are going to create a query for a computer company. The query will calculate the total and average expenses of the salesmen for each

Query Processing and Query Optmization

Chapter 6 Query Execution. Query Query Compilation (Chapter 7 ） query plan Query execution metadata （ Chapter 6 ） data the major parts Of the query processor

Utilizing Video Ontology for Fast and Accurate Query-by-Example Retrieval

Discrete Wavelet Transform Based Video Query …...Discrete Wavelet Transform Based Video Query Processing System Chandrashekhar M Shahapur 1, Shanmukhappa A Angadi 2 1,2 Department

DML Video - Axel Tech · 2020. 5. 13. · email or SMS. Monitored parameters: Disk activity / video presence / video freeze / audio presence / instant data-rate / average data-rate

New Temporal Tessellation: A Unified Approach for Video Analysis · 2017. 10. 20. · Figure 1. Tessellation for temporal coherence. For video cap-tioning, given a query video (top),

Activity Recognition in Videofiles.meetup.com/4379272/Bostion Image Processing Meetup.pdf · Document Query 2/7/2013 8. Video Indexing Process 2/7/2013 9 Blob Extraction Source Video(s)

PowerPoint PresentationPRKB.pdf · Greetings, etc. Text Center Agent System Query Answered Email Call 205 Average SMS Received/day 4,657 Average SMS Received/month 97 Average Active

IAB 2018 Video Ad Spend Study€¦ · Half of Advertisers will increase spending on digital video, mobile video, and Advanced TV. On average, Advertisers will spend more than $10

Event detection, query, and retrieval for video · PDF fileEvent detection, query, and retrieval for video surveillance ... surveillance system. ... ability to manage the surveillance