![Page 1: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/1.jpg)
BriefCam – The Video Synopsis Company
ISC West, April 2017
Extracting Actionable Data from Video Extracting Actionable Data from Video Extracting Actionable Data from Video Extracting Actionable Data from Video
SurveillanceSurveillanceSurveillanceSurveillance---- DNN & GPUDNN & GPUDNN & GPUDNN & GPU
![Page 2: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/2.jpg)
![Page 3: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/3.jpg)
Input Video Processing Storage
Interactive Applications
Big Data
![Page 4: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/4.jpg)
Object Classifier – combining machine vision (appearance) and machine learning (classification)
Behavior – object movements with related metadata (direction, speed, path…)
Statistics – group metadata – agg. & analysis (average, irregular)
Adding new use cases
✓✓✓✓
✓✓✓✓
✓✓✓✓
New Use Cases
![Page 5: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/5.jpg)
Object Track
Rich Metadata
- Woman
- Bicycle
- White
- Black
- 15 km/h
Full Scene Coverage
![Page 6: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/6.jpg)
![Page 7: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/7.jpg)
7
Events from different times presented simultaneously
Click back to view events in original video
Original video: 30 minutesOriginal video: 30 minutes Video Synopsis: 53 secondsVideo Synopsis: 53 seconds
![Page 8: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/8.jpg)
Search Alerts Insights
LE
ENT
SMB
Home
![Page 9: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/9.jpg)
![Page 10: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/10.jpg)
Environment NVIDIA GPU
Cloud Tesla K80 (AWS P2)
Server Tesla P4
Workstation/Laptop GTX 1080 Ti
Edge Device Jetson TX
![Page 11: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/11.jpg)
New Capabilities Benefits
Faster/Cheaper, cost effective processing
Proactive use
Data aggregation => insights
Multi camera search
Rich metadataClassifications (inc’ car type, model, etc)
Attributes => clothing, expressions, gestures
Improved scene coverage
Crowd
Queue
Night scene
![Page 12: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/12.jpg)
GPU Cons Tips & Tricks
GPUs on servers expensive• CPU fallback for specific deployments
• Reach high and consistent GPU utilization
Difficult to reach high utilization
• CPU – GPU transfer (latency and
throughput)
• Many operations on small images
• Powerful DNNs to offload traditional algorithms
• Batch processing
• Parallel computations (pipelines & buffers)
Limited memory
• Unfortunately, often a tradeoff with parallel
computations
• Use spatial and temporal resolutions (pyramid)
GPU virtualization is difficult • Consider using on-demand cloud instances
![Page 13: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/13.jpg)
Any questions?
For more information:
www.briefcam.com
BriefCam – The Video Synopsis Company
PROPRIETARY & CONFIDENTIAL
Amit Gavish
![Page 14: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/14.jpg)
![Page 15: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/15.jpg)
![Page 16: BriefCam– The Video Synopsis Company - NVIDIAon-demand.gputechconf.com/gtc/2017/presentation/s... · BriefCam–The Video Synopsis Company ISC West, April 2017 Extracting Actionable](https://reader035.vdocuments.us/reader035/viewer/2022081400/5f13ebc8a790cb2fea097034/html5/thumbnails/16.jpg)