Intelligent Video Surveillanceintegrated hardware and software solutions
for manufactures and system integrators
08/04/2023 1www.synesis.ru
Contents
• Market overview• TI’s DaVinci hardware reference designs• Open source Linux ONVIF/PSIA middleware• Embedded video analytics modules for DSP• Open source ONVIF/PSIA reference
applications for Windows PC• 3D security modelling• Business model and pricing
08/04/2023 www.synesis.ru 2
Key trends in video surveillance• High definition / megapixel resolution• Hybrid DVRs - a less expensive migration to IP• H.264 cuts storage costs compared to MJPEG• Emerging standards such as ONVIF and PSIA
overcame the interoperability barriers• Embedded video analytics becoming a major
force in future video surveillance• Intelligent storage in serverless computing• Video surveillance as service08/04/2023 3www.synesis.ru
Synesis intelligent video framework• Unified video
module based onTI’s DaVinci DM6467
• Extension modulesfor HD IP-camera & encoderwith embedded analytics
• Comprehensive middleware with ONVIF and PSIA support
• Powerful video analytics 1080p
embedded HD video analytics
08/04/2023 4www.synesis.ru
Unified video processing module• Design goal: development
and manufacturingcost/risk reductions
• DDR2 up to 256 Mb• NAND flash up to 2 Gb• All the DM6467 functions
accessible viathree 80 pins connectors
• Board support package• Catalogue OEM price $200
80 х 55 х 14 mm
08/04/2023 5www.synesis.ru
Balanced system configurations
IP Cameras
• Full HD camera– 2-3 MP sensor– 1080p H.264 encoding – Standard analytics
• HD camera– 1-2 MP sensor– 720p H.264 encoding– Advanced filters & analytics
• Dual sensor camera (Q1 2010)– Normal and IR sensors < 1 MP– Number plate recognition
Edge video servers / encoders
• Dual channel encoder– 1-2 PAL/NTSC inputs– D1 H.264 encoding– Video filters & analytics
• Quad channel encoder(Q1 2010)– 4 PAL/NTSC inputs– D1 H.264 encoding– Video filters & analytics
08/04/2023 6www.synesis.ru
Vertical applications based onthe video processing module
08/04/2023 www.synesis.ru 7
• Available now– Perimeter security (i-LIDS Sterile Zone scenario)– Residential security (Moscow safe city program)
• Q1 2010– High speed number plate recognition– Camera dual sensor designs
• Q2 2010– ATMs and petrol stations– Multiple camera tracking (MCT)
HW-6467-CORE Video processing module
08/04/2023 8
Full board support package (BSP) and expansion board design guide included
www.synesis.ru
08/04/2023 9
HW-6467-CAM Camera extension board• PoE consumption < 10W• 85 x 55 mm form factor• -40⁰...+85 ⁰ C
www.synesis.ru
HW-6467-CORE and CAM assembled
08/04/2023 10www.synesis.ru
Dual channel encoder with VA
• Cost efficient upgrade of legacy analog CCTV• 2 analog inputs, 2 managed analog outputs
(loop-through when power off)• 1 audio in (mic/line-in), 1 audio out (line-out)• D1 MJPEG and H.264 encoding• Versatile video analytics and ONVIF support • Backup battery operation• Plug-n-play installation, legacy compatibility
08/04/2023 11www.synesis.ru
Dual channel encoder with embedded VA
08/04/2023 www.synesis.ru 12
HW-6467-ENC2Dual channel encoder extension board
08/04/2023 13
HW-6467-CORE
DC/DC
Video encoders
5V3.3V
1.8V
Video decoders
Video in
RS232
GPIO Relays
Video out
Audio codec
Mic IN/Line IN
Audio OUT
USB 2.0Host
Ethernet PHY
DC/DC
POE (+)
RJ45
Power supply9..14V
EMAC
McASP0
Audio amplifier
LEDsPower on/off
Input signal 1 on/off
Input signal 2 on/off
RS485
12V battery
CVBS1 CVBS2Video switch
CVBS1 CVBS2
HW--6467-PS2
www.synesis.ru
Edge device middleware
1080p
08/04/2023 14
Codec Engine ServerMiddleware
DSP Core
DSP/BIOS
PSIA
ONVIF
DSP/BIOS Link
Mid
dlew
are
API
Vide
o An
alyti
cs A
PI
Video analytics
G.711
MJPEG
H.264Encoding
AAC
Video filtersMW Controller
Config ManagerEvent Manager
StreamerDisplay (opt)
Analytics ProcessSoftware Upgrade
PTZ Manager
ARM Core
Linux
Sensor driver TCP/IPARM/DSP
Communication
Third-party softwarethttpdMTD SSHBusybox
Third-party Interface
www.synesis.ru
Choice of codecs fromTI’s partner ecosystem
Supplier Advantages
Texas Instruments
Basic profile (BP) H.264 AVC and MJPEG at no extra cost
Human Monitoring
Quality main profile (MP)H.264 AVC and antishaker
Ittiam Multi-channel MP H.264 AVC encoder
Radvision H.264 Scalable Video Coding (SVC)
08/04/2023 15www.synesis.ru
Synesis DSP algorithm portfolio• Video filters
– Digital antishaker with subpixel compensation• Service detectors (sabotage detectors)
– Reorientation, over/under exposure, blurring,loss of signal, loss of video synchronization
• Universal motion detector and object tracker– i-LIDS Sterile Zone scenario
• ‘Safe city’ detectors – Q4 2009– running, unattended luggage, multi-zone rules
• Multiple camera tracker (MCT) – Q3 201008/04/2023 16www.synesis.ru
Image processing pipeline
08/04/2023 www.synesis.ru 17
Compression
MJPEG
H.264
Filters
Noise reduction
Stabilisation
Dynamic rangecompression
Analytics
Quality/sabotage control
Motion detection
Object tracking
Feature estimation
Rotation
Scaling
Color spacetransofrmation
Overlay
Watermarks
TextBuffering
andstreamingRTP/RTSP
Objectmetadata
streamingXML/SOAPor binary
inputvideo
stream
Scenes with disruptive background
• Real-world scenes– Bushes blown by wind– Open water– Snow
• Challenges– Track objects across
dynamic backgrounds– Avoid false alarms
• Solution– Dynamic texture modelling
08/04/2023 18www.synesis.ru
Video analytics for perimeter security
• Super longrange
• High sensitivity with low rate of false alarms
• Disruptive background
• Precision calibration
08/04/2023 www.synesis.ru 19
Detection ROC-curve
08/04/2023 www.synesis.ru 20
NU
MB
ER
OF
FA
LS
E A
LE
RT
SP
ER
CA
ME
RA
PE
R M
ON
TH
DETECTION DISTANCE WITH 99% PROBILITY LEVEL, METERS2550100125150175200
1
10
100
1 000
10 000
SYNESISHIGH
DEFINITION
OPTIMAL FALSE ALERT RATE
SYNESISSTANDARDDEFINITION
OTHERTECHO-LOGIES
‘Safe city’ entrance door monitoring• People entrance/exit/loitering/running detection• Camera attack/sabotage• Unattended luggage
08/04/2023 www.synesis.ru 21
Reference Application implementing ONVIF and PSIA with video analytics
08/04/2023 www.synesis.ru 22
Open source С# code
One minute visual calibration
04/08/2023 confidential 23
Angle of view and scale
Region of interest and direction
3D security infrastructure modelling
08/04/2023 www.synesis.ru 24
08/04/2023 25
Multiple camera tracking (MCT)
3D trajectory reconstruction from MCT
08/04/2023 www.synesis.ru 26
Р2
P5
P1 P2
X Y
Z
P4
P3
Detection zone modelling
XY
Z
P2
P4
P3
Synesis business models
• Hardware design and software licensing– Two options: one-off payment or royalties– Upfront payments can be avoided completely– Customer is flexible in building their own
hardware and software without vendor lock-in• Turn-key solutions / OEM-product supply• R&D contracting and consultancy• Joint ventures
08/04/2023 28www.synesis.ru
Affordable hardware kits
• Evaluation kits– HD IP-camera or 2-channel edge server / encoder– Middleware and video analytics pre-loaded– $500 list price
• Development kits– HD IP-camera or 2-channel edge server / encoder– Full board support package (BSP) in source code– $1,500 list price
• 60 day money-back warranty
08/04/2023 29www.synesis.ru
Potential for product differentiation
• Custom extension boards• Custom middleware
– Open middleware API, analytics API and xDAIS
– Third-partyprotocol support
– web UI with skins and customer logo
– Royalty-free source code middleware licensing
• Custom video filtersand analytics08/04/2023 30
Codec Engine ServerMiddleware
DSP Core
DSP/BIOS
PSIA
ONVIF
DSP/BIOS Link
Mid
dlew
are
API
Vide
o An
alyti
cs A
PI
Video analytics
G.711
MJPEG
H.264Encoding
AAC
Video filtersMW Controller
Config ManagerEvent Manager
StreamerDisplay (opt)
Analytics ProcessSoftware Upgrade
PTZ Manager
ARM Core
Linux
Sensor driver TCP/IPARM/DSP
Communication
Third-party softwarethttpdMTD SSHBusybox
Third-party Interface
ALL MODULESCAN BE
CUSTOMISEDBY CUSTOMER
www.synesis.ru
Summary: benefits of the framework• End-to-end turn-key solution for manufacturers
– hardware design + middleware + codecs + analytics• Significant potential for product differentiation• Industry standard compliance - ONVIF and PSIA• Development and manufacturing cost/risk
reductions thanks to the unified module design• Power/price balanced configurations
for camera and multi-channel encoders
08/04/2023 31www.synesis.ru
Thank you!
08/04/2023 32
www.synesis.ru
Nikolai [email protected]: nptitsynmobile: +7 (916) 978-8429office: +7 (495) 660-7747
www.synesis.ru