intelligent video surveillance - synesis integrated hardware and software solutions

Intelligent Video Surveillanceintegrated hardware and software solutions

for manufactures and system integrators

08/04/2023 1www.synesis.ru

Contents

• Market overview• TI’s DaVinci hardware reference designs• Open source Linux ONVIF/PSIA middleware• Embedded video analytics modules for DSP• Open source ONVIF/PSIA reference

applications for Windows PC• 3D security modelling• Business model and pricing

08/04/2023 www.synesis.ru 2

Key trends in video surveillance• High definition / megapixel resolution• Hybrid DVRs - a less expensive migration to IP• H.264 cuts storage costs compared to MJPEG• Emerging standards such as ONVIF and PSIA

overcame the interoperability barriers• Embedded video analytics becoming a major

force in future video surveillance• Intelligent storage in serverless computing• Video surveillance as service08/04/2023 3www.synesis.ru

Synesis intelligent video framework• Unified video

module based onTI’s DaVinci DM6467

• Extension modulesfor HD IP-camera & encoderwith embedded analytics

• Comprehensive middleware with ONVIF and PSIA support

• Powerful video analytics 1080p

embedded HD video analytics


Unified video processing module• Design goal: development

and manufacturingcost/risk reductions

• DDR2 up to 256 Mb• NAND flash up to 2 Gb• All the DM6467 functions

accessible viathree 80 pins connectors

• Board support package• Catalogue OEM price $200

80 х 55 х 14 mm


Balanced system configurations

IP Cameras

• Full HD camera– 2-3 MP sensor– 1080p H.264 encoding – Standard analytics

• HD camera– 1-2 MP sensor– 720p H.264 encoding– Advanced filters & analytics

• Dual sensor camera (Q1 2010)– Normal and IR sensors < 1 MP– Number plate recognition

Edge video servers / encoders

• Dual channel encoder– 1-2 PAL/NTSC inputs– D1 H.264 encoding– Video filters & analytics

• Quad channel encoder(Q1 2010)– 4 PAL/NTSC inputs– D1 H.264 encoding– Video filters & analytics


Vertical applications based onthe video processing module


• Available now– Perimeter security (i-LIDS Sterile Zone scenario)– Residential security (Moscow safe city program)

• Q1 2010– High speed number plate recognition– Camera dual sensor designs

• Q2 2010– ATMs and petrol stations– Multiple camera tracking (MCT)

HW-6467-CORE Video processing module

08/04/2023 8

Full board support package (BSP) and expansion board design guide included

www.synesis.ru

08/04/2023 9

HW-6467-CAM Camera extension board• PoE consumption < 10W• 85 x 55 mm form factor• -40⁰...+85 ⁰ C

www.synesis.ru

HW-6467-CORE and CAM assembled


Dual channel encoder with VA

• Cost efficient upgrade of legacy analog CCTV• 2 analog inputs, 2 managed analog outputs

(loop-through when power off)• 1 audio in (mic/line-in), 1 audio out (line-out)• D1 MJPEG and H.264 encoding• Versatile video analytics and ONVIF support • Backup battery operation• Plug-n-play installation, legacy compatibility


Dual channel encoder with embedded VA


HW-6467-ENC2Dual channel encoder extension board

08/04/2023 13

HW-6467-CORE

DC/DC

Video encoders

5V3.3V

1.8V

Video decoders

Video in

RS232

GPIO Relays

Video out

Audio codec

Mic IN/Line IN

Audio OUT

USB 2.0Host

Ethernet PHY

DC/DC

POE (+)

RJ45

Power supply9..14V

EMAC

McASP0

Audio amplifier

LEDsPower on/off

Input signal 1 on/off

Input signal 2 on/off

RS485

12V battery

CVBS1 CVBS2Video switch

CVBS1 CVBS2

HW--6467-PS2

www.synesis.ru

Edge device middleware

1080p

08/04/2023 14

Codec Engine ServerMiddleware

DSP Core

DSP/BIOS

PSIA

ONVIF

DSP/BIOS Link

Mid

dlew

are

API

Vide

o An

alyti

cs A

PI

Video analytics

G.711

MJPEG

H.264Encoding

AAC

Video filtersMW Controller

Config ManagerEvent Manager

StreamerDisplay (opt)

Analytics ProcessSoftware Upgrade

PTZ Manager

ARM Core

Linux

Sensor driver TCP/IPARM/DSP

Communication

Third-party softwarethttpdMTD SSHBusybox

Third-party Interface

www.synesis.ru

Choice of codecs fromTI’s partner ecosystem

Supplier Advantages

Texas Instruments

Basic profile (BP) H.264 AVC and MJPEG at no extra cost

Human Monitoring

Quality main profile (MP)H.264 AVC and antishaker

Ittiam Multi-channel MP H.264 AVC encoder

Radvision H.264 Scalable Video Coding (SVC)


Synesis DSP algorithm portfolio• Video filters

– Digital antishaker with subpixel compensation• Service detectors (sabotage detectors)

– Reorientation, over/under exposure, blurring,loss of signal, loss of video synchronization

• Universal motion detector and object tracker– i-LIDS Sterile Zone scenario

• ‘Safe city’ detectors – Q4 2009– running, unattended luggage, multi-zone rules

• Multiple camera tracker (MCT) – Q3 201008/04/2023 16www.synesis.ru

Image processing pipeline


Compression

MJPEG

H.264

Filters

Noise reduction

Stabilisation

Dynamic rangecompression

Analytics

Quality/sabotage control

Motion detection

Object tracking

Feature estimation

Rotation

Scaling

Color spacetransofrmation

Overlay

Watermarks

TextBuffering

andstreamingRTP/RTSP

Objectmetadata

streamingXML/SOAPor binary

inputvideo

stream

Scenes with disruptive background

• Real-world scenes– Bushes blown by wind– Open water– Snow

• Challenges– Track objects across

dynamic backgrounds– Avoid false alarms

• Solution– Dynamic texture modelling


http://www.london-weatherstation.co.uk/rainbow

Video analytics for perimeter security

• Super longrange

• High sensitivity with low rate of false alarms

• Disruptive background

• Precision calibration


Detection ROC-curve


NU

MB

ER

OF

FA

LS

E A

LE

RT

SP

ER

CA

ME

RA

PE

R M

ON

TH

DETECTION DISTANCE WITH 99% PROBILITY LEVEL, METERS2550100125150175200

1

10

100

1 000

10 000

SYNESISHIGH

DEFINITION

OPTIMAL FALSE ALERT RATE

SYNESISSTANDARDDEFINITION

OTHERTECHO-LOGIES

‘Safe city’ entrance door monitoring• People entrance/exit/loitering/running detection• Camera attack/sabotage• Unattended luggage


Reference Application implementing ONVIF and PSIA with video analytics


Open source С# code

One minute visual calibration

04/08/2023 confidential 23

Angle of view and scale

Region of interest and direction

3D security infrastructure modelling


08/04/2023 25

Multiple camera tracking (MCT)

3D trajectory reconstruction from MCT


Р2

P5

P1 P2

X Y

Z

P4

P3

Detection zone modelling

XY

Z

P2

P4

P3

Synesis business models

• Hardware design and software licensing– Two options: one-off payment or royalties– Upfront payments can be avoided completely– Customer is flexible in building their own

hardware and software without vendor lock-in• Turn-key solutions / OEM-product supply• R&D contracting and consultancy• Joint ventures


Affordable hardware kits

• Evaluation kits– HD IP-camera or 2-channel edge server / encoder– Middleware and video analytics pre-loaded– $500 list price

• Development kits– HD IP-camera or 2-channel edge server / encoder– Full board support package (BSP) in source code– $1,500 list price

• 60 day money-back warranty


Potential for product differentiation

• Custom extension boards• Custom middleware

– Open middleware API, analytics API and xDAIS

– Third-partyprotocol support

– web UI with skins and customer logo

– Royalty-free source code middleware licensing

• Custom video filtersand analytics08/04/2023 30

Codec Engine ServerMiddleware

DSP Core

DSP/BIOS

PSIA

ONVIF

DSP/BIOS Link

Mid

dlew

are

API

Vide

o An

alyti

cs A

PI

Video analytics

G.711

MJPEG

H.264Encoding

AAC

Video filtersMW Controller

Config ManagerEvent Manager

StreamerDisplay (opt)

Analytics ProcessSoftware Upgrade

PTZ Manager

ARM Core

Linux

Sensor driver TCP/IPARM/DSP

Communication

Third-party softwarethttpdMTD SSHBusybox

Third-party Interface

ALL MODULESCAN BE

CUSTOMISEDBY CUSTOMER

www.synesis.ru

Summary: benefits of the framework• End-to-end turn-key solution for manufacturers

– hardware design + middleware + codecs + analytics• Significant potential for product differentiation• Industry standard compliance - ONVIF and PSIA• Development and manufacturing cost/risk

reductions thanks to the unified module design• Power/price balanced configurations

for camera and multi-channel encoders


Thank you!

08/04/2023 32

www.synesis.ru

Nikolai [email protected]: nptitsynmobile: +7 (916) 978-8429office: +7 (495) 660-7747

www.synesis.ru

http://www.synesis.ru/

mailto:[email protected]

intelligent video surveillance - synesis integrated hardware and software solutions

Business

palntsc inputsd1

managed analog outputsloop

mp sensor720p

mp sensor1080p

embedded va31102009www

expansion board design

vertical applications

cuts storage costs