safety mcu/mpus for general purpose and vision applications · 2020. 9. 2. · nci stack nfc...

45
Company Public NXP, the NXP logo, and NXP secure connections for a smarter world are trademarks of NXP B.V. All other product or service names are the property of their respective owners. © 2019 NXP B.V. Automotive Microcontrollers and Processors Safety MCU/MPUs for General Purpose and Vision Applications Sep 2019 | Session # AMF-AUT-T3854 Philip Pesses

Upload: others

Post on 29-Mar-2021

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

Company Public – NXP, the NXP logo, and NXP secure connections for a smarter world are trademarks of NXP

B.V. All other product or service names are the property of their respective owners. © 2019 NXP B.V.

Automotive Microcontrollers and Processors

Safety MCU/MPUs for General Purpose and Vision Applications

Sep 2019 | Session # AMF-AUT-T3854

Philip Pesses

Page 2: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 1COMPANY PUBLIC 1

• General Purpose S32K Product overview

• S32K Future Products

• S32K Technical capabilities

• S32K Enablement

• Vision Processors

• Vision Enablement

Agenda

Page 3: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 2

S32K Family overview

Page 4: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 3

Safety

VDS

MCUs

Chassis, Safety,

Torque and Energy

Management

• Long term innovator in chassis

and powertrain control

• Significant growth in safety as

autonomous control drives

robust fault tolerant systems

General Purpose

General Purpose

MCUs

Industrial CAN

Motor Control

Edge Nodes

• Broadest portfolio of integrated

MCU+HV mixed-signal solutions

• Application specific software

solutions

Connectivity

Gateways

Vehicle Network

Processing (Gateways, Domain

Controllers)

• #1 in vehicle networking and

security

• End-to-end portfolio of

networking devices

Awareness

Vision & Radar

Radar, LIDAR, Vision

Sensor Fusion

• #1 in radar processing

• Comprehensive radar,

vision and central

processing portfolio

Networking

DN(Digital Networking)

• High-performance

Multicore Arm® SOCs for

Edge Compute

• Virtualized, Secure,

Solutions with Application

Specific Acceleration

Advanced Processing

Solutions

i.MX(Multimedia and General Purpose

Applications Processor)

Infotainment, Reconfigurable

Cluster, Telematics, V2X,

Driver Awareness

• #1 in Infotainment &

Reconfigurable Cluster

• Scalable multimedia solution

with audio DSP, VMCU, safety

camera/display/audio, hardware

virtualization, vision acceleration

Infotainment

NXP – Supplier of Choice for Advanced Processing

Page 5: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 4

S32K Target Applications

Industrial / General PurposeMotor Control

Infotainment

HVAC Lighting

Battery/Power mgmt

Wireless Charging,

NFC pairingEth. Audio Amp

Safety

Gear shifter Motorcycle ABS

SuspensionsTPMS

Cooling fans

Window liftBLDC/PMSM

Water Pumps

Touch Interface

Page 6: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 5

General Purpose and Integrated Solutions

GPIS(General Purpose &

Integrated Solutions)

Body Electronics

Edge Nodes

• 8/16/32bit General

Purpose MCU

• Application specific

software solutions

• MagniV Application

specific Integrated

Solutions

Sensor InterfacesMotor Control

Window Lift Pumps, Fans

Integrated Solutions

8/16/32bit General Purpose

Body Electronics

Exterior Interior

Across domains

S12 MagniV

S32K1 B

S08 – GP 8bit

S12 – GP 16bit

MPC56xxB – GP 32bit

KEA

Next Gen

S32K D

Next Gen IS

Solution

Page 7: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 6

S32K

14xS

32

K11x

Arm Cortex-M4F @ up to 112MHz

S32K116 S32K118 S32K146 S32K148S32K142 S32K144

256KB Flash 512KB Flash 1MB Flash 2MB Flash

up to 89 I/Os

2x FlexCAN

with 1x FD**

Common Features

Arm Cortex-M0+ @ 48MHz

128KB Flash 256KB Flash

up to 42 I/Os up to 58 I/Os

IEEE 1588

ENET

up to 128 I/Os up to 156 I/Os

16 channel eDMA

1x FlexCAN with 1x FD

Quad SPI

ETM Trace

32KB SRAM 64KB SRAM 128KB SRAM 256KB SRAM16KB SRAM 24KB SRAM

3x FlexCAN

with 1x FD**

3x FlexCAN

with 2x FD

3x FlexCAN

with 3x FD

LQFP-48

QFN-32 LQFP-64 LQFP-64

LQFP-144

LQFP-100

LQFP-176

MAPBGA-100

2x SAI

4 channel eDMA

2x 32-ch 12-bit

ADC

2x 24-ch 12-bit

ADC2x 16-ch 12-bit ADC

1x 16-ch 12-

bit ADC

1x 13-ch 12-

bit ADC

AEC-Q100, 125°C, 5V

CSEc Security Module

Low Power Operating Modes

& Peripherals

LPUART, LPSPI,

LPIIC, FlexIO

ASIL-B Capable:

(ECC, MPU, CRC, W’DOGs)

FlexTimers, LP Timers, Prog.

Delay Block

*JTAG

S32DS IDE, SDK

Autosar MCAL / OS

8-40MHz Ext. Osc,

8/48MHz Osc., 128KHz LPO

Application SW

*S32K14x only

** 2x CAN FD in S32K14xW (Grade 0)

LQFP-100

LQFP-48

DevelopmentProduction

S32K14x and S32K11x FeaturesGr0 Option

Page 8: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 11

S32K1 Family technical

capabilities

Page 9: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 12

S32K1: Superior Low Power MCU optimized for SW

• Reduce average power− Sleep as much as possible

− Minimize RUN execution

− Simplify power mode transitions

• Only power what is needed− Only switch on silicon portions

− Completely power gate unused portions in many power modes

• Only clock what is required− Optimize clock signal switching mechanism

− Reduce number of clocked lines

− Avoid wasting power in clock edges

• Employ intelligent autonomous operation− Switch on CPU and clock tree as little as possible

ALL modules maintained in ALL modes

ALL memory maintained in ALL modes

ALL I/O maintained in ALL modes

ALL I/O can wake up the MCU

Autonomous peripherals • e.g. DMA, RTC, ADC, LPUART

Clock gating

Clock tree management

Peripheral grouping

Optimized system solution:

Page 10: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 13

S32K1 Low Power Performance Snapshot

Ta (C) VLPS (uA) VLPR (mA) Stop 1 (mA) Run (mA)*

S32K116 25 (typ) 26 1.05 6.3 20.3

S32K118 25 (typ) 27 1.15 6.4 21.8

S32K142 25 (typ) 29 1.17 6.4 37.5

S32K14425 (typ) 29.8 1.48 7 39.6

105 (typ) 256 1.8 7.8 40.5

125 (max) 1960 3.18 12.9 46.8

S32K146 25 (typ) 37 1.57 8 47.6

S32K148 25 (typ) 38 2.17 8.5 57.7

*RUN mode with peripherals enabled. K11x @ 48MHz, K14x @ 80MHz

✓ ALL memory and ALL registers and ALL I/O are ALWAYS

maintained in ALL modes

✓ ALL I/Os can wake up the MCU

✓ Parameters of multiple use cases provided in Datasheet

Page 11: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 15

ASIL-B Functional Safety

Crossbar Switch with MPU

RAM

Up To

64KB

System

Periphera

l

Bridge Flash

Up To

512K

NV

IC

Cortex M4F

112 MHz

FPU, DSP, MPU,

4 KB I/D-Cache

EEPROM

Up To

4KB

RTC

PMC2.7 - 5.5V

FLL Clk Mult

Ext Osc (8 - 40MHz)

Fast R/C OSC(48MHz 1%)

LP OSC (128KHz 10%)

SCG

Digital

Components

5V Analogue

ComponentsMCU Core

and Memories

secu

rity

Slow R/C OSC(8MHz 3%)

16ch

eDMA

LVD

WDOG EWM

Debug

SWD JTAG

Communications / I/O System

2x A

DC

16ch 1

2bit

AC

MP

W 8

-bit D

AC

4x F

lexT

ime

r8ch 1

6-B

it

3x F

lex C

AN

1 w

ith

FD

2x P

DB

3x S

PI

1x I

2C

Flex IO

I2S

UA

RT

SP

ILP

IT

CR

C

3x U

AR

T/L

IN

• Safety Hardware

▪ Power supplies

▪ Clocks generation

▪ Core platform (core, DMA, cache …)

▪ Busses - XBAR

▪ Memories – NVM, SRAM

• Safety Process

▪ ISO 26262 development process

• Safety Support

▪ FMEDA

▪ Safety manual

▪ Technical support

• Safety Software

▪ S32K core self-test SW

Clock

Monitoring

Power

Monitoring

Watchdog

ECC on SRAM

& Flash

Cyclic Redundancy

Check

Core Self Test

Page 12: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 16

CSEc Security Block Diagram

FLASH Subsystem

Includes CSEC.

Direct access to

flash contents.

No CSEc

access here

Supports SHE functionality:

−Secure key storage: CSEc includes 17 or

20 user keys, SHE requires 10

−AES-128 encryption/decryption

−AES-128 Cypher-based Message

Authentication Code (CMAC) calculation

and authentication

−True and Pseudo random number

generation

−User configurable Secure Boot Mode

(Sequential, Strict, or Parallel Boot)

Page 13: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 17

S32K FlexIO Peripheral Capabilities

• FlexIO = Flexible Input and Output

peripheral

• Programmable logic for complex

output waveform generation

• Emulation of standard communication

interfaces:

− UART, SPI, I2C, I2S, LCD RGB, PWM, LIN, etc.

• Low CPU overhead

• DMA support

• Drivers available

Page 14: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 18

FlexNVM – EEPROM Emulation

• Seen as RAM (read and write) from the user

perspective easy!

• Flash block in the background with a robust and

proven record management methodology

Easy to use for customers.

• With appropriate tools to evaluate endurance and

data retention

EEE Data

64 KB Flash

4KB

Emulated

EEPROM

4 KB SRAM

64 KB EEPROM

Backup

(Configurable)

Page 15: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 19

S32K1 Enablement

Page 16: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 20

S32 Design Studio IDE – graphical configuration environment1. Create a new S32DS IDE New Project Wizard

• Select MCU and target package

2. Select Compiler

• GCC or 3rd party Premium Compiler

(IAR and GHS)

3. Select Integration NXP tools• Processor Expert

• Pin Mux Tool

• Device Configuration

• SDK Configuration

• Bootloader

• FreeMASTER Embedded

4. Select Software Integration• S32K SDK Integrated with-in the tools

• KEA SDK Integrated with-in the tools

• Automotive Math and Motor Control Libraries

(AMMCLib)

Page 17: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 21

Processor Expert Tool – Initialization and SDK configuration

• GUI based tool for MCU configuration

• Configure MCU clocks

• Setup peripheral initialization configurations

• Configure drivers in the SDK for S32K MCUs

• Provides consistency checks for invalid configuration detection

• Generates code that works with static initialization functions

• Pin-Muxing tool: • Assign functions to pins

• Set up pin electrical characteristics

• Generate code to initialize pins to desired functions

Page 18: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 22

S32 SDK Solution – The Best alternative to AUTOSAR

❖ Highlights and Features

− Integrated Non-AUTOSAR Production-

Grade SDK

− Contains a wide range of examples and demos

− Graphical-based Configuration

− Integrated with S32 Design Studio and other

IDEs

− Layered Software Architecture

− Documented Source Code and Examples

− FreeRTOS integration

− Multiple MCU architectures and platforms

supported with single codebase and

consolidated releases.

− Middleware support:

▪ LIN stack, System basis chip, TCP/IP, Math and

motor control, Core self test (safety)

❖Multiple IDE integration:

• S32 Design Studio, ARM Keil MDK

❖Premium compiler support:

• GHS, IAR, DIAB, GCC, ARM C

❖ Quality Level:

- QM (A-SPICE L3 compliant)

Production grade SDK /

Free of charge

Page 19: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 23

S32K – Motor Control Development Tools

HW development Kits

MCDEVKIT

Simulink Model Based Design Tool

MCD Toolbox

Automotive Math and Motor Control Library

AMMCLIB

Motor Control Application Tuning Tool

MCAT

DEVKIT-MOTORGD

Sensorless BLDC/PMSM

Page 20: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 24

S32K – BLDC/PMSM Motor Control Development Kits

24

• Overview

• MTRDEVKSBNK144 (BLDC based) MTRDEVKSPNK144 (PMSM based)

• Based on S32K144EVB and DEVKIT-MOTORGD

• S/w built on NXP enablement: S32 DS IDE & SDK, AMMCLIB, FreeMASTER, MCAT

• Sensor based and sensorless operation of both BLDC/PMSM motors

• S32K key features: CAN-FD/PN, Security

• Low cost reference implementation of the sensorless PMSM & BLDC control algorithms

• Modular approach enabling additional functionality on top of motor control

• Supporting up to 24V MC applications

• Benefits:

- Complete out-of-the box experience, spinning motor in 10 minutes

- Conveniently and quickly evaluate features & performance

- Reduce development & prototyping time

- Faster Time to Market

Embedded Analog products:

• GATE Driver: GD3000

• SBC: TJA1169

Page 21: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 25

Touch Sense Reference Design

BMS Reference Design

ISELED Driver

NFC Stack

System Solutions – Released Already

S32k

NFC

NCI Stack

NFC

Antenna

NCx3340

NFC

Controller

Embedded

Firmware

MCU

NCI

S32K

Dielectric

Electrode

PCB / FoilCAN

LIN

Turnkey solution for Safety

Applications up to ASIL-C

4 NXP Devices:

- S32K144

- KEA

- SBC

- Battery Cell Management

• 1D Touch Library

• SDK and Autosar

• Single chip solution for

automotive TS.

• Suitable for up to 10

electrodes

• Interface between MCU

and NFC controller

• Specified by NFC Forum

• Eases integration of

NFC controllers

• SDK and Autosar

• High-speed communication

for creating dynamic lighting

effects

• ISELED Driver for S32K

• Using FlexIO and SPI

• SDK and Autosar

Page 22: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 26

BMS Safety System-On-Module: NTSafeSOM

Ready to Use Safety Computer Reference Design

26

Features• Target ISO26262 ASIL-C and IEC 61508 SIL 2 System level certification

• Dual MCU and safety PMIC architecture• S32K144 – Cortex M4F MCU• KEA – Cortex M0+ MCU• FS45 – Safety & Power Management System IC

• Different support package options from NXP and Newtec• Free-of-charge reference documents• Development kit hardware with application software• Up to complete system development with safety certification

• First application designed for 6 cells Li-Ion BMS using MC33772 battery cell controller

ApplicationsIndustrial, medical or automotive system requiring functional safety certification

Page 23: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 27

S32K – ISELED LED Lighting Reference Kit

• PROBLEM – LED use growing but limitations for controlling LED brightness range & coloraccuracy

x Each LED needs calibration & speed binning

x Dedicated control/compensation needed to maintain brightness/color over temp when in app.

• SOLUTION – ISILED_ADK_D

− Inova Semiconductor Smart ‘Digitized’ LED Controller IC (packaged with RGB LEDs): provides current drive & comms. for driving/addressing LEDs, calibrates LED colour & brightness (profiles stored in IC memory). Includes temp sensor for temp monitoring / brightness regulation

− NXP S32K144 MCU: system controller for LED strip. Sends LED control commands only (min. data overhead). Can support up to 4K LCDs @ video speed

• LED Lighting Starter Kit

− H/w: S32K1xxEVB + Shield + LED Strip

− S/w: ISELED s/w driver/stack (from NXP): controls LED strip via SPI/FlexIO, licensable

− GUI: LED Effects GUI (from Lucie Labs): runs on PC, for creating lighting effects, available as eval. lic. Will package and pre-program into EVB f/w

• ISILED_ADK_D Available now at ~$598 LINK

27

https://inova-

semiconductors.de/products/ISELED.html

Page 24: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 28

Open Alliance to provide complete systems solution for smart LED,

initially targeting automotive interior lighting

• System Provider • LED Manufacturer • System Integrator• System Controller

• Smart LED Driver Chip

• ISELED Concept

• Application and Lighting SW• Theoretical Framework

Page 25: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 29

Additional S32K Demos and Ref. Designs

Secure CAN-FD

Diagnostics (S32K + UJA1169)

CAN-FD vs. CAN

CSEc vs. S/w (S32K + TFT-LCD)

DC Motor Control(S32K + HB2001)

Motorcycle ABS (S32K + SB0400)

BLDC Motor

Control(S32K + GD3000)

Low Power Demo (S32K + LP Shield)

Door Handle(S32K + MagniV +

NFC)

Flex I/O(S32K EVBs emulating

comms protocols)

CAN

authentication(S32K EVBs + TFT-

LCDs)

Injector driver demo (S32K + PT2000)

Page 26: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 30

GPIS Applications resources

Product support

(communities)

Training materials

Technical documentation

Demos/Ref. designs

Engage in good

technical discussions

• S32K /

S12+MagniV

> 1000+ technical

threads created

Develop applications and

customers. App notes

posted on

• S32k / KEA

• MagniV / S12

22 Application notes

posted on

nxp.com/s32k

Train yourself and

customers:

• Training materials in

nxp.com/s32k

Training

• > 20 technical

trainings

Accelerate you

developments.

• Contact us for

additional

information

> 15 S32K1xx/MagniV

demos/ref. designs

available.

Page 27: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 31

SafeAssure Community

Access Safety

Manuals and related

safety design

documentation

Page 28: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

32

Broad applications Ready to goBenefits to you

• Automotive MCU for

general purpose

applications

• Accelerates

automotive software

design

• Future proof

• Minimize complexity

• Maximize R&D

efficiency

• Rich set of collaterals &

solutions available

today

• Product Longevity

program

Summary- S32K Product Line

Page 29: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 33

VISION PROCESSORS

Page 30: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 34COMPANY PUBLIC 34

• S32V family overview

• S32V Enablement

• Embedded Deep Learning

• eIQTM - Auto solution for ML

Agenda

Page 31: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 35

S32V family overview

Page 32: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 36

Driver Monitor

Camera3D Positioning

Driver Alertness

Driver Awareness

Surround View

VISION3D Segmentation

Highway Autopilot Assist

Park Assist

Pedestrian Detection

S32V family use cases

NCAP Camera

VISIONPedestrian Detection, Lateral Tracking

Automatic Emergency Braking

Collision Avoidance

Rear View

Sensor Fusion

Camera / RADARSafe Decision Making

S32V

• S32V is automotive ASIL B/C

microprocessor

• Embedded / low power Vision

accelerator

• Available for production today

(PPAP in December 2017)

Page 33: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 37

S32V234 – In Production NowHighlights

• High Performance Processing – Up to Quad core ARM A53 800-1GHz Safe Clusters @ ~10K DMIPS

• Vision Acceleration - Dual APEX-2 image cognition processor cores enabled by OpenCV

• Automotive Safety – Developed according to ISO 26262 standard to reach ASIL C for sensor fusion

• Security Enabled – HIS-SHE compliant Crypto Service Engine (CSE) optimized for flash less devices

Processing Power• CPU1-4: ARM Cortex-A53 @1GHz, L1/L2 cache with ECC & Neon

• CPU5: Cortex -M4 for IO control with I/D Cache and ECC

• ICP: 2 x APEX2 CL (MIMD APU-64 CU each) at 400MHz

• 3D-GPU: GC3000 from Vivante (4 Shader)

• DDR3/LPDDR2 at 533MHz (2 x 32bit)

• Image Signal Processing (ISP)

• Image Cognition Processing with 2 x APEX2

• h.264 Codec and MJPEG decoder

Serial Interfaces• 1 PCIe controller

• 1 FlexRay (Dual Channel)

• 1 Zipwire

• 1 Gibabit Ethernet

• 2 x MIPI CSI2 - 4 lanes 6Gb/s

• 2 ISO CAN–FD, 4 x SPI, 2 x LinFLEX and 4 x Timer

Security and Safety• Crypto Service Engine (CSE3)

• ASIL B capable SoC (Safe Assure™) with LBIST and MBIST self-

testing

• Voltage/Temp monitoring

• End to End complete ECC memory

• SW core self testing, Safe DMA and CRC processing

Temperature and Support• -40°C to 125°C (junction) AEC-Q100 Grade 2

• 15 year product longevity support

SRP: ~$30-35

Page 34: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 38

S32V Value Drivers

ISPCGV APEX

M4 A53

A53 A53

A53

On-chip Image

Signal Processor

(ISP)

DUAL APEX

Vision

Accelerators

M4 Core for

Functional

Safety

QUAD 1GHz

A53 Cores

Low Power

Envelope

2-10W

• Reduce camera

BOM for SVM

• ISP graph tool

• Low power option

• <7W non GPU with

passive heatsink

• GPU enabled option

<10W

• ASIL-B Safety

• ISO26262 and

IEC61508

• AutoSAR MCAL

• AutoSAR OS

• Sensor Fusion

• APEXCV support

• CNN Deep learning

• ID and Class.

• APEX graph tool

3D

GPU

Graphic

Processing

Unit (GPU)

• GC3000 3D GPU

• 4 shader

• Supports OpenCL,

OpenVG,OpenGL

• Offload MPUs for

graphic/HMI

support

• Machine learning

• ~10k DMIPS

• 800MHz option

• Dual core option

Encryption

Security

(CSE)

• 128bit encryption

• SHE compliant

• Secure Boot

• Trust zone

OBJECT DETECTION POWER SAVINGS SAFETY

Page 35: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 39

Driver Monitor

VISION

Surround View

VISION

What is S32V?

NCAP Camera

VISION

Sensor Fusion

VISION / RADAR

✓ 3D Rendering

✓ GP-GPU

ISP

✓ HDR

✓ De-mosaic

✓ Bayer pattern

✓ Filters

✓ Kernels

✓ Classifiers

✓ CNN

✓ Transformation

✓ Extraction

✓ ASILB - D

Decision

Making

APEX

A53’s /

Neon

3D-GPU

Page 36: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 40

Enablement

Page 37: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 41

Vision SDK

• APEX-CV Libraries− APEX-CV

− APEX-native

− APU programming and ACF support

− APEX emulation support

• ISP Libraries− With MIPI-CSI2, VIU, H264 encoder/decoder and

JPEG decoder support

• IO Drivers− DCU, camera, i2c, uart, qspi

• 3rd party SW support− OpenCV, pthread, ffmpeg etc

• Latest Linux BSP Image

• Demos

• Documents

EDGES

CORNERS

BLOBS

FEATURE

Page 38: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 42

Visual Graph Tool

Page 39: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 43

SBC-S32V234 Vision Platform… Only $649

Carrier board

SOM Module

2 x MIPI interfaces

1 x HDMI interface

Gbit Ethernet

PCIe

2 x CAN port

LIN port

USB to Serial port

JTAG

Page 40: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 44

OV10640CSP-S32V

− MIPI camera module

S32V234 Compatible Cameras & Deserializer

SerDes Boards

MAX9286S32V234

MAX9286S32V234DB#

− Adapter supports 4

LVDS cameras

S32V-SONYCAM MXOV10635-S32V

− MIPI camera module

* OV9716 MIPI / VIU

• supports Maxim SerDes

adapter

* AR140

• supports both SerDes adapters

SUPPORTED CAMERAS

TI UB964

− Adapter supports 4

OV10640 or AR140

cameras

* Software available outside VSDK

Page 41: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 45

S32V234 Vision Demos

Demo Description

• The S32V234 Vision demo contains 3 pre-compiled projects which demonstrate the following demos using e-IQ™Auto software:

1. Quad-camera Surround View Monitoring Demo

− Captures and stitches 4 x 1MP cameras together for 360°awareness using software from TES (3rd party)

2. Image Classifier Demo

− CNN algorithm to classify images from trained dataset using Squeezenet and new e-IQ™-Auto software for APEX

3. Object Detection Demo

− CNN vision algorithm detects trained image types such as vehicles, pedestrians, traffic lights and signs using and new e-IQ™-Auto software for APEX

Demo Booking

• Contact: Philip Pesses at [email protected]

• Available for reservations now

S32V234 Vision Processing Demos

1

2 3

Page 42: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 46

Ecosystem Overview

OSsLinux BSP, QNX

Vision SDKVivante SDK

for GPU

AUTOSAROS & MCAL

SDK, FreeRTOS &

Drivers

Yocto Project

S32DS for

Vision IDE

(+ ISP/APEX

Graph tools)

AIREB Tresos

Studio

HW

SW

Tools

A53

Application

Cores

ISP

APEX

CODECS

GPUM4 Realtime

CoreSoC

Low Cost EVBSBC-S32V234

Camera Modules

Extensive partnerships with specialist companies providing - ISP

software, surround view applications, AI-ML solution, hardware design

and morePartners

*Software under development and will be available in Q3/Q4 2018. Contact NXP for more information.

S32V-SONYCAM

OV10640CSP-S32V

SerDes ModulesMXOV10635-S32V

AR140

OV9716

MAX9286S32V234

Deserializer

TI UB964

Deserializer

Use our SBC-

S32V234 Quick

Start Guide (QSG)

to Get Started

Page 43: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 47

Ready to be used…

• Fully release documentation and enablement available online:− Specs

− Safety Manual

− App Notes

− EVB (please email me for schematic)

− Enablement code

https://www.nxp.com/products/processors-and-microcontrollers/arm-based-processors-and-mcus/s32-automotive-platform/vision-processor-for-front-and-surround-view-camera-machine-learning-and-sensor-fusion-applications:S32V234?lang_cd=en

Page 44: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

COMPANY PUBLIC 48

S32V Vision Software Development

Apex Core Framework

S32V Vision SDK

S32V APEX-CV

S32V SW Partners

S32V Application

Partners

Ea

se o

f d

eve

lopm

ent

✓ Write required kernel(s) or select

from pre-existing kernel(s)

✓ Construct a graph using desired

kernels

✓ CNN Inference kernel

✓ Demo source code (LDW, Optical

Flow, SVM, others)

✓ ~70 kernels and graphs

✓ Geometric transformation

✓ Feature Descriptors

✓ Classifiers

✓ Algorithms

✓ OS, Tools

✓ CNN / DNN

✓ Fully licensable applications

✓ NCAP 2018 / 2020 PDET

✓ LKA, AEB …

…..

S32V Design

Studio For Vision

• ISP Tools

• APEX Tools

• Compiler

• Debugger

• IDE

Page 45: Safety MCU/MPUs for General Purpose and Vision Applications · 2020. 9. 2. · NCI Stack NFC Antenna NCx3340 NFC Controller Embedded Firmware MCU NCI S32K Dielectric Electrode PCB

NXP and the NXP logo are trademarks of NXP B.V. All other product or service names are the property of their respective owners. © 2019 NXP B.V.