ai starter kits - skymizer€¦ · • lander bsp generator r1.2 software development kits •...
TRANSCRIPT
SPEC SHEET
AI Starter Kits
skymizer.com
By diving deeply into NVDLA RTL code, we successfully make ONNC supports complex operators and multiple hardware configurations of NVDLA. It supports more ONNX models; supports more hardware configurations; and produces high performance loadable files.
Full-fledged NVDLA compiler
AI Starter Kits is a comprehensive set of FPGA-based prototyping tools including optimized Open Neural Network Compiler (ONNC), drivers (KMD/UMD), Linux kernel, virtual platform, FPGA netlist and RTL code (NVDLA). Using AI Starter Kits, you will benefit from an optimal design experience with our extensive suite of advanced design tools, a well-tested open source solution, and a fast-time-to-market prototyping FPGA board, all in one platform. AI Starter Kits optimize your design process and ensures that your software runs and exploits the full power of the underlying AI chips. Skymizer aims at providing a unique solution tailored to your needs to help you build a strong hardware/software co-design team and efficiently save your time ahead of AI chip fabrication.
OverviewFull-fledged NVDLA compiler, superior quality of compilation results, and rich FPGA supports to enable your AI-on-Chip
SoftwareDevelopmentKit BoardSupportPackage
AI models
Workspace
NVDLALoadable
Compiler VirtualPlatform
checker reader
debugger
nm
diagnostics
NVDLALoadable
UserMLApplicationSoftware
UserModeDriver
KernelModeDriver
HostCPU NVDLA
© 2019 Skymizer Taiwan, Inc. All rights reserved.
ONNC supports most popular models in ONNX model zoo. Weight of official ONNX models is not designed for NVDLA hardware, and the result may not be always correct. To resolve this problem, we create ONNC calibration tool to adjust weights in models.
Best supports of ONNX models
TABLE I: Compiler support status for ONNX model zoo.
Compiler experts make not only compiler but a chain of tools. AI Starter Kits includes a series tools for customization of NVDLA runtime environment.
Comprehensive SDK and BSP
• Open Neural Network Compiler (ONNC) for nv_full, nv_small and nv_large• ONNX model checker• ONNX model reader• Cross Compiler GCC 7.3.1 for ARM Cortex-A (aarch64)• Cross Compiler GCC 8.3.0 for RISC-V 64 (riscv64)• GreenSocs virtual platforms for ARM (aarch64) and RISC-V (riscv64) with nv_full, nv_small and
nv_large• Lander BSP generator r1.2
Software Development Kits
• Support Linux kernels 4.13, 4.14~4.19, 5.0, 5.1• Bug-fixed user mode driver• Bug-fixed kernel mode driver for virtual platforms and supported FPGAs• Slides show example program• Streaming example program
Board Support Packages
AI Starter Kits provides various platforms for different types of developers.
Strong Ecosystem
• supports ARM Cortex-A processors (aarch64)• supports RISC-V processors (riscv64)• supports various NVDLA hardware configuration (nv_small, nv_full)
Virtual Platforms
• Xilinx ZCU102 for nv_small 64MACs• Xilinx ZCU104 for nv_small 64MACs• S2C KU115 for nv_medium 1024MACs • S2C VU440 for nv_large 2048MACs
FPGA Platforms
skymizer.com email: [email protected] tel: +886 2 8797 8337
modelRun to complete FP16 correctness INT8 Quantization Example
nv_full/nv_small(64)/nv_large nv_full nv_small/nv_large
AleXNet ✓ ✓ ✓GoogleNet ✓ ✓ ✓CaffeNet ✓ ✓ ✓R-CNN ILSVRD13 ✓ ✓ ✓DenseNet-121 ✓ ✓Inception v1 ✓ ✓ ✓Inception v2 ✓ ✓ResNet-50 ✓ ✓ShuffleNet ✓ ✓SqueezeNet ✓ ✓ ✓VGG-19 ✓ ✓ ✓ZFNet-512 ✓ ✓ ✓