Video Streaming via Network using SOPC

Characterization Presentation

1

Presented By:Tal Rath and Eyal Enav

Supervisor :

Mike Sumszyk

Project Goals. Project System Overview. System Architecture. Data Flow. System Inputs. System Outputs. Rates. Real Time Performance. Conclusions. Schedule.

Agenda

2

◦Real-time streaming of webcam video through LAN using SOPC.

◦Learning SOPC environment.

◦Designing a system for real-time demands.

◦Establishing a USB and Ethernet connections.

◦Investigation and implementation of suitable internet protocols.

Project goals

3

DE2 Altera board Ethernet 10/100M port. USB device port 2.0.

Cyclone II FPGA

Nios II soft-core.

Avalon switch fabric.

Environment: SOPC builder, Quartus II and NIOS IDE II.

Project System Overview

4

System Architecture.

6

DE2 Board

Cyclone II

Nios II Soft Processor

Avalon Switch Fabric

On Chip Memory

Philips ISP1362(USB)

DM9000A (Ethernet

Controller)

Ethernet Port 10/100M

LAN

Remote PC

Local PC

USB PortUSB

Cable

USB

Cable

RJ-45RJ-45

Data Flow

7

Camera

Local PC

USB - device

USB - host USB - host

USB Service Program

DE2

USB - device

Frames

Nios II

Ethernet Port

Wait for Client

request

Create UDP

Packets

Get data From USB

Send over

Ethernet

Remote IP & MAC

Remote PC

LAN

UDP Receive & Video DisplayProgram

Ethernet

Ether. Packets

Frames

Screen Screen

DE2 board◦ Connected to PC through USB port,

using Philips USB controller.

USB webcam◦ Connected to PC through USB port.

USB connection service program ◦ Should be written for Windows OS. (C++)

◦ Reads frames from camera.◦ Sends frames to USB port using OS services.

8

System Inputs

DE2 is connected to LAN.◦ DM9000A PHY/MAC Controller supplies an Ethernet interface

for NIOS II.◦ UPD/IP over Ethernet should be Implemented using IDE2.◦ Possible implementation of ARP and DHCP.

Remote computer is connected to LAN.

UDP service program.◦ Should be written for Windows OS. (C++)

◦ Accepts UDP frame packets from the SOPC.◦ Uses buffering.◦ Displays video stream.

System Outputs

9

LAN

Rates

10

System Component

Rate(Mbit/

s)

Ideal Stream Frame Size Limitation for 15 FPS

(pixels / frame)

Notes

USB 2.0 is used.

480  1100X1100 Connects between local PC and DE2.

Fast Ethernet 100 500X500 Refers to DE2 port and PC network

cards.

• NIOS II loaded to Cyclone II can process up to 400M instructions Per second

CPU

Real Time Performance

11

Two memory buffers will be allocated on chip memory.◦ Each one with a size of constant number of UDP packets.

Operation sequence (Assuming buffer B is ready):

DMA transfer A

ended Interrupt

Start DMA transfer: USB buffer A

Send Buffer B to network using UDP packets

Buffer_A_Ready_Flag = TRUE

Wait for Buffer_A_Ready_Flag

DMA transfer

Same with B and A replaced

Conclusions

12

USB protocol will be implemented over Philips ISP1362 USB controller.

UDP sender will be implemented over DM9000A mechanism.

A USB connection service program should be written and run on local computer.

A UDP service program will be written and run on remote computer.

DMA will be used in order to achieve parallelism.

Schedule

13

Milestone Status ; Due date Comments

Explore development environment

Done

Implement Ethernet layer

Done

UDP implementation over Ethernet

15.12.08 Data sending only

Write a UDP service program for remote

PC + UDP tests

22.12.08

Receive data from USB core

29.12.08

Schedule (2)

14

Milestone Status ; Due date Comments

Camera service program for local

computer

5.1.08

NIOS II program and integration

19.1.08

integration tests and improvements

22.1.08

15