10th anniversary update - khronos group · • ... webgl html5 javascript css ... provided download...

© Copyright Khronos Group, 2010 -

10th Anniversary Update

Neil TrevettVice President Mobile Content, NVIDIA

President, The Khronos GroupTokyo, December 2010


Welcome!

• In its first 10 years Khronos has created standards that are now shipping in

100‟s of millions of devices

• Today we will give you update on Khronos and our news over the last year

- Hwanyong Lee, CTO Huone – OpenVG Overview

- Erik Noreke, OpenSL ES Chair – OpenSL ES and OpenMAX IL Overview

• … hear from Japanese members using and shipping Khronos APIs

- Takumi, Hi, Imagination, DMP

• … and discuss about how we will start out the next 10 years


Khronos Vision

“The best way to predict the future is to invent it.”Alan Kay

Billions of devices increasinggraphics, compute, video,

imaging and audio capabilities

Market growth driven by rich

user experiences

Developers creating user experiences need efficient silicon accelerator access

Standard APIs define silicon capabilities

and provide reliable developer access


Modern Mobile Silicon Functionality

• Rich end-user experiences

need significant processing

- Parallel Computing

- GPU Computing

- 3D Graphics

- 2D Graphics

- Camera control

- Image processing

- Video encode

- Video decode

- Audio encode

- Audio decode

• All this silicon needs

to be programmed


The Critical Role of APIs

Khronos APIs are low-level – just above raw silicon - to create the

“foundation” functionality needed on every platform

APIs enable software developers to turn

silicon functionality intorich end user experiences


Khronos - Forum for Industry Cooperation

Open International MembershipAny company is welcome to join to suggest working groups and technology directions

Open StandardsPublicly available onweb-site to be used

by anyone

Royalty FreeNo per-device royalty

to ship APIimplementations

Industry CooperationHundreds of man years invested by industry experts to create state-of-the APIs

Opportunity to compete to create chips, software and systems that deliver amazing end user experiences in international markets

International Market Growth= ¥ $ € !


Board of Promoters

Over 100 members – any company worldwide is welcome to join

Apple

http://www.amd.com/

http://www.aplix.co.jp/en/

http://www.codeplay.com/

http://www.antixlabs.com/

http://www.altsoftware.com/

http://www.dell.com/content/default.aspx?c=us&l=en&s=gen

http://www.google.com/

http://www.hu1.com/

http://www.fujitsu.com/

http://global.mitsubishielectric.com/

http://www.nds.com/

http://www.s3graphics.com/

http://www.st.com/

http://www.sasken.com/

http://www.toshiba.com/

http://www.vivantecorp.com/

http://www.yumetech.com/

http://www.marvell.com/index.jsp

http://www.umu.se/umu/index_eng.html

http://www.gshark.com/


Khronos Family of Standards

Embedded 3DCross platform

desktop 3D

3D Digital Asset Exchange format

Advanced Audio Vector 2D

Context, Sync and Surface Management

Mobile OSAbstraction

Au

tho

rin

g a

nd

a

cce

ssib

ilit

yA

pp

lica

tio

n

Acce

lera

tio

n

Parallel Computing

Plugin-free 3D Web Content

Streaming MediaSafety Critical 3D

Syste

m

Inte

gra

tio

n

Window SystemAcceleration

A coordinated ecosystem of compute, graphics and media

standards and APIs

Video, Audio andImage Acceleration

Codec Creation


Major Releases This Year at Khronos

Nov09

WebGL 1.0 Provisional

Specification Released

OpenCL 1.1Specification

Released

Jun10OpenGL 4.0

Released

Mar10

OpenGL 4.1Released

Jul10


OpenGL for Each Hardware Generation

Geometry Shaders

1.X

Fixed Function

2.X

Vertex and Fragment Shaders

3.X

Tessellation and Compute

4.X

„Surfacerealism‟

„Shape realism‟


Accelerating OpenGL Innovation

• OpenGL increasing pace of innovation

- Six new spec versions in two years

- Actual implementations following specifications closely

• OpenGL 4.1 and GLSL 4.10 specifications available June 2010

- Support for the latest generation of programmable hardware

• OpenGL 4.1 is now superset of DX11 functionality

DirectX 10.1

2004 2006 2008

OpenGL 2.0 OpenGL 2.1 OpenGL 3.0

OpenGL 3.1

2009

DirectX 9.0c DirectX 10.0 DirectX 11

20102005 2007

OpenGL 3.2

OpenGL 3.3+

OpenGL 4.0

2011

OpenGL 4.1

SIGGRAPH2010


Processor Parallelism

CPUsMultiple cores driving performance increases

GPUsIncreasingly general purpose data-parallel

computing

Graphics APIs and Shading

Languages

Multi-processor

programming – e.g. OpenMP

EmergingIntersection

HeterogeneousComputing

OpenCL is a programming framework for heterogeneous compute resources


Anatomy of OpenCL

• Language Specification

- C-based cross-platform programming interface

- Subset of ISO C99 with language extensions - familiar to developers

- Defined numerical accuracy - IEEE 754 rounding with specified maximum error

- Online or offline compilation and build of compute kernel executables

- Rich set of built-in functions

• Platform Layer API

- A hardware abstraction layer over diverse computational resources

- Query, select and initialize compute devices

- Create compute contexts and work-queues

• Runtime API

- Execute compute kernels

- Manage scheduling, compute, and memory resources


OpenCL Timeline

• Six months from proposal to released OpenCL 1.0 specification

- Due to a strong initial proposal and a shared commercial incentive

• Multiple conformant implementations shipping

- For CPUs and GPUs on multiple OS

• 18 month cadence between OpenCL 1.0 and OpenCL 1.1

- Many new API and language features – responding to developer feedback

- Backwards compatibility protect software investment

Apple proposes OpenCL working group and contributes draft specification to Khronos

Khronos publicly releases OpenCL 1.0 as royalty-free specification

Khronos releases OpenCL 1.0 conformance tests to ensure high-quality implementations

Jun08

Dec08

May09

2H09

Multiple conformant implementations ship across diverse OS and platforms

Jun10

OpenCL 1.1 Specification released and first implementations ship


OpenCL Desktop Implementations

• http://www.amd.com/us/products/technologies/stream-

technology/opencl/Pages/opencl.aspx

• http://software.intel.com/en-us/articles/intel-opencl-sdk/

• http://www.nvidia.com/object/cuda_opencl_new.html

http://www.amd.com/us/products/technologies/stream-technology/opencl/Pages/opencl.aspx



http://software.intel.com/en-us/articles/intel-opencl-sdk/







http://www.nvidia.com/object/cuda_opencl_new.html


OpenCL Courses

• http://maps.google.com/maps/ms?ie=UTF8&oe=UTF8&msa=0&msid=11

0337952595184289080.000491695f76aaf121c0d

http://maps.google.com/maps/ms?ie=UTF8&oe=UTF8&msa=0&msid=110337952595184289080.000491695f76aaf121c0d

http://maps.google.com/maps/ms?ie=UTF8&oe=UTF8&msa=0&msid=110337952595184289080.000491695f76aaf121c0d


Mobile Application Portability

CompositingUser Interfaces

Games and Game EnginesGames and

Game EnginesGames and Game Engines

Flash PlayersFlash PlayersFlash and SVG

Players

TV and Video StacksTV and Video

StacksTV and Video Stacks

Applications are portable toKhronos-enabled platforms

OS resource abstraction

Browsers

Silicon and platform

independent graphics, media

and compute acceleration

http://images.google.com/imgres?imgurl=http://www.cio.com/images/content/articles/body/2007/11/android_robot.gif&imgrefurl=http://www.cio.com/article/156250&h=135&w=121&sz=4&hl=en&start=4&sig2=VCDouhSNWn_-wOlH6y2rhQ&tbnid=sUOsxQroWspMpM:&tbnh=92&tbnw=82&ei=JQmVSISCAajmigHa5Zy8Cg&prev=/images?q=google+android+logo&gbv=2&hl=en&sa=X


Driving API Adoption into Device Platforms

Plug-in

Native support

SurfaceFlinger

EGL and OpenSL ES now supported in Android 2.3 NDK

http://www.apple.com/


EGL Becoming an Interoperability Hub

Buffers, textures and video streams flow efficiently

between any combination of client APIs

Inter-API Synchronization events enable efficient

resource sharing

EGL Interoperability Conformance Tests being

created to ensure that client APIs can cleanly communicate

Enabling the Khronos individual APIs to interoperate as a

coherent ecosystem


Mobile Visual ComputingCompute, graphics and AV APIs

interoperate through EGL

Visual Computing Ecosystem

Desktop Visual ComputingOpenGL and OpenCL have direct

interoperability. OpenCL objects can be created from OpenGL Textures, Buffer

Objects and Renderbuffers


WebGL – 3D on the Web – No Plug-in!

• Historic opportunity to bring accelerated 3D graphics to web

- WebGL defines JavaScript binding to OpenGL ES 2.0

• Leveraging HTML 5 and uses <canvas> element

- Enables a 3D context for the canvas

• Very different dynamic to VRML

- Browser vendors want 3D this time

- No plug-in

Availability of OpenGL ES 2.0 on almost every

web-capable device

JavaScriptbinding to

OpenGL ES 2.0Increasing JavaScript performance.HTML 5 Canvas Tag


WebGL Implementation Update

• Working group launched March 2009

- Mozilla, Apple, Google and Opera

working with OpenGL GPU vendors

- Provisional spec – November 2009

- Implementations in public daily builds

- WebGL 1.0 expected spring 2011

- WebGL on Windows uses Google Angle

to create ES2 over DX9

• WebGL JS middleware already

- GLGE, SpiderGL, X3DOM, EnergizeGL,

SceneJS, O3D, CopperLicht, CubicVR

• WebGL Extension Registry Online

- http://www.khronos.org/registry/webgl

/doc/spec/extensions/

ContentJavaScript, HTML, CSS, ...

WebGL HTML5

JavaScript CSS

BrowserProvided

OSProvided

DownloadFrom Web

Plug-in

Production support expected in 1Q11

OpenGL ES 2.0OpenGL

DX9/Angle

http://www.khronos.org/registry/webgl/doc/spec/extensions/

http://www.khronos.org/registry/webgl/doc/spec/extensions/

http://code.google.com/p/angleproject/


WebGL Compositing

• WebGL is HTML - fully participates in canvas/browser compositing

- Overlay and underlay HTML content - including SVG

- Easy to make HUDs or user interfaces

• WebGL TexImage2D accepts

- Raw buffer

- HTML image element

- HTML video element (takes current frame)

- HTML canvas element

E.g. draw text to 2D canvas, use as bump-map texture in WebGL

then composite 3D model over HTML text


OpenGL Ecosystem

Leading-edge functionality developed first on desktop

OpenGL ES 2.0 on desktop as subset of OpenGL 4.1 for mobile

content flexibility – including native support for WebGL

WebGL will drive new-generation security into

OpenGL family

Mobile functionality subset that is deployed on billions of devices

Pervasive OpenGL ES 2.0 availability enables Browser vendors to build 3D

directly into HTML5


Starting the Next 10 Years

• New working groups for ray-tracing and computer vision?

• EGL extensions for rich graphics/video interop?

• 3D Convergence - does OpenGL ES become an OpenGL profile over time?

• Need EGL and OpenMAX IL on desktop – increased application portability?

• OpenVG Express – for bring essential OpenVG onto every GPU?

• Bringing vector graphics to OpenGL / OpenGL ES?

• W3C liaison for web-based augmented reality?


Khronos Member Speakers

• Hwanyong Lee, CTO, HUONE

- OpenVG – Khronos Overview

• Erik Noreke, OpenSL ES Work Group Chairperson

- OpenSL ES and OpenMAX – Khronos Overview

• Tommy Asano, Executive Director, Advanced Technologies, TAKUMI

- Graphics IP core enabling Khronos API for embedded solutions

• Shige Matsue, President, Imagination Tech KK

- OpenGL ES, OpenVG, OpenCL - Bringing All Khronos APIs Together

• Tomotaka Watanabe, Marketing Manager, HI Corp

- Middleware product development using Khronos APIs

• Tatsuo Yamamoto, CEO, DMP

- Khronos API training programs

10th anniversary update - khronos group · • ... webgl html5 javascript css ... provided download...

Documents