lighting of killzone: shadow fall

118

Upload: guerrilla-games

Post on 19-Aug-2014

9.728 views

Category:

Entertainment & Humor


1 download

DESCRIPTION

The presentation describes Physically Based Lighting Pipeline of Killzone : Shadow Fall - Playstation 4 launch title. The talk covers studio transition to a new asset creation pipeline, based on physical properties. Moreover it describes light rendering systems used in new 3D engine built from grounds up for upcoming Playstation 4 hardware. A novel real time lighting model, simulating physically accurate Area Lights, will be introduced, as well as hybrid - ray-traced / image based reflection system. We believe that physically based rendering is a viable way to optimize asset creation pipeline efficiency and quality. It also enables the rendering quality to reach a new level that is highly flexible depending on art direction requirements.

TRANSCRIPT

Page 1: Lighting of Killzone: Shadow Fall
Page 2: Lighting of Killzone: Shadow Fall
Page 3: Lighting of Killzone: Shadow Fall

Lighting Killzone : Shadow Fall

Michal Drobot

Senior Tech Programmer

Guerrilla Games

Page 4: Lighting of Killzone: Shadow Fall

Intro

Guerrilla Games is SCEE studio based in Amsterdam

Working on two Playstation 4 titles: Killzone: Shadow Fall

New IP

Killzone: Shadow Fall is a launch tile

Annouced during Playstation 4 reveal Running on target 1080p 30fps

Page 5: Lighting of Killzone: Shadow Fall

Focus

Physically Based Lighting

Physically Based Area Lights

Rendering Pipeline

Page 6: Lighting of Killzone: Shadow Fall

Motivation

Killzone 3 Shipped in 2011

Matured PS3 technology

Considered one of generation visual benchmark titles

Killzone : Shadow Fall Next generation launch title

How does it compare?

Page 7: Lighting of Killzone: Shadow Fall
Page 8: Lighting of Killzone: Shadow Fall
Page 9: Lighting of Killzone: Shadow Fall
Page 10: Lighting of Killzone: Shadow Fall
Page 11: Lighting of Killzone: Shadow Fall
Page 12: Lighting of Killzone: Shadow Fall
Page 13: Lighting of Killzone: Shadow Fall

Generation change

Page 14: Lighting of Killzone: Shadow Fall
Page 15: Lighting of Killzone: Shadow Fall

Motivation

Physically Based Lighting Easier to achieve hyperrealism / photorealism

Consistent look in different HDR environments

Simple material interface for artists

Easy troubleshooting and extension

Page 16: Lighting of Killzone: Shadow Fall

Theory

Page 17: Lighting of Killzone: Shadow Fall

Light Flux

Irradiance = integrated light incoming from all directions (diffuse)

Radiance = light incoming from one direction (specular reflection)

Irradiance (E)

Radiance (L)

Page 18: Lighting of Killzone: Shadow Fall

Courtesy of ILM

Image Based Lighting (IBL)

Page 19: Lighting of Killzone: Shadow Fall

Courtesy of ILM

Page 20: Lighting of Killzone: Shadow Fall

Courtesy of ILM

Page 21: Lighting of Killzone: Shadow Fall

Physically Based Lighting Model

Physically Based Shading Model Responsible for surface response to incoming light depending on various

surface physical properties

Physically Based Lights Responsible for light flux calculation in the scene depending on various lights

with physical properties

Page 22: Lighting of Killzone: Shadow Fall

Physically Based Shading : Real life examples

Specular Dominant part of visible lighting

Every material exhibits specular lighting

Angle dependent

Material type dependant

Page 23: Lighting of Killzone: Shadow Fall

Real life lighting

Courtesy of John Hable

Diffuse Specular

Page 24: Lighting of Killzone: Shadow Fall

Real life lighting

Courtesy of John Hable

Diffuse Specular

Page 25: Lighting of Killzone: Shadow Fall

Real life lighting

Courtesy of John Hable

Diffuse Specular

Page 26: Lighting of Killzone: Shadow Fall

Real life lighting

Diffuse Specular

+

Courtesy of John Hable

Diffuse Specular

Page 27: Lighting of Killzone: Shadow Fall

BRDF Diffuse

Specular Eye

Page 28: Lighting of Killzone: Shadow Fall

Fresnel

‘Rough’

Reflection

Refraction

Page 29: Lighting of Killzone: Shadow Fall

Non metals

Page 30: Lighting of Killzone: Shadow Fall

Metals

Page 31: Lighting of Killzone: Shadow Fall

Roughness ‘Smooth’

‘Rough’

Page 32: Lighting of Killzone: Shadow Fall

Roughness ‘Smooth’

Page 33: Lighting of Killzone: Shadow Fall

Visibility / Self Shadowing

Page 34: Lighting of Killzone: Shadow Fall

Energy Conservative

Non - Energy Conservative

Page 35: Lighting of Killzone: Shadow Fall
Page 36: Lighting of Killzone: Shadow Fall
Page 37: Lighting of Killzone: Shadow Fall

Workflow

3 main parameters Albedo (RGB8)

Roughness (R8)

Specular Reflectance (RGB8)

Material response Decoupled from Lighting

Works in any light environment

Review assets in different IBL lighting environments

Page 38: Lighting of Killzone: Shadow Fall
Page 39: Lighting of Killzone: Shadow Fall
Page 40: Lighting of Killzone: Shadow Fall
Page 41: Lighting of Killzone: Shadow Fall

Smooth (1.0)

Rough (0.0)

Diffuse

Page 42: Lighting of Killzone: Shadow Fall

Material properties

Measured values for most materials Available in physical tables

Every material can be roughly defined by those parameters

We provided them as Photoshop color swatches

Base for hand painted textures

Page 43: Lighting of Killzone: Shadow Fall

Use case

Material Old iron plate

Covered in paint

Scratches

Bullet holes

Rust

Page 44: Lighting of Killzone: Shadow Fall

Simplified Roughness texture Thin old paint, scratched, showing off iron underneath Due weathering effects smoothened R = High

Pure rust R = very low Rusting metal R = mixed, sparkles of medium smooth metal

Bullet hole High temperature smoothens iron (due to impact energy) R = very high

Pure old paint R = medium

Page 45: Lighting of Killzone: Shadow Fall

Simplified Specular Reflectance texture Thin old paint, scratched, showing off iron underneath SR = Low Iron

Pure rust, non metal SR = Low, non metal Rusting metal, SR = Medium, non metal, Sparkles of Low Iron

Bullet hole exposes pure Iron SR = Iron

Pure paint SR = Low, Medium, High non metal, Depends on paint type Old paint = Low New paint = Medium / High

Page 46: Lighting of Killzone: Shadow Fall

Simplified Albedo texture White thin old paint, scratched, showing off iron underneath A = Dark gray (showing off metal)

Pure rust, A = Rusty in range of old concrete

Bullet hole exposes pure Iron A = Very dark (metal)

White old paint A = White in albedo range of concrete (light gray)

Page 47: Lighting of Killzone: Shadow Fall

Shadow Fall BRDF

Based on Cook-Torrance Fresnel

Smith Schlick Visiblity Function

Normalization based on Specular Reflectance

Roughness as Specular Importance Cone Angle

Approximate translucency Density maps

Translucency diffusion maps

Page 48: Lighting of Killzone: Shadow Fall

IBL Point Based BRDF

Page 49: Lighting of Killzone: Shadow Fall

IBL Point Based BRDF – factor visualization

Page 50: Lighting of Killzone: Shadow Fall

IBL Ambient BRDF – factor visualization

Page 51: Lighting of Killzone: Shadow Fall

IBL Ambient BRDF

Page 52: Lighting of Killzone: Shadow Fall

IBL Point Based BRDF

Page 53: Lighting of Killzone: Shadow Fall

IBL Ambient BRDF

Page 54: Lighting of Killzone: Shadow Fall

Big step for the studio

Artists had to adapt

Training and workshops

Production and Quality Win

Page 55: Lighting of Killzone: Shadow Fall
Page 56: Lighting of Killzone: Shadow Fall
Page 57: Lighting of Killzone: Shadow Fall
Page 58: Lighting of Killzone: Shadow Fall
Page 59: Lighting of Killzone: Shadow Fall

Physically Based Lights

Page 60: Lighting of Killzone: Shadow Fall

Blinn-Phong Point Light

Page 61: Lighting of Killzone: Shadow Fall

Blinn-Phong Point Light

Page 62: Lighting of Killzone: Shadow Fall

Area Lights

Every light source Size

Shape

Intensity

Art Photography

Light Direction

Page 63: Lighting of Killzone: Shadow Fall
Page 64: Lighting of Killzone: Shadow Fall

Spherical Light

Page 65: Lighting of Killzone: Shadow Fall

Disc Light

Page 66: Lighting of Killzone: Shadow Fall

Rectangular Light

Page 67: Lighting of Killzone: Shadow Fall

Texture Rectangular Light

Page 68: Lighting of Killzone: Shadow Fall

Area Size and Intensity

Page 69: Lighting of Killzone: Shadow Fall
Page 70: Lighting of Killzone: Shadow Fall
Page 71: Lighting of Killzone: Shadow Fall
Page 72: Lighting of Killzone: Shadow Fall
Page 73: Lighting of Killzone: Shadow Fall
Page 74: Lighting of Killzone: Shadow Fall

α α

pC0

pC1

d0

d1

pC0 > pC1, due to d0 > d1 Result : pC0 blurier than pC1

Page 75: Lighting of Killzone: Shadow Fall
Page 76: Lighting of Killzone: Shadow Fall
Page 77: Lighting of Killzone: Shadow Fall
Page 78: Lighting of Killzone: Shadow Fall

Irradiance Integral

DA : I(p,n) = Integrate(A) [L * cos(fi) * cos(fo) * dA / d^2] dA – differential area of the light L – luminance of light A – Area of the light

n

p’

p

d n’

fi

fo

Page 79: Lighting of Killzone: Shadow Fall

n

p

Y

X

3D – Word Space X , Y – set the light frame

Radiance Integral

Page 80: Lighting of Killzone: Shadow Fall

2D – projected on light frame

X

Y

Page 81: Lighting of Killzone: Shadow Fall

2D – projected on light frame

X

Y

Area of integration

Page 82: Lighting of Killzone: Shadow Fall

X

Y

PDF to integrate

Over Area

Page 83: Lighting of Killzone: Shadow Fall
Page 84: Lighting of Killzone: Shadow Fall

IES Light Profiles

Page 85: Lighting of Killzone: Shadow Fall

IES Light Profiles

Page 86: Lighting of Killzone: Shadow Fall

IES Light Profiles

Page 87: Lighting of Killzone: Shadow Fall
Page 88: Lighting of Killzone: Shadow Fall

Lighting Pipeline Overview

Page 89: Lighting of Killzone: Shadow Fall

IBL Reflection System

3 Tier Reflection Raytrace system Realtime Glossy Reflections

Localized Cubemaps

Skybox

Page 90: Lighting of Killzone: Shadow Fall
Page 91: Lighting of Killzone: Shadow Fall
Page 92: Lighting of Killzone: Shadow Fall
Page 93: Lighting of Killzone: Shadow Fall
Page 94: Lighting of Killzone: Shadow Fall
Page 95: Lighting of Killzone: Shadow Fall
Page 96: Lighting of Killzone: Shadow Fall
Page 97: Lighting of Killzone: Shadow Fall
Page 98: Lighting of Killzone: Shadow Fall
Page 99: Lighting of Killzone: Shadow Fall

Localized Cubemaps

Page 100: Lighting of Killzone: Shadow Fall
Page 101: Lighting of Killzone: Shadow Fall
Page 102: Lighting of Killzone: Shadow Fall

Picture of pretty cubemap in cross with mips

Page 103: Lighting of Killzone: Shadow Fall

Picture of pretty cubemap in cross with mips

Page 104: Lighting of Killzone: Shadow Fall
Page 105: Lighting of Killzone: Shadow Fall
Page 106: Lighting of Killzone: Shadow Fall

IBL Render Pass Breakdown

Page 107: Lighting of Killzone: Shadow Fall

Render Pass Breakdown

Baked Lightmaps Diffuse + Dynamic Lights

Page 108: Lighting of Killzone: Shadow Fall

Ambient BRDF

Page 109: Lighting of Killzone: Shadow Fall

Cubemaps

Page 110: Lighting of Killzone: Shadow Fall

Lightmap Diffuse + Dynamic Lights + Ambient BRDF * Cubemaps

Page 111: Lighting of Killzone: Shadow Fall

Real Time Glossy Reflections

Page 112: Lighting of Killzone: Shadow Fall

Real Time Glossy Reflections : Mask

Page 113: Lighting of Killzone: Shadow Fall

Final composite of IBL based lighting

Page 114: Lighting of Killzone: Shadow Fall

Render Pass Breakdown

Page 115: Lighting of Killzone: Shadow Fall
Page 116: Lighting of Killzone: Shadow Fall

Takeaway

Physically Based Lighting Higher quality

Faster asset production

Asset reuse in different environments

Physical Area Lights Time to say goodbye to point lights

Easier workflow

High quality results

Real Time Reflections Important visual clue

Page 117: Lighting of Killzone: Shadow Fall

We are hiring!

www.guerrilla-games.com/jobs