visual appearance (shading & texture mapping) course note credit: some of slides are extracted...

Visual AppearanceVisual Appearance(Shading & Texture mapping)(Shading & Texture mapping)

Course Note Credit: Some of slides are extracted from the course notes of prof. J. Lee (SNU), prof. M. Desbrun (USC) and prof. H.-W. Shen (OSU) and others.

ShadingShading(Local illumination)(Local illumination)

Photorealism in Computer GraphicsPhotorealism in Computer Graphics

Photorealism in computer graphics involves Accurate representations of surface properties, and Good physical descriptions of the lighting effects

Modeling the lighting effects that we see on an object is a complex process, involving principles of both physics and psychology

Physical illumination models involve Material properties, object position relative to light sources and

other objects, the features of the light sources, and so on

Illumination and RenderingIllumination and Rendering

An illumination model in computer graphics also called a lighting model or a shading model used to calculate the color of an illuminated position

on the surface of an object Approximations of the physical laws

A surface-rendering method determine the pixel colors for all projected positions in a scene

Light SourcesLight Sources

Point light sources Emitting radiant energy at a single point Specified with its position and the color of the emitted light

Infinitely distant light sources A large light source, such as sun, that is very far from a scene Little variation in its directional effects Specified with its color value and a fixed direction for the light

rays

Light SourcesLight Sources

Directional light sources Produces a directional beam of light Spotlight effects

Area light sources

Light SourcesLight Sources Radial intensity attenuation

As radiant energy travels, its amplitude is attenuated by the factor

Sometimes, more realistic attenuation effects can be obtained with an inverse quadratic function of distance

The intensity attenuation is not applied to light sources at infinity because all points in the scene are at a nearly equal distance from a far-off source

2/1 d

local is source if

1infinityat is source if0.1

2210 dadaa

f

Light SourcesLight Sources

Angular intensity attenuation For a directional light, we can attenuate the light

intensity angularly as well as radially

nf cos)(

Surface Lighting EffectsSurface Lighting Effects

An illumination model computes the lighting effects for a surface using the various optical properties Degree of transparency, color reflectance, surface texture

The reflection (phong illumination) model describes the way incident light reflects from an opaque surface Diffuse, ambient, specular reflections Simple approximation of actual physical models

Diffuse ReflectionDiffuse Reflection

Incident light is scattered with equal intensity in all directions

Such surfaces are called ideal diffuse reflectors (also referred to as Lambertian reflectors)

Lambert’s Cosine LawLambert’s Cosine Law

The reflected luminous intensity in any direction from a perfectly diffusing surface varies as the cosine of the angle between the direction of incident light and the normal vector of the surface.

Intuitively: cross-sectional area of the “beam” intersecting an elementof surface area is smaller for greater angles with the normal.

Diffuse ReflectionDiffuse Reflection

: the intensity of the light source

: diffuse reflection coefficient,

: the surface normal (unit vector)

: the direction of light source,(unit vector)

)(cos LNIkIkI ldld

lI

dk

N

L

Ideally diffuse surfaces obey cosine law.

Often called Lambertian surfaces.

Ambient LightAmbient Light Multiple reflection of nearby (light-reflecting)

objects yields a uniform illumination

A form of diffuse reflection independent of the viewing direction and the spatial orientation of a surface

Ambient illumination is constant for an object

: the incident ambient intensity: ambient reflection coefficient, the proportion reflected away

from the surface

aIak

aaIkI

Ambient + DiffuseAmbient + Diffuse

0 if

0 if)(

LNIk

LNLNIkIkI

aa

ldaa

Specular ReflectionSpecular Reflection

Perfect reflector (mirror) reflects all lights to the direction where angle of reflection is identical to the angle of incidence

It accounts for the highlight

Specular ReflectionSpecular Reflection

Phong specular-reflection model Note that N, L, and R are coplanar, but V may not be

coplanar to the others

nls

nls VRIkIkI )(cos

: intensity of the incident light

: color-independent specular coefficient

: the gloss of the surface

lI

sk

n

Specular ReflectionSpecular Reflection Glossiness of surfaces

Specular ReflectionSpecular Reflection

Specular-reflection coefficient ks is a material property For some material, ks varies depending on ks =1 if =90°

Calcularing the reflection vector R

NNLLR )2(

LNNLR )2(

Specular ReflectionSpecular Reflection

Simplified Phong model using halfway vector H is constant if both viewer and the light source are

sufficiently far from the surface

|| LV

LVH

nsp

nsp

nsp

nsp

HNkIkI

VRkIkII

)(cos

)(cos

Ambient+Diffuse+Specular ReflectionsAmbient+Diffuse+Specular Reflections

Single light source

Multiple light source

nlsldaa VRIkLNIkIkI )()(

l

nlsldaa VRIkLNIkIkI )()(

Parameter Choosing TipsParameter Choosing Tips For a RGB color description, each intensity and

reflectance specification is a three-element vector

The sum of reflectance coefficients is usually smaller than one

Try n in the range [0, 100]

Use a small ka (~0.1)

Example Metal: n=90, ka=0.1, kd=0.2, ks=0.5

1 sda kkk

Atmospheric EffectsAtmospheric Effects A hazy atmosphere makes colors fade and

objects appear dimmer

Hazy-atmosphere effect is often simulated with an exponential attenuation function such as

Higher values for produce a denser atmosphere

2)()(

)(d

hazy

dhazy

edf

edf

hazehazyobjhazy IdfIdfI )](1[)(

Polygon Rendering MethodsPolygon Rendering Methods We could use an illumination model to determine the surface

intensity at every projected pixel position

Or, we could apply the illumination model to a few selected points and approximate the intensity at the other surface positions

Curved surfaces are often approximated by polygonal surfaces

So, polygonal (piecewise planar) surfaces often need to be rendered as if they are smooth

Constant-Intensity Surface RenderingConstant-Intensity Surface Rendering

Constant (flat) shading Each polygon is one face of a polyhedron and is not a

section of a curved-surface approximation mesh

Intensity-Interpolation Surface RenderingIntensity-Interpolation Surface Rendering

Gouraud shading Rendering a curved surface that is approximated

with a polygon mesh Interpolate intensities at polygon vertices

Procedure

1. Determine the average unit normal vector at each vertex

2. Apply an illumination model at each polygon vertex to obtain the light intensity at that position

3. Linearly interpolate the vertex intensities over the projected area of the polygon

Intensity-Interpolation Surface RenderingIntensity-Interpolation Surface Rendering

Normal vectors at vertices Averaging the normal vectors for each polygon

sharing that vertex

1N

2N

3N

4N

vN

4321

4321 )(

NNNN

NNNNNv

Intensity-Interpolation Surface RenderingIntensity-Interpolation Surface Rendering

Intensity interpolation along scan lines I4 and I5 are interpolated along y-axis, and then Ip is interpolated along x-axis

Incremental calculation is also possibley

x

1

2

3

4 5

p scan line

545

44

45

25

323

252

23

535

221

411

21

244

Ixx

xxI

xx

xxI

Iyy

yyI

yy

yyI

Iyy

yyI

yy

yyI

pp

Intensity-Interpolation Surface RenderingIntensity-Interpolation Surface Rendering

Gouraud Shading ProblemsGouraud Shading Problems

Lighting in the polygon interior is inaccurate

Mach band effect Optical illusion

Mach Band EffectMach Band Effect

These “Mach Bands” are not physically there. Instead, they are illusions due to excitation and inhibition in our neural processing

The bright bands at 45

degrees (and 135 degrees) are illusory.

The intensity of each square

is the same.

Mach Band artifact Mach Band artifact (Gouraud Shading)(Gouraud Shading)

Mach bands: Caused by interaction of

neighboring retinal neurons. Acts as a sort of high-pass

filter, accentuating discontinuities in first derivative.

Linear interpolation causes first deriv. Discontinuities at polygon edges.

Normal-Vector Interpolation for Surface RenderingNormal-Vector Interpolation for Surface Rendering

Phong shading Interpolate normal vectors at polygon vertices

Procedure

1. Determine the average unit normal vector at each vertex

2. Linearly interpolate the vertex normals over the projected area of the polygon

3. Apply an illumination model at positions along scan lines to calculate pixel intensities n1

n2n3

Gouraud versus Phong ShadingGouraud versus Phong Shading

Gouraud shading is faster than Phong shading OpenGL supports Gouraud shading

Phong shading is more accurate

Texture MappingTexture Mapping

Can you do this …Can you do this …

Visual RealismVisual Realism

Texture MappingTexture Mapping

Surfaces in real world are very complex

Objects have properties that vary across surface

Cannot model all the fine variations

We need to find ways to add surface detail

How?

Texture MappingTexture Mapping

Of course, one can model the exact micro-geometry + material property to control the look and feel of a surface

But, it may get extremely costly

So, graphics use a more practical approach – texture mapping

Texture MappingTexture Mapping

Texture Mapping

Want a function that assigns a color to each point The the surface is a 2D domain, so that is essentially an

image can represent using any image representation raster texture images are very popular

Photo-texturesPhoto-textures

OpenGL functions - demoOpenGL functions - demo

Usually texture is a (2D/3D) image.

During initialization read in or create the texture image and place it into the OpenGL state.

glTexImage2D (GL_TEXTURE_2D, 0, GL_RGB, imageWidth, imageHeight, 0, GL_RGB, GL_UNSIGNED_BYTE, imageData);

Before rendering your textured object, enable texture mapping and tell the system to use this particular texture.

glBindTexture (GL_TEXTURE_2D, 13);

OpenGL functionsOpenGL functions

During rendering, give the cartesian coordinates and the texture coordinates for each vertex.

glBegin (GL_QUADS);glTexCoord2f (0.0, 0.0);glVertex3f (0.0, 0.0, 0.0);glTexCoord2f (1.0, 0.0);glVertex3f (10.0, 0.0, 0.0);glTexCoord2f (1.0, 1.0);glVertex3f (10.0, 10.0, 0.0);glTexCoord2f (0.0, 1.0);glVertex3f (0.0, 10.0, 0.0);

glEnd ();

Texture and TexelTexture and Texel

Each pixel in a texture map is called a Texel

Each Texel is associated with a (u,v) 2D texture coordinate

The range of u, v is [0.0,1.0] due to normalization

(u,v) tuple(u,v) tuple

For any (u,v) in the range of (0-1, 0-1) multiplied by texture image width and height, we can find the corresponding value in the texture map

How do we get F(u,v)?How do we get F(u,v)?

We are given a discrete set of values: F[i,j] for i=0,…,N, j=0,…,M

Nearest neighbor: FF(u,v) = F[ round(N*u), round(M*v) ]

Linear Interpolation: i = floor(N*u), j = floor(M*v) interpolate from F[i,j], F[i+1,j], F[i,j+1], F[i+1,j]

Filtering in general !

InterpolationInterpolation

Nearest neighbor Linear Interpolation

Specifying texture coordinatesSpecifying texture coordinates

Texture coordinates needed at every vertex

Hard to specify by hand

Difficult to wrap a 2D texture around a 3D object

Texture FilteringTexture Filtering

Resampling using mip mapping Magnification: Interpolation Minification: Averaging

Texture Image

Texture => Image

We would like a constant cost per pixel

Mip MappingMip Mapping

MIP = Multim In Parvo = Many things in a small place

Constructs an image pyramid. Each level is a prefilteredversion of the level below resampled at half the frequency.

Whilerasterizing use the level with the sampling rate closest to the desired sampling rate.

Mip MappingMip Mapping

• Used with bilinear/trilinear interpolation

G

R

B

R

G B

Trilinear interpolation

Mip Mapping - ExampleMip Mapping - Example

Courtesy of John hart

• used to save some of the filtering work needed during texture minification

Texture Filtering MethodsTexture Filtering Methods

Nearest Neighbor interpolation

Bilinear Interpolation

Trilinear Interpolation

Anisotropic filtering Precomputed rectangular(trapezoidal) maps

<anisotropic filtering)

exampleexample

No mip mapping vs with mip mapping

exampleexample

Bilinear mip mapping vs trilinear mip mapping

Specifying texture coordinatesSpecifying texture coordinates

Texture coordinates needed at every vertex

Hard to specify by hand

Difficult to wrap a 2D texture around a 3D object

Planar mappingPlanar mapping

Compute texture coordinates at each vertex by projecting the map coordinates onto the model

Cylindrical MappingCylindrical Mapping

Spherical MappingSpherical Mapping

Cube MappingCube Mapping

Modelling Surface PropertiesModelling Surface Properties

Can use a texture to supply any parameter of the illumination model ambient, diffuse, and specularcolor Specular exponent roughness

Environment MapsEnvironment Maps

Use texture to represent reflected color

Texture indexed by reflection vector

Approximation works when objects are far away from the reflective object

Environment MapsEnvironment Maps

Using a spherical environment map

Spatially variant resolution

Environment MapsEnvironment Maps

Using a cubical environment map

Environment MappingEnvironment Mapping

Environment mapping produces reflections on shiny objects

Texture is transferred in the direction of the reflected ray from the environment map onto the object

Reflected ray: R=2(N·V)N-V

Object

ViewerReflected ray

Environment Map

Approximations MadeApproximations Made The map should contain a view of the world

with the point of interest on the object as the eye We can’t store a separate map for each point, so

one map is used with the eye at the center of the object

Introduces distortions in the reflection, but the eye doesn’t notice

Distortions are minimized for a small object in a large room

The mapping can be computed at each pixel, or only at the vertices

ExampleExample

Refraction MapsRefraction Maps

Use texture to represent refraction

Opacity MapsOpacity Maps

Use texture to represent opacity

RGB channels

alpha channels

Use the alpha channel to make portions of the texture transparent. Cheaper than explicit modelling

Illumination MapsIllumination Maps

Use texture to represent illumination footprint

Illumination MapsIllumination Maps

Quake light maps

Bump MappingBump Mapping

Use texture to perturb normals

Textures are treated as height field

creates a bump-like effect

+ =

original surface bump map modified surface

),( vuO ),( vuB ),(' vuO

Does not change silhouette edges

Bump mappingBump mapping

Normal Mapping (bump mapping)Normal Mapping (bump mapping)

Replace normals

Bump MappingBump Mapping

Many textures are the result of small perturbations in the surface geometry

Modeling these changes would result in an explosion in the number of geometric primitives.

Bump mapping attempts to alter the lighting across a polygon to provide the illusion of texture.

Displacement MappingDisplacement Mapping

Use texture to displace the surface geometry

+ =

Bump mapping only affects the normals,

Displacement mapping changes the entire surface (including the silhouette)

Displacement MappingDisplacement Mapping

3D Textures3D Textures

Use a 3D mapping

tsrzyx ooo ,,,,

Can simulate an object carved from a material

• Marble or wood•The object is “carved”out of the solid texture

Texture SynthesisTexture Synthesis

Texture Synthesis

TransparencyTransparency

Alpha Blending a: foreground object , b: background object, o: output Alpha : opacity , C : color