Introduction to Computer Graphics
GAMES101, Lingqi Yan, UC Santa Barbara
Lecture 8:
Shading 2
(Shading, Pipeline and Texture Mapping)
http://www.cs.ucsb.edu/~lingqi/teaching/games101.html
Announcements
• Homework 2
- 45 submissions so far
- Upside down? No problem
- Active discussions in the BBS, pretty good
• Next homework is for shading
• Today’s topics
- Easy, but a lot
GAMES101 2 Lingqi Yan, UC Santa Barbara
Last Lecture
• Shading 1
- Blinn-Phong reflectance model
^ ^
- Diffuse l n
v^
- Specular
- Ambient
- At a specific shading point
GAMES101 3 Lingqi Yan, UC Santa Barbara
Today
• Shading 2
- Blinn-Phong reflectance model
- Specular and ambient terms
- Shading frequencies
- Graphics pipeline
- Texture mapping
- Barycentric coordinates
GAMES101 4 Lingqi Yan, UC Santa Barbara
Recap: Lambertian (Diffuse) Term
Shading independent of view direction
energy arrived
at the shading point
l n 2
Ld = kd (I/r ) max(0, n · l)
v
diffuse energy received
coefficient by the shading point
(color)
diffusely
reflected light
GAMES101 5 Lingqi Yan, UC Santa Barbara
Recap: Lambertian (Diffuse) Term
Produces diffuse appearance
[Foley et al.]
kd
GAMES101 6 Lingqi Yan, UC Santa Barbara
Specular Term (Blinn-Phong)
Intensity depends on view direction
• Bright near mirror reflection direction
R
l n
v
GAMES101 7 Lingqi Yan, UC Santa Barbara
Specular Term (Blinn-Phong)
V close to mirror direction half vector near normal
• Measure “near” by dot product of unit vectors
h = bisector(v, l)
(半程向量)
v+l
h =
l n v+l
v
Ls = ks (I/r2 ) max(0, cos ↵)p
= ks (I/r2 ) max(0, n · h)p
specularly
reflected
light specular
coefficient
GAMES101 8 Lingqi Yan, UC Santa Barbara
Cosine Power Plots
Increasing p narrows the reflection lobe
[Foley et al.]
GAMES101 9 Lingqi Yan, UC Santa Barbara
Specular Term (Blinn-Phong)
2 p
Ls = ks (I/r ) max(0, cos ↵)
Blinn-Phong 2 pp
n · h)
Ls = ks (I/r ) max(0, cos ↵)
2 p
= ks (I/r ) max(0, n · h)
[Foley et al.]
ks
Note: showing
Ld + Ls together
p
GAMES101 10 Lingqi Yan, UC Santa Barbara
Ambient Term
Shading that does not depend on anything
• Add constant color to account for disregarded
illumination and fill in black shadows
• This is approximate / fake!
La = ka Ia
ambient
coefficient
reflected
ambient light
GAMES101 11 Lingqi Yan, UC Santa Barbara
Blinn-Phong Reflection Model
Blinn-Phong
Ambient + Diffuse + Specular =
Reflection
L = La + Ld + Ls
2 2 p
= ka Ia + kd (I/r ) max(0, n · l) + ks (I/r ) max(0, n · h)
GAMES101 12 Lingqi Yan, UC Santa Barbara
Questions?
Shading Frequencies
Shading Frequencies
What caused the shading difference?
GAMES101 15 Lingqi Yan, UC Santa Barbara
Shade each triangle (flat shading)
Flat shading
• Triangle face is
flat — one normal
vector
• Not good for
smooth surfaces
GAMES101 16 Lingqi Yan, UC Santa Barbara
Shade each vertex (Gouraud shading)
Gouraud shading
• Interpolate colors
from vertices across
triangle
• Each vertex has a
normal vector (how?)
GAMES101 17 Lingqi Yan, UC Santa Barbara
Shade each pixel (Phong shading)
Phong shading
• Interpolate normal
vectors across each
triangle
• Compute full shading
model at each pixel
• Not the Blinn-Phong
Reflectance Model
GAMES101 18 Lingqi Yan, UC Santa Barbara
Shading Frequency: Face, Vertex or Pixel
Num
Vertices
Shading freq. : Face Vertex Pixel
Shading type : Flat Gouraud Phong
Image credit: Happyman, http://cg2010studio.com/
Defining Per-Vertex Normal Vectors
Best to get vertex normals from
the underlying geometry
• e.g. consider a sphere
Otherwise have to infer vertex
normals from triangle faces
• Simple scheme: average
surrounding face normals
GAMES101 20 Lingqi Yan, UC Santa Barbara
Defining Per-Pixel Normal Vectors
Barycentric interpolation (introducing soon)
of vertex normals
Don’t forget to normalize the interpolated directions
GAMES101 21 Lingqi Yan, UC Santa Barbara
Graphics (Real-time Rendering)
Pipeline
Graphics Pipeline
3
1
Application 4 Input: vertices in 3D space
2
Vertex Processing
Vertex Stream Vertices positioned in screen space
Triangle Processing
Triangle Stream Triangles positioned in screen space
Rasterization
Fragment Stream Fragments (one per covered sample)
Fragment Processing
Shaded Fragments Shaded fragments
Framebuffer Operations
Display Output: image (pixels)
GAMES101 23 Lingqi Yan, UC Santa Barbara
Graphics Pipeline
Application
Vertex Processing Model, View, Projection transforms
Vertex Stream
Triangle Processing y
Triangle Stream
Rasterization z
Fragment Stream x
Fragment Processing
Shaded Fragments
Framebuffer Operations
Display
GAMES101 24 Lingqi Yan, UC Santa Barbara
Graphics Pipeline
Application
Vertex Processing Sampling triangle coverage
Vertex Stream
Triangle Processing
Triangle Stream
Rasterization
Fragment Stream
Fragment Processing
Shaded Fragments
Framebuffer Operations
Display
GAMES101 25 Lingqi Yan, UC Santa Barbara
Rasterization Pipeline
Application
Vertex Processing Z-Buffer Visibility Tests
Vertex Stream
Triangle Processing
Triangle Stream
Rasterization
Fragment Stream
Fragment Processing
Shaded Fragments
Framebuffer Operations
Display
GAMES101 26 Lingqi Yan, UC Santa Barbara
Graphics Pipeline
Application
Vertex Processing Shading
Vertex Stream
Triangle Processing
Triangle Stream
Rasterization
Ambient + Diffuse
Fragment Stream
Fragment Processing
Shaded Fragments
Framebuffer Operations
+ Specular = Blinn-Phong
Display
Reflectance Model
GAMES101 27 Lingqi Yan, UC Santa Barbara
Graphics Pipeline
Application Texture mapping
Vertex Processing (introducing soon)
Vertex Stream
Triangle Processing
Triangle Stream
Rasterization
Fragment Stream
Fragment Processing
Shaded Fragments
Framebuffer Operations
Display
GAMES101 28 Lingqi Yan, UC Santa Barbara
Shader Programs
• Program vertex and fragment processing stages
• Describe operation on a single vertex (or fragment)
Example GLSL fragment shader program
uniform sampler2D myTexture; • Shader function executes
uniform vec3 lightDir; once per fragment.
varying vec2 uv;
• Outputs color of surface
varying vec3 norm;
at the current fragment’s
screen sample position.
void diffuseShader()
{ • This shader performs a
vec3 kd; texture lookup to obtain
kd = texture2d(myTexture, uv); the surface’s material
kd *= clamp(dot(–lightDir, norm), 0.0, 1.0); color at this point, then
gl_FragColor = vec4(kd, 1.0);
performs a diffuse
lighting calculation.
}
Shader Programs
• Program vertex and fragment processing stages
• Describe operation on a single vertex (or fragment)
Example GLSL fragment shader program
uniform sampler2D myTexture; // program parameter
uniform vec3 lightDir; // program parameter
varying vec2 uv; // per fragment value (interp. by rasterizer)
varying vec3 norm; // per fragment value (interp. by rasterizer)
void diffuseShader()
{
vec3 kd;
kd = texture2d(myTexture, uv); // material color from texture
kd *= clamp(dot(–lightDir, norm), 0.0, 1.0); // Lambertian shading model
gl_FragColor = vec4(kd, 1.0); // output fragment color
}
Snail Shader Program
Inigo Quilez
Procedurally modeled, 800 line shader.
http://shadertoy.com/view/ld3Gz2
GAMES101 31 Lingqi Yan, UC Santa Barbara
Snail Shader Program
Inigo Quilez, https://youtu.be/XuSnLbB1j6E
Goal: Highly Complex 3D Scenes in Realtime
• 100’s of thousands to millions of triangles in a scene
• Complex vertex and fragment shader computations
• High resolution (2-4 megapixel + supersampling)
• 30-60 frames per second (even higher for VR)
Unreal Engine Kite Demo (Epic Games 2015)
Graphics Pipeline Implementation: GPUs
Specialized processors for executing graphics pipeline
computations
Discrete GPU Card Integrated GPU:
(NVIDIA GeForce Titan X) (Part of Intel CPU die)
GAMES101 34 Lingqi Yan, UC Santa Barbara
GPU: Heterogeneous, Multi-Core Procesor
Modern GPUs offer ~2-4 Tera-FLOPs of performance for
executing vertex and fragment shader programs
Tera-Op’s of fixed-function
compute capability over here
Texture Mapping
Different Colors at Different Places?
L_d = k_d * (I / r^2) * (n dot l)
Pattern on ball Wood grain on floor
GAMES101 37 Lingqi Yan, UC Santa Barbara
Surfaces are 2D
Surface lives in 3D world space
Every 3D surface point also has a place
where it goes in the 2D image (texture).
y
x
ys v
xs z u
image space world space texture space
Screen space World space Texture space
GAMES101 38 Lingqi Yan, UC Santa Barbara
Texture Applied to Surface
Rendering without texture Rendering with texture Texture
Zoom
Each triangle “copies” a piece of
the texture image to the surface.
GAMES101 39 Lingqi Yan, UC Santa Barbara
Visualization of Texture Coordinates
Each triangle vertex is assigned a texture coordinate (u,v)
Triangle vertices in texture space
Visualization of texture coordinates v
u
GAMES101 40 Lingqi Yan, UC Santa Barbara
Texture Applied to Surface
Rendered result Triangle vertices in texture space
v
u
GAMES101 41 Lingqi Yan, UC Santa Barbara
Textures applied to surfaces
GAMES101 42 Lingqi Yan, UC Santa Barbara
Visualization of texture coordinates
GAMES101 43 Lingqi Yan, UC Santa Barbara
Textures can be used multiple times!
example textures
used / tiled
GAMES101 44 Lingqi Yan, UC Santa Barbara
Thank you!
(And thank Prof. Ravi Ramamoorthi and Prof. Ren Ng for many of the slides!)
