Computational Photography (CS 498) – Fall 2011
Instructor: Derek Hoiem (dhoiem
at uiuc ;
Siebel Center 3312)
Office Hours:
Mondays 10-11am, 3-4pm + drop-ins
Class Time and Place:
Tues and Thurs 11-12:15pm at Siebel Center 1214
Syllabus
Take-home
problems
Online Resources
Online
Discussion: http://groups.google.com/group/cs498-cp-uiuc
Textbook: Computer Vision: Algorithms and
Applications by Rick Szeliski
Matlab: Helpful Tutorials and References ; Writing Fast
Code
Projects
Project 1:
Hybrid Images
|
Project
2: Image Alignment
|
Project
3: Gradient Domain Fusion
|
Project
4: Face Morphing
|
Project
5: Automatic Photo Stitching
|
Final
Project
|
Class Schedule (subject to change)
|
Date |
Topic
|
Link |
Reading/Notes |
|
Aug
23 (Tues) |
NO
CLASS |
S=Szeliski
book |
|
|
Aug 25 (Thurs) |
Introduction |
|
|
|
|
Basics of
Working with Images |
|
|
|
Aug 30 (Tues) |
Pixels and image filters |
S3.2 (linear filtering) S3.3 (non-linear filtering) |
|
|
Sept 1 (Thurs) |
Thinking in frequency |
S3.4 (fourier transforms) S2.3.3 (compression) |
|
|
Sept
1 (Thurs) |
Matlab
/ Linear Algebra Tutorial |
|
SC3403,
5-6:30pm |
|
Sept 6 (Tues) |
Templates and image pyramids |
S3.5.2 (image pyramids) S8.1.1 (pyramid alignment) Other reading: |
|
|
Sept 8 (Thurs) |
Light and color |
S2.2 (light), S2.3.2 (color) or Forsyth and Ponce Ch 6 |
|
|
Sept
12 (Mon) |
Project
1 (Hybrid images) due |
|
|
|
Sept 13 (Tues) |
Histograms and color adjustment |
S3.1 (histograms and color adjustment) |
|
|
The
Digital Canvas: Coloring, Blending, Cutting, Synthesizing, and Warping Images |
|
|
|
|
Sept 15 (Thurs) |
Cutting: Intelligent Scissors and Graph Cuts |
||
|
Sept 20 (Tues) |
Growing: Texture synthesis and hole filling |
Texture
Synthesis – Efros Leung (1999) |
|
|
Sept 22 (Thurs) |
Pasting: Compositing and blending |
Project
3 released Poisson
Image Editing – Perez et al. (2003) Burt and Adelson, A
multiresolution spline with application to image
mosaics, ACM ToG (1983) |
|
|
Sept
26 (Mon) |
Project
2 (Image alignment) due |
|
|
|
Sept 27 (Tues) |
Image warping (translation, rotation, scale, etc.) |
S3.6 (warping) |
|
|
Sept 29 (Thurs) |
Image morphing |
|
|
|
Oct 4 (Tues) |
The Pinhole Camera |
S2.1.5 (3D to 2D projection) |
|
|
Oct 6 (Thurs) |
Guest Lecture: Amin Sadeghi Topic: PCA and Fun with Faces |
Project
4 released Derek
out of town Wed-Fri |
|
|
Oct
10 (Mon) |
Project
3 (Gradient domain fusion) due |
|
|
|
Oct 11 (Tues) |
Single-view Metrology |
||
|
Oct 13 (Thurs) |
Single-view 3D Reconstruction |
Project
4 Face Labels Due Tour into the picture
(Horry et al. 1997) |
|
|
Oct 18 (Tues) |
Guest Lecture: Kevin Karsch Topic: The image as a virtual stage |
Derek out of town |
|
|
Working
with Photo Collections |
|
|
|
|
Oct 20 (Thurs) |
Matching and alignment with interest points |
Grauman/Leibe Draft Chapter on
Local Features Optional: Lowe - SIFT paper |
|
|
Oct
24 (Mon) |
Project
4 (Face morphing) due |
|
|
|
Oct 25 (Tues) |
Automatic Photo Stitching and RANSAC |
Brown Lowe 2007 ; S9
(stitching); slides
; |
|
|
Oct 27 (Thurs) |
Object recognition, retrieval, and augmented reality |
Project
5 released |
|
|
Nov 1 (Tues) |
Opportunities of scale: texture synthesis, multi-view
reconstruction, im2gps, tiny images, etc. |
Reading: Hays &
Efros, Scene Completion Using Millions of Photographs |
|
|
Nov 3 (Thurs) |
Midterm Review |
||
|
Nov 8 (Tues) |
Midterm Exam, normal time/place |
|
Derek
in Barcelona, Kevin Karsch will proctor |
|
|
More
Topics of Interest |
|
|
|
Nov 10 (Thurs) |
Detecting fakes |
||
|
Nov
14 (Mon) |
Project
5 (Image stitching) due |
|
|
|
Nov 15 (Tues) |
Image-based Lighting: ray tracing, environment maps, light
probes |
Reading (do read this): |
|
|
Nov 17 (Thurs) |
Image-based Lighting cont.: HDR light probes, relighting |
Optional
Reading: Debevec
& Malik, “Recovering
High Dynamic Range Radiance Maps from Photographs”, SIGGRAPH 1997 Debevec, Rendering Synthetic Objects in
Real Scenes, 1998 |
|
|
Nov
22, 24 |
NO
CLASS - Thanksgiving Break! |
|
|
|
Nov 29 (Tues) |
Computational approaches to cameras |
|
|
|
Dec 1 (Thurs) |
How the Kinect works |
|
|
|
Dec 6 (Tues) |
Last day – wrap up |
|
|
|
Dec
9 (Fri) |
Final
Project Presentations (1:30 – 4:30pm, SC1214) |
|
Some other ideas for special topics:
Students, let me know if there’s something you’d
especially like to cover.
Some ideas: 1) Background subtraction and alpha matting; 2)
Special or Programmable cameras; 3) Environment maps and image-based lighting;
4) What makes a good (or real) photo?; 5) Video textures; 6) Recoloring; 7)
Tricks with focus or aperture (e.g. creating HDR images from multiple
exposures); 8) Physics-based models (modeling fog, water, etc.); 9)
Deconvolution and deblurring; 10) superresolution; 11) Non-photo realistic
rendering; 12) Kinect sensor and applications
Similar Courses in Other Universities
Computational
Photography (Efros,
CMU)
Computational
Photography (Hays,
Brown)
Computational
Photography SIGGRAPH Course (Raskar
& Tumblin)
Computational
Camera and Photography (Raskar,
MIT Media Lab)
Digital and
Computational Photography (Durand
& Freeman, MIT)
Computational
Photography (Essa, Georgia Tech)
Computational
Photography (Levoy, Adams, Pulli, Stanford)
Computational
Photography (Lazebnik, UNC)
Computational
Photography (Fergus, NYU)
Internet Vision (T.Berg,
SUNY)
Computer Vision (Seitz & Szeliski, UWashington)
Introduction to Visual
Computing and Visual Modeling (Kutulakos, UToronto)
Symposium on Computational Photography and Video (May
2005, MIT)
Credits and Course Notes
I
am grateful for the many preceding efforts to design excellent courses and
course notes for this topic. I am
particularly indebted to Alyosha Efros for borrowing much of his course and
project design, to Rick Szeliski for making his book available, to James Hays
for course suggestions and materials, and to Steve Seitz, Lana Lazebnik, Silvio
Savarese, among others for their slides (as credited within). Anyone who would like to use my slides
is more than welcome; please do credit the original sources where appropriate.