Project 1:
Hybrid Images
|
Project
2: Image Quilting
|
Project
3: Gradient Domain Fusion
|
Project 4:
Image-based Lighting
|
Project 5:
Video Stitching
|
Final Project
|
Class Schedule
Week |
Date |
Topic |
Link |
Reading/Notes |
1 |
Jan 21 - 26 |
Introduction |
||
|
|
Basics of Working with Images |
|
|
1 |
Pixels and image filters |
S3.2 (linear filtering) S3.3 (non-linear filtering) |
||
2 |
Jan 27 – Feb 2 |
Thinking in frequency |
S3.4 (fourier transforms) S2.3.3 (compression) |
|
2 |
Templates and image
pyramids |
S3.5.2 (image pyramids) S8.1.1 (pyramid alignment) Other reading: |
||
3 |
Feb 3 – Feb 9 |
Light and color |
S2.2 (light), S2.3.2
(color) or Forsyth and Ponce Ch 3 |
|
3 |
Histograms and color
adjustment |
S3.1 (histograms and color
adjustment) |
||
|
Feb 12 (Wed) |
Project 1 (Hybrid images) due |
|
|
|
The Digital Canvas: Coloring, Blending, Cutting,
Synthesizing, and Warping Images |
|
|
|
4 |
Feb 10 – Feb 16 |
Growing: Texture synthesis
and hole filling |
Texture
Synthesis – Efros Leung (1999) Image
Quilting – Efros Freeman (2001) |
|
4 |
Cutting: Intelligent
Scissors and Graph Cuts |
|||
5 |
Feb 17 – Feb 23 |
Pasting: Compositing and
blending |
Poisson
Image Editing – Perez et al. (2003) Burt
and Adelson, A multiresolution spline with
application to image mosaics, ACM ToG (1983) |
|
5 |
Image warping (translation,
rotation, scale, etc.) |
S3.6
(warping) |
||
|
Feb 26 (Wed) |
Project 2 (Image quilting) due |
|
|
6 |
Feb 24 – Mar 2 |
Image morphing |
||
|
|
Modeling the Physical World |
|
|
6 |
The Pinhole Camera |
S2.1.5
(3D to 2D projection) |
||
7 |
Mar 3 – Mar 9 |
Single-view Metrology +
Camera Model continued |
||
7 |
Single-view 3D
Reconstruction |
Tour into the
picture (Horry et al. 1997) |
||
8 |
Mar 8 – Mar 14 |
Midterm Exam (on PrairieLearn) |
|
|
9 |
Mar 15 – Mar 23 |
Spring Break |
|
|
10 |
Mar 24 – Mar 30 |
Image-based Lighting: ray
tracing, environment maps, light probes |
Reading (do read this): |
|
10 |
Image-based Lighting cont.:
HDR light probes, relighting |
Optional
Reading: Debevec
& Malik, “Recovering High Dynamic Range
Radiance Maps from Photographs”, SIGGRAPH 1997 Debevec,
Rendering Synthetic Objects in Real Scenes, 1998 |
||
|
Apr 2 (Wed) |
Project 3 (Gradient domain fusion) due |
|
|
11 |
Mar 31 – Apr 6 |
The image as a virtual
stage |
Rendering
Synthetic Objects (Karsch et al. 2011) |
|
|
Correspondence and Recognition |
|
|
|
11 |
Matching and alignment with
interest points |
Grauman/Leibe
Draft Chapter on Local Features Optional: Lowe - SIFT paper |
||
|
Apr 9 (Wed) |
Final Project Proposal due |
|
|
12 |
Apr 7 – Apr 13 |
Automatic Photo Stitching
and RANSAC |
Brown
Lowe 2007 ; S9 (stitching); slides |
|
12 |
Object recognition,
retrieval, and augmented reality |
|||
|
Apr 16 (Wed) |
Project 4 (Image-based lighting) due |
|
|
13 |
Apr 14 – Apr 20 |
Opportunities of scale:
texture synthesis, multi-view reconstruction, im2gps, tiny images, etc. |
Reading: Hays & Efros, Scene Completion
Using Millions of Photographs |
|
|
|
More Topics of Interest |
|
|
13 |
Generating and detecting
fakes |
|||
14 |
Apr 21 – Apr 27 |
How the Kinect works |
||
14 |
Computational approaches to
cameras |
Adelson
& Bergen, The Plenoptic Function and the Elements of Early Vision (1991) Ng
et al., Light Field Photography with a
Hand-held Plenoptic Camera (2005) Levin
et al., Image and Depth with a Coded Aperture (2007) |
||
|
Apr 30 (Wed) |
Project 5 (Video stitching) due |
|
|
15 |
Apr 28 – May 4 |
Understanding Faces |
|
|
15 |
Video
Magnification |
|
||
16 |
May 5 – May 7 |
Last day – cutting
edge and wrap up |
|
|
May 11 (Sun) |
Final Project due (cannot be late) |
|
|
|
17 |
May
9 – May 15 |
Final Exam (on PrairieLearn) |
|