Computational Photography (CS 445) – Fall 2017
Instructor: Derek Hoiem (dhoiem)
TAs: Joseph DeGol
(degol2)
Aditya Deshpande (ardeshp2)
Zhizhong Li (zli115)
Office Hours:
Derek Mon
10:00 – 11:00 SC
3312
Joe
Tues
11:00 – 12:30 near
SC 3407
Zhizhong Wed 11:00
– 12:00 near
SC 3407
Aditya Fri 2:30 – 4:00 near
SC 3407
Class Time and Place:
Tues and Thurs 9:30-10:45 at DCL 1310
Syllabus
Take-home
questions
Lecture
Recordings
Homework Submission (Compass)
Piazza Discussion Board
Textbook: Computer Vision: Algorithms and
Applications by Rick Szeliski
Matlab Info: Video Tutorials; Writing Fast
Code
Projects
Class Schedule (subject to change)
|
Date |
Topic |
Link |
Reading/Notes |
|
Aug 29 (Tues) |
Introduction |
||
|
|
Basics of
Working with Images |
|
|
|
Aug 31 (Thurs) |
Pixels and image filters |
S3.2 (linear filtering) S3.3 (non-linear filtering) |
|
|
Sept 5 (Tues) |
Thinking in frequency |
S3.4 (fourier transforms) S2.3.3 (compression) |
|
|
Sept 6
(Wed) |
Matlab Tutorial, Linear Algebra Tutorial |
|
|
|
Sept 7 (Thurs) |
Templates and image pyramids |
S3.5.2 (image pyramids) S8.1.1 (pyramid alignment) Other reading: |
|
|
Sept 12 (Tues) |
Light and color |
S2.2 (light), S2.3.2 (color) or Forsyth and Ponce Ch 3 |
|
|
Sept 14 (Thurs) |
Histograms and color adjustment |
S3.1 (histograms and color adjustment) |
|
|
Sept 18
(Mon) |
Project 1
(Hybrid images) due |
|
|
|
The Digital
Canvas: Coloring, Blending, Cutting, Synthesizing, and Warping Images |
|
|
|
|
Sept 19 (Tues) |
Growing: Texture synthesis and hole filling |
Texture
Synthesis – Efros Leung (1999) Image
Quilting – Efros Freeman (2001) |
|
|
Sept 21 (Thurs) |
Cutting: Intelligent Scissors and Graph Cuts |
||
|
Sept 26 (Tues) |
Pasting: Compositing and blending |
Poisson
Image Editing – Perez et al. (2003) Burt
and Adelson, A
multiresolution spline with application to image mosaics, ACM ToG (1983) |
|
|
Sept 28 (Thurs) |
Image warping (translation, rotation, scale, etc.) |
S3.6 (warping) |
|
|
Oct 2 (Mon) |
Project 2 (Image quilting) due |
|
|
|
Oct 3 (Tues) |
Image morphing |
||
|
|
Modeling
the Physical World |
|
|
|
Oct 5 (Thurs) |
The Pinhole Camera |
S2.1.5 (3D to 2D projection) |
|
|
Oct 10 (Tues) |
Single-view Metrology |
||
|
Oct 12 (Thurs) |
Single-view 3D Reconstruction |
Tour into the picture
(Horry et al. 1997) |
|
|
Oct 16
(Mon) |
Project 3
(Gradient domain fusion) due |
|
|
|
Oct 17 (Tues) |
Image-based Lighting: ray tracing, environment maps, light
probes |
Reading (do read this): |
|
|
Oct 19 (Thurs) |
Image-based Lighting cont.: HDR light probes, relighting |
Optional
Reading: Debevec & Malik, “Recovering
High Dynamic Range Radiance Maps from Photographs”, SIGGRAPH 1997 Debevec, Rendering Synthetic Objects in
Real Scenes, 1998 |
|
|
Oct 24 (Tues) |
The image as a virtual stage |
Rendering
Synthetic Objects (Karsch et al. 2011) |
|
|
Correspondence
and Recognition |
|
|
|
|
Oct 26 (Thurs) |
Matching and alignment with interest points |
Grauman/Leibe Draft Chapter on
Local Features Optional: Lowe -
SIFT paper |
|
|
Oct 30
(Mon) |
Project 4
(Image-based lighting) due |
|
|
|
Oct 31 (Tues) |
Automatic Photo Stitching and RANSAC |
Brown
Lowe 2007 ; S9
(stitching); slides
|
|
|
Nov 2 (Thurs) |
Object recognition, retrieval, and augmented reality |
||
|
Nov 7 (Tues) |
Opportunities of scale: texture synthesis, multi-view
reconstruction, im2gps, tiny images, etc. |
Reading: Hays & Efros, Scene Completion Using Millions of Photographs |
|
|
|
More Topics
of Interest |
|
|
|
Nov 9 (Thurs) |
How the Kinect works |
||
|
Nov 13 (Mon) |
Project 5
(Video stitching) due |
|
|
|
Nov 14 (Tues) |
Detecting fakes |
||
|
Nov 16 (Thurs) |
Computational approaches to cameras |
Adelson
& Bergen, The
Plenoptic Function and the Elements of Early Vision
(1991) Ng
et al., Light
Field Photography with a Hand-held Plenoptic Camera
(2005) Levin
et al., Image
and Depth with a Coded Aperture (2007) |
|
|
Nov 21, 23 |
NO CLASS -
Thanksgiving Break! |
|
|
|
Nov 27 (Mon) |
Final
Project Proposal due |
|
|
|
Nov 28 (Tues) |
Exam Review |
||
|
Nov 30 (Thurs) |
Exam, normal class time/place |
|
|
|
Dec 5 (Tues) |
Understanding Faces |
||
|
Dec 7 (Thurs) |
Video Magnification |
|
|
|
Dec 12 (Tues) |
Last day – cutting edge and wrap up |
||
|
Dec 15
1:30-4:30pm |
Final
Poster Presentations |
|
Credits and Course Notes
I
am grateful for the many preceding efforts to design excellent courses and
course notes for this topic. I am
particularly indebted to Alyosha Efros
for borrowing much of his course and project design, to Rick Szeliski for making his book available, to James Hays for
course suggestions and materials, and to Steve Seitz, Lana Lazebnik, Silvio
Savarese, among others for their slides (as credited within). Anyone who would like to use my slides
is more than welcome; please do credit the original sources where appropriate.