Computer Vision (CS 543 / ECE 549) – Spring 2017

Class Time and Place: Tues, Thurs 11:00-12:15 at 1310 DCL The False Mirror, Magritte 1928

Instructors	Email	Office	Office Hours
Derek Hoiem	dhoiem	Siebel 3312	Monday 10-11
Tanmay Gupta (TA)	tgupta6	Siebel 0207	Thursday 5-6
Bryan Plummer (TA)	bplumme2	Siebel 0207	Monday 2-3
Chuhang Zou (TA)	czou4	Siebel 0207	Wed 5-6

Syllabus

Lecture Recordings for 2017

Lecture Recordings from 2012: first 9, remaining

Bulletin Board

https://piazza.com/class/ixtvap01jd0674

Homeworks

HW 1: due Feb 13 hw1 ; hw1.zip ; leaderboard submit / results ; solutions

HW 2: due Feb 27 hw2 ; hw2.zip ; solutions

HW 3: due Mar 20 hw3 ; hw3.zip ; hw3_vp.zip ; solutions

HW 4: due Apr 10 hw4 ; hw4.zip ; leaderboard submit / results ; solutions

HW 5: due Apr 24 hw5 ; hw5.zip

Final Project Proposal: due Mar 31

Homework submission on Compass

Resources

Recommended Textbook:

Computer Vision: A Modern Approach (2^nd edition), Forsyth and Ponce 2011

Other Useful Books:

Multiple View Geometry in Computer Vision by Hartley and Zisserman 2004

Computer Vision: Algorithms and Applications by Rick Szeliski 2010 (online, or can be purchased in hardcover)

Computer Vision by Linda Shapiro and George Stockman 2001

Matlab: Useful Functions List; Reference Guide; Writing Fast Code

Computer vision resource page

Schedule (subject to change)

Note: FP 5 is short for Forsyth and Ponce chapter 5; HZ 6 for Hartley and Zisserman chapter 6.

Date	Topic	Slides	Reading / Notes
Jan 17 (Tues)	Intro: Logistics and Overview	ppt ; pdf
	Interpreting Intensity
Jan 19 (Thurs)	Light, Shading, and Color	ppt ; pdf	FP 2 (light and shading) FP 3 (color)
Jan 24 (Tues)	Linear Filters, Spatial Domain	ppt ; pdf	FP 4.1-4.2 (linear filters)
Jan 26 (Thurs)	Linear Filters, Frequency Domain	ppt ; pdf	FP 4.3-4.4 (spatial frequency, fft, sampling) FFT demo
Jan 31 (Tues)	Templates and Image Pyramids	ppt ; pdf	FP 4.5-4.7 (template matching, pyramids) Burt Adelson 1983 – The Laplacian Pyramid
Feb 2 (Thurs)	Edge Detection	ppt ; pdf	FP 5.1-5.2 (edge detection) Berkeley Pb Detector Detection with Mutual Information
	Correspondence and Alignment
Feb 7 (Tues)	Interest points	ppt ; pdf	FP 5.3-5.5 (interest points) Grauman/Leibe Draft Chapter on Local Features Important paper: Lowe - SIFT paper
Feb 9 (Thurs)	Feature tracking, optical flow	ppt ; pdf	FP 11.1 (feature tracking) Seminal paper: Lucas Kanade 1981 KLT Tracker
Feb 14 (Tues)	Fitting and alignment	ppt ; pdf	HW 1 due Mon FP 10.1-10.4 (robust fitting) Line fitting demo
Feb 16 (Thurs)	Alignment and object instance recognition	ppt ; pdf	FP 12.1-12.2 (object alignment) Seminal Paper: Lowe-Object Recognition
	Perspective and 3D Geometry
Feb 21 (Tues)	Camera models	ppt ; pdf	FP 1 (image formation) HZ6-7 (camera models, calibration)
Feb 23 (Thurs)	Single-view geometry and calibration	ppt ; pdf	Perspective Ch Draft - Hoiem, Savarese http://ksimek.github.io/2012/08/14/decompose/
Feb 28 (Tues)	Image stitching	ppt ; pdf	HW 2 due Mon Brown Lowe 2007 ; (panoramic stitching) HZ4.1, HZ4.7 (direct linear transform, RANSAC)
Mar 2 (Thurs)	Epipolar geometry, stereo	ppt ; pdf	HZ9: Epipolar Geometry
Mar 7 (Tues)	Structure from motion	ppt ; pdf	Snaveley Thesis (Chpt 3) Visual SfM (Wu 2013) Seminal paper: Tomasi Kanade 1992
	Grouping and Segmentation
Mar 9 (Thurs)	Clustering, K-means	ppt ; pdf	http://en.wikipedia.org/wiki/Cluster_analysis
Mar 14 (Tues)	Gestalt Cues and Image Segmentation	ppt ; pdf	FP 9.3-9.5 (segmentation) Intro to Mean-Shift -- Thirumuruganathan Boundaries and Watershed – Arbelaez et al. 2009
Mar 16 (Thurs)	EM Algorithm, Mixture of Gaussians	ppt ; pdf	EM Tutorial by Bilmes EM Demos
Mar 21, 23	No Class -- Spring Break!		HW 3 due Mon
Mar 28 (Tues)	MRFs and Graph Cut Segmentation	ppt ; pdf	What Energy Functions can be Minimized via Graph Cuts? - Kolmogorov and Zabih Grabcut – Rother et al. 2004
	Categorization and Object Recognition
Mar 30 (Thurs)	Face recognition	ppt ; pdf	Project Proposals due Mar 31 Eigenfaces Fisherfaces Optional: Face recognition: A Literature Survey (pp 1-26)
Apr 4 (Tues)	Categorization and Classifiers	ppt ; pdf	Hoiem/Savarese draft categorization Grauman/Leibe Draft Visual Vocabularies Beyond Bags of Features – Lazebnik et al. 2006
Apr 6 (Thurs)	Deep Convolutional Neural Nets	ppt ; pdf	Culurciello’s blog Karpathy’s ImageNet blog Tanmay’s deep net blog
Apr 11 (Tues)	Object Detection	ppt ; pdf	HW 4 due Mon Viola-Jones 2001 R-CNN
Apr 13 (Thurs)	Part and Pixel Labeling	ppt ; pdf
Apr 18 (Tues)	Object tracking	ppt ; pdf	FP 11 (tracking)
	Advanced Topics
Apr 20 (Thurs)	Action Recognition	ppt ; pdf
Apr 25 (Tues)	3D Scenes and Context	ppt ; pdf	HW 5 due Mon Hoiem and Savarese: Chapters 1, 4, 6 Hoiem et al. IJCV 2007 Hedau et al. ICCV 2009
Apr 27 (Thurs)	Vision and Language	ppt ; pdf
May 2 (Tues)	Class Summary, Important Open Problems, and Feedback	ppt ; pdf
May 11, 7-10pm	Final Project Poster Session
May 12	Final Project Paper is due