3D Vision (CS 598) – Fall 2021

Class Time and Place: Tues, Thurs 11:00-12:15 at 2310 Everitt Lab

Instructor	Email	Office	Office Hours
Derek Hoiem	dhoiem	Siebel 3312	after class
Syllabus
Slack (invite link) Recordings

Assignments

Weekly Paper Review

Survey

Proposal

Report

Schedule (subject to change)

Date	Topic	Slides	Reading / Notes
Aug 24 (Tues)	Intro: Logistics and Overview, 2D-3D basics	ppt ; pdf
	Multiview Depth Estimation
Aug 26 (Thurs)	2-view geometry, stereo	ppt ; pdf	Taxonomy and Evaluation of Dense Two-Frame Stereo – Scharstein et al. 2001 Lucas-Kanade 1981 (Optional)
Aug 31 (Tues)
Sep 2 (Thurs)	Multiview Stereo (non-ML based)	ppt ; pdf	COLMAP: Schonberger et al. 2016 PMVS: Furukawa Ponce 2007 (Optional)
Sep 7 (Tues)
Sep 9 (Thurs)	Deep MVS	ppt ; pdf	MVSNet
Sep 14 (Tues)
	3D Processing: surfaces, synthesis, recognition
Sep 16 (Thurs)	Surface Modeling and Texturing	ppt ; pdf	Floating Scale Surface Reconstruction Let there be color!
Sep 21 (Tues)
Sep 23 (Thurs)	Novel View Synthesis	ppt ; pdf	NeRF Free View Synthesis
Sep 28 (Tues)
Sep 30 (Thurs)	Recognition in Point Clouds	ppt ; pdf	Topic Surveys Due PointNet Minkowski CNNs
Oct 5 (Tues)
	Localization and Registration
Oct 7 (Thurs)	Structure from Motion	ppt ; pdf	Survey Reviews Due Photo Tourism COLMAP SfM
Oct 12 (Tues)
Oct 14 (Thurs)	SLAM	ppt ; pdf	ORB-SLAM
Oct 19 (Tues)
Oct 21 (Thurs)	Deep Features, SfM, and SLAM	ppt ; pdf	SuperPoint SuperGlue
Oct 26 (Tues)
Oct 28 (Thurs)	Alignment and Shape-fitting	ppt ; pdf	Research proposals due Efficient RANSAC TEASER
Nov 2 (Tues)
	Single-view Geometry
Nov 4 (Thurs)	Single-view Depth/normal/boundary prediction	ppt ; pdf	Research proposal reviews due Eigen Fergus 2015
Nov 9 (Tues)
Nov 11 (Thurs)	Single-view 3D Scene Layout	ppt ; pdf
Nov 16 (Tues)
Nov 18 (Thurs)	Single-view 3D Object Shape	ppt ; pdf	Pixels, voxels, views
Nov 22-26	Fall Break
Nov 30 (Tues)
Dec 2 (Thurs)	Project Presentations		Project reports due Mon Dec 6
Dec 7 (Tues)	Project Presentations

Resources

Multiple View Geometry in Computer Vision by Hartley and Zisserman 2004

Computer Vision: Algorithms and Applications by Rick Szeliski 2010 (online, or can be purchased in hardcover)