Following is the schedule and all other information for the Spring 2011 offering of this class.
Information
CS 4475 HP (and CS 8803 PHO) (3-0-3): Computational Photography – (Instructor: Irfan Essa) – This class explores perceptual and technical aspects of pictures, and more precisely the capture and depiction of reality on a 2D medium. The scientific, perceptual, and artistic principles behind image-making will be emphasized. Topics include the relationship between pictorial techniques and the human visual system; intrinsic limitations of 2D representations and their possible compensations; and technical issues involving depiction. Technical aspects of image capture and rendering, and exploration of how such a medium can be used to its maximum potential, will be examined. Students are strongly encouraged (not required) to bring their digital cameras and a laptop to facilitate experiments.
For more information, see the slides (link).
Instructor
- Professor Irfan Essa (Email is the BEST (and ONLY) option: irfan at cc dot gatech dot edu, please use CS4475: as the first words in the subject line)
- Office Hours: After class OR schedule via email appointment
Teaching Assistant
- TBD
Class Time/Location:
- Location: CoCB 102
- Tuesday – Thursday 1:35p – 2:55p.
Learning Objectives
In this class. you will learn about:
- The Medium of Photography (History to Modern Technologies)
- Digital Imaging (Sensors to Software)
- Computational Processes associated with Imaging and Photography
- Computation as applied to Digital Media.
- Image Analysis and Synthesis
- Images and Photography on the Web/Internet
- Storytelling with images (and computation).
Text & Reading Material.
- [RS] Computer Vision: Algorithms and Applications; by Richard Szeliski (see link for a draft of this book available online)
-
Other material available online or on T-square (See Resources/Readings/ on T-Square site for this class).
-
OPTIONAL: [BP] Understanding Exposure: How to Shoot Great Photographs with a Film or Digital Camera; by Brian Peterson; 2004; Amphoto Books (ISBN: 0817463003)
Assignments and Grading
- Class Attendance & Participation (20 %)
- Assignments / Homeworks (50%) [There will be 5 Assignments]
- Critique (10%)
- Final Project (20%)
- Includes: Proposal/Teaming(2%), Updates (5%), In class presentation and demo (8%), Final Report and Self Evaluation (5%).
- All of the above subject to slight modifications as needed, which will be announced in class.
Policies
- Class attendance is required. Late by 15 minutes, counts as an absence. Legitimate reasons for being excused from class include, personal issues, health (keep those germs away from class), interview, conference travel, etc. Travelling and exploring, assignments due in other classes, out to pick up friends, and other such excuses not accepted. Please inform Instructor of a planned absence via email before class.
- Grading. Usually a score of 90 is considered an “A” and 100 an “A+” (but a 100 is given to only artifacts that are exceptional and beyond what was expected!). 80, 70 are “B” and “C” respectively.
- Homeworks Assignments will be graded on a list of criteria (specified on the assignment) such as quality of work, completeness, insight into technical issues, insight into other relevant issues, etc. Assignments are due at the start of class on the day they are due.
- Late Assignments: Everything is DUE before the class session. NO extensions. In most circumstance, students will be asked to discuss their assignment in class.
- Laptops use in class: Use of laptops in class room for purposes of note-taking and work related to the class is allowed, but ONLY and ONLY for that purpose. If a student is seen surfing the web during class, or chatting with someone, or emailing, then points will be deducted from the class attendance and participation portions of the grade (3% for each infraction, with a total of 3 max, after that the student looses the whole class participation score).
- Cellphones in class: Please turn your cellphone and other mobile devices to “silent” mode during class. Thanks.
- This class abides by the Georgia Tech Honor Code. All assigned work is expected to be individual, except where explicitly written otherwise. You are encouraged to discuss the assignments with your classmates; however, what you hand in should be your own work. If any work product was produced based on discussions with someone else (in the class OR outside), please specify clearly in the final turn-in.
Acknowledgments
Assignments and ideas on this syllabus build on those from everyone who has taught this material before.
Schedule
Here is a weekly and day by day schedule of the class. See T-Square @ GATech site for this class for details on readings and assignments. Some topics and readings are subject to change, so please make sure to check this site on weekly basis (at-least).
Week : #1, #2, #3, #4, #5, #6, #7, #8, #9, #10, #11, #12, #13, #14, #15, #16
Week 1 (1/10/11)
- Tuesday
- Thursday
- Introduction and Overview
Week 2 (1/17/11)
- Tuesday
- Basics of Photography
- Thursday
- Digital Image Representations I
- READINGS: Szeliski Book Chapter 1 (skim), Chapter 2 (Section 2.2 and 2.3)
Week 3 (1/24/11)
- Tuesday
- Assignment #0 DUE (Presentations and Critique in class)
- Thursday
- Digital Image Representations II
- READINGS: Szeliski Book Chapter 3 (Sections 3.1 – 3.6)
- Matlab, FFT for images
Week 4 (1/31/11)
- Tuesday
- GUEST SPEAKERS: Ara Nefian (NASA Ames)
- Thursday
- Presentations and Critiques of Assignment #1 in class.
Week 5 (2/7/11)
- Tuesday
- Presentations and Critiques of Assignment #1 in class (Cont.)
- Thursday
Week 6 (2/14/11)
- Tuesday
- Cameras
- READINGS:
- Szeliski 7.1 and 7.2
- Zhang. A flexible new technique for Camera Calibration (Paper in PDF, a copy available from T-square/resources/readings))
- READINGS:
- Cameras
- Thursday
- Cameras CONTINUED
Week 7 (2/21/11)
- Tuesday
- Mutli-view Imaging
- READINGS (available from T-square/resources/readings):
- Beier & Neely (1992); Feature-based image metamorphosis SIGGRAPH 1992. [pdf]
- Chen and Williams (1993); View interpolation for image synthesis; SIGGRAPH 1993. [pdf]
- Seitz and Dyer (1996); View morphing, SIGGRAPH 1996 [pdf] [site]
- Levoy & Hanrahan (1996); Light Field Rendering, SIGGRAPH 1996.[pdf] [site]
- Horry, Anjyo, & Arai (1997); Tour into the picture: Using a spidery mesh interface to make animation from a single image. SIGGRAPH 1997 [pdf] [movie] [Course Notes from SIGGRPAH 1998]
- READINGS (available from T-square/resources/readings):
- Mutli-view Imaging
- Thursday
- Image Synthesis, Image Completion (some readings available from web, other from T-square/resources/readings)
- READINGS
- Burt, Adelson (1983); “A multiresolution spline with application to image mosaics”, TOG 1983 [pdf] [doi]
- Efros, Freeman (2001); “Image Quilting”, SIGGRAPH 2001. [pdf] [code]
- Hertzmann, Jacobs, Oliver, Curless, Salesin (2001); “Image Analogies”, SIGGRAPH 2001. [pdf] [site] [code] [gimp]
- Pérez, Gangnet, Blake (2003), “Poisson image editing”, SIGGRAPH 2003 [pdf][doi][ppt]
- Kwatra, Schodl, Essa, Turk, Bobick (2003); “Graphcut Textures: Image and Video Synthesis Using Graph Cuts”, SIGGRAPH 2003, [pdf] [site] [videos]
- Agarwala, Dontcheva, Agrawala, Drucker, Colburn, Curless, Salesin, Cohen (2004); “Interactive Digital Photomontage”, SIGGRAPH 2004, [pdf] [site] [video][code]
- Jia, Sun, Tang, Shum (2006); “Drag-and-Drop Pasting.” SIGGRAPH 2006.[pdf] [site] [Talk slides], [Video (wmv)]
- Barnes, Shechtman, Finkelstein, Goldman (2009) “PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing” SIGGRAPH) 2009 [pdf][video] [site]
- Some videos about Photoshop CS5 [http://www.youtube.com/watch?v=NH0aEp1oDOI][http://www.youtube.com/watch?v=dgKjs8ZjQNg]
- READINGS
- Assignment #2 DUE.
- Image Synthesis, Image Completion (some readings available from web, other from T-square/resources/readings)
Week 8 (2/28/11)
- Tuesday
- From Panoramas to Phototourism to Photosynth
- READINGS
- Szeliski (1996); “Video mosaics for virtual environments” IEEE CGA (PDF)
- Peleg and Herman (1997); Panoramic mosaics by manifold projection. CVPR 1997 [PDF][DOI]
- Lowe (2004); “Distinctive image features from scale-invariant keypoints,”IJCV [PDF][Demo software]
- Brown and Lowe (2007); “Automatic Panoramic Image Stitching using Invariant Features.” IJCV [pdf 3.5Mb] [site]
- Brown and Lowe (2003); “Recognising Panoramas” ICCV 2003, (pdf 820kb] [ppt][ppt 4.3Mb, avi 77.3Mb)
- Uyttendaele, Criminisi, Kang, Winder, Hartley, and Szeliski (2004); Image-based interactive exploration of real-world environments, IEEE CGA, [URL] [PDF] [Video][PPT]
- Snavely, Seitz, and Szeliski (2006). “Photo Tourism: Exploring photo collections in 3D” ACM SIGGRAPH 2006 [PDF] [Video (WMV), Video (MOV)] [Project Site] [Microsoft Project on PhotoSynth]
- Szeliski (2006); “Image alignment and stitching: A tutorial“, Foundations and Trends in Computer Graphics and Computer Vision [URL]
- Agarwal, Snavely, Simon, Seitz and Szeliski (2009) “Building Rome in a Day“, ICCV, 2009, [PDF] [Site] [Video]
- Furukawa, Curless, Seitz, and Szeliski (2009); “Reconstructing Building Interiors from Images” ICCV, 2009. [PDF] [Site] [Videos 1, 2, 3, ALL][pptx]
- Hoiem, Efros, Hebert (2005); “Automatic Photo Pop-up”, ACM SIGGRAPH 2005. [pdf ] [presentation] [software] [video]
- Thursday
Week 9 (3/7/11)
- Tuesday
- Video
- READINGS / RESOURCES
- Video Textures (http://www.cc.gatech.edu/cpl/projects/videotexture/)
- Panoramic Video Textures (http://grail.cs.washington.edu/projects/panovidtex/)
- Thursday
- Tool(kit)s for Image/Video processing
- Processing (http://processing.org/)
- Open CV (http://opencv.willowgarage.com/wiki/)
- Max/MSP/Jitter (http://en.wikipedia.org/wiki/Max_(software))
- MATLAB (by Mathworks)
- AND many more.
- Notes from Denis Aleshin Tutorial.
Week 10 (3/14/11)
- Tuesday
- Image Blur
- READINGS:
- Fergus, Singh, Hertzmann, Roweis, Freeman, (2006); “Removing camera shake from a single photograph”, SIGGRAPH 2006, [pdf][doi] [site has code/other material]
- Shan. Jia, Agarwaka (2008); “High-quality Motion Deblurring from a Single Image”, SIGGRAPH 2008, [pdf][site][ppt] (software available from site)
- Levin, Fergus, Durand, and Freeman, (2007); “Image and depth from a conventional camera with a coded aperture.” SIGGRAPH 2007 [pdf][video][ppt]
- Brostow & Essa (2001); “Image-Based Motion Blur for Stop Motion Animation” SIGGRAPH 2001 [pdf][movie][site]
- READINGS:
- Image Blur
- Thursday
- Guest Speaker: Grant Schindler
Week 11 (3/21/11) [SPRING BREAK]
Week 12 (3/28/11)
- Tuesday
- Photography and Ethics.
- READINGS
- “The Case of the Inappropriate Alarm Clock (Part 1)” Errol Morris (Oct 18, 2009) NY Times (http://opinionator.blogs.nytimes.com/2009/10/18/the-case-of-the-inappropriate-alarm-clock-part-1/)
- “Thought Experiment No. 1, and More Inappropriate Alarm Clocks” Errol Morris (Nov 9, 2009) NY Times (http://opinionator.blogs.nytimes.com/2009/11/09/thought-experiment-no-1-and-more-inappropriate-alarm-clocks/)
- “It Was All Started by a Mouse (Part 1)” Errol Morris (Jan 3, 2010) NY Times (http://opinionator.blogs.nytimes.com/2010/01/03/it-was-all-started-by-a-mouse-part-1/)
- “It Was All Started by a Mouse (Part 2)” Errol Morris (Jan 4, 2010) NY Times (http://opinionator.blogs.nytimes.com/2010/01/04/it-was-all-started-by-a-mouse-part-2/)
- “Thought Experiment No. 2” Errol Morris (Jan 12, 2010) NY Times(http://opinionator.blogs.nytimes.com/2010/01/12/thought-experiment-2/)
- Other RESOURCES
- “Behind the Scenes: Tank Man of Tiananmen” (Jun 3, 2009); NY Times (http://lens.blogs.nytimes.com/2009/06/03/behind-the-scenes-tank-man-of-tiananmen/)
- “Behind the Scenes: A New Angle on History” (Jun 4, 2009); NY Times (http://lens.blogs.nytimes.com/2009/06/04/behind-the-scenes-a-new-angle-on-history/)
- “Essay: Chop and Crop” (Sep 17, 2009); NY Times (http://lens.blogs.nytimes.com/2009/09/17/essay-9/)
- “Behind the Scenes: Digital Manipulation” (July 8, 2009); NY Times (http://lens.blogs.nytimes.com/2009/07/08/behind-5/)
- “Behind the Scenes: Edgar Martins Speaks” (July 31, 2009) NY Times (http://lens.blogs.nytimes.com/2009/07/31/behind-10/)
- http://www.petapixel.com/2010/03/03/world-press-photo-disqualifies-winner/
- Video Rewrite. Example of Video Manipulation: Driving Visual Speech with Audio
- Mary101 Page. Examples of Video Manipulation. Speech driven, facial animation
- Thursday
- In Class Session about Final Projects
Week 13 (4/4/11)
- Tuesday
- Mosaics, Collages, Seeing/Sharing pictures
- READINGS
- Shape Collage (http://www.shapecollage.com/)
- Photomosaics (http://www.engadget.com/2004/10/19/how-to-make-your-own-photo-mosaics/)
- Ken Burns Effect (http://en.wikipedia.org/wiki/Ken_Burns_effect)
- Parallax Photography (http://grail.cs.washington.edu/projects/parallax/)
- Diakopoulos, Essa 2005; Mediating Photo Collage Authoring.
- Diakopoulos, Essa 2006; Videotater ..
- AutoCollage 2008 by Microsoft Research (Video)
- Picasa 3.8 Face Movie (link)
- Thursday
- Many Images (Guest Speaker: Grant Schindler)
- READINGS
- Hays, Efros 2007; IM2GPS: estimating geographic information from a single image
- Hays, Efros 2007; Scene Completion Using Millions of Photographs (Google Talk)
- READINGS
- Many Images (Guest Speaker: Grant Schindler)
Week 14 (4/11/11)
- Tuesday
- Time Lapse
- READINGS
- Terry, Brostow, et al. 2004; Time Maps.
- Bennet, McMillan 2007; Computational-Time Lapse.
- Sunkavalli, Matusik, Pfister, Rusinkiewicz (2007); Factored Time-Lapse.
- Pritch, Rav-Acha, Peleg 2008; Video Synopisis and Indexing
- J.-F. Lalonde, S. G. Narasimhan, and A. A. Efros (2010); What Do the Sun and Sky Tell Us About the Camera?
- READINGS
- Time Lapse
- Thursday
- Critique Presentations.
Week 15 (4/18/11)
- Tuesday
- GUEST SPEAKER: Frank Dellaert on HDR Imaging
- Thursday
- Critique Presentations (Continued!)
Week 16 (4/25/11)
- Tuesday
- Final Project Presentations in CLASS
- Thursday
- FINAL in class SHOWCASE.