2012 Grad

CS 8803 PHO (3-0-3): Advanced Computational Photography – (Instructor: Irfan Essa, Grant Schindler) – This class explores perceptual and technical aspects of pictures, and more precisely the capture and depiction of reality on a 2D medium. The scientific, perceptual, and artistic principles behind image-making will be emphasized. Topics include the relationship between pictorial techniques and the human visual system; intrinsic limitations of 2D representations and their possible compensations; and technical issues involving depiction. Technical aspects of image capture and rendering, and exploration of how such a medium can be used to its maximum potential, will be examined. Students are strongly encouraged (not required) to bring their digital cameras and a laptop to facilitate experiments.

For more information, see the slides (link).

Instructor

  • Professor Irfan Essa (Email is the BEST (and ONLY) option: irfan at cc dot gatech dot edu, please use CS8803PHO: as the first words in the subject line)
  • Dr. Grant Schindler (Email is the BEST (and ONLY) option: schindler at cc dot gatech dot edu, please use CS8803PHO: as the first words in the subject line)
  • Office Hours: After class OR schedule via email appointment

Class Time/Location:

  • Location: KACB 2456
  • Monday – Wednesday 4:35p – 5:55p.

Learning Objectives

In this class. you will learn about:

  • The Medium of Photography (History to Modern Technologies)
  • Digital Imaging (Sensors to Software)
  • Computational Processes associated with Imaging and Photography
  • Computation as applied to Digital Media.
  • Image Analysis and Synthesis
  • Images and Photography on the Web/Internet
  • Storytelling with images (and computation).

Text & Reading Material.

  1. [RS] Computer Vision: Algorithms and Applications; by Richard Szeliski (see link for a draft of this book available online)
  2. Other material available online or on T-square (See Resources/Readings/ on T-Square site for this class).

Assignments and Grading

  • Class Attendance & Participation (15 %)
  • Assignments / Homeworks (20 %) [There will be 2-3 Assignments]
  • In Class Presentation (15%)
  • Reviews of Assigned Readings (15%)
  • Final Project (35%)
    • Includes:  Proposal/Teaming(5%), Updates (7%), In class presentation and demo (15%), Final Report and Self Evaluation (8%).
  • All of the above subject to slight modifications as needed, which will be announced in class.

Policies

  • Class attendance is required. Late by 15 minutes, counts as an absence. Legitimate reasons for being excused from class include, personal issues, health (keep those germs away from class), interview, conference travel, etc.  Travelling and exploring, assignments due in other classes, out to pick up friends, and other such excuses not accepted. Please inform Instructor of a planned absence via email before class.
  • Grading. Usually a score of 90 is considered an “A” and 100 an “A+” (but a 100 is given to only artifacts that are exceptional and beyond what was expected!). 80, 70 are “B” and “C” respectively.
  • Homeworks Assignments will be graded on a list of criteria (specified on the assignment) such as quality of work, completeness, insight into technical issues, insight into other relevant issues, etc. Assignments are due at the start of class on the day they are due.
  • Late Assignments: Everything is DUE before the class session.  NO extensions.  In most circumstance, students will be asked to discuss their assignment in class.
  • Laptops use in class: Use of laptops in class room for purposes of note-taking and work related to the class is allowed, but ONLY and ONLY for that purpose.  If a student is seen surfing the web during class, or chatting with someone, or emailing, then points will be deducted from the class attendance and participation portions of the grade (3% for each infraction, with a total of 3 max, after that the student looses the whole class participation score).
  • Cellphones in class: Please turn your cellphone and other mobile devices to “silent” mode during class.  Thanks.
  • This class abides by the Georgia Tech Honor Code. All assigned work is expected to be individual, except where explicitly written otherwise. You are encouraged to discuss the assignments with your classmates; however, what you hand in should be your own work. If any work product was produced based on discussions with someone else (in the class OR outside), please specify clearly in the final turn-in.

Acknowledgments

Assignments and ideas on this syllabus build on those from everyone who has taught this material before.

Schedule

Here is a weekly and day by day schedule of the class. See T-Square @ GATech site for this class for details on readings and assignments. Some topics and readings are subject to change, so please make sure to check this site on weekly basis (at-least). Links are provided to slides and material in class to the GT Internal T-Square site.


Week : #1#2#3#4#5#6#7#8, #9#10#11#12#13#14#15#16


Week 1 (1/9/12)

  • Monday
    • TOPIC: Introduction and Overview [IE/GS]
    • MATERIAL from lecture: See T-square Site (01_Introduction)
  • Wednesday
    • Topic: CAMERAS [IE] (How do cameras work? From a pinhole camera to a digital camera.)
    • MATERIAL from lecture: See T-square Site (02_Cameras)

Week 2 (1/16/12)

  • Monday
    • MLK HOLIDAY – No Class
  • Wednesday
    • TOPIC: PHOTOGRAPHY [IE] (What is the medium of photography? What is it’s technology?)
    • MATERIAL from lecture: See T-square Site (03_Photography)

Week 3 (1/23/12)

  • Monday
    • TODO: Assignment #0 Presentations in class
    • TODO: Assignment #1 Out
  • Wednesday

Week 4 (1/30/12)


Week 5 (2/6/12)

Week 6 (2/13/12)


Week 7 (2/20/12)

  • Wednesday
    • TOPIC: Texture Synthesis II and Image Stiching [IE]
    • READINGS:
      • Efros and Freeman (2001), “Image Quilting for Texture Synthesis and Transfer” SIGGRAPH 2001 [PDF] [DOI].
      • Kwatra, Schödl, Essa, Turk, Bobick (2003), “Graphcut textures: image and video synthesis using graph cuts” SIGGRAPH 2003 [PDF] [DOI].

Week 8 (2/27/12)

  • Monday
    • TOPIC: Image Analogies & Synthesis (IE)
    • READINGS
      • Hertzmann, Jacobs, Oliver, Curless, Salesin. (2001) “Image Analogies” SIGGRAPH 2001. [PDF][DOI]
      • Agarwala, Dontcheva, Agrawala, Drucker, Colburn, Curless, Salesin, Cohen. (2004). “Interactive digital photomontage.” SIGGRAPH 2004 [PDF] [DOI].
    • DISCUSSION OF FINAL PROJECTS
  • Wedenesday
    • TOPIC: Image Editing (GS)
    • READINGS
      • Perez, Gangnet, and Blake. (2003). “Poisson image editing.” ACM SIGGRAPH 2003. [PDF][DOI]
      • Jia, Sun, Tang, Shum (2006), “Drag-and-Drop Pasting”, SIGGRAPH 2006.[PDF][DOI]

Week 9 (3/5/12)

  • Monday
    • TOPIC: HDR I (GS)
    • READINGS:
      • Debevec and Malik (1997), “Recovering High Dynamic Range Radiance Maps from Photographs”, SIGGRAPH 1997. [PDF][DOI]
      • Durand and Dorsey (2002), “Fast bilateral filtering for the display of high-dynamic-range images”, SIGGRAPH 2002, [PDF][DOI]
  • Wednesday
    • TOPIC: Colorization (IE)
    • READINGS:
      • Levin, Lischinski, Weiss (2004), “Colorization using Optimization” SIGGRAPH 2004 [PDF][DOI]
      • Cohen-Or, Sorkine, Gal, Leyvand, Xu, (2006), “Color Harmonization” SIGGRAPH 2006 [PDF][DOI]

Week 10 (3/12/12)

  • Monday
  • Wednesday
    • TOPIC: Plenoptic Imaging (IE)
    • READINGS:
      • Adelson and Bergen (1991), “The Plenoptic Function and the Elements of Early Vision” Computational models of visual processing. [PDF][DOI]
      • Adelson and Wang (1992) “Single lens stereo with a plenoptic camera”, IEEE PAMI 14(2) [PDF][DOI]
      • Ng, Levoy, et al. (2005), “Light field photography with a hand-held plenoptic camera” Stanford Tech Report CTSR 2005-02, 2005. [PDF][DOI]

Week 11 (3/19/12) [SPRING BREAK]


Week 12 (3/26/12)

  • Monday
    • TOPIC: Light Fields (IE)
    • READINGS
      • McMillan and Bishop (1995), “Plenoptic modeling: An image-based rendering system”, SIGGRAPH 1995 [PDF][DOI]
      • GORTLER, S. J., GRZESZCZUK, R., SZELISKI, R., AND COHEN, M. F. 1996. The lumigraph. In SIGGRAPH 96, 43–54. [PDF][DOI]
      • LEVOY, M., AND HANRAHAN, P. 1996. Light field rendering. In SIG- GRAPH 96, 31–42.[PDF][DOI]
  • Wednesday
    • TOPIC: Video (IE)
    • READINGS
      • Schödl, Szeliski, Salesin, Essa (2000), “Video textures,” in ACM SIGGRAPH 2000 [PDF][DOI]
      • Kwatra, Schödl, Essa, Turk, Bobick (2003), “Graphcut textures: image and video synthesis using graph cuts” SIGGRAPH 2003 [PDF] [DOI].
      • Agarwala, Zheng, Pal, Agrawala, Cohen, Curless, Salesin, and Szeliski (2005) “Panoramic video textures.”  SIGGRAPH 2005 [PDF][DOI]

Week 13 (4/2/12)

  • Monday
  • Wednesday
    • TOPIC: TOPIC: Video Segmentation / Video Retargeting [MG]
    • READINGS
      • M. Grundmann, V. Kwatra, M. Han, and I. Essa (2010), “Efficient Hierarchical Graph-Based Video Segmentation,” in CVPR, 2010. [PDF][DOI]
      • M. Grundmann, V. Kwatra, M. Han, and I. Essa (2010), “Discontinuous Seam-Carving for Video Retargeting,” in CVPR, 2010. [PDF][DOI]
      • Avidan, Shamir (2007), “Seam Carving for Content-Based Image Retargeting”, in SIGGRAPH 2007. [PDF]

Week 14 (4/9/12)

  • Monday
    • TOPIC: Video and Image Stabilization [MG]
    • READINGS:
      • M. Grundmann, V. Kwatra, and I. Essa (2011), “Auto-Directed Video Stabilization with Robust L1 Optimal Camera Paths,” in CVPR, 2011. [PDF]
      • M. Grundmann, V. Kwatra, and I. Essa (2012), “Calibration-Free Rolling Shutter Removal”, International Conference on Computational Photography, 2012 (to appear) [pdf]
  • Wednesday
    • TOPIC: In Class Project Updates (Submit an update via T-square).

Week 15 (4/16/12)

  • Monday
    • TOPIC: Blur
    • READINGS:
      • Fergus, Singh, Hertzmann, Roweis, Freeman (2006), “Removing camera shake from single image”, ACM SIGGRAPH 2006 [PDF][DOI]
      • Shan, Jia, Agarwala (2008), “High-quality Motion Deblurring from a Single Image” [PDF] [DOI]
  • Wednesday

Week 16 (4/23/11)

  • Monday
    • TOPIC: Time-Lapse
    • READINGS:
      • Sunkavalli, Matusik, Pfister, Rusinkiewicz, (2007) “Factored Time-Lapse Video”, ACM Transactions on Graphics (TOG), ISSN:0730-0301, Vol. 26, Issue 3, Article 101, July 2007 [PDF][DOI]
      • Bennett and McMillan. (2007). “Computational time-lapse video”. SIGGRAPH 2007 (July 2007). [PDF] [DOI]
  • Wednesday
    • PROJECT PRESENTATIONS
Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s