ICS 288: Visual Perception

Instructor: Aditi Majumder (Office: CS 352C)
Timings: Tu-Th, 3:30am - 4:50am
Room: PSCB 213
Quarter: Spring 2005

Course Description

This course will serve as an introduction to the process of visual perception. The goal of this course is to provide the student with a understanding of what goes on behind of scenes of human visual perception, and how this understanding can help to advance the technologies of computer vision, computer graphics, multimedia and human computer interaction (HCI).
This course will offer both the physiological and the psychophysical approach to understand human vision and will relate the two fields together to create a consistent and complete understanding of the process of visual perception. For the physiological approach, the course will introduce the areas of lower level visual processing in the receptors of the eye and the lateral geniculate nucleus and higher level visual processing in different areas of the brain. In the psychophysical approach, the course will introduce the different psychophysical models of human vision, like the models of perceptual organization, perceptual segregation, and construction. Concepts of color, depth, movement and their visual perception will be introduced. To relate the materials presented in the context of different areas of computer science, examples of the quantification and use of these physiological and psychophysical models in computer vision, computer graphics, multimedia and HCI will be referenced.

Tentative Course Outline

Introduction
Optical Info
Visual System
Percieving Objects, Color, Depth and Movements
Spatial Vision
Perception and Action
Applications
- Digital Color and Visualization Systems
- Image and Video Compression
- Gamut Matching
- Perspective Projection
- Camera Calibartion
- Depth Reconstruction
Selected Papers

Course Materials

Introduction
Notes and Presentation (Classes: Jan 13 ).
Optical Information
Notes and Presentation (Classes: Jan 15 ).
Visual System
Notes and Presentation (Classes: Jan 15 , Jan 20 , Jan 22 ).
Perceiving Objects
Notes and Presentation (Classes: Jan 27 )
Perceiving Color
Notes and Presentation (Classes: Jan 29 , Feb 3 , Feb 5 )
Spatial Vision
Notes and Presentation (Classes: Feb 5 , Feb 17 )
Perceiving Depth and Size
Notes and Presentation (Classes: Feb 19 )
Perceiving Movements
Notes and Presentation (Classes: Feb 26)
Perception and Action
Notes and Presentation (Classes: Feb 26)
Applications
- Color Seamlessness of Multi-Projector Displays ( Classes: Feb 10 and Feb 12 )
- Gamut Matching in Three and Four Primary Systems ( Classes: Feb 17 )
- Image and Video Compression ( Classes: Feb 17 -- Courtsey: Kevin Jeffay of UNC)
- Perspective Projection ( Classes: Mar 4 and Mar 9)
- Camera Calibration ( Classes: Mar 11 )

Assignments

Assignment 1 (Due on Jan 27)
Assignment 2 (Due on Feb 5)
Assignment 3 (Due on Feb 17)
Midterm (Due Feb 26)
Assignment 4 (Due March 11)
Final Exam Papers (On March 23, 8:00-10:00am)
- Image Blending
  
  A Multiresolution Spline with Application to Image Mosaics,
  Peter J. Burt and Edward H. Adelson
  ACM Transactions on Graphics, Vol. 2, No. 4, October 1983, Pages 217-236. ( pdf )
- Measuring Band-Limited Contrast of Images
  
  Contrast in Complex Images,
  Eli Peli
  Journal of Optical Soceity of America, Vol. 7, No. 10, October 1990 ( pdf ) [Sharon]
- Separating Illumination and Reflectance in Images
  
  Computing Reflectance Ratios from an Image,
  S. K. Nayar and R. M. Bolle,
  Pattern Recognition, Vol. 7, August 1993. ( pdf ) [Stacy]
- Geometric Calibration of Projection Based Displays
  
  Smarter Presentations: Exploiting Homography in Camera-Projector Systems,
  Rahul Sukthankar, Robert J. Stockton and Matthew D. Mullin
  Proceedings of International Conference of Computer Vision (ICCV), 2001. ( pdf )
  
  Scalable Alignment of Large-Format Multi-Projector Displays Using Camera Homography Trees,
  Han Chen, Rahul Sukthankar, Grant Wallace, and Kai Li
  Proceedings of Visualization, 2002 ( pdf )
- Color Calibration for Projecting on Surfaces with Arbitrary Reflectance
  
  A Projection System with Radiomteric Compensations for Screen Imperfections,
  Shree K. Nayar, Harish Peri, Michael D. Grossberg and Peter N. Belhumeur
  IEEE International Workshop on Projector Camera Systems, 2003. ( pdf ) [Pablo]
- Error Metric for Realistic Image Synthesis
  
  A Perceptually Based Physical Error Metric for Realistic Image Synthesis,
  Mahesh Ramasubramanian, Sumanta N. Pattanaik and Donald P. Greenberg
  Proceceedings of SIGGRAPH, 1999 ( pdf ) [Tosin]
  
  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis,
  Laurent Itti, Kristof Koch and Ernest Neibur
  IEEE Transactions of Pattern Analysis and Machine Intelligence, Vol. 20, No. 11, November, 1998 ( pdf )
  
  Spatiotemporal Sensitivity and Visual Attention for Efficient Rendering of Dynamic Environments,
  Hector Yee, Sumanta Pattanaik and Donald P. Greenberg
  ACM Transactions of Computer Graphics, Vol. 20, No. 1, 2001 ( pdf ) [Matthew]
- High Dynamic Range Images
  
  Recovering High Dynamic Range Radiance Maps from Photographs,
  Paul Debevec and Jitendra Malik
  Proceedings of SIGGRAPH, 1997 ( pdf ) [Wilson]

Grading Policy

Assignments = 30%
Midterm = 40%
Finals = 30%