SPIE - Education Joint design of optics and image processing in computational sensing and imaging SC1219

This course provides an overview of the motivation, theory and basic examples of joint design of optics and image processing in computational sensing and imaging systems in which image processing performs significant, non-trivial role in creating the final digital output. 1) The course will review the history of optical imaging and its four revolutions: 1) forming a real image with lenses and curved mirrors through basic physical optics, 2) fixing the image with silver halide through photography, 3) capturing the image using CCDs and CMOS image sensors through digital photography, and 4) deep integration of optics and signal processing through computational imaging, where an image or image estimate is not simply captured but instead computed. 2) Joint design of imaging systems based on traditional lenses and linear signal processing, including electro-optical compensation for manufacturing variations. 3) Lensless computational sensing and imaging based on diffraction (rather than refraction or reflection). 4) Joint design of application-specific sensors, in which the output is not a two-dimensional digital image but instead a numerical output or discrete decision based on the input scene.