香港中文大学：《CMSC5719 Seminar》课程教学资源（讲义）Lecture 12 Introduction to Computational Photography

Introduction to Computational Photography Film required Bytes required Computation required 1

1 Introduction to Computational Photography

What is computational photography? 2

2 What is computational photography?

Computer Stereo, Vision 3D reconstruction,etc. Computational Photography Image Computer Processing Graphics Image enhancement, Rendering, denoising,etc. 3D modeling,etc. 3

3 Computer Vision Image Processing Computer Graphics Computational Photography Stereo, 3D reconstruction, etc. Image enhancement, denoising, etc. Rendering, 3D modeling, etc

A formal definition Computational photography refers broadly to computational imaging techniques that enhance or extend the capabilities of digital photography. The output of these techniques is an ordinary photograph,but one that could not have been taken by a traditional camera. from Wikipedia 4

A formal definition • Computational photography refers broadly to computational imaging techniques that enhance or extend the capabilities of digital photography. The output of these techniques is an ordinary photograph, but one that could not have been taken by a traditional camera. 4 - from Wikipedia

Conventional Camera Light 3D Scene: 2D Image: Illumination, Ray Bundles 'Instantaneous shape,movement,Ray Bundles Intensity Map surface BRDF.... Display on a monitor (or print it). Images captured by sensor Images displayed by monitor 5

Conventional Camera 5 2D Image: ‘Instantaneous’ Intensity Map Light + 3D Scene: Illumination, shape, movement, surface BRDF,… Position(x,y) Ray Bundles Ray Bundles Display on a monitor (or print it). Images captured by sensor ≈ Images displayed by monitor

Computational Camera Light 3D Scene: 2D Image: Illumination, Ray Bundles 'Instantaneous shape,movement, Ray Bundles Intensity Map surface BRDF.... Computational Computer Device Processing Images captured by sensor Images displayed by monitor 6

Computational Camera 6 2D Image: ‘Instantaneous’ Intensity Map Light + 3D Scene: Illumination, shape, movement, surface BRDF,… Position(x,y) Ray Bundles Ray Bundles Images captured by sensor ≠ Images displayed by monitor Computational Device Computer Processing

Interactive Image Segmentation Put the“user in the loop”! 7

7 Interactive Image Segmentation Put the “user in the loop”!

Gradient Image Manipulation Operate at gradient level instead of pixel level. 8

8 Gradient Image Manipulation Operate at gradient level instead of pixel level

Structure-Aware Image Resizing Resizing what's more important;what's less important 9

9 Structure-Aware Image Resizing Resizing – what’s more important; what’s less important ?

Panoramic Imaging 10

Panoramic Imaging 10