1.Introduction

Introduction

What is computational photography?

  • Combining CV, CG, optics&sensors.

Analog photography

  • optics(光学器件) to focus light on an image plane (成像平面)
  • film (胶卷) to capture focused light(聚焦光)(chemical process)
  • dark room(暗室) for limited postprocessing(后处理) (chemical process)

Digital photography

  • optics to focus light on an image plane
  • digital sensor to capture focused light (electrical process)
  • on-board processor(机载处理器) for postprocessing (digital process)

Computational photography

Optics + illumination + sensors + computation

  • generalized optics between scene and sensor
  • unconventional sensing and illumination(照明)
  • arbitrary(任意)computation between sensor and image
Overcome limitations of digital photography
  • Image enhancement and photographic look (图像增强与摄影效果)
Image enhancement and photographic look
  • High dynamic range (HDR) imaging (Homework!)
High dynamic range (HDR) imaging
Create realistic new imagery
  • Image blending(混合) and harmonization(协调)
Image blending(混合) and harmonization(协调)
Post-capture(捕获后的图像合成) image compositing(合成)
  • Computational zoom (计算变焦) (Homework!)
Computational zoom
Process image collections
  • Auto-stitching(缝合) images into panoramas(全景图像)
Auto-stitching(缝合) images into panoramas
Process (very) large image collections
  • Using the Internet as your camera

    Using the Internet as your camera
    • reconstructing cities from Internet photos
    • time-lapse(延时) from Internet photos

Generalized optics between scene and sensor

Capture more than 2D images
  • Light-field cameras for plenoptic(全光) imaging
  • post-capture refocusingHomework!)
post-capture refocusing*
Measure 3D from a single 2D image
  • Coded aperture (光圈) for single-image depth and refocusing
Coded aperture (光圈) for single-image depth and refocusing
Remove lenses(镜头) altogether
  • FlatCam: replacing lenses with masks
FlatCam: replacing lenses with masks

Unconventional sensing and illumination

Measure depth
  • Time-of-flight sensors(飞行时间传感器) for real-time depth sensing
Time-of-flight sensors(飞行时间传感器) for real-time depth sensing
Measure light in flight
  • Streak(条纹) camera for femtophotography(e^{-15})
Streak(条纹) camera for femtophotography
Measure photons(光子) selectively
  • Structured light for epipolar imaging(Homework!)
Structured light for epipolar imaging

Course fast-forward and logistics

Topics to be covered

Digital photography

  • optics and lenses
  • color
  • exposure
  • aperture (光圈)
  • focus and depth of field
  • image processing pipeline

Image manipulation (操作) and merging(合并)

  • image filtering (滤波)
  • image compositing (合成)
  • image blending (混合)
  • image warping (变形)
  • morphing (变形)
  • high-performance image processing

Types of cameras

  • geometric camera models
  • light-field cameras
  • coded cameras
  • lensless cameras
  • compressive cameras
  • hyperspectral cameras

Active illumination and sensing

  • time-of-flight sensors
  • structured light
  • computational light transport
  • transient imaging
  • non-line-of-sight imaging
  • optical computing

Course logistics

最后编辑于
©著作权归作者所有,转载或内容合作请联系作者
平台声明:文章内容(如有图片或视频亦包括在内)由作者上传并发布,文章内容仅代表作者本人观点,简书系信息发布平台,仅提供信息存储服务。

推荐阅读更多精彩内容

  • 遗世迎风立,婆娑又几年? 云中空寂寂,月下独翩翩。 偶有行人咏,时来粉蝶旋。 须知香沁久,不惧在天边。
    繁花落尽深眸阅读 1,007评论 8 23
  • import UIKit class BBViewController: UIViewController { o...
    i得深刻方得S阅读 597评论 0 0
  • 菊花并不少见,她的身影散布全球。她出现在诗人的歌曲里,耐人寻味;也曾出现在吵闹的集市上,随入凡尘;她还经常像个迷途...
    繁星寻梦阅读 163评论 0 3
  • 1.公司需要在每次发送请求的时候,传递uuid参数,所以为了更好的设计就想把uuid放在自己创建的基类的请求头信息...
    BlueEagleBoy阅读 1,474评论 2 2
  • 情是一点一点换来的,心是一天一天处来的,人生是一页一页翻过来的。一路上,顺境也好,逆境也罢,互相理解包容就好。一辈...
    7405365bb678阅读 185评论 0 0