Large-Scale Light Field Synthesis from Videos Enables Gemetrically Consistent Bokeh Editing

Vid2Bokeh Data Acquisition Evaluation

Advantage : Scalable and Geometrically Faithful Bokeh Synthesis on Complex Scenes

Our Vid2Bokeh pipeline synthesizes physically accurate bokeh directly from multi-view light fields, avoiding the depth estimation errors that cause artifacts in depth-based rendering. Drag the sliders below to compare a depth-based baseline against our method on the same real-world capture, with independent control over aperture size and focal plane.

Selected Near All-in-Focus View from a Captured Video

Depth Map

Ours (Vid2Bokeh, Depth-Free)

Aperture Radius (ap) ap = 06.00

Small Large

Focal Plane (slope) slope = +0.000

Far Near

Depth-Based Rendering

Aperture Radius (K) K = 18.0

Small Large

Focal Plane (var) var = +0.000

Far Near

Vid2Bokeh Full Pipeline

Bokeh Synthesis from Light Field Reconstrcuted from Video

Use the sliders below to explore variations in focal plane and aperture radius. These bokeh samples are directly generated from our Vid2Bokeh pipeline.

Note: Minor artifacts are visible due to video compression and the reduced resolution used to keep the file size small.

Step 1: Original Video

Step 2: Synthesized Light Field at Selected View (row by row)

Step 3: Bokeh images Rendered from Light Field

Focal Plane

Far Near

Aperture Radius

Small Large

Bokeh Editing

Compare to Depth-based Method

Direct side-by-side comparison of our method against a depth-based baseline (BokehDiff). Adjust aperture and focal plane independently on each panel to observe where depth estimation errors cause artifacts, while our approach maintains geometrically faithful bokeh.

Near All-in-Focus Input

BokehDiff (Depth-Based)

Aperture Radius (K) K = 8.0

Small Large

Focal Plane (var) var = 0.00

Far Near

Our Editing Result

Δ Aperture Radius dd = +0.00

Small Larg

Δ Focal Plane ds = +0.00

Far Near

Bidiretional Joint-DoF-Focus Editing

Interactively explore our method's joint control of focal plane and aperture radius. Drag the sliders to see how focus and depth-of-field change on real photographs.

Note: Focal-plane adjustment is highly sensitive, as most positions will lead to out-of-focus results when the input image has a sparse depth distribution.

Input

Our Editing Result

Δ Focal Plane (Relative Shift)

Toward Background

Original Focal Plane

Toward Foreground

Δ Aperture Radius (Relative Change)

Less Blur

Original Aperture Radius

More Blur