Experiments with Computational Cinematography

The Brief

Behind the scenes of The Walk — Image Courtesy of AV&C

Step 1 — Acquisition

We had 1 camera on a dolly tracking our model, one on a steady cam, and one end of stage providing dynamic framing as the model walks down the runway. Image courtesy of AV&C

Step 2 — Analysis and Edit

Sync — the rough cut generation software leveraged features from CoreML and produced edits for Final Cut Pro X. Note that each rough cut has different timing, but is quantized to a multiple of the BPM. If you look closely you can also see a “compressed” middle chapter with syncopated edits for the paparazzi moment as a sort of ‘climax’ in the edit. This was the result of one specific edit rule.

Review

Results

Learnings

Special Circumstances is a Computational Cinematography R&D company. We build next generation tools for film makers.