I Finally Solved AI Video Editing! (full guide)

Duncan Rogoff | Learn Claude Code

Key takeaways

Claude Code edits the video from research and scripting through cutting, graphics, quality checks, and revisions without the creator using an editing timeline. The creator still films and approves cuts; this edit took about 12 hours and 1.4 billion tokens, estimated at $445 through the API, while the creator's Claude Max 20X subscription covered the usage.

The workflow improves by splitting editing into distinct jobs and updating its skill rules from review notes, rather than asking for a finished video in one prompt; this edit used 12 rulebooks and incorporated 36 notes on one cut. The creator considers it worthwhile for their work, while noting that the starter skill is simpler and the polished result reflects five months of iteration.

Video Flow

  1. 0100:00

    A human-made script, then AI editing

    The creator reads the script on camera, while Claude Code creates the captions, motion graphics, and other edits without human timeline work. The polished result followed five months of iteration and a shift from requesting a finished video at once to assigning Claude one job at a time.

  2. 0201:15

    Research and script with fact checks

    Claude studies successful openings from top creators and saves useful examples in a library, then writes a script; the first line of this video draws on an outlier opening. Each factual claim must be checked against a real source such as a file or webpage, and unsupported lines are cut before the creator reads the script to camera.

  3. 0302:21

    Clean cuts and synchronized picture

    From the raw recording, Claude transcribes each word with its time, keeps the last clean take of each line, and removes retakes and awkward pauses; in an earlier test, it caught about eight out of ten retakes. It also measures and corrects the delay between camera picture and microphone audio, then checks its own work in a repeat-until-right loop.

  4. 0403:27

    Plan visuals with a beat map and references

    A beat map lists each spoken sentence and what should appear on screen; the previous video had 140 beats. Claude uses visual references to infer choices such as text movement and scene transitions, then maps every graphic to the beat map before building, making revisions cheaper than changing finished graphics.

  5. 0504:40

    Build graphics and render efficiently

    Claude divides the video into sections and assigns graphic construction to subagents, which build coded graphics with Hyperframes; more capable models handle planning while faster, cheaper models handle building. Renders run one at a time to avoid overloading the computer; disabling motion blur made them about three times faster, and half-size drafts precede full-quality renders after approval, using tools such as FFmpeg on the creator's machine.

  6. 0606:16

    Check edits at viewing speed

    Claude now inspects ten frames per second rather than one, checking for six errors: repeated animations, brief graphic flashes, late-arriving text, graphics covering the creator's face, duplicated spoken words, and lip-sync drift. The check is intended to match how a person watches rather than optimize for speed.

  7. 0706:58

    Turn review notes into lasting rules

    Claude uses review notes to find and rewrite the skill rule that would have prevented each mistake, such as setting a music-level rule or adding a check against duplicate on-screen copies. The skill has 12 rulebooks, and updating an existing rule instead of stacking another one is intended to reduce drift, bloat, and hallucinations.

  8. 0808:03

    Cost, time, and the starter skill

    This edit used about 1.4 billion tokens and took about 12 hours of Claude work, plus review time; API pricing would be about $445, while the creator's Claude Max 20X subscription covered the usage. The creator estimates a skilled human editor would need three days to a week and considers the system worthwhile for their work; the Club starter skill is simpler and improves as users save notes.

Tools & Resources

Start

3 roles · 1 references
End

2 roles

Handles the video editing jobs through code without the creator using an editing timeline.

  1. 01
    Handles the video editing jobs through code without the creator using an editing timeline.00:15
  2. 02
    Handles the video editing jobs through code without the creator using an editing timeline.01:43
  3. 03
    Handles the video editing jobs through code without the creator using an editing timeline.02:42
  4. 04
    Handles the video editing jobs through code without the creator using an editing timeline.03:33
  5. 05
    Handles the video editing jobs through code without the creator using an editing timeline.04:46
  6. 06
    Handles the video editing jobs through code without the creator using an editing timeline.06:22
  7. 07
    Handles the video editing jobs through code without the creator using an editing timeline.07:13

Provides a starter version of the editing skill for cleaning recordings and checking edits.

  1. 01
    Provides a starter version of the editing skill for cleaning recordings and checking edits.03:17
  2. 02
    Provides a starter version of the editing skill for cleaning recordings and checking edits.09:04

Provides motion-graphics examples and the prompts used to create them as visual references.

  1. 01
    Provides motion-graphics examples and the prompts used to create them as visual references.04:10

Turns code-built web-page graphics into video, including word-by-word captions.

  1. 01
    Turns code-built web-page graphics into video, including word-by-word captions.05:02

Handles planning and creative direction for the graphics workflow.

  1. 01
    Handles planning and creative direction for the graphics workflow.05:14

Serves as a higher-capability model for planning and creative thinking.

  1. 01
    Serves as a higher-capability model for planning and creative thinking.05:14

Runs the faster, cheaper subagents that build graphics.

  1. 01
    Runs the faster, cheaper subagents that build graphics.05:20

Renders the video locally on the creator's computer.

  1. 01
    Renders the video locally on the creator's computer.06:05

Covers the creator's Claude usage through a monthly subscription rather than per-token API billing.

  1. 01
    Covers the creator's Claude usage through a monthly subscription rather than per-token API billing.08:22

Share a little
cookie?

Your cookies help us understand visits and how you use Vigest, so we can make it better. We use Google Analytics. You can use the service without agreeing.

You can change your choice anytime.
Saved in this browser for 180 days.

Privacy notice