Hand-drawn split desk: tangled film chaos on the left, neat cards and waveform on the right, for editing video with Claude

Quick answer

Editing video with Claude now means more than asking for a cut list. In Matt Wolfe’s walkthrough, Claude researches a topic, drafts a short-form script, cleans talking-head A-roll, adds B-roll, captions, music and sound effects, then renders a Short — all from a project with reusable skills. It works best for repeatable short talking-head videos. Long-form and highly designed edits still suit CapCut, Descript or Premiere. Treat his view counts as his results, not a guarantee for your channel.

Key takeaways

  • Claude can run a short-form assembly line: research → script → A-roll cleanup → B-roll, captions, music → render.
  • Skills beat one-off prompts. A scripting skill and an editing skill learn your hooks, pacing and look over time.
  • Connectors matter: VidIQ for research, ElevenLabs for music/SFX/transcripts, FFmpeg for headless cuts.
  • Shorts first. Matt still prefers human editing for long videos.
  • Codex/ChatGPT can do the same pattern if that is the plan you already pay for.
  • Feedback is part of the product. First cuts train the skill; monthly reviews keep it improving.

For years, “AI video editing” mostly meant auto-captions, silence removal or a rough trailer. Matt Wolfe’s latest guide goes further: he treats Claude as a short-form editor that can take a link, help him record, then return a cut he is happy to post.

Here is a practical reading of that workflow — what editing video with Claude really involves, what it still can’t replace, and how to try it without throwing out CapCut or Premiere. Creator credit goes to Matt (@mreflow); the judgements below are ours.

What can Claude actually do when editing video?

In the demo, Claude is not dragging clips around inside Premiere. It works headless: it reads briefs and pages, writes scripts, inspects A-roll, plans B-roll, and uses tools such as FFmpeg and HyperFrames to assemble the file.

On Matt’s channel, that has meant a steady run of Shorts and Reels — sometimes more than one a day — with AI handling a large share of the edit. He shows examples that reached high view counts on Instagram and YouTube Shorts. Those numbers are his, in his niche, with his audience. Your mileage will differ.

StageWhat Claude handled in the demo
Idea and researchRead a source page, checked similar videos (via VidIQ), scored visual appeal
ScriptDrafted a short in a style close to his existing hooks, plus title ideas and a B-roll shot list
A-roll cleanupCut pauses, mistakes and do-overs using transcript and waveform cues
Picture and soundPlaced B-roll, captions, music and SFX, then rendered a vertical short

💡 Tip: If you only remember one editing rule from the video, make it this: tell the agent to cut using both the transcript and the waveform, so it doesn’t chop words mid-syllable.

🛠️ Practical guides

Ready to put this into practice? These step-by-step guides answer two common follow-up questions:

What does Matt Wolfe’s Claude video workflow look like?

The happy path Matt shows looks like this:

  1. Paste a URL for something worth making a short about.
  2. Claude researches, scores the idea and returns a script plus shot list.
  3. You record talking-head A-roll (messy takes are fine).
  4. You drop the file into the Claude project with little or no extra prompt.
  5. The editing skill transcribes, cuts, adds B-roll, captions, music and renders.
  6. You give notes; Claude updates the skill so the next short starts closer to your taste.

He built this inside a dedicated project (“Shortform Video Editor”) on a clean Claude Pro account so the demo wasn’t leaning on years of hidden memory. The same idea, he says, works with Codex and ChatGPT models.

Which tools sit around Claude in the edit?

Claude is the conductor. The orchestra in the video included:

  • VidIQ MCP — analyse your outliers and similar videos (the video is VidIQ-sponsored; Matt says he was already using it this way before the sponsor ask).
  • ElevenLabs — music, sound effects and timestamped transcripts from raw A-roll.
  • HyperFrames — light motion-graphics style polish.
  • FFmpeg — the actual cuts and assembly.
  • yt-dlp — downloading source or B-roll when appropriate.
  • Optional Blender — simple 3D or animated accents.

You do not need every connector on day one. A folder Claude can write to, a way to transcribe, and FFmpeg-level cutting already cover a lot. Our setup guide walks through the project and skills in order.

Why do Claude skills matter more than a single prompt?

A single clever prompt will get you one okay short. Skills are what make the tenth short look like yours.

Matt asks Claude to study his best-performing shorts, then save:

  • A short-script skill that knows his hooks (for example “This is the coolest thing I saw today”), pacing and topic patterns.
  • A short-editor skill that matches his caption style, B-roll rhythm and audio habits.

After each awkward cut, he does not only fix that file — he tells Claude to update the skill. Once a month he feeds performance feedback back in: opening frames that hold attention, places viewers drop off, scripting tweaks. That loop is the real product.

Where does AI video editing still fall short?

Honest limits from the video and from common sense:

  • Long-form still favours a human editor and a real timeline, in Matt’s own view.
  • First edits miss. Expect wrong pacing, odd B-roll choices or permission prompts that stop a render mid-way.
  • Rights and downloads. An agent that can fetch web video can also fetch footage you shouldn’t use.
  • Flooded feeds. When assembly gets cheap, average short-form gets noisier. Standing out still depends on what you find and say, not only how fast you cut.
  • Not a replacement for taste. You still judge whether the script sounds like you and whether the open is strong.

⚠️ Warning: Do not paste private client footage or paid stock you can’t clear into a cloud agent without checking your contracts and the tool’s data rules.

How do you try this without rebuilding your whole channel?

  1. Pick one recurring short format you already understand (product demo, “cool thing I found”, tip of the day).
  2. Create a Claude project and folder; connect only the tools you’ll use this week.
  3. Build thin v1 skills from 5–10 of your own best shorts (or from channels you admire if you’re new).
  4. Ship three AI-assisted shorts. Spend your energy on feedback that updates the skills.
  5. Keep CapCut or Premiere for long videos and anything client-facing until the skills are stable.

If you’re unsure whether Claude should own a given video at all, use the decision guide: Claude vs CapCut vs Premiere: When to Use AI Video Editing.

Who is editing video with Claude right for?

Suits you if: you post short talking-head clips often, you already know what “good” looks like on your channel, and you’re willing to spend an evening on setup for faster repeats later.

Matters less if: you mostly make long YouTube videos, you edit one-off branded films, or you don’t want agents touching your media folders yet. In that case, tighten CapCut/Descript habits first — or give an agent a separate computer before you widen access.

What does the video not confirm?

🔎 Unconfirmed / rumour: We have not independently verified Matt’s Shorts/Reels view counts, the accuracy of VidIQ’s view-range estimates, or that every connector behaves identically on every Claude plan. Model names and product UIs also change quickly — check current Claude project, skill and MCP options before you buy anything. The $1 VidIQ offer mentioned in the video is a sponsor deal aimed at his audience; we are not part of that offer.

Watch: the source video

What this video covers: Matt Wolfe walks through editing short-form video with Claude: researching ideas with VidIQ, building scripting and editing skills, connecting ElevenLabs and FFmpeg-style tools, running a MotionBricks demo from URL to A-roll to finished short, then improving skills from performance feedback — plus his honest mixed feelings about AI and short-form work.

Video: Matt Wolfe (@mreflow). This summary and the opinions in it are our own. View counts, tool setups and sponsor offers are as described in the video and have not been independently confirmed by us.

Frequently asked questions

Can Claude replace Premiere Pro?

For many short talking-head clips, it can handle most of the assembly. For long-form, complex grade, multi-cam or strict brand templates, a traditional editor is still the better home.

Do I have to use Claude, or will ChatGPT work?

Matt says he has run the same idea in Codex with ChatGPT models. Use the stack you already pay for.

Is this only for YouTube Shorts?

The demo focuses on Shorts and Reels-style vertical videos. The same skills idea could help other short formats, but that isn’t what he stress-tested on camera.

How much does setup cost?

You’ll need whatever you pay for Claude (or Codex), plus optional tools such as VidIQ and ElevenLabs. Matt demoed Claude Pro at about $20/month on a fresh account.

What’s the biggest beginner mistake?

Expecting a perfect cut from a blank project. Skills need a few feedback cycles before “go edit this” feels reliable.

Where do I start tomorrow?

Create the project and folder, then follow our setup guide. Decide per video with the Claude vs CapCut vs Premiere guide.

The bottom line

Editing video with Claude is now a serious option for short, repeatable talking-head content: research, script, cut, caption and score in one project, with skills that improve when you correct them. It does not retire CapCut or Premiere, and it does not invent a niche for you. Your next step: watch Matt’s walkthrough, run the setup guide for one format you already post, and keep a timeline editor for everything that still needs human hands on the edit.

author avatar
Garry Knight
I'm Garry Knight, the person behind Prodify Digital. I write about email list building, email marketing, SEO, AI search and the tools that connect them. My aim is to make online marketing easier to understand, so creators and small business owners can make informed decisions about building an audience and keeping people engaged. Here you'll find straightforward guides and product reviews that explain what something does, where it fits and which limitations matter. The focus is on clear explanations and useful next steps—not hype, shortcuts or promises of easy earnings.

Leave a Reply