Comic-book style neon desk with laptop, film reel folder, microphone and glowing tool connectors for a Claude video editing setup

Quick answer

To set up Claude for short-form video editing, create a dedicated Claude project, connect a working folder plus tools such as VidIQ, ElevenLabs, HyperFrames and FFmpeg, then ask Claude to build two skills from your best-performing shorts: one for scripting and one for editing. After that, the loop is simple: paste a source URL, record the A-roll, drop the file back in, and give feedback until the skills match your style. Matt Wolfe’s walkthrough in our main article on editing video with Claude is the source for this setup.

Key takeaways

  • Use a fresh or dedicated project so instructions and skills stay focused on short-form editing.
  • Connect a folder Claude can always write to, plus music/SFX (ElevenLabs) and research (VidIQ) if you use them.
  • Build two skills: a short-script writer and a short-form editor that use both transcripts and waveforms for cuts.
  • Expect the first edit to need feedback. Tell Claude what to fix, then ask it to update the skill.
  • The same pattern works in Codex/ChatGPT if you already pay for that plan.

📘 Main article: This guide answers one practical question from our article Editing Video With Claude: Matt Wolfe’s Short-Form Workflow. For when Claude is the wrong tool, see Claude vs CapCut vs Premiere: When to Use AI Video Editing.

Matt Wolfe’s video shows a full short-form pipeline inside Claude: research a topic, write a script that fits your channel, cut the talking-head A-roll, add B-roll, captions, music and sound effects, then render. The hard part isn’t the last prompt. It’s the one-time setup that makes “go edit this” work.

This guide answers one question: how do you set up Claude so it can edit short-form video from your A-roll? Watch the source walkthrough on YouTube, then use the steps below. The bigger picture is in our editing video with Claude article.

What do you need before you start?

  • A Claude Pro (or similar) account with access to projects, skills and connectors. Matt demoed from a blank Pro account at about $20/month.
  • A folder on your computer for project files (he called his “Claude Editor”).
  • Raw A-roll you can record yourself: talking to camera, mistakes and all.
  • Optional but useful connectors: VidIQ for short performance research, ElevenLabs for music, SFX and transcripts, HyperFrames for light motion graphics, plus FFmpeg and yt-dlp for headless editing and downloads.
  • Examples of what “good” looks like on your channel, or channels you want to learn from.

⚠️ Warning: Only connect accounts and folders you are happy for Claude to use. Prefer a dedicated project folder. If the agent will download third-party B-roll, check you have the right to use that footage.

How do you create the Claude project?

  1. Create a new Claude project. Name it something clear, such as Shortform Video Editor.
  2. Add project instructions that state the job: turn source material into a short script that is likely to perform, clean A-roll (cut pauses and mistakes), add B-roll, captions, music and polish.
  3. List the tools it may use (for example VidIQ, HyperFrames, FFmpeg, yt-dlp, Blender, ElevenLabs).
  4. Under the project’s context, add your working folder and choose always allow so it can save renders without asking every time.

💡 Tip: Keep the project instructions short and role-based. Put style rules and pacing numbers into the skills once Claude has analysed your channel, not into a huge instruction dump on day one.

Which tools should you connect?

In Matt’s demo, the connectors that mattered most were:

ToolWhat it did in the workflow
VidIQ MCPAnalysed top-performing shorts and similar videos for hooks, topics and likely view ranges
ElevenLabs (full)Background music, sound effects and timestamped transcripts when no script file was provided
HyperFramesLight After Effects-style motion and polish
FFmpegHeadless cuts and assembly (no need to drive Premiere or Resolve by remote control)
yt-dlpDownloading source or B-roll clips from the web when allowed

Connect them from Claude’s customise / connectors area, authorise each one in the browser, and for ElevenLabs choose the full version if you want music and SFX, not only speech.

How do you build the scripting and editing skills?

If you already have a channel, ask Claude to use VidIQ to analyse your best shorts (script and visuals), then create:

  • A short-script skill that writes in your hook style, length and topic patterns.
  • A short-editor skill that cuts A-roll, layers B-roll, captions, music and SFX to match your look.

Matt’s key editing rule: use both the transcript and the waveform when cutting, so words aren’t chopped mid-syllable. Tell the skill that explicitly.

If you don’t have a channel yet, point it at a few channels you admire and ask for skills inspired by those patterns — then refine with your own feedback after the first few videos.

💡 Tip: Turn on auto / always-allow while Claude builds the first skills so the analysis can finish without constant prompts. Review what it wrote before you trust it on a real upload.

How do you run your first short from a URL to a finished edit?

  1. Paste a source URL (blog post, product page, demo) into a new chat in the project.
  2. Let the script skill research, score the idea and draft a script plus a B-roll shot list.
  3. Edit the script in your own voice if needed, then record A-roll (pauses and do-overs are fine).
  4. Drop the video file into the chat with little or no extra prompt.
  5. Let the editor skill transcribe, cut, add B-roll, captions, music and render.
  6. Watch the cut. Tell Claude exactly what to fix, then ask it to update the skill so the next video starts better.

In the video, Claude also hit permission and tool blocks mid-edit. When that happens, approve the missing access, tell it to continue, and again fold any permanent rule into the skill.

How do you improve the skills after each video?

Matt treats improvement as a monthly loop: ask Claude to review last month’s outliers, note what the opening frames and drop-off points share, then update scripting and editing skills. Examples from his feedback: open on real footage of the thing (not a UI screen), keep caveats short, and change B-roll every couple of seconds.

That “show once, then update the skill” habit matches how we teach agents elsewhere — see How to Teach an AI Agent a Task by Showing It Once.

What mistakes should you avoid?

  • Expecting perfection on take one. The first edits train the skill; they are not the finished system.
  • Skipping waveform-aware cuts. Transcript-only edits often clip words.
  • Letting the agent use B-roll you don’t have rights to. Prefer your own captures and clearly licensed source media.
  • Mixing long-form and short-form in one skill. Matt still prefers human editing for long videos; keep this project for shorts.
  • Forgetting to choose Claude vs a timeline editor. Our Claude vs CapCut vs Premiere guide helps you decide per video.

Frequently asked questions

Do I need Claude, or will ChatGPT/Codex work?

Matt says the same workflow works with Codex and ChatGPT models. Use the plan you already pay for.

Do I need VidIQ?

No, but in his demo it drove topic scoring and style analysis. Without it, supply your own examples of strong shorts.

How long does the first setup take?

Budget an evening: project, connectors, first skills and one test A-roll. Later videos are mostly record-and-drop.

What if Claude stops mid-edit?

Approve the blocked tool or folder, tell it to continue, then update the skill so the same block doesn’t repeat.

Should I give it a script with the A-roll?

Optional. Matt often records first and lets ElevenLabs produce a timestamped transcript from the raw take.

The bottom line

Setting up Claude for short-form editing is mostly a one-time job: project instructions, a trusted folder, the right connectors, and two skills that learn from your best shorts. After that, paste a URL, record A-roll, drop the file in, and keep feeding corrections back into the skills. Your next step: create the project folder and connect one research tool and one audio tool today, then run a single test short this week. Full context sits in our editing video with Claude guide.

author avatar
Garry Knight
I'm Garry Knight, the person behind Prodify Digital. I write about email list building, email marketing, SEO, AI search and the tools that connect them. My aim is to make online marketing easier to understand, so creators and small business owners can make informed decisions about building an audience and keeping people engaged. Here you'll find straightforward guides and product reviews that explain what something does, where it fits and which limitations matter. The focus is on clear explanations and useful next steps—not hype, shortcuts or promises of easy earnings.

Leave a Reply