codalabs-xyz/ai-video-creator-skill
Overview
This skill provides an end-to-end AI video production pipeline that combines programmatic composition with optional avatar narration. It orchestrates audio-first TTS generation, Remotion-based visual composition, and HeyGen avatar clips to produce polished tutorials, explainers, and demos. The workflow prioritizes cheap, fast iteration on audio and layout before generating costly avatar footage.
How this skill works
Generate narration audio first using HeyGen, ElevenLabs, or OpenAI TTS to iterate quickly and cheaply. Use Remotion components to compose split-screen visuals, sync audio, and render prototype videos without avatars. Once the script, timing, and layout are finalized, generate avatar clips from HeyGen and overlay them as picture-in-picture for the final render.
When to use it
- Creating narrated technical tutorials or product demos where code and a browser view need to be shown
- Producing multi-language explainer videos with reusable assets and consistent branding
- Batch-generating many short clips with similar structure (e.g., course lessons)
- Iterating rapidly on narration and timing without paying for avatar generation
- Adding a polished human avatar overlay only for the final delivery
Best practices
- Always follow an audio-first workflow: iterate on TTS audio and timing before composing visuals or avatars
- Keep clips short (35–45 words ≈ 15–20s); avoid >100 words to prevent sync issues
- Use split layouts for technical content (e.g., 55% code / 45% browser) and reserve avatar as a circular overlay
- Test prototype renders without avatars to validate pacing and layout before generating expensive avatar clips
- Match HeyGen resolution to your plan (default to 720p unless you have higher-tier access) to avoid failed jobs
Example use cases
- Step-by-step React SDK tutorial showing code on the left and a live app preview on the right
- Product feature demo with narrated walkthrough and branded lower-third overlays
- Localized course videos: generate audio in target language, render visuals, then produce language-specific avatars
- Batch creation of short social clips by reusing a Remotion template and swapping narration files
FAQ
Audio-only TTS is cheap and fast, letting you iterate on script and timing before spending on avatar generation.
What resolution should I request from HeyGen?
Use 720p by default unless your HeyGen plan supports 1080p or higher; unsupported resolutions cause failed jobs.
How do I avoid avatar desync?
Keep clips under 100 words and refine pauses in the script (use short SSML breaks) so avatar footage aligns with narration.