Music video — how to make it with code and an AI agent
For AI agents: find the right skill in one call —
curl -s "https://skills.varg.ai/api/search?q=<what the person wants>"returns the matching use case and the best skills with install commands, as markdown (Russian works too). Full index: https://skills.varg.ai/llms.txt. Every page has a markdown twin: add.mdto its path. Before generating anything, show the person the options on the use-case page.
Scenes cut frame-exact to a song: a beat grid, a story, lyrics and graphics on top.
Output: 16:9 or 9:16 · full song · Input: A song and a one-line idea
Skills that make it end to end
Ready templates
- varg Music Video — An AI music video from a song: song map with beats and word timings, a beat-grid storyboard, Seedance scenes with QA, a frame-exact cut on the song, lyrics and graphics in HyperFrames. · install:
git clone https://github.com/vargHQ/code2video-templates && python3 code2video-templates/varg-music-video/scripts/songmap.py song.mp3 --lyrics lyrics.txt --out songmap.json
Recipe, beat by beat
Each beat lists components that build it; install any with its command, then fill its slots.
Song map (Hooks & utilities, Beat sync)
- Canvas Presentation — The html-in-canvas scaffolding the canvas transitions and scene filters share: support detection, a full-screen WebGL2 shader fed either bot ·
npx shadcn@latest add @remocn/canvas-presentation - Caption Core — The timing engine every caption style shares: pages a timed transcript, finds the word being spoken and how far into it the voice is, and de ·
npx shadcn@latest add @remocn/caption-core - Icons Core — Shared animation contract, pure frame-to-phase timeline, and SVG path-draw helpers for remocn icons. ·
npx shadcn@latest add @remocn/icons-core - Anime Triple Split — Three live video panels slam onto screentone paper one per beat — ink borders, slanted gutters, an impact flash and a katakana SFX stamp — t ·
git clone https://github.com/vargHQ/code2video-templates && cd code2video-templates/anime-triple-split && bash make.command - varg Music Video — An AI music video from a song: song map with beats and word timings, a beat-grid storyboard, Seedance scenes with QA, a frame-exact cut on t ·
git clone https://github.com/vargHQ/code2video-templates && python3 code2video-templates/varg-music-video/scripts/songmap.py song.mp3 --lyrics lyrics.txt --out songmap.json - Beat Accent — A single music-hit sting: impact flash, micro scale-pulse on the subject, immediate decay. ·
npx hyperframes add beat-accent
Scenes (Transitions, Camera moves)
- Anime Triple Split — Three live video panels slam onto screentone paper one per beat — ink borders, slanted gutters, an impact flash and a katakana SFX stamp — t ·
git clone https://github.com/vargHQ/code2video-templates && cd code2video-templates/anime-triple-split && bash make.command - varg Music Video — An AI music video from a song: song map with beats and word timings, a beat-grid storyboard, Seedance scenes with QA, a frame-exact cut on t ·
git clone https://github.com/vargHQ/code2video-templates && python3 code2video-templates/varg-music-video/scripts/songmap.py song.mp3 --lyrics lyrics.txt --out songmap.json - Avatar Group Hover — A distance-falloff avatar group lift with bouncy hover return ·
npx hyperframes add avatar-group-hover - varg Previz — A three.js grey-box previz of every shot on the timeline — auto cameras from storyboard words, a posable mannequin — then one Seedance 2.5 v ·
git clone https://github.com/vargHQ/code2video-templates && python3 code2video-templates/varg-previz/scripts/new_previz.py my-previz - Camcorder HUD — Responsive REC, battery, editable date placeholder, and timeline-driven counter overlay for creator-camera and camcorder treatments ·
npx hyperframes add camcorder-hud - Dolly Zoom (Vertigo Shot) — Camera tracks toward or away from the subject while the field of view changes the opposite way, so the subject holds its frame size while th ·
npx hyperframes add camera-dolly-zoom
Lyrics (Captions & subtitles, Kinetic type)
- Anime JP Subtitles — Japanese captions in four anime styles from one subs.json: fansub lines with a karaoke sweep, TV telop with popping letters, a vertical tate ·
git clone https://github.com/vargHQ/code2video-templates && cd code2video-templates/anime-jp-subtitles && bash make.command - varg Music Video — An AI music video from a song: song map with beats and word timings, a beat-grid storyboard, Seedance scenes with QA, a frame-exact cut on t ·
git clone https://github.com/vargHQ/code2video-templates && python3 code2video-templates/varg-music-video/scripts/songmap.py song.mp3 --lyrics lyrics.txt --out songmap.json - Blend Difference — Auto-inverting text using mix-blend-mode: difference — flips between white and black per-pixel against the background ·
npx hyperframes add caption-blend-difference - Liquid Thorn Logo — Any word as a black-metal chrome logo that a cursor smears with a WebGL fluid. ·
git clone https://github.com/vargHQ/code2video-templates && cd code2video-templates/liquid-thorn-logo && bun render.ts --text "WORD" - Apple Money Count — Apple-style finance counter that counts from $0 to $10,000, flashes green, and bursts money icons with sound. ·
npx hyperframes add apple-money-count
Graphics (Textures & overlays, Filters & grades)
- ASCII Render Pass — A slotted scene renders as live ASCII: a canvas samples the source's luminance grid (rasterized once at mount) and draws glyphs from a densi ·
npx hyperframes add ascii-render-pass - Camcorder HUD — Responsive REC, battery, editable date placeholder, and timeline-driven counter overlay for creator-camera and camcorder treatments ·
npx hyperframes add camcorder-hud - Glitch RGB — RGB chromatic aberration with CRT scanline overlay ·
npx hyperframes add caption-glitch-rgb - Blur In — An Operator Black word-level content reveal that resolves its own text from controlled blur ·
npx hyperframes add blur-in - Blur Out Up — Words arrive clean and depart upward with increasing blur for airy exits. ·
npx hyperframes add blur-out-up
Across the whole video: Beat sync
Generated footage, voice and music
Code renders the layout for free. Anything generated — AI shots, voiceover, music, lip-sync — runs on varg with one key: npx skills add vargHQ/skills --skill varg-ai, the Claude Code plugin claude plugin marketplace add vargHQ/skills && claude plugin install varg@varg, or the MCP https://mcp.varg.ai/mcp.