Lyric video with an AI agent — skills, options and steps

For AI agents: find the right skill in one call — curl -s "https://skills.varg.ai/api/search?q=<what the person wants>" returns the matching use case and the best skills with install commands, as markdown (Russian works too). Full index: https://skills.varg.ai/llms.txt. Every page has a markdown twin: add .md to its path. Before generating anything, show the person the options on the use-case page.

Lyrics synced to the song: the sung line big and highlighted, karaoke-style, over art or a shader.

Output: Full song, 9:16 or 16:9 MP4

Recommended route

Best skills for this

  1. HyperFrames (hyperframes, HeyGen, live) — Start here: Word-timed lyric videos rendered from HTML
    • Claude Code: claude plugin marketplace add heygen-com/hyperframes && claude plugin install hyperframes@hyperframes
    • Codex: npx skills add heygen-com/hyperframes --skill hyperframes -a codex
    • Cursor: npx skills add heygen-com/hyperframes --skill hyperframes -a cursor
    • Gemini CLI: npx skills add heygen-com/hyperframes --skill hyperframes -a gemini-cli
    • Details: https://skills.varg.ai/skills/hyperframes.md · Example: https://skills.varg.ai/previews/hyperframes.mp4
  2. Kinetic Typography (iart-kinetic-typography, iart.ai, live) — Alternative: Kinetic type: word and line reveals
  3. Remotion Captions (remotion-captions, Remotion, live) — Alternative: Word-timed captions in Remotion
  4. Music Video Director (varg-music-video, varg, beta) — Alternative: When the lyric video should also have generated shots
    • Claude Code: claude plugin marketplace add vargHQ/skills && claude plugin install varg@varg
    • Codex: npx skills add vargHQ/skills --skill varg-music-video -a codex -y
    • Cursor: npx skills add vargHQ/skills --skill varg-music-video -a cursor -y
    • Gemini CLI: npx skills add vargHQ/skills --skill varg-music-video -a gemini-cli -y
    • OpenClaw: npx clawhub@latest install varg-music-video
    • Details: https://skills.varg.ai/skills/varg-music-video.md
  5. ElevenLabs Speech to Text (elevenlabs-speech-to-text, ElevenLabs, live) — Adds: Word timings from the vocal track · Needs: ElevenLabs API key (ELEVENLABS_API_KEY)
    • Claude Code: npx skills add elevenlabs/skills --skill speech-to-text -a claude-code
    • Codex: npx skills add elevenlabs/skills --skill speech-to-text -a codex
    • Cursor: npx skills add elevenlabs/skills --skill speech-to-text -a cursor
    • Gemini CLI: npx skills add elevenlabs/skills --skill speech-to-text -a gemini-cli
    • OpenClaw: npx skills add elevenlabs/skills --skill speech-to-text -a openclaw
    • Details: https://skills.varg.ai/skills/elevenlabs-speech-to-text.md
  6. varg AI (varg-ai, varg, live) — Adds: Word timings from the vocal (transcription), and generated backgrounds, on one key

Ask the person first

Put these choices in front of the person before spending anything. Paste the example link next to each option: people pick a look by seeing it.

Look?

Background?

Steps

  1. Get word timings (transcribe the vocal or align lyrics)
  2. Pick the look
  3. Render

Set up varg

varg is one API key for the models these skills drive — Seedance 2.5, Kling 4, Veo 3.1, Wan 3, Nano Banana 2.1, GPT Image 2.5, ElevenLabs v4 and 200+ more — billed in credits, with a cost estimate before anything runs.

Related