API docs/workflows/music-to-video

Music to video

Generate a music video synced to a track (upload, YouTube, or Spotify link).

Requiressource.url
media: moving-imagevoice-over: off by defaultmusic: off by defaultcaptions: on by defaultratio: 9:16 by default

Build your request

Only the parameters that apply to music-to-video are shown. Set values on the left, copy the payload on the right.

View as Markdown (for LLMs)
source.prompt

What the video should be about: the AI writes the script. For music-to-video it is an optional creative brief for the visual storyline.

source.urlrequired

The source content URL: audio file, video file, YouTube link, Spotify track, article page, or PDF depending on the workflow. http(s) is enforced; bare domains get https:// prepended.

{
  "workflow": "music-to-video",
  "source": {
    "url": "https://www.youtube.com/watch?v=ip30oRP9BP0"
  }
}
Free, no API key needed.

Good to know

  • The source track is the audio; the music block controls sync (music.syncWith) and visuals (music.soundWave).
  • source.prompt is an optional creative brief for the visual storyline.
  • music.enableLyricsLipSync + music.lipSyncFrequency animate characters singing the lyrics.