What’s different from the typical T2V model:
Accepts 4 input modalities simultaneously: text, images (up to 9), video clips (up to 3, ≤15s total), and audio (up to 3, ≤15s total). Mixed input cap is 12 files.
Reference-driven generation: you can use an image to lock composition/character appearance, a video clip to specify camera movement and motion dynamics, and an audio track to drive rhythm and tempo. Outputs include generated SFX/BGM.
The key claim is “audio-driven video” rather than “video with audio attached” — meaning motion is actually synced to the audio input’s beat structure, not just overlaid.
Supports video continuation/extension with shot-to-shot coherence, and editing operations (character swap, segment insertion/removal) on existing clips.
Output: 4–15s, selectable. Comes with built-in sound.
Why this matters technically:
Most current video models treat audio as a post-processing step. Seedance 2.0 appears to condition the diffusion process on audio features directly, which would explain the beat-sync behavior. The multi-reference @ tagging system (@image1 for composition, @video1 for motion, @audio1 for rhythm) suggests a mixture-of-conditions architecture rather than simple concatenation.
Haven’t seen an official announcement yet. Docs are up on Dreamina (ByteDance’s creative platform). Curious if anyone has more details on the architecture.
If you want to test them after launch, here are a few good platforms depending on your use case:
– For developers (API): https://www.atlascloud.ai/
– For creators: Higgsfield, ImagenArt
More info of the Seedance 2.0: https://www.reddit.com/r/SoraAi/comments/1qxdv5u/seedance_20_teaser_better_than_sora_2_true/
Subreddit of Seedance 2.0 for discussion: https://www.reddit.com/r/Seedance_AI