DreamX-Creator 1.0 generates synchronized audio and 2K video

DreamX-Creator 1.0 generates audio and video jointly from a first frame and a text prompt. The Apache 2.0 release describes a 7B generator, gated cross-modal attention, progressive joint training, audio-video reinforcement learning, and autoregressive one-step 2K refinement.

Visit original source