Yesterday's Top Poster

Wan models on AI Gateway

  • Thread starter Thread starter Walter Korman , Jeremy Philemon, Matt Lenhard
  • Start date Start date
Generate stylized videos and transform existing footage with Alibaba's Wan models, now available through AI Gateway. Try them out now via AI SDK V6 or by selecting the models in the AI Gateway playground.

Wan produces artistic videos with smooth motion and can use existing content to keep videos consistent:


  • Character Reference (R2V): Extract character appearance and voice from reference videos/images to generate new scenes


  • Flash Variants: Faster generation times for quick iterations


  • Flexible Resolutions: Support for 480p, 720p, and 1080p output

Two ways to get started​


Video generation is in beta and currently available for Pro and Enterprise plans and paid AI Gateway users.


  • AI SDK V6: Generate videos programmatically AI SDK V6's generateVideo.

  • Gateway Playground: Experiment with video models with no code in the configurable AI Gateway playground that's embedded in each model page. Compare providers, tweak prompts, and download results without writing code. To access, click any video gen model in the model list.

Available Models​


Model

Type

Description

alibaba/wan-v2.6-t2v

Text-to-Video

Generate videos from text prompts

alibaba/wan-v2.6-i2v

Image-to-Video

Animate still images

alibaba/wan-v2.6-i2v-flash

Image-to-Video

Fast image animation

alibaba/wan-v2.6-r2v

Reference-to-Video

Character transfer from references

alibaba/wan-v2.6-r2v-flash

Reference-to-Video

Fast style transfer

alibaba/wan-v2.5-t2v-preview

Text-to-Video

Previous version

Simple: Text-to-Video with Audio​


Generate a stylized video from a text description.

You can use detailed prompts and specify styles with the Wan models to achieve the desired output generation. The example here uses alibaba/wan-v2.6-t2v:

Advanced: Reference-to-Video​


Generate new scenes using characters extracted from reference images or videos.

In this example, 2 reference images of dogs are used to generate the final video.

Using alibaba/wan-v2.6-r2v-flash here, you can instruct the model to utilize the people/characters within the prompt. Wan suggests using character1, character2, etc. in the prompt for multi-reference to video to get the best results.

Learn More​


For more examples and detailed configuration options for Wan models, check out the Video Generation Documentation. You can also find simple getting started scripts with the Video Generation Quick Start.

Read more

Continue reading...
 
Back
Top