Search AI Products and News

Skywork AI's research team recently unveiled SkyReels-A2, a groundbreaking video generation framework pushing the boundaries of controllable video synthesis. This Element-to-Video (E2V) framework generates natural videos from text prompts by composing diverse visual elements (characters, objects, backgrounds), maintaining high fidelity to reference images. SkyReels-A2's core lies in its sophisticated data processing pipeline. The research team designed a comprehensive data construction pipeline.

Byte's large model BuboGPT supports fine-grained multimodal joint understanding of text, images, and audio. By introducing a visual localization method, BuboGPT can accurately locate objects in images. Researchers have utilized a multimodal instruction tuning training scheme, achieving good results on multimodal tasks.