Sea AI Lab

PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)

C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Understanding R1-Zero-Like Training: A Critical Perspective

MetaFormer Baselines for Vision (TPAMI 2024)

CVPR'24, Official Codebase of our Paper: "Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generation".

? OAT: A research-friendly framework for LLM online alignment, including preference learning, reinforcement learning, etc.

[EMNLP-2024] ?? Sailor: Open Language Models for South-East Asia

Automatic Functional Differentiation in JAX

[ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)