Popular GitHub Repositories for Speech Language Model

A Survey of Spoken Dialogue Models (60 pages)

SlamKit is an open source tool kit for efficient training of SpeechLMs. It was used for "Slamming: Training a Speech Language Model on One GPU in a Day"

AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model

Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications

Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"

Speech Resynthesis and Language Modeling with Flow Matching and Llama

[CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts

一个完全开源的，类似于GPT-4o的语音到语音视频理解模型的实现。