AIbase
Product LibraryTool Navigation

mlx-omni-server

Public

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.

Creat2024-11-05T19:52:00
Update2025-03-26T12:26:02
299
Stars
0
Stars Increase

Related projects