Arcee AI introduces SuperNova, a 70 billion parameter large language model designed for enterprise deployment, aimed at providing a powerful, owned, data-privacy-focused, stable, and customizable AI solution. SuperNova utilizes Meta's Llama-3.1-70B-Instruct architecture and features advanced instruction-following capabilities through an innovative post-training process. It supports full customization for enterprises and allows deployment in their own cloud environments, ensuring data security.

Nvidia's research team has successfully launched Llama-3.1-Minitron4B using model pruning and distillation techniques. This is a compressed version of the Llama3 model, aimed at implementing artificial intelligence on devices. The model reduces the parameter count of the original 8B model through deep and width pruning techniques while maintaining performance close to larger models. Despite a significant reduction in training data (by 40 times), the model achieved a 16% performance improvement on the MMLU benchmark.

aiOS is the world's first decentralized AI network developed by the "hyperspaceai" organization, based on the Mistral7B model. It aims to fundamentally change the accessibility of artificial intelligence, allowing users to experience cutting-edge decentralized AI computing. Currently, the application is in its early development stage and is available for download and experience by Windows, Linux, and macOS users. It already supports Llama-3, offering users a free trial.According to the official

Meta has released two 24K H100 GPU clusters for training Llama-3. Llama-3 utilizes RoCEv2 networking and Tectonic/Hammerspace's NFS/FUSE network storage. It is expected that Llama-3 will go live by the end of April or mid-May, possibly as a multimodal model and will continue to be open-sourced. Meta plans to have 600,000 H100 computing power by the end of 2024.

Ant Group has released the 4bits quantized version of CodeFuse-CodeLlama-34B. The quantized model can be loaded on a single A10 or RTX4090. The quantized model achieves a performance of 73.8% on the Humaneval pass@1 metric. CodeFuse is Ant's self-developed large model for code generation, aimed at enhancing developers' efficiency by providing intelligent suggestions and real-time support.