Arcee AI introduces SuperNova, a 70 billion parameter large language model designed for enterprise deployment, aimed at providing a powerful, owned, data-privacy-focused, stable, and customizable AI solution. SuperNova utilizes Meta's Llama-3.1-70B-Instruct architecture and features advanced instruction-following capabilities through an innovative post-training process. It supports full customization for enterprises and allows deployment in their own cloud environments, ensuring data security.

Nvidia's research team has successfully launched Llama-3.1-Minitron4B using model pruning and distillation techniques. This is a compressed version of the Llama3 model, aimed at implementing artificial intelligence on devices. The model reduces the parameter count of the original 8B model through deep and width pruning techniques while maintaining performance close to larger models. Despite a significant reduction in training data (by 40 times), the model achieved a 16% performance improvement on the MMLU benchmark.