AIOS: The First Decentralized AI Network Powered by Mistral7B Model, Supporting Llama-3

AIbase

Published inAI News · 2 min read · Jul 10, 2024

aiOS is the world's first decentralized AI network developed by the "hyperspaceai" organization, based on the Mistral7B model. It aims to fundamentally change the accessibility of artificial intelligence, allowing users to experience cutting-edge decentralized AI computing. Currently, the application is in its early development stage and is available for download and experience by Windows, Linux, and macOS users. It already supports Llama-3, offering users a free trial.

According to the official statement, there are currently over 5000+ nodes, and a service to earn points will be launched in the near future. Users can download and experience it officially through:

https://aios.network/

Peking University Team Releases Multimodal Model LLaVA-o1, Inference Capabilities Comparable to GPT-o1!

Recently, research teams from Peking University announced the release of an open-source multimodal model called LLaVA-o1, which is claimed to be the first visual language model capable of spontaneous and systematic reasoning, comparable to GPT-o1. The model excels in six challenging multimodal benchmark tests, with its 11B parameter version outperforming competitors such as Gemini-1.5-pro, GPT-4o-mini, and Llama-3.2-90B-Vision-Instruct.

Aiming to be an OpenAI Alternative! SuperNova: A Customizable, Instruction-Following Large Language Model for Enterprises

Arcee AI introduces SuperNova, a 70 billion parameter large language model designed for enterprise deployment, aimed at providing a powerful, owned, data-privacy-focused, stable, and customizable AI solution. SuperNova utilizes Meta's Llama-3.1-70B-Instruct architecture and features advanced instruction-following capabilities through an innovative post-training process. It supports full customization for enterprises and allows deployment in their own cloud environments, ensuring data security.

Llama3 Compressed Version! Nvidia Releases Small Language Model Llama-3.1-Minitron4B with Only 400 Million Parameters

Nvidia's research team has successfully launched Llama-3.1-Minitron4B using model pruning and distillation techniques. This is a compressed version of the Llama3 model, aimed at implementing artificial intelligence on devices. The model reduces the parameter count of the original 8B model through deep and width pruning techniques while maintaining performance close to larger models. Despite a significant reduction in training data (by 40 times), the model achieved a 16% performance improvement on the MMLU benchmark.

Meta Releases Two 24K H100 GPU Clusters for Llama-3 Training

Meta has released two 24K H100 GPU clusters for training Llama-3. Llama-3 utilizes RoCEv2 networking and Tectonic/Hammerspace's NFS/FUSE network storage. It is expected that Llama-3 will go live by the end of April or mid-May, possibly as a multimodal model and will continue to be open-sourced. Meta plans to have 600,000 H100 computing power by the end of 2024.