NVIDIA recently launched a brand new compact generative AI supercomputer—the Jetson Orin Nano Super Developer Kit. This product not only boasts significant performance improvements but also comes at a drastically reduced price, with the ability to further enhance performance through software upgrades, aiming to enable more people to embrace generative AI.

This new Jetson Orin Nano Super Developer Kit is small enough to fit comfortably in your hand, providing commercial AI developers, enthusiasts, and students with enhanced generative AI capabilities and higher performance. Its price has dropped from $499 to $249, significantly lowering the barrier to entry.

image.png

The kit is officially available today, and compared to the previous generation, its generative AI inference performance has increased by 1.7 times, with INT8 TOPS performance improved by 70%, reaching 67 TOPS, and memory bandwidth enhanced by 50%, reaching 102 GB/s. Whether creating retrieval-augmented LLM chatbots, building visual AI agents, or deploying AI-based robots, the Jetson Orin Nano Super is the ideal choice.

Software Upgrades for Continuous Performance Improvement

Notably, the new software updates for the Jetson Orin Nano Super will also bring generative AI performance enhancements to users who already own the Jetson Orin Nano Developer Kit.

The Jetson Orin Nano Super is suitable for those interested in generative AI, robotics, or computer vision. As the AI landscape shifts from task-specific models to foundational models, it also provides a convenient platform to turn ideas into reality.

image.png

Powerful Performance to Empower Generative AI

The performance boost of the Jetson Orin Nano Super brings significant advantages for all popular generative AI models and transformer-based computer vision applications.

This developer kit includes a Jetson Orin Nano 8GB System on Module (SoM) and a reference carrier board, making it an ideal platform for prototyping edge AI applications.

The SoM features an NVIDIA Ampere architecture GPU and a 6-core Arm CPU with tensor cores, facilitating multiple concurrent AI application pipelines and high-performance inference. It can support up to four cameras, offering higher resolution and frame rates than previous versions.

A Rich Ecosystem and Community for Generative AI Software

Generative AI is rapidly evolving. The NVIDIA Jetson AI Lab provides instant support for cutting-edge models in the open-source community and offers easy-to-follow tutorials. Developers can also receive extensive support from the broader Jetson community and draw inspiration from other developers' projects.

Jetson runs NVIDIA AI software, including NVIDIA Isaac for robotics, NVIDIA Metropolis for visual AI, and NVIDIA Holoscan for sensor processing. Utilizing NVIDIA Omniverse Replicator for synthetic data generation and the NVIDIA TAO Toolkit for fine-tuning pre-trained AI models in the NGC catalog can significantly shorten development time.

Jetson ecosystem partners offer additional AI and system software, developer tools, and custom software development. They can also assist in providing cameras and other sensors, as well as carrier boards and design services for product solutions.

“Super Mode” Enhances Overall Performance of Jetson Orin

This software update not only enhances the generative AI performance of the Jetson Orin Nano Super but also brings the same 1.7 times performance boost to the Jetson Orin NX and Orin Nano series system modules.

In summary, the Jetson Orin Nano Super Developer Kit released by NVIDIA not only significantly lowers the threshold for AI development but also offers developers a broader space for innovation through powerful performance and a comprehensive software ecosystem.

Official introduction: https://blogs.nvidia.com/blog/jetson-generative-ai-supercomputer/