Drive Edge AI Innovation with NVIDIA Jetson Orin

Jetson Orin Nano Super

NVIDIA has unveiled the Jetson Orin Nano Super Developer Kit, a significant upgrade to their Jetson Orin Nano line of compact AI computers. This new "Super" version offers substantial performance improvements and a more attractive price point, making it an appealing option for developers, hobbyists, and students interested in edge AI and robotics applications.

## Key Features and Improvements

- **Performance Boost**: The Jetson Orin Nano Super delivers up to 1.7x higher generative AI performance compared to its predecessor.

- **AI Processing Power**: It now offers 67 INT8 TOPS (Tera Operations Per Second), a 70% increase from the previous 40 TOPS.

- **Memory Bandwidth**: The memory bandwidth has been increased by 50%, now reaching 102 GB/s.

- **GPU and CPU Upgrades**: The GPU clock speed has been pushed to 1,020 MHz (from 625 MHz), while the CPU clock speed has been increased to 1.7 GHz (from 1.5 GHz)

- **Price Reduction**: The Developer Kit is now priced at $249, down from the previous $499.

## Hardware Specifications

The Jetson Orin Nano Super Developer Kit includes:

- GPU: NVIDIA Ampere architecture with 1,024 CUDA cores and 32 Tensor cores
- CPU: 6-core Arm Cortex-A78AE v8.2 64-bit
- Memory: 8GB 128-bit LPDDR5
- Power Consumption: 25W (new power mode, up from 15W)

## Software and Ecosystem

The performance improvements are achieved through a software update, which means existing Jetson Orin Nano and Orin NX module owners can also benefit from these enhancements. The Jetson platform supports popular ML frameworks and optimized inferencing infrastructure, including HuggingFace Transformers, Ollama, llama.cpp, vLLM, MLC, and NVIDIA TensorRT-LLM.

## Applications

The Jetson Orin Nano Super is well-suited for various AI applications, including:

- Creating LLM chatbots based on retrieval-augmented generation
- Building visual AI agents
- Deploying AI-based robots
- Running a wide range of LLMs, VLMs, and Vision Transformers (ViTs).

## Availability

The Jetson Orin Nano Super Developer Kit is available for purchase now, with some retailers like Seeed Studio accepting orders for shipment starting January 1, 2025.

This upgrade represents a significant step forward in making powerful edge AI computing more accessible and affordable, potentially accelerating innovation in fields such as robotics, computer vision, and generative AI applications.