Nvidia Jetson
Nvidia Jetson is a series of embedded computing boards from Nvidia. The Jetson TK1, TX1 and TX2 models all carry a Tegra processor (or SoC) from Nvidia that integrates an ARM architecture central processing unit (CPU). Jetson is a low-power system and is designed for accelerating machine learning applications.
Hardware
The Jetson family includes the following boards:
- In late April 2014, Nvidia shipped the Nvidia Jetson TK1 development board containing a Tegra K1 SoC in the T124 variant and running Ubuntu Linux.[1]
- The Nvidia Jetson TX1 development board bears a Tegra X1 of model T210.[2]
- The Nvidia Jetson TX2 board bears a Tegra X2 of microarchitecture GP10B[3] (SoC type T186 or very similar). This board and the associated development platform was announced in March 2017 as a compact card design for low power scenarios, e.g. for the use in smaller camera drones. A matrix describing a set of performance modes was provided by the media along with that.[4] Further a TX2i variant, said to be rugged and suitable for industrial use cases, is mentioned.[5]
- The Nvidia Jetson Xavier was announced as a development kit in end of August 2018. Indications were given that a 20x acceleration for certain application cases compared to predecessor devices should be expected, and that the application power efficiency is 10x improved. Nvidia Jetson Xavier NX has a 6-core Nvidia Carmel ARMv8.2.
- The Nvidia Jetson AGX Xavier is the 8-core version on the same core architecture (Carmel Armv8.2).[6]
- The Nvidia Jetson Nano was announced as a development system in mid-March 2019[7] The intended market is for hobbyist robotics due to the low price point.[8][9] The final specs expose the board being sort of a power-optimized, stripped-down version of what a full Tegra X1 system would mean. Only half of the CPU (only 4x A57 @ 1.43 GHz) and GPU (128 cores of Maxwell generation @ 921 MHz) cores are present and only half of the maximum possible RAM is attached (4 GB LPDDR4 @ 64 bit + 1.6 GHz = 25.6 GB/s) whilst the available or usable interfacing is determined by the baseboard design and is further subject of implementation decisions and specifics in an end user specific design for an application case.[10]
- The Nvidia Jetson Nano Developer Kit is an AI computer for makers, learners, and developers that brings the power of modern artificial intelligence to a low-power, easy-to-use platform, to start quickly with out-of-the-box support for many popular peripherals, add-ons, and ready-to-use projects.[11][12]
- In September 2022 Nvidia announced the Jetson Orin Nano.[13][14] The modules have the same 260-pin SO-DIMM connector and 69.6 mm x 45 mm dimensions, and come in two variants. The 4 GB variant provides 20 Sparse or 10 Dense TOPs, using a 512-core Ampere GPU with 16 Tensor cores, while the 8 GB variant doubles those numbers to 40/20 TOPs, a 1024-core GPU and 16 Tensor cores. Both have 6 Arm Cortex-A78AE cores. The 4 GB module starts at $199 and the 8 GB variant for $299, when purchasing 1000 units.
Performance
The published performance modes of the Nvidia Jetson TX2 are as follows.
Mode | Max Clocks (Denver 2 + A57) | Max-P (Denver 2 + A57) | Max-P (only Denver 2) | Max-P (only A57) | Max-Q (only A57) |
---|---|---|---|---|---|
GPU Clock (MHz) | 1302 | 1122 | 854 | ||
Denver 2 Clock (MHz) | 2000 | 1400 | 2000 | stopped | stopped |
Cortex-A57 (MHz) | 2000+ | 1400 | stopped | 2000 | 1200 |
TDP / W | might vary | 15 | 15 | 15 | 7.5 |
Jetson TX2 also has 5 power modes, numbered 0 through 4 as published by NVIDIA.[15] The default mode is mode 3 (MAX-P).
Property | MAX-N
(Mode 0) |
MAX-Q
(Mode 1) |
MAX-P
(Mode 2) |
MAX-P*
(Mode 3) |
MAX-P
(Mode 4) |
---|---|---|---|---|---|
Power budget | N/A | 7.5W | 15W | 15W | 15W |
Online A57 CPU | 4 | 4 | 4 | 4 | 1 |
Online D15 CPU | 2 | 0 | 2 | 0 | 1 |
A57 CPU max freq (MHz) | 2000 | 1200 | 1400 | 2000 | 345 |
D15 CPU max freq (MHz) | 2000 | N/A | 1400 | N/A | 2000 |
GPU max freq (MHz) | 1300 | 850 | 1122 | 1122 | 1122 |
Memory max freq (MHz) | 1866 | 1331 | 1600 | 1600 | 1600 |
The published operation modes of the Nvidia Jetson Nano are:
Mode | 0 | 1 |
---|---|---|
GPU Clock (MHz) | 921 | 640 |
Cortex-A57 (MHz) | 4x 1428 | 2x 918 2x stopped |
TDP / W | 10 | 5 |
Versions
There are various versions of the Jetson board available. Some of them are:
Year | Version | Performance | GPU | CPU | Memory | Power |
---|---|---|---|---|---|---|
2017 | Jetson TX2 [16] | 1.33 TFLOPS | 256-core Nvidia Pascal architecture GPU | Dual-core Nvidia Denver 2 64-bit CPU and quad-core ARM Cortex-A57 MPCore processor | 8 GiB | 7.5–15 W |
2020 | Jetson Xavier NX | 21 TOPS | 384-core Nvidia Volta architecture GPU with 48 Tensor cores | 6-core Nvidia Carmel ARMv8.2 64-bit CPU 6MB L2 + 4MB L3 | 8 GiB | 10–20W |
2018 | Jetson Xavier AGX [17] | 32 TOPS | 512-core Nvidia Volta architecture GPU with 64 Tensor cores | 8-core NVIDIA Carmel ARMv8.2 64-bit CPU 8MB L2 + 4MB L3 | 32-64 GiB | 10W - 30W |
2019 | Jetson Nano | 472 GFLOPS | 128-core Nvidia Maxwell architecture GPU | Quad-core ARM Cortex-A57 MPCore processor | 4 GiB | 5–10 W |
2023 | Jetson Orin Nano [18] | 20–40 TOPS | from 512-core Nvidia Ampere architecture GPU with 16 Tensor cores | 6-core ARM Cortex-A78AE v8.2 64-bit CPU 1.5MB L2 + 4MB L3 | 4-8 GiB | 7–10 W |
2023 | Jetson Orin NX | 70–100 TOPS | 1024-core Nvidia Ampere architecture GPU with 32 Tensor cores | up to 8-core ARM Cortex-A78AE v8.2 64-bit CPU 2MB L2 + 4MB L3 | 8–16 GiB | 10–25 W |
2023 | Jetson Orin AGX | 200-275 TOPS | up to 2048-core Nvidia Ampere architecture GPU with 64 Tensor cores | up to 12-core ARM Cortex-A78AE v8.2 64-bit CPU 3MB L2 + 6MB L3 | 32–64 GiB | 15–60 W |
Software
Various operating systems and software might be able to run on the Jetson board series.
Linux
JetPack is a software development kit (SDK) from Nvidia for their Jetson board series. It includes the Linux for Tegra (L4T) operating system and other tools. The official Nvidia download page bears an entry for JetPack 3.2 (uploaded there on 2018-03-08) that states:
JetPack 3.2 adds support for the Linux for Tegra r28.2 image for the Jetson OS. It is packaged with newer versions of Tegra System Profiler, TensorRT, and cuDNN from the last release.[19]
RedHawk Linux is a high-performance RTOS available for the Jetson platform, along with associated NightStar real-time development tools, CUDA/GPU enhancements, and a framework for hardware-in-the-loop and man-in-the-loop simulations.[20]
QNX
The QNX operating system also available for the Jetson platform, though it is not widely announced. There are success reports of installing and running specific QNX packages on certain Nvidia Jetson board variants. Namely the package qnx-V3Q-23.16.01 that is seemingly in parts based on Nvidia's Vibrante Linux distribution is reported to run on the Jetson TK1 Pro board.[21]
References
- Michael Larabel (29 April 2014). "NVIDIA's Tegra TK1 Jetson Board Is Now Shipping". Phoronix.
- "Embedded Systems Development Solutions from NVIDIA Jetson". NVIDIA. 2015-03-18. Retrieved 2016-07-10.
- NVIDIA Rolls Out Tegra X2 GPU Support In Nouveau by Michael Larabel at phoronix.com on March 29, 2017
- NVIDIA Announces Jetson TX2: Parker Comes To NVIDIA’s Embedded System Kit, March 7, 2017
- "NVIDIA Jetson TX2i Module for Industrial Environments". NVIDIA Developer Forums. March 9, 2018.
- "Jetson AGX Xavier Developer Kit". NVIDIA Developer. July 9, 2018.
- "NVIDIA Jetson Nano For Edge AI Applications and Education". NVIDIA.
- "Nvidia Jetson Nano – $99 of CUDA X Awesomeness". March 18, 2019.
- "Hands-On: New Nvidia Jetson Nano Is More Power In A Smaller Form Factor". March 18, 2019.
- NVIDIA Introduces $99 Jetson Nano Developer Kit by Jean-Luc Aufranc on March 19, 2019 on CNXSoft
- Links to Jetson Nano Resources & Wiki
- Nvidia Jetson Developer Kit User Guide
- "Solving Entry-Level Edge AI Challenges with NVIDIA Jetson Orin Nano". NVIDIA Technical Blog. 2022-09-21. Retrieved 2022-10-27.
- Robinson, Cliff (2022-09-22). "NVIDIA Jetson Orin Nano Launched Cheaper Arm and Ampere". ServeTheHome. Retrieved 2022-10-27.
- "Tegra Linux Driver (See under "NVPModel Clock Configuration for Jetson TX2 and TX2 4GB")". docs.nvidia.com. Retrieved 2021-07-25.
- NVIDIA (18 April 2023). "Jetson TX2 Module". Nvidia.
- NVIDIA (18 April 2023). "Jetson AGX Xavier Series". Nvidia.
- NVIDIA (27 March 2023). "Jetson Orin Modules and Developer Kits". Nvidia.
- "Jetson Download Center". NVIDIA Developer. November 3, 2015.
- "Concurrent products for the NVIDIA Jetson". Concurrent Real-Time Linux RTOS Solutions.
- "Running QNX onto Jetson TK1 Pro (1860)". NVIDIA Developer Forums. June 6, 2016.