![]() ![]() Still, a doubling of performance in one generation is impressive. The other benchmarks yielded at or below two-fold improvements. The 450% boost came on a single benchmark there were a total of six benchmarks run. The AGX Orin is a serious machine.Nvidia's performance leap comes with a caveat, however. When doing the video, I was gobsmacked by the natural language translation while running another serious deep learning model at the same time. Access may require registration to access some of the documentation, but don’t worry. ![]() The documents are available from the Jetson Download Center. Also, the mechanical and support files are freely available. NVIDIA provides several thousand pages of documentation for the Jetson AGX Orin and the developer kit. This includes Arrow, Seeed Studio and Silicon Highway. The Developer Kit is available now through participating outlets. The Deep Learning Accelerator (DLA) is faster than that on the Xaviers. For the GPU, the AGX Orin has 4X the number of cores as the AGX Xavier, so it’s reasonable to expect a 3-10X bump depending. However, you can expect a 1.5-2X boost for the CPU. Of course, all of this is highly variable based on your application. Jetson AGX Orin delivers a 3-6X performance gain over Jetson AGX Xavier. Here’s a comparison of the Jetson AGX Xavier with the Jetson AGX Orin: Performance on Vision AI and Conversational AI Models Courtesy NVIDIA NVIDIA provides Deep Learning benchmark tests for comparing performance of different devices. The wire controls the fan on the heat sink: Module Right, Carrier Board Left Jetson Module Heat Sink Module Left, Carrier Board Right Benchmarks Be careful, as the module is attached to the carrier board with a small wire. By gently rocking the Jetson Module, we can detach the module from the carrier board. The Jetson AGX Module connects to the carrier board with a 699 pin connector. You can see the stack top to bottom, with the carrier board (on a plastic stand), Jetson AGX Orin module, and heat sink with fan: Dev Kit, Cover Removed Dev Kit, Cover Removed, Opposite side Removing the screws, we can take off the case cover to expose the Jetson AGX Orin module. The screws are easily accessible on the underside of the Developer Kit. There are 4 screws that hold the Developer Kit together. Let’s take a look at what’s inside after removing the case cover. Be careful when removing the cover as the antennas are connected to a WiFi card on the carrier board: Secret! PCIe connector, antennas Removing the cover exposes a PCIe connector. This marks a cover held on to the Developer Kit with magnets. I modified mine to fix that by adding googly eyes. One side holds a secret! From the factory, the Jetson AGX Orin is beautiful. Here are the four different different sides, which hold the headers and jacks mentioned above: People connect their peripherals to connectors on the sides of the Developer Kit, which connect to the carrier board. The carrier board provides access to the input and output capabilities of the kit, along with supplying the module with power. NVIDIA makes the design for the Jetson AGX Developer Kit Carrier Board freely available. The second part of the Developer Kit is the carrier board. Jetson AGX Orin Developer Kit Carrier Board For many developers, they will replace this particular thermal solution to meet requirements in their own designs. The heat sink/fan is referred to as a thermal solution. On the Developer Kit, attached to the Jetson AGX Orin module is a heat sink with integrated fan. This assembly is in a metal case which also thermally connects to the SoC: Jetson AGX Orin SoC Jetson AGX Orin Carrier Board Jetson AGX Orin Module The SoC attaches to a PCB which hold the main memory and eMMC, along with support circuitry and a 699 pin interface connector. The SoC is the brains of the Jetson and contains all the compute elements. The first is the Jetson Orin System On a Chip ( SoC). ![]() The AGX Orin Module consists of three main parts. The second part is a carrier board which provides input/output, memory and electrical connections to the module. The first is the Jetson AGX Orin Module, which is a compute module. You can think of the Jetson AGX Orin Developer Kit as two parts. Specsīefore we get much further, the price at introduction is $1999 USD. There is also a group of frameworks which leverage these new under pinnings we will talk about in upcoming articles. Latest compute stack with latest versions of CUDA 11 and TensorRT 8.The software upgrades will run on both the Orin series and the Xavier series of Jetsons. The software side is another major upgrade which we will soon be covering. ![]() We’ll cover mostly the AGX Orin hardware in this article. Here, we’ll cover some of the highlights, just to wet our appetite for upcoming development. The Jetson AGX Orin is the next evolution of the the Jetson product line. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |