The 8GB shared RAM are all there is for OS + models, so the current Jetson AGX Orin 64GB is still more interesting as it allows to run a small LLM plus ASR and TTS on one device, yet with a price tag above 2000€ and also with an Ampere GPU but at 275 TOPS.
But for vision / robotics stuff this Nano Super is a great price.
You can search for "View Jetson Orin Technical Specifications" on the Jetson Orin page [0] to see the full offering of devices (it's in the middle of the page).
I've been looking for a replacement for Google Assistant/Nest/Nest Mini that is cloudless and could support things like verbally setting alarms, inquiring about the weather, and random queries.
This looks like a decent fit. Just needs a case, microphone, and speaker. Oh an one of the newer small LLMs that fit in under 8GB.
Even with the lower price point it's still a bit of an odd fit. The dev kit is aimed at developers but costs about the same as a 3060 (which will blow it out of the water on AI performance and capacity). Unless this board was already the one you were targeting for non-development usage for your robotics/embedded edge use case then I'm not sure there is a compelling reason to be interested in the announcement.
Edit: I didn't mean to imply it's a bad use case or product, just that it's not a use case 95% here are going to care about. It's an odd fit but if you're the target of that fit it's great. If you're not that odd fit target, don't get your hopes up about a low cost AI dev kit from Nvidia. It'll just be another SBC sitting unused in your drawer.
In the world of embedded compute modules, "developer kit" isn't the equivalent of a "developer workstation" with super-high specs.
Instead, it means "We sell this module for use on PCBs, but you want to start developing software and testing before you've made your first PCB. Here's the module plugged into a PCB that provides USB, HDMI and Ethernet connectors. We'll also throw in a power supply and an SD card with a working OS image on it."
I agree 100%, edited with clarification to cause less confusion since most seemed to take it I was saying the opposite. Thanks for the clear description of what I failed to describe.
Depends what you're doing with it. You can just glue this dev board in to your hobby system, or if you're making an interactive kiosk, maybe you want a usb webcam & hdmi screen. If you want to debug, those ports can be pretty handy, you can have a monitor and keyboard on it. If you do your own pcb integration, you can decide what ports you want on your board.
If you want to connect a screen, keyboard and mouse? Or plug in a wifi dongle? Absolutely!
And by the point you don't need them, you can graduate from the dev kit and spin your own PCB without them on, if you like.
The development kit will probably break out other signals too - but if you know what SPI and CSI are, you probably don't need to be told what an embedded dev kit is :)
Some people have different views on what’s an embedded system, but hardware serial, USB and Ethernet are tablestakes for interfacing with any most industrial hardware or for robotics uses.
Kinda agree with the other replies to you, the edge case you carved out is the target use case, this is not meant to compete against the 3060, it's meant to be put on robots or other embedded use cases (even as a devkit). 3060 has more juice but it draws 170w vs 25w for the Orin nano (with 15w and 7w modes), and is much smaller.
This is what I mean by "unless this board was already the one you were targeting for non-development usage for your robotics/embedded edge use case". If you're planning on using this board already then sure, you want this dev board update. If you're not that use case of that niche then this announcement will probably not be worth looking in to.
I meant to highlight, though apparently did poorly, 95% of people here will fall into (b) as it's not aimed at being the general use AI dev kit they'd want it to be. Unfortunately that seems to have been taken as "the product is useless to those building embedded systems because you can buy a 3060" due to my unclear wording.
It appears to be the same hardware as before, even the same firwmare/software as before (JetPack 6.1 was already out), just now they've lowered the dev kit price and documented a new performance mode which increases the clocks, power consumption, thermals, and compute performance.
The specs on this look identical to the Orin Nano 8GB. Elsewhere Nvidia says the software updates are available to all Orin owners [1], so is this just a special edition released alongside the new JetPack release?
Any guesses on using this for LLM inference how it compares performance-wise (like tokens/sec ultimately) to like the new mac mini m4pro? I'm not sure how to figure that out.
I appreciated this release including the personal video from the CEO with an oven joke. Although the VRAM is very limited, these specifications compete with Raspberry Pi's platform and I would expect the Orin Nano Super to outperform.
What OSes can be run on this? I've seen people using Ubuntu and Debian but sounds like bascially anything that has an ARM64 version? What about BSD (ignoring CUDA)?
The price is interesting. What I don't like about these devices is that they are supported for a few years and after you are on your on. I have the original Jetson Nano and they stopped providing any updates for it, if you can use it without an internet connection it will work just fine for years.
Yup and trying to hack your OG jetson Nano to a later linux is very hard due to proprietary linux / nvidia firmware/drivers. Its not a matter of your are on your own for OS upgrades, it straight up wont even be able to use the GPU for cuda. Pretty annoying.
Apparently they differentiate between their regular modules and the dev kits: The Jetson Nano you mentioned is supported until 2027, but their dev kit is EOL.
For the Jetson Orin Nano the module is supported until 2032, but the dev kit likely not.
I think the latest Orin series supports both UEFI and there is "Bring Your Own Kernel" support for more recent releases[1], but you still need to apply the patches. Also, the Tegra GPU driver "nvgpu" has been open source in this form for quite some time in the Linux4Tegra tree, but I don't see it in the patch list. So, it's still a bit of a mixed bag, I think. But UEFI and 6.x kernel support is at least an improvement...
50% of the performance increase seems to come from the memory bandwidth increase and the other 20% from the extra 10 Watts to boost clocks with (15W -> 25W).
Not really comparable, Apple Silicon is not an embeddable device as the Jetson series is meant to be. And the Jetson will never replace an Apple laptop or even a MacMini for regular users.
So everyone can play around and develop for it. That's how you get to software dominance, and then can reap the rewards.
reply