Tech

71.01 Nvidia Jetson and Ollama

71.01 Nvidia Jetson and Ollama

How to get up and running an Ollama over a Nvidia Xavier NX

Nicolas Bohorquez

Photo by DAVIS VARGAS on Unsplash

Running a local LLM in a Single-Board-Computer (SBC) for 10W is fun and cheap, the results? good enough (for fun, no profit). This is a personal reminder of how to get it done.