NVIDIA Releases Personal AI Router (PAIR): An Open Inference Router That Turns The RTX, DGX Spark And Mac Boxes You Already Own Into One Local AI Cluster.
No new cluster API. No agent harness changes. No prompts leaving your network.
Here's how it works. 👇
1. It routes, it doesn't execute
PAIR is not a new inference engine. Ollama or LM Studio still runs the model on whichever machine PAIR picks. It takes over the default port each engine uses, so the agent keeps talking to the endpoint it already knows.
→ Proxies Ollama-compatible, LM Studio-compatible and OpenAI-compatible endpoints
→ The agent decides what to request, PAIR decides where it runs
2. Discovery and trust
mDNS finds nearby machines automatically, or you add a node by IP. Trust is bootstrapped by a six-digit PIN shown on one machine and entered on the other.
→ All node-to-node traffic is blocked until pairing completes
→ Paired nodes then communicate over mTLS with generated certificates
3. The eligibility filter
A node only becomes a candidate once it can actually serve the request. The scheduler weighs five signals: is the node online and ready, is a supported engine enabled, is the exact model present, what is the current job load, what is GPU utilization.
→ Models don't need to be identical across nodes — PAIR routes by model location
→ Loading the same tag on more nodes just widens the eligible pool
Repo: https://github.com/NVIDIA/Personal-AI-Router
Technical details: https://www.nvidia.com/en-us/ai-on-rtx/personal-ai-router/
https://i.redd.it/jctdqo2immnh1.png
Source: r/machinelearningnews · by /u/ai-lover