Palantir partners with Nvidia to streamline AI data center deployment

Two of the companies most synonymous with the AI revolution, Nvidia and Palantir Technologies, have linked arms to create an AI reference architecture operating system.

The new Palantir AI OS Reference Architecture (AIOS-RA) is designed to support end-to-end processes from hardware acquisition to application deployment. It will serve as a blueprint for private and public entities to design, deploy, and scale high-performance AI factories.

It runs both training and inference tasks on Nvidia’s Blackwell Ultra systems, which incorporate eight Blackwell Ultra GPUs and Spectrum-X Ethernet networking.

The reference architecture is built on a hardened Kubernetes substrate that runs various Foundry services such as Catalog, Build, and Multipass. It also integrates Palantir’s complete software suite, which includes AIP, Foundry, Apollo, Rubix, and AIP Hub.

Management is handled through Palantir Rubix for zero-trust Kubernetes security and Apollo for autonomous deployment and lifecycle oversight.

Nvidia’s software stack is also included, featuring Nvidia AI Enterprise, CUDA-X Libraries, Nemotron open models, and Magnum IO for accelerated performance.

This collaboration grants enterprises full control over their data, AI models, and applications while supporting the use of open-source AI models and related data acceleration tools.

The Palantir AI OS reference architecture gives enterprises total control over their data, AI models and applications. It is particularly critical for customers with existing GPU infrastructure, latency-sensitive workflows, data sovereignty requirements, and high geographic distribution.

“From our first deployment with the United States government and in every deployment since, our software has had to meet the moment in the most complex and sensitive environments where customers must maintain control,” says Akshay Krishnaswamy, Palantir’s chief architect in a statement.

“Together with Nvidia — and building on many customers’ existing investments — we are proud to deliver a fully integrated AI operating system that is optimized for Nvidia accelerated compute infrastructure and enables customers to realize the promise of on-premises, edge, and sovereign cloud deployments,” he added.

Sovereign AI is an emerging market that represents a country’s efforts to develop and maintain control of its own AI, using its own data, and keeping the data within its borders.