NVIDIA chips now encrypt AI work to keep data private during inference

NVIDIA is evaluating adaptations to its Blackwell GPUs to maintain AI inference performance while adding a new layer of data privacy. As large language models process increasingly sensitive information, the company is building a trusted environment using memory-encrypted confidential virtual machines, confidential GPUs, and encrypted NVLink interconnects. Maintaining high performance within this system requires co-optimization of AI frameworks and the confidential computing environment; workload characteristics, such as request volume, directly impact how noticeable any performance overhead becomes. NVIDIA Blackwell GPUs are demonstrating the ability to retain between 96.1% and 98.2% of baseline output-token throughput when running AI inference…