Verifiable LLMs are here.
Phala Network, @ionet and Engage Stack just jointly released Confidential Computing on nVIDIA Hopper GPUs: A Performance Benchmark Study.
We analyzed the impact of Trusted Execution Environments (TEEs) on NVIDIA H100 & H200 Hopper GPUs for secure LLM inference. Here’s what we found.🧵
Blog link: