Scality AI Inference Factory Serves KV Cache From Object Storage Over RDMA, 14x Faster Than Recompute

Scality today launched Scality AI Inference Factory, an open-code software stack for running open-weight models on infrastructure the customer owns. Scality validates, ships, and maintains the whole stack, which places its AI Data Infrastructure (ADI) object…

Preview courtesy of StorageReview. The full article opens on their site.