A 120B LLM Without At Least 60GB RAM Is Impossible To Run, But One Individual Defied All Odds By Combining A Phone, Three Macs And Two Windows PCs To Make it Work

A 120B LLM like gpt-oss-120b would require a minimum of 60GB to 80GB of a combination of VRAM and system memory to run at decent performance, meaning that it’s absolutely necessary to have pricey hardware in your possession to achieve this feat. However, one…

Preview courtesy of Wccftech. The full article opens on their site.