WiCi One, Checked: A 748B AI Off an SSD vs the Mac Studio We Already Run
From Frontier Watch · 7:08
Show by Guerin Green
NetworkChuck ran a 748-billion-parameter DeepSeek model on WiCi One, a box with a 32 GB RTX 5090 that streams most of the model off an SSD, at about 8 pieces of text a second. His video is sponsored by WiCi, and he says so. I checked 21 of its claims against DeepSeek's model card, WiCi's open-source InferSSD repo and Apple's spec pages: 12 hold, 6 hold with a caveat, none fail. Then I ran what I could on our own Mac Studio (M3 Ultra, 256 GB): the same coffee questions on the smaller DeepSeek V4 Flash at 22.5 a second, our model drive at 2.6 GB/s for big reads and 34 MB/s for tiny ones, a model switch in 0.69 seconds, and an answer that used 18 kilobits a second on the network. Written analysis: https://familygpu.novcog.us.com/ · Video: https://youtu.be/fXe88jyy7lk
More episodes of Frontier Watch
More episodes
- A New Website Gets Bots in Seconds: My Research Paper in Plain English
- They Watched the Second Lap: My AI Research Paper in Plain English
- Does AI Training Teach New Reasoning? A New Paper Says No. I Re-Ran It
- Karpathy Thinks 1B Will Be Enough: TwIL-8B, Checked on a Mac Studio
- InferSSD on a 256 GB Mac Studio, Tested: Plain llama.cpp Wrote 3x Faster
- AI Agent Costs, Checked: Same Price Per Token, 8x the Bill
- Semantic Caching, Checked: What It Saves, Where It Breaks, and the Threshold That Decides
- Kimi K3.1 Pro: #4 in the World, Called Open, and You Cannot Download It Yet
- Is GEO Dead? I Checked Every Study Used to Bury It
- Linking Two Macs for AI: What EXO and RDMA Actually Do
PodSearch is a free, independent podcast search engine. Read about PodSearch, the privacy policy or contact us.