WiCi One, Checked: A 748B AI Off an SSD vs the Mac Studio We Already Run

From Frontier Watch · 7:08

Show by Guerin Green

NetworkChuck ran a 748-billion-parameter DeepSeek model on WiCi One, a box with a 32 GB RTX 5090 that streams most of the model off an SSD, at about 8 pieces of text a second. His video is sponsored by WiCi, and he says so. I checked 21 of its claims against DeepSeek's model card, WiCi's open-source InferSSD repo and Apple's spec pages: 12 hold, 6 hold with a caveat, none fail. Then I ran what I could on our own Mac Studio (M3 Ultra, 256 GB): the same coffee questions on the smaller DeepSeek V4 Flash at 22.5 a second, our model drive at 2.6 GB/s for big reads and 34 MB/s for tiny ones, a model switch in 0.69 seconds, and an answer that used 18 kilobits a second on the network. Written analysis: https://familygpu.novcog.us.com/ · Video: https://youtu.be/fXe88jyy7lk

More episodes of Frontier Watch

More episodes

PodSearch is a free, independent podcast search engine. Read about PodSearch, the privacy policy or contact us.