Colibri 让笔记本无 GPU 运行 744B 参数 GLM 5.2 模型

以下是视频口播的自动转写，可能有错字。

Someone just ran a 744 billion parameter ai model on a laptop with no graphics card. A developer in italy pulled it off with glm 5.2, the open model that beats the ones that you pay for.

Nvidia's entire pitch is that you need their gpus for something like this, and you just prove you don't. The project is called calibri.

It works because only about 10 gigs of the model is actually thinking at any moment. Calibri keeps that part in your ram and streams the rest off your hard drive as it needs it.

It's the same way netflix streams movies instead of making you download it. And running it is easier than it sounds. You clone the repo and run one setup file.

The whole thing builds itself from there. The only heavy part is the model download, which takes 370 gigs on your drive.

After that, you just type cali in chat, and you're talking to it, completely offline. If you build apps, type cali serve instead, and it turns into an OpenAI endpoint.

You change one line in your code, and your token bill goes to zero, because nothing ever leaves your machine. The github link with a full install guide is in the comments.

Follow for useful technology tips you can try today.