Assuming you've got an AMD video card, and you probably do, you can still run local AI projects. The ToshLLM project claims "Native Metal acceleration, zero cloud, and no per-token bill." It won't be as fast as the M5 Ultra Mac Studio, of course, but it'll use the hardware you already have. https://…
You can run AI models on that Intel Mac Pro
Assuming you've got an AMD video card, and you probably do, you can still run local AI projects. The ToshLLM project claims "Native Metal acceleration, zero cloud, and no per-token bill." It won't be as fast as the M5 Ultra Mac Studio, of course, but it'll use the hardware you already have. https://…
Read original