Rendered at 10:00:59 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
qinqiang201 1 hours ago [-]
Could it run on Macbook? Just on GPU device?
OutOfHere 2 hours ago [-]
Will this run on CPU? (as opposed to GPU)
boxed 1 hours ago [-]
Why would you want to? It's like using a hammer for screws.
g-mork 40 minutes ago [-]
CPU compute is infinity times less expensive and much easier to work with in general
boxed 30 minutes ago [-]
Less expensive how? The reason GPUs are used is because they are more efficient. You CAN run matmul on CPUs for sure, but it's going to be much slower and take a ton more electricity. So to claim it's "less expensive" is weird.
regularfry 1 hours ago [-]
To maximise the VRAM available for an LLM on the same machine. That's why I asked myself the same question, anyway.