npub1y6ckppt03huzdsaz472u5ue7yf3v5wp5y3ygvpf74mlthee54sks2xjkf0 (npub1y6c…jkf0) > What do you expect to get out of local AI?
I don't. I was shocked that anything ran on my machine at all, since it only has Intel onboard graphics. I was just curious enough to try it and see if it worked.
I mean we're only talking 3-10 tokens/sec, so it's not like it's remotely fast, but I found it at least usable.
The machine Rob Braxman recommends is this one:
https://www.amazon.com/Beelink-126TOPS-LPDDR5X-PCIe4-0...
> Basic image,music, and chat can do great on 12-16GB GPU
I'd expect less than that for images if the Ollama ever gets the flux2-klein model working on Linux. I haven't even look at music generation though.