Only 3 years behind. Getting better, Apple
I give it a week before someone reverse engineers it and uploads a foss option.
There are already a lot of FOSS options that run on Apple Silicon.
Oh sure I’d imagine so. What I meant was whatever magic sauce that makes this better will be assimilated.
Sooooo it’s Ollama but not FOSS?
it is called install asahi or buy a proper computer
sus
Harbor is currently in a private preview under Apple’s Claris brand…
Now there’s a name I haven’t heard in a long time.
Dynamic pooling could make this more accessible to lower power macs.
Are there other handlers that can bundle computers into a local Ai instance in a similar manner?
I guess vLLM supports clusters so you could just use that? The setup is more difficult than just plugging in a cable though.
Interesting. I kind of want to buy another Mac to dee if it works either way my M4 Max MBP.
