richmondez

Isn’t that bad for the big US AI companies? The only thing they are doing that actually makes money is selling their inference service on their private models and they need to make a much larger profit on it to even start paying off the interest on the debt they have accrued on infrastructure and training costs.

This is in my opinion why there is all the scare mongering to try and lock out open weight competition to prevent decoupling inference from the models being run. Otherwise inference just becomes a low margin utility service and the big tech companies that have bet big on AI lose big.

Hates the idea of anyone but his company having it and reducing the provision of inference services to that of a low margin utility he means.

Isn’t this exactly the same pattern seen with voice assistants like echo? Cost loads to develop, people generally like using them but arent willing to pay for them or tolerate blatant advertising by them.

It doesn’t sound like they are shipping the kernel, only that your kernel must be signed with well known keys which I assume the supported distros are? Still not keen on it personally and wouldn’t run the anti cheat myself but at least it’s user space.

Why is this a problem? The issue with “social” media isn’t kids (or adults for that matter) writing messages to each other, it’s the engagement algorithms pushing emotive content to drive engagement and manipulate narratives.

Toasters would be worse.

I get doing things because you can, that doesn’t mean it’s not wholly unsuited to the task and massive over kill that you only use because either 1. It’s self hosted so you are already paying for it or 2. It’s super cheap. You likely wouldn’t entertain such a set up if you were paying the true price for training and running the models.

You managed to set up that tech stack but needed an agent with unrestricted access to figure out the time was wrong 😂

There are skill issues and a lack of imagination here but it’s not from people dismissing the use of LLM…