Same reason a lot of people don’t change their own oil in their vehicles.
Sometimes it’s just more convenient to pay someone else to do things
Oh wait you’re talking about fediverse instances. For me, I would be worried about reliability. Like if I was travelling and my apartment had a power outage or something
Are these AI decompiled games any good? I heard the Adobe ones looked good but we’re actually really slow and buggy
12GB is a lot of ram. By small local models I am talking about fine tuning something like < 2GB LLM
Why can’t they just fine tune a small locally hosted model? Are they dumb?
Most gamers have a GPU anyways
That’s too bad you can’t discuss the tianamen square massacre with your sex/roleplay chat bot.
Lol what’s your tokens per second not the server with no GPU running those sizes of models?