I have the same GPU but I always run 7B/8B variants as exl2. Do you use GGUF to use your system RAM?
I have the same GPU but I always run 7B/8B variants as exl2. Do you use GGUF to use your system RAM?
I don’t know how big the original model is but I have an RX 6700 XT and I can easily run the Llama 3 8B distill of Deepseek R1 with 32k context. I just haven’t figured out how to get good results yet, it always does the <thinking><thinking/>
thing.
Wtf I haven’t seen anything like that
This the kinda stuff my homie and his gf send each other 😭
Rightfully so, I still can’t believe that basketball just said that publicly
Wasn’t $7.99 the price for standard at some point? I mean, it was easy to predict but they really did just add the option with ads to make it as expensive as the version without ads and then make every other option way more expensive
So many people forget to tip their landlords. It’s not easy to look in the face of the single mom after doubling her rent 😔
Capitalism is totally different from a ponzi scheme. In a ponzi scheme, the profits go up to the person at the top and you always need new people that come in, otherwise the whole thing will fall apart and the people at the bottom will be the ones that suffer. Under capitalism however, the profits of everyone’s work will go up to the top and you always need new workers to come in, otherwise the system will fall apart and the people at the bottom will suffer. Totally different.
Liberals working together with fascists while socialists are the only ones who are standing against it?! That’s never happened before, especially not in Germany. But I’m sure we’ll just have to say “Oh no, who could have seen this coming”, apologize and then ban the fascist AND socialist parties again and everything will be fine again.