Just thinking about making this a monthly post, which model are you using? what are the positives and negatives?

  • SmokeyDope@lemmy.worldM
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    2 days ago

    I have been using deephermes daily. I think CoT reasoning is so awesome and such a game changer! It really helps the model give better answers especially for hard logical problems. But I don’t want it all the time especially on an already slow model. Being able to turn it on and off wirhout switching models is awesome. Mistral 24b deephermes is relatively uncensored, powerful and not painfully slow on my hardware. a high quant of llama 3.1 8b deephermes is able to fit entirely on my 8gb vram.