• birdcat@lemmy.ml
    link
    fedilink
    arrow-up
    0
    ·
    16 hours ago

    i dont even have a GPU and the 14b model runs at an acceptable speed. but yes, faster and bigger would be nice… or knowing how to distill the biggest one, cuz I only use it for something very specific.