Should be good at conversations and creative, it’ll be for worldbuilding

Best if uncensored as I prefer that over it kicking in when I least want it

I’m fine with those roleplaying models as long as they can actually give me ideas and talk to be logically

  • a2part2@lemmy.zip
    link
    fedilink
    English
    arrow-up
    0
    ·
    6 days ago

    Can’t you just increase context length at the cost of paging and slowdown?

    • Smokeydope@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      6 days ago

      At some point you’ll run out of vram memory on the GPU. You make it slower by offloading some memory layers to make room for more context.