• treadful@lemmy.zip
    link
    fedilink
    English
    arrow-up
    0
    ·
    15 days ago

    I still can’t decide if these people are delusional or I am.

    Every single time I use an LLM it fucking “lies” to me or otherwise completely fails at the task. The people talking like this seem to me like they’ve never actually used it, or haven’t actually vetted the accuracy (like most AI users).

    Maybe I’m just not using the “good stuff”. Or I’m not imaginative enough to foresee a near future where these problems are actually corrected and it becomes trustworthy.

    I’ve never been so torn by a technological prediction.

    • fonix232@fedia.io
      link
      fedilink
      arrow-up
      0
      arrow-down
      1
      ·
      15 days ago

      Your experience is pretty unique then.

      Yes, LLMs make mistakes, but even small, self-hosted ones are pretty efficient today if you prompt them well. They’re not mind reading software so you need to be able to describe the task and HOW you want it done, not just barf in some basic instructions like “write me a copy of Facebook but better”.

      • treadful@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        ·
        15 days ago

        No amount of prompt “engineering” will help when they outright make shit up.

        • fonix232@fedia.io
          link
          fedilink
          arrow-up
          0
          arrow-down
          1
          ·
          15 days ago

          Yes it does. Just need to go beyond prompt. Add reinforcement loops, make it test the solution in a separate environ it can’t screw up in, and have it not just INVENT things (“give me X”), but research the topic and base its solution on the rules created by the research.

          This is what basically the Claude harness (not the local but the remote harness you can’t see) adds to the LLM what makes it so powerful and useful. Replicate those processes and even a small 4B mode will be incredibly capable.

      • Fishnoodle@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        15 days ago

        It sounds like you’re saying people still need to be smart enough to use them properly… Which will be a problem as people rely on them more and more, and in turn become more stupid.

    • flicker@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      0
      arrow-down
      1
      ·
      15 days ago

      I’m in college and for one of my classes we actually have a prompt we feed to ChatGPT so that ChatGPT creates an excel spreadsheet for us as a step in an assignment process. The whole spreadsheet.

      The class is for healthcare and I won’t get more specific, but yes, you can use AI today to make whole ass Excel spreadsheets.

      (One of the steps in that particular assignment involves fact-checking the spreadsheet, btw, but about 95% of the time all the answers are word-for-word in the book, 4% they’re taken from the web and have more up-to-date info than the book has, and 1% is blatant lies.)

      • die444die@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        ·
        3 days ago

        Why do you think “making” a “whole spreadsheet” is even impressive?

        People fearmonger about those of us who are unimpressed with AI will be “left behind”, but its the pro AI prople who seem unable to comprehend how to do the most basic tasks.

        Ya’ll the ones letting yourselves fall behind by not bothering to learn how to do the even the basics.

      • aesthelete@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        15 days ago

        The class is for healthcare and I won’t get more specific, but yes, you can use AI today to make whole ass Excel spreadsheets.

        lol, it amazes me what some people are impressed by

        • jj4211@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          15 days ago

          Yeah, so far when someone shows me a concrete example of this amazingly complicated thing that GenAI helped then realize, I think “really… that’s it?”

          It’s a decent reminder that a lot of people have more modest needs and a lot of the enthusiasm can come from that, and maybe that’s more understandable.