• mrpxilo@lemmy.zip
    link
    fedilink
    arrow-up
    15
    ·
    4 days ago

    I don’t know how many people here program but this sort of thing always confuses me. It’s like they’ve never dealt with user input before. Never had to assume input was garbage and/or malicious. Every time an LLM generates a bad response should have been the moment they realized what was happening.

    Who programs something and runs it, then blames user input for something bad happening? People who lack fundamental programming skills are making headlines for their silly ai goofs.

    • Feathercrown@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      3 days ago

      It’s not really possible to guard against bad user input with AI. You can’t restrict the input and you can’t verify that the AI won’t produce bad output from good input. The possibility of undesirable output (“hallucinations” etc.) is fundamental to AI.