• TootSweet@lemmy.world
    link
    fedilink
    English
    arrow-up
    59
    ·
    7 days ago

    These types of errors happen even after including prompts like “Do not hallucinate.”

    Genius! Why didn’t I think of that!

    • Architeuthis@awful.systems
      link
      fedilink
      English
      arrow-up
      40
      ·
      edit-2
      7 days ago

      In every RAG guide I’ve seen, the suggested system prompts always tended to include some more dignified variation of “Please for the love of god only and exclusively use the contents of the retrieved text to answer the user’s question, I am literally on my knees begging you.”

      Also, if reddit is any indication, a lot of people actually think that’s all it takes and that the hallucination stuff is just people using LLMs wrong. I mean, it would be insane to pour so much money into something so obviously fundamentally flawed, right?

      • Soyweiser@awful.systems
        link
        fedilink
        English
        arrow-up
        8
        ·
        7 days ago

        Yeah that method is clearly flawed. Not enough incense and prayers to the Machine God, no wonder the Machine Spirit is displeased. All praise the machine god of Mars! Praise the Omnissiah!

    • khalid_salad@awful.systems
      link
      fedilink
      English
      arrow-up
      19
      ·
      7 days ago

      I’ve tried screaming “stop overfilling my hboxes” when compiling my TeX document, but it isn’t working! Am I prompting it wrong?