Small rant : Basically, the title. Instead of answering every question, if it instead said it doesn’t know the answer, it would have been trustworthy.

  • drislands@lemmy.world
    link
    fedilink
    arrow-up
    8
    ·
    3 days ago

    My first thought is that you could write a program that does something like this:

    • Receive prompt “how many times does R appear in the word ‘strawberry’”
    • Run the prompt through LLM saying “reword the following into a command to generate code that will answer the question” or something like that
    • Run the results through LLM
    • Compile and run the results
    • Provide the output to the user

    Of course, the biggest problem with this system is that a person could fool it into generating malicious code.

    • AeroLemming@lemm.ee
      link
      fedilink
      English
      arrow-up
      3
      ·
      3 days ago

      That could work in that specific case, but telling the LLM to write code to answer random questions probably wouldn’t work very well in general.