We’re developing a blueprint for evaluating the risk that a large language model (LLM) could aid someone in creating a biological threat. In an evaluation involving both biology experts and students, we found that GPT-4 provides at most a mild uplift in biological threat creation accuracy. While this uplift is not large enough to be conclusive, our finding is a starting point for continued research and community deliberation.
  • self@awful.systemsMEnglish
    2·
    10 months ago

    it’s hard to determine exactly what the author’s talking about most of the time, but a lot of the special properties they claim for inductive Turing machines and super-recursive algorithms appear to be just ordinary von Neumann model shit? also, they seem to be rather taken with the idea that you can modify and extend a Turing machine, but that’s not magic — it’s how I was taught the theoretical foundations for a bunch of CS concepts, like nondeterministic Turing machines and their relationship to NP-complete problems

    • blakestacey@awful.systemsMEnglish
      3·
      10 months ago

      New top-level thread for complaining about the worst/weirdest Wikipedia article in one’s field of specialization?

      I wonder how much Rationalists have mucked up Wikipedia over the years just by being loud and persistent on topics where actual expertise would be necessary to push back.

      • self@awful.systemsMEnglish
        2·
        10 months ago

        New top-level thread for complaining about the worst/weirdest Wikipedia article in one’s field of specialization?

        fuck yes I’m down! finally I’ve got a use for all the weird CS garbage I keep finding. do you figure this’d be better as a SneerClub or TechTakes thread?

        • blakestacey@awful.systemsMEnglish
          3·
          10 months ago

          Our house, our rules, I suppose… but maybe TechTakes is a better fit, unless the examples you have in mind seem rooted in TREACLES particularly.