starting out[0] with “I was surprised by the following results” and it just goes further down almost-but-not-quite Getting It Avenue

close, but certainly no cigar

choice quotes:

Why is it impressive that a model trained on internet text full of random facts happens to have a lot of random facts memorized? … why does that in any way indicate intelligence or creativity?

That’s a good point.

you don’t fucking say

I have a website (TrackingAI.org) that already administers a political survey to AIs every day. So I could easily give the AIs a real intelligence test, and track that over time, too.

really, how?

As I started manually giving AIs IQ tests

oh.

Then it proceeds to mis-identify every single one of the 6 answer options, leading it to pick the wrong answer. There seems to be little rhyme or reason to its misidentifications

if this fuckwit had even the slightest fucking understanding of how these things work, it would be glaringly obvious

there’s plenty more, so remember to practice stretching before you start your eyerolls

  • mozz@mbin.grits.dev
    link
    fedilink
    arrow-up
    18
    ·
    edit-2
    9 months ago

    I miss the days when GPT would make an explicit point within a decent fraction of its answers that it was only a large language model, and not a general purpose intelligence, because those are two very very different (if very similar-seeming to initial human perception) things.

    It seems that the inexorable tide of misperception that that was a futile attempt to forestall has come in.

    • froztbyte@awful.systemsOP
      link
      fedilink
      English
      arrow-up
      14
      ·
      9 months ago

      that probably got “strategically removed” for uhhhhhhh checks notes financial reasons

      (read: almost certainly some execs made the call to get that nuked, because it didn’t fit the narrative they’re tried to sell)

      • Sonori@beehaw.org
        link
        fedilink
        English
        arrow-up
        13
        ·
        9 months ago

        What your telling me that a company run by the crypto shill behind worldcoin might be bending their technology to create the appearance of progress and inflate their own value? Say it ain’t so.

    • 200fifty@awful.systems
      link
      fedilink
      English
      arrow-up
      11
      ·
      9 months ago

      I feel like it was all over from the moment they made it talk in first person. No one had any illusions that Inferkit or NovelAI were general intelligences, because it was obvious that they were just language models autocompleting a sentence you typed in.