• 2 Posts
  • 4 Comments
Joined 4 years ago
cake
Cake day: June 1st, 2020

help-circle


  • I would argue that what’s going on is that they are compressing information. And it just so happens that the most compact way to represent a generative system (like mathematical relations for instance) is to model their generative structure. For instance, it’s much more efficient to represent addition by figuring out how to add two numbers, than by memorizing all possible combinations of numbers and their sum. So implicit in compression is the need to discover generalizations. But, the network has limited capacity and limited “looping power”, and it doesn’t really know what a number is, so it has to figure all this out by example and as a result will often come to approximate versions of these generalizations. Thus, it will often appear to be intelligent until it encounters something that doesn’t quite fit whatever approximation it came up with and will suddenly get something wrong that seems outside the pattern that you thought it understood, because it’s hard to predict what it’s captured at a very deep level and what it only has surface concepts of.

    In other words, I think it is “kind of” thinking, if thinking can be considered a kind of computation, but it doesn’t always capture concepts completely because it’s not quite good enough at generalizing what it’s learned, but it’s just good enough to appear really smart within a certain distribution of inputs.

    Which, in a way, isn’t so different from us, but is maybe not the same as how we learn and naturally integrate information.


  • I was using Jerboa because i was used to Sync for reddit. But, I got a bit tired of hiw rough around the edges it is, so I switched to just installing my Lemmy instance fromt page as Firefox “app” on my phone and realized it’s not that bad as a UI, so sticking with it for now.

    I’ll probably try apps again in the future but I feel more open to “installing” good web apps now. Incidentally I tried the same trick with Reddit’s mobile interface after Sync stopped working and realized it’s also not so awful as I remembered. I did prefer Sync but I’ll see how it goes with this method. So it’s mobile web interfaces on Android for me for now.

    Having said that, in both cases I think I’d prefer a more “simple HTML” type experience like old reddit over these dynamic SPA things they both have going.