Update The upgrade was done, DB migrations took around 5 minutes. We’ll keep an eye out for (new) issues but for now it seems to be OK.

Original message We will upgrade lemmy.world to 0.18.3 today at 20:00 UTC+2 (Check what this isn in your timezone). Expect the site to be down for a few minutes. ““Edit”” I was warned it could be more than a few minutes. The database update might even take 30 minutes or longer.

Release notes for 0.18.3 can be found here: https://github.com/LemmyNet/lemmy/blob/main/RELEASES.md

(This is unrelated to the downtimes we experienced lately, those are caused by attacks that we’re still looking into mitigating. Sorry for those)

    • astral_avocado@programming.dev
      link
      fedilink
      arrow-up
      3
      arrow-down
      1
      ·
      edit-2
      1 year ago

      Haters. Groups paid by Steve Huffman. Script kiddies. Any rich trust fund pissant with a couple hundo to spend on the dark web.

        • astral_avocado@programming.dev
          link
          fedilink
          arrow-up
          2
          ·
          1 year ago

          Not too much, just that it would be incredibly tempting of an option for a millionaire. Anonymously destroy your competition by paying some dark web site in Monero? Sure why not?

          • sab@lemmy.world
            link
            fedilink
            arrow-up
            2
            ·
            1 year ago

            If that were the case, I think he would have paid a bit more and make sure it would have stayed down. No competition was destroyed here.

            I think it’s Far more likely that it’s just a bunch of scriptkiddies saying “when I press button, error page goes brrrrrrr”.

  • Ulu-Mulu-no-die@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 year ago

    Sorry for those

    It’s not your fault :) We know you admins are working really hard to keep the server as stable as possible.

    • Corvid@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      1 year ago

      It’s a bit confusing. The backend added support for infinite scrolling, but lemmy-ui(the front end) hasn’t landed that change yet.

      • dot20@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        1 year ago

        It seems to be autoloading new comments, like in this thread that is long.

        Is there a way to turn this off? I don’t like infinite scroll

      • Dr. Dabbles@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        1 year ago

        Infinite scroll and word filtering. If I see one more post about “AI”, Musk, Twitter, or fake superconductors, I might have to get off the computer for 10 whole minutes.

        • kazerniel@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 year ago

          I want to be able to ban/hide entire servers. Regularly seeing lemmynsfw celebrity communities pop up in All/Hot :| (I have nsfw disabled, so it’s just generic photos of random women.)

          Also an option would be nice to hide downvoted posts, I had that on in RES.

            • Contravariant@lemmy.world
              link
              fedilink
              arrow-up
              2
              ·
              edit-2
              1 year ago

              Fair. It’s not too hard, but most lemmy UIs make it a bit harder than it needs to be because they want to be a fancy JavaScript-ridden mess of html tags.

              On old.lemmy.world it is supremely easy, you just use the element picker tool of uBlock to select all posts, add the ‘magic’ command :contains(reddit) to filter out the word you don’t want (in this case reddit), and you’ve got your filter. This would result in old.lemmy.world##.post:contains(reddit).

              On lemmy.world it is trickier because it is the kind of HTML no sane person would write. Doing the above you end up with lemmy.world##div.mt-2.post-listing:contains(reddit) which is messy, and misses a line that is used to divide the posts. With some manual tuning you can first simplify the first part to ##.post-listing:contains(reddit) and then add :xpath(.|following::hr[1]) to get rid of the annoying line. This results in ##.post-listing:contains(reddit):xpath(.|following::hr[1]).

              • Blamemeta@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                2
                ·
                1 year ago

                Oh is it literally just css selectors, but with a slightly different syntax? Fuck me, I never looked into it and assumed it was nonsense.

                • Contravariant@lemmy.world
                  link
                  fedilink
                  arrow-up
                  2
                  ·
                  1 year ago

                  The extra syntax is just to add some features that aren’t in CSS. Not quite sure where this came from, I think it’s from the Adblock Plus era, but Gorhill perfected it for uBlock origin, which makes it a very powerful tool.

                  It’s not limited to just hiding the elements either, if you want you can simply restyle them (I’ve used this to redact sports results until I hovered over them).

  • Nix@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    1 year ago

    Awesome! It’s great to see thing become snappier and better since I joined Lemmy.

    Reddit would almost never update unless it was a pants on fire situation or they would force feed features that no one wanted or even was tested properly.

    A big thank you to everyone involved, FROM those taking the time to submit bug descriptions in a reproducible manner and those making feature requests or those simply upvoting and pointing out the most needed patch/updates TO simultaneously amateur, newly minted coders and veteran developpers pushing small and big patches to fix anything from typos, reformatting old code, cleaning almost unnoticeable UI object, transition less performing backend modules or secure/harden of all these moving parts.

    I am glad to witness and be a part of the perpetual progress of the fediverse.

  • AlmightySnoo 🐢🇮🇱🇺🇦@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    This version brings major optimizations to the database queries, which significantly reduces CPU usage. There is also a change to the way federation activities are stored, which reduces database size by around 80%.

    Is it me or is the 80% figure just insane? Are there any benchmarks to see how fast this has become versus say Lemmy 0.18.2 on a very large instance?

    • miket@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      1 year ago

      Is it me or is the 80% figure just insane?

      Not really, you’d be surprised how often systems are bloated all because of a single option, character, etc. Most developers don’t start optimizing until much later in the software’s lifecycle. Often enough, it is easily overlooked. That’s why code reviews are needed often with fresh pair of eyes.

      Just to set the expectations, reducing database size or CPU usage does not necessarily mean it is faster but it does mean there’s more free capacity on the servers to handle more users at the same performance.

      More importantly; they may help reduce costs on the smaller indie instances that doesn’t need to buy larger server instances.

      Hopefully, we’ll continue to see more of these optimizations.

      • AlmightySnoo 🐢🇮🇱🇺🇦@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        I believe if the backend doesn’t have to write as much data then you’ll have less I/O operations so it should IMO have an impact on the overall speed of Lemmy (unless all of those operations are done asynchronously). Same for the reduced CPU usage, it could allow for more stuff in parallel.

        • miket@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          edit-2
          1 year ago

          Speed/pref and capacity are two separate things. I/O has nothing to do with the size of the database. You can write 100TB per second into the database and choose to only store 1TB of content. That does not mean the app is writing 1TB per second, it is still writing 100TBps.

          They said they changed how the activities data is stored, which reduced the size by 80%; here’s one of the changes they made: https://github.com/LemmyNet/lemmy/issues/3103

          As you can see, the issue here is that they were storing a lot of data in the activities table that is not needed, it was only meant for debug purposes. So, they split up the data into two and not store the other data as it isn’t needed; they’re still writing these data the same as before. One part is used to ensure they don’t re-process the same data but this is the same thing they were doing before this change.

          In addition, they’ve limited how long the data is retained for 3 months, which is a separate job they run to remove data.

          All of this has zero impact on the users using the app right now. The main benefit is for instance admins with limited storage. One might say the system slows down if there’s not enough space but that is still the same case here with this MR, it will still slow down.

          • 2014MU69@lemmy.world
            link
            fedilink
            arrow-up
            0
            ·
            1 year ago

            Wait does that mean posts older than 3 months gets automatically deleted? Isn’t that kinda bad? Being able to find years old posts is an important part of Reddit and pretty much all social media.

            • miket@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              ·
              1 year ago

              Nobody said anything about posts. Activities could mean extra metadata like “someone joined”, “someone changed”, posted, edited, etc.

              Most of the time, these isn’t required after a short while.

  • lemmy@coeus.sbs
    link
    fedilink
    arrow-up
    0
    ·
    1 year ago

    Why are these announcements the only place I am finding out the Lemmy has an update? I figured there would be more top level discussions about it on Lemmy. Maybe I am just not following the correct communities.