• ProfessionalHandJob@lemmy.beyondcombustion.netOPM
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    Indeed, and vastly underpowered for that amount of content.

    I’m curious how many more subreddits I can scrape from without sweating though. 130 hasn’t even move the needle.

    The issue isn’t the content itself. it’s the number of users/federation activity the server has to churn through for folks not local to the instance or pulling in stuff remotely.

    Looking at my own server’s performance as i’ve been fucking around w/different things, the bottleneck is all the federation that server is trying to go through without enough resources to support it. Wish there was a way to spread that out more other then people having to move. I’ve got a ton of CPU/Memory/Disk in these Dell R720xds and R730xds that are happy to chip in beyond scraping the subreddits I used to follow.

    • sbv@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 year ago

      it’s the number of users/federation activity the server has to churn through for folks not local to the instance or pulling in stuff remotely.

      I wonder if there are better protocols for this thing than ActivityPub.

        • sbv@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 year ago

          It seems really weird each identity doesn’t have a public/private key, but whatever.

          • ProfessionalHandJob@lemmy.beyondcombustion.netOPM
            link
            fedilink
            English
            arrow-up
            3
            ·
            1 year ago

            Ya, i’ve not really dug into it too deep but it seems like it’s just spewing plain text json across the web from the bits of logs I’ve had to mess with lmao.

            “eh, good nuff” - Dessalines (probably)