• 18 Posts
  • 38 Comments
Joined 1 year ago
cake
Cake day: June 18th, 2023

help-circle



  • That could work, but it would be terrible for discoverability. In the mean time, I put up a feature request at Lemmy. I’m not a fan of pushing my problems upstream, but in this case it would actually be the easiest solution - as far as I can see (and I have 0 experience with Rust) they only need to adjust the validation regex, because the database already allows for it. That is - as long as the ActivityPub protocol allows for it.

    If they deny it, I could try something with name mapping, but you’d either end up with something that is unreadable, or something with a high collision chance. Neither option is very appealing. For now I’m just going to wait and see.







  • You know what, there actually is a setting in Lemmit that allows for scraping of new. I’ll make an exception for dota2 for you, gimme a moment to fix that. Having said that - since there’s only 7 subscribers to that community right now, it will only get updated once per hour (once per half hour once it hits 10), but you will get all the posts.


  • Heya,

    You’re right that it doesn’t pick up everything, the bot is not using the new sorting, but the default, hot. I did this intentionally, in order to have a bit of quality filter. Let’s face it, with the amount of people visiting here right now, there’s not going to be much up/down voting to do quality control.

    Those posts you mentioned did make it on here eventually (once they got enough votes on reddit), but I’m afraid that if your goal is to have a 1-on-1 copy of reddit, that won’t help you much :/








  • Correct. A few days ago I had a lot of requests by 1 user (not you) for a over 20 subreddits, they then didn’t even bother to join the resulting communities themselves. Since those do take away time from resources that are getting views, I had decided to disable scraping for a bunch of subs that only had 1 subscriber (the bot itself), including perchance.

    If you do intent to follow it, I can re-enable it in the scraper later today.