• lud@lemm.ee
    link
    fedilink
    arrow-up
    1
    arrow-down
    1
    ·
    3 months ago

    Indexing is what “scrapers” mostly do.

    That’s how search engines work. If you don’t allow any scraping don’t be surprised if you get no visitors.