Meta (slrpnk.net)

911 readers

1 users here now

Here we can discuss anything about this Lemmy instance/server itself.

Our XMPP support chat: Movim or XMPP client.

founded 4 years ago

MODERATORS

Anti SEO? (slrpnk.net)

submitted 5 months ago by sam_uk@slrpnk.net to c/meta@slrpnk.net

9 comments fedilink hide all child comments

I wondered about the robots.txt

I can see the case for it, I could also see the case for allowing at least Google to index the site.

Has there been some discussion about this previously?

you are viewing a single comment's thread
view the rest of the comments

[–] Nemo@slrpnk.net 0 points 5 months ago

There has and IIRC it's to help prevent scraping.