Meta (slrpnk.net)

944 readers

1 users here now

Here we can discuss anything about this Lemmy instance/server itself.

Our XMPP support chat: Movim or XMPP client.

founded 4 years ago

MODERATORS

Anti SEO? (slrpnk.net)

submitted 8 months ago by sam_uk@slrpnk.net to c/meta@slrpnk.net

9 comments fedilink hide all child comments

I wondered about the robots.txt

I can see the case for it, I could also see the case for allowing at least Google to index the site.

Has there been some discussion about this previously?

you are viewing a single comment's thread
view the rest of the comments

[–] sam_uk@slrpnk.net 0 points 8 months ago* (last edited 8 months ago) (1 children)

In the bottom

User-agent: *
Disallow: /

Blocks all scrapers and superseeds the text above AFAIK

[–] umbra@slrpnk.net 0 points 8 months ago

Doh.i missed that😅