this post was submitted on 10 Oct 2026
84 points (88.2% liked)

Technology

88707 readers
3774 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] DrCake@lemmy.world 77 points 1 day ago (1 children)

I think it’s safe to assume that any public code on the internet is already in their training dataset.

At this point anything that is public in general, probably all the posts in the “fediverse” have been taken already

[–] dan@upvote.au 20 points 1 day ago* (last edited 1 day ago)

probably all the posts in the “fediverse” have been taken already

I don't doubt this, as it's trivial to do (by design). You don't even have to scrape anything.

New posts and comments in a Lemmy community (or Mastodon profile or any other ActivityPub-based Fediverse app) get pushed to every server where federation is allowed and at least one person is subscribed to it. You can spin up your own server, subscribe to a bunch of communities, wait a while, and over time your PostgreSQL database will be populated with profiles, posts, comments, etc.