this post was submitted on 05 Jan 2026
129 points (97.8% liked)
Selfhosted
60177 readers
769 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil.
-
No spam.
-
Posts are to be related to self-hosting.
-
Don't duplicate the full text of your blog or readme if you're providing a link.
-
Submission headline should match the article title.
-
No trolling.
-
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Ah, good catch. This is something I have to look into. Other self-hosted apps I have usually keep a local cache for a few days only and fetch on demand when needed. Need to explore if both Lemmy and PieFed to something similar.
Lemmy fetches everything that has ever been posted in any community that any user on that instance is subscribed to and keeps it indefinitely.
Since most activity happens in big communities that most people are subscribed to, most instances keep full, persistent copies of most things that were ever posted to lemmy.
That's why Lemmy scales so badly. If Lemmy was the size of Reddit, every instance would have to have storage capacity in the same order of magnitude as all of Reddit itself.
The problem only gets worse with time, since all that has been posted still remains.
The total replication also means that the copies need to be moderated by every instance individually, since every instance stores a copy of everything. So if e.g. someone posts illegal content on another instance and your instance stores a replica, you are just as legally liable for that illegal content as the original instance. Thus you have to moderate everything that runs over your instance.
Moderation effort is thus also replicated across all instances.
That bad scaling in storage and moderation is btw the reason why e.g. lemm.ee shut down. It was just too much cost and work to keep the instance running.
As far as I can tell PieFed already handles deleting old content (1 week by default, but I’m looking at the code on my phone so not the best way of doing research). I’ll do some more code reading later if I have a chance.