Selfhosted

60707 readers

637 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

Be civil.
No spam.
Posts are to be related to self-hosting.
Don't duplicate the full text of your blog or readme if you're providing a link.
Submission headline should match the article title.
No trolling.
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.
AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

In search for a new self-hosted LLM (lemmy.ml)

submitted 3 months ago* (last edited 3 months ago) by tanka@lemmy.ml to c/selfhosted@lemmy.world

31 comments fedilink hide all child comments

Hey :) For a while now I use gpt-oss-20b on my home lab for lightweight coding tasks and some automation. I'm not so up to date with the current self-hosted LLMs and since the model I'm using was released at the beginning of August 2025 (From an LLM development perspective, it feels like an eternity to me) I just wanted to use the collective wisdom of lemmy to maybe replace my model with something better out there.

Edit:

Specs:

GPU: RTX 3060 (12GB vRAM)

RAM: 64 GB

gpt-oss-20b does not fit into the vRAM completely but it partially offloaded and is reasonably fast (enough for me)

you are viewing a single comment's thread
view the rest of the comments

[–] SuspciousCarrot78@lemmy.world 1 points 3 months ago* (last edited 3 months ago)

You're welcome :) This video discusses / shows some automation ideas, using a prebuilt kit you can grab

https://www.youtube.com/watch?v=WrreIi8LCiw

I have no affiliation with them (other than i thought of the exact same idea he did, about 12 months after him, lol). You can see it in action from about 3 mins in.

It's not the most impressive stuff possible, but the side by side screen give you and idea of what's under the hood.