this post was submitted on 03 Apr 2026
23 points (62.9% liked)
Technology
83705 readers
3278 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Local LLMs, probably even ones you can host on phones. But they won't be as powered of course
Yea I get that, but does anyone have any practical ideas for local LLM?
Literature summarization, data analysis, not being a pawn in corporate data harvesting.
As long as you don't care if the summaries and analyses are wrong!
Home assistant is the big one imo, voice control for a private smart home is useful and low-stakes so hallucinations won’t be the end of the world
I'm eagerly waiting for a locally run phone assistant. Just for voice control while driving.
In addition to what the others said, some apps allow you to link to an LLM model for additional features.
For eg Immich has prebuilt models you can choose depending on how powerful your PC is, which will give facial recognition and powerful NLP-like search capabilities for your library. So if they think this is model good they can make a new prebuilt one using this as a base. Software like Microsoft Teams uses LLM for better background blurring for video calls, so maybe an open source equivalent can make use of it.
Also you can use it for other stuff like image generation too