Selfhosted

60054 readers

1119 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam.
Posts here are to be centered around self-hosting. Please ensure it is clear in your post how it relates to self-hosting.
Don't duplicate the full text of your blog or git here. Just post the link for folks to click.
Submission headline should match the article title.
No trolling.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

What type of computer setup would one need to run ai locally? (piefed.zip)

submitted 4 months ago by Grumpy404@piefed.zip to c/selfhosted@lemmy.world

33 comments fedilink hide all child comments

Not sure if this goes here or if this post will be hated upon? but i want to host ai like llms and comfyuis newer models locally but im not sure what type of setup or parts would work best on a possible slim budget? im not sure either if now is the time with inflation and such.

I dont have a price in mind yet but im wondering how much it would cost or what parts i may need?

If you have any questions or concerns please leave a comment.

you are viewing a single comment's thread
view the rest of the comments

[–] one_old_coder@piefed.social 6 points 4 months ago (1 children)

AI said:

To run AI models locally, you'll need a computer with a capable CPU, sufficient RAM, and a powerful GPU

While it's possible to run some AI models on a laptop, a dedicated desktop setup with a powerful GPU will generally offer better performance. The cost of building a dedicated AI PC can range from around $800 for a budget build to $2,500 for a performance-oriented system

Hope that helps /s

[–] paper_moon@lemmy.world 11 points 4 months ago

I wonder if it took into account when generating the price estimated, all the hikes in RAM pricing that it itself is causing...🤔

Stupid fucking AI data centers...