Programmer Humor

33542 readers

953 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

Keep content in english
No advertisements
Posts must be related to programming or programmer topics
- If the mod doesn't find it funny, you're banned. Ha-ha!... For real: do not use the community for "statements". There are other places for such content. Keep it chill and funny.

founded 3 years ago

MODERATORS

1801

submitted 7 months ago by not_IO@lemmy.blahaj.zone to c/programmer_humor@programming.dev

292 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Samskara@sh.itjust.works 2 points 7 months ago (1 children)

Have you ever tried running a decent sized LLM locally?

[–] Vlyn@lemmy.zip 2 points 7 months ago (1 children)

Decent sized for what?

Creative writing and roleplay? Plenty, but I try to fit it into my 16 GB VRAM as otherwise it's too slow for my liking.

Coding/complex tasks? No, that would need 128GB and upwards and it would still be awfully slow. Except you use a Mac with unified memory.

For image and video generation you'd want to fit it into GPU VRAM again, system RAM would be way too slow.

[–] Samskara@sh.itjust.works 1 points 7 months ago

I use a Mac with unified memory, so that distinction slipped my mind.