Technology

1464 readers

12 users here now

A tech news sub for communists

founded 4 years ago

MODERATORS

muad_dibber@lemmygrad.ml

burlemarx@lemmygrad.ml

egs81t@lemmygrad.ml

AI Companies Are Terrified. (youtu.be)

submitted 3 weeks ago by Makan@lemmygrad.ml to c/technology@lemmygrad.ml

31 comments fedilink hide all child comments

*Western AI companies are terrified

Anyway, what do you all think of the news?

Video is 8 minutes and 30 seconds long if you're interested.

Is it true that the DeepSeek models and that other AI model (I forgot the name already lol) can be run locally? How do they compete with Claude and OpenAI?

Also, what about that other AI thing, OpenClaw?

I am interested in AI but still very much skeptical.

I have only used Duck AI sometimes but try to avoid it.

you are viewing a single comment's thread
view the rest of the comments

[–] Faux@lemmygrad.ml 0 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

You need 128GB of VRAM for aggressive quantization of DeepSeek Flash. 16GB might be enough for aggressive quantization of smaller models. In theory you can run Qwen3.6 27B in 2-bit quantization (or something like https://huggingface.co/prism-ml/Ternary-Bonsai-27B-gguf ) and have some space for context but it's a toy. You need at least 24GB of VRAM to use reasonable quant of Qwen3.6 27B (or 32GB of shared VRAM to handle Qwen3.6 35BA3B which is faster but takes more VRAM than 27B) in actual tasks.

[–] jmo@lemmygrad.ml 0 points 3 weeks ago

I've had great luck running qwen2.5-coder:7b on my work laptop. It's great for a wide range of dev and operational tasks with opencode.