The block user button is your friend
TheMightyCat
I'm running 2x4090, the 35B fits very comfortable in that.
For large models like the 397B without a ton of money there are several ways, ive seen posts of people using arrays of used 3090s with good results.
The other option is CPU inference although with current RAM prices that is less cost effective.
I was looking at maybe an array of Milk-V JUPITER2 since vllm added riscv support which could be very cost effective.
Depending what OP was using before but going from something like GPT5.2 to LLama 3 8B will be a massive difference (Although OP says to use it only for basic tasks so that does offset it)
LLama 3 already being a very old model doesn't help either
I run Qwen3.5-35B-A3B-AWQ-4bit which while leagues ahead of LLama 3 8B still is a very noticeable difference.
This is not to say open source is bad, if one had the resources to run something like Qwen3.5-397B-A17B it would also be up there.
Losing a vital plane now when you are at war then it doesn't really matter if it might get replaced sometime far in the future
You don't have to be a tankie or a wankie to recognize the fact that a loss ratio of 0% is very good for an aircraft.
If it was a Russian or Chinese aircraft doing this then that would also be a fact.
It's stupid to say that a single aircraft being damaged makes the entire type worthless like many here are saying when the F-35 is the only aircraft flying these missions and come back with only damage to a single plane.
That is not a political statement or approval of the strikes. That's just a statement on the plane.
For the all the probably hundreds of sorties flown with a result of zero losses and only a single aircraft being damaged they might aswell be invisible.
any tips?
My laptop has this option in the bios settings
Not sure if it's only for laptops but you could check there.
I'm running wayland with nvidia-open and nvidia-utils packages, and have never encountered any driver issues in both graphics and compute.
Let them cook
why the industry is still not ready to move away from it.
But why should the industry move away from it?
Am i the only person on earth who doesn't think C++ is a liability and actuallly works faster in it?
At work i have to develop a backend api in TypeScript and it severly lacks in features compared to C++, again maybe its just me but i don't find how one is expected to magically program faster in TypeScript then C++.
Not to mention the idiocy of compiling a static typed language to a dynamic typed language which is then interpreted.
I switched from github to forgejo and that was really easy, they have an migrate button.
Everyone's linux is in bed witu US corpos if you just look at the commit history of the kernel