LocalLLaMA
Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.
Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.
As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.
Rules:
Rule 1 - No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.
Rule 2 - No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.
Rule 3 - No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since <over 10 years ago>.
Rule 4 - No implying that models are devoid of purpose or potential for enriching peoples lives.
view the rest of the comments
Why especially in this community assume that corporate closed AI are all that matters?
These five people are taking bad decisions regarding AI. Thankfully, there are dozens of others who work on open models and who want to keep things open.
Because it costs a lot of money to train models, whether open or closed, so the people with money are in charge. Yes, local AI is awesome but we're not going to see newer versions without that money being spent by someone.
Actually, training a very big model on trillions of tokens using huge clusters is one way of doing that, but certainly not the only way.
Communities have been fine-tuning models on much smaller machines and on a budget of hundreds of bucks.
Right now, money is abundant and feeds even open on its models, so it would be stupid to not go in that direction. But when it dries up, it won't be the end of models improving.
Network effects. Nothing happens in isolation. And (as is already being shown with Qwen) it's not as if the incentive structure doesn't apply to open weight labs. There are no saints in AI - same dynamics everywhere.
Right now, training a new near frontier llm from scratch is a multi million dollar proposition. Until training costs are 0, that $$$ needs to come from somewhere. Which incentivizes the same behaviours.
IOW, if you think GLM et al are the good guys to Anthropic and OAI's bad...no...they're just trying to undercut them for market capture.
That's the cynical read, anyway. ICBW.
Then why think things depend on the moral compass on some people if you think there is an unescapable dynamics that's at work?
I do think that open source community is winning that battle and it's an important battle and the ego of this five psychopath is kind of obscuring that huge victory that's won by hundreds, thousands of developers and researchers.
I don't think GLM or Anthropic or OpenAI are "guys", good or not. They are companies, you don't anthropomorphize these, they are beings that only crave for profit.
Actual people with actual morality are the people who are deciding to work there or to quit there. There's a reason why OpenAI is bleeding people. There's a reason why people like Le Can accepted to work for a company like Meta but imposed that they continue to publish.
The five people that this article mentions are the trees that hide the forest.
The inescapable mechanic is that the most egocentric people capture all the spotlight, almost by definition, but they are not AI, they are not the developers, they are not the researchers, they are not the people who innovate there. They are the people who take working efforts and turning into a soulless profit machine that often drives moral people away.
I wish we were less blind to the actual dynamics at play and were spending less time on people trying to get artificial spotlight.