this post was submitted on 11 Aug 2026
279 points (96.3% liked)

Technology

87151 readers
4069 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Damage@feddit.it 5 points 3 days ago (2 children)

I think there are physical and economic limits. Neural networks may improve in software, but they still need more and more hardware, at some point that hardware resource curve is going to be to steep to climb at the current rate.

[–] village604@adultswim.fan 5 points 3 days ago (1 children)

Why are you assuming that software improvements don't include less resource utilization?

[–] Damage@feddit.it 1 points 2 days ago (1 children)

I thought it was clear that's what I was implying.

[–] village604@adultswim.fan 1 points 2 days ago

And I'm asking why you think that.

China's models have gotten significantly less resource intensive based on updating the software.

[–] TheFogan@programming.dev 2 points 3 days ago* (last edited 3 days ago) (1 children)

I think there are physical and economic limits. Neural networks may improve in software, but they still need more and more hardware, at some point that hardware resource curve is going to be to steep to climb at the current rate.

It's true, but think like the crypto miner bugs. I don't know enough on AI's working, but is a distributed computing LLM possible, or is the need for super close super low latency between nodes eliminate the risk of a distributed computing, learn as it travels botnet powered AI worm, that continues evolving even if it's home is shut down.

[–] NotMyOldRedditName@lemmy.world 2 points 3 days ago (1 children)

You could likely do some sort of distrubuted system in machines that had a reasonable graphics card, or shared memory like the M series macs. Have it silently intall a 30b parameter model or higher and somehow hide how that space is being used.

Local models are getting pretty good, and one focused on hacking / bot net behavior could probably do very well at that size.

But you'd notice it being used... fans would go off, frame rates drop etc. You'd probably need to code it to only do stuff when it seems idle?

[–] TheFogan@programming.dev 1 points 3 days ago (1 children)

well my thought is, more the botnet side of it, IE pushing less on individual machines, but more on massive distribution. IE it not needing one computer strong enough to run it, IE expecting 90% of the machines it infects to be average consumer PCs, but making more use out of 1000 systems that can handle 1% each, rather than 1 computer that handles 100%, however yeah I do suppose also allowing it to do the bulk of the work when the computer is likely unused etc... and I don't know much on the concept of communication etc... IE most major botnets were crushed by a command center being shut down. Imagining a different form that has, basically makes C&C's on the fly.

Im not super well versed in this, but i dont think you can efficiently distrubute the LLM processing like that. Even if it was possible, it would be very very slow. But I guess speed isnt always needed.