Junkasaurus

joined 2 months ago
[–] Junkasaurus@lemmy.world 10 points 5 days ago (3 children)

I doubt that. What evidence do you have?

[–] Junkasaurus@lemmy.world 3 points 1 week ago

Incredible. What a magical place

[–] Junkasaurus@lemmy.world 12 points 1 week ago (2 children)

If you told me this was a satirical Wikipedia article I would have believed you

[–] Junkasaurus@lemmy.world 2 points 1 week ago (1 children)

Eh it’s the illusion of speed. Scaling brought enormous returns from GPT-3 -> GPT-4 but it’s been far less significant for every major release since. To compensate for this, every research lab is coming up with new ways to extract value of it of models: CoT, RL, Agent Harness etc

However, these are all hacks to make LLMs more efficient or (try) to make them more reliable. They still have significant drawbacks which will take years (probably decades) to ever get them to the point where they can reliably replace knowledge workers. China knows this and is taking a far different approach to LLM development (not a tankie fyi). Scaling is a horrible idea which will burn billions of dollars with an astronomically low chance of return.

[–] Junkasaurus@lemmy.world 4 points 1 week ago

Honestly you’re not wrong. I started to proxy and honestly it feels so good. I’m so sick of spending so much money on cards.

[–] Junkasaurus@lemmy.world 1 points 2 weeks ago

What’s wrong with Funcom?

[–] Junkasaurus@lemmy.world 1 points 3 weeks ago (1 children)

I can agree with that largely but I still contend you’re conflating a few things to make that argument. Fundamentally an LLM will make predictions based on probability (ignoring temperature) and probability does not equal certainty.

[–] Junkasaurus@lemmy.world 1 points 3 weeks ago

It’s temperature primarily. That being said there is still a chance that an LLM can output values that are unexpected even at low temperatures.

[–] Junkasaurus@lemmy.world 1 points 3 weeks ago (5 children)

What are you saying precisely? It’s well known that LLMs have non-deterministic output (Ilya Sutskever even claims as such). Are you saying the way it goes about retrieving tokens as deterministic?

[–] Junkasaurus@lemmy.world 0 points 1 month ago* (last edited 1 month ago) (1 children)

How is it dead through? They recently released the remake to MGS3 and it uses the Fox engine (looks like it anyway) 🤔

view more: next ›