this post was submitted on 20 Oct 2026
189 points (84.1% liked)
Technology
89012 readers
3833 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Human review of AI is sufficient in theory, but in practice it's never as thorough as the understanding you get writing it yourself. It's hard to avoid AI, but it is a constant invitation to laziness.
Unlike reviewing a human who writes code there is zero chance of AI learning from the past and making fewer mistakes in the future. At a least a human has a chance of becoming better at coding from review feedback.
Ergo, you should leave as little places for AI to make mistakes, undiagnosable by static analysis tools, as possible. In other words, make all the technical and algorithmic decisions yourself.
No? Are you not aware of the concept of "memories"? AI do indeed take feedback into account, if they're designed to.
AI does not have memories.
It has a comparatively small context window that makes things worse the more it fills up.
Eh I really think it does. You don’t news to load everything into context. You need to load where everything is located into context.
That isn't equivalent to memories.
You are mistaken. Some AI models do indeed have memories.
They save some strings in a document to later read and "remember". Calling them memories is a reach.
My point stands that they can learn from feedback. Your memories are only information in a virtual document, too. Just as susceptible to corruption, or misinterpretation.
There is no concept of a filesystem in our brains. Weird hills, and such and so forth
Only because you don't think of it as one. It's just a different medium for the storage of information.
Does an Alzheimer's patient learn things just because they read the same note every morning explaining the reality to them?
No, their file system is corrupt. No reliable read or write access.
The AI is no different from the girl in "50 First Dates (2004)". It has to go back and read the post-it notes every time you start a new session. It does not retain memory without writing shit down to read later.
You're not wrong. It's an inferior equivalent, but would you not say she learns with each note she makes, hampered though she is?
Yes I would say that she temporarily learns something while reading the notes. And she stores it in short-term memory.
The difference with AI though is that it has to re-read the same note again and again after each question you ask it. It does not keep things in "memory" from your previous conversations. It reads it again before answering you.
That is why context length matters and is important in LLMs. There's a huge difference between talking to an AI with 10k in context length and 1mil in context length. You can try it yourself using Llama.cpp and running LLMs locally.
Our short term memory is our context window. Some people have larger capacity for information, others very little. Same thing, different terminology.
I use Ollama daily. The context limit of 10k is indeed very limiting and noticeable compared to the extended lengths of cloud models. I've had to recruit a model specifically trained on condensing salient information to perform context compression frequently. I also use the limited local context to establish effective strategies for maximizing token efficiency in the agent.md.
It's no different from how many tasks a person can simultaneously perform, or disparate words they can hold concurrently. Eventually thoughts are forgotten. What exactly is determined by the structure itself - the context-pruning strategy inherent. We don't know what our own are, but I believe we have an equivalent.
All I'm saying, in the end, is that anything that can occur in a physical entity can be emulated in a digital entity. Are we capable of doing that flawlessly yet? No, but it is looking inevitable to me. Neural networks are ubiquitous, and our ability to simulate them will only improve.
Sure, but I still think calling it "memories" is a reach and a bit disingenuous. It's not remembering anything. It's re-reading it will the every run, making it appears as if it has remembered. Calling it "reminders" or something else I think would me more appropriate.
The "memories" terminology comes from the big AI companies and they are doing everything in their power to make AI seem smarter than it actually is. A lot of reporters in media has a hard time understanding this as well and will report on AI as having it's "own thoughts" and "making own decisions".
ChatGPT breaches confinement because their engineers are stupid. Not because of some self determination to fuck with us or our infrastructure. OpenAI are responsible and let it happen. Same with Anthropic.
In the end an AI is a dumb computer program that only know and does what we tell it to do.
The auto-generated memories I've seen it create are pretty inane: "always name variables container_ when in MySpecificClass". Not really learning engineering principles.
Similar, I've found AGENT.md files might nudge it in the right direction, but as always it's a fuzzy matcher, not a learning engineer.
It's best to generate memories manually, but I've had good fortune with auto-generated so far. At least using Co-pilot.
I have found it best to have another AI generate the agent.md - having a layer of interpretation can really clarify the information imparted.
You're not wrong. I personally prefer to do the work my self.