Long-term memory in chat is useful—and a new responsibility

MemoryBank resides outside the base model

The mechanism supplements language models with an external memory. Relevant content is selected from earlier interactions, summarized, and provided again in subsequent responses.

This allows the same approach to support different model providers. The memory is not limited to a specific model architecture but is part of the surrounding application.

This separation is technically useful. A base model can be swapped while the profile and conversational continuity are preserved. At the same time, the application must be responsible for the accuracy and protection of the memory.

A more powerful model does not repair a false memory that is fed into its context as an alleged fact. Memory quality remains a separate layer.

Memories are reinforced or forgotten

MemoryBank orients its update mechanism on the Ebbinghaus forgetting curve. The passage of time and relative significance influence which content is retained, reinforced, or made less accessible.

Selective forgetting prevents every old message from permanently holding the same rank. For long-term companionship, this makes sense, because a complete trajectory becomes unwieldy and costly.

However, the assumed significance is not neutral. An algorithm can over-weight a casual remark or let a boundary that matters to the person fade.

Users should therefore not only be able to delete all data, but also to see and correct which persistent settings or memories the system actually uses.

SiliconFriend demonstrates long-term companionship

The authors deployed MemoryBank in an LLM-based companion called SiliconFriend. The system was additionally fine-tuned on psychological dialogue data.

In qualitative real-world dialogues and quantitative simulated trajectories, it demonstrated the ability to retrieve relevant memories, take the user’s personality into account, and respond more empathetically.

For the simulation, ChatGPT played various user profiles and generated long-term conversations across many topics. Such data enable controlled variation, but they only partially reflect real human development.

A successful companion demonstrator is not yet evidence of psychological efficacy or safe long-term use. Relationship dynamics and dependency in particular require real, longer-term research.

Memory must separate facts from interpretations

A display name, a chosen tone, or the companion’s name are clear preferences. A statement such as “You always feel abandoned in relationships,” by contrast, is a far-reaching interpretation.

When a system stores such interpretations as permanent memories, later responses can repeatedly confirm the assumption. An uncertain impression becomes an apparently stable personality profile.

The memory should therefore include provenance and certainty. Direct user statements, temporary conversation states, and model hypotheses require different rules.

Corrections must not merely supplement older entries but, where necessary, replace them. Otherwise, the refuted assumption resurfaces on every retrieval.

Contradictions between two user statements are not always errors either. People change their minds or describe the same situation differently on different days. The memory should retain temporal context rather than quietly declaring one version the ultimate truth.

For sensitive hypotheses, deliberately not storing them can be the best decision. The chat may address them in the current conversation without turning them into a permanent profile feature.

Retrieval can reduce hallucinations

Shuster, Poff, and Chen investigated retrieval architectures for knowledge-grounded dialogues. Retriever, ranker, and encoder-decoder were combined to generate responses that are both informative and conversational.

The best models achieved strong results on two knowledge dialogue tasks and, according to human evaluations, markedly reduced knowledge hallucinations.

The principle resembles memory retrieval: instead of letting the model recall solely from parameters, it receives selected external information. Quality then depends heavily on selection and ranking.

Retrieval does not prevent errors if the wrong memory is found or a correct source is misinterpreted. It shifts part of the quality work into storage, search, and context assembly.

Emotional consistency is a different storage task

The Emotional Chatting Machine by Zhou, Huang, and Zhang modeled emotion categories, an internal emotion state, and an external emotion vocabulary.

It was able to generate responses that were more appropriate in content and emotional expression. This memory primarily controls the form within the dialogue, not long-term personal facts across multiple sessions.

A real companion system may need both levels: momentary conversation dynamics and enduring preferences. They should not be mixed into a single opaque profile.

A momentary desire for quiet must not become a permanent attribution of personality. Conversely, a long-term chosen direct address should not be lost after each session.

Data protection begins with the question of what is not stored

Long-term memory increases utility because people do not have to start from scratch every time. At the same time, it increases the amount of sensitive information that remains associated with an account or device.

Data minimization requires a decision on purpose. Which details does the chat really need for continuity, which can remain local, and which should disappear after the session?

Registration and guest mode can have different storage commitments. A guest conversation can remain in the browser; a voluntary account can enable cross-device storage. These differences must be understandable before the decision.

Technical encryption is important but not sufficient. Access, export, deletion, retention period, and use for quality analysis are part of the complete description.

A good memory is controllable continuity

MemoryBank demonstrates a flexible way to build long-term memory around various language models. Its demonstration suggests that relevant recollections can improve companionship and personalization.

For sensitive conversations, however, memory should not be as complete a biography as possible. It should retain a few useful, verifiable pieces of information and more readily forget what is uncertain.

Tests must examine retrieval as much as storage: Is the right memory used at the right moment, does a deletion remain effective, and does a corrected assumption actually disappear?

Another test concerns account switching. Memories must never be mixed between people, browser profiles, or household devices. Even a single foreign personal memory can destroy the entire space of trust.

Long-term memory in chat is useful and a new responsibility. Only transparency, user control, data minimization, and error-aware retrieval turn memory into helpful continuity rather than an invisible psychological archive.