Glossary

Saved memory

A saved memory is a piece of information that a chat app or another application keeps outside the model. It is used again in later conversations when it is fetched. Then it lies as text in the context and therefore in the context window.

An example: In an earlier chat you said that you eat vegetarian. A saved memory records this. When you ask for a recipe later, the note is fetched and the model takes it into account. Nothing in the model itself has changed.

Not to be confused with learning: Saved does not mean learned. The weights, the numbers set by training, stay unchanged. The note only has an effect while it lies in the conversation.

Where you meet the term: In the settings of chat apps you often find an area for saved memories that you can review and delete. Whether and how an app keeps notes is decided by the provider.

The term is introduced in What a Chatbot Knows in a Conversation: Four Sources, One Context Window.

Last changed on · commit c3dc031