#caching
All links tagged #caching
Memory is such an important part of AI Adventures. The core promise of AI Dungeon is that you can have ultimate freedom to be who you want to be and that the choices you make truly matter. But if the AI forgets those choices after a few thousand tokens, then those choices actually become meaningless, breaking the power of that promise.
We’re thrilled to introduce a brand new Memory System as an Expe...
Latitude's AI Dungeon Memory System mimics brain: compresses (auto-summary) and retrieves details. Every 4 actions, AI summarizes into dense Memory. Auto Summarization appends to Story Summary plot component, re-summarizes when long. Memory Bank embeds/stores Memories, retrieves top relevant via vector similarity to current action, avoiding duplicates. Handles edits, tiers limit slots. Experimental opt-in, premium. Improves long adventures.
Every time you use a computer, the cache is working to ensure your experience is fast.