Skip to main content

Command Palette

Search for a command to run...

The blackboard pattern: why chat AI memory should erase, not accumulate

Most chat AI systems remember everything. The good ones know how to forget.

Published
4 min read
The blackboard pattern: why chat AI memory should erase, not accumulate

Picture this. It's 11pm. You're on your seventh ad concept of the day. You type, for what feels like the fiftieth time:

"Vertical 9:16, warm color grade, soft cinematic look, brand voice calm and a little playful, no neon, definitely no neon, please for the love of god no neon..."

You hit send. The result is great. You close the tab. Tomorrow you'll open a new chat — and you'll type all of it again.

This is the default behavior of nearly every chat-style AI tool today. Each conversation begins from zero. The model has no memory of who you are, what you like, or what you said yesterday. So you copy-paste your preferences forever, until the boilerplate becomes longer than the actual request.

The fix isn't more memory. It's better-shaped memory.

Append-only memory is a hoarder's strategy

The simplest way to give a chat AI memory is to log everything: every prompt, every preference, every off-the-cuff comment, dumped into a vector store and queried at inference time. Some systems do this and call it personalization.

The problem is that you, as a user, are not consistent. You said "warm tones" three weeks ago. Today you're saying "let's try cooler this quarter." A naive memory system stores both — and now your assistant is fighting itself.

Stale preferences don't decay; they vote. The longer you use the tool, the louder the past gets, until the system feels less like a collaborator and more like a haunted closet of every offhand thing you've ever said.

Blackboards, not databases

A better metaphor: a small chalkboard in the corner of the room.

A blackboard is fluid. Things get erased. Updated. Crossed out. Refined. It's the same surface as last week, but the contents have moved. A blackboard memory model has a few properties an append-only one doesn't:

  • The note gets updated, not duplicated
  • Conflicting preferences get resolved, not stacked
  • Stale notes get erased when they stop being true
  • The whole thing stays small and useful

Mechanically: instead of a vector store of raw chat history, you maintain a small structured document — preferences, working notes, current project state — that the model edits as the conversation unfolds. New information overwrites old where it should. The sum total of "what we know about this user" stays bounded.

This is closer to how a thoughtful collaborator's memory actually works. A good creative director doesn't recite every offhand thing you've said in three years of working together. They carry a small, current model of you, and they revise it. That's the surface area you actually want.

What it feels like to use

When this works, the experience flips. You stop typing the boilerplate. You start typing only the interesting part of the request. Eight words instead of two hundred — not because you got better at prompting, but because the system stopped requiring you to repeat yourself.

You can also watch the board. A few rules that fall out naturally:

  1. The blackboard has to be inspectable. The user can read every note the system has written about them.
  2. It has to be erasable. A note you don't like? Wipe it. It's gone.
  3. It has to be directly writable. "Always use this voice for product walkthroughs." Done — one new line on the board, no chat dance required.
  4. It has to be bounded to the user's workspace. No cross-account training, no shared distillation.

Without those four, "the blackboard" turns into surveillance. With them, it turns into leverage.

The compounding part

Most chat AI tools start at zero every conversation. You write the same five preferences for the rest of your life.

A blackboard-style system doesn't. Every project teaches the board a little more, and the next project starts from a smarter baseline. Week one, you're writing 200-word prompts. Week six, the same output takes 20 words. The improvement is real, and it compounds.

This is the pattern we've been building around in our own work on creative-AI tooling — a small mutable scratchpad alongside the model, edited as the conversation goes, never silently growing without permission. It changes what a chat tool can be. The "agent" stops feeling like a stranger you've briefed thirty times and starts feeling like someone who just knows where the project is.

The funniest way to experience it is to not look for it. Just use the tool for a week. Then on day eight, type something deliberately vague. Watch what comes back.

The chalk is already on the board.