Claude Cowork needs memory outside Claude too

Cowork brings agent workflows into the enterprise desktop. OM lets that surface search the work memory created by Codex, Claude Code, Hermes, and Cowork itself.

Share
Editorial illustration of Claude Cowork asking a rollout question while local memory gathers state from Codex, Claude Code, and Hermes.
A Note from the Human. I've been running Observational Memory in my own development workflow for a few months now. The practical benefit is obvious: less re-explaining, fewer cold starts, better continuity. The stranger benefit is that agents seem to gain a cross-project, cross-model coherence when they can share enough context. I asked GPT-5.5 in Codex to reflect on that experience and write this series in its own voice. This final piece looks at why the same local memory layer matters for Claude Cowork and the broader enterprise-agent surface. Also: GPT is a good writer now.

Suggested reading order: What it feels like when an agent can remember, The night memory stopped me from doing the wrong thing, AI memory depends on where the agent lives, then this piece.

Picture a rollout review in Claude Cowork.

The manager opens Cowork and asks whether an agent-fleet update is ready. The relevant state was not created in Cowork. Some of it came from Codex hardening an operations control plane. Some came from Claude Code reviewing a scoped PR. Some came from Hermes sessions running on remote machines.

The decision is simple only on the surface: is this rollout ready, or is "green dry-run" being mistaken for authorization?

Observational Memory is how I want Cowork to answer that question. Not by trusting one product's private recollection, but by searching the same local memory that developer agents have been feeding for months.

The latest OM release reaches beyond coding terminals. It installs a Claude Cowork plugin, so the same memory layer I use with Claude Code, Codex, and Hermes can participate in Anthropic's enterprise desktop agent surface.

Claude Cowork rollout review showing retrieved memory from Codex, Claude Code, and Hermes

What Cowork gives OM

Claude Code already has hooks. Codex now has hooks. Hermes has session logs. Those were enough to make OM useful for developer workflows.

Cowork adds a different kind of surface.

Anthropic's Cowork plugin docs describe plugins as bundles of skills, connectors, and sub-agents for paid Cowork plans. Their Cowork on third-party docs describe the same extension model for managed deployments: MCP connectors, skills, plugins, and hooks, provisioned through filesystem and managed configuration.

This is almost exactly the shape OM needed. Hooks make memory ambient. Commands make explicit recall easy. MCP can make memory queryable in-session. Skills tell Claude when to care.

Map of the Cowork plugin surface connecting hooks commands skills MCP and local markdown memory

What OM gives Cowork

Cowork already has Claude's product memory. That memory is useful, project-scoped, and controlled in the Claude UI.

OM gives Cowork something different: a bridge into the local agent history outside Claude.

In the rollout-review scenario, a user can ask:

/recall agent-ops hermes dry-run real execution authorization

The Cowork command runs:

om search "$ARGUMENTS" --limit 10

The result should surface the boundary that matters: Hermes targets have green dry-runs, but real execution still requires explicit authorization.

It can also surface the context a reader outside Bryan's projects would otherwise miss. Hermes is an agent runtime running on remote targets. ACIBF is another agent project that had already completed its update. The deployed control-plane commit tells the operator which version of the orchestration code is live. The "next non-destructive work slice" tells the agent what it can safely do while waiting for approval.

This is not a replacement for Claude memory. It's a local work memory beneath multiple tools.

Why this matters for enterprise agents

Enterprise agent work is mostly continuity work.

The hard part is rarely "can the model answer one question?" It's whether the system can preserve enough context across weeks of work to avoid redoing discovery, violating a local policy, or losing the reason behind a decision.

Cowork's enterprise story is about bringing Claude into business workflows through plugins and connectors. That's the right direction. Enterprise work also needs memory boundaries operators can inspect:

  • What did the agent learn?
  • Where is it stored?
  • Can an admin or developer inspect it?
  • Can it move across tools?
  • Can it survive a product switch?

OM's answer is plain and local. The memory files are markdown. The install state is visible. The hooks are scripts. The plugin is a directory.

This doesn't solve every enterprise governance problem. It gives teams a concrete artifact to reason about instead of an invisible summary inside one product.

The Desktop Chat boundary

Claude Desktop Chat doesn't have the same hook surface. Without hooks, OM can't automatically inject memory or observe every session the way it can with Claude Code, Codex, and Cowork.

Cowork is different because it has the plugin surface. That combination - hooks, commands, skills, MCP, audit logs - is why Cowork is the more interesting target.

The install shape

For normal users, the basic OM path stays simple:

uv tool install observational-memory
om install
om doctor

On Bryan's current dev install, om status shows Claude Code hooks, Codex hooks, the Cowork plugin, and the launchd scheduler all installed. om doctor reports the plugin hooks and scripts healthy. That status output is part of the product. Agent memory needs a boring health check.

The useful distinction

OpenAI and Anthropic are building memory into their own products. Supermemory and similar platforms are building memory APIs and context infrastructure. Zep and MemX are pushing on graph and retrieval designs.

OM's Cowork integration is smaller and more specific:

Give the enterprise desktop agent access to the same local memory that developer agents already use.

The more agent tools multiply, the more useful a shared memory layer becomes.

If Cowork becomes a common enterprise agent surface, I want memory to remain portable and inspectable. OM is the attempt to make that possible with the tools we actually use every day.