TeachReplay

TeachReplay

Teach once, replay anywhere.

A harness-agnostic Teach-by-Demonstration engine. Show a workflow once — clicks, typed values, shell commands — and it becomes a reusable, parameterized skill, replayed later with different inputs and an explicit success or failure.

GitHub v0.2.0
TeachReplay demo — teach, compile, change parameters, replay, success

26-second walkthrough · click for HD · teachreplay-demo.mp4

How it works

  1. Teachstart recording, demonstrate the task once
  2. →
  3. Recordsemantic events become a versioned trajectory
  4. →
  5. Compilea deterministic compiler builds a parameterized skill
  6. →
  7. Replaydeterministic execution with per-step checks
  8. →
  9. Verifyan explicit verdict — never silent success

Highlights

Harness-agnostic

Zero OpenMausBot dependencies, enforced by a test. Adapters contribute backends and stores only.

GUI + CLI workflows

Shell commands recorded with real exit codes replay beside browser steps.

Parameterized skills

Demonstrated values become inputs — your values are the defaults.

Explicit verification

Success requires the recorded condition to hold; failures say which step broke.

Real remote computers

Validated on live Linux boxes over SSH — GUI and shell in one workflow.

Semantic grounding

Roles and names, not pixels — mild UI drift tolerated, severe drift fails loudly.

Package overview

The core depends on nothing but Node.js — enforced by an automated independence test. Adapters contribute backends, stores, and event sinks only.

◆@teachreplay/coretrajectory schema · recorder · parameterized skill compiler · parameter substitution · replay engine · verifier · file stores · createTeachRuntime
◆@teachreplay/remotegeneric SSH Linux computer backend (Xvfb + Chrome DevTools) with GUI + shell channels
◆@teachreplay/mockdeterministic in-memory demo computer for tests and local demos
◆@teachreplay/adapter-dshDeepSeek Harness plugin registering teach_* tools

Integrations

StandalonecreateTeachRuntime + demo computer — no harness needed
OpenMausBotthin reference adapter — TeachReplay-OpenMausBot
DeepSeek Harnessverified plugin — teach_* tools via real DSH dispatch

Quick start

~/TeachReplay 
# clone and install
git clone https://github.com/Ottohere-Mourn/TeachReplay.git
cd TeachReplay
pnpm install

# build, then try it
pnpm build
pnpm demo        # record → compile → change parameters → replay → verify
pnpm test        # 50 tests, including the zero-harness-dependency invariant
pnpm typecheck

Runs entirely on the built-in demo computer — no credentials, no network, no harness.

Known limitations