Skip to main content
ConeReplay
Bespoke pilot service

Custom training environments for your AI agents.

We build a sandboxed environment of your operations domain and a replay-backed eval suite on top of ConeReplay, so you can measure whether a policy or agent change actually improves outcomes - before it touches production.

What a pilot delivers.

  1. 1

    A sandboxed environment of your domain

    Versioned observation/action schema, seeded fixtures, bounded episodes. No production credentials, no network, no clock - the same seed always produces the same world.

  2. 2

    Gold and adversarial trajectories

    A gold trajectory that scores full reward, plus adversarial and invalid trajectories with known outcomes - so the reward function is tested, not assumed.

  3. 3

    A replay-backed eval suite

    One command runs your policy set over fixed seeds. Every episode is captured as a ConeReplay trace; the report carries reward distributions, failure reasons, and trace-level divergence between policies. Two runs are byte-identical.

Candidate domains.

Status labels are literal: “runnable today” means the code is in the public repo with tests; “spec stage” means design only. Your domain does not need to be on this list - scoping a new one is the pilot.

DevOps incident response

Reference environment runnable today

Diagnose a seeded incident from fake telemetry: logs, metrics, deploys. Built as the open reference in the ConeReplay repo, with a before/after eval proof (injected regression detected and attributed).

E-commerce operations

Template built

Find and fix seeded faults in a synthetic catalog and order book - mispriced SKUs, oversold stock, stuck orders - without touching healthy records. Synthetic data only.

Code review

Spec stage - possible custom domain

Review seeded PRs in sandbox repos with real test execution. Specced, not built; would be scoped as bespoke pilot work.

How a pilot runs.

Discovery call, then a fixed-scope statement of work, then the build, then an evidence handoff: the environment, the eval suite, and the traces. We quote only after discovery - there is no standard price, and we do not claim training gains we have not measured on your workload.

  • You run a post-training, eval, or platform team with an agent in or near production.
  • You have recorded traces, or a workflow you can describe concretely enough to fixture.
  • You need reproducible evidence a policy change helps - not a benchmark from someone else's stack.

Start a pilot inquiry.

Email hello@conereplay.com with a sentence about your agent and the workflow you want to measure. Your inquiry goes to our team inbox and is used only to reply about the pilot.

Start a pilot inquiry