Libra CodeHub

CedarCopilot/cedar-mail

Branch: staging

audit(warp): data audit , process map, canonicalization + Turbopuffer parity tooling

merged#2593CedarCopilot

CedarCopilot wants to merge 4 commits into staging from audit/warp-data-audit

Live on prod, no production signal yetTimeline and evidence
  1. Opened
    Aug 26, 2026, 1:47 PM
  2. Aug 30, 2026, 5:23 PM
  3. Merged
    Aug 30, 2026, 6:33 PM
  4. Live on prod
    Aug 30, 2026, 6:33 PM
  5. Observed 2 days
    Aug 30, 2026, 6:33 PM
  6. Pipelines steady after this deploy
    Aug 30, 2026, 6:33 PM
  7. Unobserved

    Live on prod, no production signal yet

    Sep 2, 2026, 5:41 PM

Behaviors Libra is checking

Deal-intelligence analysis agents will apply the drafting house style consistently to Slack findings, threaded replies, and rendered HTML artifacts, including avoiding bold lead-ins, generic section labels, em dashes, filler, and prohibited vocabulary.Degradedlow confidence

Strict CloudWatch fallback found 5 prod failure log lines for [processIncomingSlackChannelData] Error processing channel (No valid connection tokens found for user <id>) in the last 24h while checking process, deltas, readme, nextsteps, usecases.

prod, checked Sep 2, 2026, 4:41 PM
Operators can bring every AOP row for an organization up to the canonical background-field taxonomy by additively applying defaults, pruning legacy `_ii_` fields, and preserving existing per-organization tuning.Degradedlow confidence

Strict CloudWatch fallback found 5 prod failure log lines for [processIncomingSlackChannelData] Error processing channel (No valid connection tokens found for user <id>) in the last 24h while checking /server, /seed-org-background-fields.ts, applied, customfielddefinitions.

prod, checked Sep 2, 2026, 5:41 PM
Operators can apply a shared canonicalization map to judgment-plane field changes by matching raw or normalized proposals, relabeling only values still equal to `other`, and clearing the corresponding proposed labels in place.Degradedlow confidence

Strict CloudWatch fallback found 5 prod failure log lines for [processIncomingSlackChannelData] Error processing channel (No valid connection tokens found for user <id>) in the last 24h while checking fieldname, process, deltas, readme, nextsteps.

prod, checked Sep 2, 2026, 5:41 PM
Operators can scan versioned judgment rows, discover every field-and-vocabulary key carrying proposed labels, and receive proposal rankings by deal recurrence and row count without modifying the extracted data.Degradedlow confidence

Strict CloudWatch fallback found 5 prod failure log lines for [processIncomingSlackChannelData] Error processing channel (No valid connection tokens found for user <id>) in the last 24h while checking process, deltas, readme, nextsteps, usecases.

prod, checked Sep 2, 2026, 3:41 PM
The extraction workflow will support `skipInstance:true` so an interrupted run can rerun the judgment phase without repeating completed instance extractions.Degradedlow confidence

Strict CloudWatch fallback found 5 prod failure log lines for [processIncomingSlackChannelData] Error processing channel (No valid connection tokens found for user <id>) in the last 24h while checking skipinstance, judgment, process, deltas, readme.

prod, checked Sep 2, 2026, 4:41 PM
Operators can perform a read-only, conversation-scoped Turbopuffer parity check that compares instance-plane document IDs against Postgres and identifies both missing embeddings and stale orphan documents.Not checked
prod

Libra has verdicts on 0 of 9 tracked behaviors on prod; 9 are still being checked. Libra has 5 low-confidence degraded verdicts it is still confirming. Libra checks hourly for 3 days after each deploy.

The Warp new-business data audit (Kendall / Will / John, Feb,Aug 2026): the requirements + data-problems record, the regeneration tools, backing data, and the process-map artifact.

Depends on nothing; sibling to #2592 (the two stage-inference fixes this audit surfaced), which is separate so those logic changes get read on their own.

Findings, for anyone opening the artifact cold

  • Win rate collapses monotonically with company size , 54% under 10 employees · 8% at 11,50 · 3% at 51,150 · 0% of 52 deals above 150. Not a low rate above 150 , none.
  • The crude rep ranking is a segment-mix artifact and inverts. Crude: John 42% / Kendall 16% / Will 12%. Standardized to a common mix: Will 34% / John 33% / Kendall 22%. John's book is 76% companies under 10; Will's is 76% above 50. These three should never be compared on crude win rate.
  • One leak dominates. 96% of deals reach a demo, 62% of those never get a proposal, and 78% of proposals close. That is a qualification problem, not a closing problem.

Ground truth is Salesforce IsWon/IsClosed, with the February Attio migration import excluded , those deals were created and closed in the same batch and inflate every rate.

The part that isn't Warp-specific

ScriptWhat it does
scripts/tpuf-parity.tsRead-only Turbopuffer↔Postgres parity for an org. Instance plane compared by id, not by count, so an offsetting pair of errors can't hide; judgment plane by count (snapshots are keyed by snapshot id , nothing to join on).
scripts/tpuf-reconcile.tsTargeted repair , deletes orphaned embeddings, embeds missing rows, scoped to a conversation set, dry-run by default.

These exist because of a structural bug worth knowing about: every taxonomy rewrite deletes and re-inserts, minting new Postgres ids, so any generation whose paired Turbopuffer delete failed is orphaned rather than overwritten. It survives carrying superseded content, and semantic reads keep returning it.

On Warp that was 2,694 orphans across 188 conversations, 87% still holding pre-canonicalization values against 15.4% in Postgres. Nothing in the write path detects it. Now reconciled , instance 12,392 = 12,392, judgment 1,862 = 1,862, 0 missing / 0 stale.

reconcile-turbopuffer.ts was not used: it deletes every instance embedding in the namespace and re-embeds the whole org (~12k needless embedding calls, org-wide blast radius) and is hardcoded to the Pirros org.

Also

  • canonicalize-judgment.mjs , the instance-plane canonicalizer globs rows_*.json only, so a customer vocab living on a versioned field was invisible to it and silently never canonicalized. Real case: qual.business_outcome.value_driver, 235 assessments across 153 deals, 100% other, reported as "0 moments" because the harvest was looking in the wrong plane.
  • extract-workflow.js , skipInstance flag, so the judgment plane can be re-run alone instead of redoing a completed instance extraction.
  • PROCESS-DELTAS delta 13 , zero-seed vocab: extract first and canonicalize after, rather than requiring the vocabulary up front.

Reproducibility

docs/audits/warp/tools/ regenerates the artifact end to end. audit-quotes.py sweeps every shipped quote and play exhibit (4,019 sides) for speaker mis-attribution, cross-plane duplicates, filler, fragments and truncation, and exits non-zero on a blocking class , currently zero in all seven classes. scratch/ is excluded per the data-audit skill's placement rule (recomputable intermediates and raw dumps).

One thing to check before this goes to the customer

The artifact's brand palette is inferred, not sourced. --accent:#4338CA and the logo mark were designed to fit Warp's positioning; warp.co serves its CSS externally so I couldn't read the real values. Everything brand-related is isolated in tools/warp-shell.html , swap the tokens and rebuild.

🤖 Generated with [Claude Code](https:/

Show production surfaces and changed-file mapping

Production surfaces

Libra has not measured any production surfaces for this change yet.

Changed files → surfaces

  • .claude/skills/data-audit/PROCESS-DELTAS.mdno production surface mapped
  • .oxlintrc.jsonno production surface mapped
  • apps/server/.claude/skills/deal-intelligence-analysis/resources/answer-format.mdno production surface mapped
  • apps/server/scripts/run-tpuf-parity.mjsno production surface mapped
  • apps/server/scripts/run-tpuf-reconcile.mjsno production surface mapped
  • apps/server/scripts/seed-org-background-fields.tsno production surface mapped
  • apps/server/scripts/taxonomy-eval/canonicalize-judgment.mjsno production surface mapped
  • apps/server/scripts/taxonomy-eval/extract-workflow.jsno production surface mapped
  • apps/server/scripts/tpuf-parity.tsno production surface mapped
  • apps/server/scripts/tpuf-reconcile.tsno production surface mapped
  • docs/audits/warp/README.mdno production surface mapped
  • docs/audits/warp/artifacts/warp-process-map.htmlno production surface mapped
  • docs/audits/warp/build_sections.pyno production surface mapped
  • docs/audits/warp/cluster_objections.pyno production surface mapped
  • docs/audits/warp/clusters.pyno production surface mapped
  • docs/audits/warp/conventions.pyno production surface mapped
  • docs/audits/warp/data/atoms/business.jsonno production surface mapped
  • docs/audits/warp/data/atoms/competitive.jsonno production surface mapped
  • docs/audits/warp/data/atoms/discovery.jsonno production surface mapped
  • docs/audits/warp/data/atoms/features.jsonno production surface mapped
  • docs/audits/warp/data/atoms/multithreading.jsonno production surface mapped
  • docs/audits/warp/data/atoms/nextSteps.jsonno production surface mapped
  • docs/audits/warp/data/atoms/objections.jsonno production surface mapped
  • docs/audits/warp/data/atoms/pitch.jsonno production surface mapped
  • docs/audits/warp/data/atoms/pricing.jsonno production surface mapped
  • docs/audits/warp/data/atoms/useCases.jsonno production surface mapped
  • docs/audits/warp/data/audit-deal-set.csvno production surface mapped
  • docs/audits/warp/data/base_rates.jsonno production surface mapped
  • docs/audits/warp/data/canon-coverage.txtno production surface mapped
  • docs/audits/warp/data/canon-map-judgment.jsonno production surface mapped
  • docs/audits/warp/data/canon-map.jsonno production surface mapped
  • docs/audits/warp/data/canon-vocab.jsonno production surface mapped
  • docs/audits/warp/data/deal-meetings.csvno production surface mapped
  • docs/audits/warp/data/deal_dimensions.jsonno production surface mapped
  • docs/audits/warp/data/deal_stages.jsonno production surface mapped
  • docs/audits/warp/data/extraction-footprint.csvno production surface mapped
  • docs/audits/warp/data/extraction-wave-plan.csvno production surface mapped
  • docs/audits/warp/data/judgment_history.jsonno production surface mapped
  • docs/audits/warp/data/lenses.jsonno production surface mapped
  • docs/audits/warp/data/section_business.jsonno production surface mapped
  • docs/audits/warp/data/section_competitive.jsonno production surface mapped
  • docs/audits/warp/data/section_discovery.jsonno production surface mapped
  • docs/audits/warp/data/section_features.jsonno production surface mapped
  • docs/audits/warp/data/section_multithreading.jsonno production surface mapped
  • docs/audits/warp/data/section_nextSteps.jsonno production surface mapped
  • docs/audits/warp/data/section_objections.jsonno production surface mapped
  • docs/audits/warp/data/section_pitch.jsonno production surface mapped
  • docs/audits/warp/data/section_pricing.jsonno production surface mapped
  • docs/audits/warp/data/section_useCases.jsonno production surface mapped
  • docs/audits/warp/data/sf-opportunity-stages.jsonno production surface mapped
  • docs/audits/warp/data/sf-stage-transitions.jsonno production surface mapped
  • docs/audits/warp/dims.pyno production surface mapped
  • docs/audits/warp/judgment.pyno production surface mapped
  • docs/audits/warp/pb.cssno production surface mapped
  • docs/audits/warp/pb.jsno production surface mapped
  • docs/audits/warp/playbook.pyno production surface mapped
  • docs/audits/warp/pm.cssno production surface mapped
  • docs/audits/warp/pull.pyno production surface mapped
  • docs/audits/warp/sales-process/CLAUDE.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/business.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/competitive.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/discovery.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/features.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/judgment-deal-risk.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/judgment-deal-thesis.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/judgment-meddpicc-decision_criteria.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/judgment-meddpicc-decision_process.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/judgment-meddpicc-pain.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/judgment-qual-business_outcome.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/judgment-qual-current_solution.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/judgment-qual-gap.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/multithreading.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/nextSteps.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/objections.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/pitch.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/pricing.mdno production surface mapped
  • docs/audits/warp/sales-process/chapters/useCases.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/README.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/SKILL.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/answer-format.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/artifact-presentation.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/choosing-quotes.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/escalation.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/examples.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/extra-tagging.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/house-style.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/lever-search.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/method-call-quality-judge.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/metrics.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/operationalize-and-approximate.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/qualitative-nuance.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/selecting-deals.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/source-transcript-policy.mdno production surface mapped
  • docs/audits/warp/sales-process/conventions/visuals.mdno production surface mapped
  • docs/audits/warp/sales-process/deals.jsonno production surface mapped
  • docs/audits/warp/sales-process/lenses.mdno production surface mapped
  • docs/audits/warp/sales-process/raw/business.jsonlno production surface mapped
  • docs/audits/warp/sales-process/raw/competitive.jsonlno production surface mapped
  • docs/audits/warp/sales-process/raw/discovery.jsonlno production surface mapped
  • docs/audits/warp/sales-process/raw/features.jsonlno production surface mapped
  • docs/audits/warp/sales-process/raw/judgment_history.jsonlno production surface mapped
  • docs/audits/warp/sales-process/raw/multithreading.jsonlno production surface mapped
  • docs/audits/warp/sales-process/raw/nextSteps.jsonlno production surface mapped
  • docs/audits/warp/sales-process/raw/objections.jsonlno production surface mapped
  • docs/audits/warp/sales-process/raw/pitch.jsonlno production surface mapped
  • docs/audits/warp/sales-process/raw/pricing.jsonlno production surface mapped
  • docs/audits/warp/sales-process/raw/section_business.jsonno production surface mapped
  • docs/audits/warp/sales-process/raw/section_competitive.jsonno production surface mapped
  • docs/audits/warp/sales-process/raw/section_discovery.jsonno production surface mapped
  • docs/audits/warp/sales-process/raw/section_features.jsonno production surface mapped
  • docs/audits/warp/sales-process/raw/section_multithreading.jsonno production surface mapped
  • docs/audits/warp/sales-process/raw/section_nextSteps.jsonno production surface mapped
  • docs/audits/warp/sales-process/raw/section_objections.jsonno production surface mapped
  • docs/audits/warp/sales-process/raw/section_pitch.jsonno production surface mapped
  • docs/audits/warp/sales-process/raw/section_pricing.jsonno production surface mapped
  • docs/audits/warp/sales-process/raw/section_useCases.jsonno production surface mapped
  • docs/audits/warp/sales-process/raw/useCases.jsonlno production surface mapped
  • docs/audits/warp/seg.pyno production surface mapped
  • docs/audits/warp/stages.pyno production surface mapped
  • docs/audits/warp/tools/assemble-map.pyno production surface mapped
  • docs/audits/warp/tools/audit-quotes.pyno production surface mapped
  • docs/audits/warp/tools/build-canon-map.pyno production surface mapped
  • docs/audits/warp/tools/build-funnel.pyno production surface mapped
  • docs/audits/warp/tools/build-process-map.pyno production surface mapped
  • docs/audits/warp/tools/dedupe-manifest.pyno production surface mapped
  • docs/audits/warp/tools/normalize-json-transcripts.pyno production surface mapped
  • docs/audits/warp/tools/seed-canon-vocab.pyno production surface mapped
  • docs/audits/warp/tools/sf-widget.js.tmplno production surface mapped
  • docs/audits/warp/tools/splice-render.pyno production surface mapped
  • docs/audits/warp/tools/warp-copy.jsonno production surface mapped
  • docs/audits/warp/tools/warp-landing.jsno production surface mapped
  • docs/audits/warp/tools/warp-shell.htmlno production surface mapped
  • docs/audits/warp/warp-2026-08-25-requirements.mdno production surface mapped
  • docs/audits/warp/warp-sales-playbook.htmlno production surface mapped
  • docs/audits/warp/wiki.pyno production surface mapped
  • docs/sales-playbook/ANATOMY.mdno production surface mapped
  • docs/sales-playbook/PROPOSAL-agent-wiki.mdno production surface mapped
  • docs/sales-playbook/PROTOTYPE.mdno production surface mapped
  • docs/sales-playbook/SPEC.mdno production surface mapped