> Data revision: baf7c2f4307d3a989a8fb9363df8000fda3d9310
> Source files:
- [EVIDENCE-MAP.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/EVIDENCE-MAP.md)

# 4.1 Provider port and test seams

> The clause text and evidence status below are from the source map. Numeric figures remain source-reported unless tied to a claim-ledger record.

**Map clause:** Provider protocol, streaming, retries, tools, and fake provider.

- **Source heading anchors:** [spec/04-provider.md#41-provider-port-and-test-seams](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/spec/04-provider.md#41-provider-port-and-test-seams); [spec/04-provider.md#42-chatgpt-responses-wire](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/spec/04-provider.md#42-chatgpt-responses-wire); [spec/04-provider.md#43-streaming](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/spec/04-provider.md#43-streaming); [spec/04-provider.md#44-error-classes](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/spec/04-provider.md#44-error-classes); [spec/04-provider.md#45-deadlines-retries-waits-fallback](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/spec/04-provider.md#45-deadlines-retries-waits-fallback); [spec/04-provider.md#46-logins-and-credentials](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/spec/04-provider.md#46-logins-and-credentials); [spec/04-provider.md#47-tools](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/spec/04-provider.md#47-tools); [spec/04-provider.md#48-fake-provider-conformance](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/spec/04-provider.md#48-fake-provider-conformance); [spec/04-provider.md#481-endpoints](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/spec/04-provider.md#481-endpoints); [spec/04-provider.md#482-roles-and-turns](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/spec/04-provider.md#482-roles-and-turns); [spec/04-provider.md#483-script-steps-json-lines](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/spec/04-provider.md#483-script-steps-json-lines)

- **Spec revision / decision reference:** v1.2 (pinned fragment locally verified); section-level D references are listed in the source classification. **Last reviewed:** 2026-10-07.
- **Type:** Safety/correctness for protocol and retry behavior; empirical for claims about harness, tool surface, latency, or task outcomes.
- **Evidence and status:** [Harness comparison](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/harness-compare-1/README.md) is **INTERIM**. [Short](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/llm-latency-short/README.md) and [long](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/llm-latency-long/README.md) latency records are **DESCRIPTIVE** client-visible timing, not task success. [X-surface](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/x-surface/README.md) is **INTERIM** with no agent-output format claim. [Grok frontier](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/grok-frontier/README.md) is **NOT-RUN**. Synthetic validation and conformance do not establish an authenticated provider comparison. Related hypotheses: H19–H38, H106–H110, H137–H138.
- **Unresolved measurement:** Authenticated, current-version provider and tool-surface comparisons with matched task, model, effort, retry policy, request accounting, venue, and official grade; test protocol edge cases separately from task efficacy.

## Related records

### Related hypotheses

- [H19](/hypotheses/h19/)
- [H38](/hypotheses/h38/)
- [H106](/hypotheses/h106/)
- [H110](/hypotheses/h110/)
- [H137](/hypotheses/h137/)
- [H138](/hypotheses/h138/)

### Related experiments

- [grok-frontier](/rounds/grok-frontier/)
- [harness-compare-1](/rounds/harness-compare-1/)
- [llm-latency-long](/rounds/llm-latency-long/)
- [llm-latency-short](/rounds/llm-latency-short/)
- [x-surface](/rounds/x-surface/)
