EXECUTIVE FINDING
The workflow holds its 2.0 s p99 budget up to 8 concurrent sessions. Above 8, tool-call retries saturate a shared connection pool and latency grows without bound.
░░░░░░░░░░░░░░░░░░▒▒▒▒▒▒▒▒▒▒┃████████████████ 1 5 8 12 STABLE DEGRADED ▲ FAILURE ▲ failure boundary · 8 concurrent sessions
- OPERATING CONDITION
- Production configuration on staging hardware; one inference endpoint; tool calls through a shared HTTP pool of 8 connections.
- OBSERVED BOUNDARY
- 8 concurrent sessions. At 9, p99 leaves the budget and does not return while load holds.
- FAILURE MECHANISM
- Retries share the pool with first attempts. At saturation, retries queue behind the requests they retry, and queue depth grows every second.
- EVIDENCE
- 12 load steps × 5 runs. Latency histograms, pool-wait traces, queue depth per second. Appendix A.
- REPRODUCTION
- Harness, seeds and configuration delivered with the report; one command re-runs every step. Appendix B.
- RECOMMENDED ACTION
- Give retries their own pool; cap retries at 2 per call with jitter; admit sessions above 8 only when the pool has headroom. Then re-examine.
- CONFIDENCE
- High. The boundary reproduced in 5 of 5 runs, within one session.