feat(jev): record provider and provider_attempts on jev_probe results #41

Merged
clawdie merged 1 commit from feat/jev-probe-provider-trace into main 2026-10-04 20:06:24 +02:00
Owner

Follow-up to #37/#38. jev_eval records provider and provider_attempts
on every successful result; jev_probe shares its transport but did not, so a
probe result lagged the tool it delegates to (and SKILL.md already told
callers to confirm the handling provider on a result).

Change

  • jev_probe records provider and provider_attempts on the result.
  • It resolves the primary transport only and does not fall back, so provider
    is the primary provider and provider_attempts equals the existing
    attempts count over that one endpoint.
  • No fallback loop, request hash, or policy-version field is added — shape
    parity only.
  • SKILL.md notes the new fields and the single-provider behaviour.

Verification

  • jev_probe: 29 tests (3 new), OK.
  • jev-triage total: 159 tests, OK.
  • New tests cover: Vercel primary recorded, TypeSafe preferred when both
    credentials are present, and provider_attempts counting a retry.
Follow-up to #37/#38. `jev_eval` records `provider` and `provider_attempts` on every successful result; `jev_probe` shares its transport but did not, so a probe result lagged the tool it delegates to (and `SKILL.md` already told callers to confirm the handling provider on a result). ## Change - `jev_probe` records `provider` and `provider_attempts` on the result. - It resolves the primary transport only and does not fall back, so `provider` is the primary provider and `provider_attempts` equals the existing `attempts` count over that one endpoint. - No fallback loop, request hash, or policy-version field is added — shape parity only. - `SKILL.md` notes the new fields and the single-provider behaviour. ## Verification - `jev_probe`: 29 tests (3 new), OK. - `jev-triage` total: 159 tests, OK. - New tests cover: Vercel primary recorded, TypeSafe preferred when both credentials are present, and `provider_attempts` counting a retry.
`jev_eval` records `provider` and `provider_attempts` on every successful
result; `jev_probe` did not, so its JSON shape lagged the tool it shares a
transport with (SKILL.md already told callers to confirm the handling
provider on a result).

Add both fields to the probe result. `jev_probe` resolves the primary
transport only and does not fall back, so `provider` is the primary provider
and `provider_attempts` equals the existing `attempts` count over that one
endpoint. No fallback loop, hash, or policy-version handling is added.

Verification: 29 jev_probe tests (3 new), 159 across jev-triage, OK.
Sign in to join this conversation.
No reviewers
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
clawdie/agent-skills!41
No description provided.