When a run fails.
Most failures are one of five things.
§1The usual five
- Network error
- The host cannot be reached, or the endpoint refuses requests that come from a browser. If it refuses browsers, this page cannot get around that.
- HTTP 401 or 403
- The key is wrong for that endpoint, or it has no access to that model.
- HTTP 429
- You hit a rate limit. Slow the run down and go again. A limited request is retried twice before it counts as failed.
- Many blank answers
- The model spent its whole allowance thinking and said nothing. Blank replies are still counted, so the two sides stay comparable, but the questions lose their edge.
- It stops early
- After 8 failures with not one success, the run gives up on that side instead of sending the rest.
→Keep reading
- Before this
- How the drift log works
- All pages
- The docs