- 10 requests per second per key, with bursts up to 10.
- Retry
model_warming,upstream_errorandrate_limitedwith exponential backoff. Don’t retry 4xx input errors. - Allow up to 60 seconds per request. The first call after a quiet spell can be slow while the detector starts.
Reference
Limits and retries
Rate limits, timeouts and what to retry.