Skip to main content
Run latency varies by model category and by the size/complexity of the input. Use the ballparks below to size your client behavior; for actual measurements per model, see Per-model performance.

Ballparks by category

These are full lifecycle measurements: queueddispatchingrunningsucceeded as observed via GET /v1/runs/{id}. Network round trips not included.
Use the p95 column to size client-side timeouts, not p50. A timeout below p95 will produce false-positive failures on long-tail runs that would have succeeded.

What this means for your client

Why we don’t publish per-model latency hints (yet)

A p50_seconds / p95_seconds field on GET /v1/public/models is on the public catalog discoverability plan (Phase D). Until that ships, use the category ballparks above. If you need per-model precision, the authenticated /v1/models/{id}/run-performance-stats endpoint returns aggregated stats from your org’s recent runs.

Solutions that include output evaluation

Some Solutions run a quality evaluation step on the output before returning. That step adds 2-4 minutes to the total wall-clock time on top of the underlying model run. Read each solution’s page at www.runflow.io/api for whether the solution evaluates output before returning, and use (category p95) + 4 min to size timeouts for solutions that do.

Runs

Lifecycle, statuses, output shape.

Callbacks

Skip polling entirely for long runs.

Rate limits

Quota and back-off rules.

Errors

Retry table per status code.