We implement rate limits to ensure the availability of the service for all.
Note - these limits do not apply if you are on a dedicated tenant, where we can work with you to devise sensible rate limits.
At the time of writing the limits are as follows:
Creation of batches
Each requesting IP is limited to 10 requests per second.
Retrieval of batches
Each requesting IP is limited to 20 requests per second.
If you exceed your allotment of requests in the time window, you will receive a 429 Too Many Requests error. You will also receive a header explaining when you may try again.
At the time of writing our TypeScript SDK does not implement backoff, but this is planned.
Currently, these limits are not modifiable, unless you are on a dedicated tenancy.