Rate Limiting in Zoho Flow (OpenAI API)

Rate Limiting in Zoho Flow (OpenAI API)

Hi Everyone,

We are facing some issues when using Zoho Flow as we have a deluge script running which is making external calls to OpenAI endpoint. Sometimes the response takes more than 30 seconds meaning the script will timeout. We want to implement a solution to rate limit the number of executions in a Flow. An example:

- 100 executions at once
- Run first 20 executions, queue the remaining 80
- Once the first 20 have run, move to the next 20 in the queue.... etc etc.

Is there a way to do this? I understand there are several other issues related to the 30 second timeout imposed by Zoho on external API calls, is there another solution?

Thanks