How to setup API Action paging?

kfawcett · February 11, 2022, 5:39pm

Are there any posts or guides to setting up paging to retrieve data from a 3rd-party API and saving it into the database?

The API I’m attempting to pull data from only provides an offset and limit and doesn’t tell me what the next page is. I am able to get a count of items I need to get from another API before I call the API I need to get the paged data from.

sid · February 11, 2022, 5:46pm

Usually the offset is fixed in such APIs. So you can just call count API to get the total number of pages. Then use a repeat with that count, and the repeat will just repeat itself that many times.

You can make use of variables (set value) declared outside the repeat to use for offset and limit. Declare them outside, use in API step (URL or body, wherever) inside the repeat and finally update the variables after API call step.

kfawcett · February 11, 2022, 5:50pm

Like this? A repeat for API and then a Repeat for database insert of records returned in API?

sid · February 11, 2022, 5:53pm

Yes. Looks good.

kfawcett · February 12, 2022, 5:03pm

To close the loop on this. I had to use a Set Value “Count” for the offset and add to it during every repeat.

I used that inside of the API to increase the offset each time.