I have a REST connection which I would like to load all the data. Now I'm unable to load all efficiently as I cant configure pagination properly.

In connection I use a parameter called offset, which is a value received in each message. In first message the value is 210187316 and in next message the value is 282787688 (seems to be some random number). example of the json below. In message there is also this hasMore attribute which tells if more data is available.

[
  {
    "results": [
      {    
    "hasMore": true,
    "offset": 210187316
  }
]

I have tried to use a parameter in connection like &offset={offset} and then defined this pagination so that it is a queryparameter {offset} and range 0 to infinity and offset 20 which is actually working except I receive thousands of duplicates and it takes forever to complete. Endcondition I have like $.offset and Const and false and it works.

How to configure this pagination so that it uses this offset value coming in each message for the next query to receive all data just once?