In Data migrator, Make C7 and C8 queries paginated

[yanavasileva]

Acceptance Criteria (Required on creation)

Use pagination for all C7 and C8 queries so that the Migrator doesn’t run out of memory.

• Make the C8 “migrator” jobs query activate only a fixed amount of jobs per loop. Stop looping when no “migrator” job is available anymore. This might solve looping through levels of call hierarchies described in In Data migrator, Handle multiple-levels of the call hierarchy #4998.
• Introduce pagination for IdKey queries.
• Hint: Can't reuse C7 history queries since there might be no history.
  • Add tests if this solves In Data migrator, Handle multiple-levels of the call hierarchy #4998. I.e., multiple call hierarchies.

Hints

• Time estimate: 3 days

Links

Breakdown

Pull Requests

Preview Give feedback

No tasks being tracked yet.

Dev2QA handover

• Does this ticket need a QA test and the testing goals are not clear from the description? Add a Dev2QA handover comment