Enable scrolling in search API endpoint

[berggren]

There is no way to fetch scrolled results from the API. You can set scrolling=True but you cannot pass in the scroll_id which make it impossible to build client side streaming.

https://github.com/google/timesketch/blob/cc9032059c0f58bd548400c711e2695f1e0906c1/timesketch/lib/datastores/opensearch.py#L634C9-L634C22

Adding something like:

        if enable_scroll:
            scroll_id = result["_scroll_id"]
            scroll_size = result["hits"]["total"]
        else:
            scroll_id = None
            scroll_size = 0

        return self.client.scroll(scroll_id=scroll_id, scroll="5m")

[jkppr]

Doesn't the Search class in the API client make use of this already?

If search_obj.max_entries > 10k it should send the scrolling request and request one page after the other until all data is returned: https://github.com/google/timesketch/blob/master/api_client/python/timesketch_api_client/search.py#L563