Skip to content

Add some random prefix to split ids. #4824

Open
@fulmicoton

Description

@fulmicoton

S3 creates partitions based on a prefix of the object keys.
Because we use ULID, splits coming from the same day end up on the same servers.
On the search side, most of the queries tend to target the last few days, and end up hitting the same servers.

For this reason, in some case, we can hit the per-prefix rate limiting.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions