Skip to content

feat(nodestore) FilestoreNodeStorage, all credits to #76250 #82126

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

rophy
Copy link

@rophy rophy commented Dec 15, 2024

See #76250 (comment)

While the original PR says "S3 Node Store", all the S3 logics actually come from configured File Store.
So I think "FilestoreNodeStorage" is probably a better term to describe the brilliant idea from @klboke

Legal Boilerplate

Look, I get it. The entity doing business as "Sentry" was incorporated in the State of Delaware in 2015 as Functional Software, Inc. and is gonna need some rights from me in order to utilize my contributions in this here PR. So here's the deal: I retain all rights, title and interest in and to my contributions, and by keeping this boilerplate intact I confirm that Sentry can use, modify, copy, and redistribute my contributions, under Sentry's choice of terms.

@github-actions github-actions bot added the Scope: Backend Automatically applied to PRs that change backend components label Dec 15, 2024
@rophy rophy force-pushed the rophy/issue-76250 branch from 3984e7c to b13f0db Compare December 15, 2024 01:42
@getsantry getsantry bot added Stale and removed Stale labels Jan 5, 2025
@getsantry getsantry bot added Stale and removed Stale labels Jan 28, 2025
@getsantry getsantry bot added the Stale label Feb 20, 2025
@cleptric
Copy link
Member

Any chance you could add some tests for this?

@rophy
Copy link
Author

rophy commented Apr 14, 2025

Any chance you could add some tests for this?

Sure, I'll try to put up something over a weeekend.

@rophy
Copy link
Author

rophy commented Apr 14, 2025

Note that this, when used with s3-compatible object storage such as MinIO, will result in buckets with "lots of small files".

I actually enabled this internally in my on-premise envs. Performance of the MinIO turned out to be horrible after certain volume.

@cleptric cleptric added WIP and removed Stale labels Apr 14, 2025
@getsentry getsentry deleted a comment from getsantry bot Apr 14, 2025
@getsentry getsentry deleted a comment from getsantry bot Apr 14, 2025
@getsentry getsentry deleted a comment from getsantry bot Apr 14, 2025
@rophy
Copy link
Author

rophy commented Apr 20, 2025

Added a few tests.

Since the implementation does not actually rely on S3Filestore logics, the tests do not configure anything specific for S3, and is ran against default Filestore which I think is a wapper of Django File.

@rophy rophy force-pushed the rophy/issue-76250 branch from da93a79 to 168a90a Compare April 20, 2025 09:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Scope: Backend Automatically applied to PRs that change backend components WIP
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants