Skip to content

[Materialized Views] Support more intelligent/adaptive MV Refresh #56973

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
LiShuMing opened this issue Mar 17, 2025 · 1 comment · May be fixed by #59590
Open

[Materialized Views] Support more intelligent/adaptive MV Refresh #56973

LiShuMing opened this issue Mar 17, 2025 · 1 comment · May be fixed by #59590
Labels
type/enhancement Make an enhancement to StarRocks

Comments

@LiShuMing
Copy link
Contributor

Enhancement

  1. MV's partition_refresh_number property has been set 1 since SR 3.3, but this can be efficient if there are too many partitions to fresh and per-partition contains no more rows. We may introduce a more adaptive method to adjust this by the base table data info.
  2. we may also make task_runs_concurrency more adaptive either.
@LiShuMing LiShuMing added the type/enhancement Make an enhancement to StarRocks label Mar 17, 2025
@LiShuMing LiShuMing mentioned this issue Apr 16, 2025
Open
1 task
@hongkunxu
Copy link
Contributor

That's a great idea! I'll proceed with the development based on it.

@hongkunxu hongkunxu mentioned this issue Apr 24, 2025
Merged
24 tasks
@hongkunxu hongkunxu linked a pull request Jun 4, 2025 that will close this issue
Open
24 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type/enhancement Make an enhancement to StarRocks
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Enhancement] Support more intelligent/adaptive MV Refresh hongkunxu/starrocks
2 participants
@LiShuMing @hongkunxu