Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Merge issue about large data part with lightweight delete #56728

@jewelzqiu

Description

@jewelzqiu

Use case

When a data part is larger than max_bytes_to_merge_at_max_space_in_pool, lightweight deleted data inside the data part will never be really deleted unless OPTIMIZE FINAL is executed.

Describe the solution you'd like

When selecting parts to merge, use estimated existed rows size
(bytes_on_disk * (rows_count - lwd_rows_count) / rows_count) as the source part size instead of bytes_on_disk.
We can enable this mode only when deleted rows ratio exceeds a certain value (maybe 25%).

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions