• persoOPM
    link
    fedilink
    arrow-up
    1
    ·
    1 year ago

    Yes. Parquet files do not support deleting or adding rows, since they are immutable. So adding or removing rows requires rewriting the file. The way I see it, using this optimization we can mark rows as deleted at delta table level without having to rewrite the underlying parquet file.