Yes. Parquet files do not support deleting or adding rows, since they are immutable. So adding or removing rows requires rewriting the file. The way I see it, using this optimization we can mark rows as deleted at delta table level without having to rewrite the underlying parquet file.
Is this just tombstones “reinvented”? https://en.wikipedia.org/wiki/Tombstone_(data_store)
Yes. Parquet files do not support deleting or adding rows, since they are immutable. So adding or removing rows requires rewriting the file. The way I see it, using this optimization we can mark rows as deleted at delta table level without having to rewrite the underlying parquet file.