Yes. Parquet files do not support deleting or adding rows, since they are immutable. So adding or removing rows requires rewriting the file. The way I see it, using this optimization we can mark rows as deleted at delta table level without having to rewrite the underlying parquet file.
Yes. Parquet files do not support deleting or adding rows, since they are immutable. So adding or removing rows requires rewriting the file. The way I see it, using this optimization we can mark rows as deleted at delta table level without having to rewrite the underlying parquet file.