• persoOPM
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      Yes. Parquet files do not support deleting or adding rows, since they are immutable. So adding or removing rows requires rewriting the file. The way I see it, using this optimization we can mark rows as deleted at delta table level without having to rewrite the underlying parquet file.