Apache Parquet on cloud storage was a great first step for data lakes — but it left engineers dealing with a painful set of problems in production: On Databricks, Delta is the default table format, deeply integrated with Apache Spark, Auto Optimize, and the Photon execution engine.
Apache Parquet on cloud storage was a great first step for data lakes — but it left engineers dealing with a painful set of problems in production:
On Databricks, Delta is the default table format, deeply integrated with Apache Spark, Auto Optimize, and the Photon execution engine.
The page is ready to read now. The fuller skim-friendly version will appear here automatically.
Apache Parquet on cloud storage was a great first step for data lakes — but it left engineers dealing with a painful set of problems in production: On Databricks, Delta is the default table format, deeply integrated with Apache Spark, Auto Optimize, and the Photon execution engine.
Open the app view to save this story, compare related coverage, and continue from the same source.