Talkpython iconTalkpythonSep 10, 2026 ~1 min source read

Talk Python to Me: #562: DuckLake: The Lakehouse That's Just SQL and Parquet

On some data lakes, you go through JSON and metadata files first, just to learn which Parquet files matter. Pedro Holanda joined DuckDB in 2018, when it was still a research prototype at CWI.

Talk Python to Me: #562: DuckLake: The Lakehouse That's Just SQL and Parquet

Share this story

Send the public story page.

Useful takeaways from this story.

On some data lakes, you go through JSON and metadata files first, just to learn which Parquet files matter.

How many files does your query read before it reads any data?

Pedro Holanda joined DuckDB in 2018, when it was still a research prototype at CWI.

Building the complete brief

The page is ready to read now. The fuller skim-friendly version will appear here automatically.

The useful part

On some data lakes, you go through JSON and metadata files first, just to learn which Parquet files matter. Pedro Holanda joined DuckDB in 2018, when it was still a research prototype at CWI. With Quack as the catalog, DuckLake handles 200 transactions a second under heavy contention.

How it works

  • How many files does your query read before it reads any data?
  • Guillermo Sanchez Dionis works on DuckLake and the new Quack protocol.

Keep reading in the app

Open the app view to save this story, compare related coverage, and continue from the same source.

Open in app