We rolled out a fresh look for duckdb.org over the last few weeks. This includes a redesigned landing page, blog posts, media collection, and the Community Extensions repository. And dark mode is now supported on all sites! ๐
DuckDB is an analytical in-process SQL database management system. It is simple, feature-rich, fast, extensible, and comes with the permissive MIT open-source license. "DuckDB" and the DuckDB logo are registered trademarks of the DuckDB Foundation.
We rolled out a fresh look for duckdb.org over the last few weeks. This includes a redesigned landing page, blog posts, media collection, and the Community Extensions repository. And dark mode is now supported on all sites! ๐
๐ฃ New post in the DuckDB tricks series
These tips can save you precious keystrokes and file scans, making both writing and running your queries faster.
One of DuckDB's key use cases is data science applications, where it's often used in combination with (or in place of) data frame libraries. These libraries often preserve row order between operations, which is also supported by DuckDB. See which operations preserve order:
https://duckdb.org/docs/sql/dialect/order_preservation
New blog post by Hannes Mรผhleisen and Mark Raasveldt:
Runtime-Extensible SQL Parsers Using PEG
https://duckdb.org/2024/11/22/runtime-extensible-parsers
This post, a shortened version of a CIDR 2025 paper, discusses how parsers in DBMSs could be re-designed using Parser Expression Grammars for extensibility and improved error reporting.
We finalized the schedule for the sixth edition of DuckCon!
We want to emphasize that DuckCon is a ๐๐ซ๐๐ event, and registration is required to attend in person. If you can't join us in person, the event will be streamed through a public stream (no registration required to watch).
Check out all the details about #DuckCon on our website: https://lnkd.in/dCE2_k5m
If you're curious about DuckCon, here is a talk from our previous edition, which took place in Seattle: https://www.youtube.com/watch?v=pY3fDhZiPDk
Find more info about the upcoming as well as previous DuckCon events on our website: https://duckdb.org/2025/01/31/duckcon6.html
๐ก๐ฒ๐ ๐ฟ๐ฒ๐น๐ฒ๐ฎ๐๐ฒ
We released DuckDB version 1.1.3, which is a bug fix release. You can find the change log here: https://github.com/duckdb/duckdb/releases/tag/v1.1.3
Follow our documentation for instructions on installing or upgrading: https://duckdb.org/docs/installation
Interested in finding out more about data wrangling with DuckDB? Be sure to watch the keynote from posit::conf, where Hannes Mรผhleisen talks about "Data Wrangling [for Python or R] Like a Boss With DuckDB": https://www.youtube.com/watch?v=GELhdezYmP0
๐๐ผ๐ป๐ฐ๐๐ฟ๐ฟ๐ฒ๐ป๐ฐ๐ ๐ฐ๐ผ๐ป๐๐ฟ๐ผ๐น ๐ฎ๐ป๐ฑ ๐น๐ผ๐ด๐ด๐ถ๐ป๐ด ๐ถ๐ป ๐๐๐ฐ๐ธ๐๐
Have you ever wondered what the .wal file is when working with DuckDB? Time to find out!
This week, the co-creators of DuckDB, Hannes Mรผhleisen and Mark Raasveldt, wrote a blog post about the Multi-Version Concurrency Control and Write-Ahead-Logging schemes designed to ensure transactional guarantees: https://duckdb.org/2024/10/30/analytics-optimized-concurrent-transactions
3 more months until the sixth edition of DuckCon, taking place in Amsterdam! Check out our event: https://www.linkedin.com/events/duckcon-67257738718894034946/
You can also find us on Bluesky. Stay up-to-date with DuckDB by following @๐๐๐๐๐๐.๐๐๐
๐๐ฎ๐ข.๐ฎ๐ถ ๐ฑ๐ฏ-๐ฏ๐ฒ๐ป๐ฐ๐ต๐บ๐ฎ๐ฟ๐ธ ๐๐ฝ๐ฑ๐ฎ๐๐ฒ๐ฑ
The ๐ง๐ค๐ฎ.๐บ๐ db-benchmark has been updated with new results: https://duckdblabs.github.io/db-benchmark/
You can find more details about the setup and the benchmark in our related blog posts: https://duckdb.org/2023/11/03/db-benchmark-update.html
๐๐ฎ๐๐๐ฒ๐ฟ ๐๐ผ๐ฝ ๐ก ๐ณ๐ผ๐ฟ ๐ฎ๐ด๐ด๐ฟ๐ฒ๐ด๐ฎ๐๐ฒ ๐ณ๐๐ป๐ฐ๐๐ถ๐ผ๐ป๐
The end of the week brings us another blog post. Alex Monahan takes a deep dive into the top N capabilities in DuckDB. Checkout how you can simplify your queries and boost performance with ๐๐๐, ๐๐๐ก aggregate functions and their advanced cousins ๐๐๐_๐๐ข and ๐๐๐ก_๐๐ข: https://duckdb.org/2024/10/25/topn
Happy Friday, everyone!
๐๐ถ๐ฟ๐๐ ๐๐๐ฐ๐ธ๐๐ ๐ ๐ฒ๐ฒ๐๐๐ฝ - ๐ฆ๐๐บ๐บ๐ฎ๐ฟ๐
Last week we hosted our first meetup, here in Amsterdam. In case you missed it, all the talks were recored and are now available on Youtube. You can find the links to the videos and the slides on our website: https://duckdb.org/2024/10/17/duckdb-amsterdam-meetup-1
Until we see you at the next meetup, make sure you register for the next DuckCon, which will take place in Amsterdam.
๐จ๐ฝ๐ฑ๐ฎ๐๐ฒ๐ ๐ผ๐ป ๐ฉ๐ฆ๐ฆ ๐๐ ๐๐ฒ๐ป๐๐ถ๐ผ๐ป
In this weekโs blog post, Max Gabrielsson dives into the details of the new features and improvements in the Vector Similarity Search Extension: https://duckdb.org/2024/10/23/whats-new-in-the-vss-extension
He talks about:
- indexing speed improvements
- index accelerated top-k aggregates
- index accelerated lateral joins
- new distance functions
In light of CVE-2024-9264, we would like to remind everyone that passing untrusted user input to DuckDB needs special care. We have a documentation page on Securing DuckDB (https://duckdb.org/docs/operations_manual/securing_duckdb/overview), which explains the details, including advice for running DuckDB in embedded mode.
๐ก๐ฒ๐ ๐๐๐ฒ๐บ ๐ถ๐ป ๐๐ต๐ฒ ๐ฆ๐ต๐ผ๐ฝ
As the chilly season approaches, we've got your backโliterally!
Our DuckDB hoodies are now available in the shop: https://shop.duckdb.org/. Perfect for staying warm this season!
๐๐ฉ๐๐๐ญ๐๐ ๐๐๐ง๐๐ก๐ฆ๐๐ซ๐ค ๐ฌ๐ฎ๐ข๐ญ๐
In this weekโs blog post, Pedro Holanda takes a deep dive into DuckDBโs CSV performance with the well-known NYC Taxi Dataset: https://duckdb.org/2024/10/16/driving-csv-performance-benchmarking-duckdb-with-the-nyc-taxi-dataset
We recognise that benchmarking is challenging, so the blog post contains detailed steps to reproduce this new benchmark. Happy coding!
Interested in DuckDBโs evolution from a research project to a mature database system?
Hannes Mรผhleisen, the co-creator of DuckDB, presented the journey of DuckDB during his keynote at @pyconde
๐๐๐ฐ ๐๐๐ฅ๐๐๐ฌ๐: ๐๐ฎ๐๐ค๐๐ ๐.๐.๐
We released DuckDB version 1.1.2, which is a bug fix release.
Curious about the change log? Here are the release notes: https://github.com/duckdb/duckdb/releases/tag/v1.1.2
Follow our documentation for instructions on installing or upgrading: https://duckdb.org/docs/installation