Amazon has acquired DuckLabs, the developer behind the open DBMS DuckDB. The acquisition was finalized on August 31, with the financial details remaining undisclosed. The team responsible for DuckDB’s development will now be part of AWS, continuing their work under the guidance of DuckLabs’ co-founders.
Amazon plans to leverage DuckDB’s innovations to modernize and enhance the analytical capabilities of the AWS platform. This includes transforming the Amazon S3 service into a storage facility with integrated data analysis functionalities. DuckDB’s codebase will remain open source under the MIT license, managed by the non-profit DuckDB Foundation. The collaboration with AWS is expected to expand DuckDB’s user base and provide resources for further enhancements to the DBMS.
DuckDB shares similarities with SQLite, offering features like compactness, embedded library connectivity, single-file database storage, and a CLI interface. It specializes in executing analytic queries efficiently, covering extensive data sets for operations such as table aggregations and merges. The DBMS supports an extended SQL dialect with advanced capabilities for handling complex and nested queries.
The project combines components from various database systems, such as SQLite’s shell, PostgreSQL’s parser, MonetDB’s Date Math, and its own window functions implementation. Additionally, it includes a query optimizer, Multi-Version Concurrency Control for job management, and a vectorized query execution engine based on the Hyper-Pipelining Query Execution algorithm for processing large data sets efficiently.