This week in Databend #26

Databend aimed to be an open source elastic and reliable cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don't want you to miss.

Features

add bloom filter for single column equivalent expression by @junli1026 (#3887)
Jwt Auth for http handler by @youngsofun (#3993)

Improvement

add partitions_scanned and partitions_total to planner statistics by @BohuTANG. (#3909)
clean up metasrv code and test by @drmingdrmer. (#3925, #3928 and more)
improve SHOW FUNCTIONS by @lianghanzhen. (#3945)
async mysql server by @PsiACE. (#3981)

Bug fixes

support escape \t \n for field_delimitor & record_delimitor by @sundy-li. (#3923)
fix pruning get error when expression is not monotonic by @zhyass. (#3940)
parallel import data error by @dantengsky. (#3964)

Experimental

new processor framework by @zhang2014. (#3380).
dal2: implement SeekableReader by @Xuanwo. (#3934).

Another key plan is that we are migrating functions to the new datavalues2 and if you are interested, you can track #3967 , which is a list of tasks.

Tips

Let's learn a weekly tip from Databend.

Analyze OnTime datasets with Databend on AWS EC2 and S3

Now, databend.rs has a learning section and will be followed by short lessons to help you understand how to use Databend better.

This article provides step-by-step instructions on how to deploy Databend on EC2 and S3 and perform analysis on the OnTime dataset.

Reporting Carrier On-Time Performance (1987-present) contains on-time arrival and departure data for non-stop domestic flights by month and year, by carrier and by origin and destination airport. Includes scheduled and actual departure and arrival times, canceled and diverted flights, taxi-out and taxi-in times, causes of delay and cancellation, air time, and non-stop distance.

Analyze OnTime datasets with Databend on AWS EC2 and S3

Changlogs

You can check the changelogs of Databend nightly to learn about our latest developments.

Ecosystem/Upstream

From open source, for open source. Our team is also committed to contributing to the Rust ecosystem and upstream dependencies.

sqllogictest-rs #15: runner: Implement validator support by @Xuanwo.
datafuse-extras/msql-srv #18: Try async: add a simple async srv implementation. by @PsiACE.

Meet Us

Please join the DatafuseLabs Community if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects.
If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues for any problems you find. We also highly appreciate any of your pull requests.