Release 409 (3 Mar 2023)#
General#
Add support for dropping nested fields with a
DROP COLUMN
statement. (#15975)Add queue, analysis, planning, and execution time to the output of
EXPLAIN ANALYZE
. (#16329)Add support for executing table functions with any number of table arguments. (#1839)
Improve output of
EXPLAIN
queries to show statistics when a query contains aggregations. (#16201)Improve performance of queries with aggregations containing a
DISTINCT
clause using table statistics. This can be configured with theoptimizer.mark-distinct-strategy
configuration property, and theoptimizer.use-mark-distinct
configuration property is now deprecated in favor of it. (#15927)Improve performance of LIKE expressions with patterns constructed dynamically. (#15999)
Remove the
distributed-index-joins-enabled
configuration property and related functionality. (#15375)Fix failure when using non-comparable and non-sortable values as part of a
VALUES
expression. (#16242)
BigQuery connector#
Cassandra connector#
Add support for
TIME
type. (#13063)
ClickHouse connector#
Delta Lake connector#
Hive connector#
Add support for the Hadoop
DefaultCodec
to Hive formats. (#16250)Add a native CSV file format reader and writer. These can be disabled with the
csv_native_reader_enabled
andcsv_native_writer_enabled
session properties or thecsv.native-reader.enabled
andcsv.native-writer.enabled
configuration properties. (#15918)Add a native JSON file format reader and writer. These can be disabled with the
json_native_reader_enabled
andjson_native_writer_enabled
session properties or thejson.native-reader.enabled
andjson.native-writer.enabled
configuration properties. (#15918)Add a native text file format reader and writer. These can be disabled with the
text_file_native_reader_enabled
andtext_file_native_writer_enabled
session properties or thetext-file.native-reader.enabled
andtext-file.native-writer.enabled
configuration properties. (#15918)Add a native sequence file format reader and writer. These can be disabled with the
sequence_file_native_reader_enabled
andsequence_file_native_writer_enabled
session properties or thesequence-file.native-reader.enabled
andsequence-file.native-writer.enabled
configuration properties. (#15918)Add a native regex file format reader. The reader can be disabled with the
regex_native_reader_enabled
session property or theregex.native-reader.enabled
configuration property. (#15918)Add
regex
andregex_case_insensitive
table properties for theREGEX
format. (#16271)Improve performance of queries which read from partitioned Hive tables and write to partitioned tables when statistics are not available for the source tables. (#16229)
Improve query performance when only table statistics generated by Apache Spark are available. This can be disabled via the
hive.metastore.thrift.use-spark-table-statistics-fallback
configuration property. (#16120)Fix incorrectly ignoring computed table statistics in
ANALYZE
. (#15995)Fix query failure when reading Parquet files generated by Kafka Connect. (#16264)
Hudi connector#
Fix query failure when reading Parquet files generated by Kafka Connect. (#16264)
Iceberg connector#
Add support for dropping nested fields with a
DROP COLUMN
statement. (#15975)Add support for Iceberg table sort orders. Tables can have a list of
sorted_by
columns which are used to order files written to the table. (#14891)Fix query failure when reading nested columns on a table with equality delete files. (#14836)
Fix query failure when reading Parquet files generated by Kafka Connect. (#16264)
SQL Server connector#
Add support for pushing down joins using
=
and!=
predicates over text columns if the column uses a case-sensitive collation within SQL Server. (#16185)