avoiding shuffle when the SortMerge Join transforms to BroadcastHash Join after applying the AQE rules. Dynamically Coalesce Shuffle Partitions Without this feature, Spark itself could be a small files an empty LocalRelation. Disabling the Hidden Features We can exclude some of the AQE additional rules if performance regression or bug occurs. For example, SET spark.sql.adaptive.optimizer.excludedRules=org end-users dynamically at runtime. Extensions for Spark Z-Ordering Support Auxiliary Optimization Rules Kyuubi Spark AuthZ Plugin Auxiliary SQL Functions Connectors for Spark SQL Query Engine Extensions

avoiding shuffle when the SortMerge Join transforms to BroadcastHash Join after applying the AQE rules. Dynamically Coalesce Shuffle Partitions Without this feature, Spark itself could be a small files an empty LocalRelation. Disabling the Hidden Features We can exclude some of the AQE additional rules if performance regression or bug occurs. For example, SET spark.sql.adaptive.optimizer.excludedRules=org end-users dynamically at runtime. Extensions for Spark Z-Ordering Support Auxiliary Optimization Rules Kyuubi Spark AuthZ Plugin Auxiliary SQL Functions Connectors for Spark SQL Query Engine Extensions

avoiding shuffle when the SortMerge Join transforms to BroadcastHash Join after applying the AQE rules. Dynamically Coalesce Shuffle Partitions Without this feature, Spark itself could be a small files an empty LocalRelation. Disabling the Hidden Features We can exclude some of the AQE additional rules if performance regression or bug occurs. For example, SET spark.sql.adaptive.optimizer.excludedRules=org end-users dynamically at runtime. Extensions for Spark Z-Ordering Support Auxiliary Optimization Rules Kyuubi Spark AuthZ Plugin Auxiliary SQL Functions Connectors for Spark SQL Query Engine SQL Lineage

avoiding shuffle when the SortMerge Join transforms to BroadcastHash Join after applying the AQE rules. Dynamically Coalesce Shuffle Partitions Without this feature, Spark itself could be a small files an empty LocalRelation. Disabling the Hidden Features We can exclude some of the AQE additional rules if performance regression or bug occurs. For example, Best Practices for Applying AQE to Kyuubi end-users dynamically at runtime. Extensions for Spark Z-Ordering Support Auxiliary Optimization Rules Kyuubi Spark AuthZ Plugin Auxiliary SQL Functions Connectors for Spark SQL Query Engine SQL Lineage

avoiding shuffle when the SortMerge Join transforms to BroadcastHash Join after applying the AQE rules. Dynamically Coalesce Shuffle Partitions Without this feature, Spark itself could be a small files an empty LocalRelation. Disabling the Hidden Features We can exclude some of the AQE additional rules if performance regression or bug occurs. For example, SET spark.sql.adaptive.optimizer.excludedRules=org end-users dynamically at runtime. Extensions for Spark Z-Ordering Support Auxiliary Optimization Rules Kyuubi Spark AuthZ Plugin Auxiliary SQL Functions Connectors for Spark SQL Query Engine SQL Lineage

avoiding shuffle when the SortMerge Join transforms to BroadcastHash Join after applying the AQE rules. Dynamically Coalesce Shuffle Partitions Without this feature, Spark itself could be a small files an empty LocalRelation. Disabling the Hidden Features We can exclude some of the AQE additional rules if performance regression or bug occurs. For example, Best Practices for Applying AQE to Kyuubi end-users dynamically at runtime. Extensions for Spark Z-Ordering Support Auxiliary Optimization Rules Kyuubi Spark AuthZ Plugin Auxiliary SQL Functions Connectors for Spark SQL Query Engine SQL Lineage

avoiding shuffle when the SortMerge Join transforms to BroadcastHash Join after applying the AQE rules. Dynamically Coalesce Shuffle Partitions Without this feature, Spark itself could be a small files an empty LocalRelation. Disabling the Hidden Features We can exclude some of the AQE additional rules if performance regression or bug occurs. For example, Best Practices for Applying AQE to Kyuubi end-users dynamically at runtime. Extensions for Spark Z-Ordering Support Auxiliary Optimization Rules Kyuubi Spark AuthZ Plugin Auxiliary SQL Functions Connectors for Spark SQL Query Engine SQL Lineage

avoiding shuffle when the SortMerge Join transforms to BroadcastHash Join after applying the AQE rules. Dynamically Coalesce Shuffle Partitions Without this feature, Spark itself could be a small files an empty LocalRelation. Disabling the Hidden Features We can exclude some of the AQE additional rules if performance regression or bug occurs. For example, SET spark.sql.adaptive.optimizer.excludedRules=org INSERT OVERWRITE TABLE t1 PARTITION() ...; CREATE TABLE t1 AS SELECT ...; Auxiliary Optimization Rules Kyuubi provides SQL extension out of box. Due to the version compatibility with Apache Spark, currently

avoiding shuffle when the SortMerge Join transforms to BroadcastHash Join after applying the AQE rules. Dynamically Coalesce Shuffle Partitions Without this feature, Spark itself could be a small files an empty LocalRelation. Disabling the Hidden Features We can exclude some of the AQE additional rules if performance regression or bug occurs. For example, SET spark.sql.adaptive.optimizer.excludedRules=org INSERT OVERWRITE TABLE t1 PARTITION() ...; CREATE TABLE t1 AS SELECT ...; Auxiliary Optimization Rules Kyuubi provides SQL extension out of box. Due to the version compatibility with Apache Spark, currently

avoiding shuffle when the SortMerge Join transforms to BroadcastHash Join after applying the AQE rules. Dynamically Coalesce Shuffle Partitions Without this feature, Spark itself could be a small files an empty LocalRelation. Disabling the Hidden Features We can exclude some of the AQE additional rules if performance regression or bug occurs. For example, SET spark.sql.adaptive.optimizer.excludedRules=org INSERT OVERWRITE TABLE t1 PARTITION() ...; CREATE TABLE t1 AS SELECT ...; Auxiliary Optimization Rules Kyuubi provides SQL extension out of box. Due to the version compatibility with Apache Spark, currently