engines’ executors’ elastic scaling. The Basics of Dynamic Resource Allocation Spark provides a mechanism to dynamically adjust the application resources based on the workload, which means that an application Deploying Kyuubi 75 Kyuubi, Release 1.3.0 6.3 Kyuubi Security Overview 6.3.1 Kyuubi Authentication Mechanism In a secure cluster, services should be able to identify and authenticate callers. As the fact sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid creden- tials provided (Mechanism level: Failed to find any Kerberos tgt)]; org.apache.hadoop.security.AccessControlException: Permission

engines’ executors’ elastic scaling. The Basics of Dynamic Resource Allocation Spark provides a mechanism to dynamically adjust the application resources based on the workload, which means that an application Deploying Kyuubi 75 Kyuubi, Release 1.3.0 6.3 Kyuubi Security Overview 6.3.1 Kyuubi Authentication Mechanism In a secure cluster, services should be able to identify and authenticate callers. As the fact sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid creden- tials provided (Mechanism level: Failed to find any Kerberos tgt)]; org.apache.hadoop.security.AccessControlException: Permission

executors’ elastic scaling. 2.1.1. The Basics of Dynamic Resource Allocation Spark provides a mechanism to dynamically adjust the application resources based on the workload, which means that an application Ticket 2.3. Configurations 2.4. Further Readings 3. ACL Management Guide 1. Kyuubi Authentication Mechanism In a secure cluster, services should be able to identify and authenticate callers. As the fact sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]; 3.1.4. org.apache.hadoop.security.AccessControlException:

engines’ executors’ elastic scaling. 1.1. The Basics of Dynamic Resource Allocation Spark provides a mechanism to dynamically adjust the application resources based on the workload, which means that an application Ticket 2.3. Configurations 2.4. Further Readings 3. ACL Management Guide 1. Kyuubi Authentication Mechanism In a secure cluster, services should be able to identify and authenticate callers. As the fact sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]; 3.1.4. org.apache.hadoop.security.AccessControlException:

Kyuubi, Release 1.4.1-incubating The Basics of Dynamic Resource Allocation Spark provides a mechanism to dynamically adjust the application resources based on the workload, which means that an application 82 Chapter 6. High Availability Kyuubi, Release 1.4.1-incubating 6.3.1 Kyuubi Authentication Mechanism In a secure cluster, services should be able to identify and authenticate callers. As the fact sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid creden- tials provided (Mechanism level: Failed to find any Kerberos tgt)]; org.apache.hadoop.security.AccessControlException: Permission

Availability Kyuubi, Release 1.3.0 The Basics of Dynamic Resource Allocation Spark provides a mechanism to dynamically adjust the application resources based on the workload, which means that an application Security Overview 82 Chapter 6. High Availability Kyuubi, Release 1.3.0 6.3.1 Kyuubi Authentication Mechanism In a secure cluster, services should be able to identify and authenticate callers. As the fact sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid creden- tials provided (Mechanism level: Failed to find any Kerberos tgt)]; org.apache.hadoop.security.AccessControlException: Permission

Protocol authentication. Note that: For KERBEROS, it is SASL/GSSAPI mechanism, and for NONE, CUSTOM and LDAP, they are all SASL/PLAIN mechanism. If only NOSASL is specified, the authentication will be NOSASL executors’ elastic scaling. 2.1.1. The Basics of Dynamic Resource Allocation Spark provides a mechanism to dynamically adjust the application resources based on the workload, which means that an application Hadoop Credentials Manager 3.1. Configurations 4. ACL Management Guide 1. Kyuubi Authentication Mechanism In a secure cluster, services should be able to identify and authenticate callers. As the fact

Protocol authentication. Note that: For KERBEROS, it is SASL/GSSAPI mechanism, and for NONE, CUSTOM and LDAP, they are all SASL/PLAIN mechanism. If only NOSASL is specified, the authentication will be NOSASL executors’ elastic scaling. 2.1.1. The Basics of Dynamic Resource Allocation Spark provides a mechanism to dynamically adjust the application resources based on the workload, which means that an application Hadoop Credentials Manager 3.1. Configurations 4. ACL Management Guide 1. Kyuubi Authentication Mechanism In a secure cluster, services should be able to identify and authenticate callers. As the fact

JobManager disappears. • Flink relies on Apache ZooKeeper for high-availability • coordination and consensus services, e.g. leader election • The JobManager writes the JobGraph and all required metadata | Boston University 2020 • Ensure result correctness • reconfiguration mechanism often relies on fault-tolerance mechanism • State re-partitioning and migration • minimize communication • keep correctness ??? Vasiliki Kalavri | Boston University 2020 Control: When and how much to adapt? Mechanism: How to apply the re-configuration? 12 • Detect environment changes: external workload and system

engines’ executors’ elastic scaling. The Basics of Dynamic Resource Allocation Spark provides a mechanism to dynamically adjust the application resources based on the workload, which means that an application enabling authentication(authn), authorization(authz) and encryption, etc. 3.3.1 Kyuubi Authentication Mechanism In a secure cluster, services should be able to identify and authenticate callers. As the fact such as the BeeLine, or the JDBC and ODBC drivers. At present, only simple LDAP authentication mechanism involving username and password is sup- ported. The client sends a username and password to the