deregister.jo b.max.failures within the TTL, an engine will deregister itself and wait for self-terminated. Otherwise, we suppose that the engine has recovered from temporary failures. dura tion 1.2 .0 0 kyuubi.engine .deregister.job.max .failures 4 Number of failures of job before deregistering the engine. int 1.2 .0 kyuubi.engine.event .json.log.path file:///tmp/ kyuubi/ev ents The location attempts 5 Max attempts for long polling asynchronous running sql query's status on raw transport failures, e.g. TTransportException int 1.4 .0 kyuubi.operation .status.polling .timeout PT5S Timeout(ms)

deregister.jo b.max.failures within the TTL, an engine will deregister itself and wait for self-terminated. Otherwise, we suppose that the engine has recovered from temporary failures. dura tion 1.2 .0 0 kyuubi.engine .deregister.job.max .failures 4 Number of failures of job before deregistering the engine. int 1.2 .0 kyuubi.engine.event .json.log.path file:///tmp/ kyuubi/ev ents The location attempts 5 Max attempts for long polling asynchronous running sql query's status on raw transport failures, e.g. TTransportException int 1.4 .0 kyuubi.operation .status.polling .timeout PT5S Timeout(ms)

deregister.jo b.max.failures within the TTL, an engine will deregister itself and wait for self-terminated. Otherwise, we suppose that the engine has recovered from temporary failures. dura tion 1.2 .0 0 kyuubi.engine.deregister.job.max.failures 4 Number of failures of job before deregistering the engine. int 1.2 .0 kyuubi.engine.event.json.log.path file:///tmp/ kyuubi/ev ents The location of all attempts 5 Max attempts for long polling asynchronous running sql query's status on raw transport failures, e.g. TTransportException int 1.4 .0 kyuubi.operation.status.polling.timeout PT5S Timeout(ms)

deregister.jo b.max.failures within the TTL, an engine will deregister itself and wait for self-terminated. Otherwise, we suppose that the engine has recovered from temporary failures. dura tion 1.2 .0 0 kyuubi.engine.deregister.job.max.failures 4 Number of failures of job before deregistering the engine. int 1.2 .0 kyuubi.engine.event.json.log.path file:///tmp/ kyuubi/ev ents The location of all attempts 5 Max attempts for long polling asynchronous running sql query's status on raw transport failures, e.g. TTransportException int 1.4 .0 kyuubi.operation.status.polling.timeout PT5S Timeout(ms)

deregister.jo b.max.failures within the TTL, an engine will deregister itself and wait for self-terminated. Otherwise, we suppose that the engine has recovered from temporary failures. dura tion 1.2 .0 0 kyuubi.engine.deregister.job.max.failures 4 Number of failures of job before deregistering the engine. int 1.2 .0 kyuubi.engine.event.json.log.path file:///tmp/ kyuubi/ev ents The location of all attempts 5 Max attempts for long polling asynchronous running sql query's status on raw transport failures, e.g. TTransportException int 1.4 .0 kyuubi.operation.status.polling.timeout PT5S Timeout(ms)

deregister.jo b.max.failures within the TTL, an engine will deregister itself and wait for self-terminated. Otherwise, we suppose that the engine has recovered from temporary failures. kyuubi.engine .deregister deregister.job.max .failures 4 Number of failures of job before deregistering the engine. int 1.2 .0 kyuubi.engine.event .json.log.path /tmp/kyuu bi/events The location of all the engine events go User. Generally speaking, a Spark user is a guy that calls Spark APIs directly, but from Kyuubi and Spark ThriftServer’s perspective, the direct API calls occur on the server-side, then a Spark user indirectly

deregister.jo b.max.failures within the TTL, an engine will deregister itself and wait for self-terminated. Otherwise, we suppose that the engine has recovered from temporary failures. kyuubi.engine .deregister deregister.job.max .failures 4 Number of failures of job before deregistering the engine. int 1.2 .0 kyuubi.engine.event .json.log.path file:/tmp/k yuubi/eve nts The location of all the engine events User. Generally speaking, a Spark user is a guy that calls Spark APIs directly, but from Kyuubi and Spark ThriftServer’s perspective, the direct API calls occur on the server-side, then a Spark user indirectly

Otherwise, we suppose that the engine has recovered from temporary failures. kyuubi.engine.dere gister.job.max.failu res 4 Number of failures of job before deregistering the engine. int 1.2.0 kyuubi.engine else. Within the session, a user or client can send multiple operation request, including metadata calls or queries, to the corresponding engine. Although it is still an interactive form, this model does for Big Result Sets Typically, when a user submits a SELECT query to Spark SQL engine, the Driver calls collect to trigger calculation and collect the entire data set of all tasks(a.k.a. partitions of an

Meaning Type Since that the engine has recovered from temporary failures. kyuubi.engine.dere gister.job.max.failu res 4 Number of failures of job before deregistering the engine. int 1.2.0 kyuubi.engine else. Within the session, a user or client can send multiple operation request, including metadata calls or queries, to the corresponding engine. Although it is still an interactive form, this model does for Big Result Sets Typically, when a user submits a SELECT query to Spark SQL engine, the Driver calls collect to trigger calculation and collect the entire data set of all tasks(a.k.a. partitions of an

access. It effectively prevents single point of failures. It helps achieve zero downtime for planned system maintenance Failure detectability Failures and system load of kyuubi server and engines are will deregister itse Otherwise, we suppose that the engine has re failures. kyuubi.engine.deregister.job.max.failures 4 Number of failures of job before deregisterin kyuubi.engine.doAs.enabled true Whether to set dynamic configurations via SET syntax. kyuubi.session.engine.alive.max.failures 3 The maximum number of failures allowed for the engin kyuubi.session.engine.alive.probe.enabled false Whether