跑了六 個月以上 ... 21 / 74 1. Submit Job 2. 建構特定 AM 3. 向 RM 註冊 AM 4. 送 Request 給 RM 5. 配置啟動 Container 6. AM/Container 溝通 7. Client/AM 溝通 8. 回收 AM Hadoop 2.x 架構 - MapReduce (MRv2) ResourceManager 與 NodeManager ApplicationMaster - Framework-Specific，負責跟 ResourceManager 協調 Resource，跟 NodeManager 合作執行 Container，監督 Container 以及 Resource 消耗的狀況，也負責 Schedule 各個 Task 22 / 74 MapReduce (MRv2) 分工優點 ResourceManager 其實是 實作不同想法。 ApplicationMaster 其實是 MRv1 與 MRv2 最大的不同，負責與中央的 ResourceManager 與各地的 NodeManager 協調溝通，執行與監督各個 Container 的運作狀況，容錯也歸它管。 因為 ApplicationMaster 分擔了 MRv1 時代 ResourceManager 該做的絕大多數工 作，所以 MRv2 的 ResourceManager

Open Source Cloud Kubernetes Istio Apache Beam TensorFlow Service Communication Management Container Orchestration Data Processing Pipelines Data Flow Graphs for Machine Intelligence Kubernetes Kubernetes releases that have been validated and tested by Google ● Access to Container services on GCP such as Cloud Build, Container Registry, Audit Logging, and more. ● Integration with Istio, Knative, ● vSphere 6.5 for Alpha ● Simple CLI installation ● Online and Offline installation ● Private container registry support ● Latest 3 versions of k8s ● High-availability control plane ● Auto-repair Installation

Unions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 451 36.7 Avoid elaborate container types . . . . . . . . . . . . . . . . . . . . . . . . . . . . 451 36.8 Prefer exported methods the interface level . . . . . . . . . . . . . . . . . 454 36.18 Don't overload methods of base container types . . . . . . . . . . . . . . . . . . . 455 36.19 Avoid type piracy . . . . . . . . . . . tuple that is closely related to function arguments and return values. A tuple is a fixed-length container that can hold any values, but cannot be modified (it is immutable). Tuples are constructed with

Unions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 451 36.7 Avoid elaborate container types . . . . . . . . . . . . . . . . . . . . . . . . . . . . 451 36.8 Prefer exported methods the interface level . . . . . . . . . . . . . . . . . 454 36.18 Don't overload methods of base container types . . . . . . . . . . . . . . . . . . . 455 36.19 Avoid type piracy . . . . . . . . . . . tuple that is closely related to function arguments and return values. A tuple is a fixed-length container that can hold any values, but cannot be modified (it is immutable). Tuples are constructed with

Unions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 484 37.7 Avoid elaborate container types . . . . . . . . . . . . . . . . . . . . . . . . . . . . 484 37.8 Prefer exported methods the interface level . . . . . . . . . . . . . . . . . 488 37.19 Don't overload methods of base container types . . . . . . . . . . . . . . . . . . . 488 37.20 Avoid type piracy . . . . . . . . . . . tuple that is closely related to function arguments and return values. A tuple is a fixed-length container that can hold any values, but cannot be modified (it is immutable). Tuples are constructed with

Unions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 484 37.7 Avoid elaborate container types . . . . . . . . . . . . . . . . . . . . . . . . . . . . 484 37.8 Prefer exported methods the interface level . . . . . . . . . . . . . . . . . 488 37.19 Don't overload methods of base container types . . . . . . . . . . . . . . . . . . . 488 37.20 Avoid type piracy . . . . . . . . . . . tuple that is closely related to function arguments and return values. A tuple is a fixed-length container that can hold any values, but cannot be modified (it is immutable). Tuples are constructed with

Unions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 484 37.7 Avoid elaborate container types . . . . . . . . . . . . . . . . . . . . . . . . . . . . 484 37.8 Prefer exported methods the interface level . . . . . . . . . . . . . . . . . 488 37.19 Don't overload methods of base container types . . . . . . . . . . . . . . . . . . . 488 37.20 Avoid type piracy . . . . . . . . . . . tuple that is closely related to function arguments and return values. A tuple is a fixed-length container that can hold any values, but cannot be modified (it is immutable). Tuples are constructed with

Unions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 495 37.8 Avoid elaborate container types . . . . . . . . . . . . . . . . . . . . . . . . . . . . 495 37.9 Prefer exported methods the interface level . . . . . . . . . . . . . . . . . 499 37.20 Don't overload methods of base container types . . . . . . . . . . . . . . . . . . . 499 37.21 Avoid type piracy . . . . . . . . . . . tuple that is closely related to function arguments and return values. A tuple is a fixed-length container that can hold any values, but cannot be modified (it is immutable). Tuples are constructed with

Unions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 496 37.7 Avoid elaborate container types . . . . . . . . . . . . . . . . . . . . . . . . . . . . 496 37.8 Prefer exported methods the interface level . . . . . . . . . . . . . . . . . 500 37.19 Don't overload methods of base container types . . . . . . . . . . . . . . . . . . . 500 37.20 Avoid type piracy . . . . . . . . . . . tuple that is closely related to function arguments and return values. A tuple is a fixed-length container that can hold any values, but cannot be modified (it is immutable). Tuples are constructed with

Unions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 495 37.7 Avoid elaborate container types . . . . . . . . . . . . . . . . . . . . . . . . . . . . 495 37.8 Prefer exported methods the interface level . . . . . . . . . . . . . . . . . 499 37.19 Don't overload methods of base container types . . . . . . . . . . . . . . . . . . . 499 37.20 Avoid type piracy . . . . . . . . . . . tuple that is closely related to function arguments and return values. A tuple is a fixed-length container that can hold any values, but cannot be modified (it is immutable). Tuples are constructed with