Apache Ozone Erasure Coding(EC) The Modern Big Data Object Store with More Than 50% Storage Space Savings Uma Maheswara Rao Gangumalla Sr. Engineering Manager, Cloudera Inc Stephen O’Donnell Sr. Staff Non EC Flow Erasure Coding Requirements ❏ Phase - I ❏ Enable EC at Cluster/Bucket Level ❏ Should be able to Write files in EC format ❏ Should be able to Read the files which were written in EC format 6:3, 10:4 EC Schemes ❏ Should be able to recover the files automatically on failures ❏ Online recovery ❏ Phase - II ❏ Offline recovery ❏ Phase - III ❏ Should provide options to enable EC via Recon

Secure access to EC2 (for developers) Agenda – introduction – EC2 in native environment – 3-tier architecture intro – alternative methods of resource connection: – Bastion host – SSM – EC2 Instance Connect DDoS attacks A regular virtual machineIt's a VM. Classic EC2 instance in de‐ fault setting. Resources: EC2SecurityGroup: Type: AWS:: EC2:: SecurityGroup Properties: GroupName: Launch-wizard-13 Launch-wizard-13 GroupDescription: Allow traffic to EC2 SecurityGroupIngress: - CidrIp: 0.0.0.0/0 IpProtocol: -1 SecurityGroupEgress: - CidrIp: 0.0.0.0/0

auto [ptr, _] = result; } else { // handle errors auto [_, ec] = result; } 1 2 3 4 5 6 7 8 9 //after: 10 if (auto [to, ec] = std::to_chars(p, last, 42)) 11 { 12 auto s = std::string(p auto [ptr, _] = result; } else { // handle errors auto [_, ec] = result; } 1 2 3 4 5 6 7 8 9 //after: 10 if (auto [to, ec] = std::to_chars(p, last, 42)) 11 { 12 auto s = std::string(p pointer auto [ptr, _] = result; } else { // handle errors auto [_, ec] = result; } //after: if (auto [to, ec] = std::to_chars(p, last, 42)) { auto s = std::string(p, to); ... } 1

........................................................................... 13 APACHE ROCKETMQ 在 EC2 上部署所在目录说明： .......................................................................... 13 Nameserver： AMAZON WEB SERVICES 客户需要在 AMAZON WEB SERVICES 上 使用 RocketMQ 的需求，我们开发了一键部署的方案，帮助客户快速的在自己的账号 部署一个基于 EC2 的高可用的 RocketMQ 集群。 架构 AMAZON CloudFormation 提供了一种创建和管理相关 AMAZON WEB SERVICES 资源的简 便方法，并通过有序 其他区域使用此方案，请点击此处 2. 确保您的账⼾下的 Elastic IP ，VPC ， EC2 ，Auto Scaling Group，NAT Gateway， EBS 等没有达到上限。如果某一项您已经达到上限，请向后台提交⼯单选择申 请提高限制。 3. 如果在该区域内您还没有密钥对，请在 Amazon EC2 控制台的导航窗格中，依 次选择密钥对、创建密钥对，选择默认的.pem 格式，键⼊名称，然后选择创建

........................................................................... 15 APACHE ROCKETMQ 在 EC2 上部署所在目录说明： ..................................................................... 15 Nameserver 具有低延迟，金融级高可用以及厂商中立的特点，目前广泛使 用于国内外的互联网公司。针对亚马逊云科技客户需要在亚马逊云科技上使用 RocketMQ 的需求，我们开发了一键部署的方案，帮助客户快速的在自己的账号部署 一个基于 EC2 的高可用的 RocketMQ 集群。 架构 Amazon CloudFormation 提供了⼀种创建和管理相关 AMAZON WEB SERVICES 资源的简便⽅法，并通过有序 且 其他区域使⽤此⽅案，请点击此处 2. 确保您的账⼾下的 Elastic IP ，VPC ， EC2 ，Auto Scaling Group，NAT Gateway，EBS 等没有达到上限。如果某⼀项您已经达到上限，请向后台提交 ⼯单选择申请提⾼限制。 3. 如果在该区域内您还没有密钥对，请在 Amazon EC2 控制台的导航窗格中， 依次选择密钥对、创建密钥对，选择默认的.pem 格式，键⼊名称，然后选择

xlarge 实例。 platform: aws: region: us-gov-west-1 serviceEndpoints: - name: ec2 url: https://ec2.us-gov-west-1.amazonaws.com - name: elasticloadbalancing url: https://elasticloadbalancing 安装所需的 安装所需的 EC2 权 权限 限 ec2:AuthorizeSecurityGroupEgress ec2:AuthorizeSecurityGroupIngress ec2:CopyImage ec2:CreateNetworkInterface ec2:AttachNetworkInterface ec2:CreateSecurityGroup ec2:CreateTags ec2:CreateTags ec2:CreateVolume ec2:DeleteSecurityGroup ec2:DeleteSnapshot ec2:DeleteTags ec2:DeregisterImage ec2:DescribeAccountAttributes ec2:DescribeAddresses ec2:DescribeAvailabilityZones ec2:DescribeDhcpOptions

限值 值 描述 描述 platform: aws: region: us-gov-west-1 serviceEndpoints: - name: ec2 url: https://ec2.us-gov-west-1.amazonaws.com - name: elasticloadbalancing url: https://elasticloadbalancing 安装所需的 安装所需的 EC2 权 权限 限 ec2:AuthorizeSecurityGroupEgress ec2:AuthorizeSecurityGroupIngress ec2:CopyImage ec2:CreateNetworkInterface ec2:AttachNetworkInterface ec2:CreateSecurityGroup ec2:CreateTags ec2:CreateTags ec2:CreateVolume ec2:DeleteSecurityGroup ec2:DeleteSnapshot ec2:DeleteTags ec2:DeregisterImage ec2:DescribeAccountAttributes ec2:DescribeAddresses OpenShift Container Platform 4.8 安装 安装 36

"IPAndPort":"127.0.0.1:49948", "NodeID":"b5872eff0569903d71330ab7bc85c5a8be03e80b70746ec33cafe27cc4f 6f8a71f8c84fd8af9d7912cb5ba068901fe4131ef69b74cc773cdfb318ab11968e41f ", "Topic":[] HelloWorld 0xb3c223fc0bf6646959f254ac4e4a7e355b50a344 set "Hello, FISCO BCOS" 0x21dca087cb3e44f44f9b882071ec6ecfcb500361cad36a52d39900ea359d0895 # 再次查看当前块高，块高增加表示已出块，账本状态已更改 注： 1. 部署合约还可以通过deployByCNS命令，可以指定部署的合约版本号，使 b83d899b5176add03369395e53a5f60c303acb 719ec0718ef1ed51feb7e9cf4836f266553df44a1cae5651bc6ddf50e01789233a node.1=70ee8e4bf85eccda9529a8daf5689410ff771ec72fc4322c431d67689efbd6 fbd474cb7dc7435f63

"IPAndPort":"127.0.0.1:49948", "NodeID":"b5872eff0569903d71330ab7bc85c5a8be03e80b70746ec33cafe27cc4f 6f8a71f8c84fd8af9d7912cb5ba068901fe4131ef69b74cc773cdfb318ab11968e41f ", "Topic":[] HelloWorld 0xb3c223fc0bf6646959f254ac4e4a7e355b50a344 set "Hello, FISCO BCOS" 0x21dca087cb3e44f44f9b882071ec6ecfcb500361cad36a52d39900ea359d0895 # 再次查看当前块高，块高增加表示已出块，账本状态已更改 [group:1]> getBlockNumber 2 b83d899b5176add03369395e53a5f60c303acb 719ec0718ef1ed51feb7e9cf4836f266553df44a1cae5651bc6ddf50e01789233a node.1=70ee8e4bf85eccda9529a8daf5689410ff771ec72fc4322c431d67689efbd6 fbd474cb7dc7435f63

6005ec03d30fcfe", "Supported Version":"2.5.0" } # 获取节点链接信息 [group:1]> getPeers [ { "IPAndPort":"127.0.0.1:49948", "NodeID":"b5872eff0569903d71330ab7bc85c5a8be03e80b70746ec33cafe27cc4f HelloWorld 0xb3c223fc0bf6646959f254ac4e4a7e355b50a344 set "Hello, FISCO BCOS" 0x21dca087cb3e44f44f9b882071ec6ecfcb500361cad36a52d39900ea359d0895 # 再次查看当前块高，块高增加表示已出块，账本状态已更改 注： 1. 部署合约还可以通过deployByCNS命令，可以指定部署的合约版本号，使 documentation.readthedocs.io/zh_CN/latest/docs/manual/certificates.html] 购买前注意事项 普通版FISCO BCOS节点使用的节点证书算法为EC secp256k1曲线 国密版FISCO BCOS节点使用的节点证书算法为SM2 用户向CFCA购买前请确认签发算法是否正确 购买前请确认证书用途、节点信息已经填写正确 使用前请确认已经安装openssl