## Performance of Apache Ozone on NVMe Wei-Chiu Chuang (jojochuang) Ritesh Shukla (kerneltime) ## Agenda • Overview of how Ozone and how it scales • Why NVME is important for Ozone for scaling • Benefits Questions ## Ozone Architecture  CLI (shell) Recon Server DataNodes S3 Gateway Servers Ozone Console ## Why does Ozone Scale concerns  ## Why does Ozone Scale? Aggregation via containers User Chunks Blocks Containers Volumes Blocks Containers

## Apache Ozone Erasure Coding(EC) The Modern Big Data Object Store with More Than 50% Storage Space Savings Uma Maheswara Rao Gangumalla Sr. Engineering Manager, Cloudera Inc Stephen O'Donnell Manager at Cloudera Apache Software Foundation Member ☐ More than 10 years with Apache Projects. Apache Hadoop Project Management Committee(PMC) Member Apache Ozone PMC Member Apache Incubator PMC ☐ chair - 2021, 2022 ## What is Ozone? Apache Ozone is a distributed, scalable, and high performance object store Ozone is designed and optimized for Big Data workloads. Ozone can scale up to billions of

# CHINA APACHE HADOOP MEETUP 2022 2022年09月24日 9:00 上海古井假日酒店4楼 ### What's new in Apache Ozone 1.3 陈怡 Apache Ozone PMC 主席 ## 目录 I. Ozone 构架 II. Ozone 1.3 新功能 III. 未来展望 ## CHINA APACHE HADOOP HADOOP MEETUP 2022 ## Ozone 构架  DataNodes ### Ozone 1.3 新功能 1. 纠删码(Erasure coding) II. 系统均衡器(Container Balancer) III. 性能优化 文件系统优化(File System Optimization) IV. 性能优化 - 合并Container RocksDB实例 V. 很多其他的性能和稳定性优化 ## 纠删码 ## CHINA APACHE HADOOP MEETUP 2022 $$ \begin{array}{c|cccc}{{{1}}}&{{{0}}}&{{{0}}}&{{{0}}} \\{{{0}

APACHECON ASIA 2022 ## Apache Ozone 的最近进展和实践分享 刘岩 陈怡 2022.07.29 ## 目录 • Apache Hadoop HDFS面临的问题 • Apache Ozone介绍 • Apache Ozone适用场景 • Apache Ozone的最近进展 • Apache Ozone的实践分享 ## 大数据存储的需求 ![Im 公有云的对象存储服务 无法在线下部署 ## 目录 • Apache Hadoop HDFS面临的问题 • Apache Ozone介绍 • Apache Ozone适用场景 • Apache Ozone的最近进展 • Apache Ozone的实践分享 ## Apache Ozone ## • Ozone是 一个分布式的KV对象存储 可扩展至数十亿个对象，从而对云原生类的应用更友好 可扩展至数十亿个对象，从而对云原生类的应用更友好 强一致性 与HDFS 和 S3 API兼容 可在存储密集型设备中部署进而极大的减少设备开支 ## Apache Ozone – 数据存储的路径设计 Ozone的存储路径为 volumes, buckets, 和 keys. Volumes 类似与用户账号. 只有Admin 可以创建或删除Volumes Buckets 类似与 S3 的 Buckets，一个 Buckets

## Ozone User Group Summit Nov 10, 2022  We believe that data can make what is impossible today, possible tomorrow ## CLOUDERA in-transit?  ## Apache Ozone Scalable, redundant distributed object store Designed for data applications to store structured and Overview (Sid Wagle) Ozone bucket types (Ethan Rose) Legacy, Object Store (OBS), and Filesystem Optimized (FSO) ☐ Diverse workloads and when/how to use? 。 Demo Ozone Snapshots (Prashant Pogde

# Ozone : Hadoop 原生分布式对象存储 Hadoop 社区推出了新一代分布式Key-value对象存储系统 Ozone，同时提供对象和文件访问的接口，从构架上解决了长久以来困扰HDFS的小文件问题。本文作为Ozone系列文章的第一篇，抛个砖，介绍Ozone的产生背景，主要架构和功能。 S3 protocol ![Image](/uploads/documents/c/9/3/1 基于这些背景，Hadoop 社区推出了新的分布式存储系统 Ozone，从构架上解决这个问题。 ## Ozone的设计原则 Ozone 由一群对大规模Hadoop集群有着丰富运维和管理经验的工程师和构架师设计和实现。他们对大数据有深刻的洞察力，清楚的了解HDFS的优缺点，这些洞察力自始自终影响了Ozone的设计和实现。Ozone的设计遵循一下原则： ## · 强一致性 ## • 构架简洁性： 构架简洁性： 当系统出现问题时，一个简单的架构更容易定位，也容易调试。Ozone尽可能的保持架构的简单，即使因此需要可扩展性上做一些妥协。但是在Ozone在扩展性上绝不逊色，目标是支持单集群1000亿个对象。 ## • 构架分层 Ozone 采用分层的文件系统。Namespace 元数据的管理，数据块和节点的管理分开。用户可以对二者独立扩展。 ## • 容易恢复 ## HDFS 一个关键优点是

Apache OFBiz $ ^{®} $ The Apache OFBiz Project Version Trunk ## Table of Contents 1. System requirements ..... 2 2. Quick start ..... 3 2.1. Download the Gradle wrapper: ..... 3 2.2. Prepare file in ASCIIDoc format you may want to see it at HTML or PDF format Welcome to Apache OFBiz! A powerful top level Apache software project. OFBiz is an Enterprise Resource Planning (ERP) System written reading section. ### 3. Security If you find a security issue, please report it to: security @ ofbiz.apache.org. Once proper mitigations to the security issues are complete the OFBiz team will disclose this

## THE APACHE SOFTWARE FOUNDATION # 解读Apache 演讲者 Craig Russell Justin Mclean 姜宁 # 本演讲包含了 Bertrand Delacretaz, Roman Shaposhnik 以及其它ASF贡献者的工作 ## Craig Russell介绍 • 软件架构师 ■ Object Data Management Group (MySQL) • Apache Committer - from 2005 • Apache Member - from 2007 • Apache Secretary - from 2010-2019 • Apache 孵化器管理委员成员 • Apache 董事会主席 ## Apache 软件基金会: 世界上最大的开源基金会 ## Apache基金会的使命 Apache软基金会 (ASF) 501(c)(3) 注册公益性组织。ASF 的使命是通过向加入 ASF 的志同道合的软件项目社区提供服务，为公众提供开源软件。 ASF提供了一个独立于任何公司影响力的中立空间，保证其中的项目可以在商业友好Apache许可证2.0下繁荣发展，为公众利益创建开源软件。 公开成立于1999年的公益组织 使命: 为公众利益提供免费的软件。 ![Image](/uploads/documents/c/6/7/4/c

### THE APACHE $ ^{®} $ SOFTWARE FOUNDATION apache.org ## Apache Explained Presented by Roman Shaposhnik Craig Russell Justin Mclean Including original work of Bertrand Delacretaz and other Cloudera → Apache Committer - from 2010 → Apache Member - from 2014 → Apache Board Member and VP of Legal Affairs - from 2018 → Member, Incubator Project Management Committee, Bigdata ## Apache Software Software Foundation: The World’s Largest Open Source Foundation ## The ASF's Mission The Apache Software Foundation (ASF) is a US 501(c)(3) charitable organization. Its mission is to provide Open Source

## THE APACHE SOFTWARE FOUNDATION ## Apache Explained Presented by Craig Russell Justin Mclean Willem Jiang Including original work of Bertrand Delacretaz, Roman Shaposhnik and other amazing ASF contributors (MySQL) • Apache Committer - from 2005 • Apache Member - from 2007 • Apache Secretary - 2010 - 2019 • Member, Incubator Project Management Committee • Chairman, Apache Board of Directors ## Apache Software Software Foundation: The World's Largest Open Source Foundation ## The ASF's Mission The Apache Software Foundation (ASF) is a US 501(c)(3) charitable organization. Its mission is to provide Open