## RUST CHINA CONF 2023 第三届中国 Rust 开发者大会 6.17-6.18 @Shanghai Rust China Conf 2023 ## 基于 Rust Arrow Flight 的物联网和时序数据传输及转换工具 霍琳贺 涛思数据 ## CONTENTS 自我介绍 TDengine taosX Rust 使用 ## TDengine https://crates.io/crates/arrow-flight https://crates.io/crates/tonic • Authentication: https://crates.io/crates/jsonwebtoken ## • Data structure: • Arrow: https://crates.io/crates/arrow Parquet: https://crates Compression: https://crates.io/crates/zstd • Async Hashmap : https://crates.io/crates/dashmap ## Arrow ## • Schema with metadata Schema { fields: [ Field { name: "ts"

# RUST CHINA CONF 2023 Build a lightweight logging and tracing tool with Apache Arrow, Parquet and DataFusion 朱霜 2023.06.18 6.17-6.18 @Shanghai ## Content 1. Introduction 2. Duo - Observability duet: duet: Logging and Tracing • What is Duo? • How does it work? 3. Apache Arrow, Parquet and DataFusion • A brief introduction to Arrow, Parquet, and DataFusion • How does Duo store and query log, span data Id, _ctx: Context<'_, S>) { ... } } ## Apache Arrow, Parquet, and DataFusion ## APACHE ARROW Parquet DATA FUSION ## Apache Arrow • Created by Wes McKinney, creator of Pandas (2016) • A

[Image](/uploads/documents/1/0/6/4/10647da56d5ca02a677b65fcecbd7641/p1_1.jpg) 字符串的七种写法 Swift Strings Seven Ways Flight School at @Swift PEK 2018 ## RDWHG99PJ5YJbP dMdOyWBjAj6rA dY4fCPjUTZdCwRh sVFLEOTOβ&OJKV aΘGGVJ6SSCiO78

Overview Apache Ballista is a distributed SQL query engine powered by the Rust implementation of Apache Arrow and DataFusion. It's mainly for interactive queries of low latency. • Support DAG and fault tolerance lake.pdf • Apache Arrow https://arrow.apache.org/ • Apache Arrow DataFusion https://github.com/apache/arrow-datafusion • Apache Arrow Ballista https://github.com/apache/arrow-ballista ## Thank you

message between two participants. Participants do not have to be explicitly declared. To have a dotted arrow, you use --> It is also possible to use <-- and <--. That does not change the drawing, but Change arrow style You can change arrow style by several ways: • add a final x to denote a lost message • use \ or / instead of < or > to • have only the bottom or top part of the arrow • repeat repeat the arrow head (for example, >> or //) head to have a thin drawing • use -- instead of - to have a dotted arrow • add a final "o" at arrow head • use bidirectional arrow <->

(participants). Не обязательно явно объявлять участников. Для получения пунктирной стрелки (dotted arrow), используйте -->. Также возможно использовать <- и <--. Это не изменит отображение, но void methods() } class Flight { flightNumber : Integer departureTime : Date } @enduml  Flight flightNumber : Integer стрелок. Возможно задать направление стрелки используя следующий синтаксис: • -down-> (default arrow) • -left-> • -up-> @startuml (*) -up-> "First Activity" -right-> "Second

actors and use cases, the arrow --> is used. The more dashes – in the arrow, the longer the arrow. You can add a label on the arrow, by adding a : character in the arrow definition. In this example e2f726e1fc719dffe2/p28_2.jpg) It is also possible to change arrow direction by adding left, right, up or down keywords inside the arrow: @startuml :user: -left-> (dummyLeft) :user: -right-> (dummyRight) [Image](/uploads/documents/0/b/2/2/0b2211e4931823e2f726e1fc719dffe2/p28_3.jpg) You can shorten the arrow by using only the first character of the direction (for example, -d- instead of -down-) or the two

{ String data void methods() } class Flight { flightNumber : Integer departureTime : Date } @enduml Dummy String data void methods() Flight FlightNumber : Integer departureTime : Date [Image](/uploads/documents/2/a/6/8/2a68653ed0100cdf73a8fc38d0ff77ad/p49_2.jpg) You can shorten the arrow by using only the first character of the direction (for example, -d- instead of -down-) or the two 7ad/p55_2.jpg) ### 4.3 改变箭头方向 你可以使用 -> 定义水平方向箭头，还可以使用下列语法强制指定箭头的方向： • -down-> (default arrow) - right -> or -> - left -> - up -> @startuml (*) -up -> "First Activity" -right

void methods() } class Flight { flightNumber : Integer departureTime : Date } @enduml  Flight flightNumber : Integer Es posible formzar la dirección de una flecha usando la siguiente sintaxis: • -down-> (default arrow) • -right-> or -> @startuml @enduml  • -right-> or -> • -left-> • -up-> @startuml [*] -up-> First First -right->

@startuml class Dummy { String data void methods() } class Flight { flightNumber : Integer departureTime : Date } @enduml Flight flightNumber : Integer departureTime : Date You can use de forcer la direction d'une flèche en utilisant la syntaxe suivante : • -down-> (default arrow) • -right-> or -> @startuml (*) -up-> "First Activity" -right-> "Second aussi possible de forcer la direction de la flèche avec la syntaxe suivante: • -down-> (default arrow) • -right-> or -> • -left-> • -up-> @startuml [*] -up-> First First -right->