Uber 核心派单系统及其集群管理演化-李宁
Uber 派单系统 &运维演化 李李宁 Uber核⼼心流稳定性负责⼈人 ⾃自我介绍 李李宁, 多年年运维: 2004-2007 浙⼤大Linux镜像和代理理运维 —杭州 2007-2012 百度⽹网⻚页搜索运维 —北北京,深圳 2013-2015 Twitter后端存储运维 —旧⾦金金⼭山 2015-2019 Uber派单系统运维 —旧⾦金金⼭山 ⽬目录 Uber派单系统简介和进化 Uber派单系统简介和进化 — 20 mins 运维改进介绍 — 20 mins Uber派单系统 If you're not embarrassed by the first version of your product, you've launched too late. —Reid Hoffman 那些让你痛苦的, 终有 ⼀一天你会笑着说出来 Record trip complete & fares API (Monolith) Postgres (API DB) Paypal& Braintree • 单数据中⼼心, Uber⾃自有 • 所有程序运⾏行行在Linux裸机 • ⼏几乎全部机器器都是单点故障 • 软件升级和变更更是⾼高⻛风险活动 • ⽆无法扩容 2014架构运维问题与挑战 • 流量量⼀一年年涨5倍0 码力 | 23 页 | 15.26 MB | 1 年前3尚硅谷大数据技术之Hadoop(生产调优手册)
用于将多个小文件在切片过程中生成一个单独的切片或者少 量的切片。 4)开启 uber 模式,实现 JVM 重用(计算方向) 默认情况下,每个 Task 任务都需要启动一个 JVM 来运行,如果 Task 任务计算的数据 量很小,我们可以让同一个 Job 的多个 Task 运行在一个 JVM 中,不必为每个 Task 都开启 一个 JVM。 (1)未开启 uber 模式,在/input 路径上上传多个小文件并执行 (2)观察控制台 2021-02-14 16:13:50,607 INFO mapreduce.Job: Job job_1613281510851_0002 running in uber mode : false (3)观察 http://hadoop103:8088/cluster 尚硅谷大数据技术之 Hadoop(生产调优手册) (4)开启 uber 模式,在 mapred-site.xml 中添加如下配置mapreduce.job.ubertask.enable true
Practices of Go Microservices on Post-Kubernetes-Wei Zheng
IDL style guide • Google Style • Uber V2 Style IDL Tool Chain - CI Workflow IDL Tool Chain - Cli • egoctl: (https://github.com/gotomicro/egoctl) • Builtin Uber prototool • Lint、format and check Package Naming - A package name is a full package name, i.e. uber.trip.v1. - A package sub-name is a part of a package name, ie uber, trip, or v1. - A package version is the last package sub-name Scaling-up/Scaling-down replicate manually or via Kubernetes Autoscaler Observability - Logging • Based on Uber zap • Auto logging with TraceID、ServiceName、Framework Version… • Structured logging for friendly
0 码力 |
59 页 |
5.66 MB
| 1 年前
3
Trends Artificial Intelligence
/ User AI Adoption = Unprecedented
10.3
4.5
0.2
0
2
4
6
8
10
12
Netflix
LinkedIn
Pinterest
Uber
Twitter
Telegram
Spotify
Facebook
YouTube
Snapchat
WhatsApp
Instagram
Disney+
Fortnite
High Cash Burn + High Valuations + High Investment Levels =
Good News for Consumers…Others TBD…
…Uber burned -$17B* between 2016 and 2022 (and materially more before that)
before its first free cash cash flow-positive year in 2023.
In 2022, it had 131MM monthly active platform consumers.
Uber’s last equity financing was a Series G.
Its fully-diluted IPO market cap was $82B, now $189B.
Tesla burned
0 码力 |
340 页 |
12.14 MB
| 4 月前
3
OpenMetrics - Standing on the shoulders of Titans
Main work has been done by Prometheus team Ben Kochie Brian Brazil myself Google Sumeer Bhola Uber Jerome Froelich Rob Skillington Richard Hartmann, RichiH@{freenode,OFTC,IRCnet}, richih@{fosdem Cloudflare CNCF at large GitLab Google Grafana InfluxData Prometheus ;) RobustPerception SpaceNet Uber Richard Hartmann, RichiH@{freenode,OFTC,IRCnet}, richih@{fosdem,debian,richih}.org, @TwitchiH OpenMetrics 4.0 Test your own OM output: robustperception.io/checking-openmetrics-output-is-valid Google and Uber want to create another reference parser to weed out bugs Richard Hartmann, RichiH@{freenode,OFTC
0 码力 |
21 页 |
84.83 KB
| 1 年前
3
1. Machine Learning with ClickHouse
Learning with ClickHouse Nikolai Kochetov, ClickHouse developer Experimental dataset NYC Taxi and Uber Trips › Where to download: https://www1.nyc.gov/site/tlc/about/tlc-trip-record-data.page › How › What you can also read: https://toddwschneider.com/posts/ analyzing-1-1-billion-nyc-taxi-and-uber-trips-with-a-vengeance/ 3 / 62 External Tools Tools you got used to Small sample of data is enough 5000) AND (trip_distance < 25) AND (total_amount != 0) AND (trip_distance != 0) AND (cab_type != 'uber') ┌─simpleLinearRegression(trip_distance, total_amount)─┐ │ (2.9427761862952964,5.24205006595278)
0 码力 |
64 页 |
1.38 MB
| 1 年前
3
0. Machine Learning with ClickHouse
Learning with ClickHouse Nikolai Kochetov, ClickHouse developer Experimental dataset NYC Taxi and Uber Trips › Where to download: https://www1.nyc.gov/site/tlc/about/tlc-trip-record-data.page › How › What you can also read: https://toddwschneider.com/posts/ analyzing-1-1-billion-nyc-taxi-and-uber-trips-with-a-vengeance/ 3 / 62 External Tools Tools you got used to Small sample of data is enough 5000) AND (trip_distance < 25) AND (total_amount != 0) AND (trip_distance != 0) AND (cab_type != 'uber') ┌─simpleLinearRegression(trip_distance, total_amount)─┐ │ (2.9427761862952964,5.24205006595278)
0 码力 |
64 页 |
1.38 MB
| 1 年前
3
Spring Boot 3.2.3-SNAPSHOT Reference Documentation
self-contained executable jar file that we could run in production. Executable jars (sometimes called “uber jars” or “fat jars”) are archives containing your compiled classes along with all of the jar dependencies to distribute a self- contained application. To solve this problem, many developers use “uber” jars. An uber jar packages all the classes from all the application’s dependencies into a single archive configure the spring-boot-maven-plugin to prevent the repackage goal from adding the dependency into the uber jar: org.springframework
0 码力 |
975 页 |
17.43 MB
| 1 年前
3
Spring Boot 3.2.9-snapshot Reference Documentation
self-contained executable jar file that we could run in production. Executable jars (sometimes called “uber jars” or “fat jars”) are archives containing your compiled classes along with all of the jar dependencies to distribute a self- contained application. To solve this problem, many developers use “uber” jars. An uber jar packages all the classes from all the application’s dependencies into a single archive configure the spring-boot-maven-plugin to prevent the repackage goal from adding the dependency into the uber jar: org.springframework
0 码力 |
976 页 |
17.49 MB
| 1 年前
3
Spring Boot 3.2.7 Reference Documentation
self-contained executable jar file that we could run in production. Executable jars (sometimes called “uber jars” or “fat jars”) are archives containing your compiled classes along with all of the jar dependencies to distribute a self- contained application. To solve this problem, many developers use “uber” jars. An uber jar packages all the classes from all the application’s dependencies into a single archive configure the spring-boot-maven-plugin to prevent the repackage goal from adding the dependency into the uber jar: org.springframework
0 码力 |
974 页 |
17.47 MB
| 1 年前
3
共 361 条
- 1
- 2
- 3
- 4
- 5
- 6
- 37