Python与云 ——AWS的Python原生应用浅析 张孝峰 亚马逊AWS资深解决方案架构师 Python 30周年 Python发展时间线 2019/10 v3.8 v2.7.17 开始实现 1989/12 v0.9.0 1991/2 v1.0.0 1994/1 v2.0 2000/10 v2.5 2006/9 v2.6 2008/10 v3.0 2008/12 2008/12 v2.7 2010/7 v3.7 2018/6 AWS发展时间线 2019/10 开始实现 1989/12 v0.9.0 1991/2 v1.0.0 1994/1 v2.0 2000/10 v2.5 2006/9 v2.6 2008/10 v3.0 2008/12 v2.7 2010/7 v3.7 2018/6 贝索斯开始思考 微服务 2000 2000 Amazon S3 2006/3 Amazon SQS 2006/7 Amazon EC2 2006/8 开始研发 2004 AWS Lambda 2014/11 2019/10 22个区域 165项服务 Python被称为“瑞士军刀” • Web开发 • AI / 机器学习 • 自动化运维 • 网络爬虫 • 大数据分析 48 82 160 280 516

in Taipei • Focus on Serverless, Container and AWS CDK • Father of a daughter • Speaker in AWS Global Summits, KubeCon and CNCF Webinar • Active in AWS User Groups from Shanghai, Taipei, Korea and other AWS service All publicly accessible endpoints AWS Lambda functions Endpoints in your VPC Regional API Endpoints AWS Lambda functions Endpoints on Amazon EC2 Your VPC AWS Manage Fully-managed Any volume Pub/sub Simple Fully-managed Flexible Amazon Simple Queue Service Amazon Simple Notification Service Messaging Synchronization Rapid Fully-managed Real-time Amazon CloudWatch

used to limit memory usage in shared hosting/cloud environments or to enforce a given quality of service. Read more... . • Resource Leak Protection The --maxtasksperchild option is used for user tasks sqs://aws_access_key_id:aws_secret_access_key@ you must remember to include the “@” at the end. The login credentials can also be set using the environment variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY AWS_SECRET_ACCESS_KEY, in that case the broker url may only be sqs://. Note: If you specify AWS credentials in the broker URL, then please keep in mind that the secret access key may contain unsafe characters that

used to limit memory usage in shared hosting/cloud environments or to enforce a given quality of service. Read more…. Resource Leak Protection The --maxtasksperchild option is used for user tasks leaking sqs://aws_access_key_id:aws_secret_access_key@ you must remember to include the “@” at the end. The login credentials can also be set using the environment variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY AWS_SECRET_ACCESS_KEY, in that case the broker url may only be sqs://. Note If you specify AWS credentials in the broker URL, then please keep in mind that the secret access key may contain unsafe characters that

result backend. celery[riak]: for using Riak as a result backend. celery[dynamodb]: for using AWS DynamoDB as a result backend. celery[zookeeper]: for using Zookeeper as a message transport. celery[sqlalchemy]: sqs://aws_access_key_id:aws_secret_access_key@ you must remember to include the “@” at the end. The login credentials can also be set using the environment variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY and kombu will attempt to retrieve access tokens from the instance metadata. Note If you specify AWS credentials in the broker URL, then please keep in mind that the secret access key may contain unsafe

as a result backend. celery[riak] for using Riak as a result backend. celery[dynamodb] for using AWS DynamoDB as a result backend. celery[zookeeper] for using Zookeeper as a message transport. celery[sqlalchemy] sqs://aws_access_key_id:aws_secret_access_key@ you must remember to include the “@” at the end. The login credentials can also be set using the environment variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY and kombu will attempt to retrieve access tokens from the instance metadata. Note: If you specify AWS credentials in the broker URL, then please keep in mind that the secret access key may contain unsafe

backend. for using Elasticsearch as a result backend. for using Riak as a result backend. for using AWS DynamoDB as a result backend. for using Zookeeper as a message transport. for using SQLAlchemy as sqs://aws_access_key_id:aws_secret_access_key@ you must remember to include the “@” at the end. The login credentials can also be set using the environment variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY and kombu will attempt to retrieve access tokens from the instance metadata. Note If you specify AWS credentials in the broker URL, then please keep in mind that the secret access key may contain unsafe

backend. for using Elasticsearch as a result backend. for using Riak as a result backend. for using AWS DynamoDB as a result backend. for using Zookeeper as a message transport. for using SQLAlchemy as sqs://aws_access_key_id:aws_secret_access_key@ you must remember to include the “@” at the end. The login credentials can also be set using the environment variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY and kombu will attempt to retrieve access tokens from the instance metadata. Note If you specify AWS credentials in the broker URL, then please keep in mind that the secret access key may contain unsafe

backend. for using Elasticsearch as a result backend. for using Riak as a result backend. for using AWS DynamoDB as a result backend. for using Zookeeper as a message transport. for using SQLAlchemy as sqs://aws_access_key_id:aws_secret_access_key@ you must remember to include the “@” at the end. The login credentials can also be set using the environment variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY and kombu will attempt to retrieve access tokens from the instance metadata. Note If you specify AWS credentials in the broker URL, then please keep in mind that the secret access key may contain unsafe

backend. for using Elasticsearch as a result backend. for using Riak as a result backend. for using AWS DynamoDB as a result backend. for using Zookeeper as a message transport. for using SQLAlchemy as 'sqs://ABCDEFGHIJKLMNOPQRST:ZYXK7NiynGlTogH8Nj+P9nlE73sq3@' where the URL format is: sqs://aws_access_key_id:aws_secret_access_key@ Please note that you must remember to include the @ sign at the end and safequote aws_access_key = safequote("ABCDEFGHIJKLMNOPQRST") aws_secret_key = safequote("ZYXK7NiynG/TogH8Nj+P9nlE73sq3") broker_url = "sqs://{aws_access_key}:{aws_secret_key}@".format( aws_access_key=aws_access_key