1、無服務(wù)器構(gòu)建全球雙主架構(gòu)最佳實(shí)踐技術(shù)創(chuàng)新 變革未來Agenda了解系統(tǒng)可靠性與可用性了解為何需要部署多地理區(qū)多主架構(gòu)了解如何在AWS上部署多地理區(qū)多主架構(gòu)構(gòu)建一個無服務(wù)器全球多主架構(gòu)結(jié)論系統(tǒng)可靠性與可用性Werner VogelsCTO A“故障是必然的，所有東西隨著時(shí)間推進(jìn)必然會發(fā)生故障.“可用性AvailabilityDowntime per yearCategories95% (1-nine)18 days 6 hoursBatch processing, Data extraction,Load jobs.99% (2-nines)3 days 15 hoursInternal Too

2、ls, Project Tracking99.9% (3-nines)8 hours 45 minutesOnline Commerce99.99% (4-nines)52 minutesVideo Delivery, Broadcast systems99.999% (5-nines)5 minutesTelecom Industry (ATM Transactions)99.9999% (6-nines)31 secondsAnswering to my loved one* Joke /wp-content/uploads/2015/04/pingdom_uptime_cheat_she

3、et.pdfAvailability in SeriesPart XPart YA = Ax AyAvailability in SeriesComponentAvailabilityDowntimeX99% (2-nines)3 days 15 hoursY99.99% (4-nines)52 minutesX and Y Combined98.99%3 days 16 hours 33 minutesPart XPart YA = Ax AyAvailability in ParallelA = 1 (1 Ax)2Part XPart XAvailability in ParallelCo

4、mponentAvailabilityDowntimeX99% (2-nines)3 days 15 hoursTwo X in parallel99.99% (4-nines)52 minutesThree X in parallel99.9999% (6-nines)31 secondsA = 1 (1 Ax)2Part XPart X“元件的冗余性可大幅提升可用性!”可用區(qū)AAWS地理區(qū)可用區(qū)B可用區(qū)C可用區(qū)AAWS多可用區(qū)架構(gòu)可用區(qū)B可用區(qū)CApplicationzon Web Services, Inc. or its affiliates. All rights Amazon Dy

5、namoDBAmazonRDSAmazon ElastiCacheAmazonS3Amazon EFSAmazon SQSAmazon KinesisAmazon ElasticSearchDefault跨AZ部署經(jīng)由配置可跨AZ部署區(qū)域性的AWS服務(wù)AWSLambdaAmazon API GatewayAWSELBreserved.區(qū)域性服務(wù)AZ1AZ2AZ3Service XYZNo servers to provision or manageScales with usageNever pay for idleAvailability and fault tolerance built

6、in為何使用無服務(wù)器元件？18 Geographic Regions55 Availability Zones (AZs)4 regions and 12 more Availability Zones announced可用性的代價(jià)CostAvailabilityComplexity一般來說，可靠的服務(wù)擁有高可用性，而可用的服務(wù)也許有，也可能沒有高的可靠性。異步模型的消息傳遞AQueueBAQueueBListenerPub-SubWeb InstancesWorkerInstanceWorker InstanceQueueAPIInstanceAPIInstanceAPIInstanceA

7、PI: DO fooPUT JOB: JobID: 0001, Task: DO fooAPI: JobID: 0001GET JOB: JobID: 0001, Task: DO fooCacheResult:JobID: 0001,Result: barWorker InstanceWorkerInstanceQueueAPIInstanceAPIInstanceAPIInstanceCacheAmazon SNSPush NotificationUser為何要打造多區(qū)域多主架構(gòu)？為何多區(qū)域？1.降低終端用戶的網(wǎng)路延遲Applications in US WestApplications

8、in US EastUsers from San FranciscoUsers from New YorkService 2Service 3Service 4Service 1Service 2Service 3Service 4為何多區(qū)域？降低終端用戶的網(wǎng)路延遲災(zāi)備Service 1為何多區(qū)域？降低終端用戶的網(wǎng)路延遲災(zāi)備業(yè)務(wù)需求mazon Web Services, Inc. or its affiliates. All rights reserved.Netflix 2013 2018, Amazon Web Services, Inc. or its affiliates. All r

9、ights reserved.Netflix 2016 2018, Azon Web Services, Inc. or its affiliates. All rights reserved.Chaos Engineering為如何在AWS打造多區(qū)域架構(gòu)？可靠并且安全的網(wǎng)絡(luò)AWS Region AAWS Region BAmazon Global NetworkJames Hamilton 2016 re:InventV i c e P r e s i d e n t & D i s t i n g u i s h e d E n g i n e e r多區(qū)域多VPC互連互通S3 跨區(qū)域同步

10、Amazon RDS跨區(qū)只讀副本* For Aurora, MySQL, MariaDB and PostgreSQL engines.“簡易”的跨區(qū)部署模型區(qū)域 讀取所有 重要 寫入的流量導(dǎo) 向單一主節(jié)點(diǎn)Aurora 多主集群 橫向擴(kuò)展讀取與寫入節(jié)點(diǎn)任何主機(jī)故障都不會影響應(yīng)用任何可用區(qū)故障都不會影響應(yīng)用更快的寫入性能與更佳的性能擴(kuò)展單區(qū)域多主節(jié)點(diǎn)現(xiàn)在可以申請預(yù)覽多區(qū)域多主節(jié)點(diǎn)2018年推出Availability Zone 1Scale out both reads and writesAvailability Zone 2Availability Zone 3ApplicationRead

11、/Write Master 1Shared distributed storage volumeRead/WriteMaster 2Read/Write Master 3Amazon DynamoDB快速并且一致的性能表現(xiàn)高度可伸縮全受管關(guān)鍵業(yè)務(wù)可靠性Consistent single-digit millisecond latency; DAX in-memory performance reduces response times to microsecondsAuto-scaling to hundreds of terabytes of data that serve millions

12、 of requests per secondAutomatic provisioning, infrastructure management, scaling, and configuration with zero downtimeData is replicated across fault tolerant Availability Zones, with fine-grained access controlPrime Day 2017 MetricsBlock Storage Use of Amazon Elastic Block Store (EBS) grew by 40%

13、year-over-year, with aggregate data transfer jumping to 52 petabytes (a 50% increase) for the day and total I/O requests rising to 835 million (a 30% increase). NoSQL Database Amazon DynamoDB requests from Alexa, the A sites, and the Amazon fulfillment centers totaled 3.34 trillion, peaking at 12.9

14、million per second. Stack Creation Nearly 31,000 AWS CloudFormation stacks were created for Prime Day in order to bring additional AWS resources on line.API Usage AWS CloudTrail processed over 50 billion events and tracked more than 419 billion, all in support of Prime Day.Configuration Tracking AWS

15、 Config generated over 14 million Configuration items for AWS resources.Amazon DynamoDB Global Tables (GA)打造高效并且全球分散的應(yīng)用對本地表的讀寫訪問具有低延遲特性多區(qū)域冗余防止單個區(qū)域故障直接導(dǎo)致應(yīng)用故障方便配置而應(yīng)用無需重新改寫分布全球的用戶Replica (N. America)Replica (Europe)Replica (Asia)Global AppGlobal TableAmazon DynamoDB Streams每個流式記錄只會在流里面出現(xiàn)一次在DynamoDB tab

16、le里面修改的item, 流式記錄會依據(jù)每個item的 修改時(shí)間先后順序存放隊(duì)列AmazonDynamoDBAWSLambdaStreamsAmazon Route 53AWS的權(quán)威網(wǎng)域名稱服務(wù)(Authoritative DNS)高度可用與可伸縮支持透過各種路由定制Traffic Flow, 并且還能同時(shí)搭配 DNS fail-over切換。支持各種低延遲，可容錯的系統(tǒng)架構(gòu).Traffic Routing with Route53Amazon Route531.延遲路由策略(Latency Based Routing)Resource AResource BTraffic Routing w

17、ith Route53Amazon Route53延遲路由策略(Latency Based Routing)地理位置路由策略(Geo DNS)Resource A In USResource Bin EUUser in USTraffic Routing with Route53延遲路由策略(Latency Based Routing)地理位置路由策略(Geo DNS)3.加權(quán)路由策略(Weighted Based)Amazon Route53Resource A In USResource Bin EUTraffic Routing with Route53延遲路由策略(Latency Ba

18、sed Routing)地理位置路由策略(Geo DNS)加權(quán)路由策略(Weighted Based)故障轉(zhuǎn)移(DNS Failover)Amazon Route53Resource A In USResource Bin EUUser in US打造多區(qū)域無服務(wù)器架構(gòu)Amazon DynamoDBAWS LambdaAmazon DynamoDBAWS LambdaAmazon API GatewayAmazon API Gatewayeu-west-1us-east-1Global TablesAmazon Route53https:/globalddb.adhorn.me/Amazon

19、DynamoDBAmazon DynamoDBeu-west-1us-east-1Global Tableszon Web Services, Inc. or its affiliates. All rights reserved.zon Web Services, Inc. or its affiliates. All rights reserved.zon Web Services, Inc. or its affiliates. All rights reserved.zon Web Services, Inc. or its affiliates. All rights reserve

20、d.Amazon DynamoDBAWS LambdaAmazon DynamoDBAWS Lambdaeu-west-1us-east-1Global Tableszon Web Services, Inc. or its affiliates. All rights reserved.AWS Lambda FunctionAmazon DynamoDBAWS LambdaAmazon DynamoDBAWS LambdaAmazon API Gatewayeu-west-1Amazon API Gatewayus-east-1Global Tablesus-west-2ClientAmazonRoute 53Regional APIEndpointRegionalAPIEndpointCustom Domain NameCustom Domain NameAPI GatewayAPI Gatewayus-east-1LambdaLambda多區(qū)域運(yùn)行API GatewayRoute53: Traffic PolicyAmazon DynamoDBAWS