This presentation was recorded at GOTO Aarhus 2012
http://gotocon.com
Adrian Cockcroft - Director of Architecture for the Cloud Systems Team at Netflix @adriancockcroft
ABSTRACT
Netflix grew rapidly and moved its streaming video service to the AWS cloud between 2009 and 2010. In 2011 the architecture was extended to use Apache Cassandra as a backend, and the service was internationalized to support Latin America. Early in 2012 Netflix launched in the UK and Ireland, using the the combination of AWS capacity in Ireland and Cassandra to create a truly global backend service. Since then the code that manages and operates the global Netflix platform is being released as a series of open source projects at netflix.github.com (Asgard, Priam etc.). The platform is structured as a large scale PaaS, strongly leveraging advanced features of AWS to deploy many thousands of instances. The platform has primary language support for Java/Tomcat with most management tools built using Groovy/Grails and operations tooling in Python. Continuous integration and deployment tooling leverages Jenkins, Ivy/Gradle, Artifactory. This talk will explain how to build your own custom PaaS on AWS using these components.
TIMECODES
0:00 Introduction
0:49 What Netflix Did
4:32 Keeping up with Developer Trends
6:32 Portability vs. Functionality
10:35 Freedom and Responsibility
12:42 Member Web Site
13:09 Content Delivery Service
14:25 Streaming Device API
14:47 Major Front End Services
15:12 Component Services
15:37 Web Server Dependencies Flow
16:22 One Request Snapshot
17:13 Current Architectural Patterns for Availability
18:39 Isolated Services
19:19 Three Balanced Availability Zones
20:52 Triple Replicated Persistence
22:15 Isolated Regions
26:15 Failure Modes and Effects
28:45 Netflix Deployed on AWS
33:03 Datacenter to Cloud Transition Goals
35:48 Netflix Datacenter vs. Cloud Arch
37:21 Chaos Monkey
39:03 Responsibility and Experience
41:34 Resilient Design - Circuit Breakers
43:22 Components
44:37 Build Pipeline
45:36 Jenkins Architecture
46:30 Netflix Extensions to Jenkins
46:59 The Bakery
48:17 Accounts Isolate Concerns
50:30 Reservations and Billing
52:10 Cloud Access Control
54:24 Runtime
54:38 Open Source Projects
57:15 Roadmap for 2012
58:03 Amazon Cloud Terminology Reference
https://twitter.com/gotocon
https://www.facebook.com/GOTOConference
http://gotocon.com