DevOpsDays Silicon Valley 2013

Video recording and production done by DevOpsDays.

In the past year, Stackdriver has gone from, well, not existing to supporting over 130 beta customers. We receive thousands of measurements per second from our customers and perform time series aggregations in real time. The infrastructure for our hot data pipeline resides on AWS and is designed for scale, availability, consistency and performance using principles that originate in a book written in 1978. Wait, what? 1978? In this talk, we will discuss how the design choices we made for our stateless cell architecture were influenced by a book called Systemantics, first published 35 years ago. We’ll also demonstrate our cell architecture, which is a concept that you could reuse in your company. For example, one of the quotes adorning the walls of our office is “What could possibly go wrong?” This kind of defensive thinking permeates our consideration of software architecture, system architecture and cloud architecture. Not only do we presume that things can go wrong, we usually presume that something is always going wrong, or at least partially wrong. Our hot data pipeline is one of our key assets and was developed by pressure testing our design considerations with Systemantics quotes like: Systems in general work poorly or not at all. Complicated systems produce unexpected outcomes The real world is what it is reported to the system A complex system that works is invariably found to have evolved from a simple system that works. The Fail-Safe Theorem: When a Fail-Safe system fails, it fails by failing to fail safe. 2 Credits info@devopsdays.org Philip Jacob Leave the first comment: Click here to add a new comment More from Devopsdays 2013 - Silicon Valley Autoplay on Systems theory for successful enjoyment of AWS - Philip Jacob (ignite) from info@devopsdays.org Devopsdays Silicon Valley - Intro Video - Breakpoint from info@devopsdays.org Devops+Agile = Business Transformation - Jesse Robins from info@devopsdays.org Continuous Quality - Jeff Sussna from info@devopsdays.org Leading the Horses to Drink … Support and Initiate a devops transformation - Damon Edwards from info@devopsdays.org Beyond Pretty Charts … Analytics for the rest of us - Toufic Boubez from info@devopsdays.org Leveling Up a New Engineer in a Devops Culture; Healthy Sustainability - Gary Foster, Mercedes Coyle from info@devopsdays.org Clusters, developers, and the complexity in Infrastructure Automation - Antoni Batchelli from info@devopsdays.org Analysis techniques for identifying waste in your build pipeline - Scott Turnquest

Rated: Everyone
Viewed 5 times
Tags: There are no tags for this video.