+1 -1 +3
Vote on this proposal

LinkedIn's Infrastructure Management System

by Pradeep Hodigere (speaking)

Section
Infrastructure
Technical level
Intermediate

Objective

LinkedIn's infrastructure is growing at an exponential pace. This talk is going to focus on the underlying platform developed so we can keep up with the pace of this growth

Description

We are one of the fastest growing companies in our space. In our environment, each day brings a new challenge. This provides a unique opportunity where one the one hand, the day-job demands keeping the 'lights on' by attending to infrastructure issues and then spend the rest of the day, thinking of the next bottleneck in the infrastructure that needs to be scaled.

With Python and its vast resource of libraries around open source utilities like celery, redis, flask, queuing and multiprocessing solutions, we have developed a platform that:
1. Manages configuration of a heterogeneous infrastructure
2. Keep track of a constantly changing configuration
3. Automatically update the system monitoring this elastic infrastructure
4. Provide a data-analysis platform that identifies operational issues close to real-time and provides capacity models for architects to scale this infrastructure

This have helped a lean infrastructure team to keep up with its exponential growth

Speaker bio

Pradeep Hodigere has been working in the infrastructure management space, at companies with massive infrastructure, building systems that manage the application, systems and network tiers. He is leading a small team of python engineers who use the best of open-source to build end-2-end systems.