LinkedIn's Infrastructure Management System
by Pradeep Hodigere (speaking)
Objective
LinkedIn's infrastructure is growing at an exponential pace. This talk is going to focus on the underlying platform developed so we can keep up with the pace of this growth
Description
We are one of the fastest growing companies in our space. In our environment, each day brings a new challenge. This provides a unique opportunity where one the one hand, the day-job demands keeping the 'lights on' by attending to infrastructure issues and then spend the rest of the day, thinking of the next bottleneck in the infrastructure that needs to be scaled.
With Python and its vast resource of libraries around open source utilities like celery, redis, flask, queuing and multiprocessing solutions, we have developed a platform that:
1. Manages configuration of a heterogeneous infrastructure
2. Keep track of a constantly changing configuration
3. Automatically update the system monitoring this elastic infrastructure
4. Provide a data-analysis platform that identifies operational issues close to real-time and provides capacity models for architects to scale this infrastructure
This have helped a lean infrastructure team to keep up with its exponential growth
Speaker bio
Pradeep Hodigere has been working in the infrastructure management space, at companies with massive infrastructure, building systems that manage the application, systems and network tiers. He is leading a small team of python engineers who use the best of open-source to build end-2-end systems.