Monitoring infrastructure and application using Django, Sensu and Celery.
Monitoring is a key aspect for any business. It enables us to find and be notified about the problem way ahead our customer notices it, which enables us to keep our businesses running and making customers happy.
I will be talking about how we SREs at Opentable Inc, tries to solve the good old monitoring problem, sensu with puppet, using Django, Sensu and Celery.
If you are fed up with the limitations of what current monitoring tools offer, this is the talk you wanna look out.
At the end of talk, audience would have an alternative approach for monitoring using python.
Contents of the talk:
- I will start the talk with a brief introduction of myself and my journey with python.
- Introduce monitoring and how we use currently at Opentable Inc.
- Describe limitations we have with our previous monitoring stack.
- Alternate new generation monitoring architecture using python tools Django and Celery, keeping sensu intact.
- How we developed a site using Django, which help us to maintain the checks and add new check definition.
- How we used Celery distribution system to run checks on multiple worker nodes and send results to sensu.
- I will talk about how we scaled celery worker nodes by setting up different queues, and prioritising the tasks and by using Flower.
- Basic knowledge of Sensu.
- Basic knowledge of Django and Celery.
- Will to learn
My name is Hari Kishore Sirivella. I have good experience with different verticals like testing, developing, devops and SRE in my 4 years of IT profession. I like to explore technology and reinvent myself, started as a manual tester in TCS, to selenium automation tester, to devops engineer, to my current role Site Reliability Engineer at Opentable. Passion towards development and will to learn operations, made me travel across various verticals and eventually land as SRE, where I get to work on both worlds - develop products and maintain them.
As a selenium automation tester, I used to work on core Java and was introduced to python just 8 months back, with a task to introduce chatops in my organisation.
I have developed and led a team, Voice based web browser as my final year project in my engineering, where you get to browse the internet , bookmark a page, navigate previous and next pages using your voice commands. The browser also reads out text enabling differently challenged persons to use it seamlessly.
I work on lot of open source projects.
I'm also a Machine Learning and Data Science enthusiast.