Baking Machine image with confidence
Devesh Bajaj (~devesh50) |
With machine learning increasingly becoming an engineering problem -not all ML applications are compatible with docker, and being an event-driven company adds the cherry on the top. Most of the standard approaches like docker, rtk fails to solve the problem like heavy model deployment, multiprocessor apps.
At Episource, we faced a similar challenge of deploying 100s of instances and configuring these instances at boot time with a wide variety of tools and libraries to support the inference models. This installation of ML model and configuration them at runtime comes with the cost of both time and money. Any failed bootstrapped instance can make that instance obsolete, which leads to affecting our SLA.
Avoid any runtime installation and network call for installation, we have built the solution around machine image and its interaction with our CICD pipeline.
This talk revolves around the best practice to build Machine images to avoid runtime crashing and how to automate the same workflow in release CICD and reduce the developer overhead. This talk talks don't focus on the specific tool but on the approach to build a sustainable and strong MI building CICD pipeline.
- A quick primer on problems related to Implement a CICD on Non-Dockerise application (~ 5 mins)
- Introduction about Episource and speaker (~3 mins)
- Introduction to Machine Image and its multiple use cases (~2 mins)
- Tools and practice associated with Machine images (~5 mins)
- Problem with building image in CI server (~5 mins)
- Observability and testing pipeline of image building (~5 mins)
- QnA (~5 mins)
(Note:- Slides are subject to vary a little at the time of conference )
Devesh is a Data Engineer with Episource LLC, with close to 2 years of experience.
With primarily involved in building microservices that perform Machine Learning Inference along with the development and deployment of end-to-end full-stack applications.
With the keen passion for the development of IoT based application and Won 2nd prize in CanSat(2017) Satellite design competition organized By American Astronautical Society (AAS) and Recognised by NASA.
You can find Devesh at
LinkedIn :- https://www.linkedin.com/in/devesh-bajaj/
Twitter :- https://twitter.com/deveshbajaj59
Medium : - https://medium.com/@deveshbajaj59
Github :- https://github.com/deveshbajaj