Turbocharged Microservices: Harnessing Python, gRPC, and Kafka for Unmatched Scalability

Allen Y (~allen8)




In this session, attendees will learn:

Introduction to Microservices Architecture:

A brief overview of microservices, their benefits, and common challenges.

Why gRPC?:

Understanding gRPC, its advantages over traditional REST APIs, and how it enhances communication in microservices.

Why Kafka?:

Exploring Kafka's role in building resilient, real-time data pipelines, and how it ensures high availability and fault tolerance.

Integrating gRPC with Python:

Step-by-step guide on setting up a gRPC server and client in Python, including defining service contracts with Protocol Buffers.

Using Kafka with Python:

Setting up Kafka producers and consumers in Python to handle real-time data streams effectively.

Combining gRPC and Kafka:

Best practices for integrating gRPC and Kafka in a microservices architecture, focusing on creating asynchronous, event-driven services.

Hands-on Demonstration:

A live coding session demonstrating the creation of a simple microservice using Python, gRPC, and Kafka. This will include setting up a Kafka cluster, defining gRPC services, and integrating both technologies in a cohesive application.

Deployment and Scaling:

Strategies for deploying and scaling microservices in production environments, including containerization with Docker and orchestration with Kubernetes.

Case Studies and Real-World Examples:

Discussion of real-world applications and success stories where Python, gRPC, and Kafka were used to solve complex problems.



Attendees should have: 1. Basic understanding of Python syntax and programming concepts. 2. Knowledge of web services and APIs, including RESTful APIs. 3. Introduction to microservices architecture and its benefits. 4. Familiarity with asynchronous programming in Python (e.g., async/await). 5. Basic understanding of messaging and streaming systems like Kafka. 6. (Optional but recommended) Experience with containerization using Docker.

Speaker Info:

Hello, I am Allen Y👋

As a Product Engineer at UST, I'm excited to embark on a journey where I'll be translating ideas into innovative solutions. I'm eager to learn, adapt, and contribute to our mission of creating impactful products. Let's connect and explore the world of product engineering together!

⚡I'm experienced in Machine Learning, Flutter, Web Development, Android Development, Python, and several JavaScript libraries

👨‍💻 To get to know about my work visit my website https://alleny244.github.io/Portfolio-Website/

➡️ You can reach out to me at alleny244@gmail.com.

➡️Find me on GitHub @Alleny244. https://github.com/Alleny244

Linkedin https://www.linkedin.com/in/allen-y-3804091ab/

Section: Python in Platform Engineering and Developer Operations
Type: Talk
Target Audience: Intermediate
Last Updated: