Description:

With the advent of Large Language Models, developers are exploring new ways to interact with these models and create AI enabled apps. With so many options for LLM available now, it is hard to decide on an approach that allows application developers to set up their environment with ease. In this talk, we will demo how a python application developer can call the service of InstructLab, an OpenSource LLM using Podman Desktop AI Lab and get it working in under 10 minutes. This talk aims to explain the benefits of using Podman Desktop AI Lab for local AI development and explains how different models such as InstructLab, Merlinite, Mistral and many more. We will also explain the Open Source InstructLab LLM and how developers can contribute to this project.

Agenda:

Introduce InstructLab, an open source LLM to the audience. Introduce Podman Desktop AI Lab, a Podman Desktop extension for running multiple LLM models locally. Demo on how to start an API service of InstructLab from Podman Desktop AI Lab on a local machine and use it in a Python application.

Prerequisites:

Basic knowledge of large language models. Python development skills.

Video URL:

https://drive.google.com/file/d/1jt6kDaQPeM8VP_OJLW7x4DB8dczYpIpk/view?usp=share_link

Speaker Info:

Ramakrishna Yekulla

Ramakrishna Reddy Yekulla ("Ramky") works as a Principal Architect within the Application Developer Business Unit at Red Hat. In this role, he focuses on creating distinctive platform features that enhance developer efficiency, streamline data and application connections, and empower customers with the knowledge and resources to prioritize software supply chain security, minimize technical obligations, and achieve compliance goals. His interests lie in System Design, Functional Programming and Observability.

Himanshu Yadav

Himanshu works as a Senior Principal Product Manager with the Application Developer Business Unit at Red Hat. In this role, he focuses on creating digital experiences for the developer audience and streamlining their experience with different technologies and Red Hat products. His interests lie in AI, UX and automation.

Speaker Links:

Ramakrishna Yekulla LinkedIn: https://www.linkedin.com/in/ramkrsna/ Previous talks: https://www.youtube.com/watch?v=bsAqoWiGmpQ

Himanshu Yadav LinkedIn: https://www.linkedin.com/in/himanshu-yadav-780a6617/ Previous talks: https://www.youtube.com/watch?v=7FPpG57cbL4