Description:

In this talk, we will explore the transformative power of local models, specifically focusing on openly available large language models (LLMs) and large multimodal models (LMMs) that can be run on personal computers, with or without GPUs. We will delve into the concept of "owning your AI," emphasizing the benefits of leveraging decentralized AI solutions rather than depending solely on a few centralized AI providers.

We will demonstrate how easy it is to use Python-based tools to implement these models, starting with simple commands like pip install ollama to get started with fully local LLMs. This session aims to empower attendees to enhance their productivity using local AI models, providing a cost-effective alternative to subscription-based AI services.

Key takeaways from this talk will include:

Understanding the benefits of using local AI models. Learning the tools and techniques to set up and run local LLMs and LMMs. Exploring practical applications that can boost your productivity. Insights into hacking and experimenting with LLMs without incurring significant costs (excluding compute and power).

Prerequisites:

Basic Python and LLM Exposure

Speaker Info:

AbdulMajedRaja, has over a decade of experience as an Engineer and Data Scientist in the tech industry. Abdul brings a wealth of professional knowledge to the table. But he's not just about technical expertise; he's a dedicated educator on a mission to make technology accessible to everyone. His true passion lies in bridging the gap between tech enthusiasts and those who may not be as tech-savvy.

Speaker Links:

Youtube - https://youtube.com/c/1littlecoder Previous Pycon talk - https://youtu.be/ECFkJLpQqCQ?si=X6BXPks0SqUkrusM