Description:

Camera based intelligent applications are a lot of fun! There are many practical applications of it like Industrial Counters, Real Time Object Tracking, Object Classification, Road Traffic Estimation etc. While they are fun and interesting, building them is not that trivial. Generally, building camera based intelligent applications require many modules in the pipelines and a data scientist may not be aware of those. It involves managing hardware, machine learning, a dashboard for user interaction and data visualization and most importantly a way to glue them all together. Taking care of all these requires a considerable amount of time to deploy an application.

I have been working on trying to build tools to simplify and streamline this process and allow data scientists to build such an application in days instead of weeks. In this talk, I will discuss the approach we have taken, the tools that we have built, of which some are open source, and explain how these tools improved the overall time needed to build camera based intelligent applications.

The presentation is structured as follows with details in slide link provided:

1. Overview

2. Modules in a camera based application

   • Data Ingestion
   • Pre-processing
   • Machine Learning
   • Dashboard

3. Our approach

   • User-agent on data capture device
   • A tool to deploy ML functions - Firefly
   • Modular dashboard components
   • Questions

In the hands on demo part, I will go through building one image/video based machine learning problem that a data scientist may want to make using our open source modules. I will show how to deploy the application on the Heroku/other platforms.

Prerequisites:

Basic knowledge of building blocks of a machine learning application. None in terms of hardware.

Content URLs:

Final Slides

Speaker Info:

The speaker is Nabarun Pal, a final year undergraduate student at Indian Institute of Technology Roorkee. Currently, he is working for rorodata which aims at providing data scientists a platform to build and deploy their models without the need of worrying about infrastructure, scalability, and performance. He is working on an Open Source Functions as a Service framework called firefly.

He is passionate about software development. He can also talk about Internet of Things, Electronics, Robotics with equal spirit. His journey with the field of software and robotics started in his schooling days. He represents the college in various Robotics competitions and was involved in projects related to the above domains, brief of which can be found here. He actively participates in conducting open lectures for students in the domains of Introductory Robotics, Control, AI and ML through a curated community of around 2000 members. He is also speaking at PyData Delhi 2017.

Speaker Links:

Homepage: https://nabarun.in<br/> LinkedIn: https://www.linkedin.com/in/nabarunpal/<br/> Github: https://github.com/palnabarun<br/> Firefly: https://github.com/rorodata/firefly/