Applying Transfer Learning on Your Data

Amita Kapoor (~amita)


7

Votes

Description:

Humans have great ability to generalize; we can very efficiently apply the knowledge we learned in classrooms to real world problems. Transfer learning provides a similar capability to artificial neural networks. The Workshop will introduce the concept of 'Transfer Learning' described by Andrew Ng, the leading expert in Machine Learning as the "next driver of ML commercial success." Transfer Learning is important because training deep neural networks from scratch have two key requirements. First, we need a large labeled dataset; the second one requires computationally efficient hardware (GPUs). While such immensely large data exists for some tasks and domains, in most cases the data are usually proprietary or expensive. Transfer Learning, the technique to use models pre-trained on one domain for another problem domain, provides the ability to use DNNs even when the dataset is small. Moreover, Transfer learning requires less computation and thus can be done in respectable time using CPUs as well.

The workshop will cover following topics:

  • Introduction to Transfer Learning
  • Application of Transfer Learning
  • Transfer Learning Scenarios
  • Applying Transfer using Keras and Tensorflow

And finally, we will have hands on session demonstrating how to use Xception and Inception networks for Dog breed Recognition.

Prerequisites:

  • Anaconda installed (Python =3.5)
  • Tensorflow 1.x
  • Numpy
  • Matplotlib
  • Pandas
  • Seaborn
  • For the sake of convenience and due to limited time, Speaker, will also provide environment 'yml' files (Windows10, Ubuntu14.04/16.04, Mac OS X)

Content URLs:

To make best use of the workshop it would be appreciated if participants are well versed with Anaconda, Python and understand Convolution Neural Networks. The information necessary can be accessed via following links

Speaker Info:

Amita Kapoor: Amita Kapoor is Associate Professor in the Department of Electronics, SRCASW, University of Delhi. She has been actively teaching neural networks for last twenty years. She did her Masters in Electronics in the year 1996, and her PhD in the year 2011. During the course of her PhD, she was awarded prestigious DAAD fellowship to pursue a part of her research work in Karlsruhe Institute of Technology, Karlsruhe, Germany. She had been awarded best Presentation Award at International Conference Photonics 2008 for her paper. She is a member of professional bodies like OSA (Optical Society of America), IEEE (Institute of Electrical and Electronics Engineers), INNS (International Neural Network Society), ISBS (Indian Society for Buddhist Studies). She has more than 40 publications in the international journals and conferences. Her present research areas include Machine Learning, Artificial Intelligence, Neural Networks, Photonics and Robotics.

Narotam Singh: Narotam Singh has been with India Meteorological Department, Ministry of Earth Sciences, India since 1996. He has been actively involved with various technical programs and training of officers of GOI in the field of Information Technology and Communication. He did his post-graduation in the field of Electronics in 1996 and both Post graduate diploma and Diploma in the field of Computer Engineering, in 1997 and 1994 respectively. He is currently working in the enigmatic field of Neural Networks.

Speaker Links:

Amita Kapoor: Personal Website, Github, Linkedin

Narotam Singh: Personal Website, Github, Linkedin

Section: Data Analysis and Visualization
Type: Workshops
Target Audience: Intermediate
Last Updated:

I received a reviewer comment, asking if it is same as my talk at PyData: Response: It is on the same topic, but while at PyData I am giving only a 30-minute talk. Here I would like to show how to do it properly (and so it is a workshop), and also take up individual problems as they try to implement it.

So yes, in terms of the topic they are same, but in terms of depth covered they will be very different. And to be honest Transfer Learning is a practical concept, even at PyData, I wanted to do the workshop, so that many are benefitted. But doing a workshop alone is not possible. I could not find a partner for PyData, but for PyCon I have a colleague Mr Narotam Singh, accompanying me.

Dr Amita Kapoor (~amita-kapoor)

It will be more helpful for us in the selection if you add your slides here.

Rajat Saini (~rajataaron)

I am adding the link to Presentation I gave in PyData Delhi. In the workshop, I will be adding working examples to perform all the three Transfer Learning methods mentioned on page 18 of the presentation.

https://github.com/amita-kapoor/Invited_Talks/blob/master/PyData%20Delhi%202017/Transfer%20Learning%20Using%20Keras%20and%20Tensorflow.pdf

Dr Amita Kapoor (~amita-kapoor)

Login to add a new comment.