Webscraping and automation for novice users.
Chirag Shah (~avidLearnerInProgress) |
Information is being generated at an exponential rate everyday. There are multiple sources generating information. It becomes really tedious for a person to go and visit all the sources to obtain information. It could be of great help to the person if there can be a single source which cumulatively providing all the links of news generated by different newspapers. This is where web scraping and automation comes into picture.
In this talk I want to explain how to scrape webpages hassle free, gather information and represent the gathered content in a easy to visualize format. By executing just a single Python file we can get all the data what we want from the web. Its not just about collecting the data, it is to reduce the repetitive work which a person does again and again to achieve the same goal. We can put repetitive work into a module and leave it upon the computer to do the same. This in turn will help us channelize our time more on the information rather than gathering that information.
Agenda of Talk:
- Introduction: Web scraping, automation tools, parsing and scraping python libraries.
- How it helps in learning python extensively: My experience with web scraping and various use-cases on which I utilized.
- Q&A session.
I have been into CS field for over 6 years now. I have completed my BTech in Information Technology from Veermata Jijabai Technological Institute, Mumbai (VJTI). Also, I have done my diploma in Information Technology.
I will be joining Barclays India as an SDE in the month of August.
Software development is my long suit. AI, ML and Data Science are my goto subjects. Competitive programming is something I love to do in my spare time.
I like tinkering with new technologies, creating new projects and implementing things by myself. I have been contributing on github for over a year now.
I am an avid learner and I can quickly adopt to new frameworks. Also, I am a mediocre public speaker with modest interest in Fintech and Investment Banking.