EvalAI: An open source alternative of Kaggle
RishabhJain |
Description:
EvalAI is an open source web application that helps researchers, students and data-scientists to create, collaborate and participate in various AI challenges organized round the globe. <p>In recent years, it has become increasingly difficult to compare an algorithm solving a given task with other existing approaches. These comparisons suffer from minor differences in algorithm implementation, use of non-standard dataset splits and different evaluation metrics. By providing a central leaderboard and submission interface, we make it easier for researchers to reproduce the results mentioned in the paper and perform reliable & accurate quantitative analysis. By providing swift and robust backends based on map-reduce frameworks that speed up evaluation on the fly, EvalAI aims to make it easier for researchers to reproduce results from technical papers and perform reliable and accurate analyses. </p>
Prerequisites:
- Basic understanding of Python
- Django, Django Rest Framework
- Knowledge of front-end technologies like AngularJS, HTML, CSS
- Basic knowledge of DevOps tools like Docker
Content URLs:
- EvalAI: https://evalai.cloudcv.org/
- Source Code: https://github.com/Cloud-CV/EvalAI
- Issue Tracker: https://github.com/Cloud-CV/EvalAI/issues
- Gitter: https://gitter.im/Cloud-CV/EvalAI
Speaker Info:
Mentors:
- Taranjeet Singh : A tech and open source enthusiast, Entrepreneur, Quizzer, GSoC'17 Mentor
- Shiv Baran Singh : An open source contributor, JavaScript Developer, GSoC'17 Mentor
- Rishabh Jain : An open source enthusiast | GSoC'17 Intern under CloudCV | Interested in Machine Learning