Architecting large volume streaming data solution in python.

Aniket Dalal (~aniket2)




Solutions developed for web, especially over social network have started seeing demand for large scale real time streaming data analytics. This requires building applications on distributed platform that can scale, reliably process data without any loss, satisfy functional needs and at the same time meet the strict latency requirements .

This talk aims at discussing use case for large volume streaming data analysis. Goal of this session would be to cover:

  • Challenges of developing streaming data architecture.
  • Defining streaming data use case and distributed architecture for it.
  • Brief introduction to Kafka and its application in solving streaming data retention.
  • Brief Introduction to Spark and its application in distributed computing.


Basic knowledge of Python Programming.

Speaker Links:

Section: Data Visualization and Analytics
Type: Talks
Target Audience: Beginner
Last Updated: