Welcome to the course project. This project will test your knowledge of the tools related to real-time data processing, which you learnt throughout this course, The project mainly revolves around concepts of Apache Kafka and Apache Spark Streaming, which are some of the most widely used tools in the industry for real-time data processing.
In the next video, you will be introduced to our industry expert, who will be guiding you through this project. You will also be given a brief overview of the project.
In this project, you will go through a real-world use case from the retail sector. Your task would be to ingest data from a centralised Kafka server in real-time and process it to calculate various KPIs or key performance indicators.
People you will hear from in this project
Adjunct Faculty
Ajay Shukla
Software Engineer-II
Ajay works as Software Engineer -II at Microsoft. He has more than five years of experience in companies, such as Walmart and Yatra. He is skilled in various big data technologies, such as Apache Flink, Apache Spark, Apache Hive and Apache Storm.
Adjunct Faculty
Ajay Shukla
Senior Data Engineer, Intuit
Ajay is currently working as a senior data engineer at Intuit. He has been working in the big data domain for the past five years and is skilled in various tools and technologies such as Hadoop, Hive, Sqoop, Spark, Kafka, Flume, Cassandra and MongoDB.
Report an error