Welcome to this session on ‘Kafka Connect and Kafka Streams’. In the upcoming video, Vishwa will provide an overview of the concepts and topics that will be covered in this session.
In this session
You will get an understanding of what Kafka Connect is. You will also understand some of the key concepts related to Kafka Connect. After completing the theoretical aspect of Kafka Connect, you will get hands-on experience of using Kafka Connect. You will try to fetch data from Twitter. You will push messages inside a topic and write a simple consumer program to read the messages on the topic.
Next, You will learn about Kafka Streams, the streaming solution offered by Kafka. You will also learn about the different nodes in a stream processing topology and go through a demonstration of a simple word count program. As there is no support for Kafka Streams in python, Java will be used as the programming language for the Kafka Streams part.
The PPT used in this session is available in the Session Summary segment. NOTE: Due to changes in Twitter’s API policy, there may be some delay in creating the Twitter developer profile.
Guidelines for in-segment questions
The questions in this session are not graded.
People you will hear from in this module
Subject Matter Expert
Vishwa Mohan
Senior Software Engineer, LinkedIn
Vishwa is currently working as a senior software engineer at LinkedIn, an online employment-oriented platform. He has over nine and a half years of experience in the IT industry and has worked at various companies, including Amazon, Walmart and Oracle. He has a deep knowledge of various tools and technologies used today.