By now, you must be well aware of the structure of a Flink program. In this segment, you will learn about some tools that can be used as connectors in a Flink program while using the DataStream API.
In the upcoming video, our expert will list some common connectors.
Let’s summarise your learnings from this video.
Connectors
Apache Flink provides users with the ability to access various external systems that can be used as a source or a sink. Some of the common connectors used by the DataStream API are as follows:
- Apache Kafka: It can act as either a source or a sink.
- Apache Cassandra: It can act as a data sink only.
- Amazon Kinesis Streams: It can act as either a source or a sink.
- Elasticsearch: It can act as a data sink only.
- HDFS: It can act as a data sink only.
- RabbitMQ: It can act as either a source or a sink.
- Google PubSub: It can act as either a source or a sink.
- JDBC: It can act as a data sink only.
Now that you are aware of all the components of a Flink program, in the following video expert will demonstrate a Flink program.
Note:
Please note that for the example shown above, you need to have installed Apache Kafka on your EC2 instance before hand.
Additional Reading
- DataStream Connectors – This is the official documentation link which explains the connectors in detail.
Report an error