So far, learnt how to collect data and also understood that once data has been collected, you can process it. But, how do we deal when we need to process the data as and when it comes? Before proceeding further with how to deal with data in real-time, let’s get a brief overview of batch and real-time processing and also understand the difference between them.
In the next video, our SME Vishwa will explain these concepts in detail.
In this video, you learnt about batch and real-time processing. In batch processing, you collect data over a period of time, and then, you process the collected data. Whereas in real-time processing, the data needs to be processed as and when it comes. You also looked at some of the examples where each of data processing is used.
Then, you were introduced to some important differences between the two types of data processing. Some of the key differences are as follows:
- Generally, in batch processing, data is collected over a period of time, which means that a huge amount of data has to be processed. In real-time processing, data is processed as and when it comes, and hence, the amount of data is less.
- Latency is given the utmost importance in real-time processing. However, this is not the case with batch processing.
- Generally, real-time processing is expensive as compared with batch processing.
- In batch processing, if there is some downtime, then we can still live up with it, but in real-time processing, downtime means loss of data and information.
Now in the next segment, you will learn how the traditional messaging systems works.
Additional Reading
Batch and Real-time processing: You can read about the difference between batch and real-time processing using this link.
Use Cases: You can read about the difference between batch and real-time processing and their use cases using this link.
Report an error