Submissions Required
Upload a ZIP file containing the following:
- A Python script (spark-streaming.py) containing the code for the project, which will process the input data streams into the resultant JSON files. This script should have proper comments, explaining all the steps taken.
- A PDF document (CodeLogic.pdf) containing the logic that you applied to solve the entire project. This will also have the commands used to run the Spark Submit job and any other commands that you used in addition to the Python script discussed above.
- A ZIP file (Output.zip) containing the following files:
- The Console-output file that will have the console output from the Spark Submit command containing the summarised input tables for the various batches
- A ZIP file (Timebased-KPI.zip) containing all JSON files created for time-based KPIs.
- A ZIP file (Country-and-timebased-KPI.zip) containing all JSON files created for the country-and time-based KPIs.
Please make sure that you are not changing any of the file names that have been provided above in brackets. The code that you are submitting should run at our end without any modifications in the code.
Make sure that you have not made any changes to the original data stream. You will be graded based on the queries and documentation submitted.
The following zip file contains sample results to show how the product solution should look like –
You must click on ‘Submit for Grading’ only if you are 100% sure of your answers.
Otherwise, you can just upload your file. It will be automatically submitted by the deadline. If you click on ‘Submit for Grading’ after uploading the file, under no circumstance will you be allowed to resubmit or make any changes to your file.
Report an error