Now that you have created an EMR instance, the next step is to access that instance by logging in to it. In the following video, you will learn how to access EMR instances in Windows os as well as Linux/mac system and the EMR instance.
Steps For Windows Users
To access EMR instances from a Windows system, PuTTY is used.
PuTTY
PuTTY is a serial console and a network file transfer application. PuTTY allows user to a remote system from their host machine . you will use PuTTY to log in to your EMR instance.
Following are the step-by- step document for the steps performed in the video above . the link to download PuTTY is also present in the document.
Note-
Make sure that you have set the security group of your Master node to ‘Anywhere’ before attempting to log in to the instance ; otherwise, you will not be able to connect to the EMR instance.
To transfer file from the local system system having Windows os to the EMR instance and versa, WinSCR is used.
WinSCP
WinSCP(Windows Secure Copy) is an open -source file transfer client for Windows. it is used for transferring files from a local computer to a remote machine. it protects private information such as login ID and password by using cryptographic methods . in the following video, you will learn how to transfer file from an EMR instance to a local machine and vice versa using WinSCP.
Steps for Mac/Linux Users
Mac and Linux users can simply use the SSH command from their terminal to log in to the EMR instance, and the SCP command for transferring files. the steps for the same are shown in the following video.
Note:
Make sure that you have set the Security group of your master node to ‘Anywhere’ before attempting to log in to the instance; otherwise, you will not be able to connect to the EMR instance.
Note:
As you know that EMR instance have to be terminated after usage, it is important that you remember to back up any code file and datasets that you might requir later on your local machine. Documenting the steps that you have taken in your EMR instance may also be beneficial to you in quickly setting up the EMR instance the next time you want to use it and continue on your work.
After having logged in to your EMR instance, it is important that you follow the steps shown in the following video before starting with your work. these steps are included in the EMR login documents given above.
Note:
In case you are not able to run the ‘aws83 1s’ command on your EMR cluster, you will have to follow the following document to add S3 Full Access permissions to your EMR EC2 default role in IAM. Please note that this is strictly required only if the above command does not work.
In the next segment, you will learn about some of the commonly used commands in Linux.
Report an error