There’s a number of our larger users that are run BIG jobs on AWS Elastic MapReduce. Since EMR spins up so many EC2 instances as part of the job, and jobs run for varying amounts of time – it can be hard to get a sense for how much a particular job actually cost, and what resources were utilised.

So starting today, we launched an EMR tracker. As you can see in the screenshot below, we use the EMR auto tags to capture all the resources used and show the total EC2 cost, EMR cost and total JOB cost -

there is also a drop down that shows all the EC2 resources used, by instance tag, time running, EC2 cost and EMR cost

You can find by going to usage tab –> compute –> EMR.

This covers most of the EMR costs – we will add S3 shortly too. If you use EMR and want to track what’s happening – signup now and give it a whirl!

No related posts.