Which service simplifies large-volume data processing with Hadoop on AWS?

• A. AWS Glue
• B. Amazon Kinesis Data Analytics
• C. AWS Data Exchange
• D. Amazon EMR

Answer: (D)

Amazon EMR is a managed Hadoop ecosystem on AWS that simplifies large-volume data processing. It handles provisioning and configuring clusters, tuning, scaling, and fault management, so you can run Hadoop frameworks like MapReduce, Hive, Pig, Spark, and Tez without managing the underlying servers. EMR integrates with S3 for data storage and supports elastic growth or shrinkage of clusters, allowing you to scale with workload demands and optimize costs. This focus on a managed Hadoop environment makes it the best fit for batch processing at scale on AWS.

The other services don’t fit as neatly. AWS Glue is a serverless ETL service aimed at data preparation and transformation rather than running Hadoop clusters. Amazon Kinesis Data Analytics targets real-time streaming analytics, not batch Hadoop processing. AWS Data Exchange is for sharing and licensing data, not executing Hadoop workloads.