A reporting system delivers hundreds of .csv files to an Amazon S3 bucket each day. The company must convert these files to Apache Parquet and store the results in a transformed data bucket. Which solution will meet the requirement with the LEAST development effort?
Choose an answer
Tap an option to check your answer.
Correct answer: Create an AWS Glue crawler to discover the data and an AWS Glue extract, transform, and load (ETL) job to transform the data, specifying the transformed data bucket as the ETL output..
Why this is the answer
AWS Glue is a fully managed ETL service that natively supports converting data formats like CSV to Parquet with minimal development effort. An AWS Glue crawler automatically discovers the schema of the CSV files, and an AWS Glue ETL job (often generated automatically or with minor modifications) can perform the conversion and write the output to the specified S3 bucket. Creating an Amazon EMR cluster with Apache Spark requires managing the cluster and writing a Spark application, which is more development effort. AWS Batch is suitable for general-purpose batch computing but requires writing and managing the transformation logic within a custom script, increasing development effort compared to Glue. An AWS Lambda function is suitable for smaller, event-driven transformations, but for hundreds of files daily, especially if they are large, managing the Lambda concurrency, memory, and execution time limits, and writing the entire transformation logic, would involve more development and operational overhead than Glue.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed