A data scientist has 20 TB of CSV data in Amazon S3 and needs to convert it to Apache Parquet with the least effort. What is the simplest way to perform this conversion?
Choose an answer
Tap an option to check your answer.
Correct answer: Write a conversion script and run it as an AWS Glue job to read the CSV and write Parquet output..
Why this is the answer
Running a conversion script as an AWS Glue job is the simplest and most efficient method for converting a large volume (20 TB) of CSV data to Parquet. AWS Glue is a fully managed extract, transform, and load (ETL) service that can handle large datasets without requiring you to provision or manage servers. It automatically scales resources as needed. Using an AWS Glue crawler primarily infers schema and populates the AWS Glue Data Catalog; it does not convert data formats. While an Amazon EMR cluster could perform the conversion, it requires more effort to set up, configure, and manage the cluster compared to a serverless AWS Glue job. An Amazon SageMaker notebook is suitable for interactive data exploration and smaller-scale processing, but it is not designed for large-scale, production-grade ETL tasks like converting 20 TB of data efficiently.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed