A company has 10 TB of log files in Apache Parquet format stored in an Amazon S3 bucket and occasionally needs to run SQL queries against them. Which is the most cost-effective solution?
Choose an answer
Tap an option to check your answer.
Correct answer: Create an AWS Glue crawler to store and retrieve table metadata from the S3 bucket. Use Amazon Athena to run SQL statements directly on the data in the S3 bucket..
Why this is the answer
The most cost-effective solution is to use AWS Glue and Amazon Athena. AWS Glue can crawl the S3 bucket to discover the schema of the Parquet files and store the metadata in a Glue Data Catalog. Amazon Athena can then use this catalog to run SQL queries directly against the data in S3 without needing to load or transform it. This is serverless, meaning you only pay for the queries you run and the data scanned, making it highly cost-effective for occasional queries. Creating an Amazon Aurora MySQL database and migrating data is expensive due to storage and compute costs for the database and the migration effort. An Amazon Redshift cluster is also costly as it involves provisioning and maintaining a cluster, even if Redshift Spectrum can query S3. An Amazon EMR cluster is powerful but involves provisioning and managing servers, making it less cost-effective for occasional queries compared to serverless Athena.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed