You receive a 50 MB Apache Parquet file for a fraud detection model that contains several correlated, unnecessary columns. What is the least-effort way to remove those columns from the file?
Choose an answer
Tap an option to check your answer.
Correct answer: Create a data flow in SageMaker Data Wrangler and add a transform step to drop the unneeded columns..
Why this is the answer
The least-effort way to remove columns from a Parquet file, especially when dealing with correlated and unnecessary features for a fraud detection model, is to use SageMaker Data Wrangler. Data Wrangler provides a visual interface to build data flows, allowing you to easily import data, add transform steps (like dropping columns), and export the processed data. This eliminates the need for writing custom code or managing infrastructure. Downloading the file locally and using a custom Python script is inefficient for larger files and requires manual execution. Creating an Apache Spark job on Amazon EMR is powerful but involves setting up and managing an EMR cluster, which is more effort than Data Wrangler for a simple column drop. Launching a SageMaker processing job with the SageMaker Python SDK is a programmatic approach, requiring you to write and manage the processing script, which is more effort than Data Wrangler's visual interface for this specific task.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed