A company runs multiple ETL workflows that pull data from operational databases into an S3 data lake. These workflows use AWS Glue and Amazon EMR. The company wants to add automated orchestration while minimizing manual effort and operational overhead. Which solution meets these goals with the LEAST operational overhead?
Choose an answer
Tap an option to check your answer.
Correct answer: AWS Step Functions tasks.
Why this is the answer
AWS Step Functions provides a serverless workflow orchestrator that integrates natively with AWS Glue and Amazon EMR, making it ideal for coordinating complex ETL processes with minimal operational overhead. It automatically manages state, retries, and error handling, reducing the need for custom code. AWS Glue workflows can orchestrate Glue jobs but are less flexible for integrating EMR or other services compared to Step Functions. AWS Lambda functions are suitable for individual tasks but require significant custom code for complex orchestration, state management, and error handling. Amazon MWAA offers powerful orchestration but involves managing an Apache Airflow environment, which has higher operational overhead than Step Functions' fully managed, serverless approach.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed