A data engineer must orchestrate an Amazon EMR ETL pipeline that ingests data from multiple sources and maximize performance while minimizing cost. Which AWS orchestration service is the most cost-effective choice for this requirement?
Choose an answer
Tap an option to check your answer.
Correct answer: AWS Step Functions.
Why this is the answer
AWS Step Functions is the most cost-effective choice because it is a serverless workflow orchestration service. You pay only for the state transitions, making it highly cost-efficient for event-driven or intermittent ETL workloads. It provides visual workflows for complex orchestrations, including error handling, retries, and parallel processing, which are crucial for robust ETL pipelines. Amazon EventBridge is a serverless event bus that primarily routes events between services, not orchestrating complex multi-step workflows. Amazon MWAA is a fully managed Apache Airflow service, which can be expensive due to its persistent infrastructure, even when idle. AWS Glue Workflows are designed for orchestrating AWS Glue jobs specifically and might not be as flexible or cost-effective for orchestrating diverse EMR-based ETL pipelines involving multiple AWS services beyond Glue.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed