A data engineer built an AWS Glue ETL pipeline and must crawl a table in Microsoft SQL Server, then write the crawl output to S3 and orchestrate the pipeline. What AWS feature provides this capability at the lowest cost?
Choose an answer
Tap an option to check your answer.
Correct answer: AWS Glue workflows.
Why this is the answer
AWS Glue workflows provide a cost-effective solution for orchestrating ETL pipelines, including crawling data from sources like Microsoft SQL Server, processing it with Glue jobs, and writing output to Amazon S3. Workflows allow you to define a sequence of Glue crawlers, jobs, and triggers, ensuring that each step executes in the correct order. This integrated approach within Glue minimizes operational overhead and cost compared to external orchestration tools. AWS Step Functions can orchestrate complex workflows but might incur higher costs for this specific use case, as Glue workflows are purpose-built for Glue ETL. AWS Glue Studio is a graphical interface for authoring Glue jobs and workflows, not an orchestration service itself. Amazon MWAA offers powerful Apache Airflow orchestration but is generally more expensive and complex for simple Glue pipeline orchestration.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed