An ML engineer will use an Amazon EMR cluster for large batch processing where any data loss is unacceptable. Which instance purchasing strategy is the most cost-effective while ensuring no data loss?
Choose an answer
Tap an option to check your answer.
Correct answer: Run the primary node and core nodes on On-Demand Instances and run the task nodes on Spot Instances..
Why this is the answer
This strategy is the most cost-effective while preventing data loss because it balances cost savings with reliability. On-Demand Instances for the primary and core nodes ensure the stability of the HDFS data and the cluster's overall state, as these instances are not interrupted. Core nodes store data in HDFS, so using On-Demand Instances for them prevents data loss from unexpected termination. Task nodes, which only perform computations and do not store persistent data, can leverage Spot Instances for significant cost savings. If a Spot Instance for a task node is interrupted, the computation can be rescheduled on another available task node without data loss, as the data resides on the core nodes. Using On-Demand Instances for all nodes (first option) is reliable but not the most cost-effective. Using Spot Instances for all nodes (second option) is the most cost-effective but risks data loss and job failure due to frequent interruptions of core nodes. Running the primary node on On-Demand and core/task on Spot (third option) still risks data loss if core nodes are interrupted.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed