Migrate Hadoop jobs for the Data Science team without changing the jobs or infrastructure design, minimizing cost and management effort. What do you deploy?

Dataproc is a fully managed service for running Apache Spark, Hadoop, and other big data workloads. It allows you to lift and shift existing Hadoop jobs without modification, directly addressing the requirement to avoid changing jobs or infrastructure design. Using preemptible worker instances significantly reduces costs compared to standard instances, aligning with the goal of minimizing cost. Dataproc also minimizes management effort because it handles cluster provisioning, management, and scaling. Manually deploying Hadoop on Compute Engine (both standard and preemptible) would require significant management overhead for setup, maintenance, and scaling, which contradicts the goal of minimizing management effort.