You must ingest minute-resolution data from 50,000 sensors, scale for growth, and make data available within 1 minute for real-time aggregations. Which ingestion approach do you use?
Choose an answer
Tap an option to check your answer.
Correct answer: Use a Cloud Dataflow pipeline to stream data into the BigQuery table..
Why this is the answer
A Cloud Dataflow pipeline streaming data into BigQuery is the most suitable approach. Dataflow provides a fully managed, autoscaling service for processing high-volume, low-latency data streams, directly addressing the requirement for minute-resolution data from 50,000 sensors and real-time availability within one minute. BigQuery's streaming inserts API, leveraged by Dataflow, allows immediate data availability for querying. Using bq load every 60 seconds is a batch approach and introduces latency that exceeds the 1-minute real-time requirement. Similarly, INSERT statements for batch inserts every 60 seconds would also introduce unacceptable latency and are less efficient for high-volume streaming than Dataflow with BigQuery's streaming API. The MERGE statement is designed for updating existing data, not for high-volume, low-latency ingestion of new sensor readings, and also implies a batch process that would violate the real-time constraint.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed