Dataflow streaming job reads from a source without exactly-once delivery, transforms messages, and writes to BigQuery. Ingestion expected ~1.5 GB/s. How do you achieve exactly-once delivery into BigQuery?
Choose an answer
Tap an option to check your answer.
Correct answer: Use the BigQuery Storage Write API and ensure that your target BigQuery table is multiregional..
Why this is the answer
The BigQuery Storage Write API supports exactly-once delivery semantics, which is crucial for ensuring data integrity in streaming pipelines. This API allows for stream-based writes with offset management, preventing duplicate records. A multiregional BigQuery dataset offers higher availability and resilience compared to a regional one, which is important for a high-throughput streaming job (1.5 GB/s) where continuous ingestion is critical. While a regional table can work with the Storage Write API, a multiregional table provides enhanced reliability. The BigQuery Streaming API (legacy insertAll method) does not guarantee exactly-once delivery and can lead to duplicates, making it unsuitable for this requirement.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed