You have an on-prem Apache Kafka cluster connected via Dedicated Interconnect. You need a high-throughput, low-latency streaming ingestion into BigQuery. Which architecture minimizes latency?
Choose an answer
Tap an option to check your answer.
Correct answer: Use Dataflow to write a connector pipeline that reads directly from Kafka and writes to BigQuery..
Why this is the answer
The most direct path minimizes latency. Dataflow can natively connect to Apache Kafka using the KafkaIO connector, allowing it to read data directly from your on-prem cluster and write it to BigQuery. This avoids intermediate hops and services. Using Kafka Connect to bridge to Pub/Sub introduces an additional messaging layer, adding latency. While Pub/Sub is highly performant, this extra step is unnecessary when Dataflow can read directly. Both the template and custom Dataflow pipeline options for Pub/Sub would incur this extra latency. Deploying a proxy host in the VPC and having Dataflow read from it also introduces an unnecessary intermediary, adding latency and complexity compared to Dataflow's direct Kafka integration.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed