Dataflow
Google Cloud's managed service for running Apache Beam pipelines that process batch and streaming data.
In more detail
Dataflow scales workers automatically and is often placed between Pub/Sub and BigQuery to transform a stream on its way to analysis. You pay for the workers while the job runs.
Related terms
- Pub/Sub — Google Cloud's managed messaging service: publishers send messages to a topic and every subscription receives a copy.
- BigQuery — Google Cloud's serverless data warehouse, which runs SQL over very large tables without servers to manage.
Taught in
- Choosing Compute — Google Cloud Associate Cloud Engineer Exam Prep
- Data And Storage Products — Google Cloud Associate Cloud Engineer Exam Prep
- Running Storage And Data — Google Cloud Associate Cloud Engineer Exam Prep