Google Cloud Dataflow

E97117

Google Cloud Dataflow is a fully managed service for developing and executing batch and streaming data processing pipelines, based on Apache Beam, within the Google Cloud ecosystem.

All labels observed (3)

Label Occurrences
Dataflow 3
Google Cloud Dataflow canonical 3
Cloud Dataflow 1

How this entity was disambiguated

Statements (63)

Predicate Object
instanceOf Google Cloud Platform service
cloud data processing service
managed service
abstracts autoscaling
cluster management
job monitoring infrastructure
resource provisioning
basedOn Apache Beam
billingModel pay-as-you-go
consoleUrl https://console.cloud.google.com/dataflow
deploymentModel serverless
developedBy Google
documentationUrl https://cloud.google.com/dataflow
executionModel unified batch and streaming model
feature SQL-based pipelines via Dataflow SQL
autoscaling of workers
classic templates
dynamic work rebalancing
exactly-once processing semantics for many operations
flex templates
pipeline visualization in Google Cloud console
shuffle service
stateful processing
streaming engine
windowing and triggers
worker logging and metrics
languageSupport Go
Java
Python
logsTo Cloud Logging
monitoredBy Cloud Monitoring
offers availability across multiple Google Cloud regions
regional job execution
partOf Google Cloud
surface form: Google Cloud Platform
provides fully managed execution environment
resourceType Dataflow job
Dataflow template
Dataflow worker
securityFeature Customer-managed encryption keys support
IAM-based access control
VPC Service Controls support
supports batch data processing
streaming data processing
supportsIntegrationWith Google BigQuery
surface form: BigQuery

Bigtable
Cloud Datastore
Cloud Functions
Cloud Logging
Cloud Monitoring
Cloud SQL
Firestore
Google Cloud Storage
Google Cloud Pub/Sub
surface form: Pub/Sub

Cloud Spanner
surface form: Spanner

Vertex AI
supportsUseCase ETL pipelines
IoT data processing
data warehousing ingestion
event processing
log processing
machine learning data preparation
real-time analytics
uses Apache Beam
surface form: Apache Beam SDKs

How these facts were elicited

Referenced by (7)

Full triples — surface form annotated when it differs from this entity's canonical label.

Google BigQuery integratesWith Google Cloud Dataflow
Google Cloud hasComponent Google Cloud Dataflow
this entity surface form: Dataflow
Google I/O 2014 announced Google Cloud Dataflow
Google Cloud Pub/Sub integratesWith Google Cloud Dataflow
Google Cloud Storage integratesWith Google Cloud Dataflow
this entity surface form: Cloud Dataflow
Cloud Spanner integratesWith Google Cloud Dataflow
this entity surface form: Dataflow
Cloud SQL integratesWith Google Cloud Dataflow
this entity surface form: Dataflow