Dataflow worker
E427704
A Dataflow worker is a compute instance in Google Cloud Dataflow that executes the parallel processing tasks of a data pipeline.
All labels observed (1)
| Label | Occurrences |
|---|---|
| Dataflow worker canonical | 1 |
How this entity was disambiguated
This entity first appeared as the object of triple T4279660 — resolving that mention is where its identity was fixed. The disambiguator weighed these candidate entities and picked the highlighted one (or “None”, minting a new entity). This is how homonymy is resolved: the same surface form can point to different entities.
NED1
Entity disambiguation (via context triple)
gpt-5-mini-2025-08-07
Target entity: Dataflow worker Context triple: [Google Cloud Dataflow, resourceType, Dataflow worker]
-
A.
Google Cloud Dataflow
Google Cloud Dataflow is a fully managed service for developing and executing batch and streaming data processing pipelines, based on Apache Beam, within the Google Cloud ecosystem.
-
B.
Web workers
Web workers are a web platform feature that enable running JavaScript in background threads separate from the main UI thread to perform computationally intensive or asynchronous tasks without blocking user interactions.
-
C.
NVIDIA AI Workflows
NVIDIA AI Workflows are pre-built, end-to-end AI pipelines from NVIDIA that streamline the development, deployment, and scaling of AI applications across common enterprise use cases.
-
D.
Workflow Builder
Workflow Builder is Slack’s no-code tool that lets users automate routine tasks and create custom workflows directly within their Slack workspace.
-
E.
Management and the Worker
Management and the Worker is a landmark 1939 book by Elton Mayo and colleagues that analyzes the Hawthorne studies and helped establish the human relations movement in industrial and organizational psychology.
- F. None of above. chosen
- G. Unsure - the case is ambiguous/there is not enough information to decide.
NED2
Entity disambiguation (via description)
gpt-5-mini-2025-08-07
Target entity: Dataflow worker Target entity description: A Dataflow worker is a compute instance in Google Cloud Dataflow that executes the parallel processing tasks of a data pipeline.
-
A.
Google Cloud Dataflow
Google Cloud Dataflow is a fully managed service for developing and executing batch and streaming data processing pipelines, based on Apache Beam, within the Google Cloud ecosystem.
-
B.
Web workers
Web workers are a web platform feature that enable running JavaScript in background threads separate from the main UI thread to perform computationally intensive or asynchronous tasks without blocking user interactions.
-
C.
NVIDIA AI Workflows
NVIDIA AI Workflows are pre-built, end-to-end AI pipelines from NVIDIA that streamline the development, deployment, and scaling of AI applications across common enterprise use cases.
-
D.
Workflow Builder
Workflow Builder is Slack’s no-code tool that lets users automate routine tasks and create custom workflows directly within their Slack workspace.
-
E.
Pipeline
Pipeline is a scikit-learn utility that chains multiple data processing and modeling steps into a single composite estimator for streamlined machine learning workflows.
- F. None of above. chosen
Statements (49)
| Predicate | Object |
|---|---|
| instanceOf |
Google Cloud Dataflow component
ⓘ
compute instance type ⓘ |
| canBe |
primary worker
ⓘ
secondary worker ⓘ |
| canUse |
custom machine types
ⓘ
preemptible VMs ⓘ |
| communicatesWith |
Dataflow service backend
ⓘ
other Dataflow workers ⓘ |
| configuredBy |
Dataflow job configuration
ⓘ
number of workers setting ⓘ worker machine type setting ⓘ |
| createdBy | Dataflow job submission ⓘ |
| environment | Google Cloud project NERFINISHED ⓘ |
| executes |
Apache Beam transforms
ⓘ
data pipeline stages ⓘ parallel processing tasks ⓘ |
| hasProperty |
disk size
ⓘ
machine type ⓘ memory size ⓘ number of vCPUs ⓘ zone ⓘ |
| hasRole | executing pipeline steps ⓘ |
| logsTo | Cloud Logging NERFINISHED ⓘ |
| managedBy | Dataflow service NERFINISHED ⓘ |
| monitoredBy | Cloud Monitoring NERFINISHED ⓘ |
| partOf | Google Cloud Dataflow NERFINISHED ⓘ |
| performs |
aggregation operations
ⓘ
data shuffling ⓘ user-defined functions ⓘ windowing operations ⓘ |
| providedBy |
Google Cloud
NERFINISHED
ⓘ
Google Cloud Dataflow service NERFINISHED ⓘ |
| readsFrom |
BigQuery
NERFINISHED
ⓘ
Cloud Storage NERFINISHED ⓘ Pub/Sub NERFINISHED ⓘ data sources ⓘ |
| runsOn | Google Compute Engine virtual machine NERFINISHED ⓘ |
| securedBy |
IAM permissions
ⓘ
service account ⓘ |
| supports |
autoscaling of worker count
ⓘ
worker harness for Apache Beam ⓘ |
| terminatedBy | Dataflow job completion ⓘ |
| usedFor |
batch data processing
ⓘ
streaming data processing ⓘ |
| uses | Dataflow SDK worker harness NERFINISHED ⓘ |
| writesTo |
BigQuery
NERFINISHED
ⓘ
Cloud Storage NERFINISHED ⓘ Pub/Sub NERFINISHED ⓘ data sinks ⓘ |
How these facts were elicited
The pipeline generated the facts above by prompting gpt-5.1 with this entity's name + description and the instruction below.
Instruction
You are a knowledge base construction expert. Given a subject entity and a description of it, return factual statements that you know for the subject as a JSON list of dictionaries(triples), where keys must be "subject", "predicate" and "object". The number of facts may be very high, between 25 to 50 or more, for very popular subjects. For less popular subjects, the number of facts can be very low, like 5 or 10. # Requirements - If you don't know the subject at all, return an empty list. - If the subject is not a named entity, return an empty list. - Include at least one triple where predicate is "instanceOf". - Do not get too wordy. - Separate several objects into multiple triples with one object.
Input
Subject: Dataflow worker Description of subject: A Dataflow worker is a compute instance in Google Cloud Dataflow that executes the parallel processing tasks of a data pipeline.
Referenced by (1)
Full triples — surface form annotated when it differs from this entity's canonical label.