Apache Beam
E427701
Apache Beam is an open-source unified programming model for defining and executing batch and streaming data processing pipelines across multiple execution engines.
All labels observed (2)
| Label | Occurrences |
|---|---|
| Apache Beam canonical | 2 |
| Apache Beam SDKs | 1 |
How this entity was disambiguated
This entity first appeared as the object of triple T4279608 — resolving that mention is where its identity was fixed. The disambiguator weighed these candidate entities and picked the highlighted one (or “None”, minting a new entity). This is how homonymy is resolved: the same surface form can point to different entities.
NED1
Entity disambiguation (via context triple)
gpt-5-mini-2025-08-07
Target entity: Apache Beam Context triple: [Google Cloud Dataflow, basedOn, Apache Beam]
-
A.
Google Cloud Dataflow
Google Cloud Dataflow is a fully managed service for developing and executing batch and streaming data processing pipelines, based on Apache Beam, within the Google Cloud ecosystem.
-
B.
Apache Flink
Apache Flink is an open-source distributed stream-processing framework designed for high-throughput, low-latency data processing and real-time analytics on large-scale data.
-
C.
Apache Spark
Apache Spark is an open-source, distributed data processing engine designed for large-scale data analytics, machine learning, and stream processing.
-
D.
Apache Storm
Apache Storm is a distributed real-time computation system designed for processing large streams of data with low latency and high fault tolerance.
-
E.
Google Cloud Dataproc
Google Cloud Dataproc is a managed cloud service for running Apache Hadoop, Spark, and other big data workloads on scalable, automated clusters in Google Cloud.
- F. None of above. chosen
- G. Unsure - the case is ambiguous/there is not enough information to decide.
NED2
Entity disambiguation (via description)
gpt-5-mini-2025-08-07
Target entity: Apache Beam Target entity description: Apache Beam is an open-source unified programming model for defining and executing batch and streaming data processing pipelines across multiple execution engines.
-
A.
Google Cloud Dataflow
Google Cloud Dataflow is a fully managed service for developing and executing batch and streaming data processing pipelines, based on Apache Beam, within the Google Cloud ecosystem.
-
B.
Apache Flink
Apache Flink is an open-source distributed stream-processing framework designed for high-throughput, low-latency data processing and real-time analytics on large-scale data.
-
C.
Apache Spark
Apache Spark is an open-source, distributed data processing engine designed for large-scale data analytics, machine learning, and stream processing.
-
D.
Apache Storm
Apache Storm is a distributed real-time computation system designed for processing large streams of data with low latency and high fault tolerance.
-
E.
Google Cloud Dataproc
Google Cloud Dataproc is a managed cloud service for running Apache Hadoop, Spark, and other big data workloads on scalable, automated clusters in Google Cloud.
- F. None of above. chosen
Statements (58)
| Predicate | Object |
|---|---|
| instanceOf |
data processing framework
ⓘ
open-source software ⓘ software framework ⓘ unified programming model ⓘ |
| category |
big data
ⓘ
distributed computing framework ⓘ |
| designGoal |
runner portability
ⓘ
separation of pipeline definition from execution engine ⓘ unified batch and streaming API ⓘ |
| developer | Apache Software Foundation NERFINISHED ⓘ |
| governedBy | Apache Beam Project Management Committee NERFINISHED ⓘ |
| license | Apache License 2.0 ⓘ |
| originatedFrom | Google Cloud Dataflow SDK NERFINISHED ⓘ |
| partOf | Apache Software Foundation projects ⓘ |
| programmingLanguage |
Go
NERFINISHED
ⓘ
Java ⓘ Python ⓘ |
| repository | https://github.com/apache/beam ⓘ |
| supportsFeature |
I/O connectors
ⓘ
composite transforms ⓘ event-time processing ⓘ processing-time processing ⓘ side inputs ⓘ stateful processing ⓘ timers ⓘ triggers ⓘ watermarks ⓘ windowing ⓘ |
| supportsIO |
Amazon Kinesis (via connector)
NERFINISHED
ⓘ
Apache Cassandra NERFINISHED ⓘ Apache HDFS NERFINISHED ⓘ Apache Kafka NERFINISHED ⓘ Elasticsearch NERFINISHED ⓘ Google BigQuery NERFINISHED ⓘ Google Cloud Pub/Sub NERFINISHED ⓘ Google Cloud Storage NERFINISHED ⓘ JDBC NERFINISHED ⓘ |
| supportsLanguage |
Go SDK
NERFINISHED
ⓘ
Java SDK NERFINISHED ⓘ Python SDK NERFINISHED ⓘ Scala (via community extensions) ⓘ |
| supportsParadigm |
batch processing
ⓘ
stream processing ⓘ unified batch and streaming model ⓘ |
| supportsRunner |
Apache Flink
NERFINISHED
ⓘ
Apache Samza (via runner) NERFINISHED ⓘ Apache Spark NERFINISHED ⓘ DirectRunner NERFINISHED ⓘ Google Cloud Dataflow NERFINISHED ⓘ Hazelcast Jet (via runner) NERFINISHED ⓘ PortableRunner NERFINISHED ⓘ Twister2 (via runner) NERFINISHED ⓘ |
| useCase |
ETL pipelines
ⓘ
batch data processing ⓘ data integration ⓘ machine learning data pipelines ⓘ real-time analytics ⓘ |
| website | https://beam.apache.org ⓘ |
How these facts were elicited
The pipeline generated the facts above by prompting gpt-5.1 with this entity's name + description and the instruction below.
Instruction
You are a knowledge base construction expert. Given a subject entity and a description of it, return factual statements that you know for the subject as a JSON list of dictionaries(triples), where keys must be "subject", "predicate" and "object". The number of facts may be very high, between 25 to 50 or more, for very popular subjects. For less popular subjects, the number of facts can be very low, like 5 or 10. # Requirements - If you don't know the subject at all, return an empty list. - If the subject is not a named entity, return an empty list. - Include at least one triple where predicate is "instanceOf". - Do not get too wordy. - Separate several objects into multiple triples with one object.
Input
Subject: Apache Beam Description of subject: Apache Beam is an open-source unified programming model for defining and executing batch and streaming data processing pipelines across multiple execution engines.
Referenced by (3)
Full triples — surface form annotated when it differs from this entity's canonical label.
this entity surface form:
Apache Beam SDKs