Google MapReduce

E185683

Google MapReduce is a programming model and processing framework developed by Google for large-scale distributed data processing across clusters of commodity hardware.

All labels observed (2)

Label Occurrences
Google MapReduce canonical 1
MapReduce 1

How this entity was disambiguated

Statements (50)

Predicate Object
instanceOf data processing framework
distributed computing framework
programming model
abstractsFromProgrammer details of data distribution
details of fault tolerance
details of parallelization
basedOn map function
reduce function
category big data technology
distributed data processing
dataLocalityStrategy moving computation to data
designedFor batch processing
distributed data processing
large-scale data processing
developer Google
executionModel map phase followed by reduce phase
faultToleranceMechanism re-execution of failed tasks
firstPublicationYear 2004
handles automatic task scheduling
data partitioning
intermediate data shuffling
load balancing
re-execution of failed tasks
influenced Hadoop
surface form: Apache Hadoop MapReduce

Apache Spark
surface form: Apache Spark programming model

Dryad
FlumeJava
inputDataModel key-value pairs
inspiredBy functional programming
notableFeature automatic handling of machine failures
simple programming interface for large clusters
operatesOn clusters of commodity hardware
outputDataModel key-value pairs
paperAuthors Jeffrey Dean
Sanjay Ghemawat
paperTitle MapReduce
surface form: MapReduce: Simplified Data Processing on Large Clusters
publishedBy Google
schedulingUnit map task
reduce task
supports automatic parallelization
data locality optimization
fault tolerance
scalability across thousands of machines
usedFor data mining
indexing web pages
log analysis
machine learning preprocessing
usedWithin Google indexing systems
Google log processing pipelines
Google search infrastructure

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.

Hadoop initiallyInspiredBy Google MapReduce
Sanjay Ghemawat knownFor Google MapReduce
this entity surface form: MapReduce