Google File System

E185682

Google File System is a distributed file system developed by Google to reliably store and process massive amounts of data across clusters of commodity hardware.

All labels observed (4)

How this entity was disambiguated

Statements (48)

Predicate Object
instanceOf distributed file system ⓘ
proprietary software ⓘ
alsoKnownAs GFS ⓘ
architectureFeature multiple chunkservers ⓘ
single master server ⓘ
chunkSize 64 MB ⓘ
consistencyModel relaxed consistency ⓘ
designedBy Google engineers ⓘ
designedFor clusters of commodity hardware ⓘ
large-scale data-intensive applications ⓘ
developer Google ⓘ
ensuresReliabilityBy replicating chunks across multiple servers ⓘ
faultToleranceMechanism master state recovery from operation log ⓘ
replication of chunk data ⓘ
handles frequent component failures ⓘ
influenced design of modern distributed file systems ⓘ
inspired HDFS ⓘ
surface form: Hadoop Distributed File System
license closed source ⓘ
masterDataStructure in-memory metadata ⓘ
masterPersistence operation log and checkpoints ⓘ
optimizedFor appending writes ⓘ
large streaming reads ⓘ
paperAbbreviation SOSP 2003 ⓘ
paperAuthors Howard Gobioff ⓘ
Sanjay Ghemawat ⓘ
Shun-Tak Leung ⓘ
paperPublicationYear 2003 ⓘ
paperPublishedIn SOSP ⓘ
surface form: ACM Symposium on Operating Systems Principles
paperTitle Google File System self-linksurface differs ⓘ
surface form: The Google File System
stores access control information ⓘ
file namespace ⓘ
locations of chunk replicas ⓘ
mapping from files to chunks ⓘ
storesFileDataOn chunkservers ⓘ
storesMetadataOn master server ⓘ
supports data replication ⓘ
fault tolerance ⓘ
high throughput ⓘ
scalability ⓘ
supportsOperation record append ⓘ
snapshot ⓘ
targetEnvironment Google production clusters ⓘ
usedFor indexing web pages ⓘ
large-scale data processing at Google ⓘ
uses heartbeat messages between master and chunkservers ⓘ
large fixed-size chunks ⓘ
leases for mutation control ⓘ
version numbers for chunk management ⓘ

How these facts were elicited

Referenced by (8)

Full triples — surface form annotated when it differs from this entity's canonical label.

Hadoop → initiallyInspiredBy → Google File System ⓘ
Jeffrey Dean → knownFor → Google File System ⓘ
Jeffrey Dean → workedOn → Google File System ⓘ
this entity surface form: Google File System (GFS)
Jeffrey Dean → coAuthorOf → Google File System ⓘ
this entity surface form: The Google File System
Bigtable → basedOn → Google File System ⓘ
MapReduce → commonlyUsedWith → Google File System ⓘ
Google File System → paperTitle → Google File System self-linksurface differs ⓘ
this entity surface form: The Google File System
Google infrastructure → hasComponent → Google File System ⓘ
this entity surface form: Colossus distributed file system