Google File System
E185682
Google File System is a distributed file system developed by Google to reliably store and process massive amounts of data across clusters of commodity hardware.
All labels observed (4)
| Label | Occurrences |
|---|---|
| Google File System canonical | 4 |
| The Google File System | 2 |
| Colossus distributed file system | 1 |
| Google File System (GFS) | 1 |
Statements (48)
| Predicate | Object |
|---|---|
| instanceOf |
distributed file system
ⓘ
proprietary software ⓘ |
| alsoKnownAs | GFS ⓘ |
| architectureFeature |
multiple chunkservers
ⓘ
single master server ⓘ |
| chunkSize | 64 MB ⓘ |
| consistencyModel | relaxed consistency ⓘ |
| designedBy | Google engineers ⓘ |
| designedFor |
clusters of commodity hardware
ⓘ
large-scale data-intensive applications ⓘ |
| developer | Google ⓘ |
| ensuresReliabilityBy | replicating chunks across multiple servers ⓘ |
| faultToleranceMechanism |
master state recovery from operation log
ⓘ
replication of chunk data ⓘ |
| handles | frequent component failures ⓘ |
| influenced | design of modern distributed file systems ⓘ |
| inspired |
HDFS
ⓘ
surface form:
Hadoop Distributed File System
|
| license | closed source ⓘ |
| masterDataStructure | in-memory metadata ⓘ |
| masterPersistence | operation log and checkpoints ⓘ |
| optimizedFor |
appending writes
ⓘ
large streaming reads ⓘ |
| paperAbbreviation | SOSP 2003 ⓘ |
| paperAuthors |
Howard Gobioff
ⓘ
Sanjay Ghemawat ⓘ Shun-Tak Leung ⓘ |
| paperPublicationYear | 2003 ⓘ |
| paperPublishedIn |
SOSP
ⓘ
surface form:
ACM Symposium on Operating Systems Principles
|
| paperTitle |
Google File System
self-linksurface differs
ⓘ
surface form:
The Google File System
|
| stores |
access control information
ⓘ
file namespace ⓘ locations of chunk replicas ⓘ mapping from files to chunks ⓘ |
| storesFileDataOn | chunkservers ⓘ |
| storesMetadataOn | master server ⓘ |
| supports |
data replication
ⓘ
fault tolerance ⓘ high throughput ⓘ scalability ⓘ |
| supportsOperation |
record append
ⓘ
snapshot ⓘ |
| targetEnvironment | Google production clusters ⓘ |
| usedFor |
indexing web pages
ⓘ
large-scale data processing at Google ⓘ |
| uses |
heartbeat messages between master and chunkservers
ⓘ
large fixed-size chunks ⓘ leases for mutation control ⓘ version numbers for chunk management ⓘ |
Referenced by (8)
Full triples — surface form annotated when it differs from this entity's canonical label.
this entity surface form:
Google File System (GFS)
this entity surface form:
The Google File System
this entity surface form:
The Google File System
this entity surface form:
Colossus distributed file system