Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
GFS: evolution on fast-forward
McKusick K., Quinlan S. Communications of the ACM53 (3):42-49,2010.Type:Article
Date Reviewed: May 13 2010

This is a friendly discussion on the status of the Google File System (GFS). Sean Quinlan works at Google and was at one time the GFS technology leader. In this article, he is interviewed by Kirk McKusick, who worked on Berkeley Software Distribution (BSD) Unix and its Fast File System (FFS) file system.

GFS is a distributed file system designed for internal use at Google. It supports petabytes of storage and is optimized for batch operations. This article identifies the two major issues with GFS: a single master that manages file placement and lookup, and an early design decision to set the block size at 64MB. The article discusses the background behind these decisions and their impact on current GFS usage and efforts.

GFS is proprietary to Google, but the Hadoop file system (HDFS), an open-source implementation, shares the same design. This article should be reviewed by distributed file system developers and by those interested in Hadoop, as the lessons learned at Google will drive systems design for many years to come.

Reviewer:  Elliot Jaffe Review #: CR137991 (1010-1036)
Bookmark and Share
  Editor Recommended
Featured Reviewer
 
 
File Systems Management (D.4.3 )
 
Would you recommend this review?
yes
no
Other reviews under "File Systems Management": Date
Working with Q & A: practical techniques in database design
Dunlop N., Scott, Foresman & Co., Glenview, IL, 1987. Type: Book (9789780673187291)
Aug 1 1988
A crash resistant UNIX file system
Anyanwu J., Marshall L. Software--Practice & Experience 16(2): 107-118, 1986. Type: Article
Sep 1 1986
Managing AFS
Campbell R., Prentice-Hall, Inc., Upper Saddle River, NJ, 1998. Type: Book (9780138027292)
Jul 1 1998
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy