While Barton, Dilger, and others formed software startup Whamcloud, where they continued to work on Lustre. Braam and several associates joined the hardware-oriented Xyratex when it acquired the assets of ClusterStor, By the end of 2010, most Lustre developers had left Oracle. (OpenSFS), EUROPEAN Open File Systems (EOFS) and others. įollowing this announcement, several new organizations sprang up to provide support and development in an open community development model, including Whamcloud, Open Scalable File Systems, Inc.
In December 2010, Oracle announced that they would cease Lustre 2.x development and place Lustre 1.8 into maintenance-only support, creating uncertainty around the future development of the file system. In 2010 Oracle Corporation, by way of its acquisition of Sun, began to manage and release Lustre. In November 2008, Braam left Sun Microsystems, and Eric Barton and Andreas Dilger took control of the project. Sun included Lustre with its high-performance computing hardware offerings, with the intent to bring Lustre technologies to Sun's ZFS file system and the Solaris operating system. In September 2007, Sun Microsystems acquired the assets of Cluster File Systems Inc. Lustre was developed under the Accelerated Strategic Computing Initiative Path Forward project funded by the United States Department of Energy, which included Hewlett-Packard and Intel. Braam went on to found his own company Cluster File Systems in 2001, starting from work on the InterMezzo file system in the Coda project at CMU.
Braam, who was a staff of Carnegie Mellon University (CMU) at the time. The Lustre file system architecture was started as a research project in 1999 by Peter J.
This makes Lustre file systems a popular choice for businesses with large data centers, including those in industries such as meteorology, simulation, oil and gas, life science, rich media, and finance. Lustre file systems are scalable and can be part of multiple computer clusters with tens of thousands of client nodes, tens of petabytes (PB) of storage on hundreds of servers, and more than a terabyte per second (TB/s) of aggregate I/O throughput. 1 ranked TOP500 supercomputer in June 2020, Fugaku, as well as previous top supercomputers such as Titan and Sequoia. Since June 2005, Lustre has consistently been used by at least half of the top ten, and more than 60 of the top 100 fastest supercomputers in the world,
Lustre file system software is available under the GNU General Public License (version 2 only) and provides high performance file systems for computer clusters ranging in size from small workgroup clusters to large-scale, multi-site systems. The name Lustre is a portmanteau word derived from Linux and cluster. Lustre is a type of parallel distributed file system, generally used for large-scale cluster computing. Yes (network, storage with ZFS 0.8+, fscrypt with Lustre 2.14.0+) Modification (mtime), attribute modification (ctime), access (atime), delete (dtime), create (crtime)ģ2bitapi, acl, checksum, flock, lazystatfs, localflock, lruresize, noacl, nochecksum, noflock, nolazystatfs, nolruresize, nouser_fid2path, nouser_xattr, user_fid2path, user_xattr Per Metadata Target (MDT): 4 billion files (ldiskfs backend), 256 trillion files (ZFS backend), up to 128 MDTs per filesystemĪll bytes except NUL ('\0') and '/' and the special file names "." and "." Andreas Dilger, Eric Barton (HPC), Phil Schwanįile, directory, hardlink, symlink, block special, character special, socket, FIFOģ00 PB (production), over 16 EB (theoretical)