Abstract
We introduce Pastis, a completely decentralized multi-user read-write peer-to-peer file system. In Pastis every file is described by a modifiable inode-like structure which contains the addresses of the immutable blocks in which the file contents are stored. All data are stored using the Past distributed hash table (DHT), which we have modified in order to reduce the number of network messages it generates, thus optimizing replica retrieval.
Pastis’ design is simple compared to other existing systems, as it does not require complex algorithms like Byzantine-fault tolerant (BFT) replication or a central administrative authority. It is also highly scalable in terms of the number of network nodes and users sharing a given file or portion of the file system. Furthermore, Pastis takes advantage of the fault tolerance and good locality properties of its underlying storage layer, the Past DHT.
We have developed a prototype based on the FreePastry open-source implementation of the Past DHT. We have used this prototype to evaluate several characteristics of our file system design. Supporting the close-to-open consistency model, plus a variant of the read-your-writes model, our prototype shows that Pastis is between 1.4 to 1.8 times slower than NFS. In comparison, Ivy and Oceanstore are between two to three times slower than NFS.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Adya, A., Bolosky, W.J., Castro, M., Cermak, G., Chaiken, R., Douceur, J.R., Howell, J., Lorch, J.R., Theimer, M., Wattenhofer, R.P.: FARSITE: Federated, Available, and Reliable Storage for an Incompletely Trusted Environment. In: 5th Symposium on Operating Systems Design and Implementation (OSDI 2002), Boston, MA (December 2002)
Kubiatowicz, J., Bindel, D., Chen, Y., Czerwinski, S., Eaton, P., Geels, D., Gummadi, R., Rhea, S., Weatherspoon, H., Weimer, W., Wells, C., Zhao, B.: Oceanstore: An architecture for global-scale persistent store. In: Proc. ASPLOS 2000, Cambridge, MA (November 2000)
Muthitacharoen, A., Morris, R., Gil, T.M., Chen, B.: Ivy: A Read/Write Peer-to- Peer File System. In: Proceedings of 5th Symposium on Operating Systems Design and Implementation OSDI 2002 (2002)
Dabek, F., Kaashoek, M.F., Karger, D., Morris, R., Stoica, I.: Wide-area cooperative storage with CFS. In: Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP 2001), Chateau Lake Louise, Banff, Canada (October 2001)
Saito, Y., Karamanolis, C., Karlsson, M., Mahalingam, M.: Taming aggressive replication in the pangaea wide-area file system. In: 5th Symp. on Op. Sys. Design and Implementation (OSDI 2002), Boston, MA, USA (December 2002)
Castro, M., Liskov, B.: Practical Byzantine fault tolerance. In: Proc. of USENIX Symposium on Operating Systems Design and Implementation OSDI 1999 (1999)
Rowstron, A., Druschel, P.: Pastry: Scalable, distributed object location and routing orlarge-scale peer-to-peer systems. In: Proc. IFIP/ACM Middleware 2001, Heidelberg, Germany (November 2001)
FreePastry, http://freepastry.rice.edu/
Busca, J.-M., Picconi, F., Sens, P.: Pastis: a highly-scalable multi-user peer-to-peer file system. INRIA Technical Report 5288 (August 2004)
Plaxton, C.G., Rajaraman, R., Richa, A.W.: Accessing nearby copies of replicated objects in a distributed environment. In: Proceedings of ACM SPAA. ACM (June 1997)
Rowstron, A., Druschel, P.: Storage management and caching in Past, a largescale, persistent peer-to-peer storage utility. In: Proc. of the ACM Symposium on Operating System Principles, SOSP 2001 (2001)
Howard, J., Kazar, M., Menees, S., Nichols, D., Satyanarayanan, M., Sidebotham, R., West, M.: Scale and performance in a distributed file system. ACM Transactions on Computer Systems 6 (February 1988)
Demers, A., Petersen, K., Spreitzer, M., Terry, D., Theimer, M., Welch, B.: The Bayou architecture: Support for data sharing among mobile users. In: Proc. of IEEE Workshop on Mobile Computing Systems & Applications (December 1994)
Rizzo, L.: Dummynet and Forward Error Correction. In: Proc. of the 1998 USENIX Annual Technical Conf. (June 1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Busca, JM., Picconi, F., Sens, P. (2005). Pastis: A Highly-Scalable Multi-user Peer-to-Peer File System. In: Cunha, J.C., Medeiros, P.D. (eds) Euro-Par 2005 Parallel Processing. Euro-Par 2005. Lecture Notes in Computer Science, vol 3648. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11549468_128
Download citation
DOI: https://doi.org/10.1007/11549468_128
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28700-1
Online ISBN: 978-3-540-31925-2
eBook Packages: Computer ScienceComputer Science (R0)