Abstract
The ultimate vision of grid computing are virtual supercomputers of unprecedented power, through utilization of geographically dispersed distributively owned resources. Despite the overwhelming success of grids there still exist many demanding applications considered the exclusive prerogative of real supercomputers (i.e. tightly coupled parallel applications like complex systems simulations). These rely on a static execution environment with predictable performance, provided through efficient co-allocation of a large number of reliable interconnected resources. In this paper, we describe a novel quasi-opportunistic supercomputer system that enables execution of demanding parallel applications in grids through identification and implementation of the set of key technologies required to realize the vision of grids as (virtual) supercomputers. These technologies include an incentive-based framework basic on ideas from economics; a co-allocation subsystem that is enhanced by communication topology-aware allocation mechanisms; a fault tolerant message passing library that hides the failures of the underlying resources; and data pre-staging orchestration.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
University of California: SETI@Home. The Search for Extra-Terrestrial Inteligence (SETI) (2007), http://setiathome.ssl.berkeley.edu
Gagliardiand, F., Jones, B., Grey, F., Bgin, M.-E., Heikkurinen, M.: Building an infrastructure for scientific grid computing: Status and goals of the EGEE project. Philosophical Transactions A of the Royal Society: Mathematical, Physical and Engineering Sciences 363(833), 1729–1742 (2005)
Kuo, D., Mckeown, M.: Advance reservation and co-Allocation protocol for grid computing. In: 1st Int’l Conference e-Science and Grid Computing, p. 8 (2005)
Aridor, Y., Domany, T., Goldshmidt, O., Moreira, J.W., Shmueli, E.: Resource Allocation and Utilization in the Blue GeneL Supercomputer. IBM Journal of Research and Development 49(2-3), 425–436 (2005)
Buyya, R., Abramson, D., Giddy, J., Stockinger, H.: Economic models for resource management and scheduling in grid computing. Concurrency and Computation: Practice and Experience 14, 1507–1542 (2002)
Reed, A.D., Lu, C.-d., Mendes, C.L.: Reliability challenges in large systems. Future Generation Computer Systems 22(3), 293–302 (2006)
Karonis, N.T., Toonen, B., Foster, I.: MPICH-G2: A Grid-enabled implementation of the Message Passing Interface. Journal of Parallel and Distributed Computing 63(5), 551–563 (2003)
Dail, H., Berman, F., Casanova, H.: A decoupled scheduling approach for grid application development environments. Journal of Parallel and Distributed Computing 63(5), 505–524 (2003)
Venugopal, S., Buyya, R., Winton, L.: A grid service broker for scheduling e-science applications on global data grids. Journal of Concurrency and Computation: Practice and Experience 18(6), 685–699 (2005)
Raman, R., Livny, M., Solomon, M.: Policy driven heterogeneous resource co-allocation with gangmatching. In: Proc. of the 12th IEEE Int’l Symposium on High Performance Distributed Computing (HPDC-12), pp. 80–89 (2002)
Irwin, I., Chase, J., Grit, L., Yumerefendi, A.: Self-recharging virtual currency. In: Proc. of the 2005 ACM SIGCOMM Workshop on Economics of Peer-to-Peer System, pp. 93–98 (2005)
Snir, M., Otto, S., Huss-Lederman, S., Walker, D., Dongarra, J.: MPI: The Complete Reference. MIT Press, Cambridge (1996)
Andreozzi, S., Sgaravatto, M., Vistoli, C.: Sharing a conceptual model of gridresources and services. Computing in High Energy and Nuclear Physics, 24–28 (2003)
Lacour, S., Perez, C., Priol, T.: A network topology description model for grid application deployment. In: Proc. 5th IEEE/ACM Int’l Workshop on Grid Computing, pp. 61–68 (2004)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kravtsov, V. et al. (2008). Quasi-opportunistic Supercomputing in Grid Environments. In: Bourgeois, A.G., Zheng, S.Q. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2008. Lecture Notes in Computer Science, vol 5022. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69501-1_24
Download citation
DOI: https://doi.org/10.1007/978-3-540-69501-1_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69500-4
Online ISBN: 978-3-540-69501-1
eBook Packages: Computer ScienceComputer Science (R0)