ABSTRACT
Running multiple instances of the MapReduce framework concurrently in a multicluster system or datacenter enables data, failure, and version isolation, which is attractive for many organizations. It may also provide some form of performance isolation, but in order to achieve this in the face of time-varying workloads submitted to the MapReduce instances, a mechanism for dynamic resource (re-)allocations to those instances is required. In this paper, we present such a mechanism called Fawkes that attempts to balance the allocations to MapReduce instances so that they experience similar service levels. Fawkes proposes a new abstraction for deploying MapReduce instances on physical resources, the MR-cluster, which represents a set of resources that can grow and shrink, and that has a core on which MapReduce is installed with the usual data locality assumptions but that relaxes those assumptions for nodes outside the core. Fawkes dynamically grows and shrinks the active MR-clusters based on a family of weighting policies with weights derived from monitoring their operation.
We empirically evaluate Fawkes on a multicluster system and show that it can deliver good performance and balanced resource allocations, even when the workloads of the MR-clusters are very uneven and bursty, with workloads composed from both synthetic and real-world benchmarks.
- Amazon Elastic MapReduce. http://aws.amazon.com/elasticmapreduce.Google Scholar
- Apache Hadoop. http://hadoop.apache.org.Google Scholar
- The Distributed ASCI Supercomputer 4. http://www.cs.vu.nl/das4.Google Scholar
- Hadoop Capacity Scheduler. http://hadoop.apache.org/docs/r2.3.0/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html.Google Scholar
- B. Avi-Itzhak and H. Levy. On Measuring Fairness in Queues. Advances in Applied Probability, 36(3), 2004.Google Scholar
- J. Buisson, O. Sonmez, H. Mohamed, W. Lammers, and D. Epema. Scheduling Malleable Applications in Multicluster Systems. IEEE Cluster, 2007. Google ScholarDigital Library
- Y. Chen, S. Alspaugh, and R. Katz. Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads. VLDB, 2012. Google ScholarDigital Library
- N. Chohan, C. Castillo, M. Spreitzer, M. Steinder, A. Tantawi, and C. Krintz. See Spot Run: Using Spot Instances for MapReduce Workflows. HotCloud, 2010. Google ScholarDigital Library
- J. Dean and S. Ghemawat. Mapreduce: Simplified Data Processing on Large Clusters. Comm. of the ACM, 51(1), 2008. Google ScholarDigital Library
- C. Ernemann, V. Hamscher, U. Schwiegelshohn, R. Yahyapour, and A. Streit. On Advantages of Grid Computing for Parallel Job Scheduling. CCGrid, 2002. Google ScholarDigital Library
- D. Feitelson, L. Rudolph, U. Schwiegelshohn, K. Sevcik, and P. Wong. Theory and Practice in Parallel Job Scheduling. JSSPP, 1997. Google ScholarDigital Library
- B. Ghit, N. Yigitbasi, and D. Epema. Resource Management for Dynamic MapReduce Clusters in Multicluster Systems. MTAGS, 2012. Google ScholarDigital Library
- A. Ghodsi, M. Zaharia, B. Hindman, A. Konwinski, S. Shenker, and I. Stoica. Dominant Resource Fairness: Fair Allocation of Multiple Resource Types. NSDI, 2011. Google ScholarDigital Library
- A. Ghodsi, M. Zaharia, S. Shenker, and I. Stoica. Choosy: Max-Min Fair Sharing for Datacenter Jobs with Constraints. Eurosys, 2013. Google ScholarDigital Library
- I. Goiri, K. Le, T. D. Nguyen, J. Guitart, J. Torres, and R. Bianchini. GreenHadoop: Leveraging Green Energy in Data-Processing Frameworks. EuroSys, 2012. Google ScholarDigital Library
- A. G. Greenberg and N. Madras. How Fair Is Fair Queuing. JACM, 39(3), 1992. Google ScholarDigital Library
- T. Hegeman, B. Ghit, M. Capota, J. Hidders, D. Epema, and A. Iosup. The BTWorld Use Case for Big Data Analytics: Description, MapReduce Logical Workflow, and Empirical Evaluation. IEEE Big Data, 2013.Google ScholarCross Ref
- H. Herodotou, F. Dong, and S. Babu. No One (Cluster) Size Fits All: Automatic Cluster Sizing for Data-Intensive Analytics. SOCC, 2011. Google ScholarDigital Library
- B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. Joseph, R. Katz, S. Shenker, and I. Stoica. Mesos: A Platform for Fine-grained Resource Sharing in the Data Center. NSDI, 2011. Google ScholarDigital Library
- S. Huang, J. Huang, J. Dai, T. Xie, and B. Huang. The Hibench Benchmark Suite: Characterization of the MapReduce-based Data Analysis. ICDEW, 2010.Google ScholarCross Ref
- M. Isard, V. Prabhakaran, J. Currey, U. Wieder, K. Talwar, and A. Goldberg. Quincy: Fair Scheduling for Distributed Computing Clusters. SIGOPS, 2009. Google ScholarDigital Library
- M. Lin, A. Wierman, L. Andrew, and E. Thereska. Dynamic Right-Sizing for Power-Proportional Data Centers. INFOCOM, 2011.Google ScholarCross Ref
- H. Mohamed and D. Epema. Koala: A Co-allocating Grid Scheduler. Concurrency and Computation: Practice and Experience, 20(16), 2008. Google ScholarDigital Library
- T. Nguyen and M. Vojnovic. Weighted Proportional Allocation. SIGMETRICS, 2011. Google ScholarDigital Library
- C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig Latin: A Not-So-Foreign Language for Data Processing. SIGMOD, 2008. Google ScholarDigital Library
- D. Raz, H. Levy, and B. Avi-Itzhak. A Resource-Allocation Queueing Fairness Measure. SIGMETRICS/PERFORMANCE, 2004. Google ScholarDigital Library
- D. Shue, M. J. Freedman, and A. Shaikh. Performance Isolation and Fairness for Multi-Tenant Cloud Storage. OSDI, 2012. Google ScholarDigital Library
- J. Tan, X. Meng, and L. Zhang. Delay Tails in MapReduce Scheduling. SIGMETRICS, 2012. Google ScholarDigital Library
- V. K. Vavilapalli, A. C. Murthy, C. Douglas, S. Agarwal, M. Konar, R. Evans, T. Graves, J. Lowe, H. Shah, S. Seth, et al. Apache Hadoop Yarn: Yet Another Resource Negotiator. SOCC, 2013. Google ScholarDigital Library
- K. Wang, M. Lin, F. Ciucu, A. Wierman, and C. Lin. Characterizing the Impact of the Workload on the Value of Dynamic Resizing in Data Centers. SIGMETRICS, 2012. Google ScholarDigital Library
- A. Wierman and M. Harchol-Balter. Classifying Scheduling Policies with Respect to Unfairness in an M/GI/1. SIGMETRICS, 2003. Google ScholarDigital Library
- M. Wojciechowski, M. Capotă, J. Pouwelse, and A. Iosup. BTWorld: Towards Observing the Global BitTorrent File-Sharing Network. HPDC, 2010. Google ScholarDigital Library
- M. Zaharia, D. Borthakur, J. Sarma, K. Elmeleegy, S. Shenker, and I. Stoica. Delay Scheduling: A Simple Technique for Achieving Locality and Fairness in Cluster Scheduling. EuroSys, 2010. Google ScholarDigital Library
Index Terms
- Balanced resource allocations across multiple dynamic MapReduce clusters
Recommendations
Balanced resource allocations across multiple dynamic MapReduce clusters
Performance evaluation reviewRunning multiple instances of the MapReduce framework concurrently in a multicluster system or datacenter enables data, failure, and version isolation, which is attractive for many organizations. It may also provide some form of performance isolation, ...
Dynamic adaptive scheduling for virtual machines
HPDC '11: Proceedings of the 20th international symposium on High performance distributed computingWith multi-core processors becoming popular, exploiting their computational potential becomes an urgent matter. The functionality of multiple standalone computer systems can be aggregated into a single hardware computer by virtualization, giving ...
Live Migration of Multiple Virtual Machines with Resource Reservation in Cloud Computing Environments
CLOUD '11: Proceedings of the 2011 IEEE 4th International Conference on Cloud ComputingVirtualization technology is currently becoming increasingly popular and valuable in cloud computing environments due to the benefits of server consolidation, live migration, and resource isolation. Live migration of virtual machines can be used to ...
Comments