Abstract
With the tremendous increased scale of networks, data transferring plays a very important role in high performance computing. Traditionally, when a task is completed, the data associated with the task will be released to free the space for the following tasks. However, the following task may require the same data, which will be fetched back and the efficiency will be affected too. In this paper, we implement a data caching method so as to improve the performance of the system. When a task is completed, the data will be stored for a longer time. If the previous used data is requested before releasing, there will be no transferring cost. With the help of data caching, the performance of the network in handling real-time tasks is significantly improved while the traffic jamming is also decreased. We extend the previous single data model to multiple type of data among servers. Tasks arrive in an online fashion, and when handling a task on some network server, we have no information about the future tasks. Assuming the storage cost is submodular, which is well adopted in reality, we propose an online algorithm to minimize the total transfer and caching costs of the system. Via theoretical analysis, the competitive ratio of the algorithm is proved to be a constant.
This work is supported by National Key R&D Program of China (2018YFB0204005), NSFC 12071460, Shenzhen research grant (KQJSCX20180330170311901, JCYJ20180305180840138 and GGFW2017073114031767), Hong Kong GRF-17208019.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cao, P., Irani, S.: Cost-aware WWW proxy caching algorithms. In: Proceedings of the USENIX Symposium on Internet Technologies and Systems, p. 18 (1997)
Charikar, M., Halperin, D., Motwani, R.: The dynamic servers problem. In: Proceedings of the Ninth Annual ACM-SIAM Symposium on Discrete Algorithms (SODA 1998), pp. 410–419 (1998)
Fan, X., Cao, J., Mao, H., Wu, W., Zhao, Y., Xu, C.: Web access patterns enhancing data access performance of cooperative caching in IMANETs. In: Proceedings of the 17th IEEE International Conference on Mobile Data Management, pp. 50–59 (2016)
Gharaibeh, A., Khreishah, A., Khalil, I.: An O(1)-competitive online caching algorithm for content centric networking. In: IEEE INFOCOM 2016–35th Annual IEEE International Conference on Computer Communications (2016)
Gharaibeh, A., Khreishah, A., Ji, B., Ayyash, M.: A provably efficient online collaborative caching algorithm for multicell-coordinated systems. IEEE Trans. Mob. Comput. 15(8), 1863–1876 (2016)
Golrezaei, N., Shanmugam, K., Dimakis, A., Molisch, A., Caire, G.: FemtoCaching: wireless video content delivery through distributed caching helperss. In: IEEE INFOCOM, pp. 1107–1115 (2012)
Li, F., Yu, D., Yang, H., Yu, J., Holger, K., Cheng, X.: Multi-armed bandit based spectrum scheduling algorithms in wireless networks: a survey. IEEE Wireless Commun. Mag. 27(1), 24–30 (2020)
Karger, D., et al.: Web caching with consistent hashing. In: Proceedings of the 8th International Conference on World Wide Web, pp. 1203–1213 (1999)
Ostovari, P., Wu, J., Khreishah, A.: Efficient online collaborative caching in cellular networks with multiple base stations. In: 2016 IEEE 13th International Conference on Mobile Ad Hoc and Sensor Systems (MASS), Brasilia, pp. 136–144 (2016)
Papadimitriou, C., Ramanathan, S., Rangan, P., et al.: Multimedia information caching for personalized video-on-demand. Comput. Commun. 18(3), 204–216 (1995)
Papadimitriou, C.H., Ramanathan, S., Venkat Rangan, P.: Optimal information delivery. In: Staples, J., Eades, P., Katoh, N., Moffat, A. (eds.) ISAAC 1995. LNCS, vol. 1004, pp. 181–187. Springer, Heidelberg (1995). https://doi.org/10.1007/BFb0015422
Shanmugam, K., Golrezaei, N., Dimakis, A., Molisch, A., Caire, G.: FemtoCaching: wireless content delivery through distributed caching helpers. IEEE Trans. Inf. Theory 59(12), 8402–8413 (2013)
Veeravalli, B.: Network caching strategies for a shared data distribution for a predefined service demand sequence. IEEE Trans. Knowl. Data Eng. 15(6), 1487–1497 (2003)
Wang, Y., He, S., Fan, X., Xu, C., Sun, X.: On cost-driven collaborative data caching: a new model approach. IEEE Trans. Parallel Distrib. Syst. 30(3), 662–676 (2018)
Wang, Y., Veeravalli, B., Tham, C.: On data staging algorithms for shared data accesses in clouds. IEEE Trans. Parallel Distrib. Syst. 24(4), 825–838 (2013)
Wang, Y., Shi, W., Hu, M.: Virtual servers co-migration for mobile accesses: online versus off-line. IEEE Trans. Mob. Comput. 14(12), 2576–2589 (2015)
Wang, Y., He, S., Fan, X., Xu, C., Sun, X.: On cost-driven collaborative data caching: a new model approach. IEEE Trans. Parallel Distrib. Syst. 30(3), 662–676 (2019)
Wang, Y., et al.: Cost-driven data caching in the cloud: an algorithmic approach. Accepted by INFOCOM 2021 (2021)
Yu, L., Cai, Z.: Dynamic scaling of virtualized networks with bandwidth guarantees in cloud datacenters. In: The 35th Annual IEEE International Conference on Computer Communications (INFOCOM 2016) (2016)
Zheng, X., Cai, Z., Li, J., Gao, H.: A study on application-aware scheduling in wireless networks. IEEE Trans. Mob. Comput. 16(7), 1787–1801 (2017)
Zhu, T., Shi, T., Li, J., Cai, Z., Zhou, X.: Task scheduling in deadline-aware mobile edge computing systems. IEEE Internet Things J. 6(3), 4854–4866 (2019)
Zou, Y., et al.: Fast distributed backbone construction despite strong adversarial jamming. In: INFOCOM 2019 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Han, X., Gao, G., Wang, Y., Ting, HF., Zhang, Y. (2021). Data Caching Based Transfer Optimization in Large Scale Networks. In: Zhang, Y., Xu, Y., Tian, H. (eds) Parallel and Distributed Computing, Applications and Technologies. PDCAT 2020. Lecture Notes in Computer Science(), vol 12606. Springer, Cham. https://doi.org/10.1007/978-3-030-69244-5_29
Download citation
DOI: https://doi.org/10.1007/978-3-030-69244-5_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-69243-8
Online ISBN: 978-3-030-69244-5
eBook Packages: Computer ScienceComputer Science (R0)