Abstract
In this paper, we introduce the DFC dataflow language and its runtime environment. DFC runtime library is in charge of constructing the DAG of the dataflow graph, firing the DFC tasks and the synchronizations between the tasks of successive passes. Basing on an elaborately implemented thread pool and queued Active Data, DFC runtime shows an ideal performance comparing with DSPatch. The experiment of a simple dataflow graph shows that DFC has better performance for the cases that the parallelism beneath the core number, while DSPatch shows a better scalability for the cases of the parallelism exceed the core number. As DFC is still a prototype language, it lacks the ability to construct the DAG dynamically, which leads to low efficiency when coding for a well-structured dataflow graph.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Sterling, T., Brodowicz, M., Anderson, M.: High Performance Computing: Modern Systems and Practices, Morgan Kaufmann, pp. 616–618 (2018)
Pell, O., Averbukh, V.: Maximum performance computing with dataflow engines. In: Computing in Science & Engineering, vol. 14, no. 4, pp. 98–103 July-August 2012. https://doi.org/10.1109/mcse.2012.78
Burger, D., et al.: The TRIPS Team, Scaling to the end of silicon with EDGE architectures. IEEE Comput. 37(7), 44–55 (2004). https://doi.org/10.1109/MC.2004.65
Gebhart, M., et al.: An evaluation of the TRIPS computer system. SIGPLAN Not 44(3), 1–12 (2009). https://doi.org/10.1145/1508284.1508246
Giorgi, R.: Teraflux: exploiting dataflow parallelism in teradevices. In: Proceedings of the 36th Annual IEEE/ACM International Symposium on Microarchitecture, CF 2012, ACM, 2012. New York, NY, USA, 2012, pp. 303–304 (2012). http://doi.acm.org/10.1145/2212908.2212959
Portero, A., Yu, Z., Giorgi, R.: Teraflux: exploiting tera-device computing challenges. Procedia CS 7, 146–147 (2011)
Ursutiu, D., Samoila, C., Jinga, V.: Creative developments in LabVIEW student training: (Creativity laboratory — LabVIEW academy). In: 2017 4th Experiment@International Conference (exp.at 2017), Faro, 2017, pp. 309–312 (2017). http://doi.org/10.1109/EXPAT.2017.7984399
Chavarrias, M., Pescador, F., Juárez, E., Garrido, M.J.: An automatic tool for the static distribution of actors in RVC-CAL based multicore designs, pp. 1–6. Design of Circuits and Integrated Systems, Madrid (2014)
Lin, H., Lin, Z., Diaz, J.M., Li, M., An, H., Gao, G.R.: swFLOW: a dataflow deep learning framework on sunway taihulight supercomputer. In: 2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC/SmartCity/DSS), Zhangjiajie, China, 2019, pp. 2467–2475 (2019)
Du, Z., Zhang, J., Sha, S., Luo, Q.: Implementing the matrix multiplication with DFC on kunlun small scale computer. In: 2019 20th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT), Gold Coast, Australia, 2019, pp. 115–120 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, J., Li, J., Du, Z., Shu, J., Luo, Q. (2021). The Dataflow Runtime Environment of DFC. In: Zhang, Y., Xu, Y., Tian, H. (eds) Parallel and Distributed Computing, Applications and Technologies. PDCAT 2020. Lecture Notes in Computer Science(), vol 12606. Springer, Cham. https://doi.org/10.1007/978-3-030-69244-5_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-69244-5_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-69243-8
Online ISBN: 978-3-030-69244-5
eBook Packages: Computer ScienceComputer Science (R0)