Skip to main content
SpringerLink
Log in

Distributed Uniform Streaming Framework: Towards an Elastic Fog Computing Platform for Event Stream Processing

  • Conference paper
  • First Online:
Advances on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC 2018)

Part of the book series: Lecture Notes on Data Engineering and Communications Technologies ((LNDECT,volume 24))

Abstract

More and more devices are connected to the internet. These devices could be used to help execute applications that otherwise would need to be executed on the cloud or on a system with more computational resources. To execute the application on multiple devices, we will split it up into multiple application components that stream events to each other. In this paper we present a framework that allows application components to stream events to each other. On top of this we present a coordinator system to move application components to other devices. This elasticity allows the coordinators to run application components on different devices based on the context, in order to optimize resources such as network usage, response times and battery life. The coordinators use an adapted version of the Contract Net Protocol which allows them to find a local minima in resource consumption. In order to verify this, three use cases are implemented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R., Konwinski, A., Zaharia, M.: A view of cloud computing. Commun. ACM 53(4), 50–58 (2010)

    Article  Google Scholar 

  2. Atzori, L., Iera, A., Morabito, G.: The internet of things: a survey. Comput. Netw. 54(15), 2787–2805 (2010)

    Article  Google Scholar 

  3. Gubbi, J., Buyya, R., Marusic, S., Palaniswami, M.: Internet of things (IoT): a vision, architectural elements, and future directions. Futur. Gener. Comput. Syst. 29(7), 1645–1660 (2013)

    Article  Google Scholar 

  4. Habak, K., Ammar, M., Harras, K.A., Zegura, E.: Femto clouds: Leveraging mobile devices to provide cloud service at the edge. in: 2015 IEEE 8th International Conference on Cloud Computing (CLOUD), pp. 9–16. IEEE (2015)

    Google Scholar 

  5. Heinze, T., Pappalardo, V., Jerzak, Z., Fetzer, C.: Auto-scaling techniques for elastic data stream processing. In: 2014 IEEE 30th International Conference on Data Engineering Workshops (ICDEW), pp. 296–302. IEEE (2014)

    Google Scholar 

  6. Hummer, W., Satzger, B., Dustdar, S.: Elastic stream processing in the cloud. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 3(5), 333–345 (2013)

    Article  Google Scholar 

  7. Moxey, C., Edwards, M., Etzion, O., Ibrahim, M., Iyer, S., Lalanne, H., Stewart, K.: A Conceptual Model for Event Processing Systems. IBM Redguide Publication (2010)

    Google Scholar 

  8. OpenSplice DDS: Adlink OpenSplice DDS Community Edition. http://www.prismtech.com/dds-community/software-downloads

  9. Paho-mqtt: Eclipse Paho MQTT Python client library. https://pypi.org/project/paho-mqtt/

  10. Pan, J., McElhannon, J.: Future edge cloud and edge computing for internet of things applications. IEEE Internet Things J. 5(1), 439–449 (2018)

    Article  Google Scholar 

  11. Sharif, M., Mercelis, S., Hellinckx, P.: Context-aware optimization of distributed resources in internet of things using key performance indicators. In: International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, pp. 733–742. Springer, Cham (2017)

    Google Scholar 

  12. Smith, R.G.: The contract net protocol: high-level communication and control in a distributed problem solver. IEEE Trans. Comput. 12, 1104–1113 (1980)

    Article  Google Scholar 

  13. Teranishi, Y., Kimata, T., Yamanaka, H., Kawai, E., Harai, H.: Dynamic data flow processing in edge computing environments. In: 2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC), vol. 1, pp. 935–944. IEEE (2017)

    Google Scholar 

  14. Wooldridge, M.: An Introduction to MultiAgent Systems. Wiley (reprint) (2009). ISBN-978-0470519462

    Google Scholar 

  15. ZeroMQ: ZeroMQ Distributed Messaging. http://zeromq.org

Download references

Author information

Authors and Affiliations

  1. University of Antwerp - imec, IDLab, Faculty of Applied Engineering, Antwerp, Belgium

    Simon Vanneste, Jens de Hoog, Thomas Huybrechts, Stig Bosmans, Muddsair Sharif, Siegfried Mercelis & Peter Hellinckx

Authors
  1. Simon Vanneste
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jens de Hoog
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Thomas Huybrechts
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Stig Bosmans
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Muddsair Sharif
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Siegfried Mercelis
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Peter Hellinckx
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Simon Vanneste .

Editor information

Editors and Affiliations

  1. Dept De Ciències De La Computació, Universitat Politècnica De Catalunya, Barcelona, Spain

    Fatos Xhafa

  2. Tunghai University, Taichung, Taiwan

    Fang-Yie Leu

  3. Università Della Campania Luigi Vanvitelli, Caserta, Italy

    Massimo Ficco

  4. Tunghai University, Taichung, Taiwan

    Chao-Tung Yang

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Vanneste, S. et al. (2019). Distributed Uniform Streaming Framework: Towards an Elastic Fog Computing Platform for Event Stream Processing. In: Xhafa, F., Leu, FY., Ficco, M., Yang, CT. (eds) Advances on P2P, Parallel, Grid, Cloud and Internet Computing. 3PGCIC 2018. Lecture Notes on Data Engineering and Communications Technologies, vol 24. Springer, Cham. https://doi.org/10.1007/978-3-030-02607-3_39

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-02607-3_39

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-02606-6

  • Online ISBN: 978-3-030-02607-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation