Skip to main content

Software Framework for Federated Science Instruments

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1315))

Abstract

There is an unprecedented promise of enhanced capabilities for federations of leadership computing systems and experimental science facilities by leveraging software technologies for fast and efficient operations. These federations seek to unify different science instruments, both computing and experimental, to effectively support science users and operators to execute complex workflows. The FedScI project addresses the software challenges associated with the formation and operation of federated environments by leveraging recent advances in containerization of software and softwarization of hardware. We propose a software framework to streamline the federation usage by science users and it’s provisioning and operations by facility providers. A distinguishing element of our work is the support for improved interaction between experimental devices, such as beam-line instruments, and more traditional high-performance computing resources, including compute, network, storage systems. We present guiding principles for the software framework and highlight portions of a current prototype implementation. We describe our science use case involving neutron imaging beam-lines (SNAP/BL-3, Imaging/CG-1D) at the Spallation Neutron Source and High Flux Isotope Reactor facilities at Oak Ridge National Laboratory. Additionally, we detail plans for a more direct instrument interaction within a federated environment, which could enable more advanced workflows with feedback loops to shorten the time to science.

T. Naughton et al.—Contributed Equally.

This manuscript has been co-authored by UT-Battelle, LLC, under contract DE-AC05-00OR22725 with the US Department of Energy (DOE). The US government retains and the publisher, by accepting the article for publication, acknowledges that the US government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this manuscript, or allow others to do so, for US government purposes. DOE will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan (http://energy.gov/downloads/doe-public-access-plan).

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Some EPICS deployments in USA include: SNS, ANL/APS, BNL, SLAC, LANL, JLAB/CEBAF, LBNL, Fermilab D0, Keck & Gemini Telescopes; and some international deployments: Australian Square-Kilometer Array Pathfinder (ASKAP) and Synchroton; Canadian Light Source; DESY, BESSY, in Germany; PSI/SLS in Switzerland; Ganil, SACLAY in France; Diamond Light Source and ISIS in England; KEK, J-Parc in Japan; IHEP in China; NSRRC in Taiwan; PLS in South Korea.

References

  1. ADIOS: Adaptable IO System. https://www.olcf.ornl.gov/center-projects/adios

  2. EPICS - Experimental Physics and Industrial Control System. https://epics.anl.gov/

  3. Globus - Data Transfer with Globus. https://www.globus.org/data-transfer

  4. Neutron Imaging Facility (Imaging | CG-1D | HFIR). https://neutrons.ornl.gov/imaging

  5. iMars3D: Preprocessing and reconstruction for the Neutron Imaging Beam Lines. https://github.com/ornlneutronimaging/iMars3D.git

  6. Liu, L., Özsu, M.T. (eds.): Encyclopedia of Database Systems. Springer, New York (2018). https://doi.org/10.1007/978-1-4614-8265-9

    Book  Google Scholar 

  7. Spallation Neutrons and Pressure Diffractometer (SNAP | BL-3 | SNS). https://neutrons.ornl.gov/snap

Download references

Acknowledgements

This research used resources of the Oak Ridge Leadership Computing Facility at the Oak Ridge National Laboratory, which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725. This research is support by the ORNL Laboratory Directed Research & Development program.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Thomas Naughton .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Naughton, T. et al. (2020). Software Framework for Federated Science Instruments. In: Nichols, J., Verastegui, B., Maccabe, A.‘., Hernandez, O., Parete-Koon, S., Ahearn, T. (eds) Driving Scientific and Engineering Discoveries Through the Convergence of HPC, Big Data and AI. SMC 2020. Communications in Computer and Information Science, vol 1315. Springer, Cham. https://doi.org/10.1007/978-3-030-63393-6_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-63393-6_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-63392-9

  • Online ISBN: 978-3-030-63393-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics