Lightweight Distributed Metric Service (LDMS)

The open-source, Sandia-led Lightweight Distributed Metric Service (LDMS) is state-of-the-art monitoring software that provides continuous, run-time insight into applications’ performance in conjunction with system conditions. “Always-on” monitoring on our HPC systems provides a wealth of information that can be used in statistical and ML-based analysis to discover causes of performance degradation and to inform resource management and scheduling decisions. LDMS was designed from the ground up with the extreme-scalability and lightweight data collection necessary to resolve data features on timescales necessary to reveal cause and effect and to drive automated, run-time feedback and response to improve the performance and efficiency of current and future HPC systems. In addition, data-driven insights from LDMS can influence next-generation architectural design.

LDMS is an R&D 100 award winner and is deployed on extreme-scale HPC systems throughout the world. Advances in LDMS and collaborative R&D directions are discussed at the LDMS Users Group Conference, LDMSCON.

Gitlab Repository
Open-source, Sandia-led Lightweight Distributed Metric Service (LDMS)

Publications

  • Schwaller, B. (2021). Integrated System and Application Continuous Performance Monitoring and Analysis Capability (Final). https://doi.org/10.2172/1822583 Publication ID: 75905
  • Aaziz, O.R., Allan, B.A., Brandt, J.M., Cook, J., Devine, K., Elliott, J., Gentile, A.C., Hammond, S., Kelley, B.M., Lopatina, L., Moore, S.G., Olivier, S.L., Foulk, J.W., Poliakoff, D., Pawlowski, R., Regier, P., Schmitz, M.E., Schwaller, B., Surjadidjaja, V., … Walton, S.P. (2021). Integrated System and Application Continuous Performance Monitoring and Analysis Capability. https://doi.org/10.2172/1819812 Publication ID: 75582
  • Elwazir, A., Badawy, A.A., Aaziz, O.R., & Cook, J. (2020). LDMS-GPU: Lightweight Distributed Metric Service (LDMS) for NVIDIA GPGPUs. 10.2172/1813665 Publication ID: 71944
  • Tucker, T., Gentile, A.C., & Brandt, J.M. (2020). Supporting Dynamic Event Monitoring in the Lightweight Distributed Metric Service (LDMS) [Conference Poster]. https://www.osti.gov/biblio/1812466 Publication ID: 74398
  • Brandt, J.M. (2019). Lightweight Distributed Metric Service: Deployments Enhancements Roadmap and Activities [Presentation]. https://www.osti.gov/biblio/1645641 Publication ID: 69785
  • Allan, B.A. (2019). Two Weeks In The Life of Skybridge. 10.2172/1762352 Publication ID: 102268
  • Izadpanah, R., Allan, B.A., Dechev, D., & Brandt, J.M. (2019). Production application performance data streaming for system monitoring. ACM Transactions on Modeling and Performance Evaluation of Computing Systems, 4(2). 10.1145/3319498 Publication ID: 70049
  • Brandt, J.M., Gentile, A.C., Showerman, M., Enos, J., Fullop, J., & Bauer, G. (2016). Large-scale persistent numerical data source monitoring system experiences [Conference Poster]. Proceedings – 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016. 10.1109/IPDPSW.2016.188 Publication ID: 48803
  • Allan, B.A., Lefantzi, S., Walsh, E.J., Ogden, J.B., & Gauntt, N.E. (2016). Lightweight Distributed Metric Service: Production analytics overview for LDMS v2 [Presentation]. https://www.osti.gov/biblio/1369518 Publication ID: 50930
  • Allan, B.A. (2016). Lightweight Distributed Metric Service: Production overview and development status [Conference Poster]. https://www.osti.gov/biblio/1368706 Publication ID: 50289
  • Brandt, J.M., Collins, W., Gentile, A.C., Martinez, M., McRee, S., Sands, D., & Yaklin, A.C. (2015). Uncovering Bottlenecks in Data Transfer from a Filesystem to HPSS using the Lightweight Distributed Metric Service (LDMS) [Conference Poster]. https://www.osti.gov/biblio/1325529 Publication ID: 45513
  • Brandt, J.M., & Gentile, A.C. (2014). Lightweight Distributed Metric Service (LDMS) [Presentation]. https://www.osti.gov/biblio/1496673 Publication ID: 37573
  • Agelastos, A.M., Allan, B.A., Brandt, J.M., Gentile, A.C., Monk, S.T., Ogden, J.B., Rajan, M., & Stevenson, J.O. (2014). The Lightweight Distributed Metric Service: A Scalable Infrastructure for Continuous Monitoring of Large Scale Computing Systems and Applications [Conference]. https://doi.org/10.1109/SC.2014.18 Publication ID: 40490
  • Agelastos, A.M., Allan, B.A., Brandt, J.M., Cassella, P., Enos, J., Fullop, J., Gentile, A.C., Monk, S.T., Naksinehaboon, N., Ogden, J.B., Rajan, M., Showerman, M., Stevenson, J.O., Taerat, N., & Tucker, T.O. (2014). The Lightweight Distributed Metric Service: A Scalable Infrastructure for Continuous Monitoring of Large Scale Computing Systems and Applications [Conference Poster]. International Conference for High Performance Computing, Networking, Storage and Analysis, SC. 10.1109/SC.2014.18 Publication ID: 39574
  • Brandt, J.M., & Gentile, A.C. (2013). Lightweight Distributed Metric Service (LDMS): Run-time Resource Utilization Monitoring [Conference]. https://www.osti.gov/biblio/1106397 Publication ID: 34992
  • Brandt, J.M., & Gentile, A.C. (2013). LDMS: Lightweight Distributed Metric Service for HPC Monitoring [Conference]. https://www.osti.gov/biblio/1063385 Publication ID: 32144
  • Gentile, A.C., & Brandt, J.M. (2012). Lightweight Distributed Metric Service [Presentation]. https://www.osti.gov/biblio/1648269 Publication ID: 30760
  • Gentile, A.C., & Brandt, J.M. (2012). Copy of Lightweight Distributed Metric Service [Presentation]. https://www.osti.gov/biblio/1686350 Publication ID: 30761
Showing 15 of 18 publications.