Lightweight Distributed Metric Service (LDMS)

The open-source, Sandia-led Lightweight Distributed Metric Service (LDMS) is state-of-the-art monitoring software that provides continuous, run-time insight into applications’ performance in conjunction with system conditions. “Always-on” monitoring on our HPC systems provides a wealth of information that can be used in statistical and ML-based analysis to discover causes of performance degradation and to inform resource management and scheduling decisions. LDMS was designed from the ground up with the extreme-scalability and lightweight data collection necessary to resolve data features on timescales necessary to reveal cause and effect and to drive automated, run-time feedback and response to improve the performance and efficiency of current and future HPC systems. In addition, data-driven insights from LDMS can influence next-generation architectural design.

LDMS is an R&D 100 award winner and is deployed on extreme-scale HPC systems throughout the world. Advances in LDMS and collaborative R&D directions are discussed at the LDMS Users Group Conference, LDMSCON.

Gitlab Repository
Open-source, Sandia-led Lightweight Distributed Metric Service (LDMS)

Publications

  • Schwaller, B. (2021). Integrated System and Application Continuous Performance Monitoring and Analysis Capability (Final). https://doi.org/10.2172/1822583 Publication ID: 75905
  • Aaziz, O., Allan, B., Brandt, J.M., Cook, J., Devine, K., Elliott, J., Gentile, A.C., Hammond, S., Kelley, B., Lopatina, L., Moore, S.G., Olivier, S.L., Bachman, W.B., Poliakoff, D., Pawlowski, R., Regier, P., Schmitz, M.E., Schwaller, B., Surjadidjaja, V., … Walton, S.P. (2021). Integrated System and Application Continuous Performance Monitoring and Analysis Capability. https://doi.org/10.2172/1819812 Publication ID: 75582
  • Elwazir, A., Badawy, A.A., Aaziz, O., Cook, J., & Cook, J. (2020). LDMS-GPU: Lightweight Distributed Metric Service (LDMS) for NVIDIA GPGPUs. https://doi.org/10.2172/1813665 Publication ID: 71944
  • Tucker, T., Gentile, A.C., Brandt, J.M., & Brandt, J.M. (2020). Supporting Dynamic Event Monitoring in the Lightweight Distributed Metric Service (LDMS) [Conference Poster]. https://www.osti.gov/biblio/1812466 Publication ID: 74398
  • Brandt, J.M. (2019). Lightweight Distributed Metric Service: Deployments Enhancements Roadmap and Activities [Presentation]. https://www.osti.gov/biblio/1645641 Publication ID: 69785
  • Allan, B. (2019). Two Weeks In The Life of Skybridge. https://doi.org/10.2172/1762352 Publication ID: 102268
  • Izadpanah, R., Allan, B., Dechev, D., Brandt, J.M., & Brandt, J.M. (2019). Production application performance data streaming for system monitoring. ACM Transactions on Modeling and Performance Evaluation of Computing Systems, 4(2). https://doi.org/10.1145/3319498 Publication ID: 70049
  • Brandt, J.M., Gentile, A.C., Showerman, M., Enos, J., Fullop, J., Bauer, G., & Bauer, G. (2016). Large-scale persistent numerical data source monitoring system experiences [Conference Poster]. Proceedings – 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016. https://doi.org/10.1109/IPDPSW.2016.188 Publication ID: 48803
  • Allan, B., Lefantzi, S., Walsh, E.J., Ogden, J.B., Gauntt, N.E., & Gauntt, N.E. (2016). Lightweight Distributed Metric Service: Production analytics overview for LDMS v2 [Presentation]. https://www.osti.gov/biblio/1369518 Publication ID: 50930
  • Allan, B. (2016). Lightweight Distributed Metric Service: Production overview and development status [Conference Poster]. https://www.osti.gov/biblio/1368706 Publication ID: 50289
  • Brandt, J.M., Collins, W., Gentile, A.C., Martinez, M., McRee, S., Sands, D., Yaklin, A.C., & Yaklin, A.C. (2015). Uncovering Bottlenecks in Data Transfer from a Filesystem to HPSS using the Lightweight Distributed Metric Service (LDMS) [Conference Poster]. https://www.osti.gov/biblio/1325529 Publication ID: 45513
  • Brandt, J.M., Gentile, A.C., & Gentile, A.C. (2014). Lightweight Distributed Metric Service (LDMS) [Presentation]. https://www.osti.gov/biblio/1496673 Publication ID: 37573
  • Agelastos, A.M., Allan, B., Brandt, J.M., Gentile, A.C., Monk, S.T., Ogden, J.B., Rajan, M., Stevenson, J.O., & Stevenson, J.O. (2014). The Lightweight Distributed Metric Service: A Scalable Infrastructure for Continuous Monitoring of Large Scale Computing Systems and Applications [Conference]. https://doi.org/10.1109/SC.2014.18 Publication ID: 40490
  • Agelastos, A.M., Allan, B., Brandt, J.M., Cassella, P., Enos, J., Fullop, J., Gentile, A.C., Monk, S.T., Naksinehaboon, N., Ogden, J.B., Rajan, M., Showerman, M., Stevenson, J.O., Taerat, N., Tucker, T.O., & Tucker, T.O. (2014). The Lightweight Distributed Metric Service: A Scalable Infrastructure for Continuous Monitoring of Large Scale Computing Systems and Applications [Conference Poster]. International Conference for High Performance Computing, Networking, Storage and Analysis, SC. https://doi.org/10.1109/SC.2014.18 Publication ID: 39574
  • Brandt, J.M., Gentile, A.C., & Gentile, A.C. (2013). Lightweight Distributed Metric Service (LDMS): Run-time Resource Utilization Monitoring [Conference]. https://www.osti.gov/biblio/1106397 Publication ID: 34992
  • Brandt, J.M., Gentile, A.C., & Gentile, A.C. (2013). LDMS: Lightweight Distributed Metric Service for HPC Monitoring [Conference]. https://www.osti.gov/biblio/1063385 Publication ID: 32144
  • Gentile, A.C., Brandt, J.M., & Brandt, J.M. (2012). Lightweight Distributed Metric Service [Presentation]. https://www.osti.gov/biblio/1648269 Publication ID: 30760
  • Gentile, A.C., Brandt, J.M., & Brandt, J.M. (2012). Copy of Lightweight Distributed Metric Service [Presentation]. https://www.osti.gov/biblio/1686350 Publication ID: 30761
Showing 15 of 18 publications.