2020
Ryan Grant, Simon David Hammond, James H. Laros, Michael J. Levenhagen, Stephen Lecler Olivier, Kevin Pedretti, Harry Lee Ward, Andrew J Younge, Andrew J Younge, ,
Enabling Power Measurement and Control on Astra: The First Petascale Arm Supercomputer, Conference, Cray Users' Group Annual Technical Conference (CUG'20),
October 28, 2020
Michael J. Levenhagen
Scalable System Software

Scalable System Software
(505) 844-4992
Sandia National Laboratories, New Mexico
P.O. Box 5800
Albuquerque, NM 87185-1319
Biography
I work in the Scalable System Software department at Sandia National Laboratories. My primary interests are designing system software for capability class high performance computing platforms and enabling co-design activities for the laboratories by designing Structural Simulation Toolkit (SST) models of computer architectures.
Publications
RyanE. Grant, SimonD. Hammond, James H. Laros, Michael J. Levenhagen, Stephen Lecler Olivier, Kevin Pedretti, H.Lee Ward, Andrew J Younge, (2022). Enabling Power Measurement and Control on Astra: The First Petascale Arm Supercomputer Concurrency and ComputationPractice and Experience https://www.osti.gov/search/identifier:1887388 Document ID: 1606272
Ryan Eric Grant, Michael J. Levenhagen, Matthew Dosanjh, Patrick Widener, (2021). RVMA: Remote Virtual Memory Access IEEE International Parallel & Distributed Processing Symposium https://www.osti.gov/search/identifier:1842658 Document ID: 1266733
Ryan Eric Grant, Simon David Hammond, James H. Laros, Michael J. Levenhagen, Stephen Lecler Olivier, Kevin Pedretti, Harry Lee Ward, Andrew J Younge, (2020). Enabling Power Measurement and Control on Astra: The First Petascale Arm Supercomputer Cray User Group Document ID: 1231740
Simon David Hammond, Clayton Hughes, Michael J. Levenhagen, Courtenay T. Vaughan, Andrew J Younge, Benjamin Schwaller, Michael James Aguilar, Kevin Pedretti, James H. Laros, (2019). Evaluating the Marvell ThunderX2 Server Processor for HPC Workloads The 6th Special Session on High Performance Computing Benchmarking and Optimization (HPBench 2019) https://www.osti.gov/search/identifier:1640906 Document ID: 961681
Simon David Hammond, Clayton Hughes, Michael J. Levenhagen, Courtenay T. Vaughan, Andrew J Younge, Benjamin Schwaller, Michael James Aguilar, Kevin Pedretti, James H. Laros, (2019). Evaluating the Marvell ThunderX2 Server Processor for HPC Workloads The 6th Special Session on High-Performance Computing Benchmarking and Optimization (HPBench 2019) https://www.osti.gov/search/identifier:1640219 Document ID: 948877
Simon David Hammond, Clayton Hughes, Michael J. Levenhagen, Courtenay T. Vaughan, Andrew J Younge, Benjamin Schwaller, Michael James Aguilar, Kevin Pedretti, James H. Laros, (2019). Evaluating the Marvell ThunderX2 Server Processor for HPC Workloads The 6th Special Session on High Performance Computing Benchmarking and Optimization (HPBench 2019) https://www.osti.gov/search/identifier:1640040 Document ID: 961366
Ryan Eric Grant, Matthew Dosanjh, Michael J. Levenhagen, Ronald B. Brightwell, Anthony Skjellum, (2019). Finepoints: Partitioned Multithreaded MPI Communication Isc High Performance 2019 https://www.osti.gov/search/identifier:1639543 Document ID: 947758
Michael J. Levenhagen, Simon David Hammond, Karl Scott Hemmert, (2019). Towards Lightweight and Scalable Simulation of Large-Scale OpenSHMEM Applications OpenSHMEM 2018Fifth Workshop on OpenSHMEM and Related Technologies https://www.osti.gov/search/identifier:1639366 Document ID: 841986
Kurt Brian Ferreira, Ryan Eric Grant, Michael J. Levenhagen, Scott Larson Nicoll Levy, Taylor Groves, (2019). Hardware MPI Message Matching: Insights into MPI Matching Behavior to Inform Design Concurrency and ComputationPractice and Experience https://www.osti.gov/search/identifier:1501630 Document ID: 913436
Michael J. Levenhagen, Simon David Hammond, Karl Scott Hemmert, (2018). Towards Lightweight and Scalable Simulation of Large-Scale OpenSHMEM Applications OpenSHMEM 2018Fifth Workshop on OpenSHMEM and Related Technologies https://www.osti.gov/search/identifier:1569316 Document ID: 853237
Matthew Dosanjh, S. Mahdieh Ghazimirsaeed, Ryan Eric Grant, William Whitney Schonbein, Michael J. Levenhagen, Patrick G. Bridges, Ahmad Afsahi, (2018). The Case for Semi-Permanent Cache Occupancy 47th International Conference on Parallel Processing https://www.osti.gov/search/identifier:1582155 Document ID: 853145
Michael J. Levenhagen, Simon David Hammond, Karl Scott Hemmert, (2018). Towards Lightweight and Scalable Simulation of Large-Scale OpenSHMEM Applications OpenSHMEM 2018Fifth Workshop on OpenSHMEM and Related Technologies Document ID: 809218
Matthew Dosanjh, S. Mahdieh Ghazimirsaeed, Ryan Eric Grant, William Whitney Schonbein, Michael J. Levenhagen, Patrick G. Bridges, Ahmad Afsahi, (2018). The Case for Semi-Permanent Cache Occupancy 47th International Conference on Parallel Processing https://www.osti.gov/search/identifier:1525690 Document ID: 808284
Kevin Pedretti, Ryan Eric Grant, James H. Laros, Michael J. Levenhagen, Stephen Lecler Olivier, Harry Lee Ward, Andrew J Younge, (2018). A Comparison of Power Management Mechanisms: P-states vs. Node-Level Power Cap Control IEEE International Parallel & Distributed Processing Symposium https://www.osti.gov/search/identifier:1515733 Document ID: 807294
Simon David Hammond, Arun F. Rodrigues, Gwendolyn Renae Voskuilen, Karl Scott Hemmert, Michael J. Levenhagen, Clayton Hughes, Robert J. Hoekstra, (2018). Structural Simulation Toolkit (SST) Tutorial Tutorial Material https://www.osti.gov/search/identifier:1513506 Document ID: 796455
Andrew J Younge, Ryan Eric Grant, James H. Laros, Michael J. Levenhagen, Stephen Lecler Olivier, Kevin Pedretti, Harry Lee Ward, (2018). Advanced Power Measurement and Control for the Trinity Supercomputer European Workshop on HPC Infrastructures https://www.osti.gov/search/identifier:1510626 Document ID: 795663
Kevin Pedretti, Ryan Eric Grant, James H. Laros, Michael J. Levenhagen, Stephen Lecler Olivier, Harry Lee Ward, Andrew J Younge, (2018). A Comparison of Power Management Mechanisms: P-states vs. Node-Level Power Cap Control The 14th Workshop on High-Performance, Power-Aware Computing (HPPAC’18) https://www.osti.gov/search/identifier:1509644 Document ID: 783311
Simon David Hammond, Clayton Hughes, Amro Awad, Gwendolyn Renae Voskuilen, Arun F. Rodrigues, Karl Scott Hemmert, Michael J. Levenhagen, Robert J. Hoekstra, (2018). SST Simulation Framework (and Complex Memory) ECP Project All-Hands Meeting https://www.osti.gov/search/identifier:1513754 Document ID: 760604
Karl Scott Hemmert, Ray Bair (ANL), Abhinav Bhatele (LLNL), Taylor Groves (LBL), Simon David Hammond, Nikhil Jain (LLNL), Michael J. Levenhagen, Misbah Mubarak (ANL), Scott Pakin (LANL), Rob Ross (ANL), Jeremiah J Wilke, (2018). Interconnect Working Group ECP Annual All Hands Meeting 2018 https://www.osti.gov/search/identifier:1513694 Document ID: 760199
Simon David Hammond, Arun F. Rodrigues, Karl Scott Hemmert, Gwendolyn Renae Voskuilen, Clayton Hughes, Michael J. Levenhagen, Robert J. Hoekstra, James A. Ang, (2018). Towards a Scalable, Integrated Simulation Framework for Extreme Heterogeneity in High Performance Computing The Extreme Heterogeneity Workshop (ASCR/DOE) https://www.osti.gov/search/identifier:1513452 Document ID: 727357
Kurt Brian Ferreira, Ryan Eric Grant, Michael J. Levenhagen, Scott Larson Nicoll Levy, Taylor Groves, (2017). Hardware MPI Message Matching: Insights into MPI Matching Behavior to Inform Design ExaMPI2017 – Workshop on Exascale MPI 2017 https://www.osti.gov/search/identifier:1511803 Document ID: 726260
Andrew J Younge, Ryan Eric Grant, James H. Laros, Michael J. Levenhagen, Stephen Lecler Olivier, Kevin Pedretti, Harry Lee Ward, (2017). Evaluating Energy and Power Profiling Techniques for HPC Workloads The 8th International Green and Sustainable Computing Conference https://www.osti.gov/search/identifier:1466488 Document ID: 670521
James H. Laros, Ryan Eric Grant, Michael J. Levenhagen, Stephen Lecler Olivier, Kevin Pedretti, Harry Lee Ward, Andrew J Younge, (2017). High Performance Computing – Power Application Programming Interface Specification Version 2.0 https://www.osti.gov/search/identifier:1347187 Document ID: 600504
James H. Laros, David DeBonis, Ryan Eric Grant, Suzanne M. Kelly, Michael J. Levenhagen, Stephen Lecler Olivier, Kevin Pedretti, (2016). High Performance Computing – Power Application Programming Interface Specification Version 1.4 https://www.osti.gov/search/identifier:1331358 Document ID: 553107
Taylor Groves, Simon David Hammond, Karl Scott Hemmert, Ryan Eric Grant, Michael J. Levenhagen, Dorian Arnold, (2016). Stalled, Active and Idle (SAI): Characterizing Large-scale Dragonfly Networks IEEE Cluster 2016 https://www.osti.gov/search/identifier:1390450 Document ID: 528741
Ryan Eric Grant, Michael J. Levenhagen, Stephen Lecler Olivier, David DeBonis, Kevin Pedretti, James H. Laros, (2016). Power API: Standardizing Power Monitoring and Control at Exascale IEEE Computer https://www.osti.gov/search/identifier:1338911 Document ID: 475878
Taylor Groves, Ryan Eric Grant, Karl Scott Hemmert, Simon David Hammond, Michael J. Levenhagen, Dorian Arnold (UNM), (2016). (SAI) Stalled, Active and Idle: Characterizing Power and Performance of Large-Scale Dragonfly Networks IEEE Cluster https://www.osti.gov/search/identifier:1368970 Document ID: 443416
James H. Laros, Kevin Pedretti, Ryan Eric Grant, Stephen Lecler Olivier, Michael J. Levenhagen, David DeBonis, James H. Laros, (2016). An Overview of Sandia National Laboratory?sHigh Performance Computing Power Application Programming Interface (API) Specification EEHPC Webinar https://www.osti.gov/search/identifier:1420852 Document ID: 443253
James H. Laros, Suzanne M. Kelly, Kevin Pedretti, Ryan Eric Grant, Stephen Lecler Olivier, Michael J. Levenhagen, David DeBonis, James H. Laros, (2016). High Performance Computing – Power Application Programming Interface Specification https://www.osti.gov/search/identifier:1561489 Document ID: 443130
James H. Laros, Kevin Pedretti, Ryan Eric Grant, Stephen Lecler Olivier, Michael J. Levenhagen, (2016). ACES and Cray Collaborate on Advanced Power Management for Trinity Cray Users Group 2016 https://www.osti.gov/search/identifier:1648670 Document ID: 431493
Ryan Eric Grant, Michael J. Levenhagen, Stephen Lecler Olivier, David DeBonis, Kevin Pedretti, James H. Laros, (2016). Overcoming Challenges in Scalable Power Monitoring with the Power API Workshop on High-Performance, Power-Aware Computing https://www.osti.gov/search/identifier:1347166 Document ID: 397951
James H. Laros, Suzanne M. Kelly, Kevin Pedretti, Ryan Eric Grant, Stephen Lecler Olivier, Michael J. Levenhagen, David DeBonis, James H. Laros, (2016). High Performance Computing – Power Application Programming Interface Specification https://www.osti.gov/search/identifier:1494356 Document ID: 409074
James H. Laros, Kevin Pedretti, Ryan Eric Grant, Stephen Lecler Olivier, Michael J. Levenhagen, David DeBonis, (2015). An Overview of Sandia National Laboratory?sHigh Performance Computing Power Application Programming Interface (API) Specification EEHPC Webinar https://www.osti.gov/search/identifier:1336288 Document ID: 365783
James H. Laros, Kevin Pedretti, Suzanne M. Kelly, Michael J. Levenhagen, David DeBonis, Stephen Lecler Olivier, Ryan Eric Grant, (2015). Power API for HPC: Standardizing Power Measurement and Control ACM / IEEE Supercomputing 2015 (SC15) https://www.osti.gov/search/identifier:1334057 Document ID: 354841
Simon David Hammond, Karl Scott Hemmert, Michael J. Levenhagen, Arun F. Rodrigues, Gwendolyn Renae Voskuilen, (2015). Ember: Reference Communication Patterns for Exascale DOE Modeling and Simulation Workshop 2015 (ModSim 2015) https://www.osti.gov/search/identifier:1307276 Document ID: 319959
James H. Laros, Suzanne M. Kelly, Kevin Pedretti, Ryan Eric Grant, Stephen Lecler Olivier, Michael J. Levenhagen, David DeBonis, James H. Laros, (2015). High Performance Computing – Power Application Programming Interface Specification https://www.osti.gov/search/identifier:1762048 Document ID: 319734
Michael J. Levenhagen, Simon David Hammond, Karl Scott Hemmert, Branden J. Moore, Arun F. Rodrigues, (2015). Evaluating Low-Level Router Design Parameters for Exascale-Class Supercomputer Interconnects IEEE Hot Interconnects 2015 Document ID: 264905
James H. Laros, Kevin Pedretti, Ryan Eric Grant, Michael J. Levenhagen, David DeBonis, Stephen Lecler Olivier, Suzanne M. Kelly, (2015). A Power Application Programming Interface (API) Specification for High Performance Computers (HPC) Sandia External Review Board https://www.osti.gov/search/identifier:1648689 Document ID: 243479
David DeBonis, Michael J. Levenhagen, (2014). A Prototype of a Power API Framework Espt-sc14 https://www.osti.gov/search/identifier:1315438 Document ID: 208484
James H. Laros, Suzanne M. Kelly, Kevin Pedretti, Ryan Eric Grant, Stephen Lecler Olivier, Michael J. Levenhagen, David DeBonis, (2014). High Performance Computing – Power Application Programming Interface Specification https://www.osti.gov/search/identifier:1151809 Document ID: 154584
David DeBonis, Michael J. Levenhagen, James H. Laros, (2014). A Prototype of a Power API Framework 3rd Extreme-Scale Programming Tools workshop in conjunction with SC14 Document ID: 144019
David DeBonis, Ryan Eric Grant, Stephen Lecler Olivier, Michael J. Levenhagen, Suzanne M. Kelly, Kevin Pedretti, James H. Laros, (2014). A Power API for the HPC Community https://www.osti.gov/search/identifier:1497613 Document ID: 143959
David DeBonis, Ryan Eric Grant, Stephen Lecler Olivier, Michael J. Levenhagen, Suzanne M. Kelly, Kevin Pedretti, James H. Laros, (2014). A Power API for the HPC Community ACM/IEEE Supercomputing 2014 Document ID: 143982
Sue S. Collins, Suzanne M. Kelly, Kevin Pedretti, Ryan Eric Grant, Michael J. Levenhagen, Stephen Lecler Olivier, David Debonis, (2014). Addressing Power/Energy Challenges for Extreme Scale HPC External Review 2014 https://www.osti.gov/search/identifier:1700644 Document ID: 5335305
Michael J. Levenhagen, Thomas A. Romero, (2012). Civil Engineering Standard Drawings https://www.osti.gov/search/identifier:1732206 Document ID: 5313461
James A. Ang, Robert E. Benner, Simon David Hammond, Richard Frederick Barrett, Michael J. Levenhagen, M. M. Rasquinha, Arun F. Rodrigues, Kevin Pedretti, James H. Laros, Suzanne M. Kelly, (2012). Early Experiences with Intel MIC Architecture XIV International Conference on Supercomputing and Mathematical Modeling https://www.osti.gov/search/identifier:1061191 Document ID: 5313404
James A. Ang, Simon David Hammond, Richard Frederick Barrett, Michael J. Levenhagen, Arun F. Rodrigues, Kevin Pedretti, James H. Laros, Suzanne M. Kelly, Mitchelle M. Rasquinha, (2012). Early Experiences with Intel MIC Architcture International Supercomputing Conference, ISC’12 https://www.osti.gov/search/identifier:1650316 Document ID: 5309151
David R. Bronowski, Keren Bergman, David Bunde, Elliot Cooper-Balis, Kurt Brian Ferreira, Karl Scott Hemmert, Brian Barrett, Cassandra Versaggi, Robert Hendry, Bruce Jacob, Hyesoon Kim, Vitus J. Leung, Michael J. Levenhagen, Mitchelle Rasquinha, Rolf Riesen, Paul Rosenfeld, Maria del Carmen Ruiz Varela, Sudhakar Yalamanchili, (2012). Improvements to the Structural Simulation Toolkit SIMUTools 2012 https://www.osti.gov/search/identifier:1117760 Document ID: 5305668
Mingyu Hsieh, Michael J. Levenhagen, Kevin Pedretti, Arun F. Rodrigues, Jie Meng, Ayse Coskun, (2012). SST+gem5=A Scalable Simulation Infrastructure for High Performance Computing SIMUTools 2012 https://www.osti.gov/search/identifier:1068435 Document ID: 5305621
David R. Bronowski, Keren Bergman, David Bunde, Elliot Cooper-Balis, Kurt Brian Ferreira, Karl Scott Hemmert, Brian Barrett, Cassandra Versaggi, Robert Hendry, Bruce Jacob, Hyesoon Kim, Vitus J. Leung, Michael J. Levenhagen, Mitchelle Rasquinha, Rolf Riesen, Paul Rosenfeld, Maria del Carmen Ruiz Varela, Sudhakar Yalamanchili, (2012). Improvements to the Structural Simulation Toolkit SIMUTools 2012 https://www.osti.gov/search/identifier:1068327 Document ID: 5305276
Brian Barrett, Richard Frederick Barrett, James M. Brandt, Ronald B. Brightwell, Matthew Leon Curry, Nathan D. Fabian, Kurt Brian Ferreira, Ann C. Gentile, Karl Scott Hemmert, Suzanne M. Kelly, Ruth Ann Klundt, James H. Laros, Vitus J. Leung, Michael J. Levenhagen, Gerald Fredrick Lofstead, Kenneth D. Moreland, Ron A. Oldfield, Kevin Pedretti, Arun F. Rodrigues, David Thompson, Harry Lee Ward, John P. Vandyke, Courtenay T. Vaughan, Kyle Bruce Wheeler, Tom Tucker, (2012). Report of Experiments and Evidence for ASC L2 Milestone 4467 – Demonstration of a Legacy Applications Path to Exascale https://www.osti.gov/search/identifier:1039013 Document ID: 5305233
Brian Barrett, Richard Frederick Barrett, James M. Brandt, Ronald B. Brightwell, Matthew Leon Curry, Nathan D. Fabian, Kurt Brian Ferreira, Ann C. Gentile, Karl Scott Hemmert, Suzanne M. Kelly, Ruth Ann Klundt, James H. Laros, Vitus J. Leung, Michael J. Levenhagen, Gerald Fredrick Lofstead, Kenneth D. Moreland, Ron A. Oldfield, Kevin Pedretti, Arun F. Rodrigues, David Thompson, Harry Lee Ward, John P. Vandyke, Courtenay T. Vaughan, Kyle Bruce Wheeler, Tom Tucker, (2012). Demonstration of a Legacy Applications Path to Exascale – ASC L2 Milestone 4467 Presentation to L2 Milestone Review Panel https://www.osti.gov/search/identifier:1688616 Document ID: 5305236
Sue S. Collins, Suzanne M. Kelly, Michael J. Levenhagen, Kevin Pedretti, (2012). Investigating Methods of Supporting Dynamically Linked Executables on High Performance Computing Platforms https://www.osti.gov/search/identifier:1035350 Document ID: 5275073
Michael J. Levenhagen, (2011). Ground-Penetrating Radar Achieving Excellence in Facilities Mangement and Sustainability https://www.osti.gov/search/identifier:1143471 Document ID: 5298740
Kevin Pedretti, Michael J. Levenhagen, Ronald B. Brightwell, Trammell Hudson, Peter Dinda, Zheng Cui, Lei Xia, Patrick Bridges, Steven Jaconette, Patrick Widener, (2011). Palacios and Kitten: High Performance Operating Systems For Scalable Virtualized and Native Supercomputing Sc09 https://www.osti.gov/search/identifier:1142272 Document ID: 5271316
Karl Scott Hemmert, Brian Barrett, Ronald B. Brightwell, Michael J. Levenhagen, Keith D. Underwood, Jerrie Coffman, Roy Larsen, (2011). Enabling Flexible Collective Communication Offload with Triggered Operations IEEE Symposium on High-Performance Interconnects https://www.osti.gov/search/identifier:1109261 Document ID: 5294992
Kevin Pedretti, Michael J. Levenhagen, Kurt Brian Ferreira, Ronald B. Brightwell, Suzanne M. Kelly, Patrick G Bridges, Trammell Hudson, (2010). LDRD Final Report: A Lightweight Operating System for Multi-core Capability Class Supercomputers https://www.osti.gov/search/identifier:1007323 Document ID: 5286932
Kevin Pedretti, Michael J. Levenhagen, Ronald B. Brightwell, John Lange, Trammell Hudson, Peter Dinda, Zheng Cui, Lei Xia, Patrick Bridges, Steven Jaconette, Patrick Widener, (2010). Palacios and Kitten: High Performance Operating Systems For Scalable Virtualized and Native Supercomputing https://www.osti.gov/search/identifier:1028948 Document ID: 5276024
Karl Scott Hemmert, Ronald B. Brightwell, Michael J. Levenhagen, Keith D. Underwood, Jerrie Coffman, Roy Larsen, (2010). Enabling Flexible Collective Communication Offload with Triggered Operations IEEE Cluster 2010 https://www.osti.gov/search/identifier:988546 Document ID: 5280420
Kirk A. Rackow, Kevin Pedretti, Michael J. Levenhagen, Ronald B. Brightwell, (2008). Exploring Memory Management Strategies in Catamount Cray User Group Conference https://www.osti.gov/search/identifier:1143277 Document ID: 5262678
Kevin Pedretti, Suzanne M. Kelly, Michael J. Levenhagen, (2008). Summary of Multi-Core Hardware and Programming Model Investigations https://www.osti.gov/search/identifier:1028920 Document ID: 5262234
Mark A. Gonzales, Ronald B. Brightwell, Michael J. Levenhagen, (2007). Evaluating NIC Hardware Requirements to Achieve High Message Rate PGAS Support on Multi-Core Processors Sc 2007 https://www.osti.gov/search/identifier:908857 Document ID: 5251942
Ronald B. Brightwell, William Lawry, Michael J. Levenhagen, Arthur B. Maccabe, Rolf E. Riesen, (2002). A Performance Comparison of Myrinet Protocol Stacks Third LCI International Conference on Linux Clusters https://www.osti.gov/search/identifier:908857 Document ID: 4477400
Showing Results.
Awards & Recognition
2018
James H. Laros, Kevin Pedretti, Ryan Grant, Stephen Lecler Olivier, Michael J. Levenhagen, Harry Lee Ward, Andrew J Younge, Andrew J Younge, ,
R&D 100 Award - Power API, R&D 100,
November 16, 2018
James H. Laros, Kevin Pedretti, Ryan Grant, Stephen Lecler Olivier, Michael J. Levenhagen, Harry Lee Ward, Andrew J Younge, Andrew J Younge, , R&D 100 Special Recognition: Corporate Social Responsibility - Power API, R&D 100, November 16, 2018