Operational Data Analytics

image
Modern HPC facilities generate vast, complex streams of operational data—covering everything from hardware performance metrics and job logs to environmental sensor readings. My research and engineering efforts in operational data analytics aims to transform these data torrents into actionable insights. I design and deploy scalable data pipelines capable of ingesting hundreds of gigabytes per day, integrating technologies such as Apache Kafka, Spark, and distributed databases to process and curate real-time and historical telemetry.

Building on these robust data foundations, I develop advanced analytics and visualization tools that help HPC operators detect anomalies, predict failures, and optimize resource usage. Whether it’s diagnosing GPU memory corruption at scale or pinpointing overcooling in data centers, the overarching goal is to enhance system reliability, efficiency, and user productivity. By bridging data engineering with domain knowledge, I help HPC sites adopt a proactive, data-centric approach to managing next-generation supercomputers.

Related Projects
ExaDigiT: Digital Twin for Exascale Supercomputers (2022 - Present)

Analytics and AI Methods at Scale Group (AAIMS), Oak Ridge National Laboratory, USA

Jul 1, 2022
GPU Memory Corruption Analysis (2021 - 2023)

Analytics and AI Methods at Scale Group (AAIMS), Oak Ridge National Laboratory, USA

Jun 1, 2021
Power & Energy Monitoring for Frontier (2021 – Present)

Analytics and AI Methods at Scale Group (AAIMS), Oak Ridge National Laboratory, USA

Jun 1, 2021
Long-Term Analysis of Summit’s Power & Thermal Dynamics (2020 – 2021)

Analytics and AI Methods at Scale Group (AAIMS), Oak Ridge National Laboratory, USA

Oct 1, 2020
Cooling Intelligence for Summit (2018 – 2024)

Technology Integration Group, Oak Ridge National Laboratory, USA

Jun 1, 2018
Related Talks and Events
The Past, Current, and Future of HPC ODA
The Past, Current, and Future of HPC ODA

The 6th ISC HPC International Workshop on “Monitoring & Operational Data Analytics”

Jun 13, 2025
Data Journey Towards Insights
Data Journey Towards Insights

The International Conference for High Performance Computing, Networking, Storage, and Analysis (SC24) - Birds of a Feather on Operational Data Analytics

Nov 20, 2024
Operational Data Analytics for HPC Energy Efficiency - The Cost of Staying Afloat
Operational Data Analytics for HPC Energy Efficiency - The Cost of Staying Afloat

2022 The International Conference for High Performance Computing, Networking, Storage, and Analysis (SC22) - Birds of a Feather on Operational Data Analytics

Nov 17, 2022