News
Work on scaling AxoNN on Frontier featured in Nature news article
The group's work on using Frontier as part of the 2024 INCITE allocation, and scaling AxoNN on Frontier has been featured in a recent news article on nature.com.
Senior PhD student Daniel Nichols will receive the ACM-IEEE CS George Michael Memorial HPC Fellowship at SC 2024
Daniel Nichols was recently announced as a recipient of the 2024 ACM-IEEE CS George Michael Memorial HPC Fellowship. The award will be presented at the 2024 Supercomputing conference in Atlanta in November.
ISC '24 paper on HPC-Coder, an LLM for parallel code
Daniel Nichols presented his work on fine-tuning existing language models with HPC specific data to create HPC-Coder, a new LLM for parallel code. The full paper is available here.
Prof. Bhatele received the Illinois CS Early Career Academic Achievement Alumni Award
Prof. Bhatele was recently recognized by the Department of Computer Science at the University of Illinois with the 2024 Early Career Academic Achievement Alumni Award.
Prof. Bhatele received the IEEE TCSC Award for Excellence in Scalable Computing (Mid-Career)
Prof. Bhatele was recently honored by the IEEE Technical Committee on Scalable Computing with an Award for Excellence for Mid-Career Researchers.
Davis, Sivaraman, Minn, and Bhatele win the SC '23 Best Research Poster Award
PSSG students, Josh Davis, Pranav Sivaraman, and Isaac Minn received the Best Research Poster award for their work titled, "Evaluating Performance Portability of GPU Programming Models".
Bhatele, Goldstein, and Menon receive a 750k node-hour INCITE allocation award
Prof. Bhatele, Prof. Tom Goldstein, and Dr. Harshitha Menon have received a competitive INCITE allocation award from the Department of Energy for scaling distributed AI training, and democratizing AI by training large open-source models.
ICS '23 paper on Large-scale Mixture-of-Experts (MoE) Training
Siddharth Singh presented recent work on a hybrid tensor-expert-data parallel framework for training MoEs at ICS 2023. The full paper is available here.
PSSG presents tutorial on Distributed Deep Learning at ISC '23
Abhinav Bhatele and Siddharth Singh presented a tutorial on "Distributed Training of Deep Neural Networks" at ISC 2023 on Sunday (May 21, 2023).
Two paper presentations at IPDPS '23 by PSSG students
Siddharth Singh presented "Exploiting Sparsity in Pruned Neural Networks to Optimize Large Model Training" and Josh Davis presented "Porting a Computational Fluid Dynamics Code with AMR to Large-scale GPU Platforms" at IPDPS 2023.
Prof. Bhatele promoted to Associate Professor with tenure
Prof. Bhatele has been granted early tenure and promoted to the rank of Associate Professor, effective July 1, 2022.
Onur Cankur presents profiling tools comparison at ISC '22
Our paper on evaluation of call graph generation by profiling tools will be presented at ISC 2022. The full paper is available here.
Two IPDPS '22 papers to be presented by PSSG students
PSSG's Josh Davis awarded NSF GRFP
Josh Davis, a first year PhD student in our group, has been awarded the prestigious NSF Graduate Research Fellowship.
PSSG's Joy Kitson awarded DOE CSGF
Joy Kitson, a first year PhD student in our group, has been awarded the DOE Computational Science Graduate Fellowship. Read more.
Prof. Bhatele receives NSF CAREER award
Prof. Bhatele has received the NSF CAREER award to develop innovative methods for optimizing the performance of parallel applications and runtimes, and the operational efficiency of supercomputers and HPC clusters.
Cluster '20 Paper on Machine Learning for Tuning MPI Collective Performance
Our paper with Sascha Hunold (TU Wien) and others on using machine learning to predict MPI collective performance was presented at IEEE Cluster in September 2020.
ICS '20 Paper on Modeling GPU Performance
Our work with Jaemin Choi and Sanjay Kale (University of Illinois), and David Richards (LLNL) on modeling the end-to-end performance of GPU codes was presented virtually at ICS 2020. The full paper is available here.