Skip to content

Commit 3798860

Browse files
committed
Add paper
1 parent 5d32c6a commit 3798860

File tree

1 file changed

+18
-2
lines changed

1 file changed

+18
-2
lines changed

source/_data/SymbioticLab.bib

Lines changed: 18 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2065,5 +2065,21 @@ @InProceedings{venn:mlsys25
20652065
}
20662066
}
20672067
2068-
2069-
2068+
@article{mlenergy-benchmark:arxiv25,
2069+
title={The {ML.ENERGY} Benchmark: Toward Automated Inference Energy Measurement and Optimization},
2070+
author={Jae-Won Chung and Jiachen Liu and Jeff J. Ma and Ruofan Wu and Oh Jun Kweon and Yuxuan Xia and Zhiyu Wu and Mosharaf Chowdhury},
2071+
archiveprefix = {arXiv},
2072+
eprint= {2505.06371},
2073+
url= {https://arxiv.org/abs/2505.06371},
2074+
year={2025},
2075+
month={May},
2076+
publist_confkey = {arXiv:2505.06371},
2077+
publist_link = {paper || https://arxiv.org/abs/2505.06371},
2078+
publist_link = {code || https://github.com/ml-energy/leaderboard},
2079+
publist_link = {website || https://ml.energy/leaderboard},
2080+
publist_topic = {Energy-Efficient Systems},
2081+
publist_topic = {Systems + AI},
2082+
publist_abstract = {
2083+
As the adoption of Generative AI in real-world services grow explosively, \emph{energy} has emerged as a critical bottleneck resource. However, energy remains a metric that is often overlooked, under-explored, or poorly understood in the context of building ML systems. We present the ML.ENERGY Benchmark, a benchmark suite and tool for measuring inference energy consumption under realistic service environments, and the corresponding ML.ENERGY Leaderboard, which have served as a valuable resource for those hoping to understand and optimize the energy consumption of their generative AI services. In this paper, we explain four key design principles for benchmarking ML energy we have acquired over time, and then describe how they are implemented in the ML.ENERGY Benchmark. We then highlight results from the latest iteration of the benchmark, including energy measurements of 40 widely used model architectures across 6 different tasks, case studies of how ML design choices impact energy consumption, and how automated optimization recommendations can lead to significant (sometimes more than 40\%) energy savings without changing what is being computed by the model. The ML.ENERGY Benchmark is open-source and can be easily extended to various customized models and application scenarios.
2084+
}
2085+
}

0 commit comments

Comments
 (0)