AutoBench: comparing the time performance of Haskell programs

HANDLEY, MARTIN; HUTTON, GRAHAM

Abstract

Two fundamental goals in programming are correctness (producing the right results) and efficiency (using as few resources as possible). Property-based testing tools such as QuickCheck provide a lightweight means to check the correctness of Haskell programs, but what about their efficiency? In this article, we show how QuickCheck can be combined with the Criterion benchmarking library to give a lightweight means to compare the time performance of Haskell programs. We present the design and implementation of the AutoBench system, demonstrate its utility with a number of case studies, and find that many QuickCheck correctness properties are also efficiency improvements.

Citation

HANDLEY, M., & HUTTON, G. (2018). AutoBench: comparing the time performance of Haskell programs. In Proceedings of the 11th ACM SIGPLAN Haskell Symposium (Haskell '18). , (26-37). https://doi.org/10.1145/3242744.3242749

• Conference Name: 11th ACM SIGPLAN International Symposium on Haskell
• Start Date: Sep 27, 2018
• End Date: Sep 28, 2018
• Acceptance Date: Aug 14, 2018
• Online Publication Date: Sep 17, 2018
• Publication Date: Sep 27, 2018
• Deposit Date: Aug 16, 2018
• Publicly Available Date: Nov 18, 2018
• Publisher: Association for Computing Machinery (ACM)
• Pages: 26-37
• Book Title: Proceedings of the 11th ACM SIGPLAN Haskell Symposium (Haskell '18)
• ISBN: 9781450358354
• DOI: https://doi.org/10.1145/3242744.3242749
• Keywords: Time performance; Optimisation; Benchmarking
• Public URL: https://nottingham-repository.worktribe.com/output/1035938
• Additional Information: Published in: Haskell 2018 Proceedings of the 11th ACM SIGPLAN International Symposium on Haskell. Pages 26-37 ; ; St. Louis, MO, USA — September 27 - 28, 2018 ; ACM New York, NY, USA ©2018 ; ISBN: 978-1-4503-5835-4 doi: 10.1145/3242744.3242749