Benchmarks

Last updated 24 May 2017.

We have graphed the performance of several implementations of the R7RS or R6RS on a set of R7RS/R6RS benchmarks collected by Will Clinger. These benchmarks include improved versions of most Gambit benchmarks (collected by Marc Feeley). The R6RS benchmarks also include new benchmarks that test some of the more important features that were introduced by the R6RS.

Please keep in mind that the results of benchmarking should not be taken too seriously.

R7RS Benchmarks

We have R7RS benchmark results for ten implementations of the R7RS:

R6RS Benchmarks

We have R6RS benchmark results for five implementations of the R6RS:

We tried to benchmark several other R7RS/R6RS systems but encountered errors while attempting to install them on our Linux machine or while attempting to run the benchmarks.

Explanation of Timings

The numbers shown give the elapsed time in seconds for a single run on an unloaded machine. The bar graphs show relative performance. Longer is better.

Where no timing is shown for a system, the system either took longer than an hour to run the benchmark or was unable to run the benchmark correctly. Most of the missing timings reflect bugs or implementation restrictions in the system that was unable to run the benchmark.