User:David.werecat/BFBench

BFBench is a benchmark suite for Brainfuck implementations by David Catt (user:David.werecat). It is written in Python and is thought to be cross-platform. The most recent version of the suite (version 1.4) can be downloaded here. This page gives a brief summary of the interpreters that were tested and the benchmarks which were run on them.

Benchmark Descriptions
BFBench currently runs a variety of benchmarks of different types against each interpreter. The benchmarks included in the most recent version are as follows:

Interpreter Descriptions
The benchmark was run on several optimizing and non-optimizing interpreters. The interpreters were compiled with TCC if their source code was provided. The interpreters benchmarked in the most recent version are as follows:

Benchmark Setup
These results have been obtained by David Catt (user:David.werecat) on a laptop with the following specs:
 * OS: Windows 7 (64-bit)
 * CPU: Intel Core i7-2670QM (2.20 GHz X 8 cores)
 * Memory: 8.00GB DDR3 (665.3 MHz dual channel)
 * Storage: 750GB HDD

Results Format
When the suite is run, it displays the results for all tests run against each interpreter on the console. The output format from the suite may be difficult to understand for the average person, they have been cleaned up and simplified. Each result is highlighted in a color which describes the outcome of the benchmark. The possible colors are as follows:

Note that any test in which the interpreter exited with an exit code other than zero is displayed in italics.

Results
The results of the benchmark are as follows (all times in seconds):

note: The interpreter "bffsree" produces extra output containing information about its code optimizations and the time taken to interpret the given input. This causes it to fail the output verification on all tests.

note: The interpreter "bffsree_ref" appends an extra newline to the end of the program output. This causes it to fail the output verification on all tests.

External resources

 * Version 1.3 of the suite
 * Version 1.4 of the suite