The source for the initial benchmarks comes from: https://web.archive.org/web/20250124180056/https://gglabs.us/node/2293
Submitted by GG on Sat, 03/12/2022 - 01:11

GG, please contact me to discuss licensing issues regarding your benchmarks!

Since the original web page is no longer accessible, I am attempting to preserve the information and make the results reproducible and more accessible.

• Calypsi
• CC65
• KickC
• llvm-mos
• Oscar64
• sdcc
• vbcc

Documentation for Windows is coming, soon.

sudo dnf install make

Follow the documentation on: https://flathub.org/apps/net.sf.VICE

The benchmark for each compiler contains specific instructions to prepare the build for the tested compiler.

The compilers are usually installed into a subfolder to avoid problems with existing local installations.

• README.md for Calypsi
• README.md for CC65
• README.md for KickC
• README.md for llvm-mos
• README.md for Oscar64
• README.md for sdcc
• README.md for vbcc

Benchmarks can be built and executed using:

make -C benchmarks all

Run all benchmarks for a specific compiler:

make -C benchmarks all INCLUDE=cc65

The available keys are: calypsi, cc65, kickc, llvm, o64, sdcc, vbcc.

Run individual benchmarks by their name:

make -C benchmarks crc8

Available benchmarks are: aes256, crc8, crc16, crc32, dhrystone, fact, pi, pow, puff2, sieve, sieve-bit.

The reports consist of an interactive webpage built with Angular.

You need to install NodeJS and NPM.

sudo dnf install nodejs npm

Warning:
Execute the following commands in the reports directory!

Download and install all dependencies:

npm ci

Start the application using:

npm start

Warning:
Build and execute all benchmarks before aggregating the results!

To collect the results from all benchmarks, execute:

npm run aggregate

It will update the .json files in the reports/public directory.