Open Source Benchmark Software

Collectl is a light-weight performance monitoring tool capable of reporting interactively as well as logging to disk. It reports statistics on cpu, disk, infiniband, lustre, memory, network, nfs, process, quadrics, slabs and more in easy to read format.

The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available that provides an extensible framework for which new tests can be easily added. The Phoronix Test Suite is designed to effectively carry out both benchmarks in a clean, reproducible, and easy-to-use manner.

FurMark is an intensive benchmarking tool designed to evaluate the performance of graphics cards using fur rendering algorithms. This tool is particularly effective in generating high workloads that can significantly increase the temperature of the GPU, making it a useful utility for testing the stability and stress tolerance of graphics cards. By simulating demanding rendering tasks, FurMark serves as a comprehensive test for assessing the robustness and thermal performance of GPUs under extreme conditions. FurMark from Geeks3D is a free OpenGL benchmark tool for Windows that can also be used to check the stability of a graphics card thanks to a built-in stress test. FurMark rendering is designed to overheat the GPU making it a viral-like stability and stress test tool (also called GPU burner) for the graphics card.

The Synthetic Data Gym (SDGym) is a benchmarking framework for modeling and generating synthetic data. Measure performance and memory usage across different synthetic data modeling techniques – classical statistics, deep learning and more! The SDGym library integrates with the Synthetic Data Vault ecosystem. You can use any of its synthesizers, datasets or metrics for benchmarking. You also customize the process to include your own work. Select any of the publicly available datasets from the SDV project, or input your own data. Choose from any of the SDV synthesizers and baselines. Or write your own custom machine learning model. In addition to performance and memory usage, you can also measure synthetic data quality and privacy through a variety of metrics. Install SDGym using pip or conda. We recommend using a virtual environment to avoid conflicts with other software on your device.

In 2015, we converted cBench to open Collective Knowledge Format (CK) and moved it here: http://github.com/ctuning/ctuning-programs CK allows you to simplify compilation and execution of these benchmarks across multiple platforms (Windows, Linux, MacOS, Android ...). Collective Benchmark (cBench) is a collection/extension of open-source programs and multiple datasets to enable realistic benchmarking and research on program and architecture optimization.

Prime95 is a popular software tool used primarily for stress testing and benchmarking computer processors by running intense calculations based on the Mersenne prime search algorithm. This rigorous testing helps users gauge system stability and detect potential issues, particularly useful for overclockers, hardware testers, and enthusiasts aiming for optimal CPU performance.

A command-line benchmarking tool. Statistical analysis across multiple runs. Support for arbitrary shell commands. Constant feedback about the benchmark progress and current estimates. Warmup runs can be executed before the actual benchmark. Cache-clearing commands can be set up before each timing run. Statistical outlier detection to detect interference from other programs and caching effects. Export results to various formats: CSV, JSON, Markdown, AsciiDoc. Parameterized benchmarks (e.g. vary the number of threads). Cross-platform. Hyperfine will automatically determine the number of runs to perform for each command. By default, it will perform at least 10 benchmarking runs and measure for at least 3 seconds. For programs that perform a lot of disk I/O, the benchmarking results can be heavily influenced by disk caches and whether they are cold or warm. If you want to run the benchmark on a warm cache, you can use the -w/--warmup option.

Plow is an HTTP(S) benchmarking tool, written in Golang. It uses excellent fast HTTP instead of Go's default net/http due to its lightning-fast performance. Plow runs at specified connections (option -c) concurrently and real-time records summary statistics, histogram of execution time and calculates percentiles to display on Web UI and terminal. It can run for a set duration( option -d), for a fixed number of requests(option -n), or until Ctrl-C is interrupted. The implementation of real-time computing Histograms and Quantiles using stream-based algorithms inspired by Prometheus with low memory and CPU bounds. so it's almost no additional performance overhead for benchmarking.

HeavyLoad is a stress-testing tool by JAM Software that evaluates a computer’s performance by placing high loads on various system components, including CPU, GPU, RAM, and hard disk. It’s designed to test system stability under extreme conditions, useful for assessing reliability and identifying potential hardware bottlenecks or failures.

netstress is a client/server utility designed to stress & benchmark network activity of a given ethernet device or path using simulated (random) real world data and packet sizes instead of fixed data and packet sizes.

This benchmark suite is intend as a tool for the research community. It consists of a set of open source, real world applications with non-trivial memory loads.

Fast Fourier Transforms (FFT) for Multi-CPU (and RAM) Stress Testing. Shows detailed information about physical and logical processors in the system. Included CPU Benchmark feature for speed testing. Automatically utilizes and tests all CPU cores.

TRMSim-WSN (Trust and Reputation Models Simulator for Wireless Sensor Networks) is a Java-based simulator aimed to test Trust and Reputation models for WSNs. It provides several Trust and Reputation models and new ones can be easily added.

Hive Mind LOIC is a version of the Low Ordbit Ion Cannon made by Praetox, which was adapted for centralized control by NewEraCracker, when the project was then taken on by me. The amongst a few fixes I added RSS control (Such as via Twitter).

SLOCCount is an easy-to-use tool that counts Source Lines of Code (SLOC). It auto-determines the language(s) (inc. C, C++, Ada, Assembly, shell, COBOL, C#, Fortran, Haskell, Java, LISP/Scheme, Perl, PHP, Python, Ruby, SQL). It also estimates cost & time.

BEYE (Binary EYE) is a free, portable, advanced file viewer with built-in editor for binary, hexadecimal and disassembler modes. It contains a highlight AVR/Java/i86-AMD64/ARM-XScale/PPC-64 and other disassembler, full preview of MZ,NE,PE,ELF and other.

This is an insultingly simple project. It's just one file, existential.exe. It's 6 KB in size, has no dependencies or external libraries, and does absolutely nothing whatsoever. So if you need a dummy Windows executable, here ya go.

WebInject is a tool for automated testing of web applications and web services. It can be used to test system components with HTTP interfaces, as a test harness to create a suite of functional and regression tests, or for service-level monitoring.

Open System Testing Architecture - a distributed software testing architecture designed around CORBA. The current toolset has the capability of performing scripted Web (HTTP and HTTPS) heavy load tests with performance measurements from Win32 platforms.

Hammerhead is a web site coverage, HTTP load generator, HTTP benchmarking, and stress testing tool. It has been designed to emulate multiple users from multiple IP addresses at maximum speed (unlike it's interpreted counterparts).

A powerful C-written web application testing and load generating tool. It uses HTTP, FTP and TLS/SSL stacks, simulating tens of thousand users / clients each with own IP-address. The goal is to provide an alternative to Spirent Avalanche and Ixia IxLoad.

A vulnerable web application designed to help assessing the features, quality and accuracy of web application vulnerability scanners. This evaluation platform contains a collection of unique vulnerable web pages that can be used to test the various properties of web application scanners. Visit WAVSEP homepage to learn more: https://code.google.com/p/wavsep/ The project includes the following test cases: Path Traversal/LFI: 816 test cases (GET & POST) Remote File Inclusion (XSS via RFI): 108 test cases (GET & POST) Reflected XSS: 66 test cases, implemented in 64 jsp pages (GET & POST) Error Based SQL Injection: 80 test cases, implemented in 76 jsp pages (GET & POST) Blind SQL Injection: 46 test cases, implemented in 44 jsp pages (GET & POST) Time Based SQL Injection: 10 test cases, implemented in 10 jsp pages (GET & POST)

FBENCH is the throughput benchmark tool for measuring TCP and UDP performance between two systems. It also used as the networking stress tool. Originally it was developed as part of the FNET TCP/IP stack project.

This project aims to provide a common and convenient environment for evaluating C and C++ compilers' relative performances on some well-known benchmarks and applications.

This CPU Benchmark is written in .NET C# and use the Linpack and Whetstone algorithm.