Show HN: Benchi – A benchmarking tool written in Go

Summary

Benchi Benchi is a minimal benchmarking framework designed to help you measure the performance of your applications and infrastructure. It leverages Docker to create isolated environments for running benchmarks and collecting metrics. It was developed to simplify the process of setting up and running benchmarks for Conduit. Features Docker Integration : Define and manage your benchmarking environments using Docker Compose. : Define and manage your benchmarking environments using Docker Compose. Metrics Collection : Collect and export metrics in CSV format for further analysis. : Collect and export metrics in CSV format for further analysis. Custom Hooks : Define custom hooks to run commands at various stages of the benchmark. : Define custom hooks to run commands at various stages of the benchmark. Progress Monitoring: Real-time monitoring of container statuses and metrics during the benchmark run. Installation To install Benchi, download the latest release or install it using Go: go install github.com/conduitio/benchi/cmd/benchi@latest Alternatively, you can install just the Benchi binary on a Linux OS with: curl https://raw.githubusercontent.com/ConduitIO/benchi/main/install.sh | sh Usage Running Benchmarks Run benchi and point -config to a benchmark configuration file. The repository includes an example benchmark, which can be run using the following command: benchi -config ./example/bench-kafka-kafka/bench.yml Results Running the benchmark will store the results in a folder named after the current date and time inside of results (e.g. results/20060102_150405 ). You can adjust the output folder using the -out flag. The output folder will contain two files: benchi.log : Log file containing the full output of benchi. : Log file containing the full output of benchi. aggregated-results.csv : Aggregated metric results from all collectors and all tests. The results are aggregated using a trimmed mean, where the top and bottom 5% of the results are removed. Benchi also ...