Benchmark-Runner

What is it?

benchmark-runner is a containerized Python lightweight and flexible framework for running benchmark workloads on Kubernetes/OpenShift runtype kinds Pod, kata and VM.

This framework support the following embedded workloads:

• hammerdb: running hammerdb workload on the following databases: MSSQL, Mariadb, Postgresql in Pod, Kata or VM with Configuration

• stressng: running stressng workload in Pod, Kata or VM Configuration

• uperf: running uperf workload in Pod, Kata or VM with Configuration

• vdbench: running vdbench workload in Pod, Kata or VM with Configuration

• bootstorm: calculate VMs boot load time Configuration

Benchmark-runner grafana dashboard example:

Reference:

• The benchmark-runner package is located in PyPi

• The benchmark-runner container image is located in Quay.io

Run vdbench workload in Pod using OpenShift

Run vdbench workload in Pod using Kubernetes

• Run workload using Podman or Docker
• Grafana dashboards
• Inspect Prometheus Metrics
• Inspect Prometheus Snapshots
• How to add new custom workload to benchmark-runner ?
• Benchmark-runner: How to develop ?
• Add any new Python code
• Run Benchmark runner from terminal
• Add new workload, modify parameters to workload, or change parameters for any CI job
• Add new benchmark operator workload to benchmark runner
• Add workload to grafana dashboard
  • Data template
• Monitor and debug workload
• Determine the version of benchmark-runner in the current container image