VMmark: The Industry’s First Virtualization Benchmark
VMmark is a free tool that hardware vendors, virtualization software vendors and other organizations use to measure the performance and scalability of applications running in virtualized environments. This virtualization benchmark software features a novel tile-based scheme for measuring application performance and provides a consistent methodology that captures both the overall scalability and individual application performance
This release adds support for persistent memory, improves workload scalability, and better reflects secure customer environments by increasing side-channel vulnerability mitigation requirements.
Please note that VMmark 3.0 will end of life on March 15th, 2019.
VMmark 3: A Web-Scale Multi-Server Virtualization Platform Benchmark
The VMmark benchmark
- Allows accurate and reliable benchmarking of virtual data center performance and power consumption.
- Allows comparison of the performance and power consumption of different virtualization platforms.
- Can be used to determine the performance effects of changes in hardware, software, or configuration within the virtualization environment.
Why a Virtualization Platform Benchmark?
A cloud environment typically collects several diverse workloads onto a virtualization platform — a collection of physical servers accessing shared storage and network resources. Traditional single-workload performance and scalability benchmarks for non-virtualized environments were developed with neither virtual machines nor cloud environments in mind. Even single-server virtualization benchmarks did not fully capture the complexities of today’s virtualized data centers.
VMmark 1.x pioneered single-server virtualization benchmarking with its unique tile-based multi-application design. VMmark 2.xexpanded this to multiple servers and platform-level workloads. Applications have evolved since then, and VMmark 3 addresses these changes in application architecture and platform-level operations. More than ever before, users are running highly scalable workloads, often referred to as third platform applications, and increasingly complex OLTP workloads.
VMmark 3 features a highly automated setup and tile-cloning process that makes benchmark deployment fast and easy, with the need for very little manual intervention. VMmark 3 uses free or open-source software throughout, eliminating the need to purchase software licenses, and the VMmark .ova includes all the needed software in one downloadable template.
Getting Started With VMmark 3
To get started with VMmark, follow these steps:
- Download the VMmark template virtual machine
VMmark 3 uses a single template as the source for all virtual machines used in the benchmark. The template contains the VMmark 3 harness, the configuration files and all of the software needed to run VMmark.
Download VMmark 3.1.0
- Download the VMmark User’s GuideDeploy the template virtual machine
- Deploy the template into the virtualized infrastructure that you wish to test.
- Refer to the VMmark User’s Guide
Follow the instructions in the User’s Guide for directions on how to set up and run the benchmark.
- Carefully read the VMmark Run and Reporting Rules
The VMmark Run and Reporting Rules document outlines the requirements for producing a publishable VMmark result. To be published, or otherwise publicly disclosed, a VMmark result must adhere to the latest version of the Run and Reporting Rules.