CN110703987B - A method and system for improving virtual disk IO performance - Google Patents

Abstract

The invention discloses a method and a system for improving IO performance of a virtual disk, which comprises the following steps: s1, improving the kernel performance of a virtual host; s2, modifying default parameter configuration of a virtual machine management tool libvirt to enable the virtual machine to be compatible with two operating systems, namely windows and linux; s3, configuring an optional IO application type for the virtual machine user, and binding an IO model with the IO application type; and S4, configuring a virtualization system to automatically optimize different types of virtual machines. The system comprises: the system comprises a kernel performance improving module, a parameter modifying module, an IO application type providing module and a virtual machine optimizing module. According to the method and the system for improving the virtual disk IO performance, provided by the invention, the configuration parameters are automatically adjusted and optimized according to the unused service scene of the user, so that the IO performance of the virtual disk is optimal under the condition of fixing hardware equipment.

Description

A method and system for improving virtual disk IO performance

technical field

The invention belongs to the technical field of virtualization, and in particular relates to a method and a system for improving the IO performance of a virtual disk.

Background technique

IOPS, short for Input/Output Per Second, is the number of reads and writes per second.

With the advantages of reducing costs, improving operational efficiency, and accelerating the pace of enterprise innovation, virtualization technology is increasingly favored by users. Kernel Virtual Machine (KVM) virtualization has largely replaced Xen as the default open source solution for creating and supporting virtual machines (VMs) on most Linux systems. When enterprises migrate services to KVM virtualization, they usually focus on core computing elements such as processors and memory, but the IO performance of virtual disks also has a significant impact on the overall performance and responsiveness of virtual machines. At present, some virtualization systems have poor performance and slow response of virtual disks, which cannot meet the needs of users in different application scenarios. Currently, there is a lack of a method for automatically adjusting parameter settings according to different types of applications, so that a virtual disk can be optimized under a certain storage hardware configuration.

This is the deficiency of the prior art, therefore, it is very necessary to provide a method and system for improving the IO performance of a virtual disk in view of the above-mentioned defects in the prior art.

SUMMARY OF THE INVENTION

Aiming at the above-mentioned defect of the prior art that there is a lack of an automatic adjustment parameter setting according to different types of applications, so that the virtual disk can reach the optimal method under a certain storage hardware configuration, the present invention provides a method and system for improving the IO performance of a virtual disk, so as to Solve the above technical problems.

In a first aspect, the present invention provides a method for improving the IO performance of a virtual disk, comprising the following steps:

S1. Improve virtual host kernel performance;

S2. Modify the default parameter configuration of the virtual machine management tool libvirt, so that the virtual machine is compatible with both windows and linux operating systems;

S3. Configure an optional IO application type for the virtual machine user, and the IO application type is bound to the IO model;

S4. Configure the virtualization system to automatically optimize different types of virtual machines. Modify the default parameter configuration of the virtual machine management tool libvirt to implement general optimization items applicable to both Windows and Linux virtual machines; configure optional IO application types for virtual machine users, and provide IO application type options for users who are not familiar with storage. Smart optimization.

Further, in step S1, the performance of the virtual host kernel is improved by upgrading the virtual host kernel version. Set the virtualized system kernel to upgrade from the default kernel of CentOS7.3 to the default kernel of CentOS7.6. Through the kernel upgrade, the network packet processing delay can be reduced, and the read and write IOPS can be greatly improved.

Further, the specific steps of step S2 are as follows:

S21. Modify the xml configuration file of the virtual machine management tool Libvirt, and modify the default read-write cache mode of the virtual disk to cache=none;

S22. Modify the xml configuration file of the virtual machine management tool Libvirt, and add an io=native field to all virtual disk read-write cache modes. Modify the default read-write cache mode of virtual disks, and add IO local fields to all disks.

Further, the optional IO application types configured for the virtual machine user in step S3 include video streaming, large file copy, backup, online analytical processing, web file server, web server log, mail collaboration server, desktop cloud virtualization, online Interactive processing of data and workstations;

The IO model includes large-block sequential reads and writes and small-block random reads and writes. The system automatically corresponds to the "large block sequential read and write" or "small block random read and write" IO model according to the IO application type. The management interface can also illustrate two types of application types to help users choose.

Further, the specific steps of step S4 are as follows:

S41. Obtain the operating system type and application type of the virtual machine, and determine the operating system type of the virtual machine;

S42. If it is a Linux operating system, go to step S43;

If it is a windows operating system, add a hyperv field to the xml configuration file of the virtual machine management tool libvirt, and go to step S43;

S43. Determine and automatically set virtual disk parameter values according to the virtual disk IO application type, and call the underlying interface to configure the virtual machine. First determine the type of the virtual machine operating system. If it is a Linux system, no special treatment is required. If it is a Windows system, add the hyperv field to the xml configuration file of the libvirt layer virtual machine; Libvirt, an open source API for managing virtualization platforms, background Programs and management tools; determine the virtual disk IO application type, automatically set the optimal parameter values and call the underlying interface for configuration, so that the virtual disk performance is optimal.

Further, the specific steps of step S43 are as follows:

S431. Determine the virtual disk IO model;

S432. When the virtual disk IO model is large-block sequential read and write, the default cluster size and CPU L2 cache size settings of the virtualization system are used; enter step S434;

S433. When the virtual disk IO model is random read and write in small blocks, set the cluster size to 256K, set the CPU L2 cache size = virtual disk size * 8/cluster size, or obtain data from a custom interface to pair the cluster size and CPU 2 level cache size to set;

S434. Call the underlying interface to configure the virtual machine. If the disk I/O type is "large block sequential read and write", no special treatment is required. If it is "small block random read and write", set the CPU's second-level cache and cluster size. When the cluster size is adjusted to 256k, the performance of small-block random read and write is greatly improved, and the CPU's second-level cache size is set to = disk size *8/cluster size to recommend the best default value and configure it; at the same time, open the CPU L2 cache and cluster size parameter setting options, which can be set by experienced users.

In a second aspect, the present invention provides a system for improving IO performance of a virtual disk, comprising:

Kernel performance improvement module, used to improve virtual host kernel performance;

The parameter modification module is used to modify the default parameter configuration of the virtual machine management tool libvirt, so that the virtual machine is compatible with both windows and linux operating systems;

The IO application type provides a module for configuring optional IO application types for virtual machine users, and the IO application type is bound to the IO model;

The virtual machine optimization module is used to configure the virtualization system to automatically optimize different types of virtual machines.

Further, the parameter modification module includes:

The cache mode modification unit is used to modify the xml configuration file of the virtual machine management tool Libvirt, and modify the default read-write cache mode of the virtual disk to cache=none;

The disk file adjustment configuration unit is used to modify the xml configuration file of the virtual machine management tool Libvirt, and the io=native field is added to all virtual disk read-write cache modes.

Further, the virtual machine optimization module includes:

A virtual machine operating system type judging unit, used to obtain the operating system type and application type of the virtual machine, and determine the virtual machine operating system type;

The Windows operating system virtual machine configuration file changing unit is used to add the hyperv field to the xml configuration file of the virtual machine management tool libvirt in the Windows operating system;

The virtual disk parameter configuration unit determines and automatically sets the virtual disk parameter value according to the virtual disk IO application type, and calls the underlying interface to configure the virtual machine.

Further, the virtual disk parameter configuration unit includes:

The IO model judgment subunit is used to judge the virtual disk IO model;

Large block sequential read and write setting subunit, used to set the default cluster size and CPU L2 cache size of the virtualization system when the virtual disk IO model is large block sequential read and write;

Small block random read and write setting subunit, used to set the cluster size to 256K when the virtual disk IO model is small block random read and write, set the CPU L2 cache size = virtual disk size * 8/cluster size, or according to custom The interface obtains data to set the cluster size and the size of the CPU L2 cache;

The virtual machine configuration subunit is used to call the underlying interface to configure the virtual machine.

The beneficial effect of the present invention is that,

The method and system for improving virtual disk IO performance provided by the present invention automatically adjusts and optimizes configuration parameters according to different business scenarios of the user, so that the virtual disk IO performance is optimal in the case of fixed hardware devices.

In addition, the present invention has reliable design principle and simple structure, and has a very wide application prospect.

It can be seen that, compared with the prior art, the present invention has outstanding substantive features and significant progress, and the beneficial effects of its implementation are also obvious.

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. In other words, other drawings can also be obtained based on these drawings without creative labor.

Fig. 1 is method flow schematic diagram one of the present invention;

Fig. 2 is method flow schematic diagram two of the present invention;

Fig. 3 is the system schematic diagram of the present invention;

In the figure, 1-kernel performance improvement module; 2-parameter modification module; 2.1-cache mode modification unit; 2.2-disk file adjustment configuration unit; 3-IO application type providing module; 4-virtual machine optimization module; 4.1-virtual machine Operating system type judgment unit; 4.2-Windows operating system virtual machine configuration file modification unit; 4.3-Virtual disk parameter configuration unit; 4.3.1-IO model judgment subunit; .3- Small block random read and write setting sub-unit; 4.3.4- Virtual machine configuration sub-unit.

Detailed ways

In order to make those skilled in the art better understand the technical solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

Example 1:

As shown in Figure 1, the present invention provides a method for improving the IO performance of a virtual disk, comprising the following steps:

S1. Improve the performance of the virtual host kernel; improve the performance of the virtual host kernel by upgrading the virtual host kernel version, improve the virtual machine message processing delay, and greatly provide read and write IOPS; set the virtualized system kernel to upgrade from the default kernel of CentOS7.3 To CentOS7.6 version default kernel;

S2. Modify the default parameter configuration of the virtual machine management tool libvirt, so that the virtual machine is compatible with both windows and linux operating systems;

S3. Configure optional IO application types for virtual machine users, and IO application types are bound to IO models; optional IO application types configured for virtual machine users include video streaming, large file copy, backup, online analytical processing, web file server , web server log, mail collaboration server, desktop cloud virtualization, online interactive data processing and workstation; IO model includes large block sequential read and write and small block random read and write;

S4. Configure the virtualization system to automatically optimize different types of virtual machines. Storage virtualization integrates resources from multiple network storage devices into a resource pool, which is equivalent to a single storage device to the outside world, along with virtualized disk, block, tape systems and file systems. The host usually connects to the storage device through protocols such as iscsi, fc, and nfs. The network packet processing performance has a great impact on the performance of the virtual disk.

Example 2:

As shown in Figure 2, the present invention provides a method for improving the IO performance of a virtual disk, comprising the following steps:

S1. Improve the performance of the virtual host kernel; improve the virtual host kernel performance by upgrading the virtual host kernel version; set the virtualized system kernel to upgrade from the default kernel of CentOS7.3 version to the default kernel of CentOS7.6 version;

S2. Modify the default parameter configuration of the virtual machine management tool libvirt to make the virtual machine compatible with both Windows and Linux operating systems; the specific steps are as follows:

S21. Modify the xml configuration file of the virtual machine management tool Libvirt, and modify the default read-write cache mode of the virtual disk to cache=none;

S22. Modify the xml configuration file of the virtual machine management tool Libvirt, and add the io=native field to all virtual disk read-write cache modes;

S3. Configure optional IO application types for virtual machine users, and IO application types are bound to IO models; optional IO application types configured for virtual machine users include video streaming, large file copy, backup, online analytical processing, web file server , web server log, mail collaboration server, desktop cloud virtualization, online interactive data processing and workstation; the IO model includes large-block sequential read and write and small-block random read and write; the management interface can also give examples of the two types of applications, help User's choice; if the virtual disk IO application type is video streaming, data backup, etc., it is recommended to select the "large block sequential read and write" option. If it is a database, OLTP (Online Transaction Processing) virtual disk I/O application type, it is recommended to select the "small block random read and write" option;

S4. Configure the virtualization system to automatically optimize different types of virtual machines; the specific steps are as follows:

S41. Obtain the operating system type and application type of the virtual machine, and determine the operating system type of the virtual machine;

S42. If it is a Linux operating system, go to step S43;

If it is a windows operating system, add a hyperv field to the xml configuration file of the virtual machine management tool libvirt, and go to step S43;

S43. Determine and automatically set virtual disk parameter values according to the virtual disk IO application type, and call the underlying interface to configure the virtual machine; the specific steps are as follows:

S431. Determine the virtual disk IO model;

S432. When the virtual disk IO model is large-block sequential read and write, the default cluster size and CPU L2 cache size settings of the virtualization system are used; enter step S434;

S433. When the virtual disk IO model is random read and write in small blocks, set the cluster size to 256K, set the CPU L2 cache size = virtual disk size * 8/cluster size, or obtain data from a custom interface to pair the cluster size and CPU 2 level cache size to set;

S434. Call the underlying interface to configure the virtual machine.

Example 3:

As shown in FIG. 3, the present invention provides a system for improving virtual disk IO performance, including:

Kernel performance improvement module 1, used to improve the virtual host kernel performance;

The parameter modification module 2 is used to modify the default parameter configuration of the virtual machine management tool libvirt, so that the virtual machine is compatible with both Windows and Linux operating systems; the parameter modification module 2 includes:

The cache mode modification unit 2.1 is used to modify the xml configuration file of the virtual machine management tool Libvirt, and modify the default read and write cache mode of the virtual disk to cache=none;

Disk file adjustment configuration unit 2.2, used to modify the xml configuration file of the virtual machine management tool Libvirt, and add the io=native field to all virtual disk read-write cache modes;

The IO application type provides module 3, which is used to configure optional IO application types for virtual machine users, and the IO application type is bound to the IO model;

The virtual machine optimization module 4 is used to configure the virtualization system to automatically optimize different types of virtual machines; the virtual machine optimization module 4 includes:

The virtual machine operating system type judgment unit 4.1 is used to obtain the operating system type and application type of the virtual machine, and judge the virtual machine operating system type;

The Windows operating system virtual machine configuration file changing unit 4.2 is used to add the hyperv field to the xml configuration file of the virtual machine management tool libvirt in the Windows operating system;

The virtual disk parameter configuration unit 4.3 determines and automatically sets the virtual disk parameter value according to the virtual disk IO application type, and calls the underlying interface to configure the virtual machine; the virtual disk parameter configuration unit 4.3 includes:

The IO model judgment subunit 4.3.1 is used to judge the virtual disk IO model;

Sub-unit 4.3.2 of large block sequential read and write setting is used to set the default cluster size and CPU L2 cache size of the virtualization system when the virtual disk IO model is large block sequential read and write;

Small block random read and write setting sub-unit 4.3.3 is used to set the cluster size to 256K when the virtual disk IO model is small block random read and write, and set the CPU L2 cache size = virtual disk size * 8/cluster size, or Set the cluster size and CPU L2 cache size according to the data obtained from the custom interface;

The virtual machine configuration subunit 4.3.4 is used to call the underlying interface to configure the virtual machine.

Although the present invention has been described in detail in conjunction with the preferred embodiments with reference to the accompanying drawings, the present invention is not limited thereto. Without departing from the spirit and essence of the present invention, those of ordinary skill in the art can make various equivalent modifications or substitutions to the embodiments of the present invention, and these modifications or substitutions should all fall within the scope of the present invention/any Those skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (9)

1. a method for improving virtual disk IO performance, is characterized in that, comprises the steps: S1. Improve virtual host kernel performance; S2. Modify the default parameter configuration of the virtual machine management tool libvirt, so that the virtual machine is compatible with both windows and linux operating systems; S3. Configure an optional IO application type for the virtual machine user, and the IO application type is bound to the IO model; S4. Configure the virtualization system to automatically optimize different types of virtual machines; The optional IO application types configured for the virtual machine user in step S3 include video streaming, large file copy, backup, online analytical processing, web file server, web server log, mail collaboration server, desktop cloud virtualization, online interactive processing data and workstations; The IO model includes large-block sequential reads and writes and small-block random reads and writes. 2. The method for improving virtual disk IO performance according to claim 1, wherein in step S1, the virtual host kernel performance is improved by upgrading the virtual host kernel version. 3. the method for improving virtual disk IO performance as claimed in claim 1, is characterized in that, the concrete steps of step S2 are as follows: S21. Modify the xml configuration file of the virtual machine management tool Libvirt, and modify the default read and write cache mode of the virtual disk to cache=none; S22. Modify the xml configuration file of the virtual machine management tool Libvirt, and add the io=native field to all virtual disk read-write cache modes. 4. the method for improving virtual disk IO performance as claimed in claim 1 is characterized in that, the concrete steps of step S4 are as follows: S41. Obtain the operating system type and application type of the virtual machine, and determine the operating system type of the virtual machine; S42. If it is a Linux operating system, go to step S43; If it is a windows operating system, add a hyperv field to the xml configuration file of the virtual machine management tool libvirt, and go to step S43; S43. Determine and automatically set virtual disk parameter values according to the virtual disk IO application type, and call the underlying interface to configure the virtual machine. 5. the method for improving virtual disk IO performance as claimed in claim 4, is characterized in that, the concrete steps of step S43 are as follows: S431. Determine the virtual disk IO model; S432. When the virtual disk IO model is large-block sequential read and write, the default cluster size and CPU L2 cache size settings of the virtualization system are used; enter step S434; S433. When the virtual disk IO model is random read and write in small blocks, set the cluster size to 256K, set the CPU L2 cache size = virtual disk size * 8/cluster size, or obtain data from a custom interface to pair the cluster size and CPU 2 level cache size to set; S434. Call the underlying interface to configure the virtual machine. 6. A system for improving virtual disk IO performance is characterized in that, comprising The kernel performance improvement module (1) is used to improve the virtual host kernel performance; The parameter modification module (2) is used to modify the default parameter configuration of the virtual machine management tool libvirt, so that the virtual machine is compatible with both windows and linux operating systems; The IO application type providing module (3) is used to configure optional IO application types for virtual machine users, and the IO application types are bound to the IO model; the optional IO application types configured for virtual machine users include video streaming, large file copy, Backups, online analytical processing, web file servers, web server logs, mail collaboration servers, desktop cloud virtualization, online interactive processing of data, and workstations; The IO model includes large block sequential read and write and small block random read and write; The virtual machine optimization module (4) is used to configure the virtualization system to automatically optimize different types of virtual machines. 7. The system for improving virtual disk IO performance according to claim 6, wherein the parameter modification module (2) comprises: The cache mode modification unit (2.1) is used to modify the xml configuration file of the virtual machine management tool Libvirt, and modify the default read and write cache mode of the virtual disk to cache=none; The disk file adjustment hive (2.2) is used to modify the xml configuration file of the virtual machine management tool Libvirt, and add the io=native field to all virtual disk read and write cache modes. 8. The system for improving virtual disk IO performance according to claim 6, wherein the virtual machine optimization module (4) comprises: A virtual machine operating system type judging unit (4.1), used to obtain the operating system type and application type of the virtual machine, and determine the operating system type of the virtual machine; The Windows operating system virtual machine configuration file changing unit (4.2) is used to add the hyperv field to the xml configuration file of the virtual machine management tool libvirt in the Windows operating system; The virtual disk parameter configuration unit (4.3) determines and automatically sets the virtual disk parameter value according to the virtual disk IO application type, and calls the underlying interface to configure the virtual machine. 9. The system for improving virtual disk IO performance according to claim 6, wherein the virtual disk parameter configuration unit (4.3) comprises: The IO model judgment subunit (4.3.1) is used to judge the virtual disk IO model; Large block sequential read and write setting sub-unit (4.3.2) is used to set the default cluster size and CPU L2 cache size of the virtualization system when the virtual disk IO model is large block sequential read and write; Small block random read and write setting subunit (4.3.3), used to set the cluster size to 256K when the virtual disk IO model is small block random read and write, and set the CPU L2 cache size = virtual disk size * 8/cluster size , or set the cluster size and CPU L2 cache size according to the data obtained from the custom interface; The virtual machine configuration sub-unit (4.3.4) is used to call the underlying interface to configure the virtual machine.

Images