CN104156255B - A kind of virtual machine migration method, virtual machine (vm) migration device and source physical host - Google Patents

Abstract

Embodiments of the present invention provide a virtual machine migration method, a virtual machine migration device, and a source physical host, relate to the technical field of virtual machine migration, and reduce the downtime of a virtual machine on a target physical host, thereby improving the migration performance of the virtual machine. Including: after the virtual machine is migrated from the source physical host to the target physical host and resumes operation on the target physical host, the source physical host sends the memory pages to be synchronized of the virtual machine to the target physical host through the network interface using the first bandwidth; the source physical host Receive the page fault request sent by the target physical host through the network interface; the source physical host finds the missing memory page according to the information of the missing memory page contained in the page fault request, and sends the missing memory page to the target physical host through the network interface using the second bandwidth; The source physical host continues to send the memory page to be synchronized of the virtual machine to the target physical host by using the third bandwidth through the network interface.

Description

A virtual machine migration method, a virtual machine migration device, and a source physical host

technical field

The present invention relates to the technical field of virtual machine migration, in particular to a virtual machine migration method, a virtual machine migration device and a source physical host.

Background technique

Efficient and flexible resource management can be achieved by using virtualization technology, so it is widely used on cloud platforms. Virtual machine migration is an important field of virtualization technology, which is widely used in clusters, data centers and cloud platform systems, as well as shared hardware and file systems. The virtual machine migration technology can ensure that the running virtual machine is migrated from the currently running physical host to another physical host in an uninterrupted manner, thus realizing the flexible management of the virtual machine on the cloud platform and providing online maintenance for the cluster , resource dynamic scheduling, load balancing system and other operations provide technical support.

Virtual machine migration is the process of migrating a virtual machine from a source physical host to a target physical host. At present, the commonly used post-copy virtual machine migration technology mainly includes two stages:

In the first stage, the source physical host stops the operation of the virtual machine, and transmits key data of the virtual machine (such as CPU status information, device information, etc.) to the target physical host.

In the second stage, the migrated virtual machine is run on the target physical host. In this phase, two forms of memory page transfers are performed between the source physical host and the target physical host. One form is: the source physical host sends unsynchronized memory pages between the two to the target physical host through the network interface (this process is called: background active transfer); the other form is: running migration on the target physical host If there is a memory page fault (that is, the memory page that the virtual machine needs to use has not been sent from the source physical host to the target physical host), the virtual machine will stop, and the target physical host will issue a page fault to the source physical host. Request, the source physical host sends the memory page indicated by the page fault request to the target physical host through the network interface, and the virtual machine restarts after the target physical host receives the missing memory page.

Since the amount of data to be transferred during the background active transfer is large and the transfer time is long, the background active transfer often occupies more or all of the bandwidth between the source physical host and the target physical host. Bandwidth congestion will cause the target physical host to receive the missing memory page for a long time, and then the virtual machine on the target physical host will also take a long time to stop. One of the key indicators for measuring virtual machine migration is the downtime of the virtual machine. The longer the downtime, the worse the migration performance of the virtual machine.

Contents of the invention

Embodiments of the present invention provide a virtual machine migration method, a virtual machine migration device, and a source physical host. On the premise of ensuring that the total time of virtual machine migration is within a reasonable range, the downtime of the virtual machine on the target physical host is reduced, thereby improving the efficiency of the virtual machine. migration performance.

In order to achieve the above purpose, the technical solution adopted in the embodiment of the present invention is:

In the first aspect, a virtual machine migration method is disclosed, the method is applied to a source physical host, including:

After the virtual machine is migrated from the source physical host to the target physical host and resumes running on the target physical host, the source physical host sends the memory page of the virtual machine to be synchronized to the target physical host through the network interface using the first bandwidth; The memory page to be synchronized of the virtual machine is: a memory page stored in the source physical host and not sent to the target physical host during the virtual machine migration process;

The source physical host receives a page fault request sent by the target physical host through the network interface; the page fault request includes information about a missing memory page, and the missing memory page is a virtual machine migrated to the target physical host Afterwards, memory pages that are required but not sent from the source physical host to the target physical host after resuming operation;

The source physical host finds the missing memory page according to the information of the missing memory page included in the page fault request, and sends the missing memory page to the target physical host through the network interface using the second bandwidth ; The source physical host continues to send the memory page of the virtual machine to be synchronized to the target physical host by using the third bandwidth through the network interface, wherein the second bandwidth and the third bandwidth are both smaller than the first bandwidth.

In combination with the first aspect, in the first possible implementation of the first aspect,

The method also includes:

The source physical host determines a proportion of the second bandwidth in the first bandwidth according to a bandwidth adaptive allocation strategy to obtain the second bandwidth; determines a proportion of the third bandwidth in the first bandwidth, obtaining the third bandwidth;

Wherein, the bandwidth adaptive allocation strategy includes: a preset parameter M and a preset parameter N, the preset parameter M is the traffic used for sending missing memory pages in a pre-stated preset time period, and the preset parameter N The traffic used for sending the memory pages to be synchronized within the preset time period;

The sum of the second bandwidth and the third bandwidth is equal to the first bandwidth;

Or, the sum of the second bandwidth and the third bandwidth is greater than the first bandwidth;

Or, the sum of the second bandwidth and the third bandwidth is smaller than the first bandwidth.

With reference to the first possible implementation of the first aspect, in the second possible implementation of the first aspect, the source physical host determines according to the bandwidth adaptive allocation policy, the preset parameter M, and the preset parameter N The ratio of the second bandwidth in the first bandwidth to obtain the second bandwidth, and determining the ratio of the third bandwidth in the first bandwidth to obtain the third bandwidth specifically includes:

The source physical host determines that the ratio of the second bandwidth to the first bandwidth is Obtaining the second bandwidth, and determining the proportion of the third bandwidth in the first bandwidth is The third bandwidth is obtained.

In combination with the first aspect, in a third possible implementation of the first aspect,

The method also includes:

The source physical host finds the missing memory page according to the information of the missing memory page included in the page fault request, and sends the missing memory page to the target physical host through the network interface using the second bandwidth. After page, the source physical host sends the memory page of the virtual machine to be synchronized to the target physical host through the network interface using the current available bandwidth, the current available bandwidth is greater than or equal to the sum of the second bandwidth and the third bandwidth .

Combining the first aspect and the first to third possible implementations of the first aspect, in the fourth possible implementation of the first aspect,

Before the source physical host sends the memory page of the virtual machine to be synchronized to the target physical host by using the first bandwidth through the network interface, the method further includes:

The source physical host records the number of times or frequency values of each memory page being accessed when the virtual machine is running on the source physical host before migration;

Correspondingly, the sending by the source physical host of the memory pages of the virtual machine to be synchronized to the target physical host by using the first bandwidth through the network interface includes: the source physical host according to the number of times or frequency values of each memory page being accessed In descending order, the memory pages to be synchronized of the virtual machine are sequentially sent to the target physical host through the network interface using the first bandwidth.

In combination with the fourth possible implementation of the first aspect, in the fifth possible implementation of the first aspect,

The process of sending the memory pages to be synchronized of the virtual machine to the target physical host sequentially through the network interface using the first bandwidth according to the descending order of the number of times or frequency values of the memory pages accessed by the source physical host includes:

Each time the source physical host sends an unsynchronized first memory page of the virtual machine to the target physical host through the network interface using the first bandwidth, the second memory page before the address of the first memory page, the The third memory page following the address of the first memory page is sent to the target physical host together.

In combination with the first aspect, in the sixth possible implementation of the first aspect,

The virtual machine is migrated from the source physical host to the target physical host, and before resuming operation on the target physical host, the method further includes:

The source physical host stops the operation of the virtual machine, and sends key data of the virtual machine to the target physical host, so that the virtual machine resumes running on the target physical host; the key data of the virtual machine It includes the status information of the central processing unit CPU of the source physical host and the device information of the source physical host.

In a second aspect, a virtual machine migration device is disclosed, which is deployed on a source physical host, and the virtual machine migration device includes:

The background transmission module is used to send the memory page to be synchronized of the virtual machine to the target physical host by using the first bandwidth through the network interface; the memory page to be synchronized of the virtual machine is: stored in the source physical host, in the virtual machine Memory pages not sent to the target physical host during machine migration;

A page fault request receiving module, configured to receive a page fault request sent by the target physical host through the network interface; the page fault request includes information about a missing memory page, and the missing memory page is for the virtual machine to migrate to the After the target physical host, memory pages that are needed after recovery but not sent from the source physical host to the target physical host;

A remote paging module, configured to find the missing memory page according to the information of the missing memory page included in the page fault request, and send the missing memory page to the target physical host through the network interface using the second bandwidth. memory page; the background transmission module is further configured to continue to send the memory page of the virtual machine to be synchronized to the target physical host by using the third bandwidth through the network interface, wherein the second bandwidth and the third bandwidth are smaller than the first bandwidth.

In combination with the second aspect, in the first possible implementation of the second aspect,

The virtual machine migration device also includes: a bandwidth adaptive module,

The bandwidth adaptive module is configured to determine the proportion of the second bandwidth in the first bandwidth according to a bandwidth adaptive allocation strategy to obtain the second bandwidth; determine the proportion of the third bandwidth in the first bandwidth The ratio in the third bandwidth is obtained;

Wherein, the bandwidth adaptive allocation strategy includes: a preset parameter M and a preset parameter N, the preset parameter M is the traffic used for sending missing memory pages in a pre-stated preset time period, and the preset parameter N The traffic used for sending the memory pages to be synchronized within the preset time period;

The sum of the second bandwidth and the third bandwidth is equal to the first bandwidth;

Or, the sum of the second bandwidth and the third bandwidth is greater than the first bandwidth;

Or, the sum of the second bandwidth and the third bandwidth is smaller than the first bandwidth.

In combination with the first possible implementation of the second aspect, in the second possible implementation of the second aspect,

The bandwidth adaptive module is specifically configured to determine the proportion of the second bandwidth in the first bandwidth according to the bandwidth adaptive allocation strategy as Obtaining the second bandwidth, and determining the proportion of the third bandwidth in the first bandwidth is The third bandwidth is obtained.

In combination with the second aspect, in a third possible implementation of the second aspect,

The background transmission module is further configured to, after the remote paging module sends the missing memory page to the target physical host by using the second bandwidth through the network interface, send the missing memory page to the target physical host by using the currently available bandwidth through the network interface. The target physical host sends the memory page of the virtual machine to be synchronized, and the currently available bandwidth is greater than or equal to the sum of the second bandwidth and the third bandwidth.

Combining the second aspect and the first to third possible implementations of the second aspect, in the fourth possible implementation of the second aspect,

The background transmission module also includes:

The hot page recording submodule is configured to record that the virtual machine is running on the source physical host before the background transfer module uses the first bandwidth to send the memory page of the virtual machine to be synchronized to the target physical host through the network interface , the number or frequency value of each memory page being accessed;

The hot page prefetching submodule is configured to sequentially send the memory pages to be synchronized of the virtual machine to the target physical host through the network interface using the first bandwidth in descending order of the number of times or frequency values of each memory page being accessed.

In combination with the fourth possible implementation of the second aspect, in the fifth possible implementation of the second aspect,

The hot page prefetching submodule is specifically configured to, each time an unsynchronized first memory page of the virtual machine is sent to the target physical host through the network interface using the first bandwidth, set The second memory page and the third memory page following the address of the first memory page are sent to the target physical host together.

In combination with the second aspect, in a sixth possible implementation of the second aspect,

A virtual machine state management module, configured to stop the operation of the virtual machine;

A key information sending module, configured to send key data of the virtual machine to the target physical host, so that the virtual machine resumes running on the target physical host; the key data of the virtual machine includes the source physical host State information of the central processing unit CPU and device information of the source physical host.

In a third aspect, a source physical host is disclosed. The source physical host includes: a hardware layer; a virtual machine monitoring unit VMM running on the hardware layer; The virtual machine of the target physical host, wherein:

The VMM is configured to send the memory page to be synchronized of the virtual machine to the target physical host by using the first bandwidth through the network interface; the memory page to be synchronized of the virtual machine is: stored in the source physical host, in the virtual machine Memory pages not sent to the target physical host during machine migration;

Receive a page fault request sent by the target physical host through the network interface; the page fault request includes information about a missing memory page, and the missing memory page is after the virtual machine migrates to the target physical host and resumes operation memory pages that are required but not sent from the source physical host to the target physical host;

According to the information of the missing memory page included in the page fault request, find the missing memory page, and send the missing memory page to the target physical host through the network interface using the second bandwidth; the source physical host The host continues to send the memory page of the virtual machine to be synchronized to the target physical host by using the third bandwidth through the network interface, wherein both the second bandwidth and the third bandwidth are smaller than the first bandwidth.

In combination with the third aspect, in the first possible implementation of the third aspect,

The VMM is further configured to determine a proportion of the second bandwidth in the first bandwidth according to a bandwidth adaptive allocation strategy to obtain the second bandwidth; determine a proportion of the third bandwidth in the first bandwidth Ratio, to obtain the third bandwidth;

Wherein, the bandwidth adaptive allocation strategy includes: a preset parameter M and a preset parameter N, the preset parameter M is the traffic used for sending missing memory pages in a pre-stated preset time period, and the preset parameter N The traffic used for sending the memory pages to be synchronized within the preset time period;

The sum of the second bandwidth and the third bandwidth is equal to the first bandwidth;

Or, the sum of the second bandwidth and the third bandwidth is greater than the first bandwidth;

Or, the sum of the second bandwidth and the third bandwidth is smaller than the first bandwidth.

In combination with the first possible implementation of the third aspect, in the second possible implementation of the third aspect,

The VMM is specifically configured to determine the proportion of the second bandwidth in the first bandwidth according to the adaptive bandwidth allocation policy as Obtaining the second bandwidth, and determining the proportion of the third bandwidth in the first bandwidth is The third bandwidth is obtained.

In combination with the third aspect, in a third possible implementation of the third aspect,

The VMM is further configured to find the missing memory page according to the information of the missing memory page contained in the page fault request, and send the missing memory page to the target physical host through the network interface using the second bandwidth. After the memory page is missing, the source physical host sends the memory page of the virtual machine to be synchronized to the target physical host through the network interface using the current available bandwidth, the current available bandwidth is greater than or equal to the second bandwidth and the third bandwidth Sum.

Combining the third aspect and the first to third possible implementations of the third aspect, in the fourth possible implementation of the third aspect,

The VMM, before sending the memory page of the virtual machine to be synchronized to the target physical host by using the first bandwidth through the network interface, is also used to record when the virtual machine runs on the source physical host before migration, each memory page The number of times or frequency of page access; according to the descending order of the number of times or frequency of each memory page being accessed, the memory pages to be synchronized of the virtual machine are sequentially sent to the target physical host through the network interface using the first bandwidth.

In combination with the fourth possible implementation of the third aspect, in the fifth possible implementation of the third aspect,

The VMM, according to the descending order of the number of times or frequency values of each memory page being accessed, uses the first bandwidth through the network interface to sequentially send the memory pages of the virtual machine to be synchronized to the target physical host, specifically for Each time an unsynchronized first memory page of the virtual machine is sent to the target physical host through the network interface using the first bandwidth, the second memory page before the address of the first memory page, the second memory page after the address of the first memory page Send the third memory page to the target physical host together.

In combination with the third aspect, in the sixth possible implementation of the third aspect,

The VMM is further configured to stop the running of the virtual machine before the virtual machine is migrated from the source physical host to the target physical host and resumes running on the target physical host, and sends the virtual machine to the target physical host. The key data of the machine, so that the virtual machine resumes running on the target physical host; the key data of the virtual machine includes the state information of the central processing unit CPU of the source physical host, and the device information of the source physical host.

In the virtual machine migration method, virtual machine migration device, and source physical host provided by the embodiments of the present invention, the virtual machine is migrated from the source physical host to the target physical host, and after the target physical host resumes operation, the source physical host will transfer to the target physical host Transfer unsynchronized memory pages. In this process, using the solution provided by the embodiment of the present invention, once the virtual machine generates a page fault on the target physical host, the source physical host will use the second bandwidth to transmit the missing memory indicated by the page fault request after receiving the page fault request page, using the third bandwidth to continue transferring unsynchronized memory pages. In this way, on the one hand, the transmission of unsynchronized memory pages is not too much affected, so that the total time of virtual machine migration is within a reasonable range; The fast transfer from the host to the target physical host reduces the downtime of the virtual machine on the target physical host, thereby improving the migration efficiency of the virtual machine as a whole. Therefore, the embodiment of the present invention can overcome to a certain extent that the missing memory pages in the existing virtual machine migration method cannot be quickly transmitted to the target physical host due to bandwidth congestion, and thus make the virtual machine shut down and wait for a long time on the target physical host. The problem.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

Figure 1a is a schematic diagram of virtual machine migration provided by the implementation of the present invention;

Fig. 1b is a schematic flowchart of a virtual machine migration method provided by the implementation of the present invention;

FIG. 2 is a schematic flowchart of a virtual machine migration method provided in Embodiment 1 of the present invention;

FIG. 3 is a schematic flowchart of another virtual machine migration method provided by Embodiment 2 of the present invention;

FIG. 4a is a schematic diagram of a bandwidth adjustment method provided by Embodiment 2 of the present invention;

FIG. 4b is a schematic diagram of another bandwidth adjustment method provided by Embodiment 2 of the present invention;

FIG. 5 is a structural block diagram of a virtual machine migration device provided in Embodiment 3 of the present invention;

FIG. 6 is another structural block diagram of a virtual machine migration device provided in Embodiment 3 of the present invention;

FIG. 7 is another structural block diagram of a virtual machine migration device provided in Embodiment 3 of the present invention;

FIG. 8 is a structural block diagram of a source physical host provided by Embodiment 4 of the present invention.

detailed description

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

In order to facilitate understanding of the embodiments of the present invention, several elements that will be introduced in the description of the embodiments of the present invention are firstly introduced here.

Virtual machine: One or more virtual computers can be simulated on a physical computer through virtual machine software, and these virtual machines can work like real physical computers.

Hardware layer: the hardware platform on which the virtualization environment runs. Among them, the hardware layer can include a variety of hardware, such as CPU, memory, network card, memory and other high-speed/low-speed input/output (I/O, Input/Output) devices, and other devices with specific processing functions, such as input and output memory management Unit (Input/Output Memory Management Unit, referred to as: IOMMU), wherein the IOMMU can be used for the conversion of the physical address of the virtual machine and the physical address of the host (Host).

Host (Host): As a management layer, it is used to complete the management and allocation of hardware resources; present a virtual hardware platform for virtual machines, and realize the scheduling and isolation of virtual machines. The Host may be a virtual machine monitor (VMM). Wherein, the virtual hardware platform provides various hardware resources for each virtual machine running on it, such as virtual CPU, memory, virtual disk, virtual network card and so on. Wherein, the virtual machine runs on a virtual hardware platform prepared by the Host, and one or more virtual machines run on the Host.

As shown in Figure 1a, multiple virtual hosts 1-1, 1-2, 1-N are running on physical host 1, and multiple virtual machines 2-1, 1-N are running on physical host 2 · · · · 2-M. Wherein, the virtual machine 1-2 running on the physical host 1 will be migrated from the physical host 1 to the physical host 2. Generally, the physical host 1 is called the source physical host, and the physical host 2 is called the target physical host.

As shown in FIG. 1 b , it is a schematic diagram of an existing virtual machine post-copy migration process. The process is roughly as follows: First, the source physical host stops running the virtual machine to be migrated on it. Then, the key data of the virtual machine (such as CPU state information of the source physical host, device information of the source physical host, etc.) is transmitted to the target physical host through the network interface. Afterwards, the target physical host resumes the operation of the virtual machine on the target physical host according to the above key data. When the virtual machine runs on the target physical host, there will be a problem of missing memory pages (that is, the page fault processing shown in Figure 1b), at this time, memory pages need to be transferred between the source physical host and the target physical host. This transfer process is divided into two parts, the first part: the source physical host actively sends the memory pages (that is, unsynchronized memory pages) stored in its memory area by the virtual machine to the target physical host, this process is also called background active transmission. The second part: When the virtual machine encounters a missing memory page during the operation of the target physical host, it performs remote request paging. At this time, the virtual machine sends a page fault request to the source physical host through the target physical host. The page fault request may carry information about the missing memory page, such as address information. After receiving the page fault request, the source physical host finds the memory page required by the virtual machine according to the missing memory page information, sends the missing memory page to the target physical host, and the virtual machine resumes running after receiving the missing memory page.

Generally, since the amount of data to be transferred during the background active transfer is large and the transfer time is long, the background active transfer often occupies more or all of the bandwidth between the source physical host and the target physical host. The congestion of the bandwidth will cause the target physical host to receive the missing memory page indicated by the page fault request for a long time, and then the downtime of the virtual machine on the target physical host is also long. One of the key indicators to measure virtual machine migration is the downtime of the virtual machine, the longer the downtime, the worse the migration performance of the virtual machine; the other is the total time of virtual machine migration, the longer the total time, the better the migration performance of the virtual machine Difference.

The following embodiments of the present invention aim to reduce the downtime of the virtual machine and improve the migration performance of the virtual machine while ensuring that the total duration of virtual machine migration is within a reasonable range.

Example 1:

An embodiment of the present invention provides a method for migrating a virtual machine, which is applied to a source physical host. As shown in FIG. 2, the method includes the following steps:

101. After the virtual machine is migrated from the source physical host to the target physical host and resumes running on the target physical host, the source physical host sends the memory page of the virtual machine to be synchronized to the target physical host through the network interface using the first bandwidth; the virtual machine The memory pages to be synchronized are: the memory pages stored in the source physical host and not sent to the target physical host during the virtual machine migration process.

Preferably, the first bandwidth in this step may be all the bandwidth currently available for transferring memory pages to be synchronized between the source physical host and the target physical host. For example, a 100M bandwidth is currently all idle, and the 100M can be used to transfer memory pages to be synchronized, then the first bandwidth is the 100M bandwidth; if a 100M bandwidth is currently transmitting other data, 10M is currently transmitting, and 90M is free , can all be used to transmit memory pages to be synchronized, then the first bandwidth is the bandwidth of 90M.

102. The source physical host receives the page fault request sent by the target physical host through the network interface; the page fault request contains the information of the missing memory page, which is required but not available after the virtual machine is migrated to the target physical host and resumes operation. Memory pages sent from the source physical host to the target physical host.

Preferably, the information of the missing memory page included in the page fault request may be the address information of the missing memory page, and of course it may also be other information that can find the memory page, such as identification information of the missing memory page.

103. The source physical host finds the missing memory page according to the missing memory page information included in the page fault request, and sends the missing memory page to the target physical host through the network interface using the second bandwidth; the source physical host uses the third bandwidth through the network interface The bandwidth continues to send the memory page of the virtual machine to be synchronized to the target physical host, wherein both the second bandwidth and the third bandwidth are smaller than the first bandwidth.

Preferably, in this step, the source physical host uses the first bandwidth to transmit the memory page to be synchronized before sending the memory page indicated by the page fault request to the target physical host (ie background active transmission). After receiving the page fault request, when sending the memory page indicated by the page fault request to the target physical host, divide the entire bandwidth that can currently be used to transfer the memory page into the second bandwidth and the third bandwidth, and use the second bandwidth to transmit the fault page The memory page indicated by the request continues to be actively transferred in the background with the third bandwidth. For example, a bandwidth of 100M was used for background active transmission before, at this time, the memory page indicated by the page fault request can be transmitted with the second bandwidth of 50M (or other values), and the third bandwidth of 50M (or other values) to continue the background active transfer. Suppose a 100M bandwidth, 10M was transmitting other data before, and 90M was idle, and the 90M was used for active background transmission. At this time, other data has been transmitted and all 100M is available. At this time, the second bandwidth of 50M (also It can be other quantitative values) to transfer the memory page indicated by the page fault request, and use the third bandwidth of 50M (also can be other quantitative values) to continue the background active transmission.

In the virtual machine migration method provided by the embodiment of the present invention, the virtual machine is migrated from the source physical host to the target physical host, and after the virtual machine resumes operation on the target physical host, the source physical host will transfer unsynchronized memory pages to the target physical host. In this process, using the solution provided by the embodiment of the present invention, once the virtual machine generates a page fault on the target physical host, the source physical host will use the second bandwidth to transmit the missing memory indicated by the page fault request after receiving the page fault request page, using the third bandwidth to continue transferring unsynchronized memory pages. In this way, on the one hand, the transmission of unsynchronized memory pages is not too much affected, so that the total time of virtual machine migration is within a reasonable range; The fast transfer from the host to the target physical host reduces the downtime of the virtual machine on the target physical host, thereby improving the migration efficiency of the virtual machine as a whole. Therefore, the embodiment of the present invention can overcome to a certain extent that the missing memory pages in the existing virtual machine migration method cannot be quickly transmitted to the target physical host due to bandwidth congestion, and thus make the virtual machine shut down and wait for a long time on the target physical host. The problem.

Preferably, in a preferred embodiment of the present invention, the source physical host determines the proportion of the second bandwidth in the first bandwidth according to a bandwidth adaptive allocation policy to obtain the second bandwidth; determine the third The ratio of the bandwidth to the first bandwidth to obtain the third bandwidth.

Wherein, the bandwidth adaptive allocation strategy includes: a preset parameter M and a preset parameter N, the preset parameter M is the traffic used for sending missing memory pages in a pre-stated preset time period, and the preset parameter N The traffic used to send the memory page to be synchronized within the preset time period; the sum of the second bandwidth and the third bandwidth is equal to the first bandwidth; or, the second bandwidth and the third bandwidth The sum is greater than the first bandwidth; or, the sum of the second bandwidth and the third bandwidth is smaller than the first bandwidth.

Preferably, in a preferred embodiment of the present invention, the source physical host determines that the ratio of the second bandwidth to the first bandwidth is Obtain the second bandwidth, determine the proportion of the third bandwidth in the first bandwidth as The third bandwidth is obtained.

Preferably, in a preferred embodiment of the present invention, the source physical host finds the missing memory page according to the information of the missing memory page contained in the page fault request, and sends the missing memory page to the target physical host through the network interface using the second bandwidth , the source physical host sends the memory page to be synchronized of the virtual machine to the target physical host by using the currently available bandwidth through the network interface.

Here, assume a 100M bandwidth, of which 50M (that is, the second bandwidth) is used to transmit the memory page indicated by the missing memory page, and the other 50M (that is, the third bandwidth) is used to transmit the unsynchronized memory page. After the missing memory page, if the 100M bandwidth is used by the transferable memory page and there is no other data to be transferred, the source physical host resumes using 100M to transfer the unsynchronized memory page (that is, background active transfer). It should be noted that at this time, the 100M bandwidth may be the previously identified first bandwidth, or it may no longer be the original first bandwidth according to the current actual situation.

Preferably, in a preferred embodiment of the present invention, before 101, the source physical host sends the memory page of the virtual machine to be synchronized to the target physical host through the network interface using the first bandwidth, the method further includes:

The source physical host records the number of times or frequency values of each memory page accessed when the virtual machine was running on the source physical host before migration. The source physical host sends the memory pages to be synchronized of the virtual machine to the target physical host sequentially through the network interface using the first bandwidth in descending order of the number of times or frequency values of each memory page being accessed. In this way, the most commonly used memory pages can be sent to the target physical host in priority through the descending order of the number of access times or frequency values, thereby reducing the probability of virtual machine page faults on the target physical host, thereby reducing the downtime of the virtual machine .

Preferably, in a preferred embodiment of the present invention, the source physical host sends the memory pages of the virtual machine to be synchronized to the target physical host sequentially through the network interface using the first bandwidth in descending order of the number of times or frequency values of each memory page accessed. During the process, each time an unsynchronized first memory page of the virtual machine is sent to the target physical host through the network interface using the first bandwidth, the second memory page before the address of the first memory page, the address of the first memory page The subsequent third memory page is sent to the target physical host together. In this way, the most commonly used memory pages can also be preferentially sent to the target physical host, thereby reducing the probability of a page fault in the virtual machine on the target physical host, thereby reducing the downtime of the virtual machine.

Preferably, in a preferred embodiment of the present invention, in step 101, the virtual machine is migrated from the source physical host to the target physical host, and before resuming operation on the target physical host, it also includes: the source physical host stops the running of the virtual machine, and transfers to the target The physical host sends the key data of the virtual machine so that the virtual machine can resume operation on the target physical host; the key data of the virtual machine includes CPU status information of the source physical host, device information of the source physical host, and the like.

Example 2:

An embodiment of the present invention provides a method for migrating a virtual machine, which is described by taking post-copy migration of a virtual machine as an example. As shown in Figure 3, the method includes the following steps:

201. The source physical host records the times or frequency values of each memory page of the virtual machine being accessed when the virtual machine to be migrated runs on the source physical host.

Preferably, in this step, a bitmap (bitmap) counter may be used to record the number of accesses or the frequency value of the memory page of the virtual machine. The larger the value of a memory page recorded in the bitmap counter, it means that the memory page is accessed more times or the frequency value is high. Correspondingly, the smaller the value of a memory page recorded in the bitmap counter, it means that the memory page The page is accessed less often or has a lower frequency value.

Table 1

Table 1 shows the bitmap counter value of each memory page before the virtual machine runs on the source physical host, and the initial test is "0".

Table 2

memory page address index bitmap counter value memory page 1 3 memory page 2 5 memory page 3 1 memory page 4 6 memory page 5 18 memory page 6 twenty three memory page 7 11 memory page 8 6 memory page 9 9 memory page 10 16

Table 2 shows the values of each memory page recorded by the bitmap counter after the virtual machine is running.

Further, the values of each memory page recorded by the bitmap counter can be sorted in descending order, as shown in Table 3.

table 3

memory page address index bitmap counter value memory page 6 twenty three memory page 5 18 memory page 10 16 memory page 7 11 memory page 9 9 memory page 4 6 memory page 8 6 memory page 2 5 memory page 1 3 memory page 3 1

Memory pages that have been accessed frequently or with high frequency values have a higher priority after being sorted in descending order, and can be limitedly transmitted in the subsequent process, so that the probability of page faults in the migrated virtual machine can be reduced, and the Downtime.

202. The source physical host stops the operation of the virtual machine to be migrated, and sends key data of the virtual machine to the target physical host, so that the virtual machine resumes running on the target physical host. The key data of the virtual machine may include CPU status information of the source physical host, device information of the source physical host, and the like.

It should be noted here that, at this time, the memory pages have not been transferred from the source physical host to the target physical host, so the virtual machine resumed by the target physical host does not yet have all the functions of the virtual machine.

203. The source physical host sends the memory page to be synchronized of the virtual machine to the target physical host by using the first bandwidth through the network interface. The memory page to be synchronized of the virtual machine is: a memory page stored in the source physical host and not sent to the target physical host during the virtual machine migration process. This process is also known as background active transfer.

In this embodiment, assuming that the bandwidth between the source physical host and the target physical host is 100M, and the 100M is idle at this time, and can be used to transfer memory pages, then the source physical host identifies the 100M bandwidth as the first bandwidth, Perform background active transfers. As shown in Figure 4a.

Preferably, in step 201, the exemplary bitmap counter records the number of times or frequency values of each memory page being accessed, and the sequence shown in Table 3 is obtained through descending sorting. Then in this step, the source physical host can send to the target physical host in the order of memory page 6, memory page 5, memory page 10...memory page 3 according to the order in Table 3.

Further, each time when the source physical host sends an unsynchronized first memory page of the virtual machine to the target physical host through the network interface using the first bandwidth, the second memory page before the first memory page address, the second The third memory page following the memory page address is sent to the target physical host together. Still taking Table 3 as an example, when the source physical host transfers memory page 8 to the target physical host, memory page 4 before the address of memory page 8 and memory page 2 after the address of memory page 8 will be transferred to the target physical host together.

204. A page fault occurs when the virtual machine runs on the target physical host, and the virtual machine sends a page fault request to the source physical host through the target physical host. Wherein, the page fault request may include the address information of the missing memory page, the missing memory page is required after the virtual machine is migrated to the target physical host, but is not sent from the source physical host to the target physical host after resuming operation memory pages.

For example, when the virtual machine runs on the target physical host, it needs to use memory page 100, but at this time the memory page 100 has not been transferred from the source physical host to the target physical host, then the target physical host generates the address "XXXXXXXX" containing the memory page 100 The page fault request is sent to the source physical host.

205. After receiving the page fault request sent by the target physical host, the source physical host finds the missing memory page according to the address information of the missing memory page contained in the page fault request, and sends it to the target physical host through the network interface using the second bandwidth A memory page is missing: the source physical host sends the memory page of the virtual machine to be synchronized to the target physical host by using the third bandwidth through the network interface.

Specifically, the source physical host determines the proportion of the second bandwidth in the first bandwidth according to the adaptive bandwidth allocation policy to obtain the second bandwidth; and determines the proportion of the third bandwidth in the first bandwidth , to obtain the third bandwidth.

Wherein, the adaptive bandwidth allocation strategy includes: a preset parameter M and a preset parameter N, the preset parameter M is the traffic used for sending missing memory pages within a pre-stated preset time period, and the preset parameter N is the preset time The traffic used to send memory pages to be synchronized within the segment. In addition, the relationship among the first bandwidth, the second bandwidth, and the third bandwidth includes the following situations: the sum of the second bandwidth and the third bandwidth is equal to the first bandwidth, or the second bandwidth and the The sum of the third bandwidths is greater than the first bandwidth. Or, the sum of the second bandwidth and the third bandwidth is smaller than the first bandwidth.

In implementation, after receiving the page fault request sent by the target physical host, the source physical host finds the memory page 100 according to the address information "XXXXXXXX". Divide the bandwidth currently used for background active transmission into the second bandwidth and the third bandwidth. For example, if there is currently 100M of bandwidth used for background active transmission, then 50M of the 100M bandwidth (that is, the second bandwidth) can be used to transfer memory Page 100, and another 50M (that is, the third bandwidth) is used to continue background active transmission, and transmit unsynchronized memory pages. As shown in Figure 4b.

Preferably, the sum of the second bandwidth and the third bandwidth may be equal to the first bandwidth. That is to say, the first bandwidth is actively transferring in the background from the very beginning, and the value of the first bandwidth has never changed. At this time, the first bandwidth can be divided into the second bandwidth of transferring the memory page indicated by the page fault request and continuing Third bandwidth for background active transfers.

Further, the ratio of the second bandwidth to the third bandwidth may be: the source physical host takes the ratio of the first bandwidth Determined as the second bandwidth, the first bandwidth's It is determined as the third bandwidth; wherein, M is the traffic used to send the missing memory page within a certain period of pre-statistics, and N is the traffic used to send the memory page to be synchronized within the period.

So far, it can be seen that if the bandwidth is not adjusted, the background transmission will occupy the entire network bandwidth, and the page fault requests generated during this period will not be resolved in time, and the running virtual machines will be suspended, waiting for missing pages. Pages are transferred from the source physical host. It will cause the virtual machine on the target physical host to stop and wait longer. If all the first bandwidth is used to transfer the missing page to the target physical host in order to meet the page fault requirement in time, the background active transfer will be limited, resulting in a longer total migration time. Therefore, reasonably allocating bandwidth to handle the page fault request of the target physical host while the source physical host transmits the memory pages to be synchronized can well solve the above problems.

206. After the source physical host sends the missing memory page to the target physical host through the network interface using the second bandwidth, the source physical host continues to send the memory page to be synchronized of the virtual machine to the target physical host through the network interface using the currently available bandwidth.

Wherein, the currently available bandwidth is greater than or equal to the sum of the second bandwidth and the third bandwidth.

For example, a bandwidth of 100M is used for background active transmission in step 203. In step 205, the memory page 100 indicated by the page fault request is transmitted with the second bandwidth of 50M, and background active transmission is continued with the third bandwidth of 50M. In this step, after the transfer of the memory page 100 is completed, the currently available bandwidth is reused for background active transfer. For example, if the 50M bandwidth has no other use after the memory page 100 is transferred, it can also be used for background transfer, and 100M bandwidth will be used for background active transfer at this time. If the 50M bandwidth transfers the memory page 100, 10M is used for other data transmission, then the remaining 40M can be used for background transmission, and 90M bandwidth will be used for background active transmission. It can be seen that, in this step, the bandwidth used for background active transmission again may be equal to or different from the original first bandwidth, which depends on the current transmission situation.

In the virtual machine migration method provided by the embodiment of the present invention, the virtual machine is migrated from the source physical host to the target physical host, and after the virtual machine resumes operation on the target physical host, the source physical host will transfer unsynchronized memory pages to the target physical host. In this process, using the solution provided by the embodiment of the present invention, once the virtual machine generates a page fault on the target physical host, the source physical host will use the second bandwidth to transmit the missing memory indicated by the page fault request after receiving the page fault request page, using the third bandwidth to continue transferring unsynchronized memory pages. In this way, on the one hand, the transmission of unsynchronized memory pages is not too much affected, so that the total time of virtual machine migration is within a reasonable range; The fast transfer from the host to the target physical host reduces the downtime of the virtual machine on the target physical host, thereby improving the migration efficiency of the virtual machine as a whole.

In addition, due to the statistics and sorting of the memory pages being accessed in advance, the commonly used memory pages are given a higher transmission priority, so it can be guaranteed that the commonly used memory pages are preferentially transmitted to the target physical host for use by the virtual machine, and then It reduces the probability of page faults in virtual machines, and also plays a role in reducing downtime and total migration time.

It is explained here that the virtual machine migration method provided by the embodiment of the present invention is not only suitable for post-copy migration, but also suitable for hybrid copy migration, which is not limited again. It can also be considered that the virtual machine migration method provided by the embodiment of the present invention is applicable to any remote paging (the process of transferring missing memory pages from the source physical host to the target physical host) and background active transfer (the source physical host actively transfers two memory pages to the target physical host). The process of unsynchronized memory pages between the two) data transfer scenarios that exist at the same time.

Example 3:

The embodiment of the present invention provides a virtual machine migration device 3, which is deployed on the source physical host, and can be applied to the above method embodiments to execute corresponding steps in the method embodiments. As shown in Figure 5, the virtual machine migration device 3 includes:

The background transmission module 301 is configured to send the memory page to be synchronized of the virtual machine to the target physical host by using the first bandwidth determined by the bandwidth adaptive module 304 through the network interface; the memory page to be synchronized of the virtual machine is: stored in the source physical host , memory pages that were not sent to the target physical host during virtual machine migration.

The page fault request receiving module 302 is configured to receive a page fault request sent by the target physical host through a network interface; the page fault request includes information about a missing memory page, and the missing memory page is for the virtual machine to resume operation after migrating to the target physical host Memory pages that are later needed but not sent from the source physical host to the target physical host.

The remote paging module 303 is configured to find the missing memory page according to the information of the missing memory page included in the page fault request, and send the missing memory page to the target physical host through the network interface using the second bandwidth determined by the bandwidth adaptive module 304; The background transmission module 301 is further configured to send the memory page of the virtual machine to be synchronized to the target physical host by using the third bandwidth determined by the bandwidth adaptation module 304 through the network interface. Wherein, both the second bandwidth and the third bandwidth are smaller than the first bandwidth.

In this embodiment, the background transmission module 301 , the remote paging module 303 and the bandwidth adaptive module 304 may constitute the virtual machine page fault management module 30 of the virtual machine migration apparatus 3 .

After the virtual machine is migrated from the source physical host to the target physical host and resumes running on the target physical host, the source physical host will transfer unsynchronized memory pages to the target physical host. In this process, using the virtual machine migration device provided by the embodiment of the present invention, once the virtual machine generates a page fault on the target physical host, the virtual machine migration device will use the second bandwidth to transmit the page fault request after receiving the page fault request The indicated missing memory page continues to transfer the unsynchronized memory page with the third bandwidth. In this way, on the one hand, the transmission of unsynchronized memory pages is not too much affected, so that the total time of virtual machine migration is within a reasonable range; The fast transfer from the host to the target physical host reduces the downtime of the virtual machine on the target physical host, thereby improving the migration efficiency of the virtual machine as a whole.

Preferably, the bandwidth adaptive module 304 is configured to determine the proportion of the second bandwidth in the first bandwidth according to a bandwidth adaptive allocation strategy to obtain the second bandwidth; determine the ratio of the third bandwidth in the first bandwidth; The ratio of the first bandwidth to the third bandwidth is obtained.

Wherein, the adaptive bandwidth allocation strategy includes: a preset parameter M and a preset parameter N, the preset parameter M is the traffic used for sending missing memory pages within a pre-stated preset time period, and the preset parameter N is the preset parameter N. The traffic used to send the memory page to be synchronized within the time period; the relationship between the first bandwidth, the second bandwidth, and the third bandwidth includes the following situations: the sum of the second bandwidth and the third bandwidth is equal to the first bandwidth a bandwidth. Or, the sum of the second bandwidth and the third bandwidth is greater than the first bandwidth. Or, the sum of the second bandwidth and the third bandwidth is smaller than the first bandwidth.

Preferably, the bandwidth adaptation module 304 is specifically configured to determine the proportion of the second bandwidth in the first bandwidth according to the bandwidth adaptive allocation strategy as Obtain the second bandwidth, determine the proportion of the third bandwidth in the first bandwidth as The third bandwidth is obtained.

Preferably, the background transmission module 301 is further configured to, after the remote paging module 303 sends the missing memory page to the target physical host through the network interface using the second bandwidth, continue sending the missing memory page to the target physical host through the network interface using the currently available bandwidth. The memory pages of the virtual machine to be synchronized. The current available bandwidth is greater than or equal to the sum of the second bandwidth and the third bandwidth.

Preferably, as shown in Figure 6, the background transmission module 301 also includes:

The hot page recording sub-module 3011 is configured to record the memory pages of each memory page when the virtual machine is running on the source physical host before the background transfer module 301 sends the memory pages to be synchronized of the virtual machine to the target physical host through the network interface using the first bandwidth. The number of visits or frequency value.

The hot page prefetch sub-module 3012 is configured to sequentially send the memory pages to be synchronized of the virtual machine to the target physical host through the network interface using the first bandwidth in descending order of the number of times or frequency values of each memory page being accessed.

Here, memory pages with high access times or high frequency values are arranged in descending order with higher priority, and can be limitedly transmitted in the subsequent process, so that the chance of page faults in the migrated virtual machine can be reduced. probability and reduce downtime.

Preferably, the hot page prefetch sub-module 3012 is specifically configured to, each time an unsynchronized first memory page of the virtual machine is sent to the target physical host through the network interface using the first bandwidth, The second memory page and the third memory page following the address of the first memory page are sent to the target physical host together.

Preferably, as shown in FIG. 7, the virtual machine migration device 3 further includes:

The virtual machine status management module 305 is configured to stop the running of the virtual machine.

The key information sending module 306 is used to send the key data of the virtual machine to the target physical host, so that the virtual machine resumes operation on the target physical host; the key data of the virtual machine includes the state information of the CPU of the source physical host, the status information of the source physical host Device information, etc.

Example 4:

The embodiments of the present invention provide a source physical host 4, which can be applied to the above method embodiments, and perform corresponding operations in the method embodiments. As shown in Figure 8, the source physical host 4 includes:

A hardware layer 40, which generally includes a CPU, a memory, a network card, and the like.

The virtual machine monitoring unit VMM401 running on the hardware layer 40 is used to send the memory page to be synchronized of the virtual machine to the target physical host by using the first bandwidth through the network interface; the memory page to be synchronized of the virtual machine is: stored in the source In the physical host, memory pages that are not sent to the target physical host during the virtual machine migration process.

Receive the page fault request sent by the target physical host through the network interface; the page fault request contains the information of the missing memory page, and the missing memory page is required after the virtual machine is migrated to the target physical host, but is not transferred from the source physical host Memory pages sent to the target physical host.

Find the missing memory page according to the missing memory page information contained in the page fault request, and send the missing memory page to the target physical host through the network interface using the second bandwidth; the source physical host sends the missing memory page to the target physical host through the network interface using the third bandwidth The memory page of the virtual machine to be synchronized. Wherein, both the second bandwidth and the third bandwidth are smaller than the first bandwidth.

In addition, the source physical host 4 further includes: at least one virtual machine 41 that is migrated from the source physical host to the target physical host and run under the control of the VMM 401 .

After the virtual machine is migrated from the source physical host to the target physical host and resumes running on the target physical host, the source physical host will transfer unsynchronized memory pages to the target physical host. In this process, using the source physical host provided by the embodiment of the present invention, once the virtual machine generates a page fault on the target physical host, the source physical host will use the second bandwidth to transmit the page fault indicated by the page fault request after receiving the page fault request. Missing memory pages, continue to transfer unsynchronized memory pages with the third bandwidth. In this way, on the one hand, the transmission of unsynchronized memory pages is not too much affected, so that the total time of virtual machine migration is within a reasonable range; The fast transfer from the host to the target physical host reduces the downtime of the virtual machine on the target physical host, thereby improving the migration efficiency of the virtual machine as a whole.

Preferably, the VMM401 is further configured to determine the proportion of the second bandwidth in the first bandwidth according to the adaptive bandwidth allocation strategy to obtain the second bandwidth; determine the proportion of the third bandwidth in the first bandwidth bandwidth in proportion to obtain the third bandwidth.

Wherein, the bandwidth adaptive allocation strategy includes: a preset parameter M and a preset parameter N, the preset parameter M is the traffic used for sending missing memory pages in a pre-stated preset time period, and the preset parameter N The traffic used to send the memory page to be synchronized within the preset time period; the relationship between the first bandwidth, the second bandwidth, and the third bandwidth satisfies the following conditions: the sum of the second bandwidth and the third bandwidth is equal to The first bandwidth. Or, the sum of the second bandwidth and the third bandwidth is greater than the first bandwidth. Or, the sum of the second bandwidth and the third bandwidth is smaller than the first bandwidth.

Preferably, the VMM401 is specifically configured to determine the proportion of the second bandwidth in the first bandwidth according to the bandwidth adaptive allocation strategy as Obtain the second bandwidth, determine the proportion of the third bandwidth in the first bandwidth as The third bandwidth is obtained.

Preferably, the VMM401 is further configured to find the missing memory page according to the information of the missing memory page included in the page fault request, and continue to send the missing memory page to the target physical host through the network interface using the second bandwidth , the source physical host sends the memory page to be synchronized of the virtual machine to the target physical host by using the currently available bandwidth through the network interface. Wherein, the currently available bandwidth is greater than or equal to the sum of the second bandwidth and the third bandwidth.

Preferably, before the VMM401 sends the memory pages to be synchronized of the virtual machine to the target physical host through the network interface using the first bandwidth, it is also used to record when the virtual machine runs on the source physical host before migration, each memory page is accessed times or frequency values; according to the descending order of the number of times or frequency values of each memory page being accessed, the memory pages to be synchronized of the virtual machine are sequentially sent to the target physical host through the network interface using the first bandwidth.

Preferably, the VMM401, according to the descending order of the number of times or frequency values of each memory page, uses the first bandwidth to send the virtual machine's memory pages to be synchronized to the target physical host sequentially through the network interface, specifically for each When using the first bandwidth to send an unsynchronized first memory page of the virtual machine to the target physical host through the network interface for the first time, the second memory page before the address of the first memory page and the third memory page after the address of the first memory page The memory pages are sent to the target physical host together.

Preferably, the VMM401 is also used to stop the operation of the virtual machine and send key data of the virtual machine to the target physical host before the virtual machine is migrated from the source physical host to the target physical host and resumes operation on the target physical host , so that the virtual machine resumes running on the target physical host; the key data of the virtual machine includes the state information of the central processing unit CPU of the source physical host, and the device information of the source physical host.

Those of ordinary skill in the art can understand that all or part of the steps for realizing the above-mentioned method embodiments can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the It includes the steps of the above-mentioned method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other various media that can store program codes.

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention. Should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be determined by the protection scope of the claims.

Claims (21)

1. a kind of virtual machine migration method, it is characterised in that methods described is applied to source physical host, including：

Virtual machine moves to target physical main frame from source physical host, and after being resumed operation on the target physical main frame, institute State the page to be synchronized that source physical host sends virtual machine by network interface using the first bandwidth to target physical main frame；Institute The page to be synchronized for stating virtual machine is：It is stored in the source physical host, is not sent during the virtual machine (vm) migration To the page of the target physical main frame；

The source physical host receives the page faults that the target physical main frame is sent by the network interface；It is described to skip leaf Request bag contains the information of missing page, extensive after the missing page is virtual machine (vm) migration to the target physical main frame Need but do not sent from the source physical host to the page of the target physical main frame after multiple operation；

The source physical host is found in the missing according to the information of the missing page included in the page faults Page is deposited, the missing page is sent to the target physical main frame using the second bandwidth by the network interface；Meanwhile, institute Source physical host is stated to continue to send treating for virtual machine to the target physical main frame using the 3rd bandwidth by the network interface Isochronous memory page；Wherein, second bandwidth, the 3rd bandwidth are respectively less than first bandwidth；Second bandwidth and institute The 3rd bandwidth sum is stated equal to first bandwidth；Or, second bandwidth is more than described first with the 3rd bandwidth sum Bandwidth；Or, second bandwidth is less than first bandwidth with the 3rd bandwidth sum.

2. according to the method described in claim 1, it is characterised in that methods described also includes：

The source physical host determines ratio of second bandwidth in first bandwidth according to bandwidth self-adaption allocation strategy Example, obtains second bandwidth；And, ratio of the 3rd bandwidth in first bandwidth is determined, the described 3rd is obtained Bandwidth；

Wherein, the bandwidth self-adaption allocation strategy includes：Parameter preset M and parameter preset N, the parameter preset M is pre- The flow used in missing page is sent in the preset time period first counted, the parameter preset N is in the preset time period Send the flow used in page to be synchronized.

3. method according to claim 2, it is characterised in that the source physical host distributes plan according to bandwidth self-adaption Slightly, ratio of second bandwidth in first bandwidth is determined, obtains second bandwidth, and determine the 3rd band The wide ratio in first bandwidth, obtains the 3rd bandwidth, specifically includes：

The source physical host determines second bandwidth ratio in first bandwidth according to bandwidth self-adaption allocation strategy ForSecond bandwidth is obtained, determines that ratio of the 3rd bandwidth in first bandwidth is To the 3rd bandwidth.

4. according to the method described in claim 1, it is characterised in that the source physical host is included according in the page faults The missing page information, the missing page is found, by the network interface using the second bandwidth to described Target physical main frame has been sent after the missing page, and methods described also includes：

The source physical host sends virtual machine using current available bandwidth by the network interface to target physical main frame Page to be synchronized, the current available bandwidth is more than or equal to second bandwidth and the 3rd bandwidth sum.

5. the method according to claim any one of 1-4, it is characterised in that pass through network interface in the source physical host Before the page to be synchronized for sending virtual machine to target physical main frame using the first bandwidth, methods described also includes：

The source physical host is recorded when being run before the virtual machine (vm) migration on the source physical host, and each page is accessed Times or frequency value；

Correspondingly, the source physical host sends virtual machine using first bandwidth by network interface to target physical main frame Page to be synchronized include：The descending for the times or frequency value that the source physical host is accessed according to each page is suitable Sequence, the page to be synchronized of virtual machine is sent by network interface to target physical main frame successively using first bandwidth.

6. method according to claim 5, it is characterised in that the source physical host is accessed according to each page Times or frequency value descending order, by network interface using the first bandwidth successively to target physical main frame send virtual machine Page to be synchronized during, including：

The source physical host sends virtual machine using first bandwidth by network interface to target physical main frame every time During one the first not synchronous page, by the second page before the first internal memory page address, first page The target physical main frame is sent the 3rd page one after address in the same direction.

7. according to the method described in claim 1, it is characterised in that virtual machine moves to target physical master from source physical host Machine, and before being resumed operation on the target physical main frame, methods described also includes：

The source physical host stops the operation of the virtual machine, and the key of the virtual machine is sent to the target physical main frame Data, so that the virtual machine resumes operation on the target physical main frame；The critical data of the virtual machine includes described The facility information of the status information of source physical host central processor CPU, the source physical host.

8. a kind of virtual machine (vm) migration device, it is characterised in that be deployed on the physical host of source, the virtual machine (vm) migration device bag Include：

Background transfer module, for sending the to be synchronized of virtual machine to target physical main frame using the first bandwidth by network interface Page；The page to be synchronized of the virtual machine is：It is stored in the source physical host, in the virtual machine (vm) migration process In do not send to the page of the target physical main frame；

Page faults receiving module, for receiving the page faults that the target physical main frame is sent by the network interface； The page faults include the information of missing page, and the missing page is virtual machine (vm) migration to the target physical master After machine, need but do not sent from the source physical host to the page of the target physical main frame after resuming operation；

Remote Paging module, for the information according to the missing page included in the page faults, finds described lack Page is lost, the missing page is sent to the target physical main frame using the second bandwidth by the network interface；Together When, the background transfer module is additionally operable to using the 3rd bandwidth continue to the target physical main frame by the network interface Send the page to be synchronized of virtual machine；Wherein, second bandwidth, the 3rd bandwidth are respectively less than first bandwidth；Institute State the second bandwidth and be equal to first bandwidth with the 3rd bandwidth sum；Or, second bandwidth and the 3rd bandwidth it With more than first bandwidth；Or, second bandwidth is less than first bandwidth with the 3rd bandwidth sum.

9. virtual machine (vm) migration device according to claim 8, it is characterised in that the virtual machine (vm) migration device also includes： Bandwidth self-adaption module,

The bandwidth self-adaption module is used for, and determines second bandwidth in the first band according to bandwidth self-adaption allocation strategy Ratio in width, obtains second bandwidth；And ratio of the 3rd bandwidth in first bandwidth is determined, obtain institute State the 3rd bandwidth；

Wherein, the bandwidth self-adaption allocation strategy includes：Parameter preset M and parameter preset N, the parameter preset M is pre- The flow used in missing page is sent in the preset time period first counted, the parameter preset N is in the preset time period Send the flow used in page to be synchronized.

10. virtual machine (vm) migration device according to claim 9, it is characterised in that

The bandwidth self-adaption module according to bandwidth self-adaption allocation strategy specifically for determining second bandwidth described Ratio is in one bandwidthSecond bandwidth is obtained, and determines the 3rd bandwidth in first bandwidth Ratio isObtain the 3rd bandwidth.

11. virtual machine (vm) migration device according to claim 8, it is characterised in that

The background transfer module is additionally operable to, when the Remote Paging module by the network interface using the second bandwidth to institute State target physical main frame to have sent after the missing page, current available bandwidth is utilized to object by the network interface The page to be synchronized that main frame sends virtual machine is managed, the current available bandwidth is more than or equal to second bandwidth and the described 3rd Bandwidth sum.

12. the virtual machine (vm) migration device according to claim any one of 8-11, it is characterised in that the background transfer module Also include：

Hot page record sub module, first bandwidth is utilized to object for platform transport module in the rear by network interface Before managing the page to be synchronized that main frame sends virtual machine, when recording the virtual machine and being run on the source physical host, respectively The accessed times or frequency value of page；

Hot page prefetches submodule, for the descending order for the times or frequency value being accessed according to each page, passes through net Network interface sends the page to be synchronized of virtual machine using first bandwidth to target physical main frame successively.

13. virtual machine (vm) migration device according to claim 12, it is characterised in that

The hot page prefetches submodule, specifically for utilizing first bandwidth to target physical main frame by network interface every time Send one of virtual machine not the first synchronous page when, by the second page before the first internal memory page address, institute State the 3rd page one target physical main frame transmission in the same direction after the first internal memory page address.

14. virtual machine (vm) migration device according to claim 8, it is characterised in that the virtual machine (vm) migration device also includes：

Virtual machine state management module, the operation for stopping the virtual machine；

Key message sending module, the critical data for sending the virtual machine to the target physical main frame, so as to described Virtual machine resumes operation on the target physical main frame；The critical data of the virtual machine includes source physical host center The facility information of processor CPU status information, the source physical host.

15. an introduces a collection physical host, it is characterised in that the source physical host includes：Hardware layer；Run in the hardware layer Virtual machine monitoring unit VMM；At least one of the VMM controls operation is migrated to target physical main frame from the source physical host Virtual machine, wherein：

The VMM, the internal memory to be synchronized for sending virtual machine to target physical main frame using the first bandwidth by network interface Page；The page to be synchronized of the virtual machine is：It is stored in the source physical host, during the virtual machine (vm) migration not Send to the page of the target physical main frame；

The page faults that the target physical main frame is sent are received by the network interface；The page faults include missing The information of page, the missing page be virtual machine (vm) migration to after the target physical main frame, being needed after resuming operation but Do not sent from the source physical host to the page of the target physical main frame；

According to the information of the missing page included in the page faults, the missing page is found, by described Network interface sends the missing page using the second bandwidth to the target physical main frame；Meanwhile, the source physical host The 3rd bandwidth is utilized to continue to send the page to be synchronized of virtual machine to the target physical main frame by the network interface, its In, second bandwidth, the 3rd bandwidth are respectively less than first bandwidth；Second bandwidth and the 3rd bandwidth sum Equal to first bandwidth；Or, second bandwidth is more than first bandwidth with the 3rd bandwidth sum；Or, described Two bandwidth are less than first bandwidth with the 3rd bandwidth sum.

16. source physical host according to claim 15, it is characterised in that

The VMM, is additionally operable to determine ratio of second bandwidth in first bandwidth according to bandwidth self-adaption allocation strategy Example, obtains second bandwidth；Ratio of the 3rd bandwidth in first bandwidth is determined, the 3rd bandwidth is obtained；

Wherein, the bandwidth self-adaption allocation strategy includes：Parameter preset M and parameter preset N, the parameter preset M is pre- The flow used in missing page is sent in the preset time period first counted, the parameter preset N is in the preset time period Send the flow used in page to be synchronized.

17. source physical host according to claim 16, it is characterised in that

The VMM according to bandwidth self-adaption allocation strategy specifically for determining that second bandwidth compares in first bandwidth Example beSecond bandwidth is obtained, and determines that ratio of the 3rd bandwidth in first bandwidth isObtain the 3rd bandwidth.

18. source physical host according to claim 15, it is characterised in that

The VMM, is additionally operable to the information according to the missing page included in the page faults, finds in the missing Page is deposited, has been sent by the network interface using the second bandwidth to the target physical main frame after the missing page, institute State source physical host and the to be synchronized of virtual machine is sent to target physical main frame using current available bandwidth by the network interface Page, the current available bandwidth is more than or equal to second bandwidth and the 3rd bandwidth sum.

19. the source physical host according to claim any one of 15-18, it is characterised in that

The VMM, the to be synchronized interior of virtual machine is being sent by network interface using first bandwidth to target physical main frame Before depositing page, it is additionally operable to record when being run before the virtual machine (vm) migration on the source physical host, each page is accessed Times or frequency value；The descending order for the times or frequency value being accessed according to each page, is utilized by network interface First bandwidth sends the page to be synchronized of virtual machine to target physical main frame successively.

20. source physical host according to claim 19, it is characterised in that

The VMM, the descending order for the times or frequency value being accessed according to each page, institute is utilized by network interface During stating the page to be synchronized that the first bandwidth sends virtual machine to target physical main frame successively, specifically for passing through every time Network interface using the first bandwidth to target physical main frame send one of virtual machine not the first synchronous page when, will be described The mesh in the same direction of the 3rd page one after the second page, the first internal memory page address before first internal memory page address Physical host is marked to send.

21. source physical host according to claim 15, it is characterised in that

The VMM, moves to target physical main frame, and recover on the target physical main frame in virtual machine from source physical host Before operation, it is additionally operable to stop the operation of the virtual machine, the crucial number of the virtual machine is sent to the target physical main frame According to so that the virtual machine resumes operation on the target physical main frame；The critical data of the virtual machine includes the source The facility information of the status information of physical host central processor CPU, the source physical host.