CN111414239A - Virtual machine mirror image management method, system and medium based on kylin cloud computing platform - Google Patents

Abstract

The invention discloses a method, a system and a medium for managing a virtual machine image based on an kylin cloud computing platform, wherein a server responds to a request of uploading a virtual machine image file by a user, and comprises the following steps: acquiring a mirror image fingerprint of a virtual machine mirror image file uploaded by a user, judging according to the mirror image fingerprint, if the virtual machine mirror image file is not stored in shared storage, storing the virtual machine mirror image file in the shared storage, and recording the reference of the user to the virtual machine mirror image file in metadata; if the virtual machine image file is already stored on the shared storage, the reference of the user to the virtual machine image file is directly added into the metadata without repeatedly storing the virtual machine image file. According to the invention, through calculation and comparison of the virtual machine mirror image fingerprints, the repetition rate of the virtual machine mirror image file is reduced, the efficiency of large-scale user scene virtual machine mirror image management is greatly improved, the space utilization rate of mirror image management can be improved, and the first starting efficiency of the virtual machine is improved.

Description

Virtual machine image management method, system and medium based on Kylin cloud computing platform

technical field

The invention relates to a virtualized resource management technology in the field of cloud computing, in particular to a virtual machine image management method, system and medium based on a Kylin cloud computing platform.

Background technique

At present, with the increasingly mature and perfect cloud computing technology system, cloud computing technology has been widely used in many industries. Cloud computing technology can realize the resource virtualization of data center infrastructure, separate applications, data and physical resources in logical management, and IT departments can provide and maintain data center resources more effectively, quickly and flexibly. Services, business units can also focus more on application and data services. In a word, data center resource virtualization can provide users with convenient and fast infrastructure as a service (IaaS) capabilities. Compared with the traditional resource management model, infrastructure as a service has the following advantages: ① Improve resource utilization: through virtualization technology Shared storage resources can be shared to different users to improve resource utilization; ②Improve maintainability: The high availability, online migration and other technologies provided by resource virtualization help to carry out the system without interruption of business. Update maintenance, and recover from unexpected network outages more quickly.

Under the infrastructure-as-a-service model, cloud computing platforms provide users with a complete operating system and basic software environment through virtual machines. Users can customize their own virtual computing environment by uploading their own images to the cloud computing platform. In this mode, with the increase of the number of users, new challenges are brought to the existing image management mode of the cloud computing center: ① It greatly increases the image storage pressure of the cloud computing center; ② It reduces the storage space caused by image reuse. Optimize efficiency.

SUMMARY OF THE INVENTION

The technical problem to be solved by the present invention: in view of the above-mentioned problems of the prior art, on the basis of the existing KVM-based virtualization management platform, a method, system and medium for virtual machine image management based on the Kylin cloud computing platform are provided. The calculation and comparison of virtual machine image fingerprints reduces the repetition rate of virtual machine image files, greatly improves the efficiency of virtual machine image management in large-scale user scenarios, improves the space utilization of image management, and improves the efficiency of virtual machine first startup.

In order to solve the above-mentioned technical problems, the technical scheme adopted in the present invention is:

A method for managing a virtual machine image based on a Kylin cloud computing platform, wherein the steps of a server responding to a user request for uploading a virtual machine image file include:

1) Obtain the description of the virtual machine image file uploaded by the user. The description of the virtual machine image file includes the image owner, the image file name, the image fingerprint fingerID, and the image file description Description;

2) Store the description of the virtual machine image file on the server; judge whether the virtual machine image file has been stored on the shared storage according to the image fingerprint fingerID comparison, and if the virtual machine image file has not been stored on the shared storage, then on the shared storage Store the virtual machine image file, and record the user's reference to the virtual machine image file in the metadata of the virtual machine image file; if the virtual machine image file has been stored on the shared storage, directly in the virtual machine image file A user's reference to the virtual machine image file is added to the metadata without repeatedly storing the virtual machine image file.

Optionally, the image fingerprint fingerID is calculated by using one of MD5, SHA1, and CRC32 algorithms according to the content of the virtual machine image file, or calculated by combining two or more algorithms.

Optionally, the description of the virtual machine image file uploaded by the user in step 1) is a virtual machine image file definition description quadruple.

Optionally, the metadata in step 2) is described by a triplet, and the triplet includes the image fingerprint fingerID, the citation number citeNumber of the image file, and the specific storage location url of the image file.

Optionally, in step 2), according to the image fingerprint fingerID comparison, judging whether the virtual machine image file has been stored on the shared storage specifically refers to: the image fingerprint fingerID of the virtual machine image file uploaded by the user is separately stored on the shared storage. The image fingerprint fingerIDs in the metadata of each virtual machine image file are compared, and if there is a matching image file, it is determined that the virtual machine image file has been stored, otherwise it is determined that the virtual machine image file has not been stored.

Optionally, recording the citation of the user to the virtual machine image file in step 2) specifically refers to that the citation number citeNumber of the image file in the metadata of the virtual machine image file is set to 1; in step 2), adding the user to the virtual machine image file citeNumber is set to 1; The citation of the machine image file specifically refers to adding 1 to the citeNumber of the image file in the metadata of the virtual machine image file.

Optionally, after step 2), it also includes a step of responding to a user request to delete the virtual machine image file, and the detailed steps include:

S1) obtain the image fingerprint fingerID of the virtual machine image file to be deleted;

S2) obtain the metadata of the virtual machine image file to be deleted stored on the shared storage according to the image fingerprint fingerID;

S3) subtract 1 from the image file citation number citeNumber in the metadata of the virtual machine image file to be deleted;

S4) Determine whether the citation number citeNumber of the image file after subtracting 1 is 0, and if it is 0, delete the virtual machine image file to be deleted on the shared storage.

Optionally, after step 2), also include the step of creating a virtual machine according to the virtual machine image file, and after creating the virtual machine, the data files of the virtual machine on the storage organization are all stored by the virtual machine image file plus the incremental data mode, And the data files stored on the shared storage of all virtual machines include all virtual machine common content, the virtual machine image file set of all virtual machines, the incremental data set of all virtual machines; step 2) according to the image fingerprint fingerID comparison judgment Whether the virtual machine image file has been stored on the shared storage specifically refers to: comparing the image fingerprint fingerID of the virtual machine image file uploaded by the user with the metadata of each virtual machine image file in the virtual machine image file set of all virtual machines. If there is a matching image file, it is determined that the virtual machine image file has been stored, otherwise it is determined that the virtual machine image file has not been stored.

In addition, the present invention also provides a virtual machine image management system based on the Kylin cloud computing platform, including computer equipment, the computer equipment is programmed or configured to perform the steps of the virtual machine image management method based on the Kylin cloud computing platform, or A computer program programmed or configured to execute the virtual machine image management method based on the Kylin cloud computing platform is stored in the memory of the computer device.

In addition, the present invention also provides a computer-readable storage medium on which a computer program programmed or configured to execute the method for managing virtual machine images based on the Kylin cloud computing platform is stored.

Compared with the prior art, the present invention has the following advantages:

1. Improve the space utilization of image management. The basis for user uploads generally only includes operating systems, basic office software, etc., which has a high repetition rate in large-scale user scenarios. By calculating and comparing the fingerprints of virtual machine images in qcow2 format, users can avoid uploading duplicate images and avoid wasting data center bandwidth and storage resources.

2. Improve the first startup efficiency of the virtual machine. In the existing mode, the same virtual machine instance shares the base image to improve startup efficiency and reduce error storage overhead. If a mirror system is determined to be started for the first time, a mirror download request needs to be sent to the mirror management shared storage, which not only increases the pressure on the bandwidth and mirror shared storage, but also greatly affects the startup time. With the functions provided by this method, the image download rate in the scenario of first booting the virtual machine can be reduced, thereby improving the first booting efficiency of the virtual machine.

Description of drawings

FIG. 1 is a schematic diagram of a basic flow of the method according to the present embodiment in response to a user request for uploading a virtual machine image file.

Detailed ways

As shown in FIG. 1 , in the virtual machine image management method based on the Kylin cloud computing platform of the present embodiment, the step of the server responding to the user’s request for uploading a virtual machine image file includes:

1) Obtain the description of the virtual machine image file uploaded by the user. The description of the virtual machine image file includes the image owner, the image file name, the image fingerprint fingerID, and the image file description Description;

2) Store the description of the virtual machine image file on the server; judge whether the virtual machine image file has been stored on the shared storage according to the image fingerprint fingerID comparison, and if the virtual machine image file has not been stored on the shared storage, then on the shared storage Store the virtual machine image file, and record the user's reference to the virtual machine image file in the metadata of the virtual machine image file; if the virtual machine image file has been stored on the shared storage, directly in the virtual machine image file A user's reference to the virtual machine image file is added to the metadata without repeatedly storing the virtual machine image file (this reference is to establish a mapping between the virtual machine description file and the actual image).

The fingerprint fingerprint fingerID of the image is a key feature introduced in this embodiment. Through the calculation of the content of the image, a unique identification symbol of the image that is independent of the image name and descriptor is generated. As an optional implementation,

In this embodiment, the fingerprint fingerID of the mirror image is calculated by using the MD5 algorithm according to the content of the virtual machine image file. In addition, it can be calculated by using the SHA1 or CRC32 algorithm as required, or MD5, SHA1, CRC32 can also be used according to the content of the virtual machine image file. It is calculated by combining two or more algorithms of the three. In the above manner, the unique feature of the virtual machine image file can be extracted, so as to realize the uniqueness detection of the server virtual machine image file.

In this embodiment, the description of the virtual machine image file uploaded by the user in step 1) is a virtual machine image file definition description four-tuple. The virtual machine image file definition and description four-tuple includes image owner, image file name, image fingerprint fingerID, and image file description Description.

As an optional implementation manner, the format of the virtual machine image file definition description quadruple is defined as follows:

<owner, name, fingerID, Description>

Among them, owner is the image owner of the virtual machine image file (that is, which user uploaded the image, specifically the client user ID obtained by the system), and name is the image file name of the virtual machine image file (the user Name, such as Ubuntu 1804-XXX, etc.), fingerID is the image fingerprint of the virtual machine image file (acquired by calculation, it is the unique feature of the virtual machine image file, different virtual machine image files have different image fingerprint fingerIDs), Description is the virtual machine image file. The description of the virtual machine image file, including the attributes of the image file, the content information of the image file, etc., is convenient for users to understand the content of the virtual machine image.

The metadata in step 2) of this embodiment is described by a triplet, and the triplet includes the image fingerprint fingerID, the citation number citeNumber of the image file, and the specific storage location url of the image file.

As an optional implementation manner, the format of the triplet is defined as follows:

<fingerID, citeNumber, url>

Wherein, fingerID is the image fingerprint of the virtual machine image file, citeNumber is the citation number of the virtual machine image file, and url is the specific storage location of the virtual machine image file.

In step 2) of this embodiment, judging whether the virtual machine image file has been stored on the shared storage according to the comparison of the fingerprint fingerprint ID The image fingerprint fingerID in the metadata of the virtual machine image file is compared, and if there is a matching image file, it is determined that the virtual machine image file has been stored, otherwise it is determined that the virtual machine image file has not been stored.

Recording the user's reference to the virtual machine image file in step 2) in this embodiment specifically refers to setting the image file citation number citeNumber in the metadata of the virtual machine image file to 1; in step 2), adding the user to the virtual machine The citation of the image file specifically refers to adding 1 to the citeNumber of the image file in the metadata of the virtual machine image file.

After step 2) of this embodiment, it also includes the step of responding to the request of the user to delete the virtual machine image file, and the detailed steps include:

S1) obtain the image fingerprint fingerID of the virtual machine image file to be deleted;

S2) obtain the metadata of the virtual machine image file to be deleted stored on the shared storage according to the image fingerprint fingerID;

S3) subtract 1 from the image file citation number citeNumber in the metadata of the virtual machine image file to be deleted;

S4) Determine whether the citation number citeNumber of the image file after subtracting 1 is 0, and if it is 0, delete the virtual machine image file to be deleted on the shared storage.

In this embodiment, when the server responds to the user's request for uploading the virtual machine image file, it also includes the virtual machine image file definition and description quadruple of the cloud computing center where the user stores the virtual machine image file; therefore, the response to the user deletes the virtual machine image file. The request also needs to delete the virtual machine image file definition description quadruplet of the virtual machine image file stored for the user.

In this embodiment, the server that responds to the user's request to upload the virtual machine image file specifically refers to the image management center of the Kylin cloud computing platform, and the image management center is used to uniformly manage the virtual machine image files of all users through shared storage.

In this embodiment, after step 2), there is also a step of creating a virtual machine according to the virtual machine image file. As an optional implementation manner, after the virtual machine is created, the data files of the virtual machine on the storage organization are all added by the virtual machine image file. Incremental data is stored, and the data files of all virtual machines stored on the shared storage include the common content of all virtual machines, the virtual machine image file collection of all virtual machines, and the incremental data collection of all virtual machines; step 2) judging whether the virtual machine image file has been stored on the shared storage according to the image fingerprint fingerID comparison specifically refers to: comparing the image fingerprint fingerID of the virtual machine image file uploaded by the user with each of the virtual machine image file sets of all virtual machines. The image fingerprint fingerID in the metadata of the virtual machine image file is compared, and if there is a matching image file, it is determined that the virtual machine image file has been stored, otherwise it is determined that the virtual machine image file has not been stored. For example the form is:

{base{image_id ₁ ,image_id ₂ ,…image_id _n },inst ₁₁ ,inst ₁₂ ,inst ₂₁ ,…,inst _nm }

In the above formula, base represents the common content of all virtual machines, {image_id ₁ , image_id ₂ ,..., image_id _n } represents the virtual machine image file set of all virtual machines, including a total of n virtual machine image files from image_id ₁ to image_id _n ; inst ₁₁ ,inst ₁₂ ,inst ₂₁ ,…,inst _nm represents the incremental data set of all virtual machines. The name of the incremental data of the virtual machine is the same as the unique identifier (instance_id) of the virtual machine instance. Generally speaking, a 10G size The file size of the incremental part of the virtual machine created by the image is only about 200M (it will increase with the increase of user programs during the use of the virtual machine). where inst ₁₁ and inst ₁₂ respectively represent the incremental data of the first and second virtual machines based on the virtual machine image file image_id ₁ , and inst ₂₁ represents the incremental data of the virtual machine based on the virtual machine image file image_id ₂ Data, inst _nm represents the incremental data of the mth virtual machine based on the virtual machine image file image_id _n . Therefore, every time a virtual machine is created, it will first detect whether there are virtual machines with the same virtual machine image file in the common content base of all virtual machines, or in the virtual machine image file set of all virtual machines {image_id ₁ ,image_id ₂ ,… , image_id _n } to detect whether the same virtual machine image file exists, if there is, just create an independent incremental file for this virtual machine, otherwise you need to download the virtual machine image from the image management center to the shared storage, and then in all A corresponding virtual machine image file is added to the virtual machine image file set of the virtual machine, and independent incremental data is created in the incremental data set of all virtual machines. In a common practice, after the virtual machine is created, its data files are stored on the shared storage. In order to improve the storage space utilization and the efficiency of virtual machine startup, the virtual machine instance adopts the incremental storage method in the storage organization. The above method has the following advantages: First, the common content of all virtual machines and the virtual machine image file collection of all virtual machines are shared, which can reduce the occupation of storage space; second, it also simplifies the virtual machine image when creating a virtual machine. File existence detection and data file generation.

In addition, the present embodiment also provides a virtual machine image management system based on the Kylin cloud computing platform, including a computer device that is programmed or configured to execute the steps of the aforementioned method for managing virtual machine images based on the Kylin cloud computing platform, or A computer program programmed or configured to execute the aforementioned method for managing virtual machine images based on the Kylin cloud computing platform is stored in the memory of the computer device.

In addition, this embodiment also provides a computer-readable storage medium, where a computer program programmed or configured to execute the aforementioned method for managing virtual machine images based on the Kylin cloud computing platform is stored thereon.

The above are only the preferred embodiments of the present invention, and the protection scope of the present invention is not limited to the above-mentioned embodiments, and all technical solutions under the idea of the present invention belong to the protection scope of the present invention. It should be pointed out that for those skilled in the art, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

Claims (10)

1. a virtual machine image management method based on Kylin cloud computing platform, is characterized in that, the step that server responds to user uploading virtual machine image file request comprises: 1) Obtain the description of the virtual machine image file uploaded by the user. The description of the virtual machine image file includes the image owner, the image file name, the image fingerprint fingerID, and the image file description Description; 2) Store the description of the virtual machine image file on the server; judge whether the virtual machine image file has been stored on the shared storage according to the image fingerprint fingerID comparison, and if the virtual machine image file has not been stored on the shared storage, then on the shared storage Store the virtual machine image file, and record the user's reference to the virtual machine image file in the metadata of the virtual machine image file; if the virtual machine image file has been stored on the shared storage, directly in the virtual machine image file A user's reference to the virtual machine image file is added to the metadata without repeatedly storing the virtual machine image file. 2. the virtual machine image management method based on Kylin cloud computing platform according to claim 1, is characterized in that, described image fingerprint fingerID is to adopt a kind of in MD5, SHA1, CRC32 according to the content of virtual machine image file Algorithm calculation or a combination of two or more algorithms. 3. The virtual machine image management method based on Kylin cloud computing platform according to claim 1, is characterized in that, in step 1), the virtual machine image file that the user uploads is described as the virtual machine image file definition description quadruple. 4. the virtual machine image management method based on kylin cloud computing platform according to claim 1, is characterized in that, the metadata in step 2) adopts triplet to describe, and described triplet comprises image fingerprint fingerID, image The number of file citations citeNumber, the specific storage location url of the mirror file. 5. the virtual machine image management method based on kylin cloud computing platform according to claim 4, is characterized in that, in step 2), according to image fingerprint fingerID comparison judges whether on shared storage has been stored with this virtual machine image file specifically is. Refers to: compare the image fingerprint fingerID of the virtual machine image file uploaded by the user with the image fingerprint fingerID in the metadata of each virtual machine image file stored on the shared storage. If there is a matching image file, it is determined that the image file has been stored. The virtual machine image file, otherwise it is determined that the virtual machine image file has not been stored. 6. the virtual machine image management method based on Kylin cloud computing platform according to claim 4, is characterized in that, in step 2), record user's reference to this virtual machine image file specifically refers to the element of this virtual machine image file. The citation number citeNumber of the mirror file in the data is set to 1; in step 2), adding a user's reference to the virtual machine mirror file specifically refers to adding 1 to the mirror file citation number citeNumber in the metadata of the virtual machine mirror file. 7. the virtual machine image management method based on Kylin cloud computing platform according to claim 4, also comprises the step of responding to user delete virtual machine image file request after step 2), and detailed steps comprise: S1) obtain the image fingerprint fingerID of the virtual machine image file to be deleted; S2) obtain the metadata of the virtual machine image file to be deleted stored on the shared storage according to the image fingerprint fingerID; S3) subtract 1 from the image file citation number citeNumber in the metadata of the virtual machine image file to be deleted; S4) Determine whether the citation number citeNumber of the image file after subtracting 1 is 0, and if it is 0, delete the virtual machine image file to be deleted on the shared storage. 8. the virtual machine image management method based on Kylin cloud computing platform according to claim 1, also comprises the step of creating virtual machine according to virtual machine image file after step 2), and after creating virtual machine, virtual machine on storage organization. The data files are stored in the form of virtual machine image files and incremental data, and the data files of all virtual machines stored on the shared storage include the common content of all virtual machines, the collection of virtual machine image files of all virtual machines, and the data files of all virtual machines. The incremental data set; step 2) according to the mirror fingerprint fingerID comparison to determine whether the virtual machine mirror file has been stored on the shared storage specifically refers to: the mirror fingerprint fingerID of the virtual machine mirror file uploaded by the user is respectively with all virtual machines Compare the image fingerprint fingerID in the metadata of each virtual machine image file in the set of virtual machine image files. If there is a matching image file, it is determined that the virtual machine image file has been stored, otherwise it is determined that the virtual machine has not been stored. image file. 9. A virtual machine image management system based on the Kylin cloud computing platform, comprising computer equipment, characterized in that the computer equipment is programmed or configured to execute the Kylin cloud computing platform-based system according to any one of claims 1 to 8. The steps of the virtual machine image management method, or a computer program programmed or configured to execute the Kylin cloud computing platform-based virtual machine image management method according to any one of claims 1 to 8 is stored in the memory of the computer device. 10. A computer-readable storage medium, wherein the computer-readable storage medium is programmed or configured to execute the Kylin cloud computing platform-based virtual machine image management according to any one of claims 1 to 8. A computer program of the method.

Images