[go: up one dir, main page]

CN107132991B - Layered storage method of virtual storage system and virtual storage system - Google Patents

Layered storage method of virtual storage system and virtual storage system Download PDF

Info

Publication number
CN107132991B
CN107132991B CN201610108921.9A CN201610108921A CN107132991B CN 107132991 B CN107132991 B CN 107132991B CN 201610108921 A CN201610108921 A CN 201610108921A CN 107132991 B CN107132991 B CN 107132991B
Authority
CN
China
Prior art keywords
service
storage
strategy
data
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610108921.9A
Other languages
Chinese (zh)
Other versions
CN107132991A (en
Inventor
尹巍
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sangfor Technologies Co Ltd
Original Assignee
Sangfor Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sangfor Technologies Co Ltd filed Critical Sangfor Technologies Co Ltd
Priority to CN201610108921.9A priority Critical patent/CN107132991B/en
Publication of CN107132991A publication Critical patent/CN107132991A/en
Application granted granted Critical
Publication of CN107132991B publication Critical patent/CN107132991B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061Improving I/O performance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0662Virtualisation aspects
    • G06F3/0664Virtualisation aspects at device level, e.g. emulation of a storage device or system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0683Plurality of storage devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a layered storage method of a virtual storage system, which comprises the following steps: acquiring a preset service strategy for a service object; calculating and generating a layered storage strategy corresponding to the service data of different service objects according to the service strategy; and storing different service data into the storage medium with corresponding read-write performance based on the layered storage strategy. The invention also discloses a virtual storage system for layered storage. Because the data can be stored hierarchically according to the service strategy preset by the specific service requirement, the combination between the hierarchical storage of the data and the specific service requirement is tighter, and the flexible hierarchical storage of the data can be performed according to different service requirements set by a user.

Description

Layered storage method of virtual storage system and virtual storage system
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a hierarchical storage method for a virtual storage system and a virtual storage system.
Background
The virtual storage technology is a storage technology that a plurality of storage medium modules such as hard disks and RAIDs are managed together in a centralized manner by a certain means, so that all the storage modules are managed in a unified manner in one storage pool, and a large-capacity and high-performance data transmission experience is provided for users. The super-fusion infrastructure is that elements such as software backup, a snapshot technology, data de-duplication, online data compression and the like are combined on the basis of resources and technologies such as calculation, network, storage, server virtualization and the like in the same set of unit equipment, and modular seamless transverse expansion is realized through the infrastructure of a plurality of sets of unit equipment aggregated by a network, so that a unified resource pool is formed. The IOPS is the number of read and write operations per second, and is used to measure the random access performance of the storage system. A super-fusion infrastructure is formed on the basis of a virtual storage system and a super-fusion basic framework and is used for dealing with the current situation that IT infrastructures of enterprises are difficult to manage and maintain.
The existing virtual storage system can only store cold data with less access in a mechanical hard disk storage medium by depending on a self hierarchical storage mechanism, and store hot data with frequent access in a solid state disk storage medium, but cannot flexibly adapt to various service requirements of users, for example:
1. when the situations of sudden calculation such as shopping website promotion, ticket booking and the like are faced, the problem of reading and writing performance shortage of a virtual storage system is caused in a short time, because the cold data needs a certain time to migrate to the hot data, and the cold data cannot be rapidly changed into the hot data in the short time;
2. the perception of the virtual storage system to the upper layer calculation is relatively dull, for example, when the virtual machine stops running for a long time, the running data of the virtual machine is changed from hot data to cold data, and the virtual machine is used again, so that the problem of blocking occurs;
3. the combination of the virtual storage system and the service requirements is not tight enough, for example, when night backup is performed, the cold data is changed into the hot data due to continuous reading and writing of the backup data, and after the backup is finished, the backup data cannot be changed into the cold data in a short time, so that the use space of the high-capacity IOPS storage medium with limited capacity is occupied.
Disclosure of Invention
The invention mainly aims to provide a layered storage method of a virtual storage system and the virtual storage system, aiming at flexibly adapting to various service requirements of users.
In order to achieve the above object, the present invention provides a hierarchical storage method for a virtual storage system, the method comprising the steps of:
acquiring a preset service strategy for a service object;
calculating and generating a layered storage strategy corresponding to the service data of different service objects according to the service strategy;
and storing different service data into the storage medium with corresponding read-write performance based on the layered storage strategy.
Preferably, the step of obtaining the service policy preset for the service object includes:
and receiving a service strategy configured for different service virtual machines by a user according to service requirements in a preset service configuration interface.
Preferably, the step of calculating and generating the hierarchical storage policy corresponding to the service data of different service objects according to the service policy includes:
acquiring the service execution performance of different service objects according to the service strategy;
calculating the storage positions of the service data of different service objects;
and generating a migration strategy of the service data of the storage position according to the service execution performance, and taking the migration strategy as a layered storage strategy.
Preferably, the step of storing different service data into the storage medium with corresponding read-write performance based on the hierarchical storage policy includes:
establishing a hierarchical trigger according to the hierarchical storage strategy;
and migrating and storing different service data into a storage medium with corresponding read-write performance by the layered trigger according to the service execution time period and/or the attribute of the service data and the service execution performance.
Preferably, if the service policy is that the service execution performance of the service object is high within a preset time period, the step of storing different service data into a storage medium with corresponding read-write performance based on the hierarchical storage policy includes:
when a preset time period is reached or before the preset time period is reached, storing the service data of the service object into a preset high-read-write-performance storage medium;
and after a preset time period, storing the service data stored in the preset high read-write performance storage medium into the preset low read-write performance storage medium.
In addition, to achieve the above object, the present invention further provides a virtual storage system for hierarchical storage, where the virtual storage system includes:
the acquisition module is used for acquiring a preset business strategy for the business object;
the calculation module is used for calculating and generating a layered storage strategy corresponding to the service data of different service objects according to the service strategy;
and the layered storage module is used for storing different service data into the storage medium with corresponding read-write performance based on the layered storage strategy.
Preferably, the obtaining module is further configured to:
and receiving a service strategy configured for different service virtual machines by a user according to service requirements in a preset service configuration interface.
Preferably, the calculation module comprises:
a service execution performance obtaining unit, configured to obtain service execution performance levels of different service objects according to the service policy;
the storage position calculation unit is used for calculating the storage positions where the business data of different business objects are located;
and the generating unit is used for generating a migration strategy of the service data of the storage position according to the service execution performance and taking the migration strategy as a layered storage strategy.
Preferably, the hierarchical storage module is further configured to:
establishing a hierarchical trigger according to the hierarchical storage strategy; and migrating and storing different service data into a storage medium with corresponding read-write performance by the layered trigger according to the service execution time period and/or the attribute of the service data and the service execution performance.
Preferably, if the service policy is that the service execution performance of the service object is high within a preset time period, the hierarchical storage module is further configured to:
storing the service data of the service object into a preset high read-write performance storage medium before reaching a preset time period or reaching the preset time period; and after a preset time period, storing the service data stored in the preset high read-write performance storage medium into the preset low read-write performance storage medium.
The invention provides a hierarchical storage method of a virtual storage system and the virtual storage system, which calculate and generate hierarchical storage strategies corresponding to service data of different service objects through service strategies preset for the service objects; and storing different service data into the storage medium with corresponding read-write performance based on the layered storage strategy. Because the data can be stored hierarchically according to the service strategy preset by the specific service requirement, the combination between the hierarchical storage of the data and the specific service requirement is tighter, and the flexible hierarchical storage of the data can be performed according to different service requirements set by a user.
Drawings
FIG. 1 is a flowchart illustrating a hierarchical storage method of a virtual storage system according to an embodiment of the present invention;
FIG. 2 is a detailed flowchart of step S20 in FIG. 1;
FIG. 3 is a functional block diagram of an embodiment of a virtual storage system for hierarchical storage according to the present invention;
fig. 4 is a schematic diagram of a detailed functional module of the calculation module 02 in fig. 3.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The invention provides a layered storage method of a virtual storage system and the virtual storage system.
Referring to fig. 1, fig. 1 is a schematic flowchart of a hierarchical storage method of a virtual storage system according to an embodiment of the present invention.
In one embodiment, the hierarchical storage method of the virtual storage system includes:
step S10, acquiring a preset service strategy for the service object;
in this embodiment, a service policy preset for a service object is first obtained, where the service policy may be a service policy set by a user according to an execution performance requirement of the user on the service object, or a service policy automatically generated according to a preset rule according to a type of the service object, and is not limited herein.
The user can set different service strategies according to different service requirements. In one embodiment, the business strategy set by the user includes business requirements for solving the problems that sales promotion of shopping websites, booking tickets and the like can cause the business quantity to swell in a short time, so that the corresponding website service is blocked and the like, and also can include business requirements for solving the problems that when a virtual machine which is idle for a long time is started, the virtual machine is blocked and the like because the virtual machine senses the upper layer slowly, and also can include business requirements for solving the problems that data for executing backup operation occupies the space of a storage medium for supporting high-performance read-write operation in a long time and the like. Specifically, the business problems of the website service card pause, the virtual machine service card pause, and the backup data retention time are not limited herein.
Step S20, calculating and generating a layered storage strategy corresponding to the service data of different service objects according to the service strategy;
because the specific storage mode of the virtual storage system for hierarchical storage is relatively transparent for the user, and the user cannot acquire the specific storage location of the data, the business strategy set by the user on the visual terminal interface needs to be converted into the hierarchical storage strategy that can be executed by the virtual storage system through the hyper-fusion virtual computing system. In one embodiment, the business policy is transmitted to the super-converged virtual computing system over a network. Specifically, the network includes a wired network and/or a wireless network, which is not limited herein. When the super-fusion virtual computing system obtains the service policy information, the virtual computing system generates a hierarchical storage policy according to the service policy, wherein the hierarchically stored virtual storage system can perform data migration operation according to the hierarchical storage policy.
And step S30, storing different service data into the storage medium with corresponding read-write performance based on the layered storage strategy.
When a layered storage strategy is received by a virtual storage system of layered storage, the virtual storage system transfers data which needs to execute high-performance reading and writing in a time period set by a user from an existing storage medium to a storage medium supporting high-performance reading and writing operation according to specific service requirements recorded by the layered storage strategy. And when the execution of the high-performance read-write operation is finished, transferring the data which does not need to execute the high-performance read-write operation from the storage medium supporting the high-performance read-write operation to the storage medium only supporting the low-performance read-write operation. Specifically, the storage medium supporting high-performance read-write operations includes a solid-state hard disk storage medium, and the storage medium supporting only low-performance read-write operations includes a mechanical hard disk storage medium, which is not limited herein.
In the embodiment, the hierarchical storage strategies corresponding to the service data of different service objects are calculated and generated through the service strategies preset for the service objects; and storing different service data into the storage medium with corresponding read-write performance based on the layered storage strategy. Because the data can be stored hierarchically according to the service strategy preset by the specific service requirement, the combination between the hierarchical storage of the data and the specific service requirement is tighter, and the flexible hierarchical storage of the data can be performed according to different service requirements set by a user.
Further, in other embodiments, the step S10 may include:
and receiving a service strategy configured for different service virtual machines by a user according to service requirements in a preset service configuration interface.
In this embodiment, a user may set a service policy configured by the service virtual machine, which is matched with different service requirements, through a terminal interface. Specifically, the terminal interface includes a mobile terminal interface and/or a desktop terminal interface, which is not limited herein. In one embodiment, the service policy is matched with a service virtual machine, and the execution of the specific service policy is controlled by the service virtual machine, where the service policy includes an on time and an off time of the service virtual machine. The service virtual machine may be automatically created through the service policy received by the terminal, and a specific creating manner is not limited herein. The purpose of executing data hierarchical storage according to specific service requirements is achieved by driving the hyper-convergence computing system through the service virtual machine, so that the data hierarchical storage is combined with the specific service requirements more tightly, and flexible data hierarchical storage can be performed according to different service requirements set by a user.
Referring to fig. 2, fig. 2 is a schematic view illustrating a detailed flow of step S20 in fig. 1, and on the basis of the foregoing embodiment, the step S20 may include:
step S21, obtaining the service execution performance of different service objects according to the service strategy;
step S22, calculating the storage positions of the service data of the different service objects;
step S23, generating a migration policy for the service data in the storage location according to the service execution performance, and using the migration policy as a hierarchical storage policy.
In this embodiment, according to the service policy, a better read-write speed of the service object to be processed is determined, and the service execution performance is determined according to the read-write speed. And according to the service object recorded in the service strategy, the super-fusion virtual computing system acquires service data required by processing the service object, and acquires the original storage position of the service data in a storage medium through computation. And the computing system integrates the service execution performance and the original storage position of the service data, determines a migration strategy of the service data, and issues the migration strategy as a layered storage strategy to a layered storage virtual storage system. Because the data can be stored hierarchically according to the service strategy preset by the specific service requirement, the combination between the hierarchical storage of the data and the specific service requirement is tighter, and the flexible hierarchical storage of the data can be performed according to different service requirements set by a user.
Further, in other embodiments, the step S30 may include:
establishing a hierarchical trigger according to the hierarchical storage strategy;
and migrating and storing different service data into a storage medium with corresponding read-write performance by the layered trigger according to the service execution time period and/or the attribute of the service data and the service execution performance.
In this embodiment, when the virtual storage system in the hierarchical storage acquires the hierarchical storage policy, the virtual storage system determines, according to the execution time period of the service object recorded by the hierarchical storage policy, the opening time and the closing time of the hierarchical trigger, and determines, according to the opening and the closing time, the time for the hierarchical trigger to execute the trigger operation. In one embodiment, the hierarchical trigger may determine the business data required to perform the triggering operation according to the data attribute of the business object of the hierarchical storage policy record. Specifically, the data attribute is not limited herein. And combining the execution performance of the business object with the time period and the data attribute to carry out comprehensive calculation, and determining the migration action of the data. The migration operation of the service data is executed through the hierarchical trigger, and the service data related to the service object is migrated to the storage media with different reading and writing speeds according to the execution performance of the service object in the time period for processing the service object, so that the purpose of executing data hierarchical storage according to specific service requirements is realized, the combination between the data hierarchical storage and the specific service requirements is tighter, and flexible data hierarchical storage can be performed according to different service requirements set by a user.
Further, in another embodiment, if the service policy is that the service execution performance of the service object is high in a preset time period, the step S30 may include:
when a preset time period is reached or before the preset time period is reached, storing the service data of the service object into a preset high-read-write-performance storage medium;
and after a preset time period, storing the service data stored in the preset high read-write performance storage medium into the preset low read-write performance storage medium.
In this embodiment, by reducing the migration time length for transmitting the service data of the service object from the storage medium supporting only the low-performance read-write operation to the storage medium supporting the high-performance read-write operation, the problem of delay caused by suddenly executing the read-write operation of a large amount of data in a short time is avoided.
In an embodiment, when the service policy is that the service execution performance of a service object is high in a preset time period, according to the volume of a storage medium occupied by service data belonging to the service object and the data transmission rate between the storage media participating in the service data migration, the migration duration of the service data transmitted from the storage medium supporting only low-performance read-write operation to the storage medium supporting high-performance read-write operation is calculated, and the migration operation of the service data is completed before the preset time period. And after a preset time period, performing a cooling operation of the service data. Because the end time of executing the migration operation is before the start time of executing the high-performance pair operation, when the migration operation of the service data is completed, the high-performance read-write operation is not started yet, and it is ensured that when the high-performance read-write operation is started, the service data is already positioned in the storage medium supporting the high-performance read-write operation, and the delay problem caused by suddenly executing the read-write operation of a large amount of data in a short time is avoided.
In another embodiment, the migration operation is started when a preset time period is reached, and the data is transmitted from the storage medium supporting only the low-performance read-write operation to the storage medium supporting the high-performance read-write operation by reducing the heating time of the service data, for example, by converting the data read and written ten times from cold data to hot data, until the data read and written once is converted from cold data to hot data. Specifically, the number of times of reading and writing is not limited herein. And after a preset time period, performing a cooling operation of the service data. By reducing the heating time of the service data, the migration time consumed when the service data executes high-performance read-write operation is saved, and the delay problem caused by the sudden execution of a large amount of data read-write operation in a short time is avoided.
The invention further provides a virtual storage system for hierarchical storage.
Referring to fig. 3, fig. 3 is a functional module diagram of an embodiment of the virtual storage system for hierarchical storage according to the present invention.
In one embodiment, the virtual storage system for hierarchical storage comprises:
the acquisition module 01 is used for acquiring a preset service strategy for a service object;
in this embodiment, a service policy preset for a service object is first obtained, where the service policy may be a service policy set by a user according to an execution performance requirement of the user on the service object, or a service policy automatically generated according to a preset rule according to a type of the service object, and is not limited herein.
The user can set different service strategies according to different service requirements. In one embodiment, the business strategy set by the user includes business requirements for solving the problems that sales promotion of shopping websites, booking tickets and the like can cause the business quantity to swell in a short time, so that the corresponding website service is blocked and the like, and also can include business requirements for solving the problems that when a virtual machine which is idle for a long time is started, the virtual machine is blocked and the like because the virtual machine senses the upper layer slowly, and also can include business requirements for solving the problems that data for executing backup operation occupies the space of a storage medium for supporting high-performance read-write operation in a long time and the like. Specifically, the business problems of the website service card pause, the virtual machine service card pause, and the backup data retention time are not limited herein.
The calculation module 02 is used for calculating and generating a hierarchical storage strategy corresponding to the service data of different service objects according to the service strategy;
because the specific storage mode of the virtual storage system for hierarchical storage is relatively transparent for the user, and the user cannot acquire the specific storage location of the data, the business strategy set by the user on the visual terminal interface needs to be converted into the hierarchical storage strategy that can be executed by the virtual storage system through the hyper-fusion virtual computing system. In one embodiment, the business policy is transmitted to the super-converged virtual computing system over a network. Specifically, the network includes a wired network and/or a wireless network, which is not limited herein. When the super-fusion virtual computing system obtains the service policy information, the virtual computing system generates a hierarchical storage policy according to the service policy, wherein the hierarchically stored virtual storage system can perform data migration operation according to the hierarchical storage policy.
And the layered storage module 03 is configured to store different service data into storage media with corresponding read-write performance based on the layered storage policy.
When a layered storage strategy is received by a virtual storage system of layered storage, the virtual storage system transfers data which needs to execute high-performance reading and writing in a time period set by a user from an existing storage medium to a storage medium supporting high-performance reading and writing operation according to specific service requirements recorded by the layered storage strategy. And when the execution of the high-performance read-write operation is finished, transferring the data which does not need to execute the high-performance read-write operation from the storage medium supporting the high-performance read-write operation to the storage medium only supporting the low-performance read-write operation. Specifically, the storage medium supporting high-performance read-write operations includes a solid-state hard disk storage medium, and the storage medium supporting only low-performance read-write operations includes a mechanical hard disk storage medium, which is not limited herein.
In the embodiment, the hierarchical storage strategies corresponding to the service data of different service objects are calculated and generated through the service strategies preset for the service objects; and storing different service data into the storage medium with corresponding read-write performance based on the layered storage strategy. Because the data can be stored hierarchically according to the service strategy preset by the specific service requirement, the combination between the hierarchical storage of the data and the specific service requirement is tighter, and the flexible hierarchical storage of the data can be performed according to different service requirements set by a user.
Further, in other embodiments, the obtaining module 01 may be configured to:
and receiving a service strategy configured for different service virtual machines by a user according to service requirements in a preset service configuration interface.
In this embodiment, a user may set a service policy configured by the service virtual machine, which is matched with different service requirements, through a terminal interface. Specifically, the terminal interface includes a mobile terminal interface and/or a desktop terminal interface, which is not limited herein. In one embodiment, the service policy is matched with a service virtual machine, and the execution of the specific service policy is controlled by the service virtual machine, where the service policy includes an on time and an off time of the service virtual machine. The service virtual machine may be automatically created through the service policy received by the terminal, and a specific creating manner is not limited herein. The purpose of executing data hierarchical storage according to specific service requirements is achieved by driving the hyper-convergence computing system through the service virtual machine, so that the data hierarchical storage is combined with the specific service requirements more tightly, and flexible data hierarchical storage can be performed according to different service requirements set by a user.
Referring to fig. 4, fig. 4 is a schematic diagram illustrating a detailed functional module of the computing module 02 in fig. 3, and on the basis of the foregoing embodiment, the computing module 02 may include:
a service execution performance obtaining unit 021, which obtains the service execution performance levels of different service objects according to the service policies;
a storage location calculation unit 022 configured to calculate a storage location where service data of different service objects is obtained;
a generating unit 023, configured to generate a migration policy for the service data in the storage location according to the level of the service execution performance, and use the migration policy as a hierarchical storage policy.
In this embodiment, according to the service policy, a better read-write speed of the service object to be processed is determined, and the service execution performance is determined according to the read-write speed. And according to the service object recorded in the service strategy, the super-fusion virtual computing system acquires service data required by processing the service object, and acquires the original storage position of the service data in a storage medium through computation. And the computing system integrates the service execution performance and the original storage position of the service data, determines a migration strategy of the service data, and issues the migration strategy as a layered storage strategy to a layered storage virtual storage system. Because the data can be stored hierarchically according to the service strategy preset by the specific service requirement, the combination between the hierarchical storage of the data and the specific service requirement is tighter, and the flexible hierarchical storage of the data can be performed according to different service requirements set by a user.
Further, in other embodiments, the hierarchical storage module 03 may be configured to:
establishing a hierarchical trigger according to the hierarchical storage strategy;
and migrating and storing different service data into a storage medium with corresponding read-write performance by the layered trigger according to the service execution time period and/or the attribute of the service data and the service execution performance.
In this embodiment, when the virtual storage system in the hierarchical storage acquires the hierarchical storage policy, the virtual storage system determines, according to the execution time period of the service object recorded by the hierarchical storage policy, the opening time and the closing time of the hierarchical trigger, and determines, according to the opening and the closing time, the time for the hierarchical trigger to execute the trigger operation. In one embodiment, the hierarchical trigger may determine the business data required to perform the triggering operation according to the data attribute of the business object of the hierarchical storage policy record. Specifically, the data attribute is not limited herein. And combining the execution performance of the business object with the time period and the data attribute to carry out comprehensive calculation, and determining the migration action of the data. The migration operation of the service data is executed through the hierarchical trigger, and the service data related to the service object is migrated to the storage media with different reading and writing speeds according to the execution performance of the service object in the time period for processing the service object, so that the purpose of executing data hierarchical storage according to specific service requirements is realized, the combination between the data hierarchical storage and the specific service requirements is tighter, and flexible data hierarchical storage can be performed according to different service requirements set by a user.
Further, in other embodiments, if the service policy is that the service execution performance of the service object is high in a preset time period, the hierarchical storage module 03 may be configured to:
when a preset time period is reached or before the preset time period is reached, storing the service data of the service object into a preset high-read-write-performance storage medium;
and after a preset time period, storing the service data stored in the preset high read-write performance storage medium into the preset low read-write performance storage medium.
In this embodiment, by reducing the migration time length for transmitting the service data of the service object from the storage medium supporting only the low-performance read-write operation to the storage medium supporting the high-performance read-write operation, the problem of delay caused by suddenly executing the read-write operation of a large amount of data in a short time is avoided.
In an embodiment, when the service policy is that the service execution performance of a service object is high in a preset time period, according to the volume of a storage medium occupied by service data belonging to the service object and the data transmission rate between the storage media participating in the service data migration, the migration duration of the service data transmitted from the storage medium supporting only low-performance read-write operation to the storage medium supporting high-performance read-write operation is calculated, and the migration operation of the service data is completed before the preset time period. And after a preset time period, performing a cooling operation of the service data. Because the end time of executing the migration operation is before the start time of executing the high-performance pair operation, when the migration operation of the service data is completed, the high-performance read-write operation is not started yet, and it is ensured that when the high-performance read-write operation is started, the service data is already positioned in the storage medium supporting the high-performance read-write operation, and the delay problem caused by suddenly executing the read-write operation of a large amount of data in a short time is avoided.
In another embodiment, the migration operation is started when a preset time period is reached, and the data is transmitted from the storage medium supporting only the low-performance read-write operation to the storage medium supporting the high-performance read-write operation by reducing the heating time of the service data, for example, by converting the data read and written ten times from cold data to hot data, until the data read and written once is converted from cold data to hot data. Specifically, the number of times of reading and writing is not limited herein. And after a preset time period, performing a cooling operation of the service data. By reducing the heating time of the service data, the migration time consumed when the service data executes high-performance read-write operation is saved, and the delay problem caused by the sudden execution of a large amount of data read-write operation in a short time is avoided.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments. Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (8)

1. A method for tiered storage in a virtual storage system, the method comprising the steps of:
acquiring a service strategy preset for a service object, wherein the service strategy is controlled by a service virtual machine;
converting the service strategy into a layered storage strategy which corresponds to service data of different service objects and is executed by a virtual storage system through a super-fusion virtual computing system, wherein the service strategy is set on a visual terminal interface by a user;
storing different service data into storage media with corresponding read-write performance based on the layered storage strategy;
the step of converting the service policy into a hierarchical storage policy corresponding to service data of different service objects and executed by the virtual storage system through a hyper-converged virtual computing system comprises the following steps:
acquiring the service execution performance of different service objects according to the service strategy;
calculating and acquiring storage positions of service data of different service objects through a super-fusion virtual computing system;
and generating a migration strategy of the service data of the storage position according to the service execution performance by the super-fusion virtual computing system, and taking the migration strategy as a layered storage strategy executed by the virtual storage system.
2. The tiered storage method for a virtual storage system as recited in claim 1, wherein said step of obtaining a service policy preset for a service object comprises:
and receiving a service strategy configured for different service virtual machines by a user according to service requirements in a preset service configuration interface.
3. The tiered storage method of a virtual storage system as claimed in claim 1, wherein said step of storing different service data into storage media of corresponding read-write performance based on said tiered storage policy comprises:
establishing a hierarchical trigger according to the hierarchical storage strategy;
and migrating and storing different service data into a storage medium with corresponding read-write performance by the layered trigger according to the service execution time period and/or the attribute of the service data and the service execution performance.
4. The tiered storage method of a virtual storage system as claimed in claim 1, wherein if the service policy is that the service execution performance of a service object is high within a preset time period, the step of storing different service data into a storage medium with corresponding read-write performance based on the tiered storage policy comprises:
when a preset time period is reached or before the preset time period is reached, storing the service data of the service object into a preset high-read-write-performance storage medium;
and after a preset time period, storing the service data stored in the preset high read-write performance storage medium into the preset low read-write performance storage medium.
5. A virtual storage system for tiered storage, said virtual storage system comprising:
the acquisition module is used for acquiring a preset service strategy for a service object, and the service strategy is controlled by a service virtual machine;
the computing module is used for converting the business strategy into a layered storage strategy which corresponds to the business data of different business objects and is executed by the virtual storage system through the super-fusion virtual computing system, wherein the business strategy is set by a user on a visual terminal interface;
the layered storage module is used for storing different service data into storage media with corresponding read-write performance based on the layered storage strategy;
wherein the calculation module comprises:
a service execution performance obtaining unit, configured to obtain service execution performance levels of different service objects according to the service policy;
the storage position calculation unit is used for calculating and acquiring the storage positions of the service data of different service objects through the super-fusion virtual calculation system;
and the generating unit is used for generating a migration strategy of the service data of the storage position according to the service execution performance through a super-fusion virtual computing system, and taking the migration strategy as a layered storage strategy executed by the virtual storage system.
6. The hierarchically stored virtual storage system of claim 5, wherein the acquisition module is further configured to:
and receiving a service strategy configured for different service virtual machines by a user according to service requirements in a preset service configuration interface.
7. The hierarchically stored virtual storage system of claim 5, wherein the layered storage module is further configured to:
establishing a hierarchical trigger according to the hierarchical storage strategy; and migrating and storing different service data into a storage medium with corresponding read-write performance by the layered trigger according to the service execution time period and/or the attribute of the service data and the service execution performance.
8. The virtual storage system of claim 5, wherein if the business policy is that the business execution performance of the business object is high within a preset time period, the hierarchical storage module is further configured to:
storing the service data of the service object into a preset high read-write performance storage medium before reaching a preset time period or reaching the preset time period; and after a preset time period, storing the service data stored in the preset high read-write performance storage medium into the preset low read-write performance storage medium.
CN201610108921.9A 2016-02-26 2016-02-26 Layered storage method of virtual storage system and virtual storage system Active CN107132991B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610108921.9A CN107132991B (en) 2016-02-26 2016-02-26 Layered storage method of virtual storage system and virtual storage system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610108921.9A CN107132991B (en) 2016-02-26 2016-02-26 Layered storage method of virtual storage system and virtual storage system

Publications (2)

Publication Number Publication Date
CN107132991A CN107132991A (en) 2017-09-05
CN107132991B true CN107132991B (en) 2020-11-20

Family

ID=59720658

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610108921.9A Active CN107132991B (en) 2016-02-26 2016-02-26 Layered storage method of virtual storage system and virtual storage system

Country Status (1)

Country Link
CN (1) CN107132991B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI697786B (en) * 2019-05-24 2020-07-01 威聯通科技股份有限公司 Virtual machine building method based on hyper converged infrastructure

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1801923A (en) * 2005-01-05 2006-07-12 中央电视台 hierarchical storage management system
CN101311911A (en) * 2007-05-23 2008-11-26 株式会社日立制作所 Staging memory system and data migration method thereof
CN102841931A (en) * 2012-08-03 2012-12-26 中兴通讯股份有限公司 Storage method and storage device of distributive-type file system
CN103106047A (en) * 2013-01-29 2013-05-15 浪潮(北京)电子信息产业有限公司 Storage system based on object and storage method thereof
CN104025058A (en) * 2012-03-29 2014-09-03 日立数据系统有限公司 Content selection for storage tiering
CN104468737A (en) * 2013-12-13 2015-03-25 浪潮(北京)电子信息产业有限公司 Storage hierarchical scheduling method and system based on service type characteristics

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7130807B1 (en) * 1999-11-22 2006-10-31 Accenture Llp Technology sharing during demand and supply planning in a network-based supply chain environment
JP2001297026A (en) * 2000-04-11 2001-10-26 Hitachi Ltd Computer system having multiple database management systems
US8688601B2 (en) * 2011-05-23 2014-04-01 Symantec Corporation Systems and methods for generating machine learning-based classifiers for detecting specific categories of sensitive information
CN102508789A (en) * 2011-10-14 2012-06-20 浪潮电子信息产业股份有限公司 Grading storage method for system
US9471243B2 (en) * 2011-12-15 2016-10-18 Veritas Technologies Llc Dynamic storage tiering in a virtual environment
CN103914516B (en) * 2014-02-25 2017-09-08 深圳市中博科创信息技术有限公司 A kind of method and system of storage system multi-zone supervision
CN104462240A (en) * 2014-11-18 2015-03-25 浪潮(北京)电子信息产业有限公司 Method and system for realizing hierarchical storage and management in cloud storage

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1801923A (en) * 2005-01-05 2006-07-12 中央电视台 hierarchical storage management system
CN101311911A (en) * 2007-05-23 2008-11-26 株式会社日立制作所 Staging memory system and data migration method thereof
CN104025058A (en) * 2012-03-29 2014-09-03 日立数据系统有限公司 Content selection for storage tiering
CN102841931A (en) * 2012-08-03 2012-12-26 中兴通讯股份有限公司 Storage method and storage device of distributive-type file system
CN103106047A (en) * 2013-01-29 2013-05-15 浪潮(北京)电子信息产业有限公司 Storage system based on object and storage method thereof
CN104468737A (en) * 2013-12-13 2015-03-25 浪潮(北京)电子信息产业有限公司 Storage hierarchical scheduling method and system based on service type characteristics

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
数字图书馆实施分层存储管理初探;张蕊;《现代情报》;20070125;1-2 *

Also Published As

Publication number Publication date
CN107132991A (en) 2017-09-05

Similar Documents

Publication Publication Date Title
US11487760B2 (en) Query plan management associated with a shared pool of configurable computing resources
CN105205014B (en) A kind of date storage method and device
US8521986B2 (en) Allocating storage memory based on future file size or use estimates
CN105335219A (en) Distribution-based task scheduling method and system
CN104216662B (en) Optimal Volume Placement Across Remote Replication Relationships
KR20110091421A (en) How to provide OS-based storage tiering and migration, computer program products, and storage systems
CN103455577A (en) Multi-backup nearby storage and reading method and system of cloud host mirror image file
CN102982182B (en) Data storage planning method and device
CN108475201A (en) A kind of data capture method in virtual machine start-up course and cloud computing system
CN110007870A (en) A kind of storage equipment write request processing method and relevant apparatus
CN102523105B (en) Failure recovery method of data storage and applied data distribution framework thereof
US8924642B2 (en) Monitoring record management method and device
US10803109B2 (en) Method and device for reading and writing video data in NAS device
CN108769123B (en) Data system and data processing method
Irie et al. A novel automated tiered storage architecture for achieving both cost saving and qoe
CN107132991B (en) Layered storage method of virtual storage system and virtual storage system
CN103605795A (en) Metadata-based file storage method and device
CN103713860A (en) Method and system for building virtual disk base on basis of backup architecture
US11977785B2 (en) Non-volatile memory device-assisted live migration of virtual machine data
CN109669814A (en) A kind of restoration methods of Metadata Service, device, equipment and readable storage medium storing program for executing
CN103064926A (en) Data processing method and device
CN107577428A (en) A kind of date storage method and device
CN114328007A (en) Container backup and restoration method, device and medium thereof
US10708340B2 (en) Methods and systems for improving efficiency in data transfers
CN101840313B (en) LUN mirror image processing method and equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: Nanshan District Xueyuan Road in Shenzhen city of Guangdong province 518000 No. 1001 Nanshan Chi Park building A1 layer

Applicant after: SANGFOR TECHNOLOGIES Inc.

Address before: Nanshan District Xueyuan Road in Shenzhen city of Guangdong province 518052 No. 1001 Nanshan Chi Park building A1 layer

Applicant before: Sangfor Technologies Co.,Ltd.

GR01 Patent grant
GR01 Patent grant