CN104283959B - A kind of memory mechanism based on grading performance suitable for cloud platform - Google Patents
A kind of memory mechanism based on grading performance suitable for cloud platform Download PDFInfo
- Publication number
- CN104283959B CN104283959B CN201410543045.3A CN201410543045A CN104283959B CN 104283959 B CN104283959 B CN 104283959B CN 201410543045 A CN201410543045 A CN 201410543045A CN 104283959 B CN104283959 B CN 104283959B
- Authority
- CN
- China
- Prior art keywords
- lun
- logical volume
- cloud platform
- volume
- virtual machine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000007246 mechanism Effects 0.000 title claims abstract description 12
- 230000004807 localization Effects 0.000 claims abstract description 12
- 238000013500 data storage Methods 0.000 claims description 2
- 238000004364 calculation method Methods 0.000 abstract description 2
- 238000000034 method Methods 0.000 description 4
- 239000012634 fragment Substances 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45504—Abstract machines for programme code execution, e.g. Java virtual machine [JVM], interpreters, emulators
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to field of cloud calculation, particularly relates to a kind of memory mechanism based on grading performance suitable for cloud platform.It is of the invention that LUN divisions are first carried out inside special purpose memory devices, and storage resource is externally provided in a manner of SAN；Then, find and log in LUN equipment, make its localization；The equipment creates logical volume group on a physical server wherein, and shares the volume group；After all LUN collaborative shares, when creating virtual machine, storage device is selected to the height of IO speed requirements according to virtual machine, then in the logical volume to corresponding virtual hard disk size should be created in the volume group of storage device；The mirror image of virtual machine is injected on the logical volume of corresponding volume group establishment again, uses establishing logical volume virtual machine.The mechanism of the present invention provides the ability for balancing whole cloud platform platform storage I/O load, and cloud platform can be scheduled on each physical server；It can be used in the storage management of cloud platform.
Description
Technical field
The present invention relates to field of cloud calculation, particularly relates to a kind of storage machine based on grading performance suitable for cloud platform
System.
Background technology
Under traditional mode, when large corporation carries out informatization, special storage device (such as IP-SAN) is purchased
It is a kind of universal selection as storage device；The storage of high-performance and high reliability can be so provided.With memory technology
Development, and continuous improvement of the application to memory requirement, large corporation can unavoidably be updated to special purpose memory devices and change
Generation, therefore, these in-house special purpose memory devices that generally there are more relatives of Taiwan compatriots living on the Mainland and differ in different generations, performance height.How
A problem always is using old special purpose memory devices.In cloud platform, these equipment can be typically assigned to different
Cluster, the physical server being mounted in cluster use as memory space.Can this application method can bring the drawbacks of following：
1st, in the case where being assigned to the cluster of the relatively low storage device of performance, because IO speed is relatively low, the physics clothes under the cluster
Being engaged in, device need I/O request to be processed is comparatively also less, and the load of whole cluster is relatively low；On the contrary, be assigned to performance compared with
Under the cluster of high storage device, the load of whole cluster is of a relatively high, and the performance of whole cloud platform has no idea to be balanced,
The treatment effeciency of platform is than relatively low.
2nd, for whole memory space, in the cluster being had been categorized into due to memory space, it is impossible in platform aspect
Use to memory space is planned and dispatched, and therefore, this method easily brings the waste of memory space, is deposited in single
Fragment is easily caused in storage equipment.
The content of the invention
Present invention solves the technical problem that be to provide a kind of memory mechanism based on grading performance suitable for cloud platform,
Solve deficiency existing for conventional method, lift the IO efficiency of whole cloud platform, reduce the generation of memory space fragment, improve storage
The solution of space availability ratio.
The present invention solve above-mentioned technical problem technical scheme be：
Comprise the following steps：
Step 1：By managing each special purpose memory devices of network entry, LUN divisions are internally carried out, and by LUN with SAN
Mode externally provides storage resource；
Step 2：Needed to use in cloud platform and LUN equipment is found and logged on the physical server of memory space, make it
Ground；
Step 3：Logical volume group is created using the storage device of localization on a physical server wherein, makes this physics
Server and other physical servers share the volume group；
Step 4：LUN equipment in all special purpose memory devices is all shared according to previous step, after completion,
All multiple volume groups of carry on every physical server；
Step 5：When creating virtual machine, storage device is selected to the height of IO speed requirements according to virtual machine, then right
The logical volume for corresponding to virtual hard disk size should be created in the volume group of storage device；
Step 6：The mirror image of virtual machine is injected on the logical volume of corresponding volume group establishment, it is virtual using establishing logical volume
Machine.
Described step a kind, LUN (Logical Unit Number) is LUN, for describing by each special
The logical volume of storage device division；SAN is the storage area network of high speed private networks or subnet, in data server
Connection is provided between different types of data storage device.
The localization of described step 2 is the basis that storage device creates logical volume group, when LUN passes through SAN mode carries
It is then further to LUN to be operated first in the LUN localizations that carry comes to after physical server.
In described step 3, storage that volume group (Volume Group, VG) is made up of one or more physical volumes
Pond, one or more logical volumes can be created in volume group；
Described physical volume (Physical Volume, PV) refers to fdisk, or DISK to Image or has created
Software PLC (Redundant Arrays of independent Disks, disk array), is LVM (Logical Volume
Manager, logical volume management) basic storage device；
Described logical volume (Logical Volume, LV) is the block device of a standard, is established on volume group；Patrolling
File system can be established on volume by collecting.
The IO speed requirements of described step 5, mainly virtual machine access the speed requirement of data for storage volume.
The mechanism of the present invention provides the ability for balancing whole cloud platform storage I/O load, and cloud platform can be in each physics
It is scheduled on server, the high-performance storage device that the high virtual machine of I/O load is operated on different physical servers is corresponding
Volume group on, and then lift the IO efficiency of whole cloud platform；The mechanism of the present invention provides the whole cloud platform storage space of scheduling
Ability, be in for I/O load for the virtual machine of medium level, can according to the size of its magnetic disk of virtual machine space-consuming,
Purpose according to the preferential storage small using remaining space is scheduled, it is possible to reduce the generation of memory space fragment, raising are deposited
Store up the utilization rate in space；The mechanism of the present invention can provide storage volume due to carrying out the division of memory space using volume group
The characteristic of dynamic expansion.
Brief description of the drawings
The present invention is further described below in conjunction with the accompanying drawings：
Fig. 1 is the flow chart of the present invention；
Fig. 2 is the model support composition of the present invention.
Embodiment
Embodiments of the present invention have it is a variety of, herein by external storage LUN with side of the IP-SAN carries to physical server
Illustrate one of which implementation method exemplified by formula, as shown in Figure 1, 2, specific implementation process is as follows
1st, by managing each special purpose memory devices of network entry, LUN division is internally carried out, and by LUN with IP-
SAN modes externally provide storage resource；
Here LUN is mounted on the multiple physical servers specified by storage device client.
2nd, needed to use in cloud platform and LUN equipment is found and logged on the physical server of memory space, make its localization；
It was found that LUN, bottom order is as follows：
#iscsiadm-m discovery-t sendtargets-p 10.10.10.3：3260-- has found IQN
#iscsiadm-m node-p 10.10.10.3：3260-T iqn.2lun.com-l-- according to IQN,
Search LUN device numbers
#ll/dev/disk/by-path | grep " iqn.2lun.com " -- list LUN quantity
#fdisk-l | grep device numbers -- search LUN sizes
Parameter interpretation：
-p 10.10.10.3：3260 storage pool server ips and port, IP connect for the centrally stored storage network interface card that externally provides
The IP of mouth, it is constant that port is generally 3260.
Log in LUN equipment：
#iscsiadm-m node-T [device]-o update--namenode.session.auth.authmethod--
Value=CHAP
#iscsiadm-m node-T [device]-o update--name node.session.auth.username--
Value=[user name]
#iscsiadm-m node-T [device]-o update--name node.session.auth.password--
Value=[password]
3rd, logical volume group is created using the storage device of localization on a physical server wherein, makes this physical services
Device and other physical servers share the volume group；
LUN is made physical volume by #pvcreate/dev/sdd--
#vgcreate VG_XenStorage-3bd23141/dev/sdd-- make VG volumes of group on the basis of physical machine volume
4th, the LUN equipment in all special purpose memory devices is all shared according to step 3, after completion, in every thing
Manage on server all multiple volume groups of carry；
Other physical servers are performed to issue orders, and share the volume group
#lvscan grep volumegroup names -- check volume group state
#lvchange-ay/dev/ volumegroup names claim -- and the volume group is shared in activation
When the 5th, creating virtual machine, storage device is selected to the height of IO speed requirements according to virtual machine, then to should
The logical volume of corresponding virtual hard disk size is created in the volume group of storage device；
#lvcreate-L 20G-n lv_kvm vg_name-- create logic volume size
Parameter interpretation：
The vg_name-- volumegroup names to be created claim
The lv_kvm- logical volume names to be created
6th, the mirror image of virtual machine is injected on the logical volume that step 5 creates, uses establishing logical volume virtual machine.
#dd if=/root/win2008-R2-64bit-20G-original.qcow2 of=/dev/vg_name/
Lv_kvm bs=5M
-- the mirror image of virtual machine is injected into the logical volume lv_kvm created.
Claims (4)
- A kind of 1. memory mechanism based on grading performance suitable for cloud platform, it is characterised in that：Comprise the following steps:Step 1：By managing each special purpose memory devices of network entry, LUN divisions are internally carried out, and by LUN in a manner of SAN Storage resource is externally provided；Step 2：Needed to use in cloud platform and LUN equipment is found and logged on the physical server of memory space, make its localization；Step 3：Logical volume group is created using the storage device of localization on a physical server wherein, makes this physical services Device and other physical servers share the volume group；Step 4：LUN equipment in all special purpose memory devices is all shared according to previous step, after completion, at every All multiple volume groups of carry on physical server；Step 5：When creating virtual machine, storage device is selected to the height of IO speed requirements according to virtual machine, then to should The logical volume of corresponding virtual hard disk size is created in the volume group of storage device；Step 6：The mirror image of virtual machine is injected on the logical volume of corresponding volume group establishment, uses establishing logical volume virtual machine；In described step 3, storage pool that volume group is made up of one or more physical volumes, can be created in volume group one or Multiple logical volumes；Described physical volume refers to fdisk, or DISK to Image or the software PLC that has created, is that LVM basic storage is set It is standby；Described logical volume is the block device of a standard, is established on volume group；File system can be established on logical volume System；The IO speed requirements of described step 5, mainly virtual machine access the speed requirement of data for storage volume.
- 2. the memory mechanism based on grading performance according to claim 1 suitable for cloud platform, it is characterised in that：It is described Step 1 in, LUN is LUN, for describing the logical volume that is divided by each special purpose memory devices；SAN is special at a high speed With the storage area network of network or subnet, to be provided between data server and different types of data storage device Connection.
- 3. the memory mechanism based on grading performance according to claim 1 suitable for cloud platform, it is characterised in that：It is described Step 2 localization be storage device create logical volume group basis, when LUN is mounted to physical server by SAN modes Afterwards, it is then further to LUN to be operated first in the LUN localizations that carry comes.
- 4. the memory mechanism based on grading performance according to claim 2 suitable for cloud platform, it is characterised in that：It is described Step 2 localization be storage device create logical volume group basis, when LUN is mounted to physical server by SAN modes Afterwards, it is then further to LUN to be operated first in the LUN localizations that carry comes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410543045.3A CN104283959B (en) | 2014-10-14 | 2014-10-14 | A kind of memory mechanism based on grading performance suitable for cloud platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410543045.3A CN104283959B (en) | 2014-10-14 | 2014-10-14 | A kind of memory mechanism based on grading performance suitable for cloud platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104283959A CN104283959A (en) | 2015-01-14 |
| CN104283959B true CN104283959B (en) | 2018-01-09 |
Family
ID=52258432
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410543045.3A Active CN104283959B (en) | 2014-10-14 | 2014-10-14 | A kind of memory mechanism based on grading performance suitable for cloud platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104283959B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105159908A (en) * | 2015-07-02 | 2015-12-16 | 浪潮(北京)电子信息产业有限公司 | Database cloning method and apparatus |
| CN108234551B (en) * | 2016-12-15 | 2021-06-25 | 腾讯科技（深圳）有限公司 | Data processing method and device |
| CN107357531B (en) * | 2017-07-12 | 2020-10-16 | 苏州浪潮智能科技有限公司 | A disk array-based virtual machine operating method, device and system |
| CN107797766A (en) * | 2017-09-27 | 2018-03-13 | 郑州云海信息技术有限公司 | A kind of method and apparatus for creating volume |
| CN107621927B (en) * | 2017-09-29 | 2020-08-14 | 南京宏海科技有限公司 | Longitudinal extension method and device based on super-fusion system |
| CN109032521B (en) * | 2018-07-25 | 2019-09-10 | 星环信息科技（上海）有限公司 | Storage volume creation method, device, server and storage medium |
| CN109547537A (en) * | 2018-11-05 | 2019-03-29 | 中国电子科技集团公司第二十八研究所 | The method for realizing openstack High Availabitity based on SAN storage shared volume |
| CN111880738A (en) * | 2020-07-29 | 2020-11-03 | 浪潮云信息技术股份公司 | A method for automatically creating and mounting LVM volumes in a K8s environment |
| CN112148224B (en) * | 2020-09-23 | 2023-01-31 | 山东省计算中心（国家超级计算济南中心） | Method and system for improving virtualized storage performance |
| CN113504954B (en) * | 2021-07-08 | 2024-02-06 | 华云数据控股集团有限公司 | Method, system and medium for calling CSI LVM plug in and dynamic persistent volume supply |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102147770A (en) * | 2011-03-28 | 2011-08-10 | 杭州电子科技大学 | Storage resource management system and method |
| CN102713825A (en) * | 2009-12-16 | 2012-10-03 | 赛门铁克公司 | Storage visibility in virtual environments |
| CN103399783A (en) * | 2013-08-07 | 2013-11-20 | 曙光信息产业(北京)有限公司 | Storage method and device of mirror image documents of virtual machines |
-
2014
- 2014-10-14 CN CN201410543045.3A patent/CN104283959B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102713825A (en) * | 2009-12-16 | 2012-10-03 | 赛门铁克公司 | Storage visibility in virtual environments |
| CN102147770A (en) * | 2011-03-28 | 2011-08-10 | 杭州电子科技大学 | Storage resource management system and method |
| CN103399783A (en) * | 2013-08-07 | 2013-11-20 | 曙光信息产业(北京)有限公司 | Storage method and device of mirror image documents of virtual machines |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104283959A (en) | 2015-01-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104283959B (en) | A kind of memory mechanism based on grading performance suitable for cloud platform | |
| CN104156216B (en) | A kind of memory management system and method towards cloud computing | |
| CN109643312B (en) | Hosted query service | |
| CN102571916B (en) | A kind of framework of renting software of cloud memory space and method of operation | |
| CN105978704B (en) | System and method for creating new cloud resource instruction set architecture | |
| CN102147770B (en) | Storage resource management system and method | |
| US8819230B2 (en) | Virtual private storage array service for cloud servers | |
| CN104579740B (en) | For managing the method and system of virtual network interface | |
| CN104484279B (en) | A kind of method that centrally stored above quota distribution suitable for cloud computing uses | |
| CN104270409B (en) | Centrally stored method is efficiently utilized in a kind of cloud platform | |
| CN101815095B (en) | A kind of SAN stored resource unified management and distribution method | |
| CN103365725A (en) | Method and system for dynamic allocation of workload deployment units across a plurality of clouds | |
| CN105808634A (en) | Distributed map reduce network | |
| CN102123176B (en) | Space distribution and management method and device for network storage system | |
| CN104050248A (en) | File storage system and storage method | |
| CN102801636B (en) | The method of cloud computing platform cloud mainframe network bandwidth restriction | |
| WO2015029341A1 (en) | Distributed database system and selection device | |
| CN104731907A (en) | NOSQL-based data storage method | |
| US11307900B2 (en) | Adjustment of the number of central processing units to meet performance requirements of an I/O resource | |
| CN102307236A (en) | Cloud-storage-structure-based remote storage management system | |
| CN105630607B (en) | A kind of resource pool management method, container creation method and electronic equipment | |
| CN109951320A (en) | An extensible multi-level monitoring framework for cloud platform and its monitoring method | |
| CN102833334A (en) | Logical volume management method | |
| CN104113606A (en) | Uniformity dynamically-balanced distributed metadata node framework | |
| CN103036952B (en) | A kind of enterprise-level isomery merges storage management system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder |
Address after: 523808 19th Floor, Cloud Computing Center, Chinese Academy of Sciences, No. 1 Kehui Road, Songshan Lake Hi-tech Industrial Development Zone, Dongguan City, Guangdong Province Patentee after: G-Cloud Technology Co., Ltd. Address before: 523808 No. 14 Building, Songke Garden, Songshan Lake Science and Technology Industrial Park, Dongguan City, Guangdong Province Patentee before: G-Cloud Technology Co., Ltd. |
|
| CP02 | Change in the address of a patent holder |