[go: up one dir, main page]

CN106681649A - Distributed storage metadata accelerating method - Google Patents

Distributed storage metadata accelerating method Download PDF

Info

Publication number
CN106681649A
CN106681649A CN201510745386.3A CN201510745386A CN106681649A CN 106681649 A CN106681649 A CN 106681649A CN 201510745386 A CN201510745386 A CN 201510745386A CN 106681649 A CN106681649 A CN 106681649A
Authority
CN
China
Prior art keywords
metadata
business
solid
cache
methods described
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510745386.3A
Other languages
Chinese (zh)
Inventor
杨造文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hunan Bailimu Technology Co Ltd
Original Assignee
Hunan Bailimu Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hunan Bailimu Technology Co Ltd filed Critical Hunan Bailimu Technology Co Ltd
Priority to CN201510745386.3A priority Critical patent/CN106681649A/en
Publication of CN106681649A publication Critical patent/CN106681649A/en
Pending legal-status Critical Current

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention relates to a distributed storage metadata accelerating method. According to the method, solid-state discs are configured through a computer storage server, mirror images of the two solid-state discs become a virtual secondary caching disc, and the secondary caching disc is arranged between cache for business reading and writing and a memory of a physical hard disc, is used for processing storage of metadata information of business access data, and is synchronized to storage nodes of other computers in a distributed manner. In the method, capability of high random reading and writing performance of the solid-state discs and the characteristic that data are not lost after power failure are utilized, and rapid reading, writing and synchronization of metadata can be realized effectively to improve reading and writing performance of a distributed storage system.

Description

A kind of distributed storage metadata accelerated method
Technical field
Patent of the present invention is related to Computer Storage field.
Background technology
As informationalized huge explosion and data exponentially level increase, the storage system of processing data is adopted During with traditional single control or dual controller framework, traffic handing capacity cannot much complete mass data Process demand, and distributed memory system is all many times to sacrifice certain performance to guarantee data Strong consistency;The appearance of solid-state disk solves the problems, such as well performance bottleneck, but the price of solid-state disk It is high so that compartment system storage system is too high using the solution cost of all solid state disk.
Therefore be highly desirable to design a kind of mechanism of L2 cache, be applied to distributed memory system with Lift the read-write of service metadata and be synchronized to other distributed storage nodes, to lift Business Processing energy Power.
Patent of invention content
Patent of the present invention is related to a kind of distributed storage metadata accelerated method, and the method passes through computer Storage server configures solid-state disk, and two pieces of solid-state disk mirrorings are a virtual L2 cache disk, and this two Level disc cache is arranged between the caching of business read-write and physical hard disk storage, for processing business access The storage of the metadata information of data and distributed synchronization are to other Computer Storage nodes, the method profit With the ability of the high random read-write performance of solid-state disk, and the characteristics of data are not lost after power down, can have Fast reading and writing and the synchronization of realizing metadata of effect, to lift the business property read and write of distributed memory system Energy.
Description of the drawings
Fig. 1 is a kind of distributed storage metadata accelerated method structural representation of patent of the present invention.
Specific embodiment
In order that the purpose of patent of the present invention, technical scheme and advantage become more apparent, below in conjunction with Drawings and Examples, are further elaborated to patent of the present invention.It should be appreciated that this place is retouched The specific embodiment stated only to explain patent of the present invention, is not intended to limit the present invention patent.
Fig. 1 is referred to, Fig. 1 is a kind of distributed storage metadata accelerated method structure of patent of the present invention Schematic diagram.
A kind of distributed storage metadata accelerated method, it is characterised in that the hardware of methods described is constituted For Computer Storage server (14a), (14b) and (14c) more than three, and solid-state disk (12a), (12b) with (12c), and physical hard disk (15), the logic components of methods described are constituted solid-state disk L2 cache (13a), (13b) and (13c) after mirror image, the business datum of methods described is constituted For metadata (10a) and (10b), business datum (11a) and (11b).
A kind of distributed storage metadata accelerated method, it is characterised in that the business of methods described writes stream Journey is service metadata (10a) and business datum (11a) when distributed memory system is written to, industry Business metadata (10a) can first write the virtual L2 cache (13a) of solid-state disk, then same by (13a) Step write is all (13b) and (13c) of L2 cache, while business datum (11a) write is calculated In machine memory node (14a), treat that data write is returned to after the completion of two above step to be completed, while Backstage is index according to the information of service metadata (10a), and finishing service data (11a) are synchronously written To in Computer Storage node (14b) and (14c).The service metadata (10b) and business number Business processing flow according to (11b) is identical with upper, difference be processing business metadata (10b) and The main L2 cache of business datum (11b) is (13b) and Computer Storage node is (14b).
A kind of distributed storage metadata accelerated method, it is characterised in that the business of methods described reads stream Journey is first to retrieve the virtual L2 cache (13a) of solid-state disk, such as retrieves service metadata (10a), The business datum (11a) in Computer Storage node (14a) is then directly read with finishing service read request, To other Nodes Retrieval service metadatas (10a) if not retrieving, other are processed reads flow process ibid.
A kind of distributed storage metadata accelerated method, it is characterised in that methods described is practically applicable to simultaneously Distributed storage node is stored as the scene of two parts of copy datas and three parts of copy datas.
The preferred embodiment of patent of the present invention is the foregoing is only, it is of the invention not special to limit Profit, all any modification, equivalent and improvement made within the spirit and principle of patent of the present invention Deng should be included within the protection domain of patent of the present invention.

Claims (4)

1. a kind of distributed storage metadata accelerated method, it is characterised in that the hardware structure of methods described Become Computer Storage server (14a), (14b) and (14c) more than three, and solid-state disk (12a), (12b) with (12c), and physical hard disk (15), the logic components of methods described are constituted solid-state disk L2 cache (13a), (13b) and (13c) after mirror image, the business datum of methods described is constituted For metadata (10a) and (10b), business datum (11a) and (11b).
2. a kind of distributed storage metadata accelerated method according to claim 1, its feature exists In it is that service metadata (10a) and business datum (11a) are writing that the business of methods described writes flow process During to distributed memory system, service metadata (10a) can first write the virtual L2 cache of solid-state disk (13a) (13b) and (13c) for being all L2 cache, then by (13a) is synchronously written, while industry In business data (11a) write Computer Storage node (14a), treat just to be returned after the completion of two above step Return data write to complete, while backstage is index according to the information of service metadata (10a), complete industry Business data (11a) is synchronously written in Computer Storage node (14b) and (14c).The business The business processing flow of metadata (10b) and business datum (11b) is identical with upper, and difference is place The main L2 cache of reason service metadata (10b) and business datum (11b) is (13b) and computer Memory node is (14b).
3. a kind of distributed storage metadata accelerated method according to claim 1, its feature exists In it is first to retrieve the virtual L2 cache (13a) of solid-state disk that the business of methods described reads flow process, is such as examined Rope then directly reads the business datum in Computer Storage node (14a) to service metadata (10a) (11a) with finishing service read request, to other Nodes Retrieval service metadatas (10a) if not retrieving, Other are processed reads flow process ibid.
4. a kind of distributed storage metadata accelerated method according to claim 1, its feature exists In simultaneously methods described is practically applicable to distributed storage node and is stored as two parts of copy datas and three parts of copies The scene of data.
CN201510745386.3A 2015-11-06 2015-11-06 Distributed storage metadata accelerating method Pending CN106681649A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510745386.3A CN106681649A (en) 2015-11-06 2015-11-06 Distributed storage metadata accelerating method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510745386.3A CN106681649A (en) 2015-11-06 2015-11-06 Distributed storage metadata accelerating method

Publications (1)

Publication Number Publication Date
CN106681649A true CN106681649A (en) 2017-05-17

Family

ID=58857322

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510745386.3A Pending CN106681649A (en) 2015-11-06 2015-11-06 Distributed storage metadata accelerating method

Country Status (1)

Country Link
CN (1) CN106681649A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1852318A (en) * 2006-04-19 2006-10-25 华中科技大学 Distributed multi-stage buffer storage system suitable for object network storage
CN102216899A (en) * 2008-11-14 2011-10-12 微软公司 Managing cache data and metadata
US20110258374A1 (en) * 2010-04-19 2011-10-20 Greenbytes, Inc. Method for optimizing the memory usage and performance of data deduplication storage systems
CN102467408A (en) * 2010-11-12 2012-05-23 阿里巴巴集团控股有限公司 Method and device for accessing data of virtual machine
CN103218179A (en) * 2013-04-23 2013-07-24 深圳市京华科讯科技有限公司 Second-level system acceleration method based on virtualization

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1852318A (en) * 2006-04-19 2006-10-25 华中科技大学 Distributed multi-stage buffer storage system suitable for object network storage
CN102216899A (en) * 2008-11-14 2011-10-12 微软公司 Managing cache data and metadata
US20110258374A1 (en) * 2010-04-19 2011-10-20 Greenbytes, Inc. Method for optimizing the memory usage and performance of data deduplication storage systems
CN102467408A (en) * 2010-11-12 2012-05-23 阿里巴巴集团控股有限公司 Method and device for accessing data of virtual machine
CN103218179A (en) * 2013-04-23 2013-07-24 深圳市京华科讯科技有限公司 Second-level system acceleration method based on virtualization

Similar Documents

Publication Publication Date Title
CN102467408B (en) Method and device for accessing data of virtual machine
US10303596B2 (en) Read-write control method for memory, and corresponding memory and server
CN105574104B (en) A kind of LogStructure storage system and its method for writing data based on ObjectStore
CN110019112B (en) Data transaction processing method and device and electronic equipment
CN102945207A (en) Cache management method and system for block-level data
CN101826044A (en) Method and device for copying data volume under single structure
CN104267912A (en) NAS (Network Attached Storage) accelerating method and system
CN107391544B (en) Processing method, device and equipment of column type storage data and computer storage medium
US20140068216A1 (en) Storage system for supporting copy command and move command and operation method of storage system
US9678871B2 (en) Data flush of group table
CN110989924B (en) Metadata storage performance optimization method and storage server
CN104750433A (en) Cache design method based on SCST
US10783021B2 (en) Transaction management for multi-node clusters
CN104965835A (en) Method and apparatus for reading and writing files of a distributed file system
CN103617195A (en) Data synchronization system and data synchronization method used for MySQL database
CN106469119A (en) A kind of data write buffer method based on NVDIMM and its device
CN107402802A (en) A kind of video monitoring storage system based on virtual machine
CN107193693A (en) A kind of online data storage optimization method based on storage system
US11789622B2 (en) Method, device and computer program product for storage management
US11010091B2 (en) Multi-tier storage
CN105892954A (en) Data storage method and device based on multiple copies
CN106681649A (en) Distributed storage metadata accelerating method
CN113448722A (en) Mapping method of process memory and instance processing method based on serverless architecture
US20230251799A1 (en) Non-volatile memory device -assisted live migration of virtual machine data
CN109582235A (en) Manage metadata storing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20170517

WD01 Invention patent application deemed withdrawn after publication