[go: up one dir, main page]

CN111143126A - A data copy method, system and related components of a distributed file system - Google Patents

A data copy method, system and related components of a distributed file system Download PDF

Info

Publication number
CN111143126A
CN111143126A CN201911330447.4A CN201911330447A CN111143126A CN 111143126 A CN111143126 A CN 111143126A CN 201911330447 A CN201911330447 A CN 201911330447A CN 111143126 A CN111143126 A CN 111143126A
Authority
CN
China
Prior art keywords
metadata
data structure
client
target data
copy
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201911330447.4A
Other languages
Chinese (zh)
Inventor
李文鹏
王帅阳
张端
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
IEIT Systems Co Ltd
Original Assignee
Inspur Electronic Information Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Electronic Information Industry Co Ltd filed Critical Inspur Electronic Information Industry Co Ltd
Priority to CN201911330447.4A priority Critical patent/CN111143126A/en
Publication of CN111143126A publication Critical patent/CN111143126A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The application discloses a data copying method of a distributed file system, which comprises the steps of receiving a copying request sent by a client, and determining a target data structure corresponding to the copying request; generating metadata of the target data structure, and associating the metadata of the target data structure with metadata of a source file in the distributed file system to obtain an association relation; and modifying the source file according to the data modification instruction sent by the client, and executing copy-on-write operation on the target data structure in the client according to the incidence relation. The data copying efficiency can be improved. The application also discloses a data copying system of the distributed file system, an electronic device and a storage medium, and the data copying system, the electronic device and the storage medium have the beneficial effects.

Description

Data copying method, system and related components of distributed file system
Technical Field
The present application relates to the field of computer technologies, and in particular, to a data copying method and system for a distributed file system, an electronic device, and a storage medium.
Background
With the ever-increasing data storage requirements, the amount of file data managed by enterprises is also increasing. When a business needs to copy mass data in a file system, a client needs to read data from a server to the client, the client sends the data to the server again to be written, and various IO (input/output) confirmations (eg: lookup and the like) are carried out in the period. The data copying mode has long IO path and low data copying efficiency.
Therefore, how to improve the data copying efficiency is a technical problem that needs to be solved by those skilled in the art at present.
Disclosure of Invention
The application aims to provide a data copying method and system of a distributed file system, an electronic device and a storage medium, which can improve the data copying efficiency.
In order to solve the above technical problem, the present application provides a data copying method for a distributed file system, where the data copying method includes:
receiving a copy request sent by a client, and determining a target data structure corresponding to the copy request;
generating metadata of the target data structure, and associating the metadata of the target data structure with metadata of a source file in the distributed file system to obtain an association relation;
and modifying the source file according to the data modification instruction sent by the client, and executing copy-on-write operation on the target data structure in the client according to the incidence relation.
Optionally, after associating the metadata of the target data structure with the metadata of the source file in the distributed file system to obtain an association relationship, the method further includes:
and returning prompt information of successful association to the client.
Optionally, after associating the metadata of the target data structure with the metadata of the source file in the distributed file system to obtain an association relationship, the method further includes:
and sending the incidence relation to the client so that the client can generate a data modification instruction according to the incidence relation.
Optionally, the method further includes:
generating an association ID of metadata of the target data structure with metadata of the source file;
correspondingly, sending the association relationship to the client includes:
and sending the association ID to the client.
Optionally, determining the target data structure corresponding to the copy request includes:
and analyzing the copy request to obtain a target directory and/or a target file, and setting the target directory and/or the target file as a target data structure.
Optionally, associating the metadata of the target data structure with metadata of a source file in the distributed file system, including:
and associating the metadata of the target data structure with the metadata of the source file in the distributed file system in a hard link mode.
The present application further provides a data copy system of a distributed file system, the data copy system including:
the request receiving module is used for receiving a copy request sent by a client and determining a target data structure corresponding to the copy request;
the association module is used for generating metadata of the target data structure and associating the metadata of the target data structure with the metadata of the source file in the distributed file system to obtain an association relation;
and the copying module is used for modifying the source file according to the data modification instruction sent by the client and executing copy-on-write operation on the target data structure in the client according to the incidence relation.
Optionally, the method further includes:
and the prompt module is used for returning prompt information of successful association to the client after the metadata of the target data structure is associated with the metadata of the source file in the distributed file system to obtain an association relationship.
The present application also provides a storage medium having a computer program stored thereon, which when executed, implements the steps performed by the data copying method of the distributed file system described above.
The application also provides an electronic device, which comprises a memory and a processor, wherein the memory stores a computer program, and the processor realizes the steps executed by the data copying method of the distributed file system when calling the computer program in the memory.
The application provides a data copying method of a distributed file system, which comprises the steps of receiving a copying request sent by a client, and determining a target data structure corresponding to the copying request; generating metadata of the target data structure, and associating the metadata of the target data structure with metadata of a source file in the distributed file system to obtain an association relation; and modifying the source file according to the data modification instruction sent by the client, and executing copy-on-write operation on the target data structure in the client according to the incidence relation.
After a copy request sent by a client is received, metadata of a target data structure corresponding to the copy request is generated, and the metadata of the target data structure and the metadata of a source file in a distributed file system are combined. When a data modification instruction sent by a client is received, copy-on-write operation corresponding to the data modification instruction can be executed on a source file and a target data structure in the distributed file system according to the association relationship. According to the method and the device, the copy-on-write mechanism is added, the data reuse rate is improved on the premise of ensuring the data consistency, and the data copy efficiency can be improved. The application also provides a data copying system of the distributed file system, an electronic device and a storage medium, which have the beneficial effects and are not repeated herein.
Drawings
In order to more clearly illustrate the embodiments of the present application, the drawings needed for the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained by those skilled in the art without inventive effort.
Fig. 1 is a flowchart of a data copying method of a distributed file system according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a file copying principle provided in an embodiment of the present application;
fig. 3 is a schematic structural diagram of a data copying system of a distributed file system according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a flowchart of a data copying method of a distributed file system according to an embodiment of the present application.
The specific steps may include:
s101: receiving a copy request sent by a client, and determining a target data structure corresponding to the copy request;
the embodiment can be applied to a distributed file system, and the physical storage resources of the distributed file system can be connected with the nodes through a computer network. Before this step, there may be an operation of sending a copy request by the client, and the present implementation may determine a target data structure in the client according to the received copy request, so as to copy the data in the distributed file system to the target data structure. The target data structure in this embodiment may include a target directory or a target file, and it should be noted that the target data structure is a virtual space structure, and the target data structure may not include actual data before this step. The client-generated copy request may include the following information: a source directory and a target directory, or a source file and a target file; and the original file is a file in the distributed file system.
As a possible implementation manner, this embodiment may parse the copy request to obtain a target directory and/or a target file, and set the target directory and/or the target file as a target data structure. The target data structure may include a target directory, may include a target file, and may include both a target directory and a target file.
S102: generating metadata of the target data structure, and associating the metadata of the target data structure with metadata of a source file in the distributed file system to obtain an association relation;
after determining the target data structure that the client needs to copy, the present embodiment may utilize the metadata server to generate metadata of the target data structure, and associate the metadata of the target data structure with metadata of a source file in the distributed file system. After the association operation in this step is performed, the source file in the distributed file system is associated with the target data structure, that is, when the source file in the distributed file system is modified, a copy-on-write operation may be performed on the target data structure according to the association relationship, so as to complete the copy. As a possible implementation manner, in this embodiment, the metadata of the target data structure and the metadata of the source file in the distributed file system may be associated in a hard link manner.
Further, after associating the metadata of the target data structure with the metadata of the source file in the distributed file system, the metadata server may also return prompt information of successful association to the client, so that the client sends a data modification instruction after receiving the prompt information of successful association.
S103: and modifying the source file according to the data modification instruction sent by the client, and executing copy-on-write operation on the target data structure in the client according to the incidence relation.
After receiving a data modification instruction sent by a client, modification operation can be performed on a source file in the distributed file system according to the data modification instruction, and a target data structure in the client performs copy-on-write operation according to the modification of the source file, so that data copy is completed. For example, in the above process, the client creates the folder a, sends a copy request to the metadata server, and the metadata server creates metadata for the folder a, and associates the metadata of the folder a with metadata of a source file in the distributed file system. When the client sends a data 1 modification instruction to the distributed file system, a source file in the data server can be modified, and the folder A in the client copies the modified data 1 to the client based on copy-on-write operation. Specifically, the data modification instruction is used to modify a target data structure in a certain data server in the distributed file system, and other data servers and the target data structure may perform copy-on-write operations based on an association relationship between the metadata and the target data structure, so as to complete replication. In the embodiment, the copy request is sent to the metadata server when the file is copied, the metadata is associated with the target file and the source file to complete the copy action, the modified data enters a COW flow when the file is modified, and other data are still shared.
In this embodiment, after receiving a copy request sent by a client, metadata of a target data structure corresponding to the copy request is generated, and the metadata of the target data structure and metadata of a source file in a distributed file system are combined. When a data modification instruction sent by a client is received, copy-on-write operation corresponding to the data modification instruction can be executed on a source file and a target data structure in the distributed file system according to the association relationship. According to the embodiment, by adding the copy-on-write mechanism, the data reuse rate is improved on the premise of ensuring the data consistency, and the data copy efficiency can be improved.
As a further introduction to the corresponding embodiment of fig. 1, after associating the metadata of the target data structure with the metadata of the source file in the distributed file system, the association relationship may also be sent to the client, so that the client generates a data modification instruction according to the association relationship. Further, after associating the metadata of the target data structure with the metadata of the target data structure of the metadata of the source file in the distributed file system, a prompt message that the association is successful may be returned to the client.
As a further introduction to the corresponding embodiment of fig. 1, after associating the metadata of the target data structure with the metadata of the source file in the distributed file system, this embodiment may further generate an association ID of the metadata of the target data structure and the metadata of the source file, and the association ID may be sent to the client while sending the association relationship between the metadata and the target data structure to the client.
The flow described in the above embodiment is explained below by an embodiment in practical use. Please refer to fig. 2, and fig. 2 is a schematic diagram illustrating a file copying principle provided in an embodiment of the present application, where in the embodiment, by adding a COW mechanism of a file, on the premise of ensuring data consistency, the data reuse rate is improved as much as possible, IO paths can be effectively reduced, a copying speed is increased, a capacity utilization rate is improved, and fast copying of mass data is achieved. The specific implementation process is as follows:
the client sends a request for the data information to be copied to the metadata server. Bulk files are supported by default in units of directories. After receiving the copy request, the metadata server creates metadata of a new target file for the target directory/file, associates the metadata of the new target file with the data of the original file, and generates an association ID, and uses the same data as the source file (the process is similar to hard linking). And returning success to the client after the association is successful. When the client modifies the data, the client sends a modification request to the data server, and all the data servers can perform copy-on-write (COW) according to the associated ID and the object size, and after the COW is completed, the client returns success.
Specifically, the data requested by the copy request sent by the client to the metadata server may be a directory or a batch file. After receiving the copy request, the metadata server creates metadata of a new target file aiming at the target directory/file, associates the new metadata with the data of the original file, generates an association ID, and uses the same data as the source file. When the client modifies the data, the client carries out COW on the object with the specified size according to the association ID, and other parts of data are still shared.
In the embodiment, the copy action is converted into the copy request and is sent to the metadata server, and the metadata server completes the copy action after executing the associated operation of the file, so that no data operation exists in the whole process. According to the embodiment, by adding the COW mechanism of the file, on the premise of ensuring data consistency, the data reuse rate is improved as much as possible, IO paths can be effectively reduced, the copying speed is increased, the capacity utilization rate is improved, and rapid copying of mass data is realized.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a data copying system of a distributed file system according to an embodiment of the present application;
the system may include:
a request receiving module 100, configured to receive a copy request sent by a client, and determine a target data structure corresponding to the copy request;
an association module 200, configured to generate metadata of the target data structure, and associate the metadata of the target data structure with metadata of a source file in the distributed file system to obtain an association relationship;
the copying module 300 is configured to modify the source file according to the data modification instruction sent by the client, and perform copy-on-write operation on the target data structure in the client according to the association relationship.
In this embodiment, after receiving a copy request sent by a client, metadata of a target data structure corresponding to the copy request is generated, and the metadata of the target data structure and metadata of a source file in a distributed file system are combined. When a data modification instruction sent by a client is received, copy-on-write operation corresponding to the data modification instruction can be executed on a source file and a target data structure in the distributed file system according to the association relationship. According to the embodiment, by adding the copy-on-write mechanism, the data reuse rate is improved on the premise of ensuring the data consistency, and the data copy efficiency can be improved.
Optionally, the method further includes:
and the prompt module is used for returning prompt information of successful association to the client after the metadata of the target data structure is associated with the metadata of the source file in the distributed file system to obtain an association relationship.
Further, the method also comprises the following steps:
and the incidence relation sending module is used for sending the incidence relation to the client so that the client can generate a data modification instruction according to the incidence relation.
Further, the method also comprises the following steps:
and the ID generation module is used for generating the association ID of the metadata of the target data structure and the metadata of the source file and sending the association ID to the client.
Further, the request receiving module 100 includes:
and the structure setting unit is used for analyzing the copy request to obtain a target directory and/or a target file and setting the target directory and/or the target file as a target data structure.
Further, the associating module 200 is specifically a module for associating the metadata of the target data structure with the metadata of the source file in the distributed file system in a hard link manner.
The embodiment provides a copy scheme of a distributed file system based on COW, and by adding a COW mechanism of a file, on the premise of ensuring data consistency, the reuse rate of the data is improved as much as possible, IO paths can be effectively reduced, the copy speed is increased, the capacity utilization rate is improved, and rapid copy of mass data is realized.
Since the embodiment of the system part corresponds to the embodiment of the method part, the embodiment of the system part is described with reference to the embodiment of the method part, and is not repeated here.
The present application also provides a storage medium having a computer program stored thereon, which when executed, may implement the steps provided by the above-described embodiments. The storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The application further provides an electronic device, which may include a memory and a processor, where the memory stores a computer program, and the processor may implement the steps provided by the foregoing embodiments when calling the computer program in the memory. Of course, the electronic device may also include various network interfaces, power supplies, and the like.
The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the system disclosed by the embodiment, the description is relatively simple because the system corresponds to the method disclosed by the embodiment, and the relevant points can be referred to the method part for description. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

Claims (10)

1.一种分布式文件系统的数据拷贝方法,其特征在于,包括:1. a data copy method of a distributed file system, is characterized in that, comprises: 接收客户端发送的拷贝请求,确定所述拷贝请求对应的目标数据结构;Receive the copy request sent by the client, and determine the target data structure corresponding to the copy request; 生成所述目标数据结构的元数据,并将所述目标数据结构的元数据与所述分布式文件系统中源文件的元数据进行关联,得到关联关系;generating the metadata of the target data structure, and associating the metadata of the target data structure with the metadata of the source file in the distributed file system to obtain an association relationship; 根据所述客户端发送的数据修改指令修改所述源文件,并根据所述关联关系对所述客户端中的所述目标数据结构执行写时拷贝操作。The source file is modified according to the data modification instruction sent by the client, and a copy-on-write operation is performed on the target data structure in the client according to the association relationship. 2.根据权利要求1所述数据拷贝方法,其特征在于,在将所述目标数据结构的元数据与所述分布式文件系统中源文件的元数据进行关联得到关联关系之后,还包括:2. The data copy method according to claim 1, characterized in that, after associating the metadata of the target data structure with the metadata of the source file in the distributed file system to obtain an association relationship, the method further comprises: 向所述客户端返回关联成功的提示信息。A prompt message indicating that the association is successful is returned to the client. 3.根据权利要求1所述数据拷贝方法,其特征在于,在将所述目标数据结构的元数据与所述分布式文件系统中源文件的元数据进行关联得到关联关系之后,还包括:3. The method for copying data according to claim 1, characterized in that, after associating the metadata of the target data structure with the metadata of the source file in the distributed file system to obtain an association relationship, the method further comprises: 将所述关联关系发送至所述客户端,以便所述客户端根据所述关联关系生成数据修改指令。The association relationship is sent to the client, so that the client generates a data modification instruction according to the association relationship. 4.根据权利要求3所述数据拷贝方法,其特征在于,还包括:4. data copy method according to claim 3, is characterized in that, also comprises: 生成所述目标数据结构的元数据与所述源文件的元数据的关联ID;generating an association ID between the metadata of the target data structure and the metadata of the source file; 相应的,将所述关联关系发送至所述客户端包括:Correspondingly, sending the association relationship to the client includes: 将所述关联ID发送至所述客户端。The association ID is sent to the client. 5.根据权利要求1所述数据拷贝方法,其特征在于,确定所述拷贝请求对应的目标数据结构包括:5. The data copy method according to claim 1, wherein determining the target data structure corresponding to the copy request comprises: 解析所述拷贝请求得到目标目录和/或目标文件,并将所述目标目录和/或所述目标文件设置为目标数据结构。Parse the copy request to obtain a target directory and/or a target file, and set the target directory and/or the target file as a target data structure. 6.根据权利要求1至5任一项所述数据拷贝方法,其特征在于,将所述目标数据结构的元数据与所述分布式文件系统中源文件的元数据进行关联,包括:6. The data copy method according to any one of claims 1 to 5, characterized in that, associating the metadata of the target data structure with the metadata of the source file in the distributed file system, comprising: 采用硬链接的方式将所述目标数据结构的元数据与所述分布式文件系统中源文件的元数据进行关联。The metadata of the target data structure is associated with the metadata of the source file in the distributed file system by means of a hard link. 7.一种分布式文件系统的数据拷贝系统,其特征在于,包括:7. A data copy system of a distributed file system, characterized in that, comprising: 请求接收模块,用于接收客户端发送的拷贝请求,确定所述拷贝请求对应的目标数据结构;a request receiving module, configured to receive the copy request sent by the client, and determine the target data structure corresponding to the copy request; 关联模块,用于生成所述目标数据结构的元数据,并将所述目标数据结构的元数据与所述分布式文件系统中源文件的元数据进行关联,得到关联关系;an association module, configured to generate the metadata of the target data structure, and associate the metadata of the target data structure with the metadata of the source file in the distributed file system to obtain an association relationship; 拷贝模块,用于根据所述客户端发送的数据修改指令修改所述源文件,并根据所述关联关系对所述客户端中的所述目标数据结构执行写时拷贝操作。A copy module, configured to modify the source file according to the data modification instruction sent by the client, and perform a copy-on-write operation on the target data structure in the client according to the association relationship. 8.根据权利要求7所述数据拷贝系统,其特征在于,还包括:8. The data copying system according to claim 7, further comprising: 提示模块,用于在将所述目标数据结构的元数据与所述分布式文件系统中源文件的元数据进行关联得到关联关系之后,向所述客户端返回关联成功的提示信息。The prompt module is configured to return the prompt information of successful association to the client after associating the metadata of the target data structure with the metadata of the source file in the distributed file system to obtain an association relationship. 9.一种电子设备,其特征在于,包括存储器和处理器,所述存储器中存储有计算机程序,所述处理器调用所述存储器中的计算机程序时实现如权利要求1至6任一项所述分布式文件系统的数据拷贝方法的步骤。9. An electronic device, characterized in that it comprises a memory and a processor, wherein a computer program is stored in the memory, and when the processor invokes the computer program in the memory, the implementation as claimed in any one of claims 1 to 6 is realized. Describe the steps of the data copy method of the distributed file system. 10.一种存储介质,其特征在于,所述存储介质中存储有计算机可执行指令,所述计算机可执行指令被处理器加载并执行时,实现如上权利要求1至6任一项所述分布式文件系统的数据拷贝方法的步骤。10. A storage medium, wherein computer-executable instructions are stored in the storage medium, and when the computer-executable instructions are loaded and executed by a processor, the distribution according to any one of claims 1 to 6 is realized. The steps of the data copy method of the type file system.
CN201911330447.4A 2019-12-20 2019-12-20 A data copy method, system and related components of a distributed file system Withdrawn CN111143126A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911330447.4A CN111143126A (en) 2019-12-20 2019-12-20 A data copy method, system and related components of a distributed file system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911330447.4A CN111143126A (en) 2019-12-20 2019-12-20 A data copy method, system and related components of a distributed file system

Publications (1)

Publication Number Publication Date
CN111143126A true CN111143126A (en) 2020-05-12

Family

ID=70519234

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911330447.4A Withdrawn CN111143126A (en) 2019-12-20 2019-12-20 A data copy method, system and related components of a distributed file system

Country Status (1)

Country Link
CN (1) CN111143126A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111737223A (en) * 2020-06-28 2020-10-02 浪潮电子信息产业股份有限公司 A file copy method, device, device and storage medium
CN113806107A (en) * 2021-08-25 2021-12-17 济南浪潮数据技术有限公司 Object copying method, device, equipment and storage medium
WO2022012044A1 (en) * 2020-07-17 2022-01-20 苏州浪潮智能科技有限公司 Thin-provisioned file copying method, apparatus and device, and readable storage medium

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1542626A (en) * 2003-04-29 2004-11-03 国际商业机器公司 Method and system for implementing copy-on-write of a file
CN102073739A (en) * 2011-01-25 2011-05-25 中国科学院计算技术研究所 Method for reading and writing data in distributed file system with snapshot function
US20110219201A1 (en) * 2010-03-02 2011-09-08 Symantec Corporation Copy on write storage conservation systems and methods
US20150066852A1 (en) * 2013-08-27 2015-03-05 Netapp, Inc. Detecting out-of-band (oob) changes when replicating a source file system using an in-line system
CN104714755A (en) * 2013-12-13 2015-06-17 华为技术有限公司 Snapshoot management method and device
US20150169668A1 (en) * 2013-12-18 2015-06-18 Quantum Corporation Single Pass File System Repair With Copy On Write
US20150234712A1 (en) * 2014-02-18 2015-08-20 Ca, Inc. Methods of synchronizing files including synchronized hash map linked lists and related data processing nodes
US20150269214A1 (en) * 2014-03-19 2015-09-24 Red Hat, Inc. Identifying files in change logs using file content location identifiers
WO2015184925A1 (en) * 2014-10-24 2015-12-10 中兴通讯股份有限公司 Data processing method for distributed file system and distributed file system
CN106575309A (en) * 2014-08-29 2017-04-19 微软技术许可有限责任公司 File system with data block sharing
CN107436952A (en) * 2017-08-15 2017-12-05 郑州云海信息技术有限公司 A kind of document copying method and device based on distributed memory system
CN109522281A (en) * 2018-11-29 2019-03-26 郑州云海信息技术有限公司 A kind of method of Distributed File System Data rapid copy
CN110008197A (en) * 2019-04-12 2019-07-12 苏州浪潮智能科技有限公司 A kind of data processing method, system and electronic equipment and storage medium
CN110032541A (en) * 2019-04-12 2019-07-19 苏州浪潮智能科技有限公司 A kind of writeable snapshot implementing method and system

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1542626A (en) * 2003-04-29 2004-11-03 国际商业机器公司 Method and system for implementing copy-on-write of a file
US20110219201A1 (en) * 2010-03-02 2011-09-08 Symantec Corporation Copy on write storage conservation systems and methods
CN102073739A (en) * 2011-01-25 2011-05-25 中国科学院计算技术研究所 Method for reading and writing data in distributed file system with snapshot function
US20150066852A1 (en) * 2013-08-27 2015-03-05 Netapp, Inc. Detecting out-of-band (oob) changes when replicating a source file system using an in-line system
CN104714755A (en) * 2013-12-13 2015-06-17 华为技术有限公司 Snapshoot management method and device
US20150169668A1 (en) * 2013-12-18 2015-06-18 Quantum Corporation Single Pass File System Repair With Copy On Write
US20150234712A1 (en) * 2014-02-18 2015-08-20 Ca, Inc. Methods of synchronizing files including synchronized hash map linked lists and related data processing nodes
US20150269214A1 (en) * 2014-03-19 2015-09-24 Red Hat, Inc. Identifying files in change logs using file content location identifiers
CN106575309A (en) * 2014-08-29 2017-04-19 微软技术许可有限责任公司 File system with data block sharing
WO2015184925A1 (en) * 2014-10-24 2015-12-10 中兴通讯股份有限公司 Data processing method for distributed file system and distributed file system
CN107436952A (en) * 2017-08-15 2017-12-05 郑州云海信息技术有限公司 A kind of document copying method and device based on distributed memory system
CN109522281A (en) * 2018-11-29 2019-03-26 郑州云海信息技术有限公司 A kind of method of Distributed File System Data rapid copy
CN110008197A (en) * 2019-04-12 2019-07-12 苏州浪潮智能科技有限公司 A kind of data processing method, system and electronic equipment and storage medium
CN110032541A (en) * 2019-04-12 2019-07-19 苏州浪潮智能科技有限公司 A kind of writeable snapshot implementing method and system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
董晓明等: "分布式文件系统的写性能优化", 《微型电脑应用》 *
陶润东: "针对拷贝因子的云存储负载均衡技术", 《信息技术》 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111737223A (en) * 2020-06-28 2020-10-02 浪潮电子信息产业股份有限公司 A file copy method, device, device and storage medium
CN111737223B (en) * 2020-06-28 2023-02-28 浪潮电子信息产业股份有限公司 A file copy method, device, equipment and storage medium
WO2022012044A1 (en) * 2020-07-17 2022-01-20 苏州浪潮智能科技有限公司 Thin-provisioned file copying method, apparatus and device, and readable storage medium
CN113806107A (en) * 2021-08-25 2021-12-17 济南浪潮数据技术有限公司 Object copying method, device, equipment and storage medium
CN113806107B (en) * 2021-08-25 2024-02-13 济南浪潮数据技术有限公司 Object copying method, device, equipment and storage medium

Similar Documents

Publication Publication Date Title
CN103020235B (en) Autonomous network stream transmission
US8977662B1 (en) Storing data objects from a flat namespace in a hierarchical directory structured file system
US9747300B2 (en) Local networked storage linked to remote networked storage system
CN111143126A (en) A data copy method, system and related components of a distributed file system
CN107689976B (en) A file transmission method and device
WO2017095820A1 (en) Methods and devices for acquiring data using virtual machine and host machine
CN109977317B (en) Data query method and device
CN111722909A (en) A virtual machine migration method, system, device and storage medium
CN114528813A (en) File conversion management method, device, equipment and medium for online preview
JP2014522017A (en) Presentation software automation service
JP5556025B2 (en) Storage system
WO2016023372A1 (en) Data storage processing method and device
CN115114232A (en) Method, device and medium for enumerating historical version objects
CN115543690A (en) Cold and hot data redundancy method, device, equipment and storage medium
JP6470126B2 (en) Method, computer apparatus, and program for creating file variant
CN109522281A (en) A kind of method of Distributed File System Data rapid copy
CN118295973A (en) Image file processing method, device, equipment and storage medium
CN107704596A (en) A kind of method, apparatus and equipment for reading file
CN111737223B (en) A file copy method, device, equipment and storage medium
CN117667437A (en) File copying method and device and electronic equipment
CN113391847B (en) Application startup optimization method and device
CN114722782A (en) Data application method and device, electronic equipment and storage medium
CN111625397A (en) Service log backup method, cluster, device, electronic equipment and storage medium
CN113703922B (en) A virtual machine creation method, device, equipment and computer readable storage medium
CN116305218B (en) Data link tracking and data updating method, device and data management system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20200512

WW01 Invention patent application withdrawn after publication