CN103685497B - A kind of on-line storage sharing method and system - Google Patents

Abstract

The invention discloses an online storage sharing method and system to save network resources and reduce transmission costs. The method includes: the personal computer data interaction server uploads the changed data block, node index information and file storage path stored in the personal computer client to the data center; the personal computer message agent interacts the file update message to the data center through the data center; The mobile terminal message agent; the mobile terminal message agent notifies the mobile terminal client that the file of the personal computer client has changed; after receiving the request sent by the mobile terminal client, the data center will interact with the mobile terminal data interaction server to generate The changed data block is synchronized to the mobile terminal client. The method provided by the embodiment of the present invention does not need to upload and download the entire file, which greatly reduces the amount of data transmission, saves precious network bandwidth resources, and reduces the cost of data transmission.

Description

A method and system for online storage sharing

technical field

The invention relates to the field of cloud storage, in particular to an online storage sharing method and system.

Background technique

With the continuous development of Internet technology, the content on the Internet is becoming more and more abundant, from pictures, software, documents, audio to video, and various types. The diversity of personal storage requirements and the current domestic bandwidth resources put forward a new challenge for online storage systems. new challenges. Although the quotas provided by relevant online storage systems for individuals have been able to meet the needs of users for storage space, however, the growth rate of network bandwidth resources is far behind the growth of storage space. This resource mismatch has seriously restricted online storage. The use of the system also affects the user experience. For example, in an enterprise LAN, for the convenience of network resource management, system administrators usually limit the network bandwidth and download speed of a single computer. These measures limit the data transmission capacity of individual users. In most parts of the country, the growth of data transmission demand is higher than the growth of network bandwidth. For example, an ordinary high-definition movie can reach more than 4GB, and the download time in a general local area network may reach several hours. How to effectively use the scarce resource of the network is particularly important in the online cloud storage system.

An online storage system provided by the prior art is a relatively popular cloud storage system (i.e. online network disk) on the Internet, such as dropbox, Baidu network disk, Jinshan network disk and Tencent network disk. The workflow of these network disks is as follows:

1) The PC client transmits the file data to the data upload server through http, ftp or a custom protocol, and the data upload server saves the data to the cloud distributed file system;

2) The data upload server notifies the PC client that the upload is successful;

3) The PC client notifies its corresponding PC message proxy server, and the message content includes the path of the successfully uploaded file and its corresponding description information;

4) The PC message proxy server publishes the message to the message queue;

5) The message queue notifies the Mobile message proxy server that there is a new message in the cloud;

6) The Mobile message proxy server notifies the Mobile client that there is data to download;

7) The mobile client sends a request to the download server;

8) The download server returns the data requested by Mobile;

9) The Mobile client notifies its corresponding Mobile message proxy server to complete the data download;

10) The Mobile message proxy server deletes the message.

However, the drawback of the online storage system provided by the above prior art is that network resources are wasted. Taking file synchronization in a common usage scenario as an example, if a local file is modified, the existing online storage system client will upload the entire modified file to the cloud storage server. In fact, unnecessary data transfers occur during this process. Especially in a wireless Internet environment, data traffic is wasted and data transmission costs are increased.

Contents of the invention

Embodiments of the present invention provide an online storage sharing method and system to save network resources and reduce transmission costs.

An embodiment of the present invention provides an online storage sharing method, the method comprising:

The personal computer data interaction server uploads the changed data block of the file stored on the personal computer client, the node index information corresponding to the changed data block, and the storage path of the file to the data center;

The personal computer message agent interacts the file update message to the mobile terminal message agent through the data center, and the file update message is a notification message that the file of the personal computer client is changed;

The mobile terminal message agent notifies the mobile terminal client that the file of the personal computer client has changed according to the file update message;

After receiving the request sent by the mobile terminal client, the data center synchronizes the changed data block to the mobile terminal client through interaction with the mobile terminal data interaction server.

Another embodiment of the present invention provides an online storage sharing system. The online storage sharing system includes a personal computer data interaction server, a data center, a personal computer message agent, a mobile terminal message agent, and a mobile terminal data interaction server;

The personal computer data interaction server is configured to upload the changed data block of the file stored on the personal computer client, the node index information corresponding to the changed data block, and the storage path of the file to the data center;

The personal computer message agent is used to exchange a file update message to the mobile terminal message agent through the data center, and the file update message is a notification message of a file change of the personal computer client;

The mobile terminal message agent is used to notify the mobile terminal client that the file of the personal computer client has changed according to the file update message;

The data center is further configured to synchronize the changed data block to the mobile terminal client through interaction with the mobile terminal data interaction server after receiving the request sent by the mobile terminal client.

It can be seen from the above-mentioned embodiments of the present invention that, since the personal computer data interaction server only uploads the changed data block of the file stored on the personal computer client, the node index information corresponding to the changed data block, and the storage path of the file to the data center, the mobile The terminal message agent notifies the mobile terminal client that the file of the personal computer client has changed according to the file update message. After receiving the request sent by the mobile terminal client, the data center interacts with the mobile terminal data interaction server to transfer the changed The data block is synchronized to the mobile terminal client. Therefore, compared with uploading and downloading the entire file in the online storage system provided by the prior art, the method provided by the embodiment of the present invention does not need to upload and download the entire file, which greatly reduces the amount of data transmission and saves precious network bandwidth resources. Reduced data transfer costs.

Description of drawings

FIG. 1 is a schematic flow diagram of the basic flow of an online storage sharing method provided by an embodiment of the present invention;

Figure 2-a is a schematic diagram of the logical structure of the online storage sharing system provided by the embodiment of the present invention;

Fig. 2-b is a schematic diagram of the logical structure of the online storage sharing system provided by another embodiment of the present invention;

FIG. 3 is a schematic diagram of a logical structure of an online storage sharing system provided by another embodiment of the present invention;

FIG. 4 is a schematic diagram of a logical structure of an online storage sharing system provided by another embodiment of the present invention;

Fig. 5-a is a schematic diagram of the logical structure of an online storage sharing system provided by another embodiment of the present invention;

Fig. 5-b is a schematic diagram of the logic structure of the online storage sharing system provided by another embodiment of the present invention;

Fig. 5-c is a schematic diagram of the logical structure of the online storage sharing system provided by another embodiment of the present invention;

Fig. 6 is a schematic diagram of a personal computer client identifying a changed data block of a file and a node index corresponding to the changed data block provided by an embodiment of the present invention.

detailed description

An embodiment of the present invention provides an online storage sharing method, including: the personal computer data interaction server stores the changed data block of the file on the personal computer client, the node index information corresponding to the changed data block, and the file's The storage path is uploaded to the data center; the personal computer message agent interacts the file update message to the mobile terminal message agent through the data center, and the file update message is a notification message that the file of the personal computer client has changed; the mobile terminal The terminal message agent notifies the mobile terminal client that the file of the personal computer client has changed according to the file update message; after receiving the request sent by the mobile terminal client, the data center interacts with the mobile terminal data interaction server , synchronizing the changed data block to the mobile terminal client. The embodiment of the present invention also provides a corresponding online storage sharing system. Each will be described in detail below.

The basic flow of the online storage sharing method in the embodiment of the present invention can be referred to FIG. 1 , the method can be applied to a data center (Data Center, DC), and mainly includes the following steps S101 to S104:

S101. The personal computer data interaction server uploads the changed data block of the file stored on the personal computer client, the node index information corresponding to the changed data block, and the storage path of the file to the data center.

In the embodiment of the present invention, the data center includes a distributed file system. As an embodiment of the present invention, the personal computer data interaction server uploads the changed data block of the file stored on the personal computer client, the node index information corresponding to the changed data block, and the storage path of the file to the data center. It may be: the personal computer data interaction server receives the serialized data sent by the personal computer client, the node index information corresponding to the changed data block, and the storage path of the file; the personal computer data interaction server deserializes the serialized data The personal computer data interaction server uploads the changed data block of the file stored on the personal computer client, the node index information corresponding to the changed data block, and the storage path of the file to the distributed file system, wherein the sequence The converted data is the data obtained by serializing the changed data block.

S102. The message agent of the personal computer interacts with the message agent of the mobile terminal through the data center, where the file update message is a notification message of a file change of the personal computer client.

In the embodiment of the present invention, the data center includes a message subscription push system. As an embodiment of the present invention, the personal computer message agent interacts the file update message with the mobile terminal message agent through the data center. Specifically, it may be: the personal computer message agent sends the file update message to the message subscription push system, and the message subscription push system sends the The above file update message is forwarded to the mobile terminal message agent.

S103, the mobile terminal message agent notifies the mobile terminal client that the file of the personal computer client has changed according to the file update message.

S104. After receiving the request sent by the mobile terminal client, the data center synchronizes the changed data block to the mobile terminal client through interaction with the mobile terminal data interaction server.

In the embodiment of the present invention, the data center includes a distributed file system. As an embodiment of the present invention, after receiving the request sent by the mobile terminal client, the data center will synchronize the changed data block to the mobile terminal client through interaction with the mobile terminal data interaction server. Specifically, it can be: distributed file The system receives the request from the mobile terminal client forwarded by the mobile terminal data interaction server, and sends the changed data block and the node index information corresponding to the changed data block to the mobile terminal data interaction server, so that the mobile terminal The terminal data interaction server sends the changed data block and node index information corresponding to the changed data block to the mobile terminal client.

In the method provided by the above-mentioned embodiments of the present invention, the personal computer data interaction server uploads the changed data block of the file stored on the personal computer client, the node index information corresponding to the changed data block, and the storage path of the file to the data Before the center, the method further includes: the personal computer client identifies the data block that has changed in the file and the index node corresponding to the data block that has changed, and the data block that has changed in the file, the data block that has changed The corresponding node index information and the storage path of the file are sent to the personal computer data interaction server. Since the file snapshot function and the file version management function are realized at the same time on the personal computer client and the personal computer data interaction server, the user can quickly and effectively obtain the file version at any time, and the user experience is enhanced.

From the above-mentioned online storage sharing method provided by the embodiment of the present invention, since the personal computer data interaction server only stores the changed data block of the file on the personal computer client, the node index information corresponding to the changed data block and the storage path of the file After uploading to the data center, the mobile terminal message agent notifies the mobile terminal client that the file of the personal computer client has changed according to the file update message. After receiving the request sent by the mobile terminal client, the data center interacts with the mobile terminal data interaction server, and synchronizing the changed data block to the mobile terminal client. Therefore, compared with uploading and downloading the entire file in the online storage system provided by the prior art, the method provided by the embodiment of the present invention does not need to upload and download the entire file, which greatly reduces the amount of data transmission and saves precious network bandwidth resources. Reduced data transfer costs.

The following describes the online storage sharing system of the embodiment of the present invention for implementing the above online storage sharing method, and its basic logic structure refers to FIG. 2-a. For ease of description, the online storage sharing system illustrated in Fig. 2-a only shows the parts related to the embodiment of the present invention. It mainly includes a personal computer data interaction server 202 , a data center 201 , a personal computer message agent 203 , a mobile terminal message agent 205 and a mobile terminal data interaction server 204 . Figure 2-b is an online storage sharing system provided by another embodiment of the present invention, which mainly includes a personal computer data interaction server 202, a data center 201, a personal computer message agent 203, a mobile terminal message agent 205, and a mobile terminal data interaction server 204 , a personal computer client 206 and a mobile terminal client 207, wherein the data center 201 includes a message subscription push system 2011, a structured database 2012, an authentication and authorization server 2013 and a distributed file system 2014. In the online storage sharing system shown in Figure 2-a or 2-b, the dotted arrows indicate the transmission of message or command streams, and the realization arrows indicate the transmission of data streams. The basic functions of each device are described as follows:

The personal computer client 206 runs on the personal computer and is mainly used for uploading, synchronizing and downloading data, and interacts with the distributed file system 2014 of the data center 201 through the Internet;

The mobile terminal client 207 is similar to the function of the personal computer client 206, and the difference is that the mobile terminal client 207 runs in a mobile device, such as a smart phone and a PDA;

The PC message agent 203 interacts with the PC client 206, provides functions such as login and authentication for the PC client 206, and receives file operation messages from the PC client 206, such as creating files, deleting files, updating files, and searching File operation messages such as files, and receiving messages from the message subscription push system 2011;

The personal computer data interaction server 202 provides data upload and download functions for the personal computer client 206 . Store data in the distributed file system 2014 or obtain data from the distributed file system 2014;

The mobile terminal message agent 205 interacts with the mobile terminal client 207, provides functions such as login and authentication for the mobile terminal client 207, and receives file operation messages from the mobile terminal client 207, such as creating files, deleting files, updating files and searching File and other file operation messages, receiving messages from the message subscription push system 2011;

The mobile terminal data interaction server 204 provides data upload and download functions for the mobile terminal client 207 . Store data in the distributed file system 2014 or obtain data from the distributed file system 2014;

The distributed file system 2014 runs in the data center 201 and stores unstructured data uploaded by all users, such as pictures, videos, and documents. The redundancy of the system is improved by backing up the data, and the concurrent access performance of the system is improved by dividing the data into blocks. ;

The structured database 2012 runs in the data center 201 and stores all user-related structured data, such as user names and passwords;

The message subscription push system 2011 runs in the data center 201 and is a carrier for message transmission between peer-to-peer clients, such as the personal computer client 206 and the mobile terminal client 207 . For example, after the personal computer client 206 uploads the file successfully, send a message to the mobile terminal client 207 through the personal computer message agent 203, the message subscription push system 2011 and the mobile terminal message agent 205 respectively, and notify the mobile terminal client 207 to perform data synchronization;

The authentication and authorization server 2013 runs in the data center 201 , and each operation of any client (including the personal computer client 206 and the mobile terminal client 207 ) needs to be judged by the authentication and authorization server 2013 .

In addition to the above-mentioned basic functions, the components of the online storage sharing system provided by the embodiment of the present invention are described in detail below in conjunction with Figure 2-a:

The personal computer data interaction server 202 is used to upload the changed data block of the file stored on the personal computer client, the node index information corresponding to the changed data block, and the storage path of the file to the data center 201;

The personal computer message agent 203 is used to exchange the file update message to the mobile terminal message agent 205 through the data center 201, and the file update message is a notification message that the file of the personal computer client is changed;

The mobile terminal message agent 205 is used to notify the mobile terminal client that the file of the personal computer client has changed according to the file update message;

The data center 201 is also configured to synchronize the changed data blocks to the mobile terminal client through interaction with the mobile terminal data interaction server 204 after receiving the request sent by the mobile terminal client.

The data center 201 illustrated in Fig. 2-a includes a distributed file system 301, such as the online storage sharing system provided by another embodiment of the present invention shown in Fig. 3 . In the online storage sharing system illustrated in Figure 3, the personal computer data interaction server 202 is used to store the changed data block of the file on the personal computer client, the node index information corresponding to the changed data block, and the file The storage path of the file is uploaded to the data center 201, specifically: the personal computer data interaction server 202 is used to receive the serialized data sent by the personal computer client, the node index information corresponding to the changed data block, and the storage path of the file , deserializing the serialized data, uploading the changed data block of the file stored on the personal computer client, the node index information corresponding to the changed data block, and the storage path of the file to the distributed file system 301, wherein the serialized data is data obtained after serializing a changed data block. The so-called serialization refers to an encoding behavior that turns data into a set of logically related byte streams before data is transmitted on the network.

In the online storage sharing system illustrated in Figure 3, the data center 201 is also used to synchronize the changed data blocks to the mobile terminal through interaction with the mobile terminal data interaction server 204 after receiving the request sent by the mobile terminal client The terminal client is specifically: the distributed file system 301 is used to receive the request from the mobile terminal client forwarded by the mobile terminal data interaction server 204, and send the changed data block and the node index information corresponding to the changed data block to The mobile terminal data interaction server 204, so that the mobile terminal data interaction server 204 sends the changed data block and the node index information corresponding to the changed data block to the mobile terminal client.

The data center 201 shown in Fig. 2-a includes a message subscription push system 401, which is an online storage sharing system provided by another embodiment of the present invention as shown in Fig. 4 . In the online storage sharing system illustrated in Figure 4, the personal computer message agent 203 is used to exchange the file update message to the mobile terminal message agent 205 through the data center 201, specifically: the personal computer message agent 203 is used to send the file update message Go to the message subscription push system 401, and forward the file update message to the mobile terminal message agent 205.

The online storage sharing system in any example of the above-mentioned accompanying drawing 2-a, accompanying drawing 3 or accompanying drawing 4 also includes a personal computer client 501, such as the online storage sharing system provided in any example of accompanying drawing 5-a to accompanying drawing 5-c system. The personal computer client 501 is used to identify the changed data block of the file and the index node corresponding to the changed data block, and combine the changed data block of the file, the node index information corresponding to the changed data block and The storage path of the file is sent to the personal computer data interaction server 202 .

In the online storage sharing system provided in any example of accompanying drawings 5-a to 5-c, the personal computer client 501 uses the file-driven technology to identify the data block where the file changes and the node corresponding to the changed data block Index, its schematic diagram is as shown in accompanying drawing 6, and description is as follows:

A file (file) is composed of 6 index nodes such as A, B, C, D, E, and F, and the data blocks pointed to by these 6 index nodes, as shown in the left part of Figure 6. At a certain moment, the file is modified. Here, it is assumed that the data block pointed to by the index node F has changed, and at the same time, the data block corresponding to the index node G has been added to form file-1 (file-1), file-1 It consists of data blocks pointed to by 7 index nodes such as A, B, C, D, E, F', and G, as shown in the middle part of Figure 6. The file file-1 has partially changed on the basis of the file file, as shown in the right part of Figure 6. Therefore, only the changed part can be uploaded to the personal computer data interaction server 202 during file synchronization.

It can be seen from the personal computer client 501 shown in accompanying drawing 6 that uses the file drive technology to identify the changed data block and the node index corresponding to the changed data block. The file snapshot function implements the file version management function, so users can quickly and effectively obtain file versions at any time, which enhances user experience.

It should be noted that the information interaction and execution process between the modules/units of the above-mentioned device are based on the same idea as the method embodiment of the present invention, and the technical effect it brings is the same as that of the method embodiment of the present invention. The specific content can be Refer to the descriptions in the method embodiments of the present invention, and details are not repeated here.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium can include: Read Only Memory (ROM, Read Only Memory), Random Access Memory (RAM, Random Access Memory), disk or CD, etc.

The online storage sharing method and system provided by the embodiments of the present invention are described above in detail. In this paper, specific examples are used to illustrate the principle and implementation of the present invention. The descriptions of the above embodiments are only used to help understand the present invention. method and its core idea; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation and application scope. Invention Limitations.

Claims (8)

1. a kind of on-line storage sharing method, it is characterised in that methods described includes：

Data block that PC data interaction server changes the file for being stored in PC client, the hair The corresponding node index information of data block for changing and the storing path of the file are uploaded to data center, in the individual Computer client and the PC data interaction server realize File Snapshot function simultaneously；

PC Message Agent is acted on behalf of file new information interaction to mobile terminal message, institute by the data center State the notification message that the file that file new information is the PC client changes；

The mobile terminal message agency notifies PC visitor described in mobile terminal client terminal according to the file new information The file at family end changes；

Receive mobile terminal client terminal transmission request after, the data center by with mobile terminal data interactive server Interaction, the data block changed is synchronized to the mobile terminal client terminal；

The data center includes distributed file system, and the PC data interaction server will be stored in PC Data block, the corresponding node index information of the data block changed and the file that the file of client changes Storing path be uploaded to data center, including：

The PC data interaction server receives serialized data, the generation that the PC client is sent The corresponding node index information of data block and the storing path of the file of change, the serialized data are to changing Data block serialized after obtained data；

The PC data interaction server is by the serialized data unserializing；

Data block that the PC data interaction server changes the file for being stored in PC client, institute The storing path for stating the corresponding node index information of the data block changed and the file is uploaded to the distributed document System.

2. according to the method described in claim 1, it is characterised in that the data center includes message subscribing supplying system, institute PC Message Agent is stated by the data center, file new information interaction to mobile terminal message is acted on behalf of, including：

The PC Message Agent sends the file new information to the message subscribing supplying system；

The file new information is forwarded to the mobile terminal message and acted on behalf of by the message subscribing supplying system.

3. according to the method described in claim 1, it is characterised in that the data center includes distributed file system, described After the request of mobile terminal client terminal transmission is received, the data center passes through the friendship with mobile terminal data interactive server Mutually, the data block changed is synchronized to the mobile terminal client terminal, including：

The distributed file system receives the objective from the mobile terminal of the mobile terminal data interactive server forwarding The request at family end；

The distributed file system is by the data block changed and the corresponding node of the data block changed Index information is sent to mobile terminal data interactive server, so that the mobile terminal data interactive server occurs described The data block of change and the corresponding node index information of the data block changed are sent to the mobile terminal client terminal.

4. the method according to claims 1 to 3 any one, it is characterised in that the PC data interaction service Data block that device changes the file for being stored in PC client, the corresponding node of the data block changed The storing path of index information and the file is uploaded to before data center, and methods described also includes：

The PC client recognizes that the data block that the file changes is corresponding with the data block changed Index node；

Data block that the PC client changes the file, the corresponding section of the data block changed The storing path of point index information and the file is sent to the PC data interaction server.

5. a kind of on-line storage shared system, it is characterised in that the on-line storage shared system is handed over including PC data Mutual server, data center, PC Message Agent, mobile terminal message agency and mobile terminal data interactive server；

The PC data interaction server, for the data that the file for being stored in PC client changes The storing path of block, the corresponding node index information of the data block changed and the file is uploaded in the data The heart, File Snapshot function is realized in the PC client and the PC data interaction server simultaneously；

The PC Message Agent, it is for by the data center, the interaction of file new information is whole to the movement Hold Message Agent, the notification message that the file new information changes for the file of the PC client；

The mobile terminal message agency, it is personal described in mobile terminal client terminal for according to the file new information, notifying The file of computer client changes；

The data center be additionally operable to receive mobile terminal client terminal transmission request after, by with the mobile terminal data The interaction of interactive server, the mobile terminal client terminal is synchronized to by the data block changed；

The data center includes distributed file system, and the PC data interaction server is used to that individual will to be stored in Data block that the file of computer client changes, the corresponding node index information of the data block changed and described The storing path of file is uploaded to data center, is specially：

The PC data interaction server, for receiving serialized data, the institute that the PC client is sent The storing path of the corresponding node index information of the data block changed and the file is stated, by the serialized data inverted sequence Rowization, the data block that the file for being stored in PC client is changed, the data block changed are corresponding The storing path of node index information and the file is uploaded to the distributed file system, and the serialized data is to hair The data that the data block for changing is obtained after being serialized.

6. on-line storage shared system according to claim 5, it is characterised in that the data center includes message subscribing Supplying system, the PC Message Agent is used for by the data center, by file new information interaction to movement eventually End Message Agent be specially：

The PC Message Agent, for the file new information to be sent to the message subscribing supplying system；

The message subscribing supplying system, is acted on behalf of for the file new information to be forwarded into the mobile terminal message.

7. on-line storage shared system according to claim 5, it is characterised in that the data center includes distributed text Part system, the data center be additionally operable to receive mobile terminal client terminal transmission request after, by with the mobile terminal The interaction of data interaction server, the data block changed is synchronized into the mobile terminal client terminal is specially：

The distributed file system, for receiving the objective from the mobile terminal of mobile terminal data interactive server forwarding The request at family end, the data block changed and the corresponding node index information of the data block changed are sent To mobile terminal data interactive server, so that the mobile terminal data interactive server is by the data block changed Node index information corresponding with the data block changed is sent to the mobile terminal client terminal.

8. the on-line storage shared system according to claim 5 to 7 any one, it is characterised in that the on-line storage Shared system also includes：

PC client, for recognizing that the data block that the file changes is corresponding with the data block changed Index node, the data block that the file is changed, the corresponding node index information of the data block changed Sent with the storing path of the file to the PC data interaction server.