CN108243203A - A kind of data sharing method in cloud system - Google Patents
A kind of data sharing method in cloud system Download PDFInfo
- Publication number
- CN108243203A CN108243203A CN201611208637.5A CN201611208637A CN108243203A CN 108243203 A CN108243203 A CN 108243203A CN 201611208637 A CN201611208637 A CN 201611208637A CN 108243203 A CN108243203 A CN 108243203A
- Authority
- CN
- China
- Prior art keywords
- data
- node
- memory
- cloud system
- cache
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 15
- 230000005540 biological transmission Effects 0.000 claims abstract description 12
- 230000003139 buffering effect Effects 0.000 claims description 6
- 238000010276 construction Methods 0.000 description 5
- 230000002688 persistence Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000000354 decomposition reaction Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to the data sharing methods in a kind of cloud system.The burden of data transmission from the server of data providing is separated, operation is selected to load minimum node as transit node, mitigates the operation load of the server of data providing, accelerates systems exchange speed.
Description
【Technical field】
The invention belongs to the data sharing methods in data sharing field more particularly to cloud system.
【Background technology】
Recently as the development of network technology, distributed computing technology has obtained in-depth study and has been widely applied, and is distributed
Each computer in formula system is all stored with data, and data can be shared and be exchanged between each computer.
Existing data sharing mode directly carries out data friendship typically between request of data side and data providing
It changes, this is very high to the read-write of the server as data providing and transmission speed requirement, but R/W speed of hard disc is led to
It is often slow, influence the data processing of server itself.
Based on the above problem, there is an urgent need for the data sharing methods in a kind of new cloud system now, mitigate data providing clothes
The processing load of business device, improves system data exchange velocity.
【Invention content】
In order to solve the above problem of the prior art, the present invention proposes the data sharing method in a kind of cloud system.
The technical solution adopted by the present invention is as follows：
A kind of data sharing method in cloud system, there is multiple nodes in cloud system, the data with storage of data structure,
It is characterized in that, this method comprises the following steps：
(1) data sharings of the node A to node B transmission data set G is asked, and the data acquisition system G includes several numbers
According to D, with storage of data structure in the nodeb, node A is request of data node to wherein data D, and node B is data transmitting node；
(2) the node C for selecting a current operating load minimum from other nodes is as cache node, in cache node
The buffering area that a region is exchanged as shared data is divided in memory；
(3) the data D in data acquisition system G is written to the above-mentioned buffer area of memory successively, cache node is read from memory
Above-mentioned data are simultaneously sequentially transmitted and give node A；
(4) node A receives the data of above-mentioned transmission and is stored in its memory.
Beneficial effects of the present invention include：The burden of data transmission is separated from the server of data providing,
Other nodes is selected to mitigate the operation load of the server of data providing as transit node, accelerate systems exchange speed.
【Description of the drawings】
Attached drawing described herein is to be used to provide further understanding of the present invention, and forms the part of the application, but
It does not constitute improper limitations of the present invention, in the accompanying drawings：
Fig. 1 is the structure chart of present system.
Fig. 2 is the flow chart of the data sharing method in cloud system of the present invention.
【Specific embodiment】
Come that the present invention will be described in detail below in conjunction with attached drawing and specific embodiment, illustrative examples therein and say
It is bright to be only used for explaining the present invention, but not as a limitation of the invention.
It is the system that the present invention is applied, in one embodiment, system is distributed system, the system referring to attached drawing 1
Including a control node and multiple calculate nodes.In other embodiments or the multi-node systems such as cloud system.
Referring to attached drawing 2, a kind of embodiment 1, the data sharing method in cloud system has multiple nodes in cloud system, described
Data are with storage of data structure, and this method comprises the following steps：
(1) data sharings of the node A to node B transmission data set G is asked, and the data acquisition system G includes several numbers
According to D, with storage of data structure in the nodeb, node A is request of data node to wherein data D, and node B is data transmitting node；
(2) the node C for selecting a current operating load minimum from other nodes is as cache node, in cache node
The buffering area that a region is exchanged as shared data is divided in memory；
(3) the data D in data acquisition system G is written to the above-mentioned buffer area of memory successively, cache node is read from memory
Above-mentioned data are simultaneously sequentially transmitted and give node A；
(4) node A receives the data of above-mentioned transmission and is stored in its memory.
Embodiment 2, this method comprises the following steps：
(1) node A is to the data exchange request of node B transmission data set G.
In one embodiment, the data acquisition system G includes several data D, and wherein data D is existed with storage of data structure
In node B, node A is request of data node, and node B is data transmitting node；
(2) a node C is selected from other nodes as cache node,
In one embodiment, a node for selecting a current operating load minimum as cache node, so as to
Then the influence that bottom line reduction runs other nodes divides a region as shared data in cache node memory
The buffering area of exchange；
(3) tree construction of the data D in data acquisition system G is divided into N stalk trees, the above-mentioned buffer area of memory is written successively；
(4) multiple subtrees in buffer area are merged into the complete tree structure of data D；
(5) repeat the above steps (3) (4), and the tree construction of the data in data acquisition system G is carried out to subtree decomposition successively, is write
Enter buffer area and complete tree merges；
(6) monitor whether the data volume stored in buffering area is more than cache threshold, if it exceeds cache threshold, then it will caching
The data acquisition system E stored in area sends node A to, and the data volume stored in buffering area is deleted；
(7) node A receives the data acquisition system E of above-mentioned transmission and is stored in its memory；
(8) it if data acquisition system E is the subset of data acquisition system G, is further continued for performing above-mentioned steps (5)-(7), if data
Set E is identical with data acquisition system G, then performs step (9)-(12)；
(9) node A is needed to store data in temporary persistence disk, be drawn in node A hard disks to prevent loss of data
Divide one piece of region as temporary persistence region；
(10) tree construction of the data F in data acquisition system E is divided into M stalk trees, above-mentioned temporary persistence area is written successively
Domain；
(11) to the subtree merging treatment in temporary persistence region into the complete tree structure of data F；
(12) repeat the above steps (10) (11), the tree construction of the data in data acquisition system E is carried out successively subtree decomposition,
Buffer area is written and complete tree merges.
By the above method, the present invention separates the burden of data transmission from the server of data providing, selects
It selects operation and loads minimum node as transit node, mitigate the operation load of the server of data providing, accelerate system and hand over
Throw-over degree.
The above is only the better embodiment of the present invention, therefore all constructions according to described in present patent application range,
The equivalent change or modification that feature and principle are done, is included in the range of present patent application.
Claims (1)
1. the data sharing method in a kind of cloud system, there are multiple nodes in cloud system, the data are special with storage of data structure
Sign is that this method comprises the following steps：
(1) data sharings of the node A to node B transmission data set G is asked, and the data acquisition system G includes several data D,
With storage of data structure in the nodeb, node A is request of data node to wherein data D, and node B is data transmitting node；
(2) the node C for selecting a current operating load minimum from other nodes is as cache node, in cache node memory
The middle buffering area for dividing a region and being exchanged as shared data；
(3) the data D in data acquisition system G is written to the above-mentioned buffer area of memory successively, cache node reads above-mentioned from memory
Data are simultaneously sequentially transmitted and give node A；
(4) node A receives the data of above-mentioned transmission and is stored in its memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611208637.5A CN108243203A (en) | 2016-12-23 | 2016-12-23 | A kind of data sharing method in cloud system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611208637.5A CN108243203A (en) | 2016-12-23 | 2016-12-23 | A kind of data sharing method in cloud system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108243203A true CN108243203A (en) | 2018-07-03 |
Family
ID=62704239
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611208637.5A Pending CN108243203A (en) | 2016-12-23 | 2016-12-23 | A kind of data sharing method in cloud system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108243203A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101047610A (en) * | 2007-04-30 | 2007-10-03 | 华为技术有限公司 | Data storage, reading, transmission method and management server and network node |
| CN102164160A (en) * | 2010-12-31 | 2011-08-24 | 青岛海信传媒网络技术有限公司 | Method, device and system for supporting large quantity of concurrent downloading |
| CN102256163A (en) * | 2011-08-10 | 2011-11-23 | 中山大学深圳研究院 | Video-on-demand system based on P2P (Peer-To-Peer) |
| CN102404378A (en) * | 2010-09-07 | 2012-04-04 | 成都索贝数码科技股份有限公司 | A streaming media distribution transmission network system |
| CN102546783A (en) * | 2011-12-28 | 2012-07-04 | 深圳市新为软件有限公司 | Course resource downloading method, course resource clients, server and system |
| CN102710790A (en) * | 2012-06-20 | 2012-10-03 | 深圳市远行科技有限公司 | Memcached implementation method and system based on metadata management |
| CN103812915A (en) * | 2012-11-15 | 2014-05-21 | 中兴通讯股份有限公司 | Resource sharing method, device and system, terminal and resource management center |
| CN103888419A (en) * | 2012-12-21 | 2014-06-25 | 中国电信股份有限公司 | Method and system for enabling virtual desktop terminal to obtain video content and CDN sub-system |
| CN104363244A (en) * | 2014-11-26 | 2015-02-18 | 上海金桥信息股份有限公司 | Multimedia information sharing system and method |
| US20150381710A1 (en) * | 2014-06-30 | 2015-12-31 | Fortinet, Inc. | Socket application program interface (api) for efficient data transactions |
-
2016
- 2016-12-23 CN CN201611208637.5A patent/CN108243203A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101047610A (en) * | 2007-04-30 | 2007-10-03 | 华为技术有限公司 | Data storage, reading, transmission method and management server and network node |
| CN102404378A (en) * | 2010-09-07 | 2012-04-04 | 成都索贝数码科技股份有限公司 | A streaming media distribution transmission network system |
| CN102164160A (en) * | 2010-12-31 | 2011-08-24 | 青岛海信传媒网络技术有限公司 | Method, device and system for supporting large quantity of concurrent downloading |
| CN102256163A (en) * | 2011-08-10 | 2011-11-23 | 中山大学深圳研究院 | Video-on-demand system based on P2P (Peer-To-Peer) |
| CN102546783A (en) * | 2011-12-28 | 2012-07-04 | 深圳市新为软件有限公司 | Course resource downloading method, course resource clients, server and system |
| CN102710790A (en) * | 2012-06-20 | 2012-10-03 | 深圳市远行科技有限公司 | Memcached implementation method and system based on metadata management |
| CN103812915A (en) * | 2012-11-15 | 2014-05-21 | 中兴通讯股份有限公司 | Resource sharing method, device and system, terminal and resource management center |
| CN103888419A (en) * | 2012-12-21 | 2014-06-25 | 中国电信股份有限公司 | Method and system for enabling virtual desktop terminal to obtain video content and CDN sub-system |
| US20150381710A1 (en) * | 2014-06-30 | 2015-12-31 | Fortinet, Inc. | Socket application program interface (api) for efficient data transactions |
| CN104363244A (en) * | 2014-11-26 | 2015-02-18 | 上海金桥信息股份有限公司 | Multimedia information sharing system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180349095A1 (en) | Log-structured merge tree based data storage architecture | |
| US9697247B2 (en) | Tiered data storage architecture | |
| JP6768928B2 (en) | Methods and devices for compressing addresses | |
| US9411659B2 (en) | Data processing method used in distributed system | |
| CN105224255B (en) | A kind of storage file management method and device | |
| US20160110224A1 (en) | Generating job alert | |
| CN105677251B (en) | Storage system based on Redis cluster | |
| CN103488685B (en) | Fragmented-file storage method based on distributed storage system | |
| CN113609055B (en) | Method, device, equipment and readable medium for obtaining descriptor by back-end equipment | |
| CN103631873B (en) | A kind of data compression method and storage system | |
| CN112346659A (en) | Storage method, equipment and storage medium for distributed object storage metadata | |
| CN104636185A (en) | Service context management method, physical host, PCIE equipment and migration management equipment | |
| EP3865992A3 (en) | Distributed block storage system, method, apparatus and medium | |
| CN105335323B (en) | A kind of buffer storage and method of data burst | |
| CN113126888B (en) | Method, apparatus and computer program product for storage management | |
| CN104461929A (en) | Distributed type data caching method based on interceptor | |
| CN111208946A (en) | Data persistence method and system supporting KB-level small file concurrent IO | |
| US20200349186A1 (en) | Method, apparatus and computer program product for managing metadata of storage object | |
| US10831561B2 (en) | Method for changing allocation of data using synchronization token | |
| CN107066204A (en) | A kind of method for interchanging data between multinode | |
| CN108243203A (en) | A kind of data sharing method in cloud system | |
| CN205899536U (en) | Geographic information service system based on tile map | |
| KR101830504B1 (en) | In-Memory DB Connection Support Type Scheduling Method and System for Real-Time Big Data Analysis in Distributed Computing Environment | |
| CN104407811A (en) | Cloud computing-based merging IO (input/output) device | |
| CN108241655A (en) | A kind of system data dump method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 101399 No. 2 East Airport Road, Shunyi Airport Economic Core Area, Beijing (1st, 5th and 7th floors of Industrial Park 1A-4) Applicant after: Zhongke Star Map Co.,Ltd. Address before: 101399 Building 1A-4, National Geographic Information Technology Industrial Park, Guomen Business District, Shunyi District, Beijing Applicant before: GEOVIS TECHNOLOGY (BEIJING) Co.,Ltd. |
|
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180703 |