[go: up one dir, main page]

CN103986760B - The efficient link transmission method of growth form data source formula based on multi-parameter arbitration - Google Patents

The efficient link transmission method of growth form data source formula based on multi-parameter arbitration Download PDF

Info

Publication number
CN103986760B
CN103986760B CN201410203215.3A CN201410203215A CN103986760B CN 103986760 B CN103986760 B CN 103986760B CN 201410203215 A CN201410203215 A CN 201410203215A CN 103986760 B CN103986760 B CN 103986760B
Authority
CN
China
Prior art keywords
data
server
transmission
data source
source
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410203215.3A
Other languages
Chinese (zh)
Other versions
CN103986760A (en
Inventor
王田田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Upper Marine Infotech Share Co Ltd Of Interrogating
Original Assignee
Upper Marine Infotech Share Co Ltd Of Interrogating
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Upper Marine Infotech Share Co Ltd Of Interrogating filed Critical Upper Marine Infotech Share Co Ltd Of Interrogating
Priority to CN201410203215.3A priority Critical patent/CN103986760B/en
Publication of CN103986760A publication Critical patent/CN103986760A/en
Application granted granted Critical
Publication of CN103986760B publication Critical patent/CN103986760B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Computer And Data Communications (AREA)

Abstract

The invention discloses a kind of efficient link transmission method of growth form data source formula based on multi-parameter arbitration, including step:S1:Build a transmission network;S2:The server transmission data into each server group forms a data source to source host respectively;The data source being formed simultaneously server transmission data in one non-data source into the server group at place forms new data source;S3:The server transmission data in each data source non-data source into the server group at place respectively forms next new data source;The server transmission data in source host to a non-data source forms another new data source simultaneously;S4:Step S3 is repeated, until Servers-all all becomes data source.As a result of a kind of efficient link transmission method of growth form data source formula based on multi-parameter arbitration of the present invention, there are multiple data sources to form net structure concurrent transmission, the advantages of greatly improving the efficiency of transmission of data.

Description

The efficient link transmission method of growth form data source formula based on multi-parameter arbitration
Technical field
The present invention relates to a kind of link transmission method more particularly to a kind of growth form data source formulas based on multi-parameter arbitration Efficient link transmission method.
Background technology
In today of Internet technology rapid development, the internet informations such as common shopping, information, recruitment, enterprise official website, Its behind is all that multiple servers are supporting work, and these servers are often distributed in the special custodian of different cities needs Member is managed, and different area network environments is different, and traditional data transmission is not molded fixed high efficiency of transmission algorithm, manages Reason person is often from a data source to Servers-all sequential delivery, deployment information, once some server node goes wrong The data transmission of other servers will be influenced, this not only increases the workload of administrative staff but also company can be caused undesirable It influences.Therefore how efficient transfer data is a current very important topic.Traditional data transmission is all single Host carrying out data transmission to each server one by one;Data Transmission Content to individual server is also random, without excellent First grade concept.Traditional data dispositions method mainly has following deficiency:
1st, the prior art does not account for the interference of many kinds of parameters in link transmission, without privilege level concept, if some Certain section of link transmission rate is very low, can directly affect the data transmission of next server.
2nd, the method that the prior art often uses single data source, data transmission can not be concurrent, causes efficiency of transmission low.
The content of the invention
The defects of it is an object of the invention to overcome the prior art, and a kind of growth form number based on multi-parameter arbitration is provided According to the efficient link transmission method of source formula, deployment different data can be efficiently transmitted in multigroup server and be passed to other servers The advantages of sending data, there are multiple data sources to form net structure concurrent transmission, greatly improve the efficiency of transmission of data.
Technical problem solved by the invention is realized using following technical scheme:
A kind of efficient link transmission method of growth form data source formula based on multi-parameter arbitration of the present invention, including step:
S1:A transmission network is built, the transmission network includes a source host and communicated to connect respectively at the source host A plurality of servers, the server according to transmission data type be divided into a plurality of server groups;
S2:The server transmission data into each server group forms a data source to the source host respectively; The data source being formed simultaneously server transmission data in one non-data source into the server group at place forms new data Source;
S3:The server transmission data shape in each data source non-data source into the server group at place respectively Into next new data source;The server transmission data in the source host to a non-data source forms another new data simultaneously Source;
S4:Step S3 is repeated, until Servers-all all becomes data source.
Further improvement of the present invention is that the server into each server group passes the source host respectively Transmission of data forms a data source step and further comprises step:
A, Servers-all is added in one and calculates queue;
B, the time of the source host each server transmission data into the calculating queue is calculated, and to current It transmits the shortest server priority transmission data of data time and forms a data source;By the server group where the data source Interior server is removed from the calculating queue;
C, step b is repeated, until an at least data source in each server group.
Further improvement of the present invention is that the source host calculates each server transport number in queue to described According to time pass through a transmission time formula calculate obtain;The transmission time formula is:
Wherein DataNiTransmission size of data needed for current operation instruction is carried out for current server;Ki services for current group The average transmission rate of device;piFor the weighted value corresponding to operational order, andN is operational order sum;T is Source host transmits the required time of data to current server.
Further improvement of the present invention is, the data source of the formation one non-data into the server group at place The server transmission data in source forms new data source step and further comprises step:
The clothes in data source each non-data source into the server group at place are calculated by the transmission time formula The time for device transmission data of being engaged in;
Server priority transmission data shortest to current transmission data time form new data source.
Further improvement of the present invention is that in the step S3, the source host passes through the transmission time formula Server transmission data to a shortest non-data source of transmission data time forms another new data source.
As a result of above technical scheme, make it have following advantageous effect is the present invention:
It is provided the foundation by building a transmission network for data transmission;Source host respectively into each server group one Server transmission data forms a data source, the service in the data source being formed simultaneously one non-data source into the server group at place Device transmission data form new data source, realize and lay data source in multiple server groups.Each data source is respectively to institute Server group in the server transmission data in a non-data source form next new data source, while the source host to The server transmission data in one non-data source forms another new data source, realizes the breeding of data source in each server group, And the concurrent transmission of multiserver data.
Description of the drawings
Fig. 1 is that the present invention is based on the transmission networks of the efficient link transmission method of growth form data source formula of multi-parameter arbitration Structure diagram;
Fig. 2 is that the present invention is based on the flow charts of the efficient link transmission method of growth form data source formula of multi-parameter arbitration.
Specific embodiment
With reference to specific embodiment, the invention will be further described.
Referring to Fig. 1, a kind of efficient link transmission method of growth form data source formula based on multi-parameter arbitration of the present invention, Including step:
S1:A transmission network is built, transmission network includes a source host 1 and the plural number communicated to connect respectively at source host 1 A server 21, server are divided into a plurality of server groups 2 according to the type of transmission data;
S2:A server 21 transmission data of the source host 1 respectively into each server group 2 form a data source, simultaneously The server 21 in the data source of formation one non-data source into the server group 2 at place transmits data and forms new data source;
Wherein, a server 21 transmission data of the source host 1 respectively into each server group 2 form a data source step Specifically include step:
A, Servers-all 21 is added in into a calculating queue;
B, by a transmission time formula calculate source host 1 to calculate each server 21 in queue transmit data when Between, transmission time formula is:
Wherein DataNiTransmission size of data needed for current operation instruction is carried out for current server;Ki services for current group The average transmission rate of device;piFor the weighted value corresponding to operational order, andN is operational order sum;T is Source host transmits the required time of data to current server;
And a data source is formed to 21 prioritised transmission data of the shortest server of current transmission data time;By data source Server 21 in the server group 2 at place is removed from calculating queue;
C, step b is repeated, until an at least data source in each server group 2.
It is formed in addition, the server 21 in the data source one non-data source into the server group 2 at place formed transmits data New data source step further comprises step:
Data source server 21 in each non-data source into the server group 2 at place is calculated by transmission time formula to pass The time of transmission of data;
21 prioritised transmission data of a server shortest to current transmission data time form new data source.
S3:Each data source respectively server 21 from the non-data source to the server group 2 at place transmit data shape Into next new data source;Source host 1 transmits the shortest non-data source of data time by transmission time formula to one simultaneously Server 21 transmits data and forms another new data source;
S4:Step S3 is repeated, until Servers-all 21 all becomes data source.
Traditional data transmission is all single host carrying out data transmission to each server one by one;To single The Data Transmission Content of server is also random, no privilege level concept.The present invention is used simultaneously using short job priority principle Multi-data source concurrently transmits the pattern of information, and data are transmitted with optimal server 21, preferentially carries out data transmission, transfers Server 21 as new data source, transmits data to other servers 21, therefore has multiple data in entire transmission process again Source forms net structure concurrent transmission, substantially increases the efficiency of transmission of data.
For source host 1 when transmitting data to multiple servers 21, the data that each server 21 receives can be identical, also may be used With difference.Server is divided into different groups, the identical data of every group of transmission by the type according to data are transmitted in server 21.Example Such as, having server1, server2 ..., serverN is total to N number of server 21, is distributed in different cities.Server A1、A2…AiIt needs It transmits data A and is denoted as A group servers, server B1、B2…BjTransmission data B is needed to be denoted as B group servers, may also have C, D Deng group server, wherein secondary i+j+ ...=N).
Source host 1 arrives the average transmission rate of each server 21:ki=last time link average transmission rate * (1- δ)+sheet Secondary link average transmission rate * δ (unit K b/s).Similarly, the link average transmission rate between two servers 21 is same as above:Chain Road average transmission rate ki-j=last time link average transmission time * (1- δ)+this link average transmission rate * δ (unit K b/ s).Average transmission time+δ * old link average transmission time (Average Transfer Time)=(1- δ) * are currently average Transmission time.Wherein δ is predetermined ratio value (for a self-defining value).
The corresponding weighted of each operational order, such as corresponding weight of each operational order is respectively p1, p2, p3 ... Pn, then p1+p2+p3+ ...+pn=1.
Source host 1 transmits principle:It is preferentially shortest to transmission time in Servers-all group 2 according to transmission time length 21 incoming data of server is converted into data source, then transmits data to Servers-all 21 further according to transmission rate.
Server 21 transmits principle:According to transmission time length, the shortest non-data source server of transmission time into group 21 transmission data.
Such as:User needs to dispose 10 server groups 2, and every group of each 2 numbers of server are 10, in first server group 2 Each 21 efficiency of transmission of server is 1Kb/s, and each server transport efficiency is 2Kb/s in second server group 2, according to the rule Restrain efficiency of transmission it is incremented by successively to each server transport efficiency in the tenth server group 2 be 10Kb/s.At this time as user uses Conventional method, i.e.,:Source host 1 need to transmit data 100Kb, required time according to from 2 to the tenth server group 2 of first server group For (100/1) * 10+ (100/2) * 10+ (100/3) * 10+ ... .+ (100/10) * 10 be about 2928s, from beginning to end only there are one Data source is in transmission data.And such as method using the present invention, first deployment of server 21 is good only to need 10s, hereafter the number It can be transmitted according to source in book server group 2, form a large amount of parallel transmission threads, when source host 1 passes for each server group 2 After a defeated data, i.e. data have been transmitted completely in 2 to the 3rd server group 2 of the tenth server group during 292.8s, only surplus 4 servers do not transmit in lower first server group 2 and second server group 2, and remaining 21 data to be transmitted of server exists End of transmission in 300s, i.e., all data transmission periods are only needed less than 600s, and greatly reducing data compared to existing method passes The defeated time.
The present invention is described in detail above in association with attached drawing embodiment, those skilled in the art can be according to upper It states and bright many variations example is made to the present invention.Thus, some details in embodiment should not form limitation of the invention, this Invention will be using the scope that the appended claims define as protection scope of the present invention.

Claims (4)

1. a kind of efficient link transmission method of growth form data source formula based on multi-parameter arbitration, which is characterized in that including step:
S1:A transmission network is built, what the transmission network was communicated to connect including a source host and respectively with the source host A plurality of servers, the server are divided into a plurality of server groups according to the type of transmission data;
S2:The server transmission data into each server group forms a data source to the source host respectively, including:
A, Servers-all is added in one and calculates queue;
B, the time of the source host each server transmission data into the calculating queue is calculated, and to current transmission The shortest server priority transmission data of data time form a data source;It will be in the server group where the data source Server is removed from the calculating queue;
C, step b is repeated, until an at least data source in each server group;
The data source being formed simultaneously server transmission data in one non-data source into the server group at place forms new Data source;
S3:The server transmission data in each data source non-data source into the server group at place respectively is formed down One new data source;The server transmission data in the source host to a non-data source forms another new data source simultaneously;
S4:Step S3 is repeated, until Servers-all all becomes data source.
2. the growth form data source formula efficient link transmission method according to claim 1 based on multi-parameter arbitration, special Sign is that the time of the source host each server transmission data into the calculating queue is public by a transmission time Formula, which calculates, to be obtained;The transmission time formula is:
Wherein DataNiTransmission size of data needed for current operation instruction is carried out for current server;Ki is current group server Average transmission rate;piFor the weighted value corresponding to operational order, andN is operational order sum;T is source master Machine transmits the required time of data to current server.
3. the growth form data source formula efficient link transmission method according to claim 2 based on multi-parameter arbitration, special Sign is, the data source of the formation server transmission data in one non-data source into the server group at place is formed newly Data source step further comprise step:
The server in data source each non-data source into the server group at place is calculated by the transmission time formula Transmit the time of data;
Server priority transmission data shortest to current transmission data time form new data source.
4. the growth form data source formula efficient link transmission method according to claim 3 based on multi-parameter arbitration, special Sign is that in the step S3, the source host is shortest non-to a transmission data time by the transmission time formula The server transmission data of data source forms another new data source.
CN201410203215.3A 2014-05-14 2014-05-14 The efficient link transmission method of growth form data source formula based on multi-parameter arbitration Active CN103986760B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410203215.3A CN103986760B (en) 2014-05-14 2014-05-14 The efficient link transmission method of growth form data source formula based on multi-parameter arbitration

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410203215.3A CN103986760B (en) 2014-05-14 2014-05-14 The efficient link transmission method of growth form data source formula based on multi-parameter arbitration

Publications (2)

Publication Number Publication Date
CN103986760A CN103986760A (en) 2014-08-13
CN103986760B true CN103986760B (en) 2018-05-22

Family

ID=51278583

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410203215.3A Active CN103986760B (en) 2014-05-14 2014-05-14 The efficient link transmission method of growth form data source formula based on multi-parameter arbitration

Country Status (1)

Country Link
CN (1) CN103986760B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102185841A (en) * 2011-04-25 2011-09-14 上海爱数软件有限公司 Classified data transmission method and system
CN102387601A (en) * 2011-10-14 2012-03-21 北京航空航天大学 Self-adaptive distribution type cooperative access method and node device
CN102404368A (en) * 2010-09-17 2012-04-04 财团法人工业技术研究院 Hybrid peer-to-peer and master-slave data transmission architecture and method
CN103546546A (en) * 2013-09-30 2014-01-29 蓝盾信息安全技术股份有限公司 Large-scale cluster file distribution method
CN103595552A (en) * 2013-06-28 2014-02-19 国家超级计算深圳中心(深圳云计算中心) Analysis method and analysis system for cluster storage network parallel load

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7945618B2 (en) * 2003-02-10 2011-05-17 Oren Asher Peer-to-peer service designer

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102404368A (en) * 2010-09-17 2012-04-04 财团法人工业技术研究院 Hybrid peer-to-peer and master-slave data transmission architecture and method
CN102185841A (en) * 2011-04-25 2011-09-14 上海爱数软件有限公司 Classified data transmission method and system
CN102387601A (en) * 2011-10-14 2012-03-21 北京航空航天大学 Self-adaptive distribution type cooperative access method and node device
CN103595552A (en) * 2013-06-28 2014-02-19 国家超级计算深圳中心(深圳云计算中心) Analysis method and analysis system for cluster storage network parallel load
CN103546546A (en) * 2013-09-30 2014-01-29 蓝盾信息安全技术股份有限公司 Large-scale cluster file distribution method

Also Published As

Publication number Publication date
CN103986760A (en) 2014-08-13

Similar Documents

Publication Publication Date Title
CN104683488B (en) Streaming computing system and its dispatching method and device
Alicherry et al. Network aware resource allocation in distributed clouds
CN105103506B (en) Method and system for allocating bandwidth for non-uniform bandwidth requests in cloud computing networks
Wu et al. Green data center placement in optical cloud networks
CN104836736B (en) Efficiency resource allocation and path method for reconfiguration in elastic optical network based on frequency spectrum perception
CN103412635B (en) Data center's power-economizing method and device
CN101951411A (en) Cloud scheduling system and method and multistage cloud scheduling system
CN103516529A (en) Management method, device and system of configuration files
CN106713468B (en) A kind of distributed type assemblies service system and its method for node synergy
CN108848146A (en) A kind of method for optimizing scheduling based on time trigger communication service
CN109617810A (en) Data transmission method and device
CN102932479A (en) A topology-aware virtual network mapping method based on historical data
CN104302008B (en) A kind of wireless multi-hop network bandwidth allocation methods of comprehensive time-division and caching accounting
CN109962774A (en) Quantum cryptography networks key relays dynamic routing method
CN102448120B (en) Multipath load sharing method and device
CN103986760B (en) The efficient link transmission method of growth form data source formula based on multi-parameter arbitration
CN102025632A (en) Label distribution method and system for data packets in MPLS network
CN106651453A (en) Network platform-oriented automatic promotion method and system, and computing device
CN104283608B (en) Long-distance passive optical network guard method towards single SRLG fault
CN101771561A (en) Method for creating label forwarding table, node equipment and system
CN105657671A (en) Method and equipment for realizing multicast
CN107135283A (en) A kind of Chief Web Officer short chain configuring management method
Yin et al. A survivable XT-aware multipath strategy for SDM-EONs
CN104506442A (en) Multipoint-to-multipoint multicast business optical grooming method for flexible grid optical network
CN109962775A (en) Quantum cryptography networks key generates control method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant