CN202068449U - Data exchange platform used for multistage data exchange - Google Patents
Data exchange platform used for multistage data exchange Download PDFInfo
- Publication number
- CN202068449U CN202068449U CN2011201629794U CN201120162979U CN202068449U CN 202068449 U CN202068449 U CN 202068449U CN 2011201629794 U CN2011201629794 U CN 2011201629794U CN 201120162979 U CN201120162979 U CN 201120162979U CN 202068449 U CN202068449 U CN 202068449U
- Authority
- CN
- China
- Prior art keywords
- server
- data
- data exchange
- etl
- interchange platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
本实用新型公开了用于多级数据交换的数据交换平台，每级数据交换平台包括数据交换服务总线服务器、数据采集任务调度服务器、交换机、ETL服务器、ODS服务器、数据仓库服务器；所述数据交换服务总线服务器、数据采集任务调度服务器、ETL服务器、ODS服务器和数据仓库服务器分别与交换机相连，上级数据交换平台的ETL服务器通过网络与下级数据交换平台的数据仓库服务器连接。本实用新型通过统一的数据交换平台，实现各系统之间不同结构和格式的数据交换，实现数据交换平台的通用化，克服了现有技术需要根据特定需求构建信息系统对信息系统之间的连接通道的缺点。
The utility model discloses a data exchange platform for multi-level data exchange, each level of data exchange platform includes a data exchange service bus server, a data collection task scheduling server, a switch, an ETL server, an ODS server, and a data warehouse server; the data exchange The service bus server, data collection task scheduling server, ETL server, ODS server and data warehouse server are respectively connected to the switch, and the ETL server of the upper data exchange platform is connected to the data warehouse server of the lower data exchange platform through the network. The utility model realizes the data exchange of different structures and formats among various systems through a unified data exchange platform, realizes the generalization of the data exchange platform, and overcomes the need to build an information system according to specific requirements in the prior art to connect information systems Disadvantages of channels.
Description
Technical field
The utility model relates to field of computer technology, particularly is used for the data interchange platform of multi-stage data exchange.
Background technology
Along with the application that deepens continuously of enterprise information system, often need to realize collaborative work, the more particularly report data that need gather by the exchange of data, need perhaps upload to higher level department from a systems exchange to the another one system from department of subordinate.If information system is not considered the exchanges data problem at first stage of construction, when developing, just need handle in the later stage the data exchange.
The available data switching technology mainly is the data exchange ways of employing system to system, promptly make up information system to the interface channel between the information system according to particular demands, this technological means need be researched and developed data exchange system separately to each exchanges data demand, when the exchanges data demand more for a long time, the workload of deployment, change and service data switching system is quite big.Prior art is not considered the demand of multi-stage data exchange in addition, realizes that multi-stage data reports and inefficiency when gathering.
The utility model content
In order to overcome the deficiencies in the prior art, the purpose of this utility model provides the data interchange platform that is used for the multi-stage data exchange, solve the data transmission problems between the heterogeneous system, realize the generalization of data interchange platform, and the Technical Architecture of each rank data interchange platform is unified when realizing the multi-stage data exchange.
The purpose of this utility model is achieved through the following technical solutions: be used for the data interchange platform of multi-stage data exchange, every grade of data switching plane comprises data warehouse server, ODS (operating data storage) server, ETL (extracting conversion loads) server, switch, data exchange service bus server and data acquisition task scheduling server; Described data warehouse server, ODS server, ETL server, data exchange service bus server, data acquisition task scheduling server link to each other with switch respectively; The ETL server of higher level's data interchange platform is connected with the data warehouse server of subordinate data interchange platform by network.
Described ODS server and data warehouse server adopt a station server to realize.
The data interchange platform that is used for the multi-stage data exchange of the present utility model links to each other with request end computer, operation system, Database Systems by network in application, and its course of work is as follows:
(1) exchanges data party in request is by request end computer called Web service.
(2) data acquisition task scheduling server specifically comprises according to the content arrangement exchanges data work of Web service:
Transfer the ETL server and from corresponding business system or database, extract desired data, and to data clean, processing such as conversion and verification, after finishing data are sent to the ODS server;
On the ODS server, the data of separate sources are integrated and gathered, after finishing data are sent in the data warehouse server and preserve.
(3) carry out multi-stage data exchange: higher level's data interchange platform extracts the data in the data warehouse server of subordinate's data interchange platform by the ELT server, and finishes by the ODS server and to store in the data warehouse server of higher level's data interchange platform after data are integrated.
The utility model has the following advantages and effect with respect to prior art:
1, the utility model is by unified data interchange platform, realize the exchanges data of different structure and form between each system, realize the generalization of data interchange platform, having overcome prior art need make up the shortcoming of information system to the interface channel between the information system according to particular demands.
2, the utility model is supported the multi-stage data exchange, has improved the efficient that multi-stage data reports and gathers.
Description of drawings
Fig. 1 is the structural representation of a kind of execution mode of the present utility model.
Fig. 2 is the schematic diagram of data interchange platform in application among Fig. 1.
Schematic diagram when Fig. 3 is applied to three grades of data exchanges for the data interchange platform among Fig. 1.
Fig. 4 is the structural representation of another kind of execution mode of the present utility model.
Embodiment
Below in conjunction with embodiment and accompanying drawing, the utility model is described in further detail, but execution mode of the present utility model is not limited thereto.
Embodiment 1
As shown in Figure 1, the data interchange platform that is used for the multi-stage data exchange of the present utility model, every grade of data switching plane comprises data warehouse server 1, ODS server 2, ETL server 3, switch 4, data exchange service bus server 5 and data acquisition task scheduling server 6; Described data warehouse server 1, ODS server 2, ETL server 3, data exchange service bus server 5, data acquisition task scheduling server 6 link to each other with switch 4 respectively; The ETL server 3 of higher level's data interchange platform is connected with the data warehouse server 1 of subordinate data interchange platform by network.
Fig. 2 is used for the schematic diagram of the data interchange platform of multi-stage data exchange in application, as shown in the figure, the data interchange platform that is used for the multi-stage data exchange is linked to each other with request end computer 9 by network by data exchange service bus server 5, is linked to each other with each operation system 7, Database Systems 8 by network by ETL server 3.
The data interchange platform of multi-stage data exchange that is used for of the present utility model is when work, all data exchange request are all passed through 5 issues of data exchange service bus server, exchanges data party in request at first issues the Web service that comprises the exchanges data demand information by request end computer 9 on data exchange service bus server 5, this Web service promptly can be all has the exchanges data party in request of similar demand that data exchange service is provided.The concrete course of work is as follows:
(1) exchanges data party in request is by request end computer 9 called Web service.
(2) data acquisition task scheduling server 6 specifically comprises according to the content arrangement exchanges data work of Web service:
Transfer ETL server 3 and from corresponding business system 7 or database 8, extract desired data, and to data clean, processing such as conversion and verification, after finishing data are sent to ODS server 2;
On ODS server 2, the data of separate sources are integrated and gathered, after finishing data are sent in the data warehouse server 1 and preserve.
(3) carry out multi-stage data exchange: Fig. 3 and be the application schematic diagram of data interchange platform of the present utility model when being used for three grades of data exchanges, as shown in the figure, the ETL server 3 of higher level's data interchange platform links to each other with the data warehouse server 1 of subordinate data interchange platform by network.When carrying out the multi-stage data exchange, higher level's data interchange platform extracts the data in the data warehouse server 1 of subordinate's data interchange platforms by ELT server 3, and finishes by ODS server 2 and to store in the data warehouse server 1 of higher level's data interchange platform after data are integrated.
Embodiment 2
As shown in Figure 4, the data interchange platform of present embodiment adopts a station server (being ODS and data warehouse server 10) realizes except that data warehouse server and ODS server, the annexation of all the other parts and part is identical with embodiment 1, its course of work is also identical, does not repeat them here.
The foregoing description is the utility model preferred implementation; but execution mode of the present utility model is not limited by the examples; other any do not deviate from change, the modification done under spirit of the present utility model and the principle, substitutes, combination, simplify; all should be the substitute mode of equivalence, be included within the protection range of the present utility model.
Claims (2)
1. the data interchange platform that is used for the multi-stage data exchange, it is characterized in that every grade of data switching plane comprises data warehouse server (1), ODS server (2), ETL server (3), switch (4), data exchange service bus server (5) and data acquisition task scheduling server (6); Described data warehouse server (1), ODS server (2), ETL server (3), data exchange service bus server (5), data acquisition task scheduling server (6) link to each other with switch (4) respectively; The ETL server (3) of higher level's data interchange platform is connected with the data warehouse server (1) of subordinate's data interchange platform by network.
2. the data interchange platform that is used for the multi-stage data exchange according to claim 1 is characterized in that, described ODS server and data warehouse server adopt a station server to realize.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011201629794U CN202068449U (en) | 2011-05-20 | 2011-05-20 | Data exchange platform used for multistage data exchange |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011201629794U CN202068449U (en) | 2011-05-20 | 2011-05-20 | Data exchange platform used for multistage data exchange |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN202068449U true CN202068449U (en) | 2011-12-07 |
Family
ID=45062298
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011201629794U Expired - Fee Related CN202068449U (en) | 2011-05-20 | 2011-05-20 | Data exchange platform used for multistage data exchange |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN202068449U (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105447176A (en) * | 2015-12-09 | 2016-03-30 | 冶金自动化研究设计院 | Enterprise heterogeneous data exchange platform |
| CN105740069A (en) * | 2016-01-29 | 2016-07-06 | 中国电力科学研究院 | An automatic scheduling method for multi-level data conversion tasks |
| CN107608985A (en) * | 2016-07-12 | 2018-01-19 | 深圳市远行科技股份有限公司 | Big data service integration method, apparatus and system |
| CN108234608A (en) * | 2017-12-20 | 2018-06-29 | 国家电网公司 | A kind of method of data synchronization between power grid ERP system and third party system |
| CN109246243A (en) * | 2018-10-29 | 2019-01-18 | 杭州数梦工场科技有限公司 | resource transmission method and device |
| CN110008042A (en) * | 2019-03-28 | 2019-07-12 | 北京易华录信息技术股份有限公司 | A container-based algorithm cascade method and system |
-
2011
- 2011-05-20 CN CN2011201629794U patent/CN202068449U/en not_active Expired - Fee Related
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105447176A (en) * | 2015-12-09 | 2016-03-30 | 冶金自动化研究设计院 | Enterprise heterogeneous data exchange platform |
| CN105740069A (en) * | 2016-01-29 | 2016-07-06 | 中国电力科学研究院 | An automatic scheduling method for multi-level data conversion tasks |
| CN107608985A (en) * | 2016-07-12 | 2018-01-19 | 深圳市远行科技股份有限公司 | Big data service integration method, apparatus and system |
| CN108234608A (en) * | 2017-12-20 | 2018-06-29 | 国家电网公司 | A kind of method of data synchronization between power grid ERP system and third party system |
| CN109246243A (en) * | 2018-10-29 | 2019-01-18 | 杭州数梦工场科技有限公司 | resource transmission method and device |
| CN109246243B (en) * | 2018-10-29 | 2021-07-30 | 杭州数梦工场科技有限公司 | Resource transmission method and device |
| CN110008042A (en) * | 2019-03-28 | 2019-07-12 | 北京易华录信息技术股份有限公司 | A container-based algorithm cascade method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN202068449U (en) | Data exchange platform used for multistage data exchange | |
| CN106339509A (en) | Power grid operation data sharing system based on large data technology | |
| CN103761309A (en) | Operation data processing method and system | |
| CN103237045A (en) | Parallel processing system and parallel processing method for large-scale real-time traffic data | |
| CN102508908A (en) | Method for acquiring subordinate financial business data and system for acquiring subordinate financial business data | |
| CN202373025U (en) | Intelligent device for dispatching business integration and data integration | |
| CN106850258A (en) | A kind of Log Administration System, method and device | |
| CN103049527A (en) | Large power grid oriented parallel real-time database master and slave switching management system | |
| CN102394903A (en) | Active reconstruction calculating system constructing system | |
| CN102333120A (en) | Flow storage system for load balance processing | |
| CN102404406A (en) | Marine real-time data synchronization system based on private cloud storage | |
| CN104735104A (en) | WeChat intelligent public platform system | |
| CN202364244U (en) | Processing device of distributed log analysis system | |
| CN104850983B (en) | The method building the office automation system based on information real-time control management | |
| CN207691854U (en) | A kind of Government Affair Information System based on data share exchange | |
| CN103699556A (en) | Digital local chronicle information system for compiling local chronicle and geographical information | |
| CN202475491U (en) | Talent assessment system for enterprise | |
| CN203057178U (en) | Integrated office system based on enterprise service bus | |
| CN202495968U (en) | Enterprise integration information platform | |
| CN106293960A (en) | A kind of method and system realizing data conversion based on strom and internal memory grid | |
| CN104299081A (en) | HR management system based on big data | |
| CN203675130U (en) | Remote maintenance system based on Internet of Things | |
| CN207491138U (en) | A kind of user data acquisition module based on Intelligent set top box | |
| CN113849568A (en) | An enterprise data center | |
| CN104317569A (en) | Method for rapid service aggregation based on application interconnection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20111207 Termination date: 20120520 |