CN101014044A - Network GIS system and data transmitting method thereof - Google Patents
Network GIS system and data transmitting method thereof Download PDFInfo
- Publication number
- CN101014044A CN101014044A CN 200710051430 CN200710051430A CN101014044A CN 101014044 A CN101014044 A CN 101014044A CN 200710051430 CN200710051430 CN 200710051430 CN 200710051430 A CN200710051430 A CN 200710051430A CN 101014044 A CN101014044 A CN 101014044A
- Authority
- CN
- China
- Prior art keywords
- gis
- server
- data
- network
- cluster
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 16
- 230000005540 biological transmission Effects 0.000 claims abstract description 21
- 230000008569 process Effects 0.000 claims description 2
- 238000007726 management method Methods 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 9
- 238000012546 transfer Methods 0.000 description 6
- 238000013500 data storage Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000009365 direct transmission Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000012467 final product Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012732 spatial analysis Methods 0.000 description 1
- 230000033772 system development Effects 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
本发明属于地理信息技术领域，提供一种网络GIS系统及其数据传输方法。网络GIS系统包括：GIS客户端，用于向客户提供GIS服务请求操作和获得服务结果；应用服务器集群，用于响应GIS客户端的GIS服务请求并提供GIS服务；基于对象存储集群，用于以空间存储对象的方式存储空间数据，并向应用服务器集群提供存储共享池。网络GIS系统的数据传输方法是：空间数据以空间存储对象的方式存储在基于对象存储集群中，应用服务器集群和基于对象存储集群相结合，基于对象存储集群给应用服务器集群提供存储共享池，GIS客户端通过应用服务器集群来访问基于对象存储集群中的空间存储对象。本发明大幅提高了网络GIS的数据传输速率。
The invention belongs to the technical field of geographic information and provides a network GIS system and a data transmission method thereof. The network GIS system includes: GIS client, used to provide customers with GIS service request operations and obtain service results; application server clusters, used to respond to GIS service requests from GIS clients and provide GIS services; object-based storage clusters, used to Store spatial data in the form of objects, and provide a storage shared pool for application server clusters. The data transmission method of the network GIS system is: the spatial data is stored in the object-based storage cluster in the form of spatial storage objects, the application server cluster and the object-based storage cluster are combined, and the object-based storage cluster provides a shared storage pool for the application server cluster. The client accesses the spatial storage objects in the object storage cluster through the application server cluster. The invention greatly improves the data transmission rate of the network GIS.
Description
Technical field
The invention belongs to the geographical information technology field, particularly a kind of network GIS system and data transmission method thereof.
Background technology
Network provides an information superhighway for information exchange between the user and information inquiry all over the world, GIS-Geographic Information System (Geographic Information System, be called for short GIS) have abundant space querying, spatial analysis and attribute management function, becoming the main contents of Internet or Intranet.Along with the continuous development of Internet technology and people demand to generalized information system, generalized information system is merged mutually with network technology, the function of utilizing Internet to browse, inquire about and analyze for the user provides spatial data, form the geographical space integrated platform of a networking, become the inexorable trend of generalized information system development.Along with the enlarging day by day of network GIS application, spatial data resolution improve constantly and one dimension is handled the transformation of handling to multidimensional, the spatial data amount of catenet GIS management sharply increases, to the TB level, even PB level is being the data-centered transformation of middle mind-set with system from the GB level.
At present, network GIS comprises client computer, application server, database server in the typical three-decker of being applied as of Internet, and all spatial datas and application services all are placed on server end, greatly reduce the workload of FTP client FTP.But along with the increase of spatial data amount, there are two transfer of data bottlenecks in this structure: server provides the network service bandwidth bottleneck of service and the storage I/O bandwidth bottleneck of spatial data storage system.Specifically, increase when the GIS number of users, the GIS application server of Single-Server structure is subjected to the restriction of the network bandwidth, be difficult to satisfy the requirement of multi-user concurrent visit, the visit capacity of this service number system also sharply increases, and this spatial data transmission pressure has caused the storage I/O bottleneck of spatial data storage system.Because network GIS is used with the regular transaction processing a great difference is arranged, outstanding behaviours is in processing mode, the spatial distributions of googol according to amount, complexity, therefore the technological means of these two kinds of bottlenecks does not appear solving in existing network GIS technical field as yet, and the network GIS application and development is restricted.
Summary of the invention
The object of the invention is to solve the prior art deficiency, provides the network GIS technical scheme to overcome network service bandwidth bottleneck and storage I/O bandwidth bottleneck.
For achieving the above object, network GIS system of the present invention comprises following part, and the GIS client is used for the GIS service request operation being provided and obtaining service result to the client; Application server cluster is used to respond the GIS service request of GIS client and GIS is provided service; Based on the object storage cluster, be used for mode memory space data, and provide the storage shared pool to application server cluster with the space storage object.
And application server cluster is made up of load dispatch device and GIS server pools, and above-mentioned part is connected by the switching network based on TCP/IP.
And, load dispatch device copy is set.
And the GIS server pools adopts the LVS server to form.
And, form by meta data server with based on object storage equipment based on the object storage cluster.
And, GIS server, meta data server and based on object storage equipment by switching network interconnection based on TCP/IP.
The present invention also provides the data transmission method of above-mentioned network GIS system, spatial data is stored in based in the object storage cluster in the mode of space storage object, application server cluster and combine based on the object storage cluster, provide the storage shared pool based on the object storage cluster to application server cluster, the GIS client visits based on the space storage object in the object storage cluster by application server cluster.
And control path, data path separate with the management path, and the GIS server sends data access request by the control path to meta data server; Meta data server is managed based on object storage equipment by the management path; The GIS server is directly visited based on object storage equipment by data path.
And the GIS client is from based on the data transmission procedure that obtains spatial data the object storage equipment being:
(a) the GIS client is sent the GIS service request to the load dispatch device;
(b) the load dispatch device is selected a GIS server and to this GIS server forwards GIS service request from the GIS server pools;
(c) the GIS server sends data service request to meta data server;
(d) meta data server authenticates the GIS server, returns effective credential;
(e) GIS server by utilizing credential is to based on object storage equipment sending data access request;
(f) verify the legitimacy of GIS server data request based on object storage equipment by credential, set up transfer of data and connect;
(g) the GIS server will be handled the back according to the GIS service request from the spatial data that obtains based on object storage equipment provides to the GIS client.
And in the term of validity of credential, the GIS client continues to need not repeating step (d)～(f) from when obtaining spatial data the object storage equipment, directly carries out exchanges data at the GIS server between based on object storage equipment.
The present invention creatively is provided with dual cluster and realizes network GIS system, come service in the supervising the network generalized information system by application server cluster, has solved the network service bandwidth bottleneck that the GIS server provides service; By application server cluster with based on the combination of object storage cluster, make up new spatial data transmission path, solved storage I/O bandwidth bottleneck.By two kinds of transfer of data bottlenecks of comprehensive solution, the present invention has significantly improved the message transmission rate of network GIS.The present invention also uses for network GIS the data transmission method of new network GIS system is provided, and has set up safe data transmission mechanism; Employing solves the isomerous environment problem of memory device based on the object storage mode.Enforcement of the present invention will be established solid network foundation for the popularization and application of global geographical information, for human lives's application of aspects geography information is brought huge convenience.
Description of drawings
Fig. 1 is a network GIS system composition frame chart of the present invention;
Fig. 2 is an application server cluster schematic diagram of the present invention;
Fig. 3 is of the present invention based on object storage cluster schematic diagram;
Fig. 4 is the transfer of data workflow diagram of the embodiment of the invention.
Embodiment
Referring to accompanying drawing 1, network GIS system provided by the invention comprises following part,
(1) the GIS client 1, and being used for provides GIS service request operation to the client;
The GIS client part mainly is that the client computer that the GIS client software is housed is formed; The GIS client links to each other with application server cluster by network (adopting Internet usually).It is partly existing that the GIS client part belongs to prior art.In a network GIS system, the quantity of GIS client usually is huge and uncertain, and the user only needs the GIS client software is installed on personal computer, means that promptly producing one can supply the client of access.Unless the therefore high GIS-Geographic Information System (for example military use) of safety requirements, GIS client 1 partly adopts internal lan to be connected with other, and employing Internet connection is the most practical way of most convenient under other situations.
(2) application server cluster 2, be used to respond the GIS service request of GIS client and GIS is provided service;
Application server in function that application server cluster is partly realized and the prior art three-decker is similar, is used to respond the GIS client-requested and service is provided.Application server cluster of the present invention partly is made up of load dispatch device 211, GIS server pools, can adopt the 100M/1000M high speed switching network of use based on TCP/IP when specifically implementing.
Cluster is the set or the group of a plurality of systems, and they work as individual server together.Therefore consider the service role that network GIS is huge day by day, adopting Clustering that the GIS service is provided is the best thinking that solves network service bandwidth bottleneck.The GIS server pools comprises a plurality of GIS servers that same services is provided, and each GIS server plays a role as a node of cluster.Cluster server technology based on the Linux core is the most ripe at present, and application server cluster 2 can make up by LVS server cluster standard when specifically implementing, and the GIS server can adopt the LVS server.For Resources allocation, also load dispatch device 211 need be set, when GIS client 1 sends the GIS service request, load dispatch device 211 will be transmitted to a certain GIS server in the GIS server pools with user's request according to built-in dispatching algorithm.Load dispatch device 211 is load balancing cores of whole application server cluster, and all operations are all finished in the (SuSE) Linux OS core space when specifically implementing, and expense is very little, has very high throughput.The GIS service need be called spatial data, and the present invention is by providing shared memory space based on the object storage cluster, with calling of all GIS servers in the support GIS server pools.
Referring to Fig. 2, the embodiment of the invention also is provided with load dispatch device copy 212 standby as load dispatch device 211, is unique part in the face of GIS client 1 in the whole application server cluster 2; The GIS server pools is formed (only enumerate two GIS servers in the accompanying drawing, in fact can expand more) by GIS server 221 and GIS server 222 etc., constitutes the real supplier of GIS service.When the load of receiving when whole system surpasses the disposal ability of all nodes at present, can in the GIS server pools, increase the GIS server and satisfy ever-increasing request load.The component part that GIS application server, data server, WMS server (WMS is a warehouse management system) or the like various GIS servers can be the GIS server pools.For good retractility and availability is provided, the present invention has adopted based on object storage technology, and the object-based storage cluster file system of GIS server access is just as the visit local file system.For the ease of the principle of reactive applications server cluster 2, the embodiment of the invention will be called the storage shared pool of application server cluster based on the shared memory space that object storage cluster 3 is realized, adopt the X mark.
(3), be used for mode memory space data, and provide storage shared pool X to application server cluster with the space storage object based on object storage cluster 3.
The data capacity of single database server can't satisfy network GIS to be used, and the present invention adopts the cluster memory technology to replace the effect of database server in the prior art.The mass data storage technology has experienced the three phases to SAN (storage area network) by DAS (direct-connected mode is stored), NAS (network is directly stored): wherein the DAS mode is that memory device is passed through cable directly to server, be piling up of hardware, do not have the improvement of file system, use limited in default of centralized management solution; The NAS mode can be considered piece level Clustering, is the All Files under the different system platform is deposited in the memory device, therefore has the I/O bottleneck equally, also can't solve the bottleneck problem that network GIS faces; The SAN mode realizes the file-level cluster by a software virtual layer, and only needing by a SAN file system is the addressable file that is stored on a plurality of equipment, and therefore a plurality of equipment constitute cluster can provide more space for the storage data.But present this mode still is difficult to satisfy the requirement of network GIS, because typical SAN mode need be provided with the center of meta data server as the large-scale cluster storage, obtain the storage data and need pass through visit, control, the management of meta data server, so meta data server constitutes the I/O bottleneck easily.And the SAN mode can only be managed the file of homogeneous environment concentratedly, is difficult to be applied to network GIS complicated spatial data source.
The present invention proposes the storage cluster scheme that is suitable for network GIS, by application server cluster 2 with based on the combination of object storage cluster 3, make up new spatial data transmission path, GIS client 1 visits based on the space storage object in the object storage cluster 3 by application server cluster 2, and the direct transmission by GIS server and memory device has solved storage I/O bandwidth bottleneck.
The present invention adopts based on object storage equipment 32, based on the abstract design of object storage by object hierarchy, functions such as the visit of storage, control, management are repartitioned, the logical construction of file system and the mapping relations of physical store are hidden into object one deck, and the accessing operation of data is realized by the interface of object.Can be hidden in the object layer separating in device-dependent characteristic (distributing) slave unit one deck based on object storage, realize cross-platform sharing, effectively solve the isomerous environment problem that SAN faces as piece.During concrete enforcement, massive spatial data is decomposed into a series of spaces storage object according to own characteristic, application and storage demand and carries out object-based spatial data storage and management.The space storage object can be defined as one group and be distributed in one or more based on the object of being made up of spatial data, memory attribute and operation on the object storage equipment.Memory attribute is used for defining the storage characteristics of different spaces data, as data layout, security information and behaviour in service statistical information etc., thereby can indicate operational processes to spatial data according to memory attribute.Based on object storage spatial data and attribute data are stored with the space storage object, managing for the centralized stores of implementation space data provides a kind of new solution.Therefore, it should be noted that of the present inventionly to mean a plurality of hardware of memory device in the specific implementation, and these hardware can be variety classes based on object storage equipment 32.These hardware are interconnected by switching network during concrete enforcement, constitute the basis of storage cluster.Connect the GIS server of application server cluster 2, meta data server 31 and get final product by switching network interconnection based on TCP/IP based on object storage equipment 32 from particular hardware.
The present invention also sums up the data transmission method that this network GIS system based on dual cluster is provided: adopt spatial data to be stored in based in the object storage cluster 3 in the mode of space storage object, application server cluster 2 and combine based on object storage cluster 3, storage shared pool X is provided for application server cluster 2 based on object storage cluster 3, GIS client 1 visits based on the space storage object in the object storage cluster 3 by application server cluster 2.The present invention has also improved spatial data storage I/O mode: when carrying out transfer of data, meta data server 31 is independent from application server, control path, data path are separated with the management path: specific embodiment is referring to Fig. 3, and a certain GIS server 221 sends data access request by the control path to meta data server 31; Meta data server 31 is managed based on object storage equipment 32 by the management path; GIS server 221 is directly visited based on object storage equipment 32 by data path.This structure has shortened the I/O path greatly, and 90% metadata management is moved down into based in the object storage equipment 32, thereby has solved the meta data server bottleneck problem in the legacy network cluster memory technology.
Referring to Fig. 4, GIS client 1 is carried out from being divided into following steps based on the data transmission procedure that obtains spatial data the object storage equipment 32:
(a) GIS client 1 is sent the GIS service request to load dispatch device 211;
(b) load dispatch device 211 is selected a GIS server 221 and is transmitted the GIS service request to this GIS server 221 from the GIS server pools;
(c) GIS server 221 sends data service request to meta data server 31;
(d) 31 pairs of GIS servers 221 of meta data server authenticate, and return effective credential;
(e) GIS server 221 utilizes credential to sending data access request based on object storage equipment 32;
(f) verify the legitimacy of GIS server 221 request of data based on object storage equipment 32 by credential, set up transfer of data and connect;
(g) GIS server 221 will be handled the back according to the GIS service request from the spatial data that obtains based on object storage equipment provides to GIS client 1.
In the term of validity of credential, GIS client 1 continues to need not repeating step (d)～(f) from when obtaining spatial data the object storage equipment 32, directly carries out exchanges data at GIS server 221 between based on object storage equipment 32.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710051430 CN101014044A (en) | 2007-01-30 | 2007-01-30 | Network GIS system and data transmitting method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710051430 CN101014044A (en) | 2007-01-30 | 2007-01-30 | Network GIS system and data transmitting method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101014044A true CN101014044A (en) | 2007-08-08 |
Family
ID=38701325
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200710051430 Pending CN101014044A (en) | 2007-01-30 | 2007-01-30 | Network GIS system and data transmitting method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101014044A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102148870A (en) * | 2011-03-07 | 2011-08-10 | 浪潮(北京)电子信息产业有限公司 | Cloud storage system and implementation method thereof |
| CN103986605A (en) * | 2014-05-23 | 2014-08-13 | 杭州华三通信技术有限公司 | Network management server, processing server, network management system and corresponding method |
| CN106664314A (en) * | 2014-07-25 | 2017-05-10 | 华为技术有限公司 | Method, computing device and system for invoking software application methods of remote Java objects |
| CN106802948A (en) * | 2017-01-13 | 2017-06-06 | 郑州云海信息技术有限公司 | A kind of grid GIS data-storage system |
| CN109447536A (en) * | 2018-08-28 | 2019-03-08 | 浙江工业大学 | A kind of warehouse Real-time Monitor Management method based on GIS |
| CN110602163A (en) * | 2019-08-07 | 2019-12-20 | 阿里巴巴集团控股有限公司 | File uploading method and device |
| CN115907697A (en) * | 2023-01-10 | 2023-04-04 | 住房和城乡建设部信息中心(住房和城乡建设部住房信息管理中心) | House building online investigation method and equipment |
-
2007
- 2007-01-30 CN CN 200710051430 patent/CN101014044A/en active Pending
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102148870A (en) * | 2011-03-07 | 2011-08-10 | 浪潮(北京)电子信息产业有限公司 | Cloud storage system and implementation method thereof |
| CN102148870B (en) * | 2011-03-07 | 2013-07-10 | 浪潮(北京)电子信息产业有限公司 | Cloud storage system and implementation method thereof |
| CN103986605A (en) * | 2014-05-23 | 2014-08-13 | 杭州华三通信技术有限公司 | Network management server, processing server, network management system and corresponding method |
| CN103986605B (en) * | 2014-05-23 | 2017-11-14 | 新华三技术有限公司 | NM server, processing server, network management system and corresponding method |
| CN106664314A (en) * | 2014-07-25 | 2017-05-10 | 华为技术有限公司 | Method, computing device and system for invoking software application methods of remote Java objects |
| US10341234B2 (en) | 2014-07-25 | 2019-07-02 | Huawei Technologies Co., Ltd. | Method, computing device and system for invoking software application methods of remote JAVA objects |
| CN106664314B (en) * | 2014-07-25 | 2020-03-31 | 华为技术有限公司 | Method, computing device and system for calling software application method of remote Java object |
| CN106802948A (en) * | 2017-01-13 | 2017-06-06 | 郑州云海信息技术有限公司 | A kind of grid GIS data-storage system |
| CN109447536A (en) * | 2018-08-28 | 2019-03-08 | 浙江工业大学 | A kind of warehouse Real-time Monitor Management method based on GIS |
| CN110602163A (en) * | 2019-08-07 | 2019-12-20 | 阿里巴巴集团控股有限公司 | File uploading method and device |
| CN110602163B (en) * | 2019-08-07 | 2022-02-01 | 创新先进技术有限公司 | File uploading method and device |
| CN115907697A (en) * | 2023-01-10 | 2023-04-04 | 住房和城乡建设部信息中心(住房和城乡建设部住房信息管理中心) | House building online investigation method and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2903992C (en) | Application marketplace for virtual desktops | |
| CN102651775B (en) | Based on method, the equipment and system of many tenants shared object management of cloud computing | |
| CA2904281C (en) | Automated data center selection | |
| Zeng et al. | Research on cloud storage architecture and key technologies | |
| US9047462B2 (en) | Computer account management system and realizing method thereof | |
| CN108121705B (en) | Open multi-source two-dimensional and three-dimensional geographic information data aggregation and release system | |
| CN104917843B (en) | Cloud storage and medical image seamless interfacing system | |
| CA2903835A1 (en) | Automated desktop placement | |
| CN106559488A (en) | A kind of method of the electrical network geographical information space service for setting up tenant's driving | |
| CN101014044A (en) | Network GIS system and data transmitting method thereof | |
| CN103078944B (en) | Based on the data center architecture of distributed symmetric file system | |
| CN103533023B (en) | Cloud service application cluster based on cloud service feature synchronizes system and synchronous method | |
| CN104680462A (en) | Case information optimization and acquisition method for medical system based on cloud platform | |
| CN105005611A (en) | File management system and file management method | |
| CN103607424A (en) | Server connection method and server system | |
| CN104063501B (en) | copy balance method based on HDFS | |
| CN107426288A (en) | A kind of resource-sharing schedule method and apparatus based on storage network | |
| EP3057007A1 (en) | Cloud-based hardware architecture | |
| Zhao et al. | Dynamic replica creation strategy based on file heat and node load in hybrid cloud | |
| CN110826993A (en) | Project management processing method, device, storage medium and processor | |
| CN111291045A (en) | Service isolation data transmission method, device, computer equipment and storage medium | |
| Wei et al. | Global virtual data space for unified data access across supercomputing centers | |
| Zhou et al. | Gis application model based on cloud computing | |
| CN117972006A (en) | A geographic information service environment for rail power management systems | |
| Yao | The Application of Cloud Computing in the Management of Digital Archives in Colleges and Universities |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Open date: 20070808 |