[go: up one dir, main page]

CN103838770A - Logic data partition method and system - Google Patents

Logic data partition method and system Download PDF

Info

Publication number
CN103838770A
CN103838770A CN201210487025.XA CN201210487025A CN103838770A CN 103838770 A CN103838770 A CN 103838770A CN 201210487025 A CN201210487025 A CN 201210487025A CN 103838770 A CN103838770 A CN 103838770A
Authority
CN
China
Prior art keywords
data
application
node
database
customer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201210487025.XA
Other languages
Chinese (zh)
Inventor
崔希宁
杨海威
张雨晴
姚勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Group Beijing Co Ltd
Original Assignee
China Mobile Group Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Group Beijing Co Ltd filed Critical China Mobile Group Beijing Co Ltd
Priority to CN201210487025.XA priority Critical patent/CN103838770A/en
Publication of CN103838770A publication Critical patent/CN103838770A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2379—Updates performed during online database operations; commit processing

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明公开了一种数据逻辑分区的方法和系统，适用于电信CRM系统RAC数据库，该方法包括对于业务数据设置客户编号为唯一标识；以所述客户编号为键值，采用不少于1个阶段的消除取余哈希算法对业务数据进行数据分片。本发明的技术方案适应性强，能够适合各种大型RAC数据中心，而且由于采取了多阶段哈希取模逻辑分片和分区路由访问，从而可以实现无阻塞高性能和分布式高扩张性，克服数据分区表的局限性。

The invention discloses a method and system for data logical partitioning, which are suitable for the RAC database of a telecom CRM system. The method includes setting a customer number as a unique identifier for business data; The phase elimination and remainder hashing algorithm performs data sharding on business data. The technical solution of the present invention has strong adaptability and can be suitable for various large-scale RAC data centers, and since it adopts multi-stage hash modulo logic sharding and partition routing access, it can realize non-blocking high performance and distributed high expansibility, Overcome the limitations of data partition tables.

Description

A kind of method and system of mathematical logic subregion
Technical field
The present invention relates to database technical field, relate in particular to a kind of method and system of mathematical logic subregion.
Background technology
The essential technological means of Real Application Clusters (Real Application Clusters, RAC) the distributed cloud computing scheme of multinode Cheng Liao telecommunications industry data center.RAC, by increasing database instance node, increases the bulk treatment ability of database, overcomes main frame (example) Single Point of Faliure simultaneously.But the whole capability of RAC not increases and linear increase with database instance node number, because coherency communications between node, internal memory merges can consume certain resource, and restriction whole capability promotes, use bad causing between node to form cluster lock problem, even reduce ability.Current provincial telco customers relation management system (Customer Relationship Management, CRM) carry out longitudinal cutting of data according to the dimension of districts and cities, or the range partition table technology that provides of usage data storehouse carries out subregion to customer data and set up partition table, put forward high performance principle to meet RAC data Physical Extents.
The best practices of RAC should be according to the data structure of application, burst and the discrete design that Service Processing Structure feature is carried out data.Reduce interleaving access, reduce the management consumption of RAC internal communication.Thereby the load between balance node, improves the ability of overall cluster.The method generally using is at present to carry out data fragmentation by physiogeographic administrative division customer data.Or the partition table technology that usage data storehouse provides is carried out burst to customer data.
But there is following problem in these methods:
1, table technology in partitions of database is to index, and inquiry is used, and maintenance requirement complexity, under application scenarios flexibly, shows very large limitation.
2, under municipality directly under the Central Government's pattern or single administrative region data pattern, carry out data cutting according to above method, cause performance, stability, the scalability problem of RAC system to be difficult to be guaranteed, application deployment causes the fault such as GC, GE of RAC to each node.
Concentrate in the current ongoing whole nation, cannot realize the design of valid data burst in the large unified system Construction such as construction of base, there is no blanket data fragmentation method for to data partition.
Summary of the invention
In order to solve the technical matters that can not realize valid data burst existing in prior art, the present invention proposes a kind of method and system of mathematical logic subregion, is applicable to various large-scale RAC data center, can realize quick distribution and calculate, and data fragmentation is flexible.
One aspect of the present invention provides a kind of method of mathematical logic subregion, is applicable to telecommunications crm system RAC database,
For business datum, customer number being set is unique identification;
Take described customer number as key assignments, employing is no less than the elimination remainder hash algorithm in 1 stage business datum is carried out to data fragmentation.
The present invention provides a kind of system of mathematical logic subregion on the other hand, is applicable to telecommunications crm system RAC database, comprises application node and database node, and application node is connected with database node, wherein,
Application node is unique identification for customer number being set for business datum, and take described customer number as key assignments, employing is no less than the elimination remainder hash algorithm in 1 stage business datum is carried out to data fragmentation;
Database node is for storage service data.
Technical scheme strong adaptability of the present invention, can be applicable to various large-scale RAC data center, and owing to having taked multistage Hash delivery logic burst and the access of subregion route, thereby can realize clog-free high-performance and distributed high dilatancy, overcome the limitation of data partition table.
Accompanying drawing explanation
Fig. 1 is the structural representation of mathematical logic partition system in the embodiment of the present invention one.
Fig. 2 is the process flow diagram of mathematical logic subregion in the embodiment of the present invention two.
Fig. 3 is data access flow process figure in the embodiment of the present invention two.
Fig. 4 is the deployment schematic diagram of crm system in the embodiment of the present invention.
Embodiment
Below in conjunction with accompanying drawing, the specific embodiment of the present invention is described in detail.
Fig. 1 is the structural representation of mathematical logic partition system in the embodiment of the present invention one.As shown in Figure 1, this mathematical logic partition system is applicable to telecommunications crm system RAC database, comprises client 101, application node 102 and database node 103.
Client is connected with application node, and application node is connected with database node.
Wherein, client obtains for the critical field of importing into by front end at application Access Layer the application node that needs access.
Application node is unique identification for customer number being set for business datum, take described customer number as key assignments, the elimination remainder hash algorithm that employing is no less than 1 stage carries out data fragmentation to business datum, also, according to the database node corresponding to data source configuration access of specifying, and access the burst business datum of storing in described database node by the described Hash route that is no less than 1 stage.
Database node further comprises the data fragmentation that is no less than 1, for storage service data.
Based on said system, the specific embodiment of the present invention has proposed a kind of method of mathematical logic subregion, and Fig. 2 is the process flow diagram of mathematical logic subregion in the embodiment of the present invention two.As shown in Figure 2, this flow process comprises the following steps:
Step 201, by client's business datum internal logic transformation, for all client's business datums, customer number being set is unique identification;
Step 202, take customer number as key assignments, adopt the elimination remainder hash algorithm in 1 stage or n stage to carry out data fragmentation to business datum.
Data fragmentation principle is to consider that data accuracy, data are uniformly distributed, apply the consideration of processing the several aspects of complexity, the performance of safeguards system, stability, extensibility.
Data partition design adopts eliminates remainder Hash (Hash) algorithm, for the relevant business datum table of three family data, comprises three family MSDSs, order table, business record table etc., according to unique identification in business datum as critical field delivery.
According to the parent customer under business datum, be that service attribute data are carried out burst by the unique identification of its body data (as customer number), burst adopts the mode to parent customer delivery, with the business datum that guarantees same client in the submeter of identical data burst, guarantee being uniformly distributed of different business tables of data submeter data, and reduce the complexity that application is processed;
The burst quantity of business datum is planned to 10 (n) are individual altogether, the submeter storage of each data fragmentation to 10 (n) delivery after a rear fragment data; Be Hash (key)=key mod 10[n], wherein key is key assignments.
Under the situation of the increase of application layer progression or mass data, can take the algorithm of two-stage delivery Hash, can guarantee in theory the Quick Extended of data partition.
Realize on the basis of multinode distributed store at CRM business datum internal logic burst, application realizes multiple database node distributed access by the Hash routing algorithm of customer data.Because hash algorithm is unblock distributed algorithm, can support distributed data to locate fast.Fig. 3 is data access flow process figure in the embodiment of the present invention two.As shown in Figure 3, this flow process comprises the following steps:
Step 301, the critical field of importing into by front end at application Access Layer are obtained the application node that needs access.
Database node corresponding to data source configuration access that step 302, this application node are specified when disposing.
Step 303, access by 1 stage or multistage Hash route the fragment data of storing in this database node.In general design, with using multistage Hash under the increase of service application level or mass data environment, i.e. multilayer application is used multistage Hash.
Dissimilar application, the mode that route is set is distinguished to some extent:
Interface adaptation application is carried out route setting in interface code.
Route setting is carried out in background process application in background process master routine.
WEB application, carries out route setting at JSP (Java Server Pages, a kind of java dynamic page standard) page or Action (Java assembly) layer.
Data route key message can be phone number (comprising broadband account number), user ID, account's mark, customer ID, order coding and/or order flowing water according to the key message of data in current crm system.
Concrete business datum burst insertion algorithm I1, I2 and routing inquiry algorithm S1, S2 are described below.
Algorithm I1: client is stored data " Client " with key " c ".First with reference to application node list, (1,2, n), the cryptographic hash of calculating key " c ", supposes that application node 1 is selected.Then two-stage Hash process.
Algorithm 12: client is directly connected to application node 1, refers again to data fragmentation list (a, b, c), calculates the cryptographic hash of key " c ", supposes that application node a is selected.By key " c ", data " Client " are stored into data fragmentation a.
Different clients is used identical client library (hash algorithm that means one-phase, two-stage is identical), also have same application node list (1,2, n) and data fragmentation list (a, b, c).
Client can be stored in data on many database RAC nodes.In the time of data query.
Algorithm S1: first client calculates the cryptographic hash (one-phase Hash) of key " c " with reference to application node list, choose application node 1.
Algorithm S2: client sends to request to choose application node 1, then application node, by the hash algorithm (two-stage Hash) for data fragmentation list (a, b, c), is searched real data " Client " according to key " c ".
Implementation procedure is seen, does not need communication to have good extensibility between each node, and whole process has fine performance when being unblock.
Fig. 4 is the data deployment of crm system in the embodiment of the present invention and the schematic diagram of data access.As shown in Figure 4, when crm system overall design, for crucial routing iinformations such as three family marks, order codings, adopt the coding rule of specifying.System applies is opening an account, when the business processing such as transfer, generate three family marks and order coding according to the coding rule of three family data, and three family data and related service data are stored in corresponding partition table, simultaneously, the mapping (enum) data of phone number and data fragmentation is carried out to buffer memory by buffer memory application interface in buffer memory service end, when being convenient to follow-up business and handling, can carry out route by phone number.
In the deployment of application layer, be divided into multiple application sets group according to the portfolio of different access channels and peripheral interface and safe class, each application sets group comprises 9 physical clusters, wherein 4 cluster correspondence database nodes one, 4 cluster correspondence database nodes two, the node across cluster access disparate databases is put in the assembly of different application cluster, makes two nodes of database can load sharing.
First WEB application, interface adaptation application, background process get crucial routing iinformation while being applied in business processing, carry out obtaining of districts and cities by crucial routing iinformation, and obtain manner is as follows.
Phone number: in being applied by buffer memory, the phone number of buffer memory and data fragmentation mapping relations are applied, and carry out obtaining of data hash burst by phone number.
Client/account/user ID: use coding rule, carry out obtaining of data hash burst by the coding rule of three family marks.
Order coding: the order data generating in new system, order coding and order mark adopt certain coding rule, can be encoded and be carried out obtaining of data hash burst by order.
Apply according to crucial routing information acquisition after data fragmentation information, pass through again relevant configuration data query to the corresponding great district of data fragmentation (database node), routing policy according to configuration carries out the access of cluster-specific, and finally accessing corresponding database node by application cluster carries out data access and operation.
It should be noted that: above embodiment is only unrestricted in order to the present invention to be described, the present invention is also not limited in above-mentioned giving an example, and all do not depart from technical scheme and the improvement thereof of the spirit and scope of the present invention, and it all should be encompassed in claim scope of the present invention.

Claims (12)

1.一种数据逻辑分区的方法，适用于电信客户关系管理系统实时应用集群数据库，其特征在于，1. A method for logical partitioning of data, applicable to real-time application cluster databases of telecom customer relationship management systems, characterized in that, 对于业务数据设置客户编号为唯一标识；For business data, set the customer number as the unique identifier; 以所述客户编号为键值，采用不少于1个阶段的消除取余哈希算法对业务数据进行数据分片。Using the customer number as the key value, the business data is segmented by adopting no less than one stage of elimination and remainder hashing algorithm. 2.根据权利要求1所述的一种数据逻辑分区的方法，其特征在于，2. A method for data logical partitioning according to claim 1, characterized in that, 按照业务数据所属的主体数据的唯一标识进行分片，分片采用对所述上级客户取模的方式，使得一个客户的业务数据在相同数据分片的分表中；Fragmentation is carried out according to the unique identifier of the subject data to which the business data belongs, and the fragmentation adopts the method of taking a modulus from the superior customer, so that the business data of a customer is in the sub-table of the same data fragmentation; 设置预设数量的分片，每个数据分片的分表中存储对预设数量取模后的一个分片数据，即Hash(key)＝key mod(预设数量)，其中key为键值。Set a preset number of shards, and store a shard data modulo the preset number in the shard table of each data shard, that is, Hash(key)=key mod (preset number), where key is the key value . 3.根据权利要求1或者2所述的一种数据逻辑分区的方法，其特征在于，所述业务数据包括三户资料表、订单表和业务记录表。3. A method for data logical partitioning according to claim 1 or 2, wherein the business data includes three household data tables, order tables and business record tables. 4.根据权利要求1或者2所述的一种数据逻辑分区的方法，其特征在于，还包括以下步骤：4. A method for logically partitioning data according to claim 1 or 2, further comprising the following steps: 在应用接入层通过前端传入的关键字段获取需要访问的应用节点；At the application access layer, obtain the application nodes that need to be accessed through the key fields passed in from the front end; 所述应用节点根据指定的数据源配置访问对应的数据库节点；The application node accesses the corresponding database node according to the specified data source configuration; 通过所述不少于1个阶段的哈希路由访问所述数据库节点中存储的分片数据。Accessing the fragmented data stored in the database node through the hash routing with no less than one stage. 5.根据权利要求4所述的一种数据逻辑分区的方法，其特征在于，对于接口适配应用，在接口代码中设置路由。5. A method for data logical partitioning according to claim 4, characterized in that, for an interface adaptation application, routing is set in the interface code. 6.根据权利要求4所述的一种数据逻辑分区的方法，其特征在于，对于后台进程应用，在后台进程主程序中设置路由。6. A method for data logical partitioning according to claim 4, characterized in that, for background process applications, routing is set in the background process main program. 7.根据权利要求4所述的一种数据逻辑分区的方法，其特征在于，对于WEB应用，在JSP页面或者Action层设置路由。7. A method for logically partitioning data according to claim 4, characterized in that, for WEB applications, routing is set at the JSP page or Action layer. 8.根据权利要求4所述的一种数据逻辑分区的方法，其特征在于，所述关键字段包括手机号码、宽带账号、用户标识、账户标识、客户标识、订单编码和/或订单流水。8. A method for logically partitioning data according to claim 4, wherein the key fields include mobile phone number, broadband account number, user ID, account ID, customer ID, order code and/or order history. 9.根据权利要求4所述的一种数据逻辑分区的方法，其特征在于，9. A method for data logical partitioning according to claim 4, characterized in that, 依据三户资料的编码规则生成三户标识和订单编码；Generate the three-household logo and order code according to the coding rules of the three-household data; 将业务数据存储到对应的数据分片的分表中；Store business data in the sub-table of the corresponding data shard; 将手机号码与数据分片的映射数据通过缓存应用接口在缓存服务端进行缓存，用于通过手机号码进行路由。The mapping data of the mobile phone number and the data fragment is cached on the cache server through the cache application interface, and is used for routing through the mobile phone number. 10.一种数据逻辑分区的系统，适用于电信CRM系统RAC数据库，其特征在于，包括应用节点和数据库节点，应用节点与数据库节点连接，其中，10. A system of data logical partitions, applicable to the RAC database of the telecom CRM system, characterized in that it includes application nodes and database nodes, and the application nodes are connected to the database nodes, wherein, 应用节点用于对于业务数据设置客户编号为唯一标识，以所述客户编号为键值，采用不少于1个阶段的消除取余哈希算法对业务数据进行数据分片；The application node is used to set the customer number as the unique identifier for the business data, and use the customer number as the key value to perform data fragmentation on the business data by using the elimination and remainder hash algorithm of not less than one stage; 数据库节点用于存储业务数据。Database nodes are used to store business data. 11.根据权利要求10所述的一种数据逻辑分区的系统，其特征在于，所述数据库节点进一步包括不少于1个的数据分片。11. A system for data logical partitioning according to claim 10, wherein the database node further includes no less than one data fragment. 12.根据权利要求10或者11户的一种数据逻辑分区的系统，其特征在于，还包括客户端，客户端与应用节点连接，12. A system according to claim 10 or 11, characterized in that it also includes a client, the client is connected to the application node, 客户端用于在应用接入层通过前端传入的关键字段获取需要访问的应用节点；The client is used to obtain the application node to be accessed through the key field passed in at the application access layer; 应用节点还根据指定的数据源配置访问对应的数据库节点，并通过所述不少于1个阶段的哈希路由访问所述数据库节点中存储的分片业务数据。The application node also accesses the corresponding database node according to the specified data source configuration, and accesses the fragmented service data stored in the database node through the hash route of no less than one stage.
CN201210487025.XA 2012-11-26 2012-11-26 Logic data partition method and system Pending CN103838770A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210487025.XA CN103838770A (en) 2012-11-26 2012-11-26 Logic data partition method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210487025.XA CN103838770A (en) 2012-11-26 2012-11-26 Logic data partition method and system

Publications (1)

Publication Number Publication Date
CN103838770A true CN103838770A (en) 2014-06-04

Family

ID=50802280

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210487025.XA Pending CN103838770A (en) 2012-11-26 2012-11-26 Logic data partition method and system

Country Status (1)

Country Link
CN (1) CN103838770A (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106095571A (en) * 2016-06-07 2016-11-09 中国建设银行股份有限公司 Many RAC group system, data access method and device
CN106844399A (en) * 2015-12-07 2017-06-13 中兴通讯股份有限公司 Distributed data base system and its adaptive approach
CN106897344A (en) * 2016-07-21 2017-06-27 阿里巴巴集团控股有限公司 The data operation request treatment method and device of distributed data base
CN106909556A (en) * 2015-12-23 2017-06-30 中国电信股份有限公司 The storage equalization methods and device of main memory cluster
CN107423425A (en) * 2017-08-02 2017-12-01 德比软件(上海)有限公司 A kind of data quick storage and querying method to K/V forms
CN107480184A (en) * 2017-07-06 2017-12-15 联动优势科技有限公司 A kind of data access method and equipment
CN108062383A (en) * 2017-12-13 2018-05-22 泰康保险集团股份有限公司 Generation method, device and the equipment of moon bill are insured again
CN109213825A (en) * 2017-06-29 2019-01-15 北京微影时代科技有限公司 A kind of data-base capacity-enlarging method and device
CN109802985A (en) * 2017-11-17 2019-05-24 北京金山云网络技术有限公司 Data transmission method, device, equipment and read/write memory medium
CN111506654A (en) * 2020-04-17 2020-08-07 北京思特奇信息技术股份有限公司 Data partitioning method for data routing
CN111666278A (en) * 2019-03-06 2020-09-15 阿里巴巴集团控股有限公司 Data storage method, data retrieval method, electronic device and storage medium
CN111694693A (en) * 2019-03-12 2020-09-22 上海晶赞融宣科技有限公司 Data stream storage method and device and computer storage medium
WO2020215912A1 (en) * 2019-04-25 2020-10-29 中兴通讯股份有限公司 Data analysis method and apparatus
CN112084189A (en) * 2020-08-31 2020-12-15 银盛支付服务股份有限公司 Database distribution method and system based on supporting horizontal infinite extension
CN113672557A (en) * 2021-08-25 2021-11-19 中国工商银行股份有限公司 Method, system, device, medium, and article of manufacture for migrating data to a distributed system
CN114416884A (en) * 2022-03-28 2022-04-29 北京奥星贝斯科技有限公司 Method and device for connecting partition table

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101145158A (en) * 2007-06-06 2008-03-19 中兴通讯股份有限公司 Data base table partition method
CN101521655A (en) * 2008-02-29 2009-09-02 华为技术有限公司 Method for searching and releasing information, system and synonymy node clustering method and device therefor
CN102201986A (en) * 2011-05-10 2011-09-28 苏州两江科技有限公司 Zonal routing method for non-relational database Cassandra
CN102244685A (en) * 2011-08-11 2011-11-16 中国科学院软件研究所 Distributed type dynamic cache expanding method and system supporting load balancing
CN102331993A (en) * 2011-06-23 2012-01-25 北京新媒传信科技有限公司 Data migration method of distributed database and distributed database migration system
US20120150791A1 (en) * 2008-06-02 2012-06-14 Ian Alexander Willson Methods and systems for loading data into a temporal data warehouse
CN102542071A (en) * 2012-01-17 2012-07-04 深圳市同洲视讯传媒有限公司 Distributed data processing system and method
CN102591970A (en) * 2011-12-31 2012-07-18 北京奇虎科技有限公司 Distributed key-value query method and query engine system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101145158A (en) * 2007-06-06 2008-03-19 中兴通讯股份有限公司 Data base table partition method
CN101521655A (en) * 2008-02-29 2009-09-02 华为技术有限公司 Method for searching and releasing information, system and synonymy node clustering method and device therefor
US20120150791A1 (en) * 2008-06-02 2012-06-14 Ian Alexander Willson Methods and systems for loading data into a temporal data warehouse
CN102201986A (en) * 2011-05-10 2011-09-28 苏州两江科技有限公司 Zonal routing method for non-relational database Cassandra
CN102331993A (en) * 2011-06-23 2012-01-25 北京新媒传信科技有限公司 Data migration method of distributed database and distributed database migration system
CN102244685A (en) * 2011-08-11 2011-11-16 中国科学院软件研究所 Distributed type dynamic cache expanding method and system supporting load balancing
CN102591970A (en) * 2011-12-31 2012-07-18 北京奇虎科技有限公司 Distributed key-value query method and query engine system
CN102542071A (en) * 2012-01-17 2012-07-04 深圳市同洲视讯传媒有限公司 Distributed data processing system and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
韦平飞: ""移动业务运营支撑系统数据库性能优化的研究"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106844399A (en) * 2015-12-07 2017-06-13 中兴通讯股份有限公司 Distributed data base system and its adaptive approach
CN106844399B (en) * 2015-12-07 2022-08-09 中兴通讯股份有限公司 Distributed database system and self-adaptive method thereof
CN106909556A (en) * 2015-12-23 2017-06-30 中国电信股份有限公司 The storage equalization methods and device of main memory cluster
CN106909556B (en) * 2015-12-23 2020-03-20 中国电信股份有限公司 Memory cluster storage balancing method and device
CN106095571B (en) * 2016-06-07 2019-06-04 中国建设银行股份有限公司 More RAC group systems, data access method and device
CN106095571A (en) * 2016-06-07 2016-11-09 中国建设银行股份有限公司 Many RAC group system, data access method and device
CN106897344A (en) * 2016-07-21 2017-06-27 阿里巴巴集团控股有限公司 The data operation request treatment method and device of distributed data base
CN109213825A (en) * 2017-06-29 2019-01-15 北京微影时代科技有限公司 A kind of data-base capacity-enlarging method and device
CN107480184A (en) * 2017-07-06 2017-12-15 联动优势科技有限公司 A kind of data access method and equipment
CN107423425A (en) * 2017-08-02 2017-12-01 德比软件(上海)有限公司 A kind of data quick storage and querying method to K/V forms
CN107423425B (en) * 2017-08-02 2020-08-14 德比软件(上海)有限公司 Method for quickly storing and inquiring data in K/V format
CN109802985A (en) * 2017-11-17 2019-05-24 北京金山云网络技术有限公司 Data transmission method, device, equipment and read/write memory medium
CN108062383A (en) * 2017-12-13 2018-05-22 泰康保险集团股份有限公司 Generation method, device and the equipment of moon bill are insured again
CN111666278B (en) * 2019-03-06 2024-03-26 阿里巴巴集团控股有限公司 Data storage method, data retrieval method, electronic device and storage medium
CN111666278A (en) * 2019-03-06 2020-09-15 阿里巴巴集团控股有限公司 Data storage method, data retrieval method, electronic device and storage medium
CN111694693A (en) * 2019-03-12 2020-09-22 上海晶赞融宣科技有限公司 Data stream storage method and device and computer storage medium
WO2020215912A1 (en) * 2019-04-25 2020-10-29 中兴通讯股份有限公司 Data analysis method and apparatus
CN111506654A (en) * 2020-04-17 2020-08-07 北京思特奇信息技术股份有限公司 Data partitioning method for data routing
CN112084189A (en) * 2020-08-31 2020-12-15 银盛支付服务股份有限公司 Database distribution method and system based on supporting horizontal infinite extension
CN113672557A (en) * 2021-08-25 2021-11-19 中国工商银行股份有限公司 Method, system, device, medium, and article of manufacture for migrating data to a distributed system
CN114416884A (en) * 2022-03-28 2022-04-29 北京奥星贝斯科技有限公司 Method and device for connecting partition table
CN114416884B (en) * 2022-03-28 2022-06-14 北京奥星贝斯科技有限公司 Method and device for connecting partition table

Similar Documents

Publication Publication Date Title
CN103838770A (en) Logic data partition method and system
CN107423368B (en) Spatio-temporal data indexing method in non-relational database
US8676951B2 (en) Traffic reduction method for distributed key-value store
WO2017067117A1 (en) Data query method and device
CN104252528B (en) Big data secondary index establishing method based on identifier space mapping
US12032550B2 (en) Multi-tenant partitioning in a time-series database
CN105608224A (en) Orthogonal multilateral Hash mapping indexing method for improving massive data inquiring performance
CN104216962A (en) Mass network management data indexing design method based on HBase
CN103310000A (en) Metadata management method
CN101694672A (en) Distributed safe retrieval system
Xiao et al. Using parallel bloom filters for multiattribute representation on network services
CN103246659A (en) Method and device for key value data query
WO2013143278A1 (en) Method, device and system for querying data index
CN106599091B (en) RDF graph structure storage and index method based on key value storage
CN102609464A (en) Method and device for associative table query of MONGODB shards
CN106570113B (en) Mass vector slice data cloud storage method and system
CN105959419A (en) Establishment method and system for distributed storage structure based on consensus tree
CN103095587B (en) A method for registration service, network group center control nodes and system
CN103336782A (en) Relational distributed database system
Von der Weth et al. Multiterm keyword search in NoSQL systems
CN108460030A (en) A kind of set element judgment method based on improved Bloom filter
CN109947764B (en) A query enhancement system and method for constructing elastic field based on delay
CN106789632A (en) A kind of method of the node-routing of large-scale distributed storage system
CN101719155A (en) Method of multidimensional attribute range inquiry for supporting distributed multi-cluster computing environment
CN104978327B (en) A method for querying data, a management control node and a target data node

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20140604

RJ01 Rejection of invention patent application after publication