[go: up one dir, main page]

CN114730314A - A transaction submission system, method and related equipment - Google Patents

A transaction submission system, method and related equipment Download PDF

Info

Publication number
CN114730314A
CN114730314A CN201980102354.8A CN201980102354A CN114730314A CN 114730314 A CN114730314 A CN 114730314A CN 201980102354 A CN201980102354 A CN 201980102354A CN 114730314 A CN114730314 A CN 114730314A
Authority
CN
China
Prior art keywords
transaction
write request
storage server
server
copy
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201980102354.8A
Other languages
Chinese (zh)
Inventor
王艳群
林超
魏明昌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Cloud Computing Technologies Co Ltd
Original Assignee
Huawei Cloud Computing Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Cloud Computing Technologies Co Ltd filed Critical Huawei Cloud Computing Technologies Co Ltd
Publication of CN114730314A publication Critical patent/CN114730314A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The application provides a transaction submission system, a transaction submission method and related equipment, wherein the system comprises a coordination server and a plurality of storage servers; the coordination server receives a transaction sent by the service server, generates at least one write request according to the transaction, sends each write request to a storage server storing data required to be operated by each write request, executes the received write request and respectively sends execution results to the coordination server, and the coordination server determines a transaction processing result of the transaction according to the execution result of the write request fed back by each storage server and sends the transaction processing result to the service server. The coordination server can determine the transaction processing result of the transaction according to the execution result of the write request sent by each storage server, and returns the transaction processing result of the transaction to the service server, so that one-stage transaction submission is realized, the time delay of write request processing is reduced, and the processing efficiency and the working efficiency of the service server are improved.

Description

PCT国内申请,说明书已公开。PCT domestic application, the description has been published.

Claims (28)

  1. A transaction processing system comprising a coordinating server and a plurality of storage servers;
    the coordination server is used for receiving a transaction, the transaction comprises at least one transaction data message, and each transaction data message comprises storage position information of a copy of original data on the storage server and a write operator; determining transaction data distribution information according to pre-stored data distribution information, wherein the data distribution information indicates a storage server storing each copy of each original data in the transaction processing system, and the transaction data distribution information indicates a storage server storing each copy of the original data corresponding to each transaction data information included in the transaction; generating at least one write request, each write request including the transaction data distribution information and one transaction data information; sending each write request to a storage server where a copy of original data corresponding to the transaction data information included in each write request is located;
    the storage server receives any write request and is used for storing the transaction data distribution information; according to the transaction data information included in the write request, operating a copy of original data corresponding to the transaction data information included in the write request; sending an execution result of the write request to the coordination server;
    the coordination server is further configured to determine a transaction processing result of the transaction according to the execution result of the write request sent by each storage server that receives the write request, and send the transaction processing result to a service server.
  2. The transaction processing system of claim 1,
    the coordination server is used for receiving a read request, wherein the read request comprises a storage position of a copy of target data on the storage server and a read operator; determining a storage server for storing the copy of the target data according to the data distribution information; sending the read request to a storage server storing a copy of the target data;
    the storage servers receiving the read requests are used for inquiring the execution results of the write requests from each storage server receiving the write requests according to the transaction data distribution information; determining to execute a commit operation or a rollback operation according to an execution result of executing the write request sent by each storage server receiving the write request; after the submitting operation or the rollback operation is executed, reading the target data according to the storage position of the copy of the target data on a storage server; and sending the read target data to the coordination server.
  3. The transaction processing system of claim 2,
    the storage servers receiving the read request are further used for generating operation information according to the execution result of the write request, the operation information indicates a commit operation or a rollback operation, and the operation information is sent to each storage server receiving the write request.
  4. A transaction system as claimed in claim 2 or claim 3, wherein there is an overlap between the storage location of the copy of the target data on the storage server and the storage location of the copy of the original data on the storage server, or the copy of the target data and the copy of the original data are stored in a data block which needs to be kept consistent.
  5. Transaction processing system according to one of the claims 2 to 4,
    the coordination server is used for determining a plurality of storage servers for storing the copies of the target data according to the data distribution information; selecting a target storage server from the determined plurality of storage servers storing copies of the target data; and sending the read request to the target storage server.
  6. The transaction processing system of claim 1,
    the coordination server is further configured to determine, according to the execution result of the write request sent by each storage server that receives the write request, operation information that needs to be executed by each storage server that receives the write request, where the operation information indicates to execute a commit operation or a rollback operation, and send the operation information to each storage server that receives the write request.
  7. The transaction processing system of claim 6,
    the storage server receiving the write request is further configured to determine that the operation information sent by the coordination server is not received within a preset time after the execution result of the operation is sent to the coordination server, and query, according to the transaction data distribution information, the execution result of the write request to the storage server storing each copy of the original data corresponding to each transaction data information included in the transaction; and determining to execute the submitting operation or the rollback operation according to the execution result.
  8. A transaction processing method applied to a transaction processing system including a coordination server and a plurality of storage servers, the method comprising:
    the coordination server receives a transaction sent by a business server, wherein the transaction comprises at least one transaction data message, and each transaction data message comprises storage position information of a copy of original data on a storage server and a write operator;
    the coordination server determines transaction data distribution information according to pre-stored data distribution information, wherein the data distribution information indicates a storage server storing each copy of each original data in the transaction processing system, and the transaction data distribution information indicates a storage server storing each copy of the original data corresponding to each transaction data information included in the transaction;
    the coordination server generates at least one write request, wherein each write request comprises the transaction data distribution information and transaction data information;
    the coordination server sends each write request to a storage server where a copy of original data corresponding to the transaction data information included in each write request is located;
    the storage server receiving any write request stores the transaction data distribution information, operates a copy of original data corresponding to the transaction data information included in the write request according to the transaction data information included in the write request, and sends an execution result of the write request to the coordination server;
    and the coordination server determines the transaction processing result of the transaction according to the write request execution result sent by each storage server receiving the write request, and sends the transaction processing result to a service server.
  9. The method of claim 8, wherein the method further comprises:
    the coordination server receives a read request sent by the service server, wherein the read request comprises a storage position of a copy of target data on a storage server and a read operator;
    the coordination server determines a storage server for storing the copy of the target data according to the data distribution information, and sends the read request to the storage server for storing the copy of the target data;
    the storage server receiving the read request inquires the execution result of the write request from each storage server receiving the write request according to the transaction data distribution information; determining to execute a commit operation or a rollback operation according to an execution result of executing the write request sent by each storage server receiving the write request;
    and the storage server receiving the reading request reads the target data according to the storage position of the copy of the target data on the storage server, and sends the read target data to the coordination server.
  10. The method of claim 9, wherein the method further comprises:
    and the storage server receiving the read request generates operation information according to the execution result of the write request, and sends the operation information to each storage server receiving the write request, wherein the operation information indicates a submission operation or a rollback operation.
  11. The method of claim 9 or 10, wherein there is an overlap between the storage locations of the copy of the target data on the storage server and the copy of the original data on the storage server, or the copy of the target data and the copy of the original data are stored in a data block that needs to be kept consistent.
  12. The method of any of claims 9 to 11, wherein the coordinating server determines a storage server storing a copy of the target data based on the data distribution information, and sends the read request to the storage server storing the copy of the target data, comprising:
    the coordination server determines a plurality of storage servers for storing the copies of the target data according to the data distribution information;
    the coordination server selects a target storage server from the determined plurality of storage servers storing the copies of the target data, and sends the read request to the target storage server.
  13. The method of claim 8, wherein the method further comprises:
    the coordination server determines operation information which needs to be executed by each storage server receiving the write request according to an execution result of the write request sent by each storage server receiving the write request, wherein the operation information indicates to execute a commit operation or a rollback operation;
    and the coordination server sends the operation information to each storage server which receives the write request.
  14. The method of claim 13, wherein the method further comprises:
    the storage server receiving the write request determines that the operation information sent by the coordination server is not received within a preset time after the execution result of the operation is sent to the coordination server, and inquires the execution result of the write request from the storage server storing each copy of the original data corresponding to each transaction data information included in the transaction according to the transaction data distribution information;
    and the storage server receiving the write request determines to execute the submission operation or the rollback operation according to the execution result.
  15. A method of transaction processing, the method comprising:
    the coordination server receives a transaction sent by the business server, wherein the transaction comprises at least one transaction data message, and each transaction data message comprises storage position information of a copy of original data on the storage server and a write operator;
    the coordination server determines transaction data distribution information according to pre-stored data distribution information, wherein the data distribution information indicates a storage server storing each copy of each original data in a transaction processing system, and the transaction data distribution information indicates a storage server storing each copy of the original data corresponding to each transaction data information included in the transaction;
    the coordination server generates at least one write request, wherein each write request comprises the transaction data distribution information and transaction data information;
    the coordination server sends each write request to a storage server where a copy of original data corresponding to the transaction data information included in each write request is located;
    the coordination server receives the execution result of the write request sent by each storage server which receives the write request;
    and the coordination server determines the transaction processing result of the transaction according to the execution result of the write request sent by each storage server receiving the write request, and sends the transaction processing result to the service server.
  16. The method of claim 15, wherein the method further comprises:
    the coordination server determines operation information which needs to be executed by each storage server receiving the write request according to an execution result of the write request sent by each storage server receiving the write request, wherein the operation information indicates to execute a commit operation or a rollback operation;
    and the coordination server sends the operation information to each storage server receiving the write request.
  17. A method of transaction processing, the method comprising:
    the method comprises the steps that a storage server receives a write request sent by a coordination server, wherein the write request comprises transaction data distribution information and transaction data information, the write request is one of at least one write request generated by the coordination server according to a received transaction, the storage server is one of a plurality of storage servers where copies of original data corresponding to the transaction data information included in the at least one write request are located, the transaction comprises at least one transaction data information, each transaction data information comprises storage location information of one copy of the original data on the storage server and a write operation character, and the transaction data distribution information indicates the storage server where each copy of the original data corresponding to each transaction data information included in the transaction is stored;
    the storage server operates a copy of original data corresponding to the transaction data information included in the write request according to the transaction data information, and sends an execution result of the write request to the coordination server;
    the storage server receives a read request sent by the coordination server, wherein the read request comprises a storage position of a copy of target data on the storage server and a read operator;
    the storage server inquires the execution result of the at least one write request from a storage server storing each copy of the original data corresponding to each transaction data information included in the transaction according to the transaction data distribution information;
    and the storage server executes a submitting operation or a rollback operation according to the execution result of the at least one write request obtained by the query.
  18. The method of claim 17, wherein the method further comprises:
    the storage server generates operation information according to the execution result of the at least one write request obtained by query, wherein the operation information indicates a submitting operation or a rollback operation;
    and the storage server sends the operation information to a storage server for storing each copy of the original data corresponding to each transaction data information included in the transaction.
  19. The method of claim 17 or 18,
    the storage position of the copy of the target data on the storage server and the storage position of the copy of the original data on the storage server are overlapped, or the copy of the target data and the copy of the original data are stored in a data block which needs to keep consistency.
  20. A coordinating device, comprising:
    the communication unit is used for receiving a transaction sent by a service server, wherein the transaction comprises at least one transaction data message, and each transaction data message comprises storage position information of a copy of original data on a storage server and a write operator;
    the processing unit is used for determining transaction data distribution information according to pre-stored data distribution information, wherein the data distribution information indicates a storage server which stores each copy of each original data in a transaction processing system, and the transaction data distribution information indicates a storage server which stores each copy of the original data corresponding to each transaction data information included in the transaction;
    generating at least one write request, each write request including the transaction data distribution information and one transaction data information;
    the communication unit is further configured to send each write request to a storage server where a copy of original data corresponding to the transaction data information included in each write request is located;
    receiving an execution result of the write request sent by each storage server receiving the write request;
    the processing unit is further configured to determine a transaction processing result of the transaction according to an execution result of the write request sent by each storage server that receives the write request;
    the communication unit is further configured to send the transaction processing result to the service server.
  21. The apparatus of claim 20,
    the processing unit is specifically configured to determine, according to an execution result of the write request sent by each storage server that receives the write request, operation information that needs to be executed by each storage server that receives the write request, where the operation information indicates to execute a commit operation or a rollback operation;
    the communication unit is further configured to send the operation information to each storage server that receives the write request.
  22. A storage device, the device comprising:
    a communication unit, configured to receive a write request sent by a coordination server, where the write request includes transaction data distribution information and transaction data information, the write request is one of at least one write request generated by the coordination server according to a received transaction, the storage server is one of multiple storage servers where copies of original data corresponding to the transaction data information included in the at least one write request are located, the transaction includes at least one transaction data information, each transaction data information includes storage location information of a copy of the original data on the storage server and a write operator, and the transaction data distribution information indicates the storage server where each copy of the original data corresponding to each transaction data information included in the transaction is stored;
    the processing unit is used for operating the copy of the original data corresponding to the transaction data information included in the write request according to the transaction data information;
    the communication unit is further configured to send an execution result of the write request to the coordination server; receiving a read request sent by the coordination server, wherein the read request comprises a storage position of a copy of target data on a storage server and a read operator;
    the processing unit is further configured to query, according to the transaction data distribution information, an execution result of the at least one write request to a storage server that stores each copy of the original data corresponding to each transaction data information included in the transaction;
    and executing a submitting operation or a rollback operation according to the execution result of the at least one write request obtained by the query.
  23. The apparatus of claim 22,
    the processing unit is further configured to generate operation information according to an execution result of the at least one write request obtained through query, where the operation information indicates a commit operation or a rollback operation;
    the communication unit is further configured to send the operation information to a storage server that stores each copy of original data corresponding to each transaction data information included in the transaction.
  24. The apparatus of claim 22 or 23, wherein there is an overlap between the storage location of the copy of the target data on the storage server and the storage location of the copy of the original data on the storage server, or wherein the copy of the target data and the copy of the original data are stored in a data block that needs to maintain consistency.
  25. A coordination server comprising a processor and a memory; the memory is for storing instructions, the processor is for executing the instructions, and when the processor executes the instructions, the processor performs the method of any one of claims 15 or 16.
  26. A storage server comprising a processor and a memory; the memory is for storing instructions for execution by the processor, the processor performing the method of any of claims 17 to 19 when the processor executes the instructions.
  27. A non-transitory computer readable storage medium storing a computer program which, when executed by a coordination server, implements the method of any of claims 15 or 16.
  28. A non-transitory computer readable storage medium storing a computer program which, when executed by a storage server, implements the method of any of claims 17 to 19.
CN201980102354.8A 2019-11-30 2019-11-30 A transaction submission system, method and related equipment Pending CN114730314A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/122287 WO2021103036A1 (en) 2019-11-30 2019-11-30 Transaction commit system and method, and related device

Publications (1)

Publication Number Publication Date
CN114730314A true CN114730314A (en) 2022-07-08

Family

ID=76129035

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980102354.8A Pending CN114730314A (en) 2019-11-30 2019-11-30 A transaction submission system, method and related equipment

Country Status (2)

Country Link
CN (1) CN114730314A (en)
WO (1) WO2021103036A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115729444A (en) * 2021-09-01 2023-03-03 华为技术有限公司 A data processing method and device
CN115103011B (en) * 2022-06-24 2024-02-09 北京奥星贝斯科技有限公司 Cross-data center service processing method, device and equipment
CN116303328B (en) * 2023-03-28 2025-07-01 厦门大学 Client and distributed file system
CN116578395B (en) * 2023-07-13 2024-04-05 腾讯科技(深圳)有限公司 Transaction processing method, system, device, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102419764A (en) * 2010-10-20 2012-04-18 微软公司 Distributed transaction management for database systems with multiversioning
CN103677968A (en) * 2012-09-07 2014-03-26 腾讯科技(深圳)有限公司 Transaction processing method, transaction coordinator device and transaction participant device and system
US20150248308A1 (en) * 2014-02-28 2015-09-03 Red Hat, Inc. Systems and methods for semi-durable transaction log storage in two-phase commit protocol transaction processing
CN106997305A (en) * 2013-10-29 2017-08-01 华为技术有限公司 A kind of transaction methods and device
CN109901914A (en) * 2018-12-28 2019-06-18 阿里巴巴集团控股有限公司 Transaction methods, device and equipment
CN110196760A (en) * 2018-07-12 2019-09-03 腾讯科技(深圳)有限公司 Distributed transaction consistency implementation method and device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9027030B2 (en) * 2007-11-29 2015-05-05 Red Hat, Inc. Commit-one-phase distributed transactions with multiple starting participants
CN105786595B (en) * 2016-02-29 2019-04-23 浪潮通用软件有限公司 A kind of transaction control method that two-part is submitted

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102419764A (en) * 2010-10-20 2012-04-18 微软公司 Distributed transaction management for database systems with multiversioning
CN103677968A (en) * 2012-09-07 2014-03-26 腾讯科技(深圳)有限公司 Transaction processing method, transaction coordinator device and transaction participant device and system
CN106997305A (en) * 2013-10-29 2017-08-01 华为技术有限公司 A kind of transaction methods and device
US20150248308A1 (en) * 2014-02-28 2015-09-03 Red Hat, Inc. Systems and methods for semi-durable transaction log storage in two-phase commit protocol transaction processing
CN110196760A (en) * 2018-07-12 2019-09-03 腾讯科技(深圳)有限公司 Distributed transaction consistency implementation method and device
CN109901914A (en) * 2018-12-28 2019-06-18 阿里巴巴集团控股有限公司 Transaction methods, device and equipment

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
JIANYING CHEN 等: "Synchronized update to over distributed and parallel database", 《2009 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY》, 1 November 2009 (2009-11-01), pages 1 - 2 *
蒋洪伟 等: "分布式事务一致性研究及其在自助服务终端集群管理中的应用", 《中国金融电脑》, 7 January 2019 (2019-01-07), pages 58 - 63 *

Also Published As

Publication number Publication date
WO2021103036A1 (en) 2021-06-03

Similar Documents

Publication Publication Date Title
CN114730314A (en) A transaction submission system, method and related equipment
US10078536B2 (en) Cloud-based build service
CN109189351B (en) Cloud printing method, storage medium and server
CN103312549B (en) A kind of office management method and device and system
JP2019517043A5 (en)
JP2012079219A (en) Job execution system, job acceptance apparatus and program
AU2016373251A1 (en) Method for performing inter-system service operation, service platform, and target system
CN105302676A (en) Method and apparatus for transmitting host and backup mechanism data of distributed file system
CN113793139A (en) Payment exception processing method, processing device, storage medium and electronic device
CN117076409B (en) File sharing method, device, system, electronic equipment and storage medium
CN106886455A (en) Method and system for realizing user isolation
CN113626218A (en) Data processing method, data processing device, storage medium and computer equipment
WO2019178534A1 (en) Simulation system for a production environment and related methods of use
US20160150010A1 (en) Information processing apparatus, data save method, and information processing system
JP2008293278A (en) Distributed processing program, distributed processing apparatus, and distributed processing method
US12050796B2 (en) Managing deduplication operations based on a likelihood of duplicability
CN113900931B (en) A Docker-based testing method, device, equipment and storage medium
US10467077B2 (en) Configuration item integrity
CN113076113A (en) Method, client, server application and system for installing operating system
CN116301562A (en) Data storage method, device, computer equipment and storage medium
CN113703802B (en) A data update method and related device for storage management software
JP5530810B2 (en) Scale-out system and method and program
JP6292064B2 (en) Print processing program, print processing method, and information processing apparatus
US20230043057A1 (en) Computer-readable recording medium storing application control program and application control method
CN117201318A (en) Asynchronous business processing methods, devices, equipment and media

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination