[go: up one dir, main page]

CN105487813A - Distributed storage based multi-path I/O transmission method - Google Patents

Distributed storage based multi-path I/O transmission method Download PDF

Info

Publication number
CN105487813A
CN105487813A CN201510689437.5A CN201510689437A CN105487813A CN 105487813 A CN105487813 A CN 105487813A CN 201510689437 A CN201510689437 A CN 201510689437A CN 105487813 A CN105487813 A CN 105487813A
Authority
CN
China
Prior art keywords
scsi
path
distributed storage
request
policy
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510689437.5A
Other languages
Chinese (zh)
Inventor
柏广宇
谢宾铭
李东辉
陈艳
俞俊
吴小志
朱广新
郑磊
程聪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Integration Of Information System Branch Office Of Nanjing Nanrui Group Co ltd
State Grid Corp of China SGCC
State Grid Shanghai Electric Power Co Ltd
Nanjing NARI Group Corp
Original Assignee
Integration Of Information System Branch Office Of Nanjing Nanrui Group Co ltd
State Grid Corp of China SGCC
State Grid Shanghai Electric Power Co Ltd
Nanjing NARI Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Integration Of Information System Branch Office Of Nanjing Nanrui Group Co ltd, State Grid Corp of China SGCC, State Grid Shanghai Electric Power Co Ltd, Nanjing NARI Group Corp filed Critical Integration Of Information System Branch Office Of Nanjing Nanrui Group Co ltd
Priority to CN201510689437.5A priority Critical patent/CN105487813A/en
Publication of CN105487813A publication Critical patent/CN105487813A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0662—Virtualisation aspects
    • G06F3/0664—Virtualisation aspects at device level, e.g. emulation of a storage device or system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明属于数据存储技术领域，公开了一种分布式存储的多路径I/O传输方法，在分布式存储集群的每个节点上部署Target服务，把分布式存储集群上划分出的虚拟硬盘映射到客户端，在任一服务器上通过Initiator连接每个节点上的Target服务端口。多路径I/O技术旨在增强存储系统的可用性和可靠性，减少由于单路径数据传输错误而出现的单点失效；同时，能够更好的平衡系统的I/O负载，提高系统的吞吐率，提供比单路径更好的性能。The invention belongs to the technical field of data storage, and discloses a multi-path I/O transmission method for distributed storage. Target service is deployed on each node of the distributed storage cluster, and virtual hard disks divided on the distributed storage cluster are mapped To the client, connect to the Target service port on each node through the Initiator on any server. Multi-path I/O technology is designed to enhance the availability and reliability of the storage system, reduce single-point failures due to single-path data transmission errors; at the same time, it can better balance the I/O load of the system and improve the throughput of the system , providing better performance than single path.

Description

一种分布式存储的多路径I/O传输方法A Multipath I/O Transmission Method for Distributed Storage

技术领域technical field

本发明属于数据存储技术领域，涉及一种数据传输方法，具体涉及一种分布式存储的多路径I/O传输方法。The invention belongs to the technical field of data storage, and relates to a data transmission method, in particular to a distributed storage multi-path I/O transmission method.

背景技术Background technique

I/O路径技术是指位于主机和存储设备之间用于传输数据的技术。在I/O子系统中，单路径I/O传输错误是导致系统单点失效的根源，它难以满足新的I/O路径技术和现代存储对系统可用性和可靠的新要求；同时，在单条I/O路径中，数据只能在一条I/O通道中传输,成为性能的瓶颈。The I/O path technology refers to the technology used to transmit data between the host and the storage device. In the I/O subsystem, single-path I/O transmission errors are the root cause of the system's single point of failure. It is difficult to meet the new requirements of new I/O path technology and modern storage for system availability and reliability; In the I/O path, data can only be transmitted in one I/O channel, which becomes a performance bottleneck.

发明内容Contents of the invention

发明目的：本发明的目的是为了解决现有技术中单路径I/O传输错误而导致数据传输错误，提供了一种安全、可靠的分布式存储的多路径I/O传输方法。Purpose of the invention: The purpose of the present invention is to solve data transmission errors caused by single-path I/O transmission errors in the prior art, and provide a safe and reliable multi-path I/O transmission method for distributed storage.

技术方案：本发明所述的分布式存储的多路径I/O传输方法，其目的是这样实现的，Technical solution: the multi-path I/O transmission method of distributed storage described in the present invention, its purpose is to realize in this way,

一种分布式存储的多路径I/O传输方法，其特征在于，包括以下步骤：A multi-path I/O transmission method for distributed storage, characterized in that it comprises the following steps:

S01：在分布式存储集群的每个节点上部署Target服务，把分布式存储集群上划分出的虚拟硬盘映射到客户端，在任一服务器上通过Initiator连接每个节点上的Target服务端口；S01: Deploy the Target service on each node of the distributed storage cluster, map the virtual hard disk divided on the distributed storage cluster to the client, and connect the Target service port on each node through the Initiator on any server;

S02：在SCSI总线扫描时，当一个SCSI设备的UUID被检查出来后，所有已经被扫描过的SCSI设备就会搜索一个匹配的UUID，每扫到一个新的UUID，就加载到SCSI设备中；S02: When scanning the SCSI bus, when the UUID of a SCSI device is checked out, all scanned SCSI devices will search for a matching UUID, and each time a new UUID is scanned, it will be loaded into the SCSI device;

S03：在SCSI中间层多路径中，块设备I/O请求的处理,首先被插入I/O请求队列中，然后进行路径选择，路径选择策略通过全局变量scsi_path_policy来控制，其控制方法为：当scsi_payh_policy为SCSI_PATH_POLICY_ROUND_ROBN时，每个SCSI设备的I/O路径将会被分配到所有的可用的I/O请求的路径上；S03: In the SCSI middle layer multi-path, block device I/O request processing is first inserted into the I/O request queue, and then path selection is performed. The path selection policy is controlled by the global variable scsi_path_policy, and the control method is: when When scsi_payh_policy is SCSI_PATH_POLICY_ROUND_ROBN, the I/O path of each SCSI device will be allocated to all available I/O request paths;

S04：SCSI命令通过queuecommand()函数来处理，处理过的I/O其请求将按照完成的状态分为以下几类：S04: SCSI commands are processed through the queuecommand() function, and the processed I/O requests will be divided into the following categories according to the completed status:

SUCCESS：I/O请求完成，没发送错误，I/O请求到达了磁盘；Scsi_finish_command()函数完成最终的SCSI命令的I/O请求处理，并且向SCSI子系统的Upper-Level返回，SUCCESS: The I/O request is completed, no error is sent, and the I/O request has reached the disk; the Scsi_finish_command() function completes the I/O request processing of the final SCSI command, and returns to the Upper-Level of the SCSI subsystem,

ADD_TO_MLQUEUE:表示I/O请求是以SCSIQUEUEFULL的状态完成的，这种情况下，SCSI命令将会通过scsi_queque_intert()函数来进行重试，直至出现SUCCESS状态。ADD_TO_MLQUEUE: Indicates that the I/O request is completed in the state of SCSIQUEUEFULL. In this case, the SCSI command will be retried through the scsi_queque_intert() function until the SUCCESS state occurs.

有益效果：本发明所述的分布式存储的多路径I/O传输方法，与单路径I/O传输相比，具有以下优点：Beneficial effects: Compared with single-path I/O transmission, the multi-path I/O transmission method for distributed storage of the present invention has the following advantages:

1、单路径I/O传输错误是导致系统单点消息的根源，它难以满足新的I/O路径技术和现代存储对系统可用性和可靠的新要求；而启用互连多路径的I/O存储方式，能够增强存储系统的可用性和可靠性，减少由于单路径数据传输错误而出现的单点失效。1. Single-path I/O transmission errors are the root cause of system single-point messages. It is difficult to meet the new requirements of new I/O path technology and modern storage for system availability and reliability; while enabling interconnected multi-path I/O The storage method can enhance the availability and reliability of the storage system and reduce the single point of failure due to single-path data transmission errors.

2、利用多路径I/O的存储方式还能很好的平衡系统的I/O负载，提高系统的吞吐率，提供比单路径传输更好的性能2. Using the multi-path I/O storage method can also balance the I/O load of the system, improve the throughput of the system, and provide better performance than single-path transmission

多路径I/O技术旨在增强存储系统的可用性和可靠性，减少由于单路径数据传输错误而出现的单点失效；同时，能够更好的平衡系统的I/O负载，提高系统的吞吐率，提供比单路径更好的性能。Multi-path I/O technology is designed to enhance the availability and reliability of the storage system, reduce single-point failures due to single-path data transmission errors; at the same time, it can better balance the I/O load of the system and improve the throughput of the system , providing better performance than single path.

具体实施方式detailed description

为了加深对本发明的理解，下面将结合实施例对本发明作进一步详述，该实施例仅用于解释本发明，并不构成对本发明保护范围的限定。In order to deepen the understanding of the present invention, the present invention will be further described below in conjunction with examples, which are only used to explain the present invention and do not constitute a limitation to the protection scope of the present invention.

一种分布式存储的多路径I/O传输方法，包括以下步骤：A multi-path I/O transmission method for distributed storage, comprising the following steps:

S01：在分布式存储集群的每个节点上部署Target服务，把分布式存储集群上划分出的虚拟硬盘映射到客户端，在任一服务器上通过Initiator连接每个节点上的Target服务端口；S01: Deploy the Target service on each node of the distributed storage cluster, map the virtual hard disk divided on the distributed storage cluster to the client, and connect the Target service port on each node through the Initiator on any server;

S02：在SCSI总线扫描时，当一个SCSI设备的UUID被检查出来后，所有已经被扫描过的SCSI设备就会搜索一个匹配的UUID，每扫到一个新的UUID，就加载到SCSI设备中；S02: When scanning the SCSI bus, when the UUID of a SCSI device is checked out, all scanned SCSI devices will search for a matching UUID, and each time a new UUID is scanned, it will be loaded into the SCSI device;

S03：在SCSI中间层多路径中，块设备I/O请求的处理,首先被插入I/O请求队列中，然后进行路径选择，路径选择策略通过全局变量scsi_path_policy来控制，其控制方法为：当scsi_payh_policy为SCSI_PATH_POLICY_ROUND_ROBN时，每个SCSI设备的I/O路径将会被分配到所有的可用的I/O请求的路径上；S03: In the SCSI middle layer multi-path, block device I/O request processing is first inserted into the I/O request queue, and then path selection is performed. The path selection policy is controlled by the global variable scsi_path_policy, and the control method is: when When scsi_payh_policy is SCSI_PATH_POLICY_ROUND_ROBN, the I/O path of each SCSI device will be allocated to all available I/O request paths;

S04：SCSI命令通过queuecommand()函数来处理，处理过的I/O其请求将按照完成的状态分为以下几类：S04: SCSI commands are processed through the queuecommand() function, and the processed I/O requests will be divided into the following categories according to the completed status:

SUCCESS：I/O请求完成，没发送错误，I/O请求到达了磁盘；Scsi_finish_command()函数完成最终的SCSI命令的I/O请求处理，并且向SCSI子系统的Upper-Level返回，SUCCESS: The I/O request is completed, no error is sent, and the I/O request has reached the disk; the Scsi_finish_command() function completes the I/O request processing of the final SCSI command, and returns to the Upper-Level of the SCSI subsystem,

ADD_TO_MLQUEUE:表示I/O请求是以SCSIQUEUEFULL的状态完成的，这种情况下，SCSI命令将会通过scsi_queque_intert()函数来进行重试，直至出现SUCCESS状态。ADD_TO_MLQUEUE: Indicates that the I/O request is completed in the state of SCSIQUEUEFULL. In this case, the SCSI command will be retried through the scsi_queque_intert() function until the SUCCESS state occurs.

以上所述仅为本发明的较佳实施例而已，并不用以限制本发明，凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included in the scope of the present invention. within the scope of protection.

Claims (1)

1. a Multipath I/O transmission method for distributed storage, is characterized in that, comprise the following steps:
S01: serve at each node deploy Target of distributed storage cluster, the virtual hard disk that distributed storage cluster marks off is mapped to client, arbitrary server is connected by Initiator the Target serve port on each node;
S02: scanning SCSI bus, when the UUID of a scsi device examined out after, all scsi devices be scanned will search for the UUID of a coupling, often sweep to a new UUID, are just loaded in scsi device;
S03: in the multipath of SCSI middle layer, the process that block device I/O asks, first be inserted in I/O request queue, then routing is carried out, routing strategy is controlled by global variable scsi_path_policy, its control method is: when scsi_payh_policy is SCSI_PATH_POLICY_ROUND_ROBN, and the I/O path of each scsi device will be assigned on the path of all available I/O requests;
S04:SCSI order is processed by queuecommand () function, and its request of the I/O processed is divided into according to the state completed:
SUCCESS:I/O has asked, and does not send mistake, and I/O request reaches disk; Scsi_finish_command () function completes the I/O request process of final scsi command, and returns to the Upper-Level of SCSI subsystem,
ADD_TO_MLQUEUE: represent that I/O request is what to complete with the state of SCSIQUEUEFULL, in this case, scsi command will carry out retry by scsi_queque_intert () function, until there is SUCCESS state.
CN201510689437.5A 2015-10-21 2015-10-21 Distributed storage based multi-path I/O transmission method Pending CN105487813A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510689437.5A CN105487813A (en) 2015-10-21 2015-10-21 Distributed storage based multi-path I/O transmission method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510689437.5A CN105487813A (en) 2015-10-21 2015-10-21 Distributed storage based multi-path I/O transmission method

Publications (1)

Publication Number Publication Date
CN105487813A true CN105487813A (en) 2016-04-13

Family

ID=55674819

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510689437.5A Pending CN105487813A (en) 2015-10-21 2015-10-21 Distributed storage based multi-path I/O transmission method

Country Status (1)

Country Link
CN (1) CN105487813A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111625193A (en) * 2020-05-22 2020-09-04 浪潮电子信息产业股份有限公司 Configuration method, device, equipment and medium of multipath alias

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1694081A (en) * 2005-05-31 2005-11-09 清华大学 Realization method of virtualized intelligent controller in SAN system
US20090271418A1 (en) * 2008-04-28 2009-10-29 Vmware, Inc. Computer file system with path lookup tables
CN103324444A (en) * 2013-05-24 2013-09-25 浪潮电子信息产业股份有限公司 Host terminal and storage terminal synergetic multi-control IO dispatch method
CN104937584A (en) * 2012-12-19 2015-09-23 赛门铁克公司 Providing optimized quality of service to prioritized virtual machines and applications based on quality of shared resources

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1694081A (en) * 2005-05-31 2005-11-09 清华大学 Realization method of virtualized intelligent controller in SAN system
US20090271418A1 (en) * 2008-04-28 2009-10-29 Vmware, Inc. Computer file system with path lookup tables
CN104937584A (en) * 2012-12-19 2015-09-23 赛门铁克公司 Providing optimized quality of service to prioritized virtual machines and applications based on quality of shared resources
CN103324444A (en) * 2013-05-24 2013-09-25 浪潮电子信息产业股份有限公司 Host terminal and storage terminal synergetic multi-control IO dispatch method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111625193A (en) * 2020-05-22 2020-09-04 浪潮电子信息产业股份有限公司 Configuration method, device, equipment and medium of multipath alias

Similar Documents

Publication Publication Date Title
EP3754511B1 (en) Multi-protocol support for transactions
US20220317936A1 (en) Solid-state drive with initiator mode
US9619389B1 (en) System for a backward and forward application environment compatible distributed shared coherent storage
CN111897751B (en) Data transmission method, device, equipment and system
US9195603B2 (en) Storage caching
US8756345B2 (en) Methods and structure for managing protection information with a serial attached SCSI expander
US8751741B2 (en) Methods and structure for implementing logical device consistency in a clustered storage system
US10423332B2 (en) Fibre channel storage array having standby controller with ALUA standby mode for forwarding SCSI commands
US8732357B2 (en) Apparatus and method for dynamically enabling and disabling write XFR—RDY
CN109815170B (en) Data redundancy processing method and related computer system
US20130007504A1 (en) High availability data storage systems and methods
KR20180010131A (en) Dual-ported pci express-based storage cartridge including single-ported storage controllers
JP2015518203A (en) Storage system with multicast DMA and integrated address space
TW201027354A (en) Dynamic physical and virtual multipath I/O
US10007536B2 (en) Virtualization system, switch controller, fiber-channel switch, migration method and migration program
US10013370B2 (en) Method and system for providing access of a storage system using a shared storage module as a transport mechanism
WO2016197848A1 (en) Method, apparatus and system for managing network card
JP2020530169A (en) Data access methods, equipment and systems
US8621121B1 (en) Detecting bogus IOs in a multipathing driver
CN113767360A (en) Termination of non-volatile memory networking messages at driver level
US20160034191A1 (en) Grid oriented distributed parallel computing platform
CN105487813A (en) Distributed storage based multi-path I/O transmission method
US9729305B2 (en) Airplane system and control method thereof
US20120102561A1 (en) Token-based reservations for scsi architectures
US9317678B2 (en) System and method for managing logins in a network interface

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160413

RJ01 Rejection of invention patent application after publication