WO2020000725A1 - Electronic apparatus, data migration method, and storage medium - Google Patents

Abstract

The present application relates to an electronic apparatus, a data migration method, and a storage medium. The method comprises: on an operation interface of a migration platform, after an instruction for migrating data to be migrated from an original database of one or more service systems is received, configuring, based on the instruction, migration parameters of this instance of migration, and mapping data between the original database and a target database; after the configuration operation is completed, reading the data to be migrated according to the configured migration parameters and mapping data and by means of multi-threading, and converting the data to be migrated into XML file data; and using multiple threads to acquire the XML file data, parsing the XML file data according to a pre-determined parsing method, and using a method which is asynchronous with reading of the data to be migrated to write the parsed XML file data in the target database. The present application can realize rapid and efficient migration of data at a higher amount level.

Description

Electronic device, data migration method and storage medium

Declaration of priority

This application is based on the Paris Convention and claims the priority of a Chinese patent application filed on June 29, 2018 with an application number of CN201810694928.2, entitled "Electronic Device, Method of Data Migration and Storage Medium", the entire content of the Chinese patent application This application is incorporated by reference.

Technical field

The present application relates to the field of communication technologies, and in particular, to an electronic device, a method for data migration, and a storage medium.

Background technique

At present, in the data migration technology with a large amount of data (for example, more than 100GB), for example, data migration between old and new database systems, the existing solution is led by database staff, assisted by developers, and uses the database level Way for data migration. This method generally takes a long time to complete the data migration, and even the situation where migration cannot be achieved occurs. In view of this, when the amount of data is large, a fast and efficient data migration solution is needed.

Summary of the invention

The purpose of this application is to provide an electronic device, a method for data migration, and a storage medium, which are intended to realize the rapid and efficient migration of data of a large number of levels.

To achieve the above object, the present application provides an electronic device, the electronic device includes a memory and a processor connected to the memory, and the memory stores a processing system operable on the processor, and the processing When the system is executed by the processor, the following steps are implemented:

On the operation interface of the migration platform, after receiving an instruction to migrate the data to be migrated from the original database of one or more business systems, based on the instruction, the migration parameters of the current migration and the mapping between the original database and the target database Data configuration

After the configuration operation is completed, the data to be migrated is read in a multi-threaded manner according to the configured migration parameters and mapping data, and the data to be migrated is converted into XML file data;

Multiple threads are used to obtain the XML file data, the XML file data is parsed according to a predetermined parsing method, and the parsed XML file data is written to the target database in a manner asynchronous to reading the data to be migrated.

To achieve the above object, the present application further provides a method for data migration, and the method for data migration includes:

S1. On the operation interface of the migration platform, after receiving an instruction to migrate the data to be migrated from the original database of one or more business systems, based on the instruction, the migration parameters of the current migration and the original database and the target database are migrated. Configuration of mapping data;

S2. After completing the configuration operation, read the data to be migrated in a multi-threaded manner according to the configured migration parameters and mapping data, and convert the data to be migrated into XML file data;

S3. Use multiple threads to obtain the XML file data, parse the XML file data according to a predetermined parsing method, and write the parsed XML file data to the target database in a manner asynchronous to reading the data to be migrated.

The present application also provides a computer-readable storage medium, where the computer-readable storage medium stores a processing system, and the processing system implements steps when executed by a processor:

On the operation interface of the migration platform, after receiving an instruction to migrate the data to be migrated from the original database of one or more business systems, based on the instruction, the migration parameters of the current migration and the mapping between the original database and the target database Data configuration

After the configuration operation is completed, the data to be migrated is read in a multi-threaded manner according to the configured migration parameters and mapping data, and the data to be migrated is converted into XML file data;

Multiple threads are used to obtain the XML file data, the XML file data is parsed according to a predetermined parsing method, and the parsed XML file data is written to the target database in a manner asynchronous to reading the data to be migrated.

The beneficial effect of this application is: This application configures the migration parameters and the mapping data of the original database and the target database on the operation interface of the migration platform. When migrating data, according to the configured migration parameters and mapping data, and using multiple The threaded method reads the data to be migrated, uses XML files as intermediate storage, and controls multiple threads to read XML files, parse the XML files, and migrate the parsed data to the target database. This application is a platformized data migration method , Can provide TB-level data volume data migration services for business systems, quickly and efficiently migrate data from different databases and different data table structures.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of a hardware architecture of an embodiment of an electronic device of the present application;

2 is a schematic flowchart of a first embodiment of a data migration method of this application;

FIG. 3 is a schematic flowchart of a second embodiment of a data migration method of this application.

detailed description

In order to make the purpose, technical solution, and advantages of the present application clearer, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the application, and are not used to limit the application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

It should be noted that the descriptions related to "first", "second", etc. in this application are for descriptive purposes only, and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated . Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but must be based on those that can be realized by a person of ordinary skill in the art. When the combination of technical solutions conflicts or cannot be achieved, such a combination of technical solutions should be considered non-existent. Is not within the scope of protection claimed in this application.

FIG. 1 is a schematic diagram of a hardware architecture of an electronic device according to an embodiment of the present application. The electronic device 1 is a device capable of automatically performing numerical calculation and / or information processing in accordance with an instruction set or stored in advance. The electronic device 1 may be a computer, a single network server, a server group composed of multiple network servers, or a cloud composed of a large number of hosts or network servers based on cloud computing. Cloud computing is a type of distributed computing. A super virtual computer consisting of a loosely coupled set of computers.

In this embodiment, the electronic device 1 may include, but is not limited to, a memory 11, a processor 12, and a network interface 13 that are communicably connected to each other through a system bus. The memory 11 stores a processing system that can run on the processor 12. It should be noted that FIG. 1 only shows the electronic device 1 with components 11-13, but it should be understood that it is not required to implement all the illustrated components, and more or fewer components may be implemented instead.

The memory 11 includes a memory and at least one type of readable storage medium. The memory provides a cache for the operation of the electronic device 1; the readable storage medium may be, for example, a flash memory, a hard disk, a multimedia card, a card-type memory (for example, SD or DX memory, etc.), a random access memory (RAM), a static random access memory (SRAM) ), Read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disks, optical disks and other non-volatile storage media. In some embodiments, the readable storage medium may be an internal storage unit of the electronic device 1, such as a hard disk of the electronic device 1. In other embodiments, the non-volatile storage medium may also be external to the electronic device 1. The storage device is, for example, a plug-in hard disk, a smart memory card (SMC), a secure digital (SD) card, a flash memory card (Flash card), etc. provided on the electronic device 1. In this embodiment, the readable storage medium of the memory 11 is generally used to store an operating system and various types of application software installed in the electronic device 1, such as program code of a processing system in an embodiment of the present application. In addition, the memory 11 can also be used to temporarily store various types of data that have been output or are to be output.

In some embodiments, the processor 12 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or another data processing chip. The processor 12 is generally used to control the overall operation of the electronic device 1, such as performing control and processing related to data interaction or communication with other devices. In this embodiment, the processor 12 is configured to run program code or process data stored in the memory 11, for example, to run a processing system.

The network interface 13 may include a wireless network interface or a wired network interface. The network interface 13 is generally used to establish a communication connection between the electronic device 1 and other electronic devices.

The processing system is stored in the memory 11 and includes at least one computer-readable instruction stored in the memory 11, which can be executed by the processor 12 to implement the methods of the embodiments of the present application; and The at least one computer-readable instruction may be divided into different logic modules according to different functions implemented by each part thereof.

In an embodiment, when the processing system is executed by the processor 12, the following steps are implemented:

On the operation interface of the migration platform, after receiving an instruction to migrate the data to be migrated from the original database of one or more business systems, based on the instruction, the migration parameters of the current migration and the mapping between the original database and the target database Data configuration

In this embodiment, the browser is used to log in to the migration platform. On the operation interface of the migration platform, you can choose to migrate the data of the original database of one or more business systems.

The data to be migrated may be data of different databases (for example, data migration between MYSQL-> ORACLE and SQLSERVER-> ORACLE), data of different table structures, or data of different data types. This embodiment may implement data of different databases. Migration of data, data of different table structures, or data of different data types.

Among them, the migration parameters include: the database name of the original database and the target database, the server corresponding to the original database and the target database, the login account and login password corresponding to the original database and the target database, the data table name, the data table group, and the migration start time , The migration end time point, whether to support rollback, the number of threads (including a minimum of 1 thread, a maximum of 100 threads), and so on. The mapping data between the original database and the target database includes: the data table of the original database and the data table of the target database during migration, the fields of the two tables, the correspondence between the data types, and so on.

Further, in order to realize the flexibility of large data migration, configuration of scheduled migration, migration suspension, migration stop and rollback are provided on the operation interface, and scheduled migration can be performed, and during the migration process, migration suspension and migration can be performed. Stop and rollback operations.

After the configuration operation is completed, the data to be migrated is read in a multi-threaded manner according to the configured migration parameters and mapping data, and the data to be migrated is converted into XML (Extentsible Markup Language) file data;

This embodiment uses an XML file as an intermediate storage. After the configuration operation is completed, the multi-threaded method is used to read the data to be migrated in the original database according to the configured migration parameters and mapping data, and the data to be migrated is converted into XML file data. .

Wherein, the data table of the original database is stored in the target data table in the target database after the XML file. One data table of the original database can correspond to multiple XML files. The XML file data includes various information of the target data table (for example, data Table name, field name, data type, initial value, etc.). In order to complete the data migration quickly, a data table in the original database can use multiple threads to read the data to be migrated. For example, the data table in the original database has 100 million data volumes. It will take a long time to migrate using one thread. Long, but using 100 threads for migration, the migration speed is increased by 100 times.

Multiple threads are used to obtain the XML file data, the XML file data is parsed according to a predetermined parsing method, and the parsed XML file data is written to the target database in a manner asynchronous to reading the data to be migrated.

Among them, multiple threads are used to obtain the XML file data for rapid data migration. The predetermined parsing method is a parsing method of the XML simple application program interface. Specifically, the parsing method of the xml simple application program interface is suitable for parsing large XML file data. It parses the XML file data line by line. When parsing the XML file data, the target data table name, field name, data type, and initial value are parsed. Data that needs to be written to the target data table is stored in memory. When the loop is parsed to a certain amount, such as 100 times, it will trigger once to submit the data recorded in memory and write the data to the target data table. .

Among them, the operation of reading the data to be migrated in the original database and the operation of writing data to the target data table are asynchronously processed to achieve read / write separation and improve the efficiency of migration.

Compared with the prior art, this application configures the migration parameters and the mapping data of the original database and the target database on the operation interface of the migration platform. When migrating the data, according to the configured migration parameters and mapping data, and using multiple The threaded method reads the data to be migrated, uses XML files as intermediate storage, and controls multiple threads to read XML files, parse the XML files, and migrate the parsed data to the target database. This application is a platformized data migration method , Can provide business systems with terabytes of data migration services, quickly and efficiently migrate data from different databases and different data table structures.

In a preferred embodiment, based on the above embodiment, when the processing system is executed by the processor, the following steps are further implemented:

The first ciphertext is obtained by encrypting each single line of data in the original database to be migrated according to a predetermined encryption method, and each second line of data stored in the target database is encrypted according to the predetermined encryption method to obtain a second ciphertext. Cipher text

If the first ciphertext and the corresponding second ciphertext are respectively the same, the verification is passed;

If there is a difference between the first ciphertext and the corresponding second ciphertext, a single line of data corresponding to the second ciphertext is rolled back and cleared to re-migrate the single line of data.

Among them, the predetermined encryption method is MD5 (Message-Digest Algorithm). This embodiment encrypts the data to be migrated in the original database in a row-by-row encryption method, encrypts the data in the target database in a row-by-row encryption method, and compares the first ciphertext with the corresponding second ciphertext. If the two are the same, the verification is passed, and the data corresponding to the second ciphertext is valid in the target database; if the two are not the same, the verification fails, and the data corresponding to the second ciphertext needs to be rolled back from the target data table Clear and remigrate the single line of data. In this way, on the basis of quickly and efficiently migrating large amounts of data, single-line data can be strictly verified to find data that has been wrongly migrated and ensure the accuracy of the migrated data.

In a preferred embodiment, based on the above embodiment, when the processing system is executed by the processor, the following steps are further implemented:

Obtaining a primary key identifier of the data to be migrated, using the first preset number of primary key identifiers as a group, and generating a first index file of the data to be migrated based on each group of primary key identifiers;

A primary key identifier of data stored in the target database is obtained, and a second preset number of primary key identifiers are used as a group, and a second index file of data in the target database is generated based on the primary key identifiers of each group.

The first preset number and the second preset number may be the same or different. Preferably, the first preset number is the same as the second preset number, for example, the first preset number and the second preset number are 1000. A primary key is one or more fields in a data table. The primary key identifier is used to uniquely identify a record in the data table. In this embodiment, the first preset number or the second preset number of primary keys are identified as a group (if the first preset number is not enough, they are filled with characters 0), and the first index file or the second is stored in a fixed-length format. Index files to disk files, each time the primary key data is fetched for processing.

The first index file is used to record and locate the XML file corresponding to the data to be migrated. Under normal circumstances, because the amount of data to be migrated is very large, and the generated XML files are also very large, it is necessary to first read the first index file during migration, and locate it by the name of the first index file and the primary key data. Can quickly find XML files for migration.

The second index file is used to identify the primary key of each piece of data in the target database in the target data table after the data to be migrated from the original database is written to the target database. When the migration operation needs to be rolled back, the corresponding data in the target data table can be extracted through the second index file for cleaning.

As can be seen from the above description, in this embodiment, the first index file can quickly find the XML file and perform data migration, and the second index file can quickly extract the data to be rolled back in the target data table and clear it.

As shown in FIG. 2, FIG. 2 is a schematic flowchart of an embodiment of a data migration method of the present application. The data migration method includes the following steps:

Step S1: On the operation interface of the migration platform, after receiving an instruction to migrate data to be migrated from the original database of one or more business systems, based on the instruction, the migration parameters of the current migration and the original database and target Database mapping data for configuration;

In this embodiment, the browser is used to log in to the migration platform. On the operation interface of the migration platform, you can choose to migrate the data of the original database of one or more business systems.

The data to be migrated may be data of different databases (for example, data migration between MYSQL-> ORACLE and SQLSERVER-> ORACLE), data of different table structures, or data of different data types. This embodiment may implement data of different databases. Migration of data, data of different table structures, or data of different data types.

Among them, the migration parameters include: the database name of the original database and the target database, the server corresponding to the original database and the target database, the login account and login password corresponding to the original database and the target database, the data table name, the data table group, and the migration start time , The migration end time point, whether to support rollback, the number of threads (including a minimum of 1 thread, a maximum of 100 threads), and so on. The mapping data between the original database and the target database includes: the data table of the original database and the data table of the target database during migration, the fields of the two tables, the correspondence between the data types, and so on.

Further, in order to realize the flexibility of large data migration, configuration of scheduled migration, migration suspension, migration stop and rollback are provided on the operation interface, and scheduled migration can be performed, and during the migration process, migration suspension and migration can be performed. Stop and rollback operations.

Step S2: After the configuration operation is completed, read the data to be migrated in a multi-threaded manner according to the configured migration parameters and mapping data, and convert the data to be migrated into XML file data;

This embodiment uses an XML file as intermediate storage. After the configuration operation is completed, the multi-threaded method is used to read the data to be migrated from the original database according to the configured migration parameters and mapping data, and the data to be migrated is converted into XML file data .

Wherein, the data table of the original database is stored in the target data table in the target database after the XML file. One data table of the original database can correspond to multiple XML files. The XML file data includes various information of the target data table (for example, data Table name, field name, data type, initial value, etc.). In order to complete the data migration quickly, a data table in the original database can use multiple threads to read the data to be migrated. For example, the data table in the original database has 100 million data volumes. It will take a long time to migrate using one thread. Long, but using 100 threads for migration, the migration speed is increased by 100 times.

In step S3, multiple threads are used to obtain the XML file data, the XML file data is parsed according to a predetermined parsing method, and the parsed XML file data is written to the target database in a manner asynchronous to reading the data to be migrated. .

Among them, multiple threads are used to obtain the XML file data for rapid data migration. The predetermined parsing method is a parsing method of the XML simple application program interface. Specifically, the parsing method of the xml simple application program interface is suitable for parsing large XML file data. It parses the XML file data line by line. When parsing the XML file data, the target data table name, field name, data type, and initial value are parsed. Data that needs to be written to the target data table is stored in memory. When the loop is parsed to a certain amount, such as 100 times, it will trigger once to submit the data recorded in memory and write the data to the target data table. .

Among them, the operation of reading the data to be migrated in the original database and the operation of writing data to the target data table are asynchronously processed to achieve read / write separation and improve the efficiency of migration.

Compared with the prior art, this application configures the migration parameters and the mapping data of the original database and the target database on the operation interface of the migration platform. When migrating the data, according to the configured migration parameters and mapping data, and using multiple The threaded method reads the data to be migrated, uses XML files as intermediate storage, and controls multiple threads to read XML files, parse the XML files, and migrate the parsed data to the target database. This application is a platformized data migration method , Can provide TB-level data migration services for business systems, quickly and efficiently migrate data from different databases and different data table structures.

In a preferred embodiment, based on the above embodiment, as shown in FIG. 3, after step S3, the method further includes:

Step S4, encrypting each single line of data in the original database to be migrated according to a predetermined encryption method to obtain a first ciphertext, and encrypting each single line of data stored in the target database according to the predetermined encryption method. Get the second ciphertext;

Step S45, analyzing whether the first ciphertext is the same as the corresponding second ciphertext;

Step S5: If the first ciphertext and the corresponding second ciphertext are respectively the same, the verification is passed, and the data corresponding to the second ciphertext is valid data in the target database;

In step S6, if the first ciphertext is different from the corresponding second ciphertext, a single line of data corresponding to the second ciphertext is rolled back and cleared to re-migrate the single line of data.

Among them, the predetermined encryption method is MD5 (Message-Digest Algorithm). This embodiment encrypts the data to be migrated in the original database in a row-by-row encryption method, encrypts the data in the target database in a row-by-row encryption method, and compares the first ciphertext with the corresponding second ciphertext. If the two are the same, the verification is passed. The data corresponding to the second ciphertext is valid data in the target data. If the two are not the same, the verification fails. The data corresponding to the second ciphertext needs to be returned from the target data table. Roll clear, re-migrate the single line of data. In this way, on the basis of quickly and efficiently migrating large amounts of data, single-line data can be strictly verified to find data that has been wrongly migrated and ensure the accuracy of the migrated data.

In a preferred embodiment, based on the above embodiment, after step S2, the method further includes: obtaining a primary key identifier of the data to be migrated, using a first preset number of primary key identifiers as a group, and based on each group of primary keys. Identifying a first index file that generates the data to be migrated;

After step S3, the method further includes: obtaining a primary key identifier of the data stored in the target database, using a second preset number of primary key identifiers as a group, and generating a second index file of data in the target database based on the primary key identifiers of each group.

The first preset number and the second preset number may be the same or different. Preferably, the first preset number is the same as the second preset number, for example, the first preset number and the second preset number are 1000. A primary key is one or more fields in a data table. The primary key identifier is used to uniquely identify a record in the data table. In this embodiment, the first preset number or the second preset number of primary keys are identified as a group (if the first preset number is not enough, they are filled with characters 0), and the first index file or the second is stored in a fixed-length format. Index files to disk files, each time the primary key data is fetched for processing.

The first index file is used to record and locate the XML file corresponding to the data to be migrated. Under normal circumstances, because the amount of data to be migrated is very large, and the generated XML files are also very large, it is necessary to first read the first index file during migration, and locate it by the name of the first index file and the primary key data. Can quickly find XML files for migration.

The second index file is used to identify the primary key of each piece of data in the target database in the target data table after the data to be migrated from the original database is written to the target database. When the migration operation needs to be rolled back, the corresponding data in the target data table can be extracted through the second index file for cleaning.

As can be seen from the above description, in this embodiment, the first index file can quickly find the XML file and perform data migration, and the second index file can quickly extract the data to be rolled back in the target data table and clear it.

The present application also provides a computer-readable storage medium on which a processing system is stored. When the processing system is executed by a processor, the steps of the foregoing method for data migration are implemented.

The above-mentioned serial numbers of the embodiments of the present application are merely for description, and do not represent the superiority or inferiority of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods in the above embodiments can be implemented by means of software plus a necessary universal hardware platform, and of course, also by hardware, but in many cases the former is better. Implementation. Based on such an understanding, the technical solution of this application that is essentially or contributes to the existing technology can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, The optical disc) includes several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in the embodiments of the present application.

The above are only preferred embodiments of the present application, and thus do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the description and drawings of the application, or directly or indirectly used in other related technical fields Are included in the scope of patent protection of this application.

Claims (20)

An electronic device, characterized in that the electronic device includes a memory and a processor connected to the memory, the memory stores a processing system that can run on the processor, and the processing system is described by the The processor executes the following steps: On the operation interface of the migration platform, after receiving an instruction to migrate the data to be migrated from the original database of one or more business systems, based on the instruction, the migration parameters of the current migration and the mapping between the original database and the target database Data configuration After the configuration operation is completed, the data to be migrated is read in a multi-threaded manner according to the configured migration parameters and mapping data, and the data to be migrated is converted into XML file data; Multiple threads are used to obtain the XML file data, the XML file data is parsed according to a predetermined parsing method, and the parsed XML file data is written to the target database in a manner asynchronous to reading the data to be migrated. The electronic device according to claim 1, wherein when the processing system is executed by the processor, the following steps are further implemented: The first ciphertext is obtained by encrypting each single line of data in the original database to be migrated according to a predetermined encryption method, and each second line of data stored in the target database is encrypted according to the predetermined encryption method to obtain a second ciphertext. Cipher text If the first ciphertext and the corresponding second ciphertext are respectively the same, the verification is passed; If there is a difference between the first ciphertext and the corresponding second ciphertext, a single line of data corresponding to the second ciphertext is rolled back and cleared to re-migrate the single line of data. The electronic device according to claim 1, wherein when the processing system is executed by the processor, the following steps are further implemented: Obtaining a primary key identifier of the data to be migrated, using the first preset number of primary key identifiers as a group, and generating a first index file of the data to be migrated based on each group of primary key identifiers; A primary key identifier of the data stored in the target database is obtained, and a second preset number of primary key identifiers are used as a group, and a second index file of data in the target database is generated based on the primary key identifiers of each group. The electronic device according to claim 2, wherein when the processing system is executed by the processor, the following steps are further implemented: Obtaining a primary key identifier of the data to be migrated, using the first preset number of primary key identifiers as a group, and generating a first index file of the data to be migrated based on each group of primary key identifiers; A primary key identifier of data stored in the target database is obtained, and a second preset number of primary key identifiers are used as a group, and a second index file of data in the target database is generated based on the primary key identifiers of each group. The electronic device according to claim 1, wherein the operation interface is provided with a configuration of scheduled migration, migration suspension, migration stop, and rollback, and when the processing system is executed by the processor, the following steps are further implemented: : Receive operation instructions for scheduled migration, migration suspension, migration stop, or rollback, and perform corresponding operations of scheduled migration, migration suspension, migration stop, or rollback according to the operation instructions. The electronic device according to claim 2, wherein the operation interface is provided with a configuration of scheduled migration, migration suspension, migration stop, and rollback, and when the processing system is executed by the processor, the following steps are further implemented: : Receive operation instructions for scheduled migration, migration suspension, migration stop, or rollback, and perform corresponding operations of scheduled migration, migration suspension, migration stop, or rollback according to the operation instructions. The electronic device according to claim 1 or 2, wherein the predetermined parsing method is a parsing method of an XML simple application program interface. A method for data migration, characterized in that the method for data migration includes: S1. On the operation interface of the migration platform, after receiving an instruction to migrate the data to be migrated from the original database of one or more business systems, based on the instruction, the migration parameters of the current migration and the original database and the target database are migrated. Configuration of mapping data; S2. After completing the configuration operation, read the data to be migrated in a multi-threaded manner according to the configured migration parameters and mapping data, and convert the data to be migrated into XML file data; S3. Use multiple threads to obtain the XML file data, parse the XML file data according to a predetermined parsing method, and write the parsed XML file data to the target database in a manner asynchronous to reading the data to be migrated. The method for data migration according to claim 8, wherein after step S3, the method further comprises: The first ciphertext is obtained by encrypting each single line of data in the original database to be migrated according to a predetermined encryption method, and each second line of data stored in the target database is encrypted according to the predetermined encryption method to obtain a second ciphertext. Cipher text If the first ciphertext and the corresponding second ciphertext are respectively the same, the verification is passed; If there is a difference between the first ciphertext and the corresponding second ciphertext, a single line of data corresponding to the second ciphertext is rolled back and cleared to re-migrate the single line of data. The method for data migration according to claim 8, wherein after step S2, further comprising: obtaining a primary key identifier of the data to be migrated, using a first preset number of primary key identifiers as a group, based on each group of primary keys Identifying a first index file that generates the data to be migrated; After step S3, the method further includes: obtaining a primary key identifier of the data stored in the target database, using a second preset number of primary key identifiers as a group, and generating a second index file of data in the target database based on the primary key identifiers of each group. The method for data migration according to claim 9, wherein after step S2, further comprising: obtaining a primary key identifier of the data to be migrated, using a first preset number of primary key identifiers as a group, based on each group of primary keys Identifying a first index file that generates the data to be migrated; After step S3, the method further includes: obtaining a primary key identifier of the data stored in the target database, using a second preset number of primary key identifiers as a group, and generating a second index file of data in the target database based on the primary key identifiers of each group. The method of data migration according to claim 8, wherein the operation interface is provided with a configuration of scheduled migration, migration suspension, migration stop, and rollback, and the method further comprises: Receive operation instructions for scheduled migration, migration suspension, migration stop, or rollback, and perform corresponding operations of scheduled migration, migration suspension, migration stop, or rollback according to the operation instructions. The method for data migration according to claim 9, wherein the operation interface is provided with a configuration of scheduled migration, migration suspension, migration stop, and rollback, and the method further comprises: Receive operation instructions for scheduled migration, migration suspension, migration stop, or rollback, and perform corresponding operations of scheduled migration, migration suspension, migration stop, or rollback according to the operation instructions. The data migration method according to claim 8 or 9, wherein the predetermined parsing manner is a parsing manner of an XML simple application program interface. A computer-readable storage medium, characterized in that a processing system is stored on the computer-readable storage medium, and the processing system implements steps when executed by a processor: On the operation interface of the migration platform, after receiving an instruction to migrate the data to be migrated from the original database of one or more business systems, based on the instruction, the migration parameters of the current migration and the mapping between the original database and the target database Data configuration After the configuration operation is completed, the data to be migrated is read in a multi-threaded manner according to the configured migration parameters and mapping data, and the data to be migrated is converted into XML file data; Multiple threads are used to obtain the XML file data, the XML file data is parsed according to a predetermined parsing method, and the parsed XML file data is written to the target database in a manner asynchronous to reading the data to be migrated. The computer-readable storage medium according to claim 15, wherein when the processing system is executed by the processor, the following steps are further implemented: The first ciphertext is obtained by encrypting each single line of data in the original database to be migrated according to a predetermined encryption method, and each second line of data stored in the target database is encrypted according to the predetermined encryption method to obtain a second ciphertext. Cipher text If the first ciphertext and the corresponding second ciphertext are respectively the same, the verification is passed; If there is a difference between the first ciphertext and the corresponding second ciphertext, a single line of data corresponding to the second ciphertext is rolled back and cleared to re-migrate the single line of data. The computer-readable storage medium according to claim 15, wherein when the processing system is executed by the processor, the following steps are further implemented: Obtaining a primary key identifier of the data to be migrated, using the first preset number of primary key identifiers as a group, and generating a first index file of the data to be migrated based on each group of primary key identifiers; A primary key identifier of data stored in the target database is obtained, and a second preset number of primary key identifiers are used as a group, and a second index file of data in the target database is generated based on the primary key identifiers of each group. The computer-readable storage medium according to claim 16, wherein when the processing system is executed by the processor, the following steps are further implemented: Obtaining a primary key identifier of the data to be migrated, using the first preset number of primary key identifiers as a group, and generating a first index file of the data to be migrated based on each group of primary key identifiers; A primary key identifier of data stored in the target database is obtained, and a second preset number of primary key identifiers are used as a group, and a second index file of data in the target database is generated based on the primary key identifiers of each group. The computer-readable storage medium according to claim 15, wherein a configuration of scheduled migration, migration suspension, migration stop, and rollback is provided on the operation interface, and when the processing system is executed by the processor, To achieve the following steps: Receive operation instructions for scheduled migration, migration suspension, migration stop, or rollback, and perform corresponding operations of scheduled migration, migration suspension, migration stop, or rollback according to the operation instructions. The computer-readable storage medium according to claim 16, wherein the operation interface is provided with a configuration of scheduled migration, migration suspension, migration stop, and rollback, and when the processing system is executed by the processor, To achieve the following steps: Receive operation instructions for scheduled migration, migration suspension, migration stop, or rollback, and perform corresponding operations of scheduled migration, migration suspension, migration stop, or rollback according to the operation instructions.

Images