CN113704120A

CN113704120A - Data transmission method, device, equipment and storage medium

Info

Publication number: CN113704120A
Application number: CN202111013415.9A
Authority: CN
Inventors: 崇帮忠
Original assignee: Ping An Puhui Enterprise Management Co Ltd
Current assignee: Ping An Puhui Enterprise Management Co Ltd
Priority date: 2021-08-31
Filing date: 2021-08-31
Publication date: 2021-11-26

Abstract

The application relates to a data transmission method, a device, equipment and a storage medium, wherein the method comprises the following steps: receiving a processing instruction of data to be processed; if the data to be processed comprises external environment data, acquiring an external generation file of the external environment data from a pre-stored file library based on the identification information of the external environment data; acquiring target configuration information of a database in a local environment based on a pre-stored data source list and connection information of an external environment data uploading database in an external generation file; and uploading the external environment data to a database of a local environment based on the target configuration information, a preset interface and the access logic of the external environment data in the external generation file, so that the external environment data is processed by the electronic equipment corresponding to the local environment. By the method and the device, convenience of data processing and success rate of data processing can be improved.

Description

Data transmission method, device, equipment and storage medium

Technical Field

The present application relates to the field of data processing technologies, and in particular, to a data transmission method, apparatus, device, and storage medium.

Background

In the course of a company's operation, some other company-developed data applications may be used. For example, the tableau application in Business Intelligence (BI) tool software. the preparation (prep) module in the tableau application is used to process data and the desktop (desktop) module in the tableau application is used to analyze and visualize data. However, the data used by these data applications typically require human upload and configuration to be deployed in a local environment. The environment used by the user using the data is not a local environment, and the data needs to be reconfigured, resulting in insufficient convenience of operation.

Disclosure of Invention

The embodiment of the application provides a data transmission method, a data transmission device, data transmission equipment and a data transmission storage medium, and can improve the convenience of data processing and the success rate of data processing.

In a first aspect, an embodiment of the present application provides a data transmission method, where:

receiving a processing instruction of data to be processed;

if the data to be processed comprises external environment data, acquiring an external generation file of the external environment data from a pre-stored file library based on identification information of the external environment data, wherein the external generation file comprises connection information of an external environment data uploading database and access logic of the external environment data;

acquiring target configuration information of the database in a local environment based on a pre-stored data source list and the connection information;

and uploading the external environment data to the database of the local environment based on the target configuration information, a preset interface and the access logic, so that the external environment data is processed by the electronic equipment corresponding to the local environment.

In a second aspect, an embodiment of the present application provides a data transmission apparatus, where:

the storage unit is used for storing a data source list and a preset interface;

the communication unit is used for receiving a processing instruction of data to be processed;

the processing unit is used for acquiring an external generation file of the external environment data from a pre-stored file library based on identification information of the external environment data if the data to be processed comprises the external environment data, wherein the external generation file comprises connection information of an external environment data uploading database and access logic of the external environment data; acquiring target configuration information of the database in a local environment based on the data source list and the connection information; uploading the external environment data to the database of the local environment based on the target configuration information, the preset interface and the access logic, so that the external environment data is processed by the electronic equipment corresponding to the local environment.

In a third aspect, an embodiment of the present application provides a computer device, including a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for some or all of the steps described in the first aspect.

In a fourth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, where the computer program makes a computer execute to implement part or all of the steps described in the first aspect.

The embodiment of the application has the following beneficial effects:

after the data transmission method, the data transmission device, the data transmission equipment and the storage medium are adopted, after a processing instruction of the data to be processed is received, whether the data to be processed comprises external environment data or not is determined. And if so, acquiring an external generation file of the external environment data from a pre-stored file library based on the identification information of the external environment data. And then acquiring target configuration information of the database in the local environment based on the pre-stored data source list and the connection information in the external generation file. And uploading the external environment data to a database of the local environment based on the target configuration information, the preset interface and the access logic of the external environment data. As such, there is no need to reconfigure external environment data. And the external environment data is uploaded to the database of the local environment through data transmission, so that the electronic equipment corresponding to the local environment processes the data, and the convenience of data processing and the success rate of data processing are improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Wherein:

fig. 1 is a schematic flowchart of a data transmission method according to an embodiment of the present application;

fig. 2 is a schematic structural diagram of a data transmission device according to an embodiment of the present application;

fig. 3 is a schematic structural diagram of a computer device according to an embodiment of the present application.

Detailed Description

In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art without any inventive work according to the embodiments of the present application are within the scope of the present application.

The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

The system applied to the embodiment of the application comprises the electronic equipment and the server. The number of the electronic devices and the number of the servers are not limited, and the electronic devices can communicate with at least one server. The electronic device may be a Personal Computer (PC), a notebook computer, or a smart phone, and may also be an all-in-one machine, a palm computer, a tablet computer (pad), a smart television playing terminal, a vehicle-mounted terminal, or a portable device. The operating system of the PC-side electronic device, such as a kiosk or the like, may include, but is not limited to, operating systems such as Linux system, Unix system, Windows series system (e.g., Windows xp, Windows 7, etc.), Mac OS X system (operating system of apple computer), and the like. The operating system of the electronic device on the mobile side, such as a smart phone, may include, but is not limited to, an operating system such as an android system, an IOS (operating system of an apple mobile phone), a Windows system, and the like.

The server may be an independent server, or may be a cloud server that provides basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a network service, cloud communication, a middleware service, a domain name service, a security service, a Content Delivery Network (CDN), a big data and artificial intelligence platform, and the like. Or may be a server cluster comprised of multiple servers.

The server is used for providing services for the electronic equipment. For example, in a test scenario, a server performs a test based on a test case to be tested, and sends an execution result obtained by the test to an electronic device, so that a user obtains the execution result of the test case through the electronic device. For another example, in a development scenario, data related to a program to be developed is acquired by a server, so that a user develops based on the data through an electronic device. For another example, in a production scenario, real data in production is run through the server, and a result obtained by the running can be sent to the electronic device, so that the user can obtain the result through the electronic device.

It should be noted that the server may provide services for different data applications (or platforms or systems). For example, a server of the tableau application (e.g., tableau server) or a server corresponding to the information management system. In the embodiment of the application, the information management system can be a soldier system and is used for storing information such as codes, test codes and test cases of all application programs, so that companies can conveniently manage the information in a unified manner, and the improvement of the reuse rate of data is facilitated.

The data transmission method provided by the embodiment of the application can be executed by a data transmission method device. The device can be realized by software and/or hardware, can be generally integrated in a server, does not need to reconfigure external environment data, and improves the convenience of data processing and the success rate of data processing.

Referring to fig. 1, fig. 1 is a schematic flow chart of a data transmission method provided in the present application. The method is applied to the electronic equipment corresponding to the local environment for illustration, and the electronic equipment corresponding to the local environment refers to the electronic equipment currently running the data transmission method. The method comprises the following steps S101-S104, wherein:

s101: and receiving a processing instruction of the data to be processed.

In the embodiment of the application, the processing instruction is used for instructing the electronic device corresponding to the local environment to process the data to be processed. The processing instruction can be an instruction sent by a user, and can also be an instruction triggered by the arrival of a test cycle or a development cycle or a production cycle of a product corresponding to the information management platform.

The processing instruction may include identification information and processing requirements of the data to be processed, and the like. The identification information is used for identifying the data to be processed, and the identification information can be represented by the data name and data type of the data to be processed, the identification of the applied application (or platform or system), the version type and other information. The processing requirements may include parameter information, processing type, processing method, and the like of the data to be processed.

The parameter information may include data information of the data to be processed, for example, a range of values in the data to be processed, a time requirement, version information, and the like. The type of processing may include, or include specific matters in development, testing, and production. For example, the development of a certain application, the testing of a certain function, the production of a certain data, etc. The processing method is used for indicating how to process the data to be processed, such as checking duplicate, checking whether the data connection is normal, whether the access logic is correct, and the like.

The application does not limit the data to be processed. If the data to be processed can be directly accessed and processed by the electronic device corresponding to the local environment, the data to be processed may be referred to as local environment data. The local environment data may include data stored in the electronic device corresponding to the local environment or newly created data, or data downloaded from a network, etc. It should be noted that, if the local environment data sets the authority, for example, sets a password, sets an operation authority, data processing needs to be performed after the authority is acquired.

If the data to be processed cannot be directly accessed by the electronic device corresponding to the local environment, the data to be processed may be referred to as external environment data. The external environment data is not data stored, edited and downloadable in the electronic device corresponding to the local environment, but may be understood as data in an environment other than the local environment, and the environment limits the use right of the data, so that the electronic device corresponding to the environment other than the environment (for example, the local environment) cannot directly access the data. And transmitting the external environment data to the electronic device corresponding to the local environment (or a database in the local environment) under the use environment of the external environment data, so that the electronic device corresponding to the local environment can access and process the data.

The external environment data may include data uploaded by other users in a cloud platform that is limited to data processing only under the current network. The external environment data is generally data or a data source (an electronic device uploading the external environment data) uploaded to a server corresponding to a data application developed by another company by connecting a database. The data application may include a tableau application or other applications, etc., and is not limited herein.

The externally generated file refers to a file generated after external environment data (or a data source) is uploaded to a server corresponding to the data application. The external generation file may include related information configured when the database is connected, and may also include data information obtained by processing the external environment data in the data application, and the like, which is not limited herein.

The relevant information of the configuration can comprise connection information of the database and the access logic of the external environment data. The connection information of the database is used for connecting the database, and may include an internet protocol address (IP address) of the server and port information. The connection information may further include a name of the database, a type of the database, a structure of the database, an authentication method of logging in the database, a type of file transmission, information of the user, and a Structured Query Language (SQL) statement (which may be referred to as an initial SQL statement) executed during connection, which are not limited herein. It will be appreciated that the external environment data may be connected to the database in other environments based on the connection information of the database so that electronic devices in other environments may process the data.

The external environment data fetching logic may be understood as a method for obtaining the external environment data. SQL statements may typically be included so that external environment data may be looked up based on the SQL statements. It will be appreciated that in other environments, the external environment data may be retrieved from the database based on the fetch logic for the external environment data after connection to the database.

Taking the tableau application as an example, the externally generated file refers to a file generated after external environment data (e.g., a data source) is uploaded to the tableau application through a database (e.g., cloudera Hadoop), and the suffix of the file is tdx. The externally generated file may include connection information of a database filled when the external environment data is uploaded to the tableau application, and access logic of the external environment data. Uploading external environment data to the tableau application may include the steps of: and selecting the database on the tableau application, and filling the connection information of the database on a login page of the database. After connecting the database, the specific database architecture of the external environment data is selected or specified. Then, SQL statements are imported or filled in to obtain the access logic of the external environment data. After the external environment data is uploaded to the tableau application, a component of the uploading function may be implemented by clicking a "publish" or other button, so that the external environment data is uploaded to a server (e.g., tableau server) of the tableau application.

S102: and if the data to be processed comprises external environment data, acquiring an external generation file of the external environment data from a pre-stored file library based on the identification information of the external environment data, wherein the external generation file comprises connection information of an external environment data uploading database and access logic of the external environment data.

In the embodiment of the present application, an externally generated file of each data (or data source) may be stored in advance, so that other users can use the data source in their corresponding electronic devices. Specifically, the externally generated files may be uploaded to the information management system described above or other storage locations. For example, in a block created one on a Blockchain (Blockchain) network. The blockchain is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism and an encryption algorithm. The blockchain is essentially a decentralized database, which is a string of data blocks associated by using cryptography, each data block contains information of a batch of network transactions, and the information is used for verifying the validity (anti-counterfeiting) of the information and generating the next block. The blockchain may include a blockchain underlying platform, a platform product services layer, and an application services layer. Therefore, data are stored in a distributed mode through the block chain, data security is guaranteed, and meanwhile data sharing of information among different platforms can be achieved.

The present application is not limited to the method for obtaining the externally generated file, and in a possible example, the processing instruction includes a processing requirement of the data to be processed and identification information of the external environment data, and obtaining the externally generated file of the external environment data from a file library stored in advance based on the identification information of the external environment data may include the following steps a1 and a2, where:

a1: and searching a reference file of the external environment data from a file library stored in advance based on the identification information.

In the embodiment of the present application, the pre-stored file library includes externally generated files or related files of each data. The relevant file of the data to be processed can be searched from the file library through the identification information of the data to be processed, and the file is called as a reference file of the external environment data. Therefore, the method and the device for searching the external environment data in the data to be processed search the relevant files of the external environment data in the data to be processed, and are beneficial to improving the efficiency and accuracy of obtaining the external generation files of the external environment data.

A2: and selecting an external generation file of the external environment data from the reference file based on the processing requirement.

The method for selecting the externally generated file based on the processing requirement is not limited, and the externally generated file corresponding to the processing type and the parameter information in the processing requirement can be searched from the reference file. Therefore, the accuracy of obtaining the externally generated file can be improved.

It should be noted that the sequence of searching the externally generated file based on the processing type and the parameter information is not limited, and the externally generated file may be synchronously executed or firstly searched based on the processing type and then searched based on the parameter information. If the number of the parameter information is greater than or equal to 2, the parameter information can be searched one by one based on the sequence of the parameter information. The order of the parameter information may determine the difference between the data to be processed and other data according to the dimension of the parameter information, and the like, which is not limited herein.

It is understood that, in step a1 and step a2, a reference file of the external environment data is first obtained from a file library stored in advance based on the identification information of the data to be processed. And selecting an external generation file of the external environment data from the reference file based on the processing requirement of the data to be processed. Therefore, the efficiency and the accuracy of obtaining the externally generated file can be improved.

S103: and acquiring target configuration information of the database in the local environment based on a pre-stored data source list and the connection information.

In the embodiment of the application, the data source list comprises information of a plurality of databases, and the information can be stored through Excel files, and each line in the list can correspond to one externally generated file. For example, there is an externally generated file with a suffix of. tdx for each row. The data source list is a file which is stored in advance manually and comprises configuration information of various servers in different types of electronic equipment. The different types of electronic devices may be electronic devices of different manufacturers, or may be electronic devices of different system types, or may be electronic devices used by different users, and the like, which are not limited herein. The list of data sources may be stored by the information management system described above or other storage location.

The electronic equipment in the local environment can be connected with the database corresponding to the external environment data through the target configuration information, and the electronic equipment corresponding to the local environment can acquire the external environment data in the database after connection, so that the success rate of acquiring the external environment data is improved, and the success rate of data processing is favorably improved.

The present application is not limited to the method for obtaining the target configuration information, and in a possible example, the step S103 includes the following steps B1 and B2, where:

b1: and searching a reference external generation file of the database in the local environment from a pre-stored data source list.

In the embodiment of the application, the reference external generation file is contained in the data source list, and the relevant information of the local environment connected to the database corresponding to the uploaded external environment data is recorded. The reference externally generated file may be found from a data source manifest based on the identification information of the local environment and the identification information of the database. The reference external generation file may include reference configuration information, which is configuration information when the local environment connects to a database corresponding to the external environment data, and the reference configuration information may refer to description of related information configured when the local environment connects to the database.

The data applications corresponding between generating the reference externally generated file and generating the externally generated file may be the same or different. For example, a data application corresponding to the reference external generation file is generated as a first application, and a data application corresponding to the external generation file is generated as a second application.

B2: and adjusting the connection information based on the reference configuration information of the database in the reference external generation file to obtain the target configuration information of the database in the local environment.

The database connected in the connection information corresponds to a local environment when data is uploaded before, and the local environment may be greatly different from the current local environment. Therefore, in the steps B1 and B2, the reference externally generated files of the database in the local environment are searched from the pre-stored data source list, and the connection information is adjusted based on the reference configuration information of the database in the reference externally generated files, so that the target configuration information suitable for connecting the database in the local environment can be obtained, which is beneficial to improving the success rate of database connection.

The present application does not limit the adjusting method of the reference configuration information, and in a possible example, the step B2 may include the following steps B21 to B24, where:

b21: and determining information to be modified and fixed information in the connection information.

In the embodiment of the present application, the fixed information may be understood as connection information that does not need to be modified, for example, a name of a database, a framework of the database, and the like. The information to be modified is connection information that needs to be modified according to the specific situation of the local environment, for example, an authentication mode of a user logging in a database, a type of file transmission, an SQL statement executed during connection, and the like.

The information to be modified and the fixed information in the connection information may be determined based on whether a user changes in the processing instruction, whether the authority of the processing level changes, whether a service supported by the electronic device in the local environment changes, and the like.

It is understood that if the user changes, the authentication method of the user logging in the database may change. Therefore, the authentication information in the connection information is the information to be modified. The information to be modified needs to be modified based on the changed authentication information of the user. The permissions of the user's processing level may be determined based on the user's job position and/or permissions of the data, and the like. If the authority of the processing level of the user is changed, the scope of the external environment data of the user may be different from that of the previous user. Therefore, the data authority information in the connection information is the information to be modified. The information to be modified needs to be modified based on the authority of the processing level of the user. If the services supported by the electronic device in the local environment change, the configuration information of the connected external environment may change. Therefore, the configuration information of the service in the connection information is the information to be modified. The information to be modified needs to be modified based on configuration information of services supported by the electronic device.

B22: and acquiring reference modification information corresponding to the information to be modified based on the reference configuration information of the database in the reference external generation file.

B23: and replacing the information to be modified with the reference modification information to obtain reference connection information corresponding to the connection information.

In the embodiment of the present application, the reference to the modification information may be understood as replacement information of the information to be modified. And replacing the information to be modified in the connection information with the reference modification information to obtain the modified connection information, namely the reference connection information. Therefore, the success rate of database connection can be improved by replacing the information to be modified in the connection information.

The reference configuration information may refer to a description of the connection information. The method for acquiring the reference modification information by the reference configuration information is not limited, and if the environment information of the local environment for generating the reference external generation file is consistent with the current environment information of the local environment, the reference modification information can be acquired directly based on the reference configuration information in the reference external generation file. The environment information of the local environment may include information of an electronic device used by the local environment. Such as the system, version, services available, etc. of the electronic device. The environment information of the local environment may alternatively include information of the network used by the local environment. Such as network address, network rate, network compatibility, etc. The environment information of the local environment may alternatively include information of the user being used. For example, identification information such as the name, job number, and account number of the user, authority to process data, the position of the user, and the like.

If the environment information of the local environment for generating the reference external generation file is inconsistent with the environment information of the current local environment, the consistent content can be searched, the rule of the inconsistent content is obtained, and the reference modification information is obtained according to the rule. Or obtain the reference modification information based on the configuration information preset by the inconsistent content, and the like, which is not limited herein.

B24: and converting the format of the reference connection information based on the format of the reference configuration information to obtain the target configuration information of the database in the local environment.

In the embodiment of the present application, the format of the reference configuration information may include a position of each sub information in the reference configuration information, a length (or byte) and a type of the sub information, and the like. For example, the format is defined as the first 1 byte for writing the identification information of the environment. The last 1 byte, used to write the network address. And the last 1 byte is used for writing the identification information of the database.

It can be understood that format conversion is performed on the reference connection information based on the format of the reference configuration information, so that the target configuration information format obtained through format conversion meets the preset format, the efficiency and the success rate of data analysis are improved, and the success rate of database connection is improved.

In steps B21 to B24, the fixed information and the information to be modified in the connection information are determined first. And then acquiring reference modification information corresponding to the information to be modified based on the reference configuration information of the database in the reference external generation file. And then, replacing the information to be modified with reference modification information to obtain reference connection information corresponding to the connection information, thereby realizing information updating. And format conversion is carried out on the reference connection information based on the format of the reference configuration information to obtain target configuration information suitable for connecting the database in the local environment, so that the success rate of database connection is improved.

S104: and uploading the external environment data to the database of the local environment based on the target configuration information, a preset interface and the access logic, so that the external environment data is processed by the electronic equipment corresponding to the local environment.

In this embodiment, the preset interface may be an application interface for front-end and back-end separation. For example, a presentation state transfer application interface (rest api) or the like. The preset interface may store a file of data alone or a storage location of data. Therefore, the file or the storage position containing the external environment data can be obtained from the database used for uploading the external environment data based on the preset interface.

It is understood that the electronic device corresponding to the local environment may be enabled to connect to a database for external environment data upload based on the target configuration information. And then, based on a preset interface and an access logic, external environment data can be acquired from a source database, and then the external environment data can be uploaded to a database of the local environment. Therefore, the electronic equipment corresponding to the local environment can process the external environment data in the database of the local environment.

In one possible example, after step S104, the method may further include the steps of: and processing the external environment data based on the processing type of the external environment data.

The process types, as previously described, may include development, testing, and production, or specific matters in development, testing, and production. It can be understood that different processing types have different processing manners, and in the embodiment of the present application, the external environment data is processed based on the processing type of the external environment data, so that the efficiency and the accuracy of data processing can be improved.

The following is exemplified by taking the type of process as a test, and in one possible example, after step S104, the following steps C1 to C3 may also be included, wherein:

c1: and acquiring a first test code and an application to be tested corresponding to the external environment data based on the processing requirement.

In the embodiment of the present application, the application to be tested refers to an application program that applies external environment data. That is, the main body corresponding to the data processing is the application to be tested. After the external environment data is obtained, the application to be tested may be tested based on the external environment data and the test code.

The first testing code is used for testing the application to be tested based on the external environment data. The method for acquiring the first test code is not limited in the present application, and the test code of the preset data to be processed may be acquired from the code library, and then the first test code corresponding to the external environment data may be selected from the test code. In one possible example, step C1 may include the following steps C11-C13, wherein:

c11: determining test logic for the external environment data based on the processing requirements.

In the embodiment of the application, the test logic is used for describing the test steps of the external environment data and the test algorithm of each test step. Based on the test logic and the external environment data, a test case and test code of the application to be tested can be generated.

C12: and if the application to be tested comprises an updating module and a non-updating module, acquiring a historical test code of the application to be tested.

In the embodiment of the present application, if there are different functional modules between an application to be tested and a historical test version of the application to be tested (an application to be tested obtained by performing a test last time), the application to be tested is referred to as an update module. Otherwise, it is referred to as a non-update module. Different functional modules refer to different types of functions or different methods for realizing the functions. That is to say, if a function is added to the application to be tested or an update is performed on a function, the functional module corresponding to the function is called an update module.

The historical test code is used for testing the application to be tested corresponding to the historical test version. That is, the historical test code is the last test code. The historical test code may be obtained from test codes of the application to be tested stored in the information management system or other systems.

C13: and modifying the historical test codes based on the test logic to obtain first test codes corresponding to the external environment data.

It is understood that in steps C11-C13, the test logic of the external environment data in the data to be processed is determined based on the processing requirement of the data to be processed. And if the application to be tested comprises an updating module and a non-updating module, acquiring a historical test code of the application to be tested. And modifying the historical test codes based on the test logic to obtain first test codes corresponding to the external environment data. Therefore, the efficiency and the accuracy of obtaining the first test code can be improved.

The method for modifying the historical test code is not limited in the present application, and in a possible example, the step C13 may include the following steps C131 to C135, where:

c131: and determining a first test logic corresponding to the updating module and a second test logic corresponding to the non-updating module in the test logics.

In this embodiment, the first test logic is a sub-test logic corresponding to the update module in the test logic. The second test logic is corresponding to the non-updating module in the test logic. It can be understood that, based on the data corresponding to the first test logic and the update module, a test case corresponding to the data and a test code corresponding to the data can be generated. And based on the second test logic and the data corresponding to the non-updated module, a test case corresponding to the data and a test code corresponding to the data can be generated.

C132: and acquiring a first sub-test code corresponding to the first test logic.

In this embodiment, the first sub-test code is a program for testing data corresponding to the first test logic. The method for obtaining the first sub-test code is not limited, and corresponding data and test steps can be determined based on the first test logic; and then determining the steps executed in parallel or the steps executed in series in the testing step. The steps executed in parallel can simultaneously determine the test codes corresponding to the steps. The step of serial execution may sequentially determine the corresponding test codes according to the order of serial execution. And finally, combining the obtained test codes to obtain a first sub-test code. Therefore, the efficiency and the accuracy of obtaining the first subtest code can be improved.

C133: and acquiring a second sub-test code corresponding to the second test logic from the historical test code.

It can be understood that the historical test code is a test code for testing the application to be tested last time, and the historical test code includes a test code of the second test logic corresponding to the non-updated module, which is referred to as a second sub-test code. The second sub-test code is obtained from the historical test code, so that the efficiency of the second sub-test code can be improved, and the efficiency of obtaining the first test code is improved.

C134: determining an association between the update module and the non-update module.

In an embodiment of the present application, the association relationship between the update module and the non-update module may include a relationship of data transmission between the update module and the non-update module, for example, an upstream-downstream relationship. Or a mapping relationship between data. If no data is transmitted between two modules, the association relationship may be referred to as a parallel relationship. The intimacy of the modules transmitting data is greater than that of the modules not transmitting data, and the association relationship is tighter. The association between the update module and the non-update module may alternatively include similarities in functionality between the update module and the non-update module, such that similar functionality and differing functionality may be obtained. The incidence relation may be determined based on the first test logic and the second test logic. Or the determination may be made based on the function types used by the update module and the non-update module, the processing method of data therein, and the like, which is not limited herein.

C135: and adjusting the first sub-test code and the second sub-test code based on the association relationship to obtain a first test code corresponding to the external environment data.

In the embodiment of the application, the relationship of data transmission and the mapping relationship of data between the updating module and the non-updating module can be obtained based on the association relationship, so that the sequence and the calling relationship in the codes corresponding to the data in the first sub-test code and the second sub-test code can be adjusted, or the algorithm of data processing is added. Therefore, the first test code obtained through adjustment can realize the test of the updating module and the non-updating module and the test between the updating module and the non-updating module, and is favorable for improving the comprehensiveness of the test.

It is understood that, in steps C131 to C135, corresponding sub-test codes are first obtained based on the sub-test logics corresponding to the updated module and the non-updated module in the test logic, respectively. And adjusting the sub-test codes based on the incidence relation between the updating module and the non-updating module to obtain first test codes corresponding to the external environment data. Therefore, the efficiency of obtaining the first test code and the test comprehensiveness are improved.

C2: and testing the application to be tested based on the first test code and the external environment data to obtain a test result.

C3: and uploading the test result to the file library based on the identification information.

It is to be understood that, in steps C1-C3, if the processing type of the data to be processed is the test, the first test code corresponding to the external environment data is obtained based on the processing requirement of the data to be processed. And then the application to be tested is tested based on the first test code and the external environment data, so that the testing efficiency and accuracy can be improved. And then uploading the test result to a file library based on the identification information of the external environment data. Therefore, when the external environment data is used next time, the test result of the external environment data can be checked, and the reusability of the data is improved.

In one possible example, the method further comprises: updating the externally generated file based on the test result to obtain a target file; and uploading the target file to the file library based on the identification information.

The method for updating the externally generated file is not limited, and the information of the test result can be increased. Such as the name of the application to be tested, the test scenario, the target configuration information, the expected execution results, the query variables, etc. The test scenario is used for describing a test flow. The expected execution result is an execution result expected by the externally generated data and may include an expected sub-execution result of each sub-test case. The query variables are used to query data records in the test process, which may include data involved in the test process, execution results, and the like. It can be understood that the externally generated file is updated based on the test result and uploaded to the file library, and the test result can be tracked, which is beneficial to improving the reusability of data.

In one possible example, the data to be processed further includes local environment data, the method further includes the following steps C4-C7, wherein:

c4: and acquiring a second test code corresponding to the local environment data based on the processing requirement.

In an embodiment of the application, the second test code is configured to test the application to be tested based on the local environment data. Reference may be made to the method for obtaining the first test code, which is not described herein again.

C5: and acquiring a data relation corresponding to the external environment data and the local environment data.

In the embodiment of the present application, the data relationship is used to describe a data relationship between the external environment data and the local environment data, and may include an upstream-downstream relationship or a parallel relationship, etc. The data relationship may be determined based on a test logic of the data to be processed, or may be determined based on data types of the external environment data and the local environment data, and the like, which are not limited herein.

C6: and adjusting the first test code and the second test code based on the data relationship to obtain a target test code corresponding to the external environment data and the local environment data.

In an embodiment of the present application, the target test code is used to test the external environment data and the local environment data to determine whether the processing requirements are met. Based on the data relationship, the order and the call relationship in the code corresponding to the data in the first test code and the second test code may be adjusted, or an algorithm for data processing may be added, which may refer to the description in step C135 and is not described herein again.

C7: and testing the application to be tested based on the target test code, the external environment data and the local environment data to obtain a test result.

It is understood that, in the step C1 and the steps C4 to C7, the first test code and the second test code corresponding to the local environment data and the external environment data are acquired, respectively. And adjusting the first test code and the second test code based on the data relationship between the local environment data and the external environment data to obtain a target test code. And then the application to be tested is tested based on the target test code, the local environment data and the external environment data, so that the accuracy of testing the data to be processed can be improved.

After obtaining the test result, the test result may be uploaded to the file library based on the identification information, i.e., step C3 is performed. Therefore, when the external environment data is used next time, the test result of the data to be processed can be checked, and the reusability of the data is improved.

In the method shown in fig. 1, after receiving a processing instruction of data to be processed, it is determined whether the data to be processed includes external environment data. And if so, acquiring an external generation file of the external environment data from a pre-stored file library based on the identification information of the external environment data. And then acquiring target configuration information of the database in the local environment based on the pre-stored data source list and the connection information in the external generation file. And uploading the external environment data to a database of the local environment based on the target configuration information, the preset interface and the access logic of the external environment data. As such, there is no need to reconfigure external environment data. And the external environment data is uploaded to the database of the local environment through data transmission, so that the electronic equipment corresponding to the local environment processes the data, and the convenience of data processing and the success rate of data processing are improved.

The method of the embodiments of the present application is set forth above in detail and the apparatus of the embodiments of the present application is provided below.

Referring to fig. 2, fig. 2 is a schematic structural diagram of a data transmission device according to the present application, and as shown in fig. 2, the data transmission device 200 includes:

the storage unit 201 is used for storing a data source list and a preset interface;

the communication unit 202 is configured to receive a processing instruction of data to be processed;

the processing unit 203 is configured to, if the to-be-processed data includes external environment data, obtain an external generation file of the external environment data from a pre-stored file library based on identification information of the external environment data, where the external generation file includes connection information of an external environment data upload database and access logic of the external environment data; acquiring target configuration information of the database in a local environment based on the data source list and the connection information; uploading the external environment data to the database of the local environment based on the target configuration information, the preset interface and the access logic, so that the external environment data is processed by the electronic equipment corresponding to the local environment.

In a possible example, the processing unit 203 is specifically configured to search the data source manifest for a reference externally generated file of the database in a local environment; and adjusting the connection information based on the reference configuration information of the database in the reference external generation file to obtain the target configuration information of the database in the local environment.

In a possible example, the processing unit 203 is specifically configured to determine information to be modified and fixed information in the connection information; acquiring reference modification information corresponding to the information to be modified based on the reference configuration information of the database in the reference external generation file; replacing the information to be modified with the reference modification information to obtain reference connection information corresponding to the connection information; and converting the format of the reference connection information based on the format of the reference configuration information to obtain the target configuration information of the database in the local environment.

In a possible example, the processing type of the data to be processed is a test, the processing instruction includes a processing requirement of the data to be processed, and the processing unit 203 is further configured to obtain a first test code and an application to be tested corresponding to the external environment data based on the processing requirement; testing the application to be tested based on the first test code and the external environment data to obtain a test result; and uploading the test result to the file library based on the identification information.

In one possible example, the processing unit 203 is specifically configured to determine a test logic of the external environment data based on the processing requirement; if the application to be tested comprises an updating module and a non-updating module, acquiring a historical test code of the application to be tested; and modifying the historical test codes based on the test logic to obtain first test codes corresponding to the external environment data.

In a possible example, the processing unit 203 is specifically configured to determine a first test logic corresponding to the updated module and a second test logic corresponding to the non-updated module in the test logic; acquiring a first sub-test code corresponding to the first test logic; acquiring a second sub-test code corresponding to the second test logic from the historical test code; determining an association relationship between the update module and the non-update module; and adjusting the first sub-test code and the second sub-test code based on the association relationship to obtain a first test code corresponding to the external environment data.

In a possible example, the data to be processed further includes local environment data, and the processing unit 203 is further configured to obtain, based on the processing requirement, a second test code corresponding to the local environment data; acquiring a data relationship between the external environment data and the local environment data; adjusting the first test code and the second test code based on the data relationship to obtain a target test code corresponding to the external environment data and the local environment data; testing the application to be tested based on the target test code, the external environment data and the local environment data.

For detailed processes executed by each unit in the data transmission apparatus 200, reference may be made to the execution steps in the foregoing method embodiments, which are not described herein again.

Referring to fig. 3, fig. 3 is a schematic structural diagram of a computer device according to an embodiment of the present disclosure. As shown in fig. 3, the computer device 300 includes a processor 310, a memory 320, a communication interface 330, and one or more programs 340. The processor 310, the memory 320, and the communication interface 330 are interconnected via a bus 350. The related functions implemented by the communication unit 202 shown in fig. 2 can be implemented by the communication interface 330, the related functions implemented by the storage unit 201 shown in fig. 2 can be implemented by the memory 320, and the related functions implemented by the processing unit 203 shown in fig. 2 can be implemented by the processor 310.

The one or more programs 340 are stored in the memory 320 and configured to be executed by the processor 310, the programs 340 including instructions for:

receiving a processing instruction of data to be processed;

In one possible example, in the aspect of obtaining the target configuration information of the database in the local environment based on the pre-stored data source list and the connection information, the program 340 is specifically configured to execute the following steps:

searching a reference external generation file of the database in a local environment from a pre-stored data source list;

and adjusting the connection information based on the reference configuration information of the database in the reference external generation file to obtain the target configuration information of the database in the local environment.

In a possible example, in terms of the adjusting the connection information based on the reference configuration information of the database in the reference externally-generated file to obtain the target configuration information of the database in the local environment, the program 340 is specifically configured to execute the following steps:

determining information to be modified and fixed information in the connection information;

acquiring reference modification information corresponding to the information to be modified based on the reference configuration information of the database in the reference external generation file;

replacing the information to be modified with the reference modification information to obtain reference connection information corresponding to the connection information;

and converting the format of the reference connection information based on the format of the reference configuration information to obtain the target configuration information of the database in the local environment.

In a possible example, the processing type of the data to be processed is a test, the processing instruction includes a processing requirement of the data to be processed, and after the external environment data is uploaded to the database of the local environment based on the target configuration information, a preset interface and the access logic, the program 340 is further configured to execute the following steps:

acquiring a first test code and an application to be tested corresponding to the external environment data based on the processing requirement;

testing the application to be tested based on the first test code and the external environment data to obtain a test result;

and uploading the test result to the file library based on the identification information.

In one possible example, in terms of obtaining the first test code corresponding to the external environment data based on the processing requirement, the program 340 specifically includes instructions for performing the following steps:

determining test logic for the external environment data based on the processing requirements;

if the application to be tested comprises an updating module and a non-updating module, acquiring a historical test code of the application to be tested;

and modifying the historical test codes based on the test logic to obtain first test codes corresponding to the external environment data.

In a possible example, in the aspect that the historical test code is modified based on the test logic to obtain the first test code corresponding to the external environment data, the program 340 is specifically configured to execute the following steps:

determining a first test logic corresponding to the updating module and a second test logic corresponding to the non-updating module in the test logics;

acquiring a first sub-test code corresponding to the first test logic;

acquiring a second sub-test code corresponding to the second test logic from the historical test code;

determining an association relationship between the update module and the non-update module;

and adjusting the first sub-test code and the second sub-test code based on the association relationship to obtain a first test code corresponding to the external environment data.

In one possible example, the pending data further includes local environment data, and the program 340 is further for executing the instructions of:

acquiring a second test code corresponding to the local environment data based on the processing requirement;

acquiring a data relationship between the external environment data and the local environment data;

adjusting the first test code and the second test code based on the data relationship to obtain a target test code corresponding to the external environment data and the local environment data;

testing the application to be tested based on the target test code, the external environment data and the local environment data.

Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for causing a computer to execute to implement part or all of the steps of any one of the methods described in the method embodiments, and the computer includes an electronic device and a server.

Embodiments of the application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform to implement some or all of the steps of any of the methods recited in the method embodiments. The computer program product may be a software installation package, the computer comprising an electronic device and a server.

It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art will also appreciate that the embodiments described in this specification are presently preferred and that no particular act or mode of operation is required in the present application.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, a division of a unit is merely a logical division, and an actual implementation may have another division, for example, at least one unit or component may be combined or integrated with another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may also be distributed on at least one network unit. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a hardware mode or a software program mode.

The integrated unit, if implemented in the form of a software program module and sold or used as a stand-alone product, may be stored in a computer readable memory. With such an understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a memory and includes several instructions for causing a computer (which may be a personal computer, a server, a network device, or the like) to execute all or part of the steps of the methods according to the embodiments of the present application. And the aforementioned memory comprises: various media capable of storing program codes, such as a usb disk, a read-only memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and the like.

The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A method of data transmission, comprising:

receiving a processing instruction of data to be processed;

2. The method of claim 1, wherein the obtaining target configuration information of the database in a local environment based on a pre-stored data source list and the connection information comprises:

3. The method of claim 2, wherein the adjusting the connection information based on the reference configuration information of the database in the reference externally generated file to obtain the target configuration information of the database in the local environment comprises:

4. The method according to any one of claims 1-3, wherein the processing type of the data to be processed is a test, the processing instruction includes a processing requirement of the data to be processed, and after the uploading the external environment data into the database of the local environment based on the target configuration information, a preset interface and the fetch logic, the method further comprises:

5. The method of claim 4, wherein obtaining the first test code corresponding to the external environment data based on the processing requirement comprises:

6. The method of claim 5, wherein modifying the historical test code based on the test logic to obtain a first test code corresponding to the external environment data comprises:

acquiring a first sub-test code corresponding to the first test logic;

and adjusting the first sub-test code and the second sub-test code based on the incidence relation to obtain a first test code corresponding to the external environment data.

7. The method of claim 4, wherein the data to be processed further comprises local environment data, the method further comprising:

and testing the application to be tested based on the target test code, the external environment data and the local environment data to obtain a test result.

8. A data transmission apparatus, comprising:

the storage unit is used for storing a data source list and a preset interface;

9. A computer device comprising a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps of the method of any of claims 1-7.

10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, the computer program causing a computer to execute to implement the method of any one of claims 1-7.