CN117424855A - Method, device, storage medium and equipment for generating supplementary traffic - Google Patents

Abstract

This application provides methods, devices, storage media and equipment for generating supplementary flow, including: obtaining the pressure measurement flow format and original flow data; converting the original flow data into supplementary flow according to the pressure measurement flow format; converting the supplementary flow The traffic is uploaded to the preset interface of the stress testing platform and the stress testing task is performed. Generating supplementary traffic data based on historical traffic data eliminates the manual operation of writing supplementary traffic data, improves the data generated by supplementary traffic, and makes the stress test results closer to the real state.

Description

Supplementary traffic generation methods, devices, storage media and equipment

Technical field

The invention relates to the field of platform testing, and specifically to methods, devices, storage media and equipment for supplementary traffic generation.

Background technique

E-commerce systems are prone to face rapid increases in traffic during product promotions. In order to ensure that the e-commerce system can access normally when a large amount of traffic occurs in a short period of time, the e-commerce system needs to be stress tested. Stress testing refers to testing conducted under conditions of high concurrency and large traffic. Testers can observe the performance of the system under peak traffic load to find potential performance risks in the system. Stress testing is a common way to discover problems in the system, and it is also an important means to ensure system availability and stability.

For stress testing tasks, the stress testing platform generally captures traffic to implement stress testing. If no traffic is captured or the captured traffic is insufficient for the stress testing task, additional traffic needs to be performed. The existing supplementary traffic is uploaded to the stress testing platform by manually filling in the flow information according to the reissue traffic requirements, resulting in a large amount of manual processing data and low efficiency.

Contents of the invention

Based on this, the present invention provides methods, devices, storage media and equipment for generating supplementary flow, and automatically supplements flow data to implement pressure testing and improve the efficiency of supplementary flow.

In a first aspect, the present invention provides a method for supplementary traffic generation, including:

Obtain the pressure test flow format and original flow data;

Convert the original flow data into supplementary flow according to the pressure measurement flow format;

Upload the supplementary traffic to the preset interface of the stress testing platform and perform the stress testing task.

Wherein, the format for obtaining pressure measurement flow includes:

Pull the existing traffic information of the pressure testing platform, and extract the pressure testing traffic format based on the traffic information;

Or create a stress test traffic format based on the traffic information attributes required by the stress test task.

Among them, the acquisition of original traffic data includes:

Randomly pull several pieces of historical traffic data from the database as original traffic data;

Or randomly pull several pieces of historical data from the business intelligence system as original traffic data.

Wherein, converting the original flow data into supplementary flow according to the pressure measurement flow format includes:

Obtain traffic information attributes according to the pressure measurement traffic format;

Obtain necessary information in the original traffic data according to the traffic information attributes;

Arrange the necessary information according to the pressure measurement flow format to obtain the supplementary flow rate.

Wherein, obtaining the necessary information in the original traffic data according to the traffic information attributes includes:

Set one or more mark symbols according to the traffic information attribute;

The original traffic data is segmented using the mark symbols to obtain one or more necessary information.

Wherein, uploading the supplementary traffic to a preset interface of the stress testing platform and performing the stress testing task includes:

Upload the supplementary traffic to the preset interface of the stress testing platform;

Receive concurrent requests for stress testing tasks, and send a set amount of supplementary traffic based on the concurrent requests.

Furthermore, after receiving concurrent requests for stress testing tasks, it also includes:

Obtain verification information according to the concurrent request;

Set corresponding decoding information in the supplementary traffic according to the verification information;

When performing a stress test task, the decoding information in the supplementary traffic is verified based on the verification information.

In a second aspect, the present invention also provides a device for supplementing traffic generation, including:

Data acquisition module, used to obtain pressure measurement flow format and original flow data;

A flow replacement module, used to convert the original flow data into supplementary flow according to the pressure test flow format;

The traffic upload module is used to upload the supplementary traffic to the preset interface of the stress testing platform and perform stress testing tasks.

In a third aspect, the present invention provides a computer-readable storage medium on which a computer program is stored, and when executed by a processor, the computer program implements the steps of any one of the supplementary traffic generation methods in the first aspect.

In a fourth aspect, the present invention provides a computer device, including a memory and a processor. The memory stores a computer program. When the processor executes the computer program, it performs any one of the supplementary traffic generation methods in the first aspect. .

The beneficial effects of adopting the above technical solution are: the method for generating supplementary flow in pressure testing of the present invention can prepare supplementary flow according to the predetermined pressure measurement flow format, without the need to manually continuously write supplementary flow data, improve efficiency and make the pressure measurement effect closer actual.

Description of the drawings

In order to more clearly explain the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to describe the embodiments or the prior art will be briefly introduced below.

Figure 1 is a schematic diagram of a method for generating supplementary traffic in an embodiment of the present application;

Figure 2 is a schematic diagram of a device for supplementing traffic generation in an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention. In order to describe the present invention in more detail, the method, device, storage medium and equipment for supplementary traffic generation provided by the present invention will be described in detail below with reference to the accompanying drawings.

Embodiments of the present application provide an application scenario for the method of supplementing traffic generation. The application scenario includes the terminal device provided by the embodiment. The terminal device includes but is not limited to a smart phone and a computer device. The computer device may be a desktop computer or a portable computer. , at least one of a laptop computer, a mainframe computer, a tablet computer, and other devices. The user operates the terminal device to obtain the classification of the attack information. For the specific process, please refer to the method embodiment of supplementary traffic generation.

Stress testing is to test the performance problems of the e-commerce system when a large amount of traffic increases, and to avoid performance problems before new system functions are launched or specific promotions are launched. Stress testing requires setting up a test environment with the same functions as the formal environment, and importing or generating a batch of test traffic data. Since the stress test requires a large amount of test traffic to be input into the e-commerce system, the stress testing platform needs to supplement the traffic if it does not capture the traffic or does not capture enough traffic.

In order to ensure that the stress test effect is close to the actual effect and avoid the difference between the built test environment and the formal environment, the traffic selected for the stress test is mostly existing online data and existing online environment.

Based on this, embodiments of the present invention provide a method for generating supplementary traffic, which is explained by taking the method as applied to a terminal device as an example, with reference to the schematic diagram of the method for generating supplementary traffic shown in FIG. 1 .

Step S101: Obtain the pressure measurement flow format and original flow data.

For the generation of supplementary traffic in a stress test, it is first necessary to clarify what data attributes the traffic data needs for the stress test, so the stress test traffic format needs to be obtained; secondly, in order to make the stress test environment and data closer to the formal environment or real environment, Selecting the historical traffic data of this system or adapting it from the historical traffic data of other similar systems can make the supplementary traffic more realistic and improve the reliability of the test.

First of all, there are two ways to obtain the pressure measurement traffic format in different scenarios, namely:

When performing a stress test task for the existing functions of the existing system, the existing flow information of the stress testing platform is pulled, and the stress testing flow format is extracted based on the flow information.

When performing a stress test task for new functions of an existing system or functions of a new system, create a stress test flow format based on the flow information attributes required by the stress test task.

Among them, in the embodiment of this application, the pressure measurement traffic format is a standard and internally nested JSON format.

Secondly, there are two ways to obtain original traffic data based on different data sources for obtaining traffic data, which are:

Randomly pull several pieces of historical traffic data from the database as original traffic data.

The historical traffic data of the existing system or the historical traffic data of similar systems are regularly stored in the database. According to the stress test task, several pieces of historical traffic data that meet the requirements are pulled as the original traffic data. The amount of historical traffic data pulled is set according to the requirements of the stress test task.

Or, randomly pull several pieces of historical data from the business intelligence system as original traffic data.

The user access information of the existing system is stored in the business intelligence system in the form of a data table. According to the stress test task, several corresponding pieces of historical data, that is, the user access information, are pulled as the original traffic data. The amount of user access information pulled is set according to the requirements of the stress test task.

Step S102: Convert the original flow data into supplementary flow according to the pressure test flow format.

Since the raw traffic data is pulled from multiple different databases or business intelligence systems, there is a possibility that the formats of the pulled raw traffic data are different or that the raw traffic data is incompatible with the supplementary traffic format required by the stress testing task. In order to To match the pulled raw traffic data with the supplementary traffic format required by the stress testing task, the format of the raw traffic data needs to be converted.

Specifically, step S102 describes converting the original flow data into supplementary flow according to the pressure test flow format, including:

Step S201: Obtain traffic information attributes according to the pressure measurement traffic format.

According to the stress test traffic format, the traffic information attributes contained in the supplementary traffic to be generated can be determined. For example, the supplementary traffic corresponding to the user login function contains the user's identity certificate.

Step S202: Obtain necessary information in the original traffic data according to the traffic information attributes.

Since the original traffic data may contain information data that is irrelevant to the generation of supplementary traffic or information data that does not need to be replaced, in this regard, it is only necessary to extract the necessary information from the original traffic data according to the traffic information attributes.

In order to better process the necessary information, embodiments of the present application can also store the extracted necessary information in the form of a collection, making it easier to subsequently convert it into supplementary traffic in JSON format.

Step S203: Arrange the necessary information according to the pressure test flow format to obtain the supplementary flow rate.

Extract information one by one from the collection of necessary information, arrange it according to the stress test traffic format, and generate supplementary traffic. In this embodiment, the necessary information is extracted one by one from the collection and written in JSON format line by line to obtain the required supplementary traffic.

Among them, obtaining the necessary information in the original traffic data according to the traffic information attributes in the above-mentioned step S202 includes:

Step S301: Set one or more mark symbols according to the traffic information attributes.

Specifically, the original traffic data contains one or more traffic information attributes, and mark symbols are used to separate the information of different attributes. The mark symbols may be in the form of commas, spaces, or \r or \n.

Step S302: Use the mark symbols to segment the original traffic data to obtain one or more necessary information.

Step S103: Upload the supplementary traffic to the preset interface of the stress testing platform and perform the stress testing task.

Specifically, in step S103, the supplementary traffic is uploaded to the preset interface of the stress testing platform and the stress testing task is performed, including:

Step S401: Upload the supplementary traffic to the preset interface of the stress testing platform.

Step S402: Receive a concurrent request for a stress testing task, and send a set amount of supplementary traffic through the preset interface according to the concurrent request.

Among them, since the supplementary traffic during the stress test process is generally a large amount of data, and the concurrent requests of the stress test task limit the amount of test traffic, when receiving concurrent requests, the supplementary traffic will be calculated based on the set number of concurrent requests. Split it and send supplementary traffic through the interface one by one according to the set batches.

Furthermore, when the stress test task is executed based on the supplementary traffic, the corresponding monitoring system can be used to check the traffic request situation and data concurrency to determine whether the stress test task is executed normally.

In addition, in the above supplementary traffic generation method, after receiving the concurrent request of the stress testing task, step S402 also includes:

Obtain verification information according to the concurrent request;

Set corresponding decoding information in the supplementary traffic according to the verification information;

When performing a stress test task, the decoding information in the supplementary traffic is verified based on the verification information.

Sending supplementary traffic requires calling some interfaces. In order to improve the security of the interface calling process, the verification of the first verification information and the second verification information can be added to improve security.

In addition, for the supplementary traffic uploaded to the preset interface, you can also set up escape format check and exception check, respectively to check whether the data that needs to be escaped marked conforms to the escape processing, and to perform the stress test task on the supplementary traffic if there are exceptions or errors. Reminders or logging.

Through the above method, corresponding supplementary traffic can be automatically generated based on online historical traffic information to perform stress testing tasks. No more additional configuration is required, and supplementary traffic generation is more efficient and the results of the stress test are closer. on real data.

It should be understood that although the various steps in the flow chart of FIG. 1 are shown in sequence as indicated by the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order in which these steps are performed and these steps can be performed in any other order. Moreover, at least some of the steps in Figure 1 may include multiple sub-steps or sub-stages. These sub-steps or stages are not necessarily executed at the same time, but may be executed at different times. The execution order of these sub-steps or stages is It does not necessarily have to be performed sequentially, but can be performed in turn or alternately with other steps or sub-steps of other steps or at least part of the stages.

The above-mentioned embodiments disclosed by the present invention describe in detail the method of generating supplementary traffic. The above-mentioned method disclosed by the present invention can be implemented by various forms of equipment. Therefore, the present invention also discloses a device for generating supplementary flow corresponding to the above-mentioned method. In combination with Figure 2, specific embodiments are given below for detailed description.

The data acquisition module 501 is used to obtain the pressure test flow format and original flow data.

The flow replacement module 502 is used to convert the original flow data into supplementary flow according to the pressure test flow format.

The traffic upload module 503 is used to upload the supplementary traffic to the preset interface of the stress testing platform and perform stress testing tasks.

Regarding the specific limitations on the device for generating supplementary flow, please refer to the limitations on the method above, and will not be repeated here. Each module in the above device can be implemented in whole or in part by software, hardware and combinations thereof. Each of the above modules can be embedded in or independent of the processor of the terminal device in the form of hardware, or can be stored in the memory of the terminal device in the form of software so that the processor can call and execute operations corresponding to each of the above modules.

In one embodiment, the present invention also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the method for supplementary traffic generation are implemented.

The computer-readable storage medium may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM (Erasable Programmable Read-Only Memory), hard disk, or ROM. Optionally, the computer-readable storage medium includes non-transitory computer-readable storage medium (non-transitory computer-readable storage medium). The computer-readable storage medium has storage space for program codes that perform any method steps in the above methods. These program codes can be read from or written into one or more computer program products, and the program codes can be compressed in an appropriate form.

In one embodiment, the present invention provides a computer device including a memory and a processor. The memory stores a computer program. When the processor executes the computer program, the above-mentioned method for generating supplementary traffic is performed.

The computer device includes a memory, a processor, and one or more computer programs, wherein the one or more computer programs may be stored in the memory and configured to be executed by the one or more processors, and the one or more application programs may be configured Methods for performing supplemental traffic generation described above.

A processor may include one or more processing cores. The processor uses various interfaces and lines to connect various parts of the entire computer device, and executes various functions of the computer device by running or executing instructions, programs, code sets or instruction sets stored in the memory, and calling data stored in the memory. functions and process data. Optionally, the processor can use at least one of digital signal processing (Digital Signal Processing, DSP), field-programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). implemented in hardware form. The processor may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a point data reporting verifier (Graphics Processing Unit, GPU), a modem, etc. Among them, the CPU mainly handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the display content; and the modem is used to handle wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor and may be implemented solely through a communication chip.

The memory may include random access memory (RAM) or read-only memory (Read-Only Memory). Memory may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory may include a program storage area and a data storage area, where the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions, etc. used to implement each of the above method embodiments. The storage data area can also store data created by the terminal device during use.

The above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions of the foregoing embodiments. The recorded technical solutions may be modified, or some of the technical features thereof may be equivalently replaced; however, these modifications or substitutions shall not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of each embodiment of the present invention.

Claims (10)

1. A method for supplementing traffic generation, characterized by including: Obtain the pressure test flow format and original flow data; Convert the original flow data into supplementary flow according to the pressure measurement flow format; Upload the supplementary traffic to the preset interface of the stress testing platform and perform the stress testing task. 2. The method for generating supplementary traffic as claimed in claim 1, wherein the obtaining the pressure measurement traffic format includes: Pull the existing traffic information of the pressure testing platform, and extract the pressure testing traffic format based on the traffic information; Or create a stress test traffic format based on the traffic information attributes required by the stress test task. 3. The method of supplementary traffic generation according to claim 1, characterized in that said obtaining original traffic data includes: Randomly pull several pieces of historical traffic data from the database as original traffic data; Or randomly pull several pieces of historical data from the business intelligence system as original traffic data. 4. The method for generating supplementary flow as claimed in claim 1, wherein converting the original flow data into supplementary flow according to the pressure measurement flow format includes: Obtain traffic information attributes according to the pressure measurement traffic format; Obtain necessary information in the original traffic data according to the traffic information attributes; Arrange the necessary information according to the pressure measurement flow format to obtain the supplementary flow rate. 5. The method of supplementary traffic generation according to claim 4, wherein said obtaining necessary information in said original traffic data according to said traffic information attributes includes: Set one or more mark symbols according to the traffic information attribute; The original traffic data is segmented using the mark symbols to obtain one or more necessary information. 6. The method for generating supplementary traffic as claimed in claim 1, wherein uploading the supplementary traffic to a preset interface of a stress testing platform and performing a stress testing task includes: Upload the supplementary traffic to the preset interface of the stress testing platform; Receive concurrent requests for stress testing tasks, and send a set amount of supplementary traffic based on the concurrent requests. 7. The method for supplementary traffic generation according to claim 6, characterized in that after receiving concurrent requests for stress testing tasks, it further includes: Obtain verification information according to the concurrent request; Set corresponding decoding information in the supplementary traffic according to the verification information; When performing a stress test task, the decoding information in the supplementary traffic is verified based on the verification information. 8. A device for supplementing traffic generation, characterized in that it includes: Data acquisition module, used to obtain pressure measurement flow format and original flow data; A flow replacement module, used to convert the original flow data into supplementary flow according to the pressure test flow format; The traffic upload module is used to upload the supplementary traffic to the preset interface of the stress testing platform and perform stress testing tasks. 9. A computer-readable storage medium with a computer program stored thereon, characterized in that, when executed by a processor, the computer program implements the steps of the method for generating supplementary traffic in any one of claims 1-7. 10. A computer device, including a memory and a processor, the memory stores a computer program, characterized in that when the processor executes the computer program, it executes any one of claims 1-7 to supplement traffic generation. method.