[go: up one dir, main page]

CN108572914B - Method and device for generating log for pressure test - Google Patents

Method and device for generating log for pressure test Download PDF

Info

Publication number
CN108572914B
CN108572914B CN201810211537.0A CN201810211537A CN108572914B CN 108572914 B CN108572914 B CN 108572914B CN 201810211537 A CN201810211537 A CN 201810211537A CN 108572914 B CN108572914 B CN 108572914B
Authority
CN
China
Prior art keywords
log
logs
master
generating
main
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810211537.0A
Other languages
Chinese (zh)
Other versions
CN108572914A (en
Inventor
陈凌宇
曹铁铮
谢成锦
胡斌
陈地树
孟涛
王小冬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koubei Shanghai Information Technology Co Ltd
Original Assignee
Koubei Shanghai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koubei Shanghai Information Technology Co Ltd filed Critical Koubei Shanghai Information Technology Co Ltd
Priority to CN201810211537.0A priority Critical patent/CN108572914B/en
Publication of CN108572914A publication Critical patent/CN108572914A/en
Application granted granted Critical
Publication of CN108572914B publication Critical patent/CN108572914B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Prevention of errors by analysis, debugging or testing of software
    • G06F11/3668Testing of software
    • G06F11/3672Test management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The application discloses a method for generating logs for stress test, which generates a required number of log groups, and each log group is generated by adopting the following method: generating a preset number of main logs based on an existing log topology model, wherein each main log records corresponding main log information and a main log identifier, and the main log identifiers of the main logs have an association relationship; generating an associated log associated with each main log according to the association relationship between each main log represented by the log topology model and each type of associated log; each associated log record has corresponding associated log information and a corresponding associated log identifier, and the associated log identifier of each associated log has an association relation with the master log identifier of the associated master log. Therefore, the technical scheme is convenient for inquiring the log of the relevant processing error when the generated log for the pressure test is used for the pressure test and the equipment in the network system has an operation error.

Description

Method and device for generating log for pressure test
Technical Field
The application relates to a method for generating a log, in particular to a method for generating a log for a stress test, and also relates to a stress test method. The application also relates to a device for generating a pressure test. The present application additionally relates to an electronic device for generating a pressure test, and a computer-readable storage medium.
Background
Network systems typically process a large amount of data during certain time periods, for example, network sales platforms process a large amount of data related to orders and calculate related statistics during the large sales activities. If the network system is not configured properly, the devices in the network system may operate incorrectly in the face of processing pressure of a large amount of data, which may adversely affect the production of life. In order to prevent the devices in the network system from operating incorrectly when facing a large amount of data processing pressure, it is usually necessary to know what the maximum data pressure the network system can bear, so that the network system operates under the maximum data pressure, or network devices may be added appropriately according to the data processing pressure that may be faced, so as to make up for the shortage of the data processing capability of the current network device. In any case, it is always necessary to know the maximum data processing pressure that the current network system can bear, which usually needs to be obtained through pressure test.
In the prior art, the network system can be tested by generating data through a large amount of actual equipment, but the testing method is reliable, but is difficult to organize a large-scale quantity for testing, and the cost is high. In addition, when a pressure test is usually performed, a large amount of data for the pressure test is generated by a pressure test tool, then the generated large amount of data is used as input data of the device to be tested, and the maximum capability of the device to be tested for processing the data is obtained by monitoring the operation condition of the device to be tested. However, the prior art still fails to provide a more feasible log generation method for recording data.
The method for generating logs for stress test in the prior art has the main defects that although the association exists between the master logs and the association logs, the association logs of different master logs do not exist in association, and thus when the stress test is performed by using the logs and an operation error occurs, the logs with processing errors cannot be quickly and accurately traced. In addition, in the conventional technique, when a log for stress test is generated, some types of related logs are also generated, but it is difficult to generate a related log which more reliably simulates behavior data in an actual scene, for example, a log which records data having hot-spot property (a large number of occurrences and a large occurrence probability).
Disclosure of Invention
The application provides a method for generating a log for pressure test, which aims to solve the technical problem that the log with the processing error cannot be traced quickly and accurately when the log is used for pressure test and the operation error occurs in the prior art. In addition, the method and the device aim to solve the technical problem that when the logs for the stress test are generated in the prior art, the associated logs which simulate behavior data in an actual scene more practically are difficult to generate.
The application provides a method for generating logs for stress test, generating a required number of log groups, and generating each log group by adopting the following mode: generating a preset number of main logs based on an existing log topology model, wherein each main log records corresponding main log information and a main log identifier, and the main log identifiers of the main logs have an association relationship; generating an associated log associated with each main log according to the association relationship between each main log represented by the log topology model and each type of associated log; each associated log record has corresponding associated log information and a corresponding associated log identifier, and the associated log identifier of each associated log has an association relation with the master log identifier of the associated master log.
Optionally, the log topology model includes a preset number of master logs and associated logs respectively associated with one master log, and the master logs have an association relationship with each other; the master logs and the associated logs are nodes of the topology model, and the association relationship among the master logs, the association relationship between the master logs and the associated logs are the connection relationship among the nodes of the topology model; and the association relations are recorded through the log identifiers of the master log and the association log.
Optionally, the log topology model is generated by performing the following steps: analyzing the relationship among the logs according to the information recorded in the logs for recording the operations of the user; determining a preset number of main logs, associated logs respectively associated with each main log and an association relationship among the main logs according to the relationship among the logs; the master logs and the associated logs are nodes of the topology model, and the association relationship among the master logs, the association relationship between the master logs and the associated logs are the connection relationship among the nodes of the topology model; and the association relations are recorded through the log identifiers of the master log and the association log.
Optionally, the master log identifiers of the master logs have an association relationship, and the association log identifier of each association log has an association relationship with the master log identifier of the associated master log, where the association relationship is specifically that the log identifiers are the same.
Optionally, the logs of each log group of the logs for stress testing have a stress identification recognizable as stress test data.
Alternatively, the log identification uses an identification having a specific meaning.
Optionally, in the step of generating an associated log associated with each master log, the associated log fields of the respective record types mapped by each master log are randomly generated based on ratios in all the associated log fields preset for the associated log fields of each record type.
Optionally, one or some fields with range limits recorded in the associated log information are generated by performing the following steps: reading a pre-loaded target dimension table; and selecting a certain or some selectable values from the selectable range of the target dimension table to the related field record as the field value of the field in the associated log information.
Optionally, the field value selected in the dimension table satisfies a probability distribution rule of a preset kurtosis coefficient.
Optionally, the selectable values in the dimension table include any one of the following types of data: activity identification information data, user address information data.
Optionally, if a certain field or some fields in the associated log information is an enumeration type, the field value is selected and determined in a preset determination manner from a predetermined enumeration value selection range.
Optionally, if one or some fields in the associated log information are of a rule type, the field value is generated according to a predetermined rule.
Optionally, the required number of log groups is generated, where the number of log groups is generated at a preset rate in a time dimension.
Optionally, the required number of log groups is generated, where the number of log groups is limited within a predetermined number range according to the time dimension.
The application also provides a method for performing stress test according to the log generated by the method, which comprises the following steps:
determining corresponding data interaction processes of the client and the server according to the incidence relation between each main log and the corresponding associated log in each log group and the recorded information; generating corresponding script statements by using a script function according to the determined corresponding data interaction process of the client and the server; generating a corresponding process or thread according to the corresponding script statement; and acquiring target performance data of the equipment to be tested.
The present application also provides an apparatus for generating a log for stress testing, the apparatus comprising: the log generating unit is configured to generate a preset number of master logs based on an existing log topology model, each master log records corresponding master log information and master log identification, and the master log identifications of the master logs have an association relationship; the associated log generation unit is configured to generate an associated log associated with each master log according to the association relationship between each master log represented by the log topology model and each type of associated log; each associated log record has corresponding associated log information and a corresponding associated log identifier, and the associated log identifier of each associated log has an association relation with the master log identifier of the associated master log.
Optionally, the apparatus further comprises: the analysis unit is configured to analyze the relationship among the logs according to the information recorded in the existing logs for recording the operations of the user; the association relation determining unit is configured to determine a preset number of main logs, association logs respectively associated with each main log and association relations among the main logs according to relations among the logs; the master logs and the associated logs are nodes of the topology model, and the association relationship among the master logs, the association relationship between the master logs and the associated logs are the connection relationship among the nodes of the topology model; and the association relations are recorded through the log identifiers of the master log and the association log.
Optionally, the master log generating unit further includes: and the associated log field generating subunit is configured to randomly generate the associated log fields of the respective record types mapped by each master log based on the ratios in all the associated log fields preset for the associated log fields of each record type.
Optionally, the master log generating unit further includes: the target dimension table reading subunit is configured to read a preloaded target dimension table; and the field value selection subunit is configured to select a certain or some selectable values from the selectable range of the target dimension table for the relevant field record, and select the certain or some selectable values as the field values of the fields in the associated log information.
The present application further provides a device for performing a stress test on a log generated according to the above device, comprising: the interactive process determining unit is configured to determine a corresponding data interactive process between the client and the server according to the incidence relation between each main log and the corresponding associated log in each log group and the recorded information; the script statement generating unit is configured to generate a corresponding script statement by using a script function according to the determined corresponding data interaction process of the client and the server; the process or thread generating unit is configured to generate a corresponding process or thread according to the corresponding script statement; and the target performance data acquisition unit is configured to acquire target performance data of the equipment to be tested.
Optionally, the apparatus further comprises: the analysis unit is configured to analyze the relationship among the logs according to the information recorded in the existing logs for recording the operations of the user; the association relation determining unit is configured to determine a preset number of main logs, association logs respectively associated with each main log and association relations among the main logs according to relations among the logs; the master logs and the associated logs are nodes of the topology model, and the association relationship among the master logs, the association relationship between the master logs and the associated logs are the connection relationship among the nodes of the topology model; and the association relations are recorded through the log identifiers of the master log and the association log.
Optionally, the master log generating unit further includes: and the associated log field generating subunit is configured to randomly generate the associated log fields of the respective record types mapped by each master log based on the ratios in all the associated log fields preset for the associated log fields of each record type.
Optionally, the master log generating unit further includes: the target dimension table reading subunit is configured to read a preloaded target dimension table; and the field value selection subunit is configured to select a certain or some selectable values from the selectable range of the target dimension table for the relevant field record, and select the certain or some selectable values as the field values of the fields in the associated log information.
The present application also provides a device for performing a stress test on a log generated by the above device for generating a log for a stress test, including: the interactive process determining unit is configured to determine a corresponding data interactive process between the client and the server according to the incidence relation between each main log and the corresponding associated log in each log group and the recorded information; the script statement generating unit is configured to generate a corresponding script statement by using a script function according to the determined corresponding data interaction process of the client and the server; the process or thread generating unit is configured to generate a corresponding process or thread according to the corresponding script statement; and the target performance data acquisition unit is configured to acquire target performance data of the equipment to be tested.
The present application further provides an electronic device for generating a log for stress testing, the electronic device comprising: a display; a processor; a memory for storing a program for scheduling retries, which when read executed by the processor performs the following: generating a required number of log groups, wherein each log group is generated in a mode that a preset number of main logs are generated based on an existing log topological model, each main log records corresponding main log information and main log identification, and the main log identification of each main log has an association relation; generating an associated log associated with each main log according to the association relationship between each main log represented by the log topology model and each type of associated log; each associated log record has corresponding associated log information and a corresponding associated log identifier, and the associated log identifier of each associated log has an association relation with the master log identifier of the associated master log.
The present application also provides a computer-readable storage medium having stored thereon a program for generating a log for stress testing, the program, when read and executed by a processor, performs the operations of: generating a required number of log groups, wherein each log group is generated in a mode that a preset number of main logs are generated based on an existing log topological model, each main log records corresponding main log information and main log identification, and the main log identification of each main log has an association relation; generating an associated log associated with each main log according to the association relationship between each main log represented by the log topology model and each type of associated log; each associated log record has corresponding associated log information and a corresponding associated log identifier, and the associated log identifier of each associated log has an association relation with the master log identifier of the associated master log.
Compared with the prior art, the invention has the following advantages: besides that each master log in the master log set records the identification of the master log set, each type of associated log mapped by each master log is also associated with the identification of the master log set of the corresponding master log, so that the master log associated with the master log, the associated log associated with the master log and the associated log mapped by the associated master log can be queried through any master log. According to the scheme, when the generated log for pressure test is used for pressure test and equipment in the network system runs wrongly, the log with relevant processing errors is inquired; by adopting the technical scheme, reasonable association relation between logs can be obtained according to existing data, so that more reasonable pressure measurement data are set, and the pressure measurement effect is improved.
Drawings
FIG. 1 is a process flow diagram of one embodiment of a method of generating a log for stress testing as provided herein;
FIG. 2 is a process flow diagram of one embodiment of a method provided herein for stress testing logs generated in accordance with the method shown in FIG. 1;
FIG. 3 is a diagram illustrating an embodiment of a log group generated according to the method of generating logs for stress testing illustrated in FIG. 1.
FIG. 4 is a schematic structural diagram of an embodiment of an apparatus for generating a log for stress testing provided by the present application.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of embodiments in many different forms than those described herein and is therefore not limited to the specific embodiments disclosed below since those skilled in the art will be able to apply this application without departing from the spirit and scope of the present invention.
Fig. 1 shows a process flow diagram of an embodiment of a method for generating a log for stress testing provided by the present application, and fig. 3 shows a schematic diagram of an embodiment of a log group generated according to the method for generating a log for stress testing shown in fig. 1. The method for generating the log for the stress test provided by the present application is described in detail below with reference to fig. 1 and 3.
The method of generating a log for stress testing shown in fig. 1, comprising the steps of:
step S101, a required number of log groups are generated, and each log group is generated in the following manner: based on the existing log topology model, a preset number of main logs are generated, each main log records corresponding main log information and main log identification, and the main log identification of each main log has an association relationship.
The 'topological model' refers to a method for researching points and lines which are irrelevant to size and shape in topology, a research object is abstracted into one point, a mapping relation between the points is abstracted into one line, and a geometric figure formed by the points and the line is the topological model.
The "log" refers to a record in which data information is recorded, such as a log in which "order information" is recorded, and a log in which "payment information" is recorded. The logs are generally recorded in log files, and a log file usually contains several logs recorded in a certain client or a certain server. In the general context, a log file is often referred to as a log, and a particular log of log files is referred to as a log record. In this document, a particular log record is referred to by the name of the log.
Logs in the same file or different files can have an association relationship; and forming a log group by a plurality of logs with the association relationship. For example, in a network platform shopping scenario, with various operation requests of a user, the server may also perform various corresponding operations and generate a log group for recording the operation data. In general, the generated logs mainly include an "order log" (e.g., daily shopping order of the user) recorded with order details, an "item detail log" (e.g., log describing detailed introduction of date and usage of the item, etc.), a "terminal log" generated with the order (e.g., log describing type of terminal device, which may be a mobile phone terminal, a tablet computer terminal, a computer terminal), a "payment log" of the user (e.g., log describing payment time, payment amount, etc.), a "payment terminal log" of the user (e.g., log describing type of payment terminal, which may be a mobile phone terminal, a tablet computer terminal, a computer terminal), and a "payment method log" (e.g., record describing payment for all money, payment by date information, etc.).
If each log in a log group is abstracted into a point, the association relationship between the logs is abstracted into a line, and an abstract geometric figure consisting of the point abstracted from the log and the line abstracted from the association relationship between the logs forms a log topology model.
"Master Log" refers to a "primary" log that is validated based on the type or importance of the information recorded. For example, the log in which "order information" is recorded and the log in which "payment information" is recorded are logs in which the most important information is recorded in a scenario in which the user purchases a product from a shopping platform, and the generated connection relationship with other logs is the most, and thus the logs can be confirmed as "master logs".
The order information and the payment information submitted by the user are main log information of the corresponding main log.
Each master log also records a "master log identifier" for identifying the information recorded in the master log so as to distinguish from other similar information, for example, the master log identifier of the master log recording the shopping "Order information" submitted by the user may be "Order No. (see fig. 3), and the master log identifier of the master log recording the user" payment information "may be" bank agentmode Order No. (see fig. 3).
"the master log identifications of the respective master logs have an association relationship" is explained according to an example of two master log identifications in the previous paragraph. As can be seen from the above paragraph that the main log identifier "Order No. online" of the main log in which the "Order information" submitted by the user is recorded and the main log identifier "payment information" of the user is recorded may be "bank agentmode Order No., the main log identifiers of the two main logs both contain" Order No., so that the two main logs are associated with each other through the associated main log identifiers.
Of course, in the example of the two master log identifications, the association is achieved by having the same field "Order No." in the different master log identifications.
In addition, the association can also be realized by two identical master log identifications. For example, when a simulation user purchases two identical products through one Order, two master logs with the same master log identifier can be generated, wherein the master log identifiers are both "Order No. online journal", and the two master logs are associated through the same master log identifier.
The preset number of master logs refers to that the number of master logs in the existing log topology model is preset to be fixed. For example, the master log in the above example has only a master log in which "shopping order information" is recorded and a master log in which "user payment information" is recorded.
As for "generating a required number of log groups", for example, 10 ten thousand log groups are generated. In practice, each log in a group of 10 ten thousand logs with various information recorded may be generated using a software testing tool, such as a Virtual User Generator (Virtual User Generator) of LoadRunner (a load testing tool that predicts system behavior and performance). The virtual generator can generate a virtual user, and can also execute each step of a pre-recorded business process (such as an order) to generate a corresponding log. Parameterization may be performed by a Virtual User Generator, which may replace data in the record (such as the order number or customer name) with other variable values, as exemplified by a process of shopping order data generation. Possible order numbers and customer names can be freely taken at these variables to simulate the operation behavior of multiple actual users.
Step S102, generating an associated log associated with each main log according to the association relationship between each main log represented by the log topology model and each type of associated log; each associated log record has corresponding associated log information and a corresponding associated log identifier, and the associated log identifier of each associated log has an association relation with the master log identifier of the associated master log.
The existing log topological model can also represent the association relationship between the main log and each type of associated log in the log group. The existing log topology model determines, in advance, a log in which "detailed logs of an article" (e.g., a log of detailed introduction of a date and a use method of the article), a "terminal log" for generating an order (e.g., a log in which a terminal device type is recorded, which may be a mobile phone terminal, a tablet computer terminal, or a computer terminal), and the like are associated with an order log submitted by a user as an associated log of the master log. Similarly, a log in which the user "payment terminal log" (for example, the log describes the type of the payment terminal, which may be a mobile phone terminal, a tablet terminal, or a computer terminal), a "payment method log" (for example, the log describes the payment by all, the payment by due date information, or the like) and the like are associated with the user "payment log" in the description content may be determined as the associated log of the master log.
The above-mentioned association log may be generated by a software testing tool such as LoadRunner (a load testing tool that predicts system behavior and performance) described in step S101.
For example, based on the master log generated in step S101 and recorded with shopping "order information", association logs of various types associated with the master log may be generated according to an association relationship between the master log and the association logs characterized by an existing log topology model. For example, one type of the associated log records "order source information" (e.g., from a computer or a mobile phone), and the other type of the associated log records "category information of goods" (e.g., drinks, such as fresh goods), and so on.
For another example, for the master log recorded with "payment information" generated in step S101, association logs of various types of the master log may be generated according to an association relationship between the master log and the association logs characterized by an existing log topology model. For example, one type of the associated log records "payment and payment terminal information" (e.g., pay bank payment, phone fee deduction payment), and the other type of the associated log records "payment period information" (e.g., full payment, installment payment, etc.).
"each associated log records corresponding associated log information and corresponding associated log identifier, and the associated log identifier of each associated log has an association relationship with the master log identifier of the associated master log", as explained by the following example. For example, one of the associated log identifiers of the type "detailed log of item" is "eternal soymilk Order no. The association log identification is associated with the main log identification 'Order No. onlineurgent' through 'Order No'.
As can be seen from the above description, the existing log topology model may include a preset number of master logs and associated logs respectively associated with one master log, and the master logs have an association relationship with each other; the master logs and the associated logs are nodes of the topology model, and the association relationship among the master logs, the association relationship between the master logs and the associated logs are the connection relationship among the nodes of the topology model; and the association relations are recorded through the log identifiers of the master log and the association log.
Meanwhile, the existing log topology model can be generated by executing the following steps:
step 1, analyzing the relationship among logs according to the information recorded in the logs for recording the operations of the user;
for example, according to the existing log recorded with "order information" of shopping (such as order number, time of placing an order, etc.) and the log recorded with "category information of goods" (such as drinks, such as fresh category), it can be known that the goods of the category are purchased at a certain time, and thus the association relationship between the two logs is determined.
Step 2, determining a preset number of main logs, associated logs respectively associated with each main log and an association relationship among the main logs according to the relationship among the logs;
for example, in step 1, the "order information" (such as order number, order placing time, etc.) is obviously very important information in the online shopping scene, and thus is determined as a "master log", and the "item information of goods" (such as drinks, such as fresh food) is determined as an associated log of the aforementioned master log.
The master logs (order information, such as order numbers, ordering time and the like) and the associated logs (such as drinks and the like, and fresh products) are nodes of the topology model, and the association among the master logs, the association between the master logs and the associated logs and the connection among the nodes of the topology model are the association; and the association relations are recorded through the log identifiers of the master log and the association log. Examples are mentioned above and will not be described further here.
After step S101 and step S102 are adopted, the following technical effects can be achieved: according to the embodiment, not only the main logs and the associated logs are associated, but also the main logs are associated, and in addition, the associated logs of different main logs are also associated, for example, the associated logs of different main logs are all recorded with the identifier of "Order No.", so that the association is realized. When the logs are used for pressure testing and operation errors occur, the error logs can be quickly and accurately traced.
In the step of "generating an associated log associated with each master log" in S102 of this embodiment, a specific implementation manner is as follows:
and step S102-1, randomly generating the associated log fields of the record types mapped by each master log based on the occupation ratios in all the associated log fields preset for the associated log fields of each record type.
For example, when the number of generated log groups is 10 ten thousand, the 10 ten thousand log groups may correspond to 10 ten thousand "item type logs". The number (i.e., 2 ten thousand) of the associated log fields (e.g., "Yong and soymilk" fields) having each record type may be determined according to a predetermined percentage (e.g., 20%) of each record type in an associated log field (e.g., "Yong and soymilk" as a record value of the "item type" log field).
As for the determined associated log fields, a certain proportional number (for example, 20%) is associated with the master logs in which log groups, the decision can be assigned according to the random number. The numerical value of "random number" is used to characterize the randomly generated state of each type of associated log. For example, a value of "1" for the random number indicates that a certain type of associated log is generated, and a value of "0" for the random number indicates that no associated log of a certain type is generated. Specifically, as described above, when it is decided to allocate the associated logs of 2 ten thousand "perpetual and soymilk" item types to be generated in association with the master logs in which log groups of 10 ten thousand master log sets, it can be decided by a series of steps of: setting the occurrence probability of the random number '1', and then starting to inquire the random number; determining whether to generate an associated log aiming at the main log in the current main log set or not according to the numerical value of the random number; and if the random number is 1, generating a correlation log of the permanent and soybean milk product type, otherwise, not generating. In this way, 2 ten thousand log groups can be randomly selected from 10 ten thousand log groups, and the associated log associated with the corresponding master log is generated based on the association relationship between the corresponding master log and the associated log in the log groups characterized by the log topology model. It should be noted that the "random number" may be generated by a random number generator.
In this implementation manner, based on the ratio preset in all the associated log fields for the associated log field of each record type, the associated log field of each record type mapped by each master log is randomly generated, and the following technical effects can be achieved: the generated associated logs of certain types can more reliably simulate the behavior data in the actual scene. For example, in an online shopping application scenario, the associated log with the possible "item type" of "perpetual and soymilk" only accounts for 20% of all the associated logs, but not 80%, the proportion of the associated logs in all the associated log fields preset by the associated log field of each record type can be better controlled by means of random numbers, and the actual application scenario can be simulated more practically.
In step S102-1, which is an optional implementation manner of this embodiment, one or some fields with range limitation recorded in the associated log information are generated by performing the following steps:
step S102-1-1, reading a pre-loaded target dimension table;
the "dimension table" may be a table in which target information is recorded, and for example, the table records item type information such as fields "stay and soya milk", "rice village moon cake", "millet 4A mobile phone", "Maxoner air cleaner", and the like.
"preloaded" may mean that the dimension table in the above example has entered a process or thread and is in a readable state.
Step S102-1-2 selects a certain or some selectable values from the selectable range of the target dimension table for the relevant field record as the field value of the field in the associated log information.
And according to the data in the read dimension table, for example, the read data is 'Yonghe soymilk', the read data is used as the field value of the field in the associated log information, and the 'Yonghe soymilk' field value is used for recording the type of the associated log as 'Yonghe soymilk goods type'.
In step S102-1-1 and step S102-1-2 of the optional implementation manner of this embodiment, the selectable values in the dimension table satisfy the probability distribution rule of the preset kurtosis coefficient.
Wherein, the "kurtosis coefficient" represents the characteristic number of the probability density distribution curve with the peak value at the average value. For example, the kurtosis (coefficient) of a normal distribution is constant 3, and the kurtosis (coefficient) of a uniform distribution is constant 1.8. In statistical practice, we often use these two typical distribution curves as references for evaluating the distribution behavior of the sample data sequence. For example, if the above field values "stay and stay soymilk", "Daoxiangcun moon cake", "millet 4A mobile phone" and "Maxon air cleaner" are preset to satisfy the uniform distribution with the preset kurtosis factor of 1.8, it means that the probability of the occurrence of each data is substantially the same, and is 25%. For another example, if the field values "stay and stay soymilk", "luoxicun mooncake", "millet 4A mobile phone", and "Maxoner air purifier" are preset to satisfy a normal distribution with a preset kurtosis factor of 3, the probability of occurrence of each data is relatively large, for example, the probability of occurrence of "stay and stay soymilk", "luoxicun mooncake" may be 40%, and the probability of occurrence of "millet 4A mobile phone", and "Maxoner air purifier" may be 10%.
Optionally, the field value may be used to record, in addition to the item type used to record the associated log: activity identification information data, user address information data. For example, the campaign presentation information data "1212" indicates that the order-related good is a good participating in a twenty-two promotional campaign on a shopping network platform; further, the user address information data "huadong" indicates that the relevant activity is for the user in the east china.
Optionally, if a certain field or some fields in the associated log information is an enumeration type, the field value is selected and determined in a preset determination manner from a predetermined enumeration value selection range. For example, the associated log field value for recording the associated log of "user Source province" is selected only from the following determined field values: such as "Beijing", "shanghai", "shenzhen", etc.
Optionally, one or some fields in the associated log information may be of a rule type, and then the field values are generated according to a predetermined rule. For example, a field value for recording the order number is generated according to a uniformly distributed numbering rule. The ordering of the field values may be "2017111101", "20171102", "20171103", etc.
Optionally, the required number of log groups is generated, where the number of log groups is generated at a preset rate in a time dimension. For example, every 1000 log groups are generated, limited to 0.5 seconds.
Optionally, the required number of log groups is generated, where the number of log groups is limited within a predetermined number range according to the time dimension. For example, every 1 second, the number of generated log groups is limited to the range of 1000-1500.
Optionally, the logs of each log group of the logs for stress testing have a stress identification recognizable as stress test data. For example, the identification may be assisted by a field value "used for space".
Alternatively, the log identification uses an identification having a specific meaning. For example, the selected field value may use pinyin or english words (e.g., bank agent), and may clearly display the meaning that is easy for the user to understand.
The present application also provides a flow chart of one embodiment of a method of stress testing logs generated according to the foregoing method, see fig. 2. The method for performing the stress test according to the log generated by the method comprises the following steps:
step S201, determining corresponding data interaction processes of a client and a server according to the incidence relation and the recorded information of each main log and the corresponding associated log in each log group;
by way of example, a log group such as that described above includes two master logs associated with each other, namely an "order log" submitted by the user (e.g., a daily shopping order for the user), and a "payment log" of the user (e.g., a log recording payment time, payment amount, etc.). Meanwhile, the main log "order log" submitted by the user includes corresponding associated logs, that is, a "detailed log of the item" (e.g., a log of detailed introduction of date, usage method, etc. of the item) described by the order, and a "terminal log" of the generated order (e.g., a log recording the type of the terminal device, which may be a mobile phone terminal, a tablet computer terminal, or a computer terminal). The user's main log "payment log" includes corresponding association logs, such as "user payment terminal log" (for example, recording the type of payment terminal, which may be a mobile phone terminal, a tablet terminal, and a computer terminal), "payment method log" (for example, recording the payment by total amount, the payment by date information, and the like).
According to the association relationship and the information recorded in each log, it can be known that the interaction process between the client and the server is as follows:
generating a corresponding order log according to an order request submitted by a user;
acquiring detailed information of the items described by the user order log and generating a detailed log of the items described by the order;
acquiring information of a terminal generating an order and generating a terminal log of the order;
generating a corresponding user payment log according to a payment request submitted by a user;
generating a payment mode log according to information recorded in the user payment log;
and acquiring the information of the user payment terminal and generating a log of the user payment terminal.
Step S202, generating corresponding script statements by using script functions according to the determined corresponding data interaction process of the client and the server;
a "script" is a plain text saving program, and a general computer script program is a combination of a predetermined series of operations for controlling a computer to perform an arithmetic operation.
After determining the corresponding data interaction process of the client and the server based on step S201, the determined corresponding data interaction process of the client and the server may be used to generate a corresponding script statement by using a script function. In particular, a script statement may be generated using the test tool LoadRunner.
Step S203, after receiving the scheduling command, generating a corresponding process or thread according to the corresponding script statement;
generally, a Program being executed in a computer is called a Process (Process), and is not called a Program (Program). A Thread (Thread) is a basic unit of execution in a process.
After generating the corresponding script statement based on step S202, the pressure scheduling tool in the pressure testing tool LoadRunner may generate an actual process according to the content recorded in the script statement. For example, if 10 ten thousand users are to be simulated in a test scenario, the pressure generator may generate 10 ten thousand processes or threads, and each process or thread interprets and executes a corresponding script statement.
Step S204, obtaining target performance data of the equipment to be tested.
"device under test" refers to a target device, such as a server, that needs to test its operational performance and the ability to process large amounts of data. "target performance data" may be utilization of the central processing unit, used memory, disk input output rate, and network throughput. Wherein, the utilization rate of the central processing unit refers to the proportion of resources in the central processing unit occupied by the running program. The resources in the central processing unit include an operator unit, an arithmetic logic unit, a controller unit, a register unit, and the like. Used memory refers to the memory that is being occupied by a running program. The disk input/output rate refers to the number of times of disk read/write operations per unit time. Network throughput refers to the number of processing user requests per unit of time. In practice, the Load Runner may be used for the acquisition of target performance data.
Fig. 4 is a schematic structural diagram of an embodiment of an apparatus for generating a log for stress testing provided in the present application. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to the corresponding description of the method embodiments provided above for relevant portions. The device embodiments described below are merely illustrative. The retry apparatus includes: a master log generating unit 401 and an associated log generating unit 402. In this embodiment, the master log generating unit 401 is configured to generate a preset number of master logs based on an existing log topology model, where each master log records corresponding master log information and master log identifiers, and the master log identifiers of each master log have an association relationship; an associated log generating unit 402, configured to generate an associated log associated with each master log according to an association relationship between each master log represented by the log topology model and each type of associated log; each associated log record has corresponding associated log information and a corresponding associated log identifier, and the associated log identifier of each associated log has an association relation with the master log identifier of the associated master log.
Optionally, the apparatus further comprises: the analysis unit is configured to analyze the relationship among the logs according to the information recorded in the existing logs for recording the operations of the user; the association relation determining unit is configured to determine a preset number of main logs, association logs respectively associated with each main log and association relations among the main logs according to relations among the logs; the master logs and the associated logs are nodes of the topology model, and the association relationship among the master logs, the association relationship between the master logs and the associated logs are the connection relationship among the nodes of the topology model; and the association relations are recorded through the log identifiers of the master log and the association log.
Optionally, the master log generating unit further includes: and the associated log field generating subunit is configured to randomly generate the associated log fields of the respective record types mapped by each master log based on the ratios in all the associated log fields preset for the associated log fields of each record type.
Optionally, the master log generating unit further includes: the target dimension table reading subunit is configured to read a preloaded target dimension table; and the field value selection subunit is configured to select a certain or some selectable values from the selectable range of the target dimension table for the relevant field record, and select the certain or some selectable values as the field values of the fields in the associated log information.
The present application further provides a device for performing a stress test on a log generated according to the above device, comprising: the interactive process determining unit is configured to determine a corresponding data interactive process between the client and the server according to the incidence relation between each main log and the corresponding associated log in each log group and the recorded information; the script statement generating unit is configured to generate a corresponding script statement by using a script function according to the determined corresponding data interaction process of the client and the server; the process or thread generating unit is configured to generate a corresponding process or thread according to the corresponding script statement; and the target performance data acquisition unit is configured to acquire target performance data of the equipment to be tested.
The present application further provides an electronic device for generating a log for stress test, which is basically similar to the method embodiment, so that the description is relatively simple, and please refer to the corresponding description of the method embodiment provided above. The embodiments of the electronic device described below are merely illustrative. The application provides an electronic equipment for generating log for stress test, includes: a display; a processor; a memory for storing a program for scheduling retries, which when read executed by the processor performs the following: generating a required number of log groups, wherein each log group is generated in a mode that a preset number of main logs are generated based on an existing log topological model, each main log records corresponding main log information and main log identification, and the main log identification of each main log has an association relation; generating an associated log associated with each main log according to the association relationship between each main log represented by the log topology model and each type of associated log; each associated log record has corresponding associated log information and a corresponding associated log identifier, and the associated log identifier of each associated log has an association relation with the master log identifier of the associated master log.
The present application further provides a computer-readable storage medium, which is substantially similar to the method embodiment, so that the description is relatively simple, and please refer to the corresponding description of the method embodiment provided above for related parts. The embodiments of computer-readable storage media described below are merely illustrative. A computer-readable storage medium is provided, on which a program for generating a log for stress testing is stored, which program, when read by a processor, performs the following operations: generating a required number of log groups, wherein each log group is generated in a mode that a preset number of main logs are generated based on an existing log topological model, each main log records corresponding main log information and main log identification, and the main log identification of each main log has an association relation; generating an associated log associated with each main log according to the association relationship between each main log represented by the log topology model and each type of associated log; each associated log record has corresponding associated log information and a corresponding associated log identifier, and the associated log identifier of each associated log has an association relation with the master log identifier of the associated master log.
Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application, and those skilled in the art can make variations and modifications without departing from the spirit and scope of the present application, therefore, the scope of the present application should be determined by the claims that follow.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
1. Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-transitory computer readable media (transient media), such as modulated data signals and carrier waves.
2. As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Claims (21)

1. A method of generating logs for stress testing, characterized in that a required number of log groups are generated, and each log group is generated in the following way:
generating a preset number of main logs based on an existing log topology model, wherein each main log records corresponding main log information and a main log identifier, and the main log identifiers of the main logs have an association relationship;
generating an associated log associated with each main log according to the association relationship between each main log represented by the log topology model and each type of associated log; each associated log record has corresponding associated log information and corresponding associated log identification, and the associated log identification of each associated log has an association relation with the master log identification of the associated master log;
the logs of the respective log groups of the logs for stress testing have a stress identification recognizable as stress test data.
2. The method for generating logs for stress testing according to claim 1, wherein the log topology model comprises a preset number of master logs and associated logs respectively associated with one master log, and the master logs have an association relationship with each other; the master logs and the associated logs are nodes of the topology model, and the association relationship among the master logs, the association relationship between the master logs and the associated logs are the connection relationship among the nodes of the topology model; and the association relations are recorded through the log identifiers of the master log and the association log.
3. The method of generating a log for stress testing of claim 1, wherein the log topology model is generated by performing the steps of:
analyzing the relationship among the logs according to the information recorded in the logs for recording the operations of the user;
determining a preset number of main logs, associated logs respectively associated with each main log and an association relationship among the main logs according to the relationship among the logs;
the master logs and the associated logs are nodes of the topology model, and the association relationship among the master logs, the association relationship between the master logs and the associated logs are the connection relationship among the nodes of the topology model; and the association relations are recorded through the log identifiers of the master log and the association log.
4. The method according to claim 1, wherein the master log identifiers of the master logs have an association relationship, and the association log identifier of each association log has an association relationship with the master log identifier of the associated master log, wherein the association relationship is that the log identifiers are the same.
5. Method for generating a log for stress testing according to claim 4, characterized in that said log identification uses an identification with a specific meaning.
6. The method of generating a log for stress testing according to claim 1, wherein in the step of generating the associated log associated with each master log, the associated log fields of the respective record types mapped by each master log are randomly generated based on a ratio in all the associated log fields preset for the associated log fields of each record type.
7. The method of generating a log for stress testing of claim 6, wherein the field or fields with range limits recorded in the associated log information are generated by performing the steps of:
reading a pre-loaded target dimension table;
and selecting a certain or some selectable values from the selectable range of the target dimension table to the related field record as the field value of the field in the associated log information.
8. The method of generating a log for stress testing according to claim 7, wherein the value of the field selected in the dimension table satisfies a probability distribution rule of a preset kurtosis coefficient.
9. The method of generating a log for stress testing of claim 8 wherein the selectable values in the dimension table comprise any of the following types of data: activity identification information data, user address information data.
10. The method for generating a log used for stress test according to claim 6, wherein if some field or some fields in the associated log information is/are of enumeration type, the field value is selected and determined from a predetermined range of enumeration values in a predetermined determination manner.
11. The method of generating a log for stress testing according to claim 6, wherein if some field or fields in the associated log information is a rule type, the field value is generated according to a predetermined rule.
12. The method of generating logs for stress testing according to claim 1, wherein generating a required number of log groups, wherein the number of log groups is generated at a preset rate in a time dimension.
13. Method for generating logs for stress testing according to claim 1 or 12, characterized in that said generating of a required number of log groups is performed with the number of log groups being limited to a predetermined number according to a time dimension.
14. A method of stress testing the logs generated by the method of generating logs for stress testing of claim 1, comprising:
determining corresponding data interaction processes of the client and the server according to the incidence relation between each main log and the corresponding associated log in each log group and the recorded information;
generating corresponding script statements by using a script function according to the determined corresponding data interaction process of the client and the server;
generating a corresponding process or thread according to the corresponding script statement;
and acquiring target performance data of the equipment to be tested.
15. An apparatus for generating logs for stress testing, wherein a desired number of log groups are generated using:
the log generating unit is configured to generate a preset number of master logs based on an existing log topology model, each master log records corresponding master log information and master log identification, and the master log identifications of the master logs have an association relationship;
the associated log generation unit is configured to generate an associated log associated with each master log according to the association relationship between each master log represented by the log topology model and each type of associated log; each associated log record has corresponding associated log information and corresponding associated log identification, and the associated log identification of each associated log has an association relation with the master log identification of the associated master log;
the logs of the respective log groups of the logs for stress testing have a stress identification recognizable as stress test data.
16. The apparatus for generating a log for stress testing of claim 15, wherein the apparatus further comprises:
the analysis unit is configured to analyze the relationship among the logs according to the information recorded in the existing logs for recording the operations of the user;
the association relation determining unit is configured to determine a preset number of main logs, association logs respectively associated with each main log and association relations among the main logs according to relations among the logs;
the master logs and the associated logs are nodes of the topology model, and the association relationship among the master logs, the association relationship between the master logs and the associated logs are the connection relationship among the nodes of the topology model; and the association relations are recorded through the log identifiers of the master log and the association log.
17. The apparatus for generating a log for stress testing of claim 15, wherein said master log generating unit further comprises:
and the associated log field generating subunit is configured to randomly generate the associated log fields of the respective record types mapped by each master log based on the ratios in all the associated log fields preset for the associated log fields of each record type.
18. The apparatus for generating a log for stress testing of claim 17, wherein said master log generating unit further comprises:
the target dimension table reading subunit is configured to read a preloaded target dimension table;
and the field value selection subunit is configured to select a certain or some selectable values from the selectable range of the target dimension table for the relevant field record, and select the certain or some selectable values as the field values of the fields in the associated log information.
19. An apparatus for stress testing the log generated by the apparatus for generating a log for stress testing of claim 15, comprising:
the interactive process determining unit is configured to determine a corresponding data interactive process between the client and the server according to the incidence relation between each main log and the corresponding associated log in each log group and the recorded information;
the script statement generating unit is configured to generate a corresponding script statement by using a script function according to the determined corresponding data interaction process of the client and the server;
the process or thread generating unit is configured to generate a corresponding process or thread according to the corresponding script statement;
and the target performance data acquisition unit is configured to acquire target performance data of the equipment to be tested.
20. An electronic device for generating a log for stress testing, the electronic device comprising:
a display;
a processor;
a memory for storing a program for scheduling retries, which when read executed by the processor performs the following: a required number of log groups are generated, and each log group is generated in the following manner,
generating a preset number of main logs based on an existing log topology model, wherein each main log records corresponding main log information and a main log identifier, and the main log identifiers of the main logs have an association relationship;
generating an associated log associated with each main log according to the association relationship between each main log represented by the log topology model and each type of associated log; each associated log record has corresponding associated log information and corresponding associated log identification, and the associated log identification of each associated log has an association relation with the master log identification of the associated master log;
wherein, the log of each log group of the log used for the pressure test has a pressure measuring mark which can be identified as pressure test data.
21. A computer-readable storage medium on which a program for generating a log for stress testing is stored, the program, when read and executed by a processor, performing the operations of: a required number of log groups are generated, and each log group is generated in the following manner,
generating a preset number of main logs based on an existing log topology model, wherein each main log records corresponding main log information and a main log identifier, and the main log identifiers of the main logs have an association relationship;
generating an associated log associated with each main log according to the association relationship between each main log represented by the log topology model and each type of associated log; each associated log record has corresponding associated log information and corresponding associated log identification, and the associated log identification of each associated log has an association relation with the master log identification of the associated master log;
wherein, the log of each log group of the log used for the pressure test has a pressure measuring mark which can be identified as pressure test data.
CN201810211537.0A 2018-03-14 2018-03-14 Method and device for generating log for pressure test Active CN108572914B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810211537.0A CN108572914B (en) 2018-03-14 2018-03-14 Method and device for generating log for pressure test

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810211537.0A CN108572914B (en) 2018-03-14 2018-03-14 Method and device for generating log for pressure test

Publications (2)

Publication Number Publication Date
CN108572914A CN108572914A (en) 2018-09-25
CN108572914B true CN108572914B (en) 2020-12-18

Family

ID=63574495

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810211537.0A Active CN108572914B (en) 2018-03-14 2018-03-14 Method and device for generating log for pressure test

Country Status (1)

Country Link
CN (1) CN108572914B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110597777A (en) * 2019-09-18 2019-12-20 金瓜子科技发展(北京)有限公司 Log processing method and device
CN111625469B (en) * 2020-06-11 2024-09-20 深圳前海微众银行股份有限公司 Pressure testing method, device, equipment and computer readable storage medium
CN113220593B (en) * 2021-06-04 2024-06-14 中国农业银行股份有限公司 Method, apparatus, device, storage medium and program product for generating test data
CN118656276A (en) * 2024-06-28 2024-09-17 北京优特捷信息技术有限公司 A log data display method, device, medium and program product

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102929936A (en) * 2012-09-26 2013-02-13 东软集团股份有限公司 Log recording method, log inquiring method and system
CN104346365A (en) * 2013-07-30 2015-02-11 阿里巴巴集团控股有限公司 Device and method for determining specific service associated logs
CN107704357A (en) * 2017-08-28 2018-02-16 北京小度信息科技有限公司 Daily record generation method and device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102929936A (en) * 2012-09-26 2013-02-13 东软集团股份有限公司 Log recording method, log inquiring method and system
CN104346365A (en) * 2013-07-30 2015-02-11 阿里巴巴集团控股有限公司 Device and method for determining specific service associated logs
CN107704357A (en) * 2017-08-28 2018-02-16 北京小度信息科技有限公司 Daily record generation method and device

Also Published As

Publication number Publication date
CN108572914A (en) 2018-09-25

Similar Documents

Publication Publication Date Title
CN108572914B (en) Method and device for generating log for pressure test
CN109309596B (en) Pressure testing method and device and server
CN102568522B (en) The method of testing of hard disk performance and device
CN106055464B (en) Data buffer storage testing schooling pressure device and method
US20080178147A1 (en) Apparatus, system, and method for profiling and reusing software development assets
CN107480039A (en) The small documents readwrite performance method of testing and device of a kind of distributed memory system
CN110968495A (en) A method and device for evaluating the performance of a container cloud platform
CN111160950A (en) Resource information processing and outputting method and device
CN114490375A (en) Method, device and equipment for testing performance of application program and storage medium
CN111723004A (en) Measuring method for agile software development, measuring data output method and device
CN111694748B (en) Pressure testing method and device
CN111984519B (en) Test method and device for service system
CN104636397B (en) Resource allocation methods, calculating accelerated method and device for Distributed Calculation
CN111709769A (en) Data processing method and device
TW200809222A (en) Method and apparatus for automatically formatting data based on a best match test result type
CN115794570A (en) Pressure testing method, device, equipment and computer readable storage medium
US9990274B2 (en) Testing integrated business systems
CN108334521A (en) A kind of database volume prediction technique and device
CN116662317A (en) Data verification method and device, processor and electronic equipment
CN109960654A (en) Test method, device, equipment and storage medium for damage determination rules
CN110717701A (en) Simulation wave generation method and device and electronic equipment
CN116383055A (en) Financial scene testing method and device, processor and electronic equipment
CN111949504A (en) Pressure testing method, device and medium
CN106998468B (en) A kind of method and system of Performance Testing of Video Server
KR20210096972A (en) Methods and apparatuses for prioritizing energy trading resources for improving power relay reliability

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant