CN1889471A - Automatic testing device and method for user interface - Google Patents

Abstract

The invention discloses an automatic testing device for a user interface, comprising: a command line generator for generating executable commands; a command line executor for executing the command generated by the command line generator and returning the execution result ; The result analysis and processing module is used to judge the executed result and process the executable command according to the judgment result; the main control module is used to control the command line generator to generate the executable command. According to the present invention, it is possible to traverse and execute the user interface of the network communication device, so that the user interface of the network device can be tested more quickly and comprehensively, and the user interface of the network device can be adjusted in time according to the test result, thereby ensuring the stability of the network device .

Description

An automatic testing device and method for a user interface

technical field

The invention relates to a network communication technology, in particular to an automatic testing device and method of a user interface.

Background technique

Users generally use the command line to configure data and perform other operations on network communication devices. In order to ensure the operation stability and security of network communication equipment, it is necessary to test each command of the network equipment. When testing it, in order to complete a function, it is necessary to configure a combination of several commands and their parameters.

In the prior art, the general method of testing the command line is: firstly design the command line test case according to the command line design specification, select the boundary and intermediate values of the parameters of the command through the boundary value method, and then manually execute these use cases, the executed The results are generally judged by humans to be correct. However, since the number of commands and parameters is very large, and the number of various combinations thereof is very large, manual testing can only cover a very small part of them, and the problem of missed testing is likely to occur.

In some command-line test methods, although there are already some automation technologies in the execution of use cases and the judgment of results. However, because the more time-consuming use case design is still done manually, there is still a problem of low efficiency; secondly, there may be errors and omissions in the use cases designed manually; moreover, due to manpower constraints, commands and parameters In the case of many combinations, complete coverage cannot be done.

Contents of the invention

In view of the above-mentioned defects in the prior art, the purpose of the present invention is to provide an automatic testing device and method for user interface, which not only improves the testing efficiency, but also can comprehensively test each command of the user interface.

The present invention is achieved through the following technical solutions. The present invention provides an automatic test device for user interface, comprising:

Command line generator, used to generate executable commands;

The command line executor is used to execute the command generated by the command line generator and return the execution result;

The result analysis and processing module is used to judge the executed result, and process the executable command according to the judgment result;

The main control module is used to control the command line generator to generate executable commands.

The test device also includes: a command line filter, used to filter the commands sent to the command executor.

The main control module also includes a hot patch module, which is used to modify the functions of each module of the user interface automatic test device.

The present invention also provides an automatic testing method of a user interface, comprising:

A. The command line generator generates commands to be executed;

B. Process the command generated according to it.

Described step A further comprises:

If the current mode is a new mode, perform the following steps:

Get all commands in the current mode;

Put all commands into the list of all commands corresponding to the current mode;

Add the current schema to the list of known schemas;

The command line generator generates commands to be executed from all command lists corresponding to the current mode according to the command generation method and command line elements;

The command line generator removes the generated command from the list of all commands.

Described step A further comprises:

If the current mode is a known mode,

Then judge whether all the command lists are empty, if so, execute the steps:

Add the current schema to the traversal completion list;

Judging whether the number of the traversal completion list is equal to the number of the known mode list, if they are equal, return an empty command; otherwise, the command line generator generates the command to be executed from the mode switching command list;

Otherwise, perform the steps:

The command line generator generates commands to be executed from all command lists according to the command generation method and command line elements;

The command line generator removes the generated command from the list of all commands.

The command generation method includes sequential generation method and random generation method.

The command elements include: command prompt, command association symbol, command terminator, command parameter type, command parameter range, and command mode uniqueness.

Described step B further comprises:

If the command generated by the command line generator is empty, then end this process, otherwise, perform the following steps:

B1. The command line executor executes the command generated by the command line generator and returns the executed result;

B2. If mode switching occurs as a result of the execution, put the command into the mode switching command list;

B3. The result analysis and processing module processes the command according to the returned result;

B4. Step A is executed.

Before executing step B1, also execute: the command line filter to filter the commands from the command line list.

According to the present invention, it is possible to traverse and execute the commands of the network communication equipment, so that the user interface of the network equipment can be tested more quickly and comprehensively, and the user interface of the network equipment can be adjusted in time according to the test results, thereby ensuring the stability of the network equipment.

Description of drawings

Fig. 1 shows the automatic testing device of the user interface of the present invention;

Fig. 2 shows a flow chart of the automatic testing method of the user interface of the present invention.

Detailed ways

In order to make it easier for those skilled in the art to understand and realize the present invention, the embodiments of the present invention are described in conjunction with the accompanying drawings.

As shown in FIG. 1 , the automatic testing device of the user interface of the present invention includes: a main control module, a command line generator, a command line executor, a command line filter and a result analysis and processing module.

The above five modules work together, as an organic whole, the process of working together can be expressed as follows in pseudocode:

if{All traversal has been completed} {

return

}

The command line generator gets all the commands in the current mode;

foreach{each command} {

The command line executor executes this command;

Record the execution result of the command;

if {entered a new mode} {

Make a recursive call;

}

}

Mark all the commands in this mode have been traversed;

As can be seen from the pseudo-code segment above, as shown in Figure 2, the basic idea of the present invention is: in step 1, the command line generator generates the command to be executed; Whether the command is empty, if so, in step 6, then end this process. Otherwise, perform the following steps: In step 3, the command line executor executes the command generated by the command line generator, and returns the executed result; in step 4, if the executed result has a mode switch, the command Put it into the mode switching command list; in step 5, the result analysis and processing module processes the command according to the returned result, and returns to step A.

The above five modules are introduced respectively below.

2. Main control module

The main control module is mainly responsible for the overall scheduling of the program, the judgment of the execution end, hot patching, etc.

1) Overall scheduling: Overall scheduling is essentially a big cycle. It first calls the command line generator to obtain the next command to be executed and calls the command line filter to determine whether the command needs to be executed. If it needs to be executed, it calls the command line executor to execute this command.

2) Execution end judgment: If the command obtained from the command line generator is empty, it means that all commands have been executed and the program ends.

3) Hot patch: Since the traversal of the command line is very time-consuming, hours and days are common, so each cycle provides a chance for the program to self-correct, and the user can dynamically update the program during the execution of the program. Change the behavior of the program, for example, modify the filtering rules of the command line, remove the BUG of the program, change the judgment conditions of the command execution result, and so on.

The hot patch determines whether to update itself by judging the flag bit in the registry or the modification time of an external file. If it is found that it needs to be updated, it reloads each function library file to complete the dynamic update of the function.

3. Command line generator

1) Overall architecture: The main function of the command line generator is to generate executable commands. It first obtains all the command sets corresponding to the current mode, and then generates the next command to be executed according to the predefined command generation method. If all common commands are executed, it is considered that the mode command has been executed. If all known modes If all traversals are completed, it is considered that all traversals have been completed, and an empty command is returned.

The algorithm for generating executable commands can be expressed in pseudocode as follows:

#Variable definitions

set "List of Known Patterns" null

set "traversing the complete pattern list" null

set "List of all commands" null

set "mode switching command list" null

get current mode

if{current mode is new mode} {

add current mode to "list of known modes"

}

Get the "all command list" corresponding to the current mode

if{"all command list"==null} {

Add the current mode to "traversal complete mode list"

If{number("traversing the list of complete patterns")>=number("list of known patterns")} {

    #Indicates that all traversal is complete

return null

}

} else {

# Take out a command from the "all command list"

switch{command generation mode} {

case random method:

Randomly take a command from the "all command list"

Sequence of cases:

Sequentially take a command from the "all command list"

}

The remove command from "List of all commands"

if{command is mode switching command} {

Add command to "mode switching command list"

}

return command

}

return Take a command from the "mode switching command list"

Several concepts involved in this application are explained below.

Command mode: All commands of the communication device must be executed in a certain command mode. Even the same command may have different meanings in different command modes. Therefore, commands are classified by command mode. First, the current command mode is obtained, and then all command sets in this command mode can be obtained.

Mode switching command: There are two types of commands, one is common command and the other is mode switching command. The mode switching command means that after the command is executed, the command mode changes. For example, the "exit" command often means to exit the current mode and enter the parent command mode, so the "exit" command belongs to the mode switching command.

Command generation mode: Since the functions of network devices are often related to the execution order of multiple commands, the command generation mode defines the execution order of commands. The sequence is generated randomly, and multiple executions of the same command set may produce different effects.

2) Command generation: After getting the command, a command line is also generated according to the parameters of the command. The following describes the technique of generating the command from the current command line mode.

The technology of automatically generating command lines is related to the specific realization of network devices. This application defines the command line elements that should be provided by the command lines of network devices. For a specific network device, it is only necessary to simply modify the relevant configuration files, and the automatic generation of the command line can be completed according to these elements.

Command line elements that a network device should provide: command line elements illustrate necessity command prompt There are two main functions, one is to indicate that the previous command has been executed, and the other is to wait for the next command to be entered; the command line generator can use it to extract the current command mode. For example "#", ">", "[]" and so on. must command association The network device must provide the function of automatically associating network device commands, for example, "a?" lists all commands beginning with "a", and "atm?" lists all parameters that can be entered under the "atm" command. Here "?" is the command association character. must command terminator The symbol used to indicate the end of the command, such as "<cr>" means the end of the command. must Command parameter type The parameters of the command should be able to reflect the type of the parameter, for example, "INTEGER<1-99>" indicates that the type of the parameter is an integer. If the command parameter type is ambiguous, the generated command line may not reflect the actual condition of the command. optional Command parameter range The parameter of the command should give the range, for example "INTEGER<1-99>" means the range of the parameter is 1 to 99. With the range of parameters, use cases of boundary values and outliers can be automatically generated to enhance the effect of testing. optional command pattern uniqueness The command line mode of a network device should be unique, and the same command mode should have the same set of commands. Although the number of commands can be used to determine whether they are in the same pattern, there is still a small probability that some commands cannot be traversed. optional

The algorithm generated by the command can be expressed in pseudocode as follows:

proc GetCmds{cmd} {

if{The current command does not meet the filter conditions} {

return

}

# Get the parameter list of the current command

set command parameter list [command executor "current command command association"]

foreach{each parameter} {

                                                                 

return "Current command parameter"

} else {

#Recursive call

Return[GetCmds "Current Command Command Parameters"]

}

}

}

The user can set the number of command parameters to improve the performance of the search. By default, the limit search may take a long time.

Fourth, the command line filter

The command line filter mainly provides the function of command filtering, so as to prevent some special commands from affecting the command traversal or the execution time of some commands is too long, for example, the command to reset the system is recommended to be filtered out.

The command line filter is dynamic during command filtering, that is to say, during the execution of the command line traversal program, the filter conditions can be dynamically modified through the hot patch function of the main control module, which will take effect immediately without interrupting the execution of the program .

The filtering of the command line is divided into two levels, one level is the mode, and the other level is each command in the mode, that is to say, the filtered commands are expressed in two dimensions. Each mode can include several commands that need to be filtered. Both patterns and commands are expressed in the form of regular expressions.

5. Command executor and result analysis and processing module

The role of the command executor is to execute each searched command and return the execution result. In order to improve the efficiency of traversing commands, when executing the searched commands, it is preferable to limit the execution time. That is to say, how long does it take to execute a command to consider that the command is completed? You can speed up the execution efficiency based on the command prompt or other symbols. For example, once you find the next command prompt, you can consider that the previous command has been executed. up.

The result analysis and processing module is used to automatically judge the correctness of the execution results, and there are two forms of general judgment and special judgment. The general judgment uses some unique clues to indicate that there is a problem in the system, such as "Error", "Fail", "Warning" and other prompt messages; the special judgment refers to a reference file to match the execution result of the command with the expected result of the command , once the execution result of the command is found to be inconsistent with the expected result, it is considered that there is a problem. Both the execution result of the command and the expected result of the command are expressed in the form of regular expressions.

When it is found that there is a problem with the execution of the command (the general judgment or the special judgment fails), there are two optional actions, one is to suspend the execution of the program, and wait for the user's intervention, so that the first scene can be reserved to facilitate problem location; the other Choose Yes to continue execution, and record errors to the execution log, which is suitable for unattended situations.

According to the present invention, it is possible to traverse and execute a vast number of commands of network communication devices, and it can run for a long time without being on duty. If conditions permit, multiple command line terminals can also operate on the same network device, which will be more efficient. Quickly test the user interface of the network equipment, so as to adjust the user interface of the network equipment in time according to the test results, which effectively guarantees the stability of the network equipment.

Although the present invention has been described by the embodiments, those of ordinary skill in the art know that, without departing from the spirit and essence of the present invention, the present invention can have many modifications and variations, and the scope of the present invention is defined by the appended rights Requirements to limit.

Claims (10)

1. the automatic testing equipment of a user interface is characterized in that, comprising:

The order line generator is used for producing executable order;

The order line actuator is used for the order that fill order row generator is produced, and returns the result of execution;

The interpretation of result processing module is used for judging performed result, and according to judged result executable order is handled;

Main control module is used for control command row generator and produces executable order.

2. the automatic testing equipment of user interface according to claim 1 is characterized in that, described testing apparatus also comprises: the order line filter is used for the order of being sent to command executer is filtered.

3. the automatic testing equipment of user interface according to claim 1 and 2 is characterized in that, described main control module also comprises the hot patch module, is used to revise each functions of modules of user interface automatic testing equipment.

4. the automatic test approach of a user interface is characterized in that, comprising:

A, order line generator produce pending order;

B, it is handled according to the order that is produced.

5. the automatic test approach of user interface according to claim 4 is characterized in that, described steps A further comprises:

If present mode is a new model, carry out the following step:

Obtain all orders under the present mode;

Pairing all command list (CLIST)s of present mode are put in all orders;

Present mode is added in the known mode tabulation;

The order line generator produces pending order according to order producing method and order line key element from pairing all command list (CLIST)s of present mode;

The order line generator is deleted the order that is produced from all command list (CLIST)s.

6. the automatic test approach of user interface according to claim 4 is characterized in that, described steps A further comprises:

If present mode is a known mode,

Judge that then whether all command list (CLIST)s are empty, if, execution in step then:

Adding present mode to traversal finishes in the tabulation;

Judge that whether travel through the number of finishing tabulation equates with the number of known mode tabulation, if equate, then returns null command; Otherwise the order line generator produces pending order from the mode switch command list (CLIST);

Otherwise, execution in step:

The order line generator produces pending order according to order producing method and order line key element from all command list (CLIST)s;

The order line generator is deleted the order that is produced from all command list (CLIST)s.

7. according to the automatic test approach of claim 5 or 6 described user interfaces, it is characterized in that described order producing method comprises producing method and producing method in proper order at random.

8. according to the automatic test approach of claim 5 or 6 described user interfaces, it is characterized in that described order key element comprises: CMD, order association symbol, order end mark, command parameter type, command parameter scope, command mode uniqueness.

9. according to the automatic test approach of one of them described user interface of claim 4 to 6, it is characterized in that described step B further comprises:

If order that the order line generator produced is for empty, ending said process then, otherwise, carry out the following step:

The order that B1, order line actuator fill order row generator are produced, and return performed result;

B2, if the emergence pattern of carrying out as a result switches, the mode switch command list (CLIST) is put in described order;

B3, interpretation of result processing module are handled order according to return results;

B4, execution in step A.

10. the automatic test approach of user interface according to claim 9 is characterized in that, also carries out before execution in step B1: the order line filter is to filtering from the order in the order line tabulation.

Images