CN111881054A - User interface automation test method, system, equipment and storage medium - Google Patents

Abstract

The present invention provides a user interface automated testing method, system, device and storage medium. The method includes: establishing at least one image comparison verification point based on a UI object of the user interface, the image comparison verification point is associated with at least part of the code, each The image comparison verification point corresponds to the local area in the user interface, and the standard picture of each image comparison verification point is set. The current screenshot is obtained by taking a screenshot of the local area through the image comparison verification point, and the mapping relationship between the current screenshot and the current screenshot comparison verification point is established. When it is judged through graphic comparison that the current screenshot is different from the standard image of the image comparison verification point of the current screenshot, it is detected whether there is an error in the code associated with the generation of the current screenshot, and if so, the standard image of the image comparison verification point is maintained unchanged. , if not, replace the standard picture of the image comparison verification point with the current screenshot, and the present invention can realize the effect of UI automation test.

Description

User interface automated testing method, system, device and storage medium

technical field

The present invention relates to the field of UI automation testing, in particular, to a user interface automatic testing method, system, device and storage medium.

Background technique

UI design (or interface design) refers to the overall design of software human-computer interaction, operation logic, and beautiful interface. UI design is divided into physical UI and virtual UI. The commonly used UI design on the Internet is virtual UI, and UI is the abbreviation of User Interface. A good UI design not only makes the software personal and tasteful, but also makes the operation of the software comfortable, simple and free, fully reflecting the positioning and characteristics of the software.

At present, in the process of UI automation testing, the verification of the expected result is mainly achieved by obtaining the value of the control. The main disadvantages of doing this are as follows:

(1) UI controls often change with changes in demand, and testers need to maintain test cases frequently, which is costly.

(2) The style of the UI cannot be verified.

(3) In the case of many verification points, a large number of test cases need to be written, which further increases the cost of writing and maintaining test cases. Therefore, a new verification method is needed for UI automation testing to avoid the above drawbacks, improve test efficiency, and reduce maintenance costs.

Therefore, the present invention provides a user interface automated testing method, system, device and storage medium.

SUMMARY OF THE INVENTION

In view of the problems in the prior art, the purpose of the present invention is to provide a user interface automated testing method, system, equipment and storage medium, overcome the difficulties of the prior art, solve the maintenance and verification difficulties faced by the UI automated testing, and can Realize the effect of verifying the verification points of UI automation testing by comparison methods such as images, texts, and AI.

An embodiment of the present invention provides an automated testing method for a user interface, comprising the following steps:

S101, establishing at least one image comparison verification point based on the UI object of the user interface, the image comparison verification point is associated with at least part of the code, and each image comparison verification point corresponds to a local area in the user interface, Set standard pictures for each of the image comparison verification points.

S102 , taking a screenshot of the local area through the image comparison verification point to obtain a current screenshot, and establishing a mapping relationship between the current screenshot and the current screenshot comparison verification point.

S103: Determine whether the current screenshot is different from the standard picture of the image comparison verification point described in the current screenshot through graphic comparison, and if so, execute step S104, and if not, end.

S104. Detect whether there is an error in the code associated with the generation of the current screenshot, if yes, execute step S105, and if not, execute step S106.

S105, maintaining the standard picture of the image comparison verification point unchanged.

S106. Replace the standard picture of the image comparison verification point with the current screenshot.

Preferably, in the step S102, a mapping relationship among the current screenshot, the current screenshot comparison verification point and the UI object is established.

Preferably, the step S103 includes covering the area where the UI object in the user interface where the current screenshot is the same as the standard picture of the verification point by a first color, and using a second color different from the first color The colors cover the area of the UI object where the current screenshot is different from the standard picture of the verification point in the user interface.

Preferably, the step S103 includes covering the code corresponding to the current screenshot in the user interface that is different from the standard picture of the verification point by a third color.

Preferably, the step S105 further includes generating error reporting information, where the error reporting information includes at least a UI object, a code associated with the current screenshot, and the current screenshot.

Preferably, the step S105 includes outputting the code associated with the current screenshot and the current screenshot, and establishing an error code sample set.

Preferably, in the step S105, the UI object is any one or a combination of the following:

button.

text.

image.

icon.

data field.

advertising space.

Preferably, in the step S101, the image comparison verification point is written in the code through the Airtest SDK or the Selenium SDK.

Preferably, in the step S103, the current screenshot and the standard picture of the image comparison verification point described in the current screenshot are sent to the Watcher comparison platform, and the graphic comparison is performed through the Watcher comparison platform to obtain a comparison. result.

An embodiment of the present invention also provides an automated user interface testing system for implementing the above-mentioned automated user interface testing method, and the automated user interface testing system includes:

The object preset module establishes at least one image comparison verification point based on the UI object of the user interface, the image comparison verification point is associated with a part of the code, and each image comparison verification point corresponds to a part of the user interface. area, set a standard picture for each of the image comparison verification points.

The mapping relationship module obtains a current screenshot by taking a screenshot of the local area through the image comparison verification point, and establishes a mapping relationship between the current screenshot and the current screenshot comparison verification point.

The graphic comparison module judges whether the current screenshot is different from the standard picture of the image comparison verification point described in the current screenshot through graphic comparison, and if so, executes the error detection module, and if not, ends.

The error detection module detects whether there is an error in the code associated with the generation of the current screenshot, if yes, executes the first execution module, and if not, executes the second execution module.

The first execution module maintains the standard picture of the image comparison verification point unchanged.

The second execution module replaces the standard picture of the image comparison verification point with the current screenshot.

Embodiments of the present invention also provide a user interface automated testing device, including:

processor.

a memory in which executable instructions for the processor are stored.

Wherein, the processor is configured to execute the steps of the above-mentioned automated user interface testing method by executing the executable instructions.

Embodiments of the present invention also provide a computer-readable storage medium for storing a program, when the program is executed, the steps of the above-mentioned automated user interface testing method are implemented.

The user interface automatic testing method, system, equipment and storage medium of the present invention solve the maintenance and verification difficulties faced by UI automatic testing, and can realize the verification of UI automatic testing verification points by using images, texts, AI and other comparison methods. It improves the efficiency of testers writing UI automation tests, reduces the maintenance cost and false positive rate of UI automation use cases, and facilitates testers or related personnel to intuitively and efficiently view and understand where problems occur, speeding up the detection of bugs. efficiency.

Description of drawings

Other features, objects and advantages of the present invention will become more apparent upon reading the detailed description of non-limiting embodiments with reference to the following drawings.

FIG. 1 is a flow chart of the user interface automatic testing method of the present invention.

FIG. 2 is a schematic block diagram of the user interface automatic testing system of the present invention.

FIG. 3 is a schematic structural diagram of the user interface automatic testing device of the present invention. as well as

FIG. 4 is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention.

Detailed ways

Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals in the drawings denote the same or similar structures, and thus their repeated descriptions will be omitted.

FIG. 1 is a flow chart of the user interface automatic testing method of the present invention. As shown in Figure 1, an embodiment of the present invention provides a user interface automated testing method, comprising the following steps:

S101, establishing at least one image comparison verification point based on the UI object of the user interface, the image comparison verification point is associated with at least part of the code, each image comparison verification point corresponds to a local area in the user interface, and each image comparison verification point is set Standard picture of verification point.

S102 , taking a screenshot of a local area through the image comparison verification point to obtain a current screenshot, and establishing a mapping relationship between the current screenshot and the current screenshot comparison verification point.

S103: Determine whether the current screenshot is different from the standard picture of the image comparison verification point of the current screenshot through graphic comparison, if yes, execute step S104, if not, execute step S107.

S104. Detect whether there is an error in the code associated with the generation of the current screenshot, if yes, go to step S105, and if not, go to step S106.

S105, maintaining the standard picture of the image comparison verification point unchanged.

S106. Replace the standard picture of the image comparison verification point with the current screenshot.

S107. End.

The invention solves the maintenance and verification difficulties faced by the UI automation test, and can realize the effect of using images, texts, AI and other comparison methods to verify the verification points of the UI automation test.

In a preferred solution, in step S102, a mapping relationship among the current screenshot, the current screenshot comparison verification point and the UI object is established, so that in the subsequent steps, when it is found that it is different from the standard picture, the relevant UI can be quickly and accurately found objects, determine when to check for faulty objects, speeding up the efficiency of automated testing of user interfaces.

In a preferred solution, step S103 includes covering the area where the UI object where the current screenshot is the same as the standard picture of the verification point in the user interface is covered with a first color, and covering with a second color different from the first color The area where the current screenshot in the user interface is different from the standard image of the verification point is located.

In a preferred solution, step S103 includes covering the code corresponding to the current screenshot in the user interface that is different from the standard picture of the verification point by a third color.

In a preferred solution, in step S105, it also includes generating error report information, and the error report information includes at least the UI object, the code associated with the current screenshot, and the current screenshot, so that in the subsequent steps, when it is found that it is different from the standard picture, it can be quickly and accurately found. Related UI objects determine the code that needs to be checked for bugs, which greatly shortens the time for bug checking and speeds up the efficiency of automated user interface testing.

In a preferred solution, step S105 includes outputting the code associated with the current screenshot and the current screenshot, and establishing an error code sample set.

In a preferred solution, in step S105, the UI object is any one or a combination of the following: button, text, image, icon, data field, and advertising space.

In a preferred solution, in step S101, an image comparison verification point is written in the code through Airtest SDK or Selenium SDK.

In a preferred solution, in step S103, the standard picture of the current screenshot and the image comparison verification point of the current screenshot is sent to the Watcher comparison platform, and the graphics comparison is performed through the Watcher comparison platform to obtain the comparison result.

By integrating the existing technologies such as Airtest, Selenium, OpenCV, YOLO and the like, the present invention realizes the purpose of verifying the verification points of the UI automation test by using image, text and AI comparison methods.

In the present invention, in the process of writing UI automation test cases, the user writes the image comparison verification point through the method provided by Airtest SDK or Selenium SDK. When the test case is executed for the first time, the verification point will capture the corresponding screenshot and upload it to On the Watcher platform, the image of the verification point executed for the first time will be marked as the benchmark image.

When the test case is subjected to regression testing, the newly captured image of the verification point will be compared with the benchmark image. If the comparison result is the same, the verification point is passed. If the comparison result is different, the tester needs to confirm whether it is a bug. If it is a bug, Then record the bug, and the benchmark map can be left unchanged. If it is not caused by a bug but by a UI change, you need to set the new screenshot as the new baseline image.

The present invention is mainly composed of Airtest SDK, Watcher platform and Watcher image comparison service:

Among them, Airtest is an open source UI automation testing framework, which supports UI automation testing of Android, IOS, Web and other platforms. In order to enable Airtest to support the verification testing technology of the present invention, the present invention provides the Airtest SDK, a Python framework package. By introducing the Airtest SDK into the automated test project, automated use cases can easily insert verification points.

The Watcher comparison platform is a Web site, which is mainly responsible for image comparison, comparison test results display, test configuration, etc. In the Watcher comparison platform, we can intuitively view the final results of the comparison and the short information of the test cases. , and distinguish success/failure/added use cases with colors and icons. The Watcher image comparison service is a RESTFUL service site that provides a series of services for image comparison and returns the comparison results.

For test cases that fail the comparison, the test or developer still needs to review and confirm, and the relevant personnel can view the detailed results of the comparison on the comparison result details page. If the test case is actually passed, mark the result as passed, and if you need to replace the benchmark image, you can also choose to replace the latest screenshot with the benchmark image. If the test result is actually a failure, mark the result as failed and log the defect,

In the process of reviewing the test results, the comparison settings of the test cases can also be modified, such as setting ignore areas, setting thresholds, etc.

The key of the visual test in the present invention lies in the image comparison, so the quality of the image comparison algorithm becomes the key to the success of the visual test. Watcher provides a variety of image comparison modes, namely precise comparison (pixels), template comparison, content comparison and AI comparison.

In a preferred example, accurate comparison is achieved by pixel comparison, which is the default and most commonly used comparison method of Watcher. Here we use the algorithm in OpenCV to implement. The advantage of accurate comparison is that it is more comprehensive. The style and content of the page are within the comparison range, but sometimes it is too sensitive, and a slight change in the style will affect the comparison result. Therefore, for some pages or areas, you can also choose the way of content comparison. The content comparison is mainly realized through the text recognition of the image,

Template comparison is to first circle the screenshot of the region to be compared in the baseline screenshot, and then perform image template matching according to the screenshot of the region in the latest screenshot, which is also realized by the algorithm of OpenCV.

AI comparison is a comparison method in Watcher that is still in the trial phase. Through AI image recognition technology, we can intelligently ignore normal differences (such as dates, changes in control size, etc.) Abnormal parts (such as missing images, text stacking, etc.) are implemented using YOLOv3.

The Watcher in the present invention provides a complete set of visual testing solutions from SDK to image comparison & result display to confirmation. Through this solution, the following effects are mainly achieved: improve the efficiency of testers writing UI automation tests, reduce the maintenance cost and false positive rate of UI automation use cases, and testers or related personnel can view and understand intuitively and efficiently where the problem occurs.

The user interface automatic testing method of the present invention solves the problems of maintenance and verification difficulties faced by UI automatic testing, can realize the effect of using images, texts, AI and other comparison methods to verify the verification points of UI automatic testing, and improves the tester's ability to write UI. The efficiency of automated testing reduces the maintenance cost and false positive rate of UI automation use cases, so that testers or related personnel can intuitively and efficiently view and understand where problems occur, and speed up the efficiency of checking bugs.

FIG. 2 is a schematic block diagram of the user interface automatic testing system of the present invention. As shown in FIG. 2 , an embodiment of the present invention also provides a user interface automatic testing system for implementing the above-mentioned user interface automatic testing method, and the user interface automatic testing system 9 includes:

The object preset module 91 establishes at least one image comparison verification point based on the UI object of the user interface, the image comparison verification point is associated with part of the code, each image comparison verification point corresponds to a local area in the user interface, and each image comparison verification point is set Standard images for image comparison verification points.

The mapping relationship module 92 obtains the current screenshot by taking a screenshot of the local area through the image comparison verification point, and establishes a mapping relationship between the current screenshot and the current screenshot comparison verification point.

The graphic comparison module 93 judges whether the current screenshot is different from the standard picture of the image comparison verification point of the current screenshot through graphic comparison, if so, executes the error detection module 94, and if not, ends.

The error detection module 94 detects whether there is an error in the code associated with the generation of the current screenshot, if so, executes the first execution module 95 , and if not, executes the second execution module 96 .

The first execution module 95 maintains the standard picture of the image comparison verification point unchanged.

The second execution module 96 replaces the standard picture of the image comparison verification point with the current screenshot.

The user interface automatic testing system of the present invention solves the problems of maintenance and verification difficulties faced by UI automatic testing, and can realize the effect of using images, texts, AI and other comparison methods to verify the verification points of the UI automatic testing, and improve the tester's ability to write UI. The efficiency of automated testing reduces the maintenance cost and false positive rate of UI automation use cases, so that testers or related personnel can intuitively and efficiently view and understand where problems occur, and speed up the efficiency of checking bugs.

The embodiment of the present invention also provides a user interface automatic testing device, which includes a processor. A memory in which executable instructions for the processor are stored. Wherein, the processor is configured to execute the steps of the user interface automation testing method via executing the executable instructions.

As shown above, this embodiment solves the problems of maintenance and verification difficulties faced by UI automation testing, and can achieve the effect of using images, text, and AI to verify the verification points of UI automation testing, and improve the tester's ability to write UI automation. The efficiency of testing reduces the maintenance cost and false positive rate of UI automation use cases, so that testers or related personnel can intuitively and efficiently view and understand where problems occur, and speed up the efficiency of checking bugs.

As will be appreciated by one skilled in the art, various aspects of the present invention may be implemented as a system, method or program product. Therefore, various aspects of the present invention can be embodied in the following forms: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software aspects, which may be collectively referred to herein as implementations "Circuit", "Module" or "Platform".

FIG. 3 is a schematic structural diagram of the user interface automatic testing device of the present invention. The electronic device 600 according to this embodiment of the present invention is described below with reference to FIG. 3 . The electronic device 600 shown in FIG. 3 is only an example, and should not impose any limitation on the function and scope of use of the embodiments of the present invention.

As shown in FIG. 3, electronic device 600 takes the form of a general-purpose computing device. Components of the electronic device 600 may include, but are not limited to, at least one processing unit 610, at least one storage unit 620, a bus 630 connecting different platform components (including the storage unit 620 and the processing unit 610), a display unit 640, and the like.

The storage unit stores program codes, which can be executed by the processing unit 610, so that the processing unit 610 executes the steps according to various exemplary embodiments of the present invention described in the foregoing electronic prescription flow processing method section of this specification. For example, the processing unit 610 may perform the steps shown in FIG. 1 .

The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 6201 and/or a cache storage unit 6202 , and may further include a read only storage unit (ROM) 6203 .

The storage unit 620 may also include a program/utility 6204 having a set (at least one) of program modules 6205 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, An implementation of a network environment may be included in each or some combination of these examples.

The bus 630 may be representative of one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local area using any of a variety of bus structures bus.

The electronic device 600 may also communicate with one or more external devices 700 (eg, keyboards, pointing devices, Bluetooth devices, etc.), with one or more devices that enable a user to interact with the electronic device 600, and/or with Any device (eg, router, modem, etc.) that enables the electronic device 600 to communicate with one or more other computing devices. Such communication may occur through input/output (I/O) interface 650 . Also, the electronic device 600 may communicate with one or more networks (eg, a local area network (LAN), a wide area network (WAN), and/or a public network such as the Internet) through a network adapter 660 . Network adapter 660 may communicate with other modules of electronic device 600 through bus 630 . It should be appreciated that, although not shown, other hardware and/or software modules may be used in conjunction with electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives And data backup storage platform, etc.

Embodiments of the present invention further provide a computer-readable storage medium for storing a program, and the steps of an automated user interface testing method implemented when the program is executed. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes program code, when the program product runs on a terminal device, the program code is used to cause the terminal device to execute the above-mentioned description in this specification. The steps according to various exemplary embodiments of the present invention are described in the section of the electronic prescription flow processing method.

As shown above, this embodiment solves the problems of maintenance and verification difficulties faced by UI automation testing, and can achieve the effect of using images, text, and AI to verify the verification points of UI automation testing, and improve the tester's ability to write UI automation. The efficiency of testing reduces the maintenance cost and false positive rate of UI automation use cases, so that testers or related personnel can intuitively and efficiently view and understand where problems occur, and speed up the efficiency of checking bugs.

FIG. 4 is a schematic structural diagram of a computer-readable storage medium of the present invention. Referring to FIG. 4, a program product 800 for implementing the above method according to an embodiment of the present invention is described, which can adopt a portable compact disk read only memory (CD-ROM) and include program codes, and can be stored in a terminal device, For example running on a personal computer. However, the program product of the present invention is not limited thereto, and in this document, a readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples (non-exhaustive list) of readable storage media include: electrical connections with one or more wires, portable disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

A computer-readable storage medium may include a data signal propagated in baseband or as part of a carrier wave with readable program code embodied thereon. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A readable storage medium can also be any readable medium other than a readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages—such as Java, C++, etc., as well as conventional procedural programming Language - such as the "C" language or similar programming language. The program code may execute entirely on the user computing device, partly on the user device, as a stand-alone software package, partly on the user computing device and partly on a remote computing device, or entirely on the remote computing device or server execute on. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (eg, using an Internet service provider business via an Internet connection).

To sum up, the user interface automatic testing method, system, device and storage medium of the present invention solve the maintenance and verification difficulties faced by UI automatic testing, and can realize the verification of UI automatic testing using image, text, AI and other comparison methods The effect of point verification improves the efficiency of testers writing UI automation tests, reduces the maintenance cost and false positive rate of UI automation use cases, and facilitates testers or related personnel to intuitively and efficiently view and understand where the problem occurs, speeding up Check the efficiency of BUG.

The above content is a further detailed description of the present invention in combination with specific preferred embodiments, and it cannot be considered that the specific implementation of the present invention is limited to these descriptions. For those of ordinary skill in the technical field of the present invention, without departing from the concept of the present invention, some simple deductions or substitutions can be made, which should be regarded as belonging to the protection scope of the present invention.

Claims (12)

1. An automated testing method for a user interface is characterized by comprising the following steps:

s101, establishing at least one image comparison verification point based on a UI object of a user interface, wherein the image comparison verification point is associated with at least part of codes, each image comparison verification point corresponds to a local area in the user interface, and a standard picture of each image comparison verification point is set;

s102, obtaining a current screenshot from the local area screenshot through an image comparison verification point, and establishing a mapping relation between the current screenshot and the current screenshot comparison verification point;

s103, judging whether the current screenshot is different from a standard picture of the image comparison verification point of the current screenshot through image comparison, if so, executing the step S104, and if not, ending the step;

s104, detecting whether the code associated with the current screenshot is generated to be wrong or not, if so, executing a step S105, and if not, executing a step S106;

s105, maintaining the standard picture of the image comparison verification point unchanged;

and S106, replacing the standard picture of the image comparison verification point with the current screenshot.

2. The method for automatically testing a user interface according to claim 1, wherein in step S102, a mapping relationship among the current screenshot, the current screenshot comparison verification point, and a UI object is established.

3. The method for automatically testing a user interface according to claim 1, wherein the step S103 includes covering, by a first color, an area where the UI object having the same current screenshot as the standard picture of the verification point is located in the user interface, and covering, by a second color different from the first color, an area where the UI object having the different current screenshot from the standard picture of the verification point is located in the user interface.

4. The method for automatically testing the user interface according to claim 1, wherein the step S103 includes covering a code corresponding to a current screenshot of the user interface different from the standard picture of the verification point with a third color.

5. The method for automatically testing a user interface according to claim 1, wherein the step S105 further comprises generating error information, wherein the error information at least includes a UI object, and a code associated with the current screenshot and the current screenshot.

6. The method for automatically testing the user interface according to claim 1, wherein the step S105 includes outputting a code associated with the current screenshot and the current screenshot, and creating an error code sample set.

7. The method for automatically testing the user interface according to claim 1, wherein in the step S105, the UI object is any one or a combination of the following:

a button;

a text;

an image;

an icon;

a data field;

an ad slot.

8. The method for automatically testing the user interface according to claim 1, wherein in step S101, an image contrast verification point is written in the code by Airtest SDK or Selenium SDK.

9. The method according to claim 1, wherein in step S103, the standard pictures of the image comparison verification points of the current screenshot and the current screenshot are sent to a watch comparison platform, and a comparison result is obtained by performing a graph comparison through the watch comparison platform.

10. A user interface automated testing system for implementing the user interface automated testing method of claim 1, comprising:

the object presetting module is used for establishing at least one image comparison verification point based on a UI object of a user interface, wherein the image comparison verification point is associated with a part of codes, each image comparison verification point corresponds to a local area in the user interface, and a standard picture of each image comparison verification point is set;

the mapping relation module obtains the local area screenshot through an image comparison verification point to obtain a current screenshot, and establishes a mapping relation between the current screenshot and the current screenshot comparison verification point;

the image comparison module judges whether the current screenshot is different from the standard image of the image comparison verification point of the current screenshot through image comparison, if so, the error detection module is executed, and if not, the process is ended;

the error detection module is used for detecting whether the code associated with the current screenshot is generated has errors or not, if so, the first execution module is executed, and if not, the second execution module is executed;

the first execution module maintains the standard picture of the image comparison verification point unchanged;

and the second execution module is used for replacing the standard picture of the image comparison verification point with the current screenshot.

11. A user interface automated testing device, comprising:

a processor;

a memory having stored therein executable instructions of the processor;

wherein the processor is configured to perform the steps of the user interface automated testing method of any of claims 1 to 10 via execution of the executable instructions.

12. A computer-readable storage medium storing a program which, when executed, performs the steps of the method of automated testing of a user interface of any of claims 1 to 10.

Images