CN112650670A

CN112650670A - Application testing method, device, system, electronic equipment and storage medium

Info

Publication number: CN112650670A
Application number: CN202011502053.5A
Authority: CN
Inventors: 李秋林; 任星旺
Original assignee: Jingdong Shuke Haiyi Information Technology Co Ltd
Current assignee: Jingdong Shuke Haiyi Information Technology Co Ltd
Priority date: 2020-12-17
Filing date: 2020-12-17
Publication date: 2021-04-13
Anticipated expiration: 2040-12-17
Also published as: CN112650670B

Abstract

The embodiment of the invention discloses an application testing method, device and system, electronic equipment and a storage medium. Relates to the technical field of computers and is used for solving the problem of low application test efficiency. Receiving test task information sent by a client, and creating a test task according to the test task information; compiling a source code of an application to be tested corresponding to the test task, and triggering a test machine to run the application to be tested based on a target file obtained by compiling; acquiring an automated test case corresponding to the application to be tested, and triggering automated test equipment to execute the automated test case aiming at the application to be tested running by the test machine; and generating a test report corresponding to the test task according to the execution result of the automatic test case, and returning the test report to the user terminal for displaying. By the technical scheme of the embodiment of the invention, the efficiency of the application test is improved.

Description

Application testing method, device, system, electronic equipment and storage medium

Technical Field

The embodiment of the invention relates to the technical field of computers, in particular to an application testing method, device and system, electronic equipment and a storage medium.

Background

Software testing is a process of auditing or comparing between actual output and expected output. The classical definition of software testing is: the process of operating a program under specified conditions to discover program errors, to measure software quality, and to evaluate whether it meets design requirements.

In the process of implementing the invention, the inventor finds that at least the following technical problems exist in the prior art:

the existing application software test, namely the process of the application test, comprises a plurality of steps, each step is relatively dispersed, different systems and platforms are needed to be used in different steps, the test process is not consistent, and the test efficiency is low.

Disclosure of Invention

The embodiment of the invention provides an application test method, device and system, electronic equipment and a storage medium, so as to improve the efficiency of application test.

In a first aspect, an embodiment of the present invention provides an application testing method, where the method includes:

receiving test task information sent by a client, and creating a test task according to the test task information;

compiling a source code of an application to be tested corresponding to the test task, and triggering a test machine to run the application to be tested based on a target file obtained by compiling;

acquiring an automated test case corresponding to the application to be tested, and triggering automated test equipment to execute the automated test case aiming at the application to be tested running by the test machine;

and generating a test report corresponding to the test task according to the execution result of the automatic test case, and returning the test report to the client for displaying.

In a second aspect, an embodiment of the present invention further provides an application testing method, where the method includes:

when detecting the application test triggering operation of a user, displaying a test task interface;

acquiring the test task information input by a user through the test task interface, and sending the test task information to a server;

receiving a test report returned by the server, and displaying the test report;

the test report is generated according to the execution result of the automatic test case after the server creates a test task according to the test task information, compiles the source code of the application to be tested corresponding to the test task, triggers the tester to run the application to be tested based on the target file obtained by compiling, obtains the automatic test case corresponding to the application to be tested, and triggers the automatic test equipment to execute the automatic test case aiming at the application to be tested running by the tester.

In a third aspect, an embodiment of the present invention further provides an application testing apparatus, including:

the system comprises a test task creating module, a test task processing module and a test task processing module, wherein the test task creating module is used for receiving test task information sent by a client and creating a test task according to the test task information;

the to-be-tested application running module is used for compiling the source code of the to-be-tested application corresponding to the test task and triggering the tester to run the to-be-tested application based on the target file obtained by compiling;

the automatic test case execution module is used for acquiring an automatic test case corresponding to the application to be tested and triggering automatic test equipment to execute the automatic test case aiming at the application to be tested running by the test machine;

and the test report generating module is used for generating a test report corresponding to the test task according to the execution result of the automatic test case, and returning the test report to the client for displaying.

In a fourth aspect, an embodiment of the present invention further provides an application testing apparatus, including:

the system comprises a test task interface display module, a test task interface display module and a test task interface display module, wherein the test task interface display module is used for displaying a test task interface when application test trigger operation of a user is detected;

the system comprises a test task information sending module, a service end and a task information processing module, wherein the test task information sending module is used for acquiring test task information input by a user through a test task interface and sending the test task information to the service end;

the test report receiving module is used for receiving the test report returned by the server and displaying the test report;

In a fifth aspect, an embodiment of the present invention further provides an application testing system, where the system includes: server and user terminal, wherein:

the user terminal is used for displaying a test task interface when detecting the application test triggering operation of a user; acquiring the test task information input by a user through the test task interface, and sending the test task information to a server; receiving a test report returned by the server, and displaying the test report;

the server is used for receiving the testing task information sent by the user terminal and creating a testing task according to the testing task information; compiling a source code of an application to be tested corresponding to the test task, and triggering a test machine to run the application to be tested based on a target file obtained by compiling; acquiring an automated test case corresponding to the application to be tested, and triggering automated test equipment to execute the automated test case aiming at the application to be tested running by the test machine; and generating a test report corresponding to the test task according to the execution result of the automatic test case, and returning the test report to the user terminal.

In a sixth aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:

one or more processors;

a storage device for storing one or more programs,

when executed by the one or more processors, cause the one or more processors to implement an application testing method as provided by any of the embodiments of the invention.

In a seventh aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the application testing method provided in any embodiment of the present invention.

The embodiment of the invention has the following advantages or beneficial effects:

according to the embodiment of the invention, the test task information sent by the client is received, and the test task is established according to the test task information; compiling a source code of an application to be tested corresponding to the test task, and triggering a test machine to run the application to be tested based on a target file obtained by compiling; acquiring an automated test case corresponding to the application to be tested, and triggering automated test equipment to execute the automated test case aiming at the application to be tested running by the test machine; the test report corresponding to the test task is generated according to the execution result of the automatic test case, the test report is returned to the user terminal for displaying, the scheme of automatically integrating the whole test flow is realized, namely, the whole test flow can be completed by using one system platform, the problems of incoherent test flow and low test efficiency of the conventional application test are solved, the test flow is simple and visual in operation, the data of the whole test process are conveniently recorded at the same time, and the test efficiency is improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description will be given below of the drawings required for the embodiments or the technical solutions in the prior art, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a schematic flow chart of an application testing method according to an embodiment of the present invention;

FIG. 2 is a schematic flow chart of another application testing method provided in the second embodiment of the present invention;

fig. 3 is a schematic flowchart of an application testing method according to a third embodiment of the present invention;

FIG. 4 is a schematic diagram of a task interface for providing a test according to a third embodiment of the present invention;

FIG. 5 is a diagram showing the results of an energy efficiency analysis according to a third embodiment of the present invention;

fig. 6(a) is a schematic diagram of a flow progress of a task detail interface according to a third embodiment of the present invention;

fig. 6(b) is a schematic diagram of an operation log of a test task detail interface according to a third embodiment of the present invention;

fig. 6(c) is a schematic diagram of a use case for associating a test task detail interface according to a third embodiment of the present invention;

fig. 6(d) is a schematic diagram of an association BUG list of a test task detail interface according to a third embodiment of the present invention;

fig. 7 is an interaction flow diagram of an application testing method according to a fourth embodiment of the present invention;

fig. 8 is a schematic structural diagram of an application testing apparatus according to a fifth embodiment of the present invention;

fig. 9 is a schematic structural diagram of an application testing apparatus according to a sixth embodiment of the present invention;

fig. 10 is a schematic structural diagram of an application test system according to a seventh embodiment of the present invention;

fig. 11 is a schematic structural diagram of an electronic device according to an eighth embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.

Example one

Fig. 1 is a flowchart of an application testing method according to an embodiment of the present invention, which can be applied to a server and is suitable for a situation where a developed application software needs to be tested. The method may be performed by an application testing apparatus, which may be implemented by means of software and/or hardware. Optionally, the application testing device may be configured in a server. As shown in fig. 1, the method specifically includes the following steps:

and S110, receiving the test task information sent by the client, and creating a test task according to the test task information.

In order to measure whether the application software meets the design requirements, the software needs to be tested, i.e. a program is operated under specified conditions to find out program errors, and the quality of the software is measured. Different systems and platforms are needed to be used in different steps in the existing software testing process, and the connection between each system and each platform is not very tight, so that the testing efficiency is not improved; and the existing software testing tools and the like are deployed according to a layered structure, so that the automatic coverage rate is low in the complete testing implementation process. In order to solve the problems and improve the automation coverage rate and the test efficiency in the test process, the technical scheme of the embodiment of the invention constructs a platform capable of supporting the whole test process and accesses a detection and test tool into each step of the test, so that complete test data can be obtained and analyzed, the test efficiency is improved, and the research and development quality is promoted. Specifically, the method includes receiving test task information sent by a client, and creating a test task according to the test task information. Specifically, the test task information includes, but is not limited to, at least one of a test title, a test department, a test time, a test completion time, a requirement presenter, an application developer, a tester, an application to be tested, test content, and a requirement document address. The created test task may include a test task identifier and corresponding test task information.

Optionally, after the test task is created according to the test task information and before the source code of the application to be tested corresponding to the test task is compiled, the relevant person corresponding to the test task may be determined according to the test task information, and the service provided by the information sending module is called to automatically send a test notification to the communication account corresponding to the relevant person, so that the relevant person knows that the application to be tested is tested according to the test notification and successfully establishes the test task on the platform. Wherein the related personnel may include at least one of a requirement proposition person, an application development person, and a testing person. Optionally, when a request for a notification of a test sent by the client is received, the relevant person corresponding to the test task in the request for notification of a test is determined, and the test notification is sent to the communication account corresponding to the relevant person by calling the service provided by the information sending module. The prompt notification request is generated after a user performs a prompt notification trigger operation on an interface of the client, where the prompt notification trigger operation may be clicking a prompt notification button in the interface of the client, and the like. Alternatively, the user may be an application developer. Optionally, the communication account may be an instant communication account such as a mobile phone number, a mailbox, a WeChat, and the like. Optionally, after the test task is created according to the test task information, a test report viewing request sent by the client may be received, a test report is generated according to the test task information, and the test report is sent to the client for displaying. The report viewing request is generated after a user executes a report viewing trigger operation on an interface of the client, where the report viewing trigger operation may be clicking a report button in the interface of the client, and the like. Alternatively, the user may be an application developer or tester. Optionally, the test report includes test title, test department, test time, test completion time, requirement presenter, application developer, tester, application to be tested, test content, and document address of requirement.

And S120, compiling the source code of the to-be-tested application corresponding to the test task, and triggering the tester to run the to-be-tested application based on the target file obtained by compiling.

In the embodiment of the invention, the test task is created according to the test task information, the source code of the to-be-tested application corresponding to the test task is obtained, the source code of the to-be-tested application is compiled, and the tester is triggered to run the to-be-tested application based on the target file obtained by compiling. Optionally, when an application construction request sent by the client is received, compiling a source code of the application to be tested corresponding to the test task, and triggering the test machine to run the application to be tested based on a target file obtained by compiling. The application construction request is generated after a user executes an application construction triggering operation on an interface of the client, where the application construction triggering operation may be clicking an application construction button in the interface of the client, and the like. Optionally, the user comprises a tester. In some embodiments, before the test machine is triggered to run the application to be tested based on the compiled target file, a service provided by the host management module is called, and an SHH (Secure Shell) protocol is adopted to access the test machine corresponding to the application to be tested to the system, that is, to establish a communication connection with the test machine, so that the compiled target file can be sent to the test machine based on the established connection, and the test machine runs the corresponding application to be tested based on the target file. Optionally, the access mode to the system includes two modes, i.e., user password authentication and public-private key password-less mode, which is not limited in this embodiment.

Specifically, the application management module stores application identifiers of the testable applications and application deployment information corresponding to the application identifiers in advance. Optionally, the application deployment information corresponding to the application identifier of the application to be tested corresponding to the test task may be obtained by calling the service provided by the application management module. The application deployment information comprises an application code address and a tester address. Alternatively, the application identification may be, but is not limited to, a name, a number, or a character string formed of at least one of numbers, letters, and characters, etc. of the application to be tested. And acquiring a source code of the application to be tested according to the application code address in the application deployment information, compiling the source code, and sending a target file obtained by compiling to a testing machine corresponding to the address of the testing machine, so that the testing machine runs the application to be tested based on the target file.

S130, obtaining an automatic test case corresponding to the application to be tested, and triggering the automatic test equipment to execute the automatic test case aiming at the application to be tested running on the test machine.

In the embodiment of the invention, when a test acceptance request sent by a client is received, an automatic test case corresponding to an application to be tested is obtained by calling the service provided by the automatic test equipment, and the automatic test equipment is automatically triggered to execute the automatic test case aiming at the application to be tested running by the tester. The test acceptance request is generated after the user performs a test acceptance trigger operation on the interface of the client, and the test acceptance trigger operation may be clicking a test acceptance button or the like on the interface of the client. Alternatively, the user may be a tester. The automation test cases comprise automation interface test cases and/or automation UI test cases.

Optionally, the use case management module obtains the relevant information of the executed automatic test case, and sends the relevant information of the automatic test case to the client for displaying, so that a relevant user can know the situation of the executed automatic test case more clearly when testing the application to be tested.

Optionally, after the automated testing device is triggered to execute the automated testing case for the application to be tested running in the testing machine, the functional testing coverage checking request sent by the client is received, the functional testing coverage of the application to be tested is obtained from the testing machine, and the functional testing coverage is returned to the client for displaying. Optionally, the functional test coverage may be obtained by performing statistical analysis by a test coverage statistical tool such as JACOCO deployed on the test machine.

Optionally, after the automated testing device is triggered to execute the automated testing case for the application to be tested running in the testing machine, error (BUG) information generated when the automated testing case is executed and sent by the automated testing device may be received, and the BUG information is sent to the client, so that the client displays the BUG information and obtains the BUG content and the BUG handler which are filled in the interface of the client by the user based on the BUG information. Optionally, the BUG information includes information such as an identifier of the BUG and a generated location. Optionally, the user may be a tester, the BUG content may include a unique identifier preset for the BUG, or may include specific BUG detail information, and the BUG handler may be a developer who writes a code corresponding to the BUG location. And then, when a BUG forwarding request which is sent by the client and carries the BUG content and the BUG handler is received, the BUG processing notification information is sent to a communication account corresponding to the BUG handler by calling the service provided by the information sending module. And when the change of the BUG state is detected, sending notification information of the change of the BUG state to a communication account number of related personnel corresponding to the test task by calling the service provided by the information sending module. Alternatively, the BUG state change may be that the BUG is removed or a new BUG is generated after the BUG handler processes the BUG. The above operations regarding the BUG process may be performed by a BUG management module provided in the system.

Optionally, after the test machine is triggered to run the application to be tested based on the compiled target file, an application log viewing request sent by the client may be received, and a running log of the application to be tested is obtained from the log retrieval platform, where the running log is generated by the log retrieval platform based on log information of the application to be tested read from a memory of a search Engine (ES), and the log information in the memory is log information generated in the running process of the application to be tested sent by the test machine. Alternatively, log information generated in real time during the test machine running the application to be tested may be periodically stored in the memory of the ES by an AGENT (AGENT) tool deployed on the test machine.

And S140, generating a test report corresponding to the test task according to the execution result of the automatic test case, and returning the test report to the client for display.

In the embodiment of the invention, the execution result of the automatic test case sent by the automatic test equipment can be received, the test report of the test task can be generated according to the execution result, and the test report can be sent to the client for displaying. Optionally, the test report may be automatically sent to the client for display when the test report is generated; the test report viewing trigger operation may be a click of a test report button in the client interface, or the like. In order to enable the relevant personnel of the test task to see the test report at the first time, the service provided by the information sending module can be called to send the test report to the communication account corresponding to the relevant personnel of the test task, and optionally, the communication account can be an instant communication account such as a mobile phone number, a mailbox, a micro message and the like. Optionally, the test report includes, but is not limited to, at least one of test tasks, test report departments, test results, related contacts, related documents, test dates, test cases, and other test contents.

Optionally, after a test report corresponding to the application to be tested is generated, an online notification check request sent by the client is received, a check list corresponding to the application to be tested is generated, and the check list is sent to the client, so that the client displays the check list. Wherein, the check list comprises check items to be confirmed before the application to be tested is online; specifically, the examination items include, but are not limited to: whether the code passes the code review, whether the test case passes the case review and is completely executed, whether all BUGs are repaired and verified before the on-line process, whether a test report is sent and other check items. Then, check item confirmation information sent by the client is received, wherein the check item confirmation information comprises check item confirmation information input in the check list by the user. Alternatively, the user may be an application developer. And finally, generating online notification information based on the checking item confirmation information, and sending the online notification information to the communication account number of the relevant person corresponding to the test task by calling the service provided by the information sending module so that the relevant person knows that the application to be tested is about to be online.

Optionally, after the online notification information is sent to the communication account of the relevant person corresponding to the test task, the online verification report checking request sent by the client may be received, an online verification table corresponding to the application to be tested is generated, and the online verification table is sent to the client, so that the client displays the online verification table. The online verification table comprises verification items which need to be confirmed by a user after the application to be tested is online. And then, receiving verification item confirmation information sent by the client, wherein the verification item confirmation information comprises verification confirmation information input by the user in the online verification table. Optionally, the user includes application developers, testers and production personnel. And finally, generating an online verification report based on the verification item confirmation information, and sending the online verification report to the communication account number of the relevant personnel corresponding to the test task by calling the service provided by the information sending module, so that the relevant personnel further know that the application to be tested is successfully online.

On the basis of the above embodiment, when an energy efficiency analysis request carrying analysis dimensions and sent by a client is received, energy efficiency analysis of each analysis dimension can be performed based on stored test process data of each application, so as to obtain energy efficiency analysis data. Wherein the energy efficiency analysis data is used for code quality quantification and/or work efficiency quantification. Optionally, the analysis dimensions include, but are not limited to: testing team dimension, personnel dimension, application dimension, project dimension and the like. And sending the generated energy efficiency analysis data to a client for displaying. Optionally, the energy efficiency analysis data corresponding to the dimension of the test team includes: at least one of an average demand period, an average development period, an average test period, an average lead time, a BUG average processing age, an average static code quality score, and an average single test coverage. Optionally, the energy efficiency analysis data corresponding to the staff dimension includes: at least one of acceptance number of test extraction, refund number of test extraction, average BUG solution failure, BUG reopening rate, static code quality score, single test coverage rate, average development period, execution coverage rate, effective BUG number, use case number, average test period, BUG rejection rate and automatic test case related number. The energy efficiency analysis data corresponding to the project dimension comprises the following steps: at least one of BUG situation, requirement cycle, BUG average processing aging, core working period, BUG reopening rate and requirement changing times. Optionally, the energy efficiency analysis data corresponding to the application dimension includes: at least one of static code quality score, test frequency improvement, single-side coverage, automatic test case relevance number and automatic deployment success rate.

According to the embodiment of the invention, the extracting and testing task information sent by the client is received, and the extracting and testing task is established according to the extracting and testing task information; compiling a source code of an application to be tested corresponding to the test task, and triggering a test machine to run the application to be tested based on a target file obtained by compiling; acquiring an automatic test case corresponding to an application to be tested, and triggering automatic test equipment to execute the automatic test case aiming at the application to be tested running in the test machine; the test report corresponding to the test task is generated according to the execution result of the automatic test case, and the test report is returned to the client for display, so that the problems of inconsistent test flow and low test efficiency of the existing application software are solved, the data of the whole test process are recorded at the same time, and the test efficiency is improved.

Example two

Fig. 2 is a flowchart of an application testing method according to a second embodiment of the present invention, where the present embodiment is applicable to a server and is applicable to a situation where a developed application software needs to be tested. On the basis of the above embodiment, after the test task is created according to the test task information and before the automated test case corresponding to the application to be tested is obtained, a trigger code specification detection device is added to test the execution unit of the application to be tested based on the source code of the application to be tested and scan the source code to obtain a code specification detection result; and returning the code specification detection result to the client for displaying. The sum is used for acquiring a smoking test case corresponding to the application to be tested and triggering the automatic test equipment to execute the smoking test case aiming at the application to be tested running by the test machine; and returning the smoking test result obtained after the smoking test case is executed to the client for displaying. And explanations of terms identical to or corresponding to the above-mentioned embodiments are omitted here. Referring to fig. 2, the application testing method provided in this embodiment includes:

s210, receiving the test task information sent by the client, and creating a test task according to the test task information.

S220, compiling the source code of the to-be-tested application corresponding to the test task, and triggering the tester to run the to-be-tested application based on the target file obtained by compiling.

S230, triggering the code specification detection equipment to test the application execution unit to be tested based on the source code of the application to be tested and scan the source code to obtain a code specification detection result; and returning the code specification detection result to the client for displaying.

In the embodiment of the invention, after the test task is created according to the test task information, the application deployment information of the to-be-tested application corresponding to the test task is automatically acquired. Optionally, an application code address is obtained from the application deployment information, and a source code of the application to be tested is obtained according to the application code address, where the source code includes a test code package, and the test code includes a unit test case corresponding to the task to be tested. And sending the source code containing the test code packet to the code specification detection equipment, so that the code specification detection equipment executes the unit test cases in the test code packet by calling locally deployed project management comprehensive tools such as MAVEN and the like, and acquires the execution results of the unit test cases, thereby realizing the unit test of the application to be tested. Meanwhile, after receiving the source code of the application to be tested, the code specification detection device can scan the source code of the application to be tested by calling a local code quality management tool such as SONAR (self-organizing network architecture), match the scanned code with a preset code specification and obtain a code scanning result according to the matching result. Then, a code specification detection result is generated based on the unit test case execution result and the unit code scanning result. And sending the generated code specification result to the client for displaying.

Optionally, when a unit test request sent by the client is received, the code specification detection device may be triggered to test the source code execution unit of the application to be tested and scan the source code, so as to generate a code specification detection result corresponding to the application to be tested, and send the code specification detection result to the client for displaying. The unit test request is generated after a user performs a unit test trigger operation on an interface of the client, where the unit test trigger operation may be clicking a unit test button in the client interface, or the like. Alternatively, the user may be a tester.

Optionally, when a unit test coverage checking request sent by the client is received, the unit test coverage when the unit test case is executed on the application to be tested is obtained from the code specification detection device, and the unit test coverage is sent to the client for displaying. Specifically, statistical analysis may be performed by a code quality management tool such as SONAR deployed in the code specification detection device to obtain the unit test coverage.

S240, acquiring a smoking test case corresponding to the application to be tested, and triggering the automatic test equipment to execute the smoking test case aiming at the application to be tested running on the test machine; and returning the smoking test result obtained after the smoking test case is executed to the client for displaying.

In the embodiment of the invention, the smoking test case of the application to be tested is obtained by calling the service of the automatic test equipment, the automatic test equipment is automatically triggered to execute the smoking test case aiming at the application to be tested running by the test machine, and the smoking test result obtained after the smoking test case is executed is returned to the client for displaying. The smoking test case comprises a smoking interface test case and/or a smoking UI test case.

Optionally, when a smoking test request sent by the client is received, a smoking test case corresponding to the application to be tested is obtained, and the automated testing equipment is triggered to execute the smoking test case for the application to be tested running in the testing machine. The smoking test request is generated after a user executes a smoking test triggering operation on an interface of the client. Optionally, executing the smoking test case may enable the tester to know the basic performance state of the application to be tested.

S250, obtaining an automatic test case corresponding to the application to be tested, and triggering the automatic test equipment to execute the automatic test case aiming at the application to be tested running on the test machine.

Optionally, in some disclosed embodiments, after the unit test case, the code scan, and the smoking test case are executed, the code specification detection result and the smoking test result are sent to the client for display, so that a user (e.g., a tester) determines whether to trigger a formal automated test according to the results, if the result is triggered, a test acceptance triggering operation is executed on an interface of the client, after the client detects the test acceptance triggering operation, the client sends a test acceptance request to the server, and when the server receives the test acceptance request sent by the client, the server obtains an automated test case corresponding to the application to be tested, and triggers the automated test equipment to execute the automated test case for the application to be tested running in the test machine.

The automatic test equipment is managed with a smoking test case and an automatic test case, the smoking test case is used for smoking test of the application to be tested, the automatic test case is used for formally and automatically testing the application to be tested, and compared with the automatic test, the smoking test has the test fineness smaller than that of the automatic test. The automatic test equipment can distinguish the smoking test case from the automatic test case by adding marks to the test case.

And S260, generating a test report corresponding to the test task according to the execution result of the automatic test case, and returning the test report to the client for displaying.

According to the embodiment of the invention, the extracting and testing task information sent by the client is received, and the extracting and testing task is established according to the extracting and testing task information; compiling a source code of an application to be tested corresponding to the test task, and triggering a test machine to run the application to be tested based on a target file obtained by compiling; acquiring an automatic test case corresponding to an application to be tested, and triggering automatic test equipment to execute the automatic test case aiming at the application to be tested running in the test machine; the test report corresponding to the test task is generated according to the execution result of the automatic test case, the test report is returned to the client for displaying, the data of the whole test process is recorded at the same time, the code specification detection result and the smoke test result are obtained and sent to the client for displaying by testing the execution unit test, the code scanning and the smoke test of the application to be tested, so that the tester can determine whether to perform the automatic case test, and the test efficiency is further improved.

EXAMPLE III

Fig. 3 is a flowchart of an application testing method according to a third embodiment of the present invention, and this embodiment is applied to a client and is applicable to a case where a developed application software needs to be tested. The method may be performed by an application testing apparatus, which may be implemented by means of software and/or hardware. Optionally, the application testing apparatus may be configured in a user terminal, and the user terminal may be an electronic device such as a notebook computer, an intelligent tablet, a mobile phone, and the like. As shown in fig. 3, the method specifically includes the following steps:

and S310, displaying a test task interface when detecting the application test triggering operation of the user.

In the embodiment of the invention, when the application test triggering operation of the user is detected, the test task interface is displayed, so that the user can input the test task information through the test task interface. An example of a test task interface is shown in fig. 4, and the test task information that needs to be input through the test task interface includes, but is not limited to, at least one of a test title, a test department, a test time, a test completion time, a requirement presenter, an application developer, a tester, an application to be tested (i.e., a test application and a branch), test content, and a requirement document address. In the test extracting task interface, a user can also select whether to immediately send a test extracting notification and whether to immediately construct a test extracting application, if the user selects to immediately send the test extracting notification, the server side immediately sends the test extracting notification to relevant personnel when receiving test extracting task information, and if the user does not select to immediately send the test extracting notification, the server side sends the test extracting notification to the relevant personnel when receiving a test extracting notification request sent by the client side; if the user selects to immediately construct the test application, the server immediately executes the operation of application construction for the application to be tested when receiving the test task information, and if the user does not select to immediately construct the test application, the server executes the operation of application construction for the application to be tested when receiving the application construction request sent by the client.

And S320, acquiring the testing task information input by the user through the testing task interface, and sending the testing task information to the server.

In the embodiment of the invention, after the test task interface is displayed, a user needs to select the application to be tested through the test task interface and input the test task information of the application to be tested.

When a user selects an application to be tested through a test task interface, acquiring identification information of each testable application from a server, displaying the identification information of each testable application, and taking the testable application corresponding to the identification information selected by the user in each identification information as the application to be tested; the identification information of each testable application may be acquired by the server by calling a service provided by the application management module. And the application management module of the server is used for storing and managing the identification information of each testable application and the application deployment information corresponding to each identification information. The identification information of each testable application and the application deployment information corresponding to each identification information stored in the application management module can be obtained as follows: firstly, when detecting that an application addition triggering operation executed by a user on a client interface, displaying an application management interface and acquiring application management information input by the user through the application management interface. The user may be an application developer. The application management information includes application identifications of the testable applications and corresponding application deployment information. The application identification may include, but is not limited to, a name, a number, or a character string formed of at least one of a number, a letter, and a character of the application to be tested, etc. The application deployment information may include an application code address and a tester address. And then, sending the obtained application identification and the application deployment information of the testable application to the server, and performing associated storage on the received application identification and the application deployment information by the server, wherein the associated storage can be specifically stored in an application management module. The subsequent server can obtain the source code of the application to be tested according to the application code address in the application deployment information, and determine the tester according to the tester address in the application deployment information. The testing machine is used for running the application to be tested, and in order to send a target file required by running the application to be tested to the testing machine, the testing machine needs to be accessed into the system in advance, namely, communication connection is established between the testing machine and the testing machine. Specifically, when detecting a host access triggering operation of a user, the host management interface is displayed, a test machine address input by the user through the host management interface is acquired, and a host access request carrying the test machine address is sent to the server, so that the server accesses the test machine into the system by calling a service provided by the host management module and adopting an SHH protocol. Optionally, the access system mode includes two modes, i.e., user password authentication and public-private key password-less mode, which is not limited in this embodiment. Alternatively, the user may be a developer or a tester.

After the test task information of the application to be tested input by a user through the test task interface is obtained, the obtained test task information is sent to the server, so that the server creates a test task according to the test task information. Optionally, the user may include an application developer.

Optionally, after sending the test task information to the server, the user may trigger the server to send a test notification to relevant people of the test task through an interface of the client, so that the relevant people know that the application to be tested is tested according to the test notification and successfully establish the test task on the platform. Specifically, when detecting a trigger operation of a test report executed by a user on a test report detail interface of a client, sending a test report request to a server, so that the server determines related personnel corresponding to the test report according to the test report information, and sending the test report to a communication account corresponding to the related personnel by calling the service provided by an information sending module. Specifically, the relevant personnel include, but are not limited to, demand givers, developers, and testers. Optionally, the notification of the prompt and test may be sent to an instant messaging account of a related person, such as a mobile phone number, a mailbox, a WeChat, and the like.

Optionally, after sending the test task information to the server, the user may view the test report through an interface of the client. Specifically, when a trigger operation of checking the report executed by the user on a report detail interface of the client is detected, a report checking request is sent to the server, a report generated according to the report information returned by the server is received, and the report is displayed. Optionally, the test report includes, but is not limited to, at least one of test title, test department, test time, test completion time, requirement presenter, application developer, tester, application to be tested, test content, and required document address.

Optionally, after sending the test task information to the server, the user may trigger the server to execute application construction, specifically, when detecting an application construction triggering operation executed by the user on a test task detail interface of the client, send an application construction request to the server, so that the server compiles a source code of an application to be tested corresponding to the test task when receiving the application construction request, and triggers the test machine to run the application to be tested based on a target file obtained by the compilation. Optionally, the user may include a tester.

Optionally, after the test task information is sent to the server, specifically, after an application building request is sent to the server, the user may trigger the server to test the application execution unit to be tested through an interface of the client. Specifically, when a unit test triggering operation executed by a user on a test task detail interface of a client is detected, a unit test request is sent to a server, so that the server sends a source code of an application to be tested to code specification detection equipment when receiving the unit test request, and the code specification detection equipment is triggered to test the execution unit of the application to be tested and scan the source code based on the received source code, so that a code specification detection result is obtained. Optionally, the user may include a tester. Optionally, the code specification detection result returned by the server may be received, and the code specification detection result is displayed, so that a tester determines the code writing specification degree of the current application to be tested.

Optionally, the user may test the coverage rate through an interface viewing unit of the client. Specifically, when a unit test coverage checking triggering operation executed by a user on a test task detail interface of a client is detected, a unit test coverage checking request is sent to a server. Optionally, the user may include a tester. And then, receiving the unit test coverage rate returned by the server when the unit test is executed on the application to be tested, and displaying the unit test coverage rate. The unit test coverage is obtained by calling a code quality management tool such as SONAR when the unit test case is executed by the application to be tested.

Optionally, after the test task information is sent to the server, specifically, after a unit test request is sent to the server, the user may also trigger the server to execute a smoke test on the application to be tested through an interface of the client. Specifically, when detecting a smoking test triggering operation executed by a user on a test task detail interface of a client, sending a smoking test request to a server, so that the server obtains a smoking test case corresponding to an application to be tested when receiving the smoking test request, and triggering automatic test equipment to execute the smoking test case for the application to be tested running by a test machine. Alternatively, the user may be a tester. Optionally, the smoking test result returned by the server may be received, and the smoking test result is displayed, so that a tester can obtain the smoking test result of the application to be tested.

Optionally, after the code specification test result and the smoking test result are displayed, a user (e.g., a tester) may determine whether to trigger a formal automated test according to the results. And if the test is triggered, executing test acceptance triggering operation on the interface of the client, thereby triggering the server to execute the automatic test on the application to be tested. Specifically, when detecting a test acceptance triggering operation executed by a user on a test task detail interface of a client, sending a test acceptance request to a server, so that the server obtains an automated test case corresponding to an application to be tested when receiving the test acceptance request, and triggering automated test equipment to execute the automated test case for the application to be tested running in a test machine.

Optionally, after sending the test task information to the server, the user may check the coverage rate of the functional test in the execution process of the automated test through an interface of the client. Specifically, when detecting a function test coverage checking triggering operation executed by a user on a test task detail interface of a client, sending a function test coverage checking request to a server; and receiving the function test coverage rate of the application to be tested returned by the server side, and displaying the function test coverage rate. Wherein, the function test coverage rate is obtained by calling a service provided by a code coverage rate tool such as JACOCO.

Optionally, in the process of automatically testing the application to be tested at the server, the user may process the BUG generated by the test through the interface of the client. Specifically, receiving BUG information generated when an automatic test case is executed by automatic test equipment sent by a server; and displaying the BUG information, and acquiring the BUG content and the BUG handler which are filled in on the interface of the client by the user based on the BUG information. Optionally, the user may be a tester, the BUG content may include a unique identifier preset for the BUG, or may include specific BUG detail information, and the BUG handler may be a developer who writes a code corresponding to the BUG location. And then, sending a BUG forwarding request carrying the BUG content and the BUG handler to the service end, so that the service end sends BUG processing notification information to a communication account corresponding to the BUG handler by calling the service provided by the information sending module.

Optionally, the user may view log information generated when the application to be tested runs on the testing machine in the testing process through an interface of the client. Specifically, when detecting an application log viewing trigger operation executed by a user on a task detail interface of a client, sending an application log viewing request to a server, so that the server obtains an operation log of an application to be tested from a log retrieval platform; and then, receiving the running log returned by the server, and displaying the running log. The running log is generated by the log retrieval platform based on the log information of the application to be tested, which is read from the storage of the ES, and the log information in the storage is the log information generated in the running process of the application to be tested and sent by the testing machine.

And S330, receiving the test report returned by the server and displaying the test report.

In the embodiment of the invention, the test report is generated according to the execution result of the automatic test case after the server creates the test task according to the test task information, compiles the source code of the application to be tested corresponding to the test task, triggers the test machine to run the application to be tested based on the target file obtained by compiling, obtains the automatic test case corresponding to the application to be tested, and triggers the automatic test equipment to execute the automatic test case aiming at the application to be tested running by the test machine. Optionally, the test report includes, but is not limited to, at least one of test tasks, test report departments, test results, related contacts, related documents, test dates, test cases, and other test contents.

Optionally, after receiving the test report returned by the server, the user may trigger the server to send an online notification message to the relevant person submitting the test task through the interface of the client, so that the relevant person knows that the application to be tested is about to be online. Specifically, when detecting an online notification triggering operation executed by a user on a test task detail interface of a client, sending an online notification viewing request to a server, so that the server generates a check list corresponding to an application to be tested. And then, receiving the check list returned by the server, displaying the check list and acquiring check item confirmation information input by the user in the check list. Wherein, the check list comprises check items which need to be confirmed before the application to be tested is online. Specifically, the examination items include, but are not limited to: whether the code passes the code review, whether the test case passes the case review and is completely executed, whether all BUGs are repaired and verified before the on-line process, whether a test report is sent and the like. And then, sending check item confirmation information to the server so that the server generates online notification information based on the check item confirmation information, and sending the online notification information to related personnel corresponding to the test task by calling the service provided by the information sending module.

Optionally, after sending the check item confirmation information to the server, the user may trigger the server to send an online verification report to the relevant person who submits the test task through the interface of the client, so that the relevant person knows that the application to be tested is online successfully. Specifically, when detecting an online verification report checking triggering operation executed by a user on a task detail interface of a client, sending an online verification report checking request to a server, so that the server generates an online verification table corresponding to an application to be tested. Then, receiving an online verification table returned by the server, displaying the online verification table and acquiring verification item confirmation information input by a user in the online verification table; wherein the online verification table comprises verification items which need to be confirmed by a user after the application to be tested is online. And then, sending verification item confirmation information to the server so that the server generates an online verification report based on the verification item confirmation information, and sending the online verification report to the communication account number of the relevant person corresponding to the test task by calling the service provided by the information sending module.

On the basis of the embodiment, the user can trigger the server side to perform energy efficiency analysis based on the test process data through the interface of the client side, and check the energy efficiency analysis result. Specifically, fig. 5 is a graph showing the energy efficiency analysis results. When energy efficiency analysis triggering operation of a user is detected, an energy efficiency analysis request carrying analysis dimensionality is sent to a server side, so that the server side carries out energy efficiency analysis of the analysis dimensionality on the basis of stored test process data of each application to obtain energy efficiency analysis data; wherein the energy efficiency analysis data is used for code quality quantification and/or work efficiency quantification. Optionally, the analysis dimensions include, but are not limited to: testing team dimension, personnel dimension, application dimension, project dimension and the like. And receiving energy efficiency analysis data returned by the server side, and displaying the energy efficiency analysis data. Optionally, the energy efficiency analysis data corresponding to the dimension of the test team includes: at least one of an average demand period, an average development period, an average test period, an average lead time, a BUG average processing age, an average static code quality score, and an average single test coverage. Optionally, the energy efficiency analysis data corresponding to the staff dimension includes: at least one of acceptance number of test extraction, refund number of test extraction, average BUG solution failure, BUG reopening rate, static code quality score, single test coverage rate, average development period, execution coverage rate, effective BUG number, use case number, average test period, BUG rejection rate and automatic test case related number. The energy efficiency analysis data corresponding to the project dimension comprises the following steps: at least one of BUG situation, requirement cycle, BUG average processing aging, core working period, BUG reopening rate and requirement changing times. Optionally, the energy efficiency analysis data corresponding to the application dimension includes: at least one of static code quality score, test frequency improvement, single-side coverage, automatic test case relevance number and automatic deployment success rate.

On the basis of the foregoing embodiment, the test task detail interface includes the process progress shown in fig. 6(a), as shown in the figure, each operation node in the whole test process may be displayed in the test task detail interface of the client, so that relevant people can know the current test progress through the interface, and meanwhile, a button under each node may be clicked to trigger a corresponding operation, for example, a "view test report" button is clicked to view a test report. A log list as shown in fig. 6(b) may also be included in the test task detail interface, where the log list may show the relevant content of the operation log, including operation information such as an operator, an operation type, an execution result, and operation time of each operation node, and through the display of the information, relevant personnel may clearly know each operation performed by the current test task; optionally, the log list may also show the unit test coverage, the function test coverage, the smoking test result, the automation test result, and other contents. On the basis of the above embodiment, the test task detail interface further includes an associated use case list shown in fig. 6(c) and an associated BUG list shown in fig. 6(d), and relevant use case information of the executed automated test use case corresponding to the current test task may be displayed in the associated use case list shown in fig. 6(c), including information such as a use case number, use case content, creation time of the use case, a creator of the use case, and an execution result of the use case. The BUG information generated in the process of executing the automated test can be displayed in the associated BUG list as shown in fig. 6(d), and includes BUG serial number, BUG title, creator of BUG, handler of BUG, time of creating BUG, latest modification time of BUG, current state of BUG and other information, so as to make relevant personnel clearer the relevant BUG information of the current testing task.

The method and the device for detecting the application upgrading task interface display are used for displaying the upgrading task interface when detecting the application upgrading triggering operation of a user; acquiring the test task information of the application to be tested, which is input by a user through a test task interface, and sending the test task information to a server; the test report returned by the server is received and displayed, so that the test process is simple and visual in operation, the data of the whole test process is conveniently recorded, and the test efficiency is improved.

Example four

Fig. 7 is a schematic flowchart of an application testing method according to a fourth embodiment of the present invention, which is applicable to a situation where a developed application software needs to be tested. On the basis of the above embodiments, the present embodiment mainly embodies an interaction process between the client and the server in the application test method. As shown in fig. 7, the method specifically includes the following steps:

s410, when detecting the application upgrading triggering operation of a user, the client displays an upgrading task interface; acquiring the test task information of the application to be tested, which is input by a user through a test task interface, and sending the test task information to a server;

s411, the server receives the testing task information sent by the client and creates a testing task according to the testing task information;

s412, when detecting that the user executes the test-providing notification trigger operation on the interface, the client sends a test-providing notification request to the server;

s413, the server receives a request for a prompt and test notification sent by the client, determines relevant personnel corresponding to the prompt and test task according to the prompt and test task information, and sends the prompt and test notification to a communication account corresponding to the relevant personnel by calling the service provided by the information sending module;

s414, when detecting the application construction triggering operation executed by the user on the interface, the client sends an application construction request to the server;

s415, the server receives an application construction request sent by the client, compiles a source code of the to-be-tested application corresponding to the test task, and triggers the tester to run the to-be-tested application based on a target file obtained by compiling;

s416, when detecting the unit test triggering operation executed by the user on the interface, the client sends a unit test request to the server;

s417, the server receives the unit test request sent by the client, triggers the code specification detection equipment to execute unit test on the application to be tested based on the source code of the application to be tested and scans the source code to obtain a code specification detection result, and sends the code specification detection result to the client;

s418, the client receives the code specification detection result returned by the server and displays the code specification detection result;

s419, when detecting the smoking test triggering operation executed by the user on the interface, the client sends a smoking test request to the server;

s420, when receiving a smoking test request sent by a client, a server acquires a smoking test case corresponding to an application to be tested, triggers automatic test equipment to execute the smoking test case aiming at the application to be tested running by a test machine, and returns a smoking test result to the client;

s421, the client receives the smoking test result returned by the server and displays the smoking test result;

s422, when detecting a test acceptance triggering operation executed by a user on an interface, the client sends a test acceptance request to the server;

s423, the server receives the test acceptance request sent by the client, acquires an automated test case corresponding to the application to be tested, and triggers the automated test equipment to execute the automated test case aiming at the application to be tested running on the test machine; generating a test report according to the execution result of the automatic test case, and returning the test report to the client for display;

s424, when detecting the on-line notification triggering operation executed by the user on the interface, the client sends an on-line notification viewing request to the server;

s425, the server generates a check list corresponding to the application to be tested, and returns the check list to the client;

s426, the client receives the check list returned by the server, displays the check list, acquires check item confirmation information input by the user in the check list, and sends the check item confirmation information to the server;

s427, the server receives the checking item confirmation information sent by the client, generates online notification information based on the checking item confirmation information, and sends the online notification information to the related personnel corresponding to the testing task by calling the service provided by the information sending module;

s428, when detecting the on-line verification report checking triggering operation executed by the user on the interface, the client sends an on-line verification report checking request to the server;

s429, the server receives an online verification report checking request sent by the client, generates an online verification table corresponding to the application to be tested, and returns the online verification table to the client;

s430, the client receives the on-line verification table returned by the server, displays the on-line verification table, acquires verification item confirmation information input by the user in the on-line verification table, and sends the verification item confirmation information to the server;

and S431, the server receives the verification item confirmation information sent by the client, generates an online verification report based on the verification item confirmation information, and sends the online verification report to the communication account number of the relevant person corresponding to the test task by calling the service provided by the information sending module.

The embodiment of the invention realizes simple and visual operation of the test process, is convenient to record the data of the whole test process simultaneously and improves the test efficiency.

EXAMPLE five

Fig. 8 is a schematic structural diagram of an application testing apparatus according to a fifth embodiment of the present invention, where the application testing apparatus is configured in a server. The device and the application test method of each embodiment belong to the same inventive concept, and details which are not described in detail in the embodiment of the application test device can refer to the embodiment of the application test method.

The specific structure of the application test device is shown in fig. 8, and includes: the test system comprises a test task creating module 510, an application to be tested running module 520, an automatic test case executing module 530 and a test report generating module 540.

The system comprises a test task creating module 510, a test task setting module and a test task processing module, wherein the test task creating module is used for receiving test task information sent by a client and creating a test task according to the test task information;

the to-be-tested application running module 520 is configured to compile a source code of the to-be-tested application corresponding to the test task, and trigger the tester to run the to-be-tested application based on a target file obtained by compiling;

the automated test case execution module 530 is configured to obtain an automated test case corresponding to the application to be tested, and trigger the automated test equipment to execute the automated test case for the application to be tested running on the test machine;

and the test report generating module 540 is configured to generate a test report corresponding to the test task according to the execution result of the automated test case, and return the test report to the client for display.

Optionally, the apparatus further comprises:

and the first extraction notification sending unit is used for determining related personnel corresponding to the extraction task according to the extraction task information and sending the extraction notification to the communication account corresponding to the related personnel by calling the service provided by the information sending module.

Optionally, the first prompt notification sending unit is specifically configured to:

when a request for a test notification sent by a client is received, determining relevant personnel corresponding to the test task according to the test task information, and sending the test notification to a communication account corresponding to the relevant personnel by calling the service provided by the information sending module; the test notification request is generated after a user executes a test notification triggering operation on an interface of the client.

Optionally, the apparatus further comprises:

the system comprises a reporting report generating unit, a reporting task information processing unit and a reporting task information processing unit, wherein the reporting report generating unit is used for receiving a reporting report viewing request sent by a client, generating a reporting report according to reporting task information and sending the reporting report to the client for displaying; the report viewing request is generated after a user executes a report viewing trigger operation on an interface of the client.

Optionally, the to-be-tested application running module 520 is specifically configured to:

when an application construction request sent by a client is received, compiling a source code of an application to be tested corresponding to a test task, and triggering a test machine to run the application to be tested based on a target file obtained by compiling; the application building request is generated after a user executes application building triggering operation on an interface of the client.

acquiring application deployment information of an application to be tested corresponding to the test task by calling a service provided by an application management module; wherein the application deployment information comprises: an application code address and a tester address;

and acquiring a source code of the application to be tested according to the application code address, compiling the source code, and sending a target file obtained by compiling to a testing machine corresponding to the testing machine address so that the testing machine runs the application to be tested based on the target file.

Optionally, the apparatus further comprises:

and the test machine access unit is used for accessing the test machine corresponding to the application to be tested into the system by calling the service provided by the host management module and adopting an SHH protocol.

Optionally, the apparatus further comprises:

the first detection result acquisition unit is used for triggering the code specification detection equipment to test the application execution unit to be tested based on the source code of the application to be tested and scan the source code to obtain a code specification detection result;

and the detection result display unit is used for returning the code specification detection result to the client for display.

Optionally, the first detection result obtaining unit is specifically configured to:

when a unit test request sent by a client is received, triggering code specification detection equipment to test an application execution unit to be tested based on a source code of the application to be tested and scan the source code; the unit test request is generated after a user executes a unit test trigger operation on an interface of the client.

Optionally, the apparatus further comprises:

and the second detection result acquisition unit is used for receiving a unit test coverage rate checking request sent by the client, acquiring the unit test coverage rate when the unit test is executed on the application to be tested from the code specification detection equipment, and returning the unit test coverage rate to the client for displaying.

Optionally, the apparatus further comprises:

the third detection result acquisition unit is used for acquiring a smoking test case corresponding to the application to be tested and triggering the automatic test equipment to execute the smoking test case aiming at the application to be tested running by the test machine; and returning the smoking test result obtained after the smoking test case is executed to the client for displaying.

Optionally, the third detection result obtaining unit is specifically configured to:

when a smoking test request sent by a client is received, acquiring a smoking test case corresponding to an application to be tested, and triggering automatic test equipment to execute the smoking test case aiming at the application to be tested running by a test machine; the smoking test request is generated after a user executes a smoking test triggering operation on an interface of the client.

Optionally, the automatic test case execution module 530 is specifically configured to:

when a test acceptance request sent by a client is received, acquiring an automatic test case corresponding to an application to be tested, and triggering automatic test equipment to execute the automatic test case aiming at the application to be tested running by a test machine; the test acceptance request is generated after a user executes a test acceptance trigger operation on an interface of the client.

Optionally, the apparatus further comprises:

and the function test coverage rate obtaining unit is used for receiving a function test coverage rate checking request sent by the client, obtaining the function test coverage rate of the application to be tested from the testing machine, and returning the function test coverage rate to the client for displaying.

Optionally, the apparatus further comprises:

the device comprises an error BUG information sending unit, a test machine processing unit and a BUG processing unit, wherein the error BUG information sending unit is used for receiving error BUG information generated when the test machine executes an automatic test case, and sending the BUG information to a client so that the client can display the BUG information and acquire BUG content and BUG handlers which are filled in on an interface of the client by a user based on the BUG information;

the BUG forwarding request receiving unit is used for receiving a BUG forwarding request which is sent by a client and carries BUG content and a BUG handler, and sending BUG processing notification information to a communication account corresponding to the BUG handler by calling a service provided by the information sending module;

and the notification message sending unit is used for sending notification information of the change of the BUG state to the communication account number of the related personnel corresponding to the test task by calling the service provided by the information sending module when the change of the BUG state is detected.

Optionally, the apparatus further comprises:

the log running acquiring unit is used for receiving an application log checking request sent by the client, acquiring a log running of the application to be tested from the log retrieval platform, and returning the log running to the client for displaying;

the running log is generated by the log retrieval platform based on log information of the application to be tested, which is read from a memory of the search engine ES, and the log information in the memory is log information generated in the running process of the application to be tested and sent by the testing machine.

Optionally, the apparatus further comprises:

the check list sending unit is used for receiving an online notification check request sent by the client, generating a check list corresponding to the application to be tested, and sending the check list to the client so that the client can display the check list and acquire check item confirmation information input by a user in the check list; wherein the check list comprises check items needing to be confirmed before the application to be tested is online;

and the online notification message generating unit is used for receiving the checking item confirmation information sent by the client, generating online notification information based on the checking item confirmation information, and sending the online notification information to the communication account number of the relevant person corresponding to the test task by calling the service provided by the information sending module.

Optionally, the apparatus further comprises:

the online verification table generating unit is used for receiving an online verification report checking request sent by the client, generating an online verification table corresponding to the application to be tested, and sending the online verification table to the client so that the client can display the online verification table and acquire verification item confirmation information input by a user in the online verification table; the online verification table comprises verification items which need to be confirmed by a user after the application to be tested is online;

and the online verification report generating unit is used for receiving verification item confirmation information sent by the client, generating an online verification report based on the verification item confirmation information, and sending the online verification report to the communication account number of the relevant person corresponding to the test task by calling the service provided by the information sending module.

Optionally, the apparatus further comprises:

the energy efficiency analysis request receiving module is used for receiving an energy efficiency analysis request which is sent by a client and carries analysis dimensions, and carrying out energy efficiency analysis on the analysis dimensions based on stored test process data of each application to obtain energy efficiency analysis data; wherein, the energy efficiency analysis data is used for quantifying code quality and/or quantifying work efficiency;

and the energy efficiency analysis data sending module is used for sending the energy efficiency analysis data to the client so that the client can display the energy efficiency analysis data.

Optionally, the analysis dimension includes: testing at least one of a team dimension, a personnel dimension, a project dimension, and an application dimension.

Optionally, the energy efficiency analysis data corresponding to the dimension of the test team includes: at least one of an average demand period, an average development period, an average test period, an average lead time, a BUG average processing age, an average static code quality score, and an average single test coverage.

Optionally, the energy efficiency analysis data corresponding to the staff dimension includes: at least one of acceptance number of test extraction, refund number of test extraction, average BUG solution failure, BUG reopening rate, static code quality score, single test coverage rate, average development period, execution coverage rate, effective BUG number, use case number, average test period, BUG rejection rate and automatic test case related number.

Optionally, the energy efficiency analysis data corresponding to the project dimension includes: at least one of BUG situation, requirement cycle, BUG average processing aging, core working period, BUG reopening rate and requirement changing times.

Optionally, the energy efficiency analysis data corresponding to the application dimension includes: at least one of static code quality score, test frequency improvement, single-side coverage, automatic test case relevance number and automatic deployment success rate.

The application testing device provided by the embodiment of the invention can execute the method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

It should be noted that, in the embodiment of the application test apparatus, the included units and modules are only divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.

EXAMPLE six

Fig. 9 is a schematic structural diagram of an application testing apparatus according to a sixth embodiment of the present invention, where the application testing apparatus is configurable in a user terminal. The device and the application test method of each embodiment belong to the same inventive concept, and details which are not described in detail in the embodiment of the application test device can refer to the embodiment of the application test method.

The specific structure of the application test device is shown in fig. 9, and includes: the system comprises a test task interface display module 610, a test task information sending module 620 and a test report receiving module 630.

The system comprises a test task interface display module 610, a test task interface display module and a test task interface display module, wherein the test task interface display module 610 is used for displaying a test task interface when an application test triggering operation of a user is detected;

the test task information sending module 620 is configured to obtain test task information of an application to be tested, which is input by a user through a test task interface, and send the test task information to a server;

the test report receiving module 630 is configured to receive a test report returned by the server and display the test report;

the test report is generated according to the execution result of the automatic test case after the server creates the test task according to the test task information, compiles the source code of the application to be tested corresponding to the test task, triggers the tester to run the application to be tested based on the target file obtained by compiling, obtains the automatic test case corresponding to the application to be tested, and triggers the automatic test equipment to execute the automatic test case aiming at the application to be tested running by the tester.

Optionally, the apparatus further comprises:

and the test-upgrading notification sending unit is used for sending a test-upgrading notification request to the server when detecting a test-upgrading notification triggering operation executed by a user on a test-upgrading task detail interface of the client, so that the server determines related personnel corresponding to the test-upgrading task according to the test-upgrading task information, and sends the test-upgrading notification to the communication account corresponding to the related personnel by calling the service provided by the information sending module.

Optionally, the apparatus further comprises:

the system comprises a reporting and reporting request sending unit, a reporting and reporting request receiving unit and a reporting and reporting request sending unit, wherein the reporting and reporting request sending unit is used for sending a reporting and reporting request checking request to a server side when a reporting and reporting triggering operation executed by a user on a reporting and reporting task detail interface of a client side is detected;

and the report receiving unit is used for receiving a report generated according to the report task information and returned by the server and displaying the report.

Optionally, the apparatus further comprises:

the application construction request sending unit is used for sending an application construction request to the server when detecting application construction triggering operation executed by a user on a test task detail interface of the client, so that the server compiles a source code of an application to be tested corresponding to a test task when receiving the application construction request, and triggers the testing machine to run the application to be tested based on a target file obtained by compiling.

Optionally, the apparatus further comprises:

the application management interface display unit is used for displaying an application management interface when detecting application addition triggering operation of a user;

the information acquisition unit is used for acquiring the application identification and the application deployment information of the application to be tested, which are input by a user through the application management interface;

and the associated information storage unit is used for sending the application identifier and the application deployment information of the application to be tested to the server for associated storage, so that the server acquires the source code of the application to be tested according to the application code address in the application deployment information, and determines the tester according to the tester address in the application deployment information.

Optionally, the apparatus further comprises:

the host management interface display unit is used for displaying a host management interface when detecting host access triggering operation of a user;

and the host access request sending unit is used for acquiring the address of the test machine input by the user through the host management interface and sending a host access request carrying the address of the test machine to the server so that the server calls the service provided by the host management module and accesses the test machine into the system by adopting an SHH protocol.

Optionally, the apparatus further comprises:

the system comprises a unit test request sending unit, a unit test request sending unit and a code specification detecting device, wherein the unit test request sending unit is used for sending a unit test request to a server when detecting unit test triggering operation executed by a user on a test task detail interface of a client, so that when the server receives the unit test request, the code specification detecting device is triggered to test an application execution unit to be tested based on a source code of an application to be tested and scan the source code to obtain a code specification detecting result;

and the detection result display unit is used for receiving the code specification detection result returned by the server and displaying the code specification detection result.

Optionally, the apparatus further comprises:

the unit test coverage rate checking request sending unit is used for sending a unit test coverage rate checking request to the server side when detecting a unit test coverage rate checking trigger operation executed by a user on a test task detail interface of the client side;

and the checking result display unit is used for receiving the unit test coverage rate returned by the server when the unit test is executed on the application to be tested, and displaying the unit test coverage rate.

Optionally, the apparatus further comprises:

the smoking test request sending unit is used for sending a smoking test request to the server when smoking test triggering operation executed by a user on a test task detail interface of the client is detected, so that the server obtains a smoking test case corresponding to an application to be tested when receiving the smoking test request, and triggers the automatic test equipment to execute the smoking test case aiming at the application to be tested operated by the test machine;

and the smoking test result display unit is used for receiving the smoking test result returned by the server and displaying the smoking test result.

Optionally, the apparatus further comprises:

the test acceptance request sending unit is used for sending a test acceptance request to the server when detecting a test acceptance triggering operation executed by a user on a test task detail interface of the client, so that the server obtains an automatic test case corresponding to the application to be tested when receiving the test acceptance request, and triggers the automatic test equipment to execute the automatic test case aiming at the application to be tested running by the test machine.

Optionally, the apparatus further comprises:

the system comprises a function test coverage rate checking request sending unit, a function test coverage rate checking unit and a service end, wherein the function test coverage rate checking request sending unit is used for sending a function test coverage rate checking request to the service end when detecting a function test coverage rate checking trigger operation executed by a user on a test task detail interface of a client end;

and the function test coverage rate display unit is used for receiving the function test coverage rate of the application to be tested returned by the server and displaying the function test coverage rate.

Optionally, the apparatus further comprises:

the BUG information receiving unit is used for receiving BUG information which is sent by the server and generated when the automatic test equipment executes an automatic test case;

the BUG information display unit is used for displaying the BUG information and acquiring BUG contents and a BUG handler which are filled in on an interface of the client by a user based on the BUG information;

and the BUG forwarding request sending unit is used for sending a BUG forwarding request carrying the BUG content and the BUG handler to the service end so that the service end sends BUG processing notification information to a communication account corresponding to the BUG handler by calling the service provided by the information sending module.

Optionally, the apparatus further comprises:

the application log viewing request sending unit is used for sending an application log viewing request to the server when detecting application log viewing triggering operation executed by a user on a task detail interface of the client, so that the server can obtain an operation log of an application to be tested from a log retrieval platform; the log retrieval platform generates a log information of the application to be tested, which is read from a memory of a search engine ES, and the log information in the memory is the log information which is sent by the tester and generated in the running process of the application to be tested;

and the running log display unit is used for receiving the running log returned by the server and displaying the running log.

Optionally, the apparatus further comprises:

the online notification viewing request sending unit is used for sending an online notification viewing request to the server when online notification triggering operation executed by a user on a test task detail interface of the client is detected, so that the server generates a check list corresponding to the application to be tested;

the check list receiving unit is used for receiving the check list returned by the server, displaying the check list and acquiring check item confirmation information input by a user in the check list; wherein the check list comprises check items needing to be confirmed before the application to be tested is online;

and the inspection item confirmation information sending unit is used for sending inspection item confirmation information to the server so that the server generates online notification information based on the inspection item confirmation information, and sends the online notification information to the relevant personnel corresponding to the test task by calling the service provided by the information sending module.

Optionally, the apparatus further comprises:

the online verification report checking request sending unit is used for sending an online verification report checking request to the server when detecting that the online verification report checking triggering operation executed by a user on a task detail interface of the client is detected, so that the server generates an online verification table corresponding to the application to be tested;

the verification item confirmation information acquisition unit is used for receiving the online verification table returned by the server, displaying the online verification table and acquiring verification item confirmation information input by a user in the online verification table; the online verification table comprises verification items which need to be confirmed by a user after the application to be tested is online;

and the verification item confirmation information sending unit is used for sending verification item confirmation information to the server so that the server generates an online verification report based on the verification item confirmation information, and sends the online verification report to the communication account number of the relevant person corresponding to the test task by calling the service provided by the information sending module.

Optionally, the apparatus further comprises:

the energy efficiency analysis request sending module is used for sending an energy efficiency analysis request carrying analysis dimensionality to the server when detecting energy efficiency analysis triggering operation of a user, so that the server performs energy efficiency analysis of the analysis dimensionality based on stored test process data of each application to obtain energy efficiency analysis data; wherein, the energy efficiency analysis data is used for quantifying code quality and/or quantifying work efficiency;

and the energy efficiency analysis data receiving module is used for receiving the energy efficiency analysis data returned by the server and displaying the energy efficiency analysis data.

EXAMPLE seven

Fig. 10 is a schematic structural diagram of an application testing system according to a seventh embodiment of the present invention, which belongs to the same inventive concept as the application testing method according to the foregoing embodiments, and reference may be made to the above embodiment of the application testing method for details that are not described in detail in the embodiment of the application testing system.

The specific structure of the application test system is shown in fig. 10, and includes: server 710, user terminal 720.

The user terminal 720 is used for displaying a test task interface when detecting the application test triggering operation of the user; acquiring the test task information of the application to be tested, which is input by a user through a test task interface, and sending the test task information to a server; and receiving a test report returned by the server, and displaying the test report.

The server 710 is configured to receive the test task information sent by the user terminal, and create a test task according to the test task information; compiling a source code of an application to be tested corresponding to the test task, and triggering a test machine to run the application to be tested based on a target file obtained by compiling; acquiring an automatic test case corresponding to an application to be tested, and triggering automatic test equipment to execute the automatic test case aiming at the application to be tested running in the test machine; and generating a test report corresponding to the test task according to the execution result of the automatic test case, and returning the test report to the user terminal.

The application test system provided by the embodiment of the invention can execute the method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

Example eight

Fig. 11 is a schematic structural diagram of an electronic device according to an eighth embodiment of the present invention. FIG. 11 illustrates a block diagram of an exemplary electronic device 11 suitable for use in implementing embodiments of the present invention. The electronic device 11 shown in fig. 11 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiment of the present invention.

As shown in fig. 11, the electronic device 11 is represented in the form of a general-purpose computing electronic device. The components of electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.

Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, micro-channel architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

Electronic device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by electronic device 12 and includes both volatile and nonvolatile media, removable and non-removable media.

The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)30 and/or cache memory 32. The electronic device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 11, and commonly referred to as a "hard drive"). Although not shown in FIG. 11, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. System memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.

A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in system memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.

Electronic device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with electronic device 12, and/or with any devices (e.g., network card, modem, etc.) that enable electronic device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, the electronic device 12 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet) via the network adapter 20. As shown in FIG. 11, the network adapter 20 communicates with the other modules of the electronic device 12 via the bus 18. It should be appreciated that although not shown in FIG. 11, other hardware and/or software modules may be used in conjunction with electronic device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.

The processing unit 16 executes various functional applications and sample data acquisition by running programs stored in the system memory 28, such as implementing the application testing methods provided by the present embodiments,

when the method is applied to a server, the method comprises the following steps:

receiving the test task information sent by the user terminal, and creating a test task according to the test task information;

acquiring an automatic test case corresponding to an application to be tested, and triggering automatic test equipment to execute the automatic test case aiming at the application to be tested running in the test machine;

and generating a test report corresponding to the test task according to the execution result of the automatic test case, and returning the test report to the user terminal for displaying.

When the method is applied to the client, the method comprises the following steps:

acquiring the testing task information input by a user through a testing task interface, and sending the testing task information to a server;

receiving a test report returned by the server, and displaying the test report;

the test report is generated according to the execution result of the automatic test case after the server creates the test task according to the test task information, compiles the source code of the application to be tested corresponding to the test task, triggers the test machine to run the application to be tested based on the target file obtained by compiling, acquires the automatic test case corresponding to the application to be tested, and triggers the automatic test equipment to execute the automatic test case aiming at the application to be tested running by the test machine.

Of course, those skilled in the art can understand that the processor may also implement the technical solution of the sample data obtaining method provided in any embodiment of the present invention.

Example nine

The ninth embodiment provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements an application testing method provided in the embodiments of the present invention, where when the method is applied to a server, the method includes:

receiving a test report returned by the server, and displaying the test report;

Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer-readable storage medium may be, for example but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, or the like, as well as conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

It will be understood by those skilled in the art that the modules or steps of the invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of computing devices, and optionally they may be implemented by program code executable by a computing device, such that it may be stored in a memory device and executed by a computing device, or it may be separately fabricated into various integrated circuit modules, or it may be fabricated by fabricating a plurality of modules or steps thereof into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments illustrated herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. An application testing method, the method comprising:

2. The method of claim 1, wherein after creating the test task according to the test task information and before compiling the source code of the application to be tested corresponding to the test task, the method further comprises:

and determining related personnel corresponding to the test task according to the test task information, and sending a test notification to a communication account corresponding to the related personnel by calling the service provided by an information sending module.

3. The method according to claim 2, wherein determining relevant persons corresponding to the test task according to the test task information, and sending a test notification to a communication account corresponding to the relevant persons by calling a service provided by an information sending module, comprises:

when a request for a test notification sent by the client is received, determining relevant personnel corresponding to the test task according to the test task information, and sending the test notification to a communication account corresponding to the relevant personnel by calling a service provided by an information sending module; the prompt notification request is generated after a user executes prompt notification trigger operation on an interface of the client.

4. The method of claim 1, wherein after receiving the information of the provisioning task sent by the client, the method further comprises:

receiving a report viewing request sent by the client, generating a report according to the report task information, and sending the report to the user terminal for displaying; the report viewing request is generated after a user executes a report viewing trigger operation on an interface of the client.

5. The method of claim 1, wherein compiling source codes of applications to be tested corresponding to the test task and triggering a tester to run the applications to be tested based on a target file obtained by compiling comprise:

when an application construction request sent by the client is received, compiling a source code of an application to be tested corresponding to the test task, and triggering a testing machine to run the application to be tested based on a target file obtained by compiling; the application building request is generated after a user executes application building triggering operation on the interface of the client.

6. The method of claim 1, wherein compiling source codes of applications to be tested corresponding to the test task and triggering a tester to run the applications to be tested based on a target file obtained by compiling comprise:

7. The method of claim 1, wherein prior to triggering the tester to run the application to be tested based on the compiled target file, the method further comprises:

and accessing the tester into the system by calling the service provided by the host management module and adopting a secure shell SHH protocol.

8. The method of claim 1, wherein after creating a test task according to the test task information and before obtaining an automated test case corresponding to the application to be tested, the method further comprises:

the trigger code specification detection equipment tests the execution unit of the application to be tested based on the source code of the application to be tested and scans the source code to obtain a code specification detection result;

and returning the code specification detection result to the client for displaying.

9. The method of claim 8, wherein triggering a code specification detection device to perform unit testing and scan of the source code of the application under test based on the source code of the application under test comprises:

when a unit test request sent by the client is received, triggering code specification detection equipment to execute unit test on the application to be tested based on a source code of the application to be tested and scan the source code; the unit test request is generated after a user executes a unit test trigger operation on the interface of the client.

10. The method of claim 8, further comprising:

and receiving a unit test coverage rate checking request sent by the client, acquiring the unit test coverage rate when the unit test is executed on the application to be tested from the code specification detection equipment, and returning the unit test coverage rate to the client for displaying.

11. The method of claim 1, wherein after creating a test task according to the test task information and before obtaining an automated test case corresponding to the application to be tested, the method further comprises:

acquiring a smoking test case corresponding to the application to be tested, and triggering automatic test equipment to execute the smoking test case aiming at the application to be tested running by the test machine;

and returning the smoking test result obtained after the smoking test case is executed to the client for displaying.

12. The method of claim 11, wherein obtaining a smoking test case corresponding to the application to be tested, and triggering an automated testing device to execute the smoking test case for the application to be tested running on the testing machine comprises:

when a smoking test request sent by the client is received, acquiring a smoking test case corresponding to the application to be tested, and triggering automatic test equipment to execute the smoking test case aiming at the application to be tested running by the test machine; and the smoking test request is generated after a user executes smoking test triggering operation on the interface of the client.

13. The method of claim 1, wherein obtaining an automated test case corresponding to the application to be tested, and triggering automated test equipment to execute the automated test case for the application to be tested running on the tester comprises:

when a test acceptance request sent by the client is received, acquiring an automatic test case corresponding to the application to be tested, and triggering automatic test equipment to execute the automatic test case aiming at the application to be tested running by the test machine; the test acceptance request is generated after a user executes a test acceptance triggering operation on the interface of the client.

14. The method of claim 1, wherein after triggering automated test equipment to execute the automated test case for the application under test run by the tester, the method further comprises:

and receiving a function test coverage rate checking request sent by the client, acquiring the function test coverage rate of the application to be tested from the testing machine, and returning the function test coverage rate to the client for displaying.

15. The method of claim 1, wherein after triggering automated test equipment to execute the automated test case for the application under test run by the tester, the method further comprises:

receiving error BUG information generated when the automatic test equipment executes the automatic test case, and sending the BUG information to the client so that the client can display the BUG information and acquire BUG content and a BUG handler which are filled in on an interface of the client by a user based on the BUG information;

receiving a BUG forwarding request which is sent by the client and carries the BUG content and the BUG handler, and sending BUG processing notification information to a communication account corresponding to the BUG handler by calling a service provided by an information sending module;

and when the change of the BUG state is detected, sending notification information of the change of the BUG state to a communication account number of related personnel corresponding to the test task by calling the service provided by the information sending module.

16. The method of claim 1, wherein after triggering the tester to run the application to be tested based on the compiled target file, the method further comprises:

receiving an application log viewing request sent by the client, acquiring an operation log of the application to be tested from a log retrieval platform, and returning the operation log to the client for displaying;

the running log is generated by the log retrieval platform based on the log information of the application to be tested, which is read from a memory of a search engine ES, and the log information in the memory is the log information generated in the running process of the application to be tested and sent by the tester.

17. The method of claim 1, wherein after generating the test report corresponding to the test task, the method further comprises:

receiving an online notification viewing request sent by the client, generating a check list corresponding to the application to be tested, and sending the check list to the client so that the client displays the check list and acquires check item confirmation information input by a user in the check list; wherein the check list comprises check items needing to be confirmed before the application to be tested is online;

and receiving the checking item confirmation information sent by the client, generating online notification information based on the checking item confirmation information, and sending the online notification information to the communication account number of the relevant person corresponding to the test task by calling the service provided by the information sending module.

18. The method according to claim 17, wherein after sending the online notification information to the communication account of the relevant person corresponding to the survey-promoting task, the method further comprises:

receiving an online verification report checking request sent by the client, generating an online verification table corresponding to the application to be tested, and sending the online verification table to the client, so that the client displays the online verification table and acquires verification item confirmation information input by a user in the online verification table; wherein the online verification table comprises verification items which need to be confirmed by a user after the application to be tested is online;

and receiving the verification item confirmation information sent by the client, generating an online verification report based on the verification item confirmation information, and sending the online verification report to the communication account number of the relevant personnel corresponding to the test task by calling the service provided by the information sending module.

19. The method according to any one of claims 1-18, further comprising:

receiving an energy efficiency analysis request carrying analysis dimensions sent by the client, and performing energy efficiency analysis of the analysis dimensions based on stored test process data of each application to obtain energy efficiency analysis data; wherein the energy efficiency analysis data is used for code quality quantification and/or work efficiency quantification;

and sending the energy efficiency analysis data to the client so that the client displays the energy efficiency analysis data.

20. The method of claim 19, wherein the analysis dimension comprises: testing at least one of a team dimension, a personnel dimension, a project dimension, and an application dimension;

the energy efficiency analysis data corresponding to the dimension of the test team comprises the following data: at least one of an average demand period, an average development period, an average test period, an average lead time, a BUG average processing age, an average static code quality score, and an average single test coverage;

the energy efficiency analysis data corresponding to the staff dimensions comprise: at least one of acceptance number, refund number, average BUG solution average failure, BUG reopening rate, static code quality score, single test coverage rate, average development period, execution coverage rate, effective BUG number, use case number, average test period, BUG rejection rate and automatic test case related number is extracted;

the energy efficiency analysis data corresponding to the project dimension comprises: at least one of BUG situation, requirement cycle, BUG average processing timeliness, core working period, BUG reopening rate and requirement change times;

the energy efficiency analysis data corresponding to the application dimension comprises: at least one of static code quality score, test frequency improvement, single-side coverage, automatic test case relevance number and automatic deployment success rate.

21. An application testing method, the method comprising:

receiving a test report returned by the server, and displaying the test report;

22. The method of claim 21, wherein after sending the test task information to a server and before receiving a test report returned by the server, the method further comprises:

when detecting that a user triggers a test report executed on a test report detail interface, sending a test report request to the server, so that the server determines related personnel corresponding to the test report according to the test report information, and sending the test report to a communication account corresponding to the related personnel by calling the service provided by an information sending module.

23. The method of claim 21, wherein after sending the test task information to a server and before receiving a test report returned by the server, the method further comprises:

when detecting a prompt report checking triggering operation executed by a user on a prompt task detail interface, sending a prompt report checking request to the server;

and receiving a reporting report which is returned by the server and generated according to the reporting task information, and displaying the reporting report.

24. The method of claim 21, wherein after sending the test task information to a server and before receiving a test report returned by the server, the method further comprises:

when detecting application construction triggering operation executed by a user on a test task detail interface, sending an application construction request to a server, so that the server compiles a source code of an application to be tested corresponding to a test task when receiving the application construction request, and triggering a test machine to run the application to be tested based on a target file obtained by compiling.

25. The method of claim 21, wherein prior to detecting the application promotion trigger operation of the user, the method further comprises:

when detecting application addition triggering operation of a user, displaying an application management interface;

acquiring application identification and application deployment information of an application to be tested, which are input by a user through the application management interface;

and sending the application identification and the application deployment information of the application to be tested to the server for associated storage, so that the server obtains the source code of the application to be tested according to the application code address in the application deployment information, and determining a tester according to the tester address in the application deployment information.

26. The method of claim 21, wherein prior to detecting the application promotion trigger operation of the user, the method further comprises:

when detecting the host access triggering operation of a user, displaying a host management interface;

and acquiring the address of the test machine input by a user through the host management interface, and sending a host access request carrying the address of the test machine to the server so that the server accesses the test machine to the system by calling the service provided by the host management module and adopting an SHH protocol.

27. The method of claim 21, wherein after sending the test task information to a server and before receiving a test report returned by the server, the method further comprises:

when detecting a unit test triggering operation executed by a user on a test task detail interface, sending a unit test request to the server, so that when the server receives the unit test request, triggering code specification detection equipment to test the to-be-tested application execution unit based on a source code of the to-be-tested application and scan the source code to obtain a code specification detection result;

and receiving the code specification detection result returned by the server side, and displaying the code specification detection result.

28. The method of claim 27, wherein after sending a unit test request to the server, the method further comprises:

when detecting a unit test coverage rate checking triggering operation executed by a user on a test task detail interface, sending a unit test coverage rate checking request to the server;

and receiving the unit test coverage rate returned by the server when the unit test is executed on the application to be tested, and displaying the unit test coverage rate.

29. The method of claim 21, wherein after sending the test task information to a server and before receiving a test report returned by the server, the method further comprises:

when detecting a smoking test triggering operation executed by a user on a task detail interface, sending a smoking test request to the server, so that the server obtains a smoking test case corresponding to the application to be tested when receiving the smoking test request, and triggering automatic test equipment to execute the smoking test case aiming at the application to be tested running by the test machine;

and receiving a smoking test result returned by the server side, and displaying the smoking test result.

30. The method of claim 21, wherein after sending the test task information to a server and before receiving a test report returned by the server, the method further comprises:

when detecting a test acceptance triggering operation executed by a user on a test task detail interface, sending a test acceptance request to the server, so that the server obtains an automated test case corresponding to the application to be tested when receiving the test acceptance request, and triggering automated test equipment to execute the automated test case for the application to be tested running by the test machine.

31. The method of claim 21, wherein after sending the provisioning task information to a server, the method further comprises:

when detecting a function test coverage rate checking triggering operation executed by a user on a test task detail interface, sending a function test coverage rate checking request to the server;

and receiving the function test coverage rate of the application to be tested returned by the server side, and displaying the function test coverage rate.

32. The method of claim 21, wherein after sending the provisioning task information to a server, the method further comprises:

receiving BUG information which is sent by the server and generated when the automatic test equipment executes the automatic test case;

displaying the BUG information and acquiring BUG content and a BUG handler which are filled in on an interface by a user based on the BUG information;

and sending a BUG forwarding request carrying the BUG content and the BUG handler to the server so that the server sends BUG processing notification information to a communication account corresponding to the BUG handler by calling the service provided by the information sending module.

33. The method of claim 21, wherein after sending the provisioning task information to a server, the method further comprises:

when detecting an application log viewing triggering operation executed by a user on a task detail interface, sending an application log viewing request to the server, so that the server obtains an operation log of the application to be tested from a log retrieval platform; the running log is generated by the log retrieval platform based on log information of the application to be tested, which is read from a memory of a search engine ES, and the log information in the memory is log information generated in the running process of the application to be tested and sent by the tester;

and receiving the running log returned by the server side, and displaying the running log.

34. The method of claim 21, wherein after receiving the test report returned by the server, the method further comprises:

when detecting an online notification triggering operation executed by a user on a task detail interface, sending an online notification checking request to the server, so that the server generates a check list corresponding to the application to be tested;

receiving the check list returned by the server, displaying the check list and acquiring check item confirmation information input by a user in the check list; wherein the check list comprises check items needing to be confirmed before the application to be tested is online;

and sending the checking item confirmation information to the server so that the server generates online notification information based on the checking item confirmation information, and sending the online notification information to the related personnel corresponding to the test task by calling the service provided by the information sending module.

35. The method of claim 34, wherein after sending the check item acknowledgement information to the server, the method further comprises:

when detecting an online verification report checking triggering operation executed by a user on a task detail interface, sending an online verification report checking request to the server, so that the server generates an online verification table corresponding to the application to be tested;

receiving the online verification table returned by the server, displaying the online verification table and acquiring verification item confirmation information input by a user in the online verification table; wherein the online verification table comprises verification items which need to be confirmed by a user after the application to be tested is online;

and sending the verification item confirmation information to the server so that the server generates an online verification report based on the verification item confirmation information, and sending the online verification report to the communication account number of the relevant person corresponding to the test task by calling the service provided by the information sending module.

36. The method according to any one of claims 21-35, further comprising:

when energy efficiency analysis triggering operation of a user is detected, sending an energy efficiency analysis request carrying analysis dimensionality to the server, so that the server performs energy efficiency analysis of the analysis dimensionality based on stored test process data of each application to obtain energy efficiency analysis data; wherein the energy efficiency analysis data is used for code quality quantification and/or work efficiency quantification;

and receiving the energy efficiency analysis data returned by the server side, and displaying the energy efficiency analysis data.

37. An application testing apparatus, comprising:

38. An application testing apparatus, comprising:

39. An application testing system, comprising: server and user terminal, wherein:

40. An electronic device, characterized in that the device comprises:

one or more processors;

a memory for storing one or more programs;

when executed by the one or more processors, cause the one or more processors to implement the application testing method of any of claims 1-36.

41. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the application testing method according to any one of claims 1 to 36.