KR100775570B1 - Performance and load inspection system and method of mobile communication system - Google Patents

Abstract

The present invention dynamically generates an additional service test call and a load test call having a scenario for all sections of the mobile communication system, so that the performance and load checking system of the mobile communication system capable of automatically testing the function and capacity of the mobile communication system. And a method, in which a plurality of operations corresponding to functions are combined to create a test scenario or a test scenario suitable for a newly proposed exchange package, and a combination of the scenarios can be used to create a project. It is possible to support the testing of all exchange packages that can be developed, and to set up the test environment through the MMC (Man Machine Communication) interface with additional equipment of the mobile communication system, to provide a test environment similar to the real environment, Order according to scenario and project By performing each operation, control the mobile terminal, and the test call is dynamically and automatically generate, and provides the execution result for your review.

Description

System and method for verifying a capability and a load of mobile communication system

1 is a configuration diagram showing a performance and load inspection system of a mobile communication system according to the present invention.

2 is a functional block diagram showing the configuration of a mobile call simulator provided in the system according to the present invention.

3 is a diagram illustrating a DM interface structure applied to a mobile call simulator according to the present invention.

4 is a block diagram showing a multi-terminal support structure in the mobile call simulator according to the present invention.

5 is a S / W modular structure diagram of the load and performance test system of the mobile communication system according to the present invention.

6 is a flowchart illustrating a method for checking the function and performance of a new exchange package in a mobile communication system according to the present invention.

7 is a flowchart showing a process of executing a project for testing a voice call in the system according to the present invention.

8 is a view showing a voice test call for each section that can be supported in the system according to the present invention.

9 is a diagram illustrating an SMS test call for each section that can be supported by the present invention.

FIG. 10 is a diagram illustrating an additional service call for each section that can be supported by the performance and load checking system according to the present invention.

11A to 11H illustrate examples of a user interface screen provided in the performance and load checking system according to the present invention.

Explanation of symbols on the main parts of the drawings

10: performance and load inspection system

11: user interface

12: System Handler

13: Mobile Call Simulator (MCS)

The present invention relates to a system and method for performance and load checking of a mobile communication system that can automatically test the functionality and capacity of the mobile communication system and can further support pre-verification of newly applied exchange packages.

The mobile communication system is developed to perform voice communication in a wireless environment, and stores information on a mobile switching center (MSC) and a mobile communication service subscriber that performs call exchange between multiple base station controllers (BSCs). Home Location Register, Authentication Center (AuC), Short Message Center (SMC) and Voice data, which provide subscriber data for mobile device origination, location registration, and incoming calls. Switching network unit performing inter-format conversion between packet data and performing routing function between mobile terminals, including IWF / PDSN (Inter Work Function / Packet Data Service Node) connecting wireless communication network and Internet, and mobile station Base station (BSS: Base Transceiver Syste) that is directly connected to the baseband to perform baseband signal processing / wireless / wireless conversion / transmission / reception of wireless signals. m), including a base station controller (BSC) located between the base station (BSS) and the mobile switching center (MSC) to perform base station management and control; It includes a wireless network unit that performs support management, and an operation support unit that supports the maintenance and operation of a mobile communication system, including a network management center, a customer management and billing device (AAA).

In addition, as an additional service equipment, a voice mail system (VMS) and a value added system (VAS) that store caller's voice memos and provide them to the called party when the called party cannot answer the call. Include.

The MSC processes the basic voice service and the supplementary service, handles incoming / outgoing calls of subscribers, performs location registration procedure and handoff procedure function, and interworking functions with other networks of the existing network. This is the most important network configuration equipment in mobile communication system.

On the other hand, in recent years, the mobile communication system not only provides a voice communication service but also expands its service area to additional services such as a text message service, a multimedia service, a location inquiry service, and the like, together with a data communication service. Services are being proposed.

In order to stably provide the newly proposed service as described above, it is desirable to prevent the problem by verifying the function and performance in advance in the field situation or similar situation. There is no means to perform this.

SUMMARY OF THE INVENTION The present invention has been proposed to solve the above-mentioned conventional problems, and an object thereof is to dynamically generate an additional service test call and a load test call having scenarios for all sections of the mobile communication system, thereby enabling the function and capacity of the mobile communication system. It is to provide a system and method for checking the performance and load of a mobile communication system that can automatically test the system.

In addition, another object of the present invention is to automatically verify the function and performance of the new exchange package to be applied to the mobile communication system, the performance of the mobile communication system capable of network problem verification and pre-functional test through the on-site situation reproduction And a load inspection system and method.

The present invention is a configuration means for implementing the above-described object, to create a test scenario by combining a plurality of operations corresponding to each function, to create a project by combining the scenarios, and to monitor the created test scenario and test project And a user interface unit providing a user interface screen and a function for inquiring a result of the execution. Set up the test environment through the MMC (Man Machine Communication) interface with the additional equipment of the mobile communication system, manage the test scenario and test project information set through the user interface unit, operation in the corresponding order according to the requested scenario and project A system handler for instructing performance, collecting and performing statistical results of the performance, and providing the result to the user interface; And a mobile call simulator connected to one or more mobile terminals and controlling the one or more mobile terminals through a DM interface according to the instruction of the system handler to perform the origination and reception of a test call. It provides a performance and load inspection system of a mobile communication system.

In addition, the present invention is another configuration means for achieving the above object, in the method for performing the performance and load check of the mobile communication system through the mobile terminal, controlling the mobile terminal to perform the corresponding function for each function made in the mobile terminal Setting a plurality of operations to perform; Setting up a test scenario for checking the performance and load of any service by combining a plurality of operations selected by the user; If the start of the test is required, sequentially instructing performance of the operation according to the order of the set scenarios; Controlling the mobile terminal according to the instruction to perform the indicated operation; Collecting a result of performing the operation; And analyzing the collected performance results and generating and providing performance and load test result data of the mobile communication system to a user.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In addition, the same reference numerals are used for parts having similar functions and functions throughout the drawings.

1 is a block diagram illustrating a first embodiment of a performance and load checking system of a mobile communication system according to the present invention.

Performance and load test system 10 of the mobile communication system according to the first embodiment of the present invention, the user of the test call type scenarios, capacity check scenarios and the setting of the combination project and the monitoring of the test call and capacity check And a test environment through a user interface unit 11 which provides a user interface screen and a function to perform a performance result and statistics inquiry, and a MMC interface with an additional device of a mobile communication system. It manages the information of the test and load box scenarios set through the user interface unit 11 and the project information in combination with them, instructs operations in the corresponding order according to the requested scenarios and projects, collects the results and performs statistical processing. And the system handler 12 to provide the user interface unit 11 with the system handle. According to the instructions of multiple (12) to control at least one physical mobile terminal (9), and a mobile number simulator 13 to process test calls.

The system handler 12 is connected to an additional equipment, such as HLR / SCP / VAS / AuC / SMC / VMS, connected to a mobile switching center (MSC) of a mobile communication system through a TCP / IP based MMC interface.

More specifically, the user interface 11 provides a test call scenario setting function to the user to configure various types of test scenarios, and provides a test call execution and monitoring function to execute a test. It provides real-time monitoring and confirmation of the test call, and provides test call performance result and cause analysis function and statistics related to the test call to analyze the test result after the test is completed to predict problems that may occur when applying new additional services. It provides the trunk channel monitoring and channel listening function where the test is performed, so that the channel status can be checked during the test. In addition, for operation and management of the performance and load inspection system, user registration and management, user history inquiry, system status / fault / load monitoring function, inquiry function such as fault history and statistics, and system information setting function Can be provided. The user interface screen provided by the user interface unit 11 will be described in more detail below.

In addition, the system handler 12 sets a test environment of the mobile communication system indicated through the user interface unit 11 through an MMC interface with additional equipment such as HLR, SCP, VAS, AuC, SMC, VMS, and the like. In addition, through the user interface unit 11 manages the test scenario and the test project information combining the plurality of scenarios, and when the indicated test schedule, the mobile call simulator 13 according to the corresponding scenario ) Instructs the operation to be performed so that the test call is made according to the corresponding scenario, and collects the result of the execution and provides the result to the user at the request of the user interface unit 11. At this time, the information managed by the system handler 12 includes a test execution result, a tracking log during the test execution, and statistical information of the completed test. In addition, the system handler 12 performs management, setting control, system state monitoring, and operation maintenance functions of parameter information of the performance and load inspection system for operation / maintenance of the performance and load inspection system according to the present invention. do.

The mobile call simulator 13 checks the information setting and status of the mobile terminal 9 through a DM (Diagnostic Monitor) with the mobile terminal 9, and also performs a voice call signal and an SMS call to the mobile terminal 9. The mobile terminal 9 is controlled to process a signal, and the result of the execution and the log are received and provided to the system handler 12. In addition, for this processing, system configuration information such as terminal information and channel information of each mobile terminal 9 is set. The DM is for diagnosing or controlling the state of the mobile terminal by accessing the internal resources of the mobile terminal 9, but it was first provided by Qualcomm, but is not limited thereto. Products of other manufacturers may also be used.

2 is a functional block diagram showing the internal configuration of the mobile call simulator 13, where the mobile call simulator 13 is connected to the mobile terminal 9, and supports a DM interface for controlling the operation of the mobile terminal 9; A test for controlling the mobile terminals 9 so that a test call is generated and received by the mobile unit 9 connected through the DM interface processor 13a according to the processor 13a and the system handler 12. A call control section 13b and a management information storage section 13c for storing management information necessary for control of the test call control section 13b.

More specifically, the mobile call simulator 13 uses a DM diagnostic message to control the mobile terminal 9. That is, as shown in FIG. 5, the test call control unit 13b of the mobile call simulator 13 generates a control message for generating and processing a test call through a DM interface, more specifically, a diagnostic message. The diagnostic message is generated and encoded in an Async-HDLC link layer frame, and the Async-HDLC link layer frame is configured to exchange with the mobile terminal 9 on a high speed RS-232C physical link.

In addition, the SMS call control of the mobile terminal 9 in the mobile call simulator 13 may be performed using an AT extension command through IS-707A-Compliant Modem Mode extension, and an interface defined by each terminal standard ( For example, the EIF interface is used to send and receive SMS.

In addition, the mobile call simulator 13 may simultaneously control one or more mobile terminals 9 using the multi-port terminal server 13d. The multi-port terminal server 13d is a server having a plurality of ports to which a plurality of mobile terminals 9 can be connected. The multi-port terminal server 13d is connected to the mobile call simulator 13 via Ethernet, and is connected to the plurality of mobile terminals 9. Perform data exchange between mobile call simulators 13.

Through the above configuration, the test call control unit 13b of the mobile call simulator 13 controls the plurality of mobile terminals 9, where the control process is driven by one thread per mobile terminal. In addition, the test call control unit 13b may not only control simple test call generation and processing, but also emulate a user keypad scenario to test additional services, such as a user directly pressing a keypad of the mobile terminal 9. To help.

The control operation provided by the mobile call simulator 13 through the above-described configuration includes a voice call origination request, a voice call call waiting state, a voice call progress inquiry, a button input request, a voice call termination request, an SMS call request, and an SMS reception wait. The terminal may include one or more of terminal state information inquiry and channel state information inquiry, and the user may create a test scenario by combining the above-described control operations through the user interface unit 11, and the test call based on the created scenario It is processed by the system handler 12 through the operator exchange with the mobile call simulator 12.

In addition, the management information storage unit 13c of the mobile call simulator 13 stores configuration information and state information about a port connected to the mobile terminal 9 for generating and processing a test call, and connected to the port. Information and status information of the mobile terminal 9 is stored.

The above-described system handler 12 requests a test call by scheduling a test scenario and a test project created through the user interface unit 11, and performs call-by-call test call and load box call control. The test results collected through the call-by-call test call control are collected and stored in real time for each type in the internal DB, and then statistically processed after the test is completed and stored in the statistical DB.

In addition, the system handler 12 enables the test environment to be set in advance through the MMC interface and the supplementary service equipment of the mobile communication system, and from each supplementary service equipment during the test by the mobile call simulator 13 described above. Trace logs to help users monitor test progress.

FIG. 5 is a diagram illustrating an internal software module configuration for controlling a test call related to performance and capacity testing of a mobile communication system in a performance and load checking system according to the present invention.

Referring to FIG. 5, the mobile call simulator 13 includes an outgoing call simulator 21 for controlling the processing of an outgoing test call and an incoming call simulator 22 for controlling the processing of an incoming test call. The SMS call agent 21 and the incoming call simulator 22 are each instructed by an SMS related operation from the system handler 12 and control the signaling handlers 213 and 223 to perform an SMS test call corresponding to the operation. Voice call agents 212 and 222 which control signaling handlers 213 and 223 and IVR handlers 214 and 224 to perform voice test calls according to the operation instruction from the system handler 12, and the SMS call agent A signaling handler (213, 223) for performing call control signal processing for the mobile terminal (9) in accordance with control from 211, 221 and voice call agents (212, 222); IVR handlers (214,224) for interactive voice response (IVR) channel management and call channel control, DTMF transmission and reception, sound source playback, and end-to-end path loss testing It is provided.

In addition, the system handler 12 is connected to the first DB 121 for storing the scenario and project information created for the test call, and the terminal information of the mobile terminal 9 connected to the mobile call simulator 11 to perform the test. And a second DB 122 storing state information, a third DB 123 storing information on additional service equipments of the mobile communication system connected to the system handler 12, and a test call execution result. A fourth DB 124 to store, a fifth DB 125 to store statistical processing results of test call execution results stored in the fourth DB 124, and a test stored in the first DB 121 Poll the project periodically, read the test scenario of the project to execute or schedule the project, and solve the scenario triggered by the project scheduler 127 and the project scheduler 127 to trigger the test call for each scenario. To instruct a detailed operation to the SMS / voice call agent 211/212, 221/222 of the mobile call simulator 11, and the call agent 211/212, 221/222 of the mobile call simulator 11. The call controller 128 receives the execution result from the call controller 128 to control the next operation, collects the result of each operation in the scenario, and records the result in the fourth DB 124 and the load box from the project scheduler 127. The call is triggered to interact with the call agents 211/212, 221/222 of the mobile call simulator 11 to exchange operations to control the load test call and receive the result to the fourth DB 124. A loadbox call controller 129 for recording and a mobile communication system for each additional service equipment to process the MMC interface with the additional equipment and to store the result of the execution; A log manager 131 which filters a performance log for a test call transmitted from the mobile call simulator 11 to generate a real-time trace log 126, and when the test call for a predetermined scenario is ended, the fourth call manager 11; The state manager 132 generates statistics by recording the result of the execution stored in the DB 124 and records the fifth DB 125.

The performance / load test procedure of the mobile communication system according to the above configuration is performed as shown in the flowchart of FIG. 6.

That is, when the user wants to test the mobile communication system in the performance and load checking system 10 according to the present invention (S600), the user may check the system handler 12 of the system handler 12 provided through the user interface unit 11. From the list of scenarios stored in the first DB 121, a scenario matching a desired test is selected, or a desired scenario is created through a scenario creation function provided through the user interface unit 11 (S610 to S630).

In the above, one test scenario consists of a combination of basic control operations provided by each call simulator 13 and 14, which generally corresponds to one test subject function.

The combination of the scenarios created as described above may generate a test project including a plurality of test functions (S640).

For the generated test project, both scheduled execution and immediate execution are possible (S650, S660), and when the scheduled execution, the reservation time can be set according to the test plan.

In addition, if a test project to be executed immediately or a test project reached at a scheduled time exists, a test is performed according to the scenario by reading a corresponding scenario (S670), and the system handler 12 will be described in more detail. The project scheduler 127 reads the scenario according to the setting of the project and triggers the call-bycall call controller 128 or the loadbox call controller 129 according to the test type, and the call-bycall call controller 128. And instructs the corresponding operation to the call simulators 13 and 14 according to the order of the scenarios in the load box call controller 129, and thus the originating call simulator 21 or the incoming call simulator of the corresponding call simulators 13 and 14 ( The signaling handler 213 to perform the operation indicated by the SMS call agent or the voice call agent 211/212, 221/222 provided in 22). By controlling the IVR handler 214 processes the outgoing test call and the called test number.

In the above, when the test call is an outgoing call, the call is processed by the outgoing call simulator 21, and the incoming call is processed by the incoming call simulator 22, and when the test call is an SMS call, it is processed by the SMS call agents 211 and 221. In case of a voice call, the voice call agent 212 and 222 processes the voice call.

When the test call instructed as described above is performed, the call agent 211, 212, 221, 222 returns the execution result to the system handler 12, and the system handler 12 stores the returned result in the fourth DB 124. do. In addition, the system handler 12 receives log information generated during test call execution from the call simulators 13, 141 and 5, which are processed by the log manager 131 to generate a trace log 126.

When the test is completed, the state manager 132 adds the test execution result stored in the fourth DB 124 to generate statistical data and store the statistical data in the fifth DB 125.

Performance results and statistical information stored in the fourth and fifth DBs 124 and the tracking log 126 generated by the log manager 131 are provided to the user through the user interface unit 11 (S690).

7 is a flowchart illustrating a specific process of performing a voice call test. When a user schedules a test project for a voice call through a user interface screen of the operation console, it is stored in the first DB 121 and is reserved. When the time is reached, the information of the reserved project is read by the project scheduler 127, and when corresponding scenario information is transferred to the call controller 128, the call controller 128 requests call origination according to the scenario. According to the operation to instruct the call originating call simulator 21 and the call waiting call to the incoming call simulator (22). Thereby, the outgoing call simulator 21 controls the mobile terminal 9 designated for outgoing to make a call, and transmits a call origination result to the call controller 128, whereby the outgoing call is transferred to the mobile switchboard. (MSC) is delivered and set up, and is delivered to the mobile terminal 9 set to the called party, the incoming call simulator 22 is waiting for a call incoming, when the incoming call is delivered through the MSC, This is received and the call reception result is transmitted to the call controller 128 of the system handler 12.

The call controller 128 stores the execution result of the indicated operation, that is, the call setup result in the fourth DB 124, and stores the execution result stored in the fourth DB 124 of the user interface unit 11. It is provided to the user through the monitoring function.

The performance and load checking system of the present invention having the above-described configuration and operation controls the test call by combining the mobile call simulator 13 and the base station call simulator 14, thereby providing additional service for each section of the mobile communication system. Performance and capacity can be tested. 8 to 10 show the types of test calls provided through the performance and load test system according to the present invention for each section. The performance and load test system according to the present invention is divided into voice test call, SMS test call, and additional service test. A call can be provided.

First, in the present invention, the voice test call is a test call for testing an additional service of a switching system such as a call transfer, call waiting, and a multiparty call, and a voice test call for each section that can be provided through the performance and load checking system of the present invention. Is as shown in FIG.

First, by setting the mobile terminal 9 controlled by the mobile call simulator 13 as a called / destination destination, the mobile call simulator 13 instructs to simulate both the outgoing / incoming call, and thus the interval from mobile to mobile ( It is possible to provide a negative test call for M-to-M).

9 shows SMS test calls for each section that can be provided through the performance and load checking system in the present invention, and SMS test calls are for providing a processing capacity test of various application services and a message center (SMC) using SMS. The mobile terminal 9 controlled by the mobile call simulator 13 controls incoming and outgoing calls to provide an SMS test call for a section M-to-M from mobile to mobile.

Next, the additional service test call is provided for the function and capacity test for various additional service equipment, such as VMS, VAS, intelligent network system, the scenario control function through DTMF / sound transmission and reception is used for the test.

FIG. 10 shows an additional service test call for each section provided by the performance and load checking system according to the present invention. Since the additional service is performed between the mobile terminal and the additional service equipment, the destination is the additional service equipment, and the origination process is performed. Is controlled to be performed at each mobile terminal connected to the mobile call simulator 13, thereby providing an additional service test call for a section from the mobile to the additional service equipment.

The present invention can easily test the performance and processing capacity of the switching system for the newly proposed service by combining the aforementioned voice test call, SMS test call and additional service test call.

In this case, the user interface 11 provides a test scenario management, a project management, and a result analysis screen so that a user may facilitate test management and result checking of the exchange system, which may be provided as shown in FIGS. 11A to 11H. have.

11A illustrates a scenario creation screen that supports scenario creation of a test desired by a user, hierarchically representing a test scenario previously registered to the left side of the screen, and expressing detailed operations set to the scenario selected from the left side on the right side. In addition, it is possible to set parameters in a separate window for the selected operation in the right window. One of the scenarios presented through the screen may be selected or a scenario may be newly created.

FIG. 11B illustrates an example of a project creation screen that generates a test project for testing a plurality of functions by combining a plurality of scenarios, and displays a scenario that may be included in the project at the bottom left of the screen, and is included in the project on the right side of the screen. The scenarios are displayed in order, and the scenarios included in the left screen of the screen may be set in the project by using a drag and drop function. When generating a project, by selecting a scenario shown in the lower left of the screen as described above, copied to the right screen, by selecting each scenario to specify the parameters, the project generation is completed. In the above parameter setting, the call-by-call scenario for the performance test should input the number of test repetitions and the test start time, and the load box scenario for the load test should include the total number of calls, the call generation type, the average call time, and the total execution time. Input load rate information, etc.

In addition, the project creation screen provides a function that can be set by selecting immediate execution or scheduled execution of the project.

11c shows an example of a monitoring screen providing a progress state for the user to monitor the ongoing test through the performance and load inspection system according to the present invention, and shows the progress rate, success rate and failure rate of the running project, and the project reservation status. Project unit monitoring that is displayed, scenario unit monitoring that displays the progress, success rate, and failure rate of the scenario, operation-specific monitoring that indicates whether the operation is successful, the cause of failure, actual performance operation parameters, and application layer (ISUP, BSSAP) level. Provides a trace log of call processing and MMC execution results.

FIG. 11D illustrates an example of a result search screen in which a user can search for a result of a completed project, and the user interface 11 displays test results (success rate and failure rate) for each project stored in the system handler 12. Etc.), and a test result for the project selected through the search screen is provided in detail through a detailed test result analysis screen as shown in FIG. 11E. The project search function provided in FIG. 11D includes a function of searching for a completed project based on a project name and a test date, call statistics such as number of attempts, successes, and failures by project / scenario and statistics by failure cause. In the detailed analysis screen provided as shown in FIG. 11E, the number of scenario unit attempts, success rate, call setup delay time, holding time, success or failure per operation, cause of failure, actual performance parameter, tracking log, and It provides the output function for MMC performance result of additional equipment.

In addition, the user interface unit 11 according to the present invention provides a user interface function for operation management and maintenance of a corresponding performance and load inspection system, in addition to monitoring and analyzing results. 11F to 11H illustrate examples of a user interface screen for operation management and maintenance.

First, FIG. 11F illustrates an example of a system monitoring screen provided to a user by the user interface unit 11. The system state of the performance and load inspection system 10 according to the present invention, such as a mounting shape, a failure, and an operating state, is illustrated. Provide information so that the system can be monitored. More specifically, in the system monitoring screen shown in Fig. 11F, the mounting shape for each component constituting the performance and load inspection system 10 is shown in the center window of the screen, and the fault occurrence position W20 is shown in the mounting shape. Display visually. In addition, the left side of the system monitoring screen provides a load monitoring screen (W10) such as the CPU load rate, channel occupancy rate, disk usage rate of the performance and load inspection system 10, and the lower portion of the alarm monitor screen to warn the operator when a failure occurs ( W30).

Next, FIG. 11G illustrates an example of an MMC console screen provided by the user interface unit 11, and additional service equipments (HLR / SCP / VAS / AuC) of a mobile communication system connected to the system handler 12. / SMC / VMS, etc.) allows the operator to execute commands directly through the MMC interface and check the results. As shown in the figure, the MMC console screen displays a registered command list (W80), a command parameter input window (W60) for management of command registration / modification and parameter setting for each device, and a command execution result representing a command execution result. It includes a result display window (W70).

 Finally, FIG. 11H shows an example of a system statistics screen provided through the user interface unit 11. The system statistics screen allows the performance and load test system 10 according to the present invention to search and view call test statistics and performance and load test system 10 generated during a call test. A search window (W90) for selecting, a window (W100) for setting a storage and storage file type for the search result, a first search result inquiry window (W110) showing a graph of the search results, and a search result in a table form And a second search result inquiry window W120 indicated by.

As described above, the mobile call simulator of the present invention controls the actual mobile terminal and provides a test call to the mobile switchboard of the mobile communication system, thereby providing additional services in the mobile communication system from the mobile terminal to the mobile terminal or at the mobile terminal. Automatic test of the performance and capacity of the equipment section.

In addition, the present invention allows a user to create a test scenario by combining the control operations of the call simulator corresponding to a function in a mobile communication system, thereby easily creating a test scenario for a newly proposed new service. This allows new services to be pre-validated under conditions similar to those in the field, resulting in superior service quality.

Claims (27)

A user interface unit for allowing a user to set a test scenario in which a plurality of operations corresponding to each function are combined, set a project by combining the test scenarios, and check monitoring and execution results of each test scenario and a test project; A system handler for managing test scenarios and test project information set through the user interface unit, instructing operation execution in a corresponding order according to the requested scenario and project, and collecting and providing the result of the execution to the user interface unit; And A mobile call simulator connected to one or more mobile terminals to manage information of the connected mobile terminals, and controlling one or more mobile terminals according to the instructions of the system handler to perform origination and reception of test calls; Including but not limited to: The system handler may further include a log manager configured to receive a performance log of each test call from the mobile call simulator and generate a real-time tracking log to monitor and confirm the performance in real time. Performance and load inspection system. The method of claim 1, wherein the mobile call simulator A DM (Diagnostic Monitor) interface processor for supporting operation and state control of the mobile terminal; A test call control unit controlling mobile terminals connected through the DM interface processing unit so that the operation indicated by the system handler is performed; And A management information storage unit for storing configuration information and state information on a port connected to the mobile terminal for the control operation of the test call controller, and information and state information of the mobile terminal connected to the port; Performance and load test system of the mobile communication system comprising a. The method according to claim 1 or 2, And the mobile call simulator controls generation and processing of an SMS test call through a mobile terminal using AT extension commands. The method according to claim 1 or 2, It further comprises a multi-port terminal server having a plurality of ports connected to a plurality of mobile terminals, and is connected via the mobile call simulator and Ethernet to control data exchange between the plurality of mobile terminals and the mobile call simulator. Performance and load inspection system of the mobile communication system. The mobile call simulator of claim 1 or 2, wherein the mobile call simulator comprises: Performs an operation consisting of one or more of a voice call origination request, a voice call waiting state, a voice call progress inquiry, a button input request, a voice call termination request, an SMS call request, an SMS reception wait, a terminal state information inquiry, and a channel state information inquiry And a performance and load inspection system of a mobile communication system. The method of claim 2, The test call controller emulates an input scenario of a user keypad and generates an additional service test call. The method of claim 2, The test call control unit transmits DTMF tones corresponding to the calling party and the called party at the calling party and checks whether the DTMF tone received at the receiving party matches the calling party's calling party's calling party and the called party's calling party number. End-to-End Path Loss) A performance and load checking system of a mobile communication system, characterized by further performing. The method according to claim 1 or 2, The system handler may include: a project scheduler configured to periodically poll a created test project, read a test scenario of a project to execute or schedule a project, and trigger a test call for each scenario; A call-by-call call controller for interpreting a scenario triggered by the project scheduler to instruct a detailed operation, controlling a next operation by receiving a response result of the indicated operation, and collecting a result of performing each operation; And A load box call controller which triggers a load box call for capacity checking from the project scheduler, instructs an operation for a test of the load box call, and collects in response to the execution result; Performance and load test system of the mobile communication system comprising a. The system of claim 8, wherein the system handler is Each additional part of the mobile communication system further includes an MMC interface handler provided with each additional service device for the test call to process an MMC (Man Machine Communication) interface with the additional device and to store the result of the execution. A performance and load inspection system of a mobile communication system, characterized in that the test environment is set by controlling the equipment. delete The system of claim 8, wherein the system handler is And a state manager for generating statistics of a test result by summing performance results collected by the call-by-call call controller and the load box call controller when the test for the test scenario is ended. Load inspection system. The system of claim 8, wherein the system handler is A first DB for storing test scenarios and test project information; A second DB for storing terminal information and state information of the mobile terminal; A third DB for storing information on additional service equipments of the mobile communication system; A fourth DB for storing a test call performance result; And A fifth DB for storing statistical data on test call execution results stored in the fourth DB; Performance and load test system of the mobile communication system comprising a. The mobile call simulator of claim 1 or 2, wherein the mobile call simulator comprises: A signaling handler performing signal processing for call control for the mobile terminal; An Interactive Voice Response (IVR) handler that performs channel management, call channel control, DTMF / sound transmission and reception, and end-to-end path loss testing; And An outgoing call simulator and an incoming call simulator each consisting of a voice call agent controlling a signaling handler and an IVR handler to perform a voice test call and a voice supplementary service test according to an operation instruction from the system handler. Performance and load inspection system of the mobile communication system, characterized in that it comprises. The method of claim 13, The outgoing / incoming call simulator of the mobile call simulator receives an SMS related operation from the system handler, controls the signaling handler to perform an SMS test call corresponding to the operation, and returns the result to the system handler. Performance and load checking system of a mobile communication system, further comprising an SMS call agent. The method of claim 1, The user interface unit sets at least one of the number of test repetitions and test start time information in the case of the performance test scenario, and at least one of the total number of generated calls, the call generation type, the average call time, and the total execution time in the load test scenario. And a user interface function for setting load ratio information including a performance and load checking system of a mobile communication system. The method of claim 1, The user interface unit, project unit monitoring information indicating the progress rate, success rate and failure rate of the running project and the project reservation status, scenario unit monitoring information indicating the progress rate, success rate and failure rate of the scenario, success or failure of the operation, cause of failure, And a monitoring screen including at least one of operation-specific monitoring information displaying parameters of an actual performing operation, a call processing execution process, and tracking log information. The method of claim 16, The user interface unit further includes a function search function for searching a project for which execution has been completed and a project search screen for providing call statistics for each project or scenario found and statistical results for each failure cause. . The method of claim 17, The user interface unit outputs one or more of the number of scenario unit attempts, success rate, call setup delay time, holding time, success or failure of each operation, cause of failure, actual performance parameter, trace log, and environment setting result for the selected project. Performance and load inspection system of the mobile communication system, characterized by further providing a detailed analysis screen. In the method for performing the performance and load check of the mobile communication system through the mobile terminal, Setting a plurality of operations for controlling the mobile terminal to perform a corresponding function for each function performed in the mobile terminal; Setting up a test scenario for checking the performance and load of any service by combining a plurality of operations selected by the user; If the start of the test is required, sequentially instructing performance of the operation according to the order of the set scenarios; Controlling the mobile terminal according to the instruction to perform the indicated operation; Collecting log information generated during a test call while the operation is performed; Collecting a result of performing the operation; And And providing the collected tracking log information and the performance result to the user. The method of claim 19, And combining a plurality of the test scenarios to set up a test project including a plurality of test functions. The method of claim 19 or 20, The operation for controlling the mobile terminal may include voice call origination request, voice call incoming call waiting, voice call progress state inquiry, button input request, voice call termination request, SMS call request, SMS reception wait, and terminal state information inquiry. And channel status information inquiry. The method of claim 19 or 20, And setting a test start time for the set scenario or project, and determining that a test start is required when the set test start time arrives. The method of claim 19 or 20, And setting a test environment by controlling each equipment of the mobile communication system before starting the test. The method of claim 19 or 20, And monitoring the trunk channel of the mobile communication system in which the test is performed so as to check a channel state during a test and providing a channel listening function. delete The method of claim 19 or 20, Analyzing the collected performance results, generating and providing performance and load test result data of the mobile communication system to the user, And summing up the collected performance results to provide statistics. The method of claim 19, The step of setting a test scenario for checking the performance and load of any service by combining a plurality of operations selected by the user, For performance test scenarios, set one or more of the number of test iterations and test start time information, and for load test scenarios, load rates that include one or more of total number of generated calls, call generation type, average talk time, and total execution time. A method for checking performance and load in a mobile communication system, comprising the step of setting information.

Images