KR101773908B1 - System for Verifying Application, Terminal and Screen Capturing Method Thereof - Google Patents

Abstract

An embodiment of the present invention relates to an application verification system, a terminal, and a screen capture method in a terminal. An application verification system according to an embodiment of the present invention determines whether an operation state of the application is required to be verified when a device including an arbitrary application is connected and is provided with a verification tool for verification according to the determination result, A terminal for capturing the screen by using a screen capture button displayed on a screen during operation of the verification tool to generate image information; And a cloud computing service device providing the verification tool to the terminal, receiving the image information, storing the image information, and providing the image information upon request of the terminal.

Description

[0001] The present invention relates to an application verification system, a terminal capture method,

An embodiment of the present invention relates to an application verification system, a terminal, and a screen capture method in a terminal. More specifically, a specific library such as a DDMS (Dalvik Debug Monitoring Service) is stored so that an operation of a terminal having an operating system (OS) such as Android or an application can be stored as an image and used for document data or problem delivery process An application verification system capable of creating a code to be used and capturing a screen of a terminal in a Java run-only environment (JRE) of a terminal verification tool, and a screen capture method in a terminal and a terminal.

2. Description of the Related Art In recent years, mobile communication terminals have been rapidly developing their functions as a result of active research activities. That is, the size of the terminal is reduced and the weight is also lightly improved in order to make it convenient to carry. In the inner function of the terminal, not only a general voice call but also various functions such as internet search, wireless data communication, It is implemented and provides convenience to users.

In accordance with such development trend, at present, there is provided a camera in a mobile communication terminal, and an image can be taken, edited and registered as a background screen or transmitted, and a scene currently displayed on a terminal screen is captured and stored as important information And it is reaching a state where it can utilize it when necessary. For example, the captured information may be used to check the driving status of the terminal.

1 is a diagram illustrating a structure of a conventional terminal.

As shown in FIG. 1, the conventional terminal includes a control unit 100, a display unit 110, a general screen providing unit 120, and a capturing screen providing unit 130.

Here, the controller 100 controls the overall signal of the terminal, and the display unit 110 displays a general screen or a captured screen under the control of the controller 100. [ In addition, the general screen providing unit 120 provides a general screen according to the operation in the general operation mode, and the capture screen providing unit 130 generates and stores a capture screen when a predetermined capture operation key signal is inputted, And provides the captured screen to the control unit 100 upon request.

However, in the conventional OMP (Open Market Place) verification system, in order to capture a verification screen, the android SDK (Software Development Kit), which is an Android development environment, must be installed in a state where a JAVA development environment is installed in the terminal, I used a DDMS tool in the tool to connect the serial cable to the PC. In general, I could not do a screen capture if I did not know the tool.

For example, when a developer wants to share a screen or issue a screen of an Android device during terminal verification or application verification, it is possible to capture the screen while the tool is installed and the environment is in the above state. Thus, the Java SE Developers Kit There was a lot of hassle in installing, downloading the Android SDK file, and setting up and running the tool to perform screen capture.

Embodiments of the present invention provide an application verification system, a terminal, and a screen capturing method of a terminal, which can easily capture a screen in a JRE environment of a terminal verification tool by generating a code using a specific library such as a DDMS have.

An application verification system according to an embodiment of the present invention determines whether an operation state of the application is required to be verified when a device including an arbitrary application is connected and is provided with a verification tool for verification according to the determination result, A terminal for capturing the screen by using a screen capture button displayed on a screen during operation of the verification tool to generate image information; And a cloud computing service device providing the verification tool to the terminal, receiving the image information, storing the image information, and providing the image information upon request of the terminal.

A terminal according to a first embodiment of the present invention includes a display unit for displaying installation states of a system including data transmitted and received by wired / wireless communication and a specific program on a screen; Wherein the verification tool comprises a Java Run-Time Environment (JRE) and a DDMS library (Dalvik Debug Monitoring Service Library) as a collection of capture-related programs that execute command processing on the JRE A screen capture validation tool; And a controller for controlling the display unit to display the data and the installation state of the system on a screen, and controlling the capturing of the screen by driving the verification tool.

The terminal according to the second embodiment of the present invention may include an Apple validation determination unit for determining whether the operation state of the application is required to be verified when a device including an arbitrary application is connected; A verification tool for verification or verification tool-related information is provided from the cloud computing service apparatus according to a result of the determination by the Apple verification determination unit, and the verification is performed using a screen capture button displayed on the screen according to the driving of the verification tool, A control unit for providing image information of a screen to the computing service apparatus and managing the image information; And a display unit displaying the operation state of the application, the screen capture button, and the image information on the screen.

Also, a screen capture method in a terminal according to an exemplary embodiment of the present invention is a verification tool used when capturing a screen of a terminal, and includes a Java Run-Only Environment (JRE) and a DDMS corresponding to a collection of capture- Determining whether a verification tool having a library exists, and installing the verification tool in the terminal if the verification tool is not present; Generating and displaying a screen capture button for driving the verification tool to execute the command processing; And performing a screen capture according to a command provided when the screen capture icon is selected, and storing image information on the screen capture.

According to the embodiment of the present invention, for example, since the operation of the Android terminal or the application operation is stored as an image and is used for the document data or the problem delivery process, it is possible to provide convenience to the developer or operator on the job.

Also, in the process of testing an application using an application verification tool without installing a plurality of tools and capturing a screen provided at that time using a specific tool, a screen capture related button is simplified It is convenient for users because it can capture screen of terminal by clicking.

1 is a diagram illustrating a structure of a terminal according to the related art for screen capture,
2 is a diagram illustrating an OMP verification system according to a first embodiment of the present invention;
3 is a diagram showing the structure of a verification tool stored in the Apple verification tool part of FIG. 2,
4 is a diagram illustrating a driving process of the second terminal of FIG. 2,
5 is a diagram showing a driving screen of the second terminal of FIG. 2 by the verification tool,
6 is a diagram illustrating an OMP verification system in a cloud computing environment according to a second embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 2 is a diagram showing an OMP verification system according to a first embodiment of the present invention, and FIG. 3 is a diagram showing a structure of a verification tool stored in the Apple verification tool unit of FIG.

2 and 3, the OMP verification system according to the first embodiment of the present invention includes a first terminal 200 and a second terminal 210 (hereinafter referred to as a terminal) 210 includes an Apple verification tool 215 for verifying a running state of the first terminal 200 or an application in the first terminal 200. [

The terminals 200 and 210 may be applied to various wired and wireless environments and may be classified into personal digital assistants (PDAs) classified into types of terminals 200 and 210, cellular phones, smart phones, and the like, (Global System for Mobile) phone, a W-CDMA (Wideband CDMA) phone, a CDMA-2000 phone, and an MBS (Mobile Broadband System) phone. Here, the MBS phone is a terminal to be used in a next generation system currently being discussed. In addition, the terminals 200 and 210 may further include a desktop computer, a laptop computer, a netbook, a tablet PC, and a cloud terminal used in a cloud computing environment. The first terminal 200 is preferably a smart phone of the Android operating system, and the second terminal 210 is preferably a PC according to an embodiment of the present invention.

The terminals 200 and 210 may include or further include a wireless communication module, a wireless LAN (WLAN) module and a GPS module, a key input unit, a memory, and the like, although not shown separately in the drawings. The wireless communication module can be connected to a communication network to perform voice and data communication with the other party. By providing the wireless LAN module, the wireless LAN module can access a communication network via an access point (AP) And can receive data provided through the GPS satellite as the GPS module is provided.

The terminals 200 and 210 may be connected to a wireless application protocol (WAP), an Internet access protocol (WAP), a Microsoft Internet Explorer (MIE) based on HTML using an HTTP protocol, a Handheld Device Transport Protocol (HDPT) , I-mode by NTT DoKoMo, or a browser for a wireless Internet access of a specific communication company. Among the Internet access protocols used by the terminals 200 and 210, the MIE uses m-HTML, which slightly reduces and modifies HTML, and in the case of i-Mode, a language called compact HTML (c-HTML) Lt; / RTI > In recent years, in order to provide a faster wireless Internet, a terminal such as a smart phone uses a browser for a wireless Internet access of a specific communication company such as Opera Mini for iPhone, WiFi (WiFi) and WiBro (WiBro) are also used together to provide wireless broadband.

In more detail with respect to the second terminal 210, the second terminal 210 verifies an application or the like in the first terminal 200 having, for example, the Android operating system. The second terminal 210 may include a control unit 211, a display unit 213, and an Apple verification tool unit 215 in order to perform the functions thereof.

First, the control unit 211 controls overall signals for operating the second terminal 210. In other words, specific data is displayed on the display unit 213 by controlling signals or data transmitted and received through the wireless communication module, the wireless LAN module, and the GPS module, and when the first terminal 200 is connected to the first terminal 200, 215 to capture a specific screen when the user selects a screen capture button displayed on the display unit 213 and store the image information on the captured screen in a memory.

In addition, the Apple verification tool unit 215 can be used as a verification tool for verifying a specific application in the first terminal 200, for example, by using a specific library such as a Java Runtime Environment (JRE) and a DDMS tool And the like. Here, the JRE provides an environment that allows a Java application to be executed on the terminal regardless of the operating system of the C language. Regardless of the operating system, Java programs can be executed on a user terminal because Java is a Java virtual machine (JVM) and programs are executed and JRE provides a JVM-driven environment. For example, let's say you create a program in Java and send it to a friend who uses the Windows operating system and a friend who uses the Linux operating system. At this time, if two friends have installed the JRE, they will run without recompiling the Java program. Accordingly, the verification tool according to the embodiment of the present invention may be any type of tool as long as it is a development tool having a Java-based web application form. In addition to the JVM, the JRE also includes a Runtime class library and a Java application launcher for running programs written in the Java programming language. On the other hand, the library is a collection of frequently used partial programs in a program. In the embodiment of the present invention, DDMS used for screen capture and debugging is one example.

The verification tool of the Apple verification tool unit 215 may be formed in the form of a folder structure as shown in FIG. Referring to FIG. 3, OMP_SOAV_MD indicates the main directory of the verification tool, and an android folder is added for screen capture. For example, ddmlib is the unzipped version of ddmlib.jar in the Android SDK, and the screenshot part is the command to interface ddmlib with the command from the validation tool. The screenshot section is a part of the Java program developed for command processing. The imgs folder stores image information about the screen captured by the verification tool.

The command can be handled and processed in the following command processing format. In the tool, the command is transmitted to ddmlib by clicking the screen capture button.

> java (javaw) com.android.screenshot.Screenshot [OUTPUT FILE]

If you do not uncompress ddmlib and make it ddmlib.jar, if you make the screenshot part as screenshot.jar, normal operation will be possible.

>> java -jar screenshot.jar [OUTPUT FILE]

As a result, the command system for capturing a screen using the verification tool according to the embodiment of the present invention generates a screen capture command within the screen capture button click & verification tool and transfers the captured screen capture command to the DDMS. → the screen capture from the verification tool.

FIG. 4 is a diagram illustrating a driving process of the second terminal of FIG. 2, and FIG. 5 is a diagram illustrating a driving screen of the second terminal of FIG. 2 by the verification tool.

Referring to FIG. 4 together with FIG. 2, if the second terminal 210 does not have an Apple verification tool installed therein for verifying the application of the first terminal 200, (S401). The verification tool is connected to the same specific device. Such a verification tool is, for example, a program capable of processing commands using only a JRE and a specific library. Here, the specific library is a collection of frequently used partial programs in a program. In the embodiment of the present invention, the DDMS used for screen capture and debugging may be a form of library.

Then, the second terminal 210 performs application verification by the verification tool in connection with the first terminal 200 having the Android operating system (S403). At this time, the second terminal 210 may display a screen capture button in the progress of the verification tool. Here, the second terminal 210, or more accurately, the control unit 211 may recognize that the first terminal 200 is connected by, for example, executing a connection manager or an automatic program when the first terminal 200 is connected.

When the user selects a screen capture button to capture a specific or continuous screen of the application in the process of testing the application in the first terminal 200 using the verification tool, the second terminal 210 displays the screen capture button (S405). ≪ / RTI > Here, it may be understood that the second terminal 210 determines whether a screen capture button has been selected, that is, generates a specific command for performing a screen capture function when a button is selected.

When the screen capture button is selected by the user, the second terminal 210 captures a screen displayed on the display unit 213 during a test process for a specific application in the first terminal 200, (Step S407). And the saved image information can be displayed on the screen.

The user of the second terminal 210 may then invoke the stored image to create a user's comment in text and use it in the testing process of the verification tool. To do this, you can send related images to the developer.

When the verification tool is operated, a screen capture button may be displayed substantially on the screen of the second terminal 210 as shown in FIG. 5. At this time, in the process of testing the application in the first terminal 200, To sequentially generate the first image (image 1) to the fourth image (image 4), and display the stored first to fourth images on the screen. Even if the screen changes quickly due to the application operation, if the screen capture button is pressed, the next screen is captured and stored in the image folder of the verification tool, so that the screen capture can be performed quickly and conveniently.

6 is a diagram illustrating an OMP verification system in a cloud computing environment according to a second embodiment of the present invention.

6, the OMP verification system of the cloud computing environment according to the second embodiment of the present invention includes a second terminal 610 and a cloud computing service apparatus 630, and includes a first terminal 600, A communication network 620 and a cloud provider 640. [

Here, the first terminal 600 and the second terminal 610 (hereinafter, referred to as terminal) in the second embodiment of the present invention may also be used in a mobile terminal such as a smart phone, a desktop computer, A laptop computer, a netbook, a tablet PC, and a cloud terminal used in a cloud computing environment. In a second embodiment of the present invention, the first terminal 600 is a smartphone of the Android operating system , And the second terminal 610 may be a PC.

The terminals 600 and 610 according to the second embodiment of the present invention are terminals 600 and 610 having minimal hardware and software resources applied under a cloud computing environment and exist in an intangible form such as a cloud The second terminal 610 receives a computing resource, such as software, from the cloud computing service device 630, for example, in accordance with the second embodiment of the present invention, the verification tool for verifying the application in the first terminal 600, The information may be provided from the computing service device 630 or only the information provided after the cloud computing service device 630 drives the verification tool when the service of the second terminal 610 is requested.

More specifically, when the first terminal 600 connects to the second terminal 610 in order to verify the operation of the application in the first terminal 600, the second terminal 610 determines the first terminal 600 from the cloud computing service apparatus 630, 1 is provided with a verification tool for verifying an application in the terminal 600 and temporarily stored, or after storage, an image of an operation of the application in the first terminal 600 using a screen capture button to verify the application And related image information may be stored in the memory of the second terminal 610 or may be provided to the cloud computing service device 630 for storage. After that, the second terminal 610 can supply the image information again from the cloud computing service device 630 whenever necessary and provide a comment to the application developer or the like. In order to perform this function, the second terminal 610 may include an Apple verification determination unit (not shown) for determining whether the first terminal 600 is connected and performs application verification. For example, the Apple validation determination unit may include a smart automatic program, which automatically determines when the first terminal 600 accesses the second terminal 610 and transmits the first terminal 600 to the first terminal 600 And a connection manager that enables the user to perform a verification process for an application in the network 600.

The communication network 620 includes both wired and wireless communication networks and includes, for example, a base station controller, a base station transmitter, and / or a repeater as a wireless communication network. Here, the base station controller relays signals between the base station transmitter and the exchange. The network 620 supports both synchronous and asynchronous. Therefore, in case of the synchronous type, the transmission and reception base station transmitter will be a base station transmission system (BTS), the transmission and reception base station controller will be a base station controller (BSC) The transmitting and receiving base station controller will be an RNC (Radio Network Controller). Of course, the communication network 620 according to an embodiment of the present invention is not limited to this, and may be a GSM network, which is not a CDMA network, and an access network of a next-generation mobile communication system to be implemented in the future, such as a cloud computing network under a cloud computing environment .

The cloud computing service device 630 is an apparatus for storing and managing computing resources such as software existing in an intangible form. For example, the cloud computing service device 630 may be configured to perform the operation of the application in the first terminal 600 according to a request of the second terminal 610, And provides a processing result only after the verification tool is driven internally. The operation of the application in the first terminal 600 made by the verification tool is displayed on the screen of the second terminal 610 Stored in the form of captured image information, and may provide the stored image again when requested by the second terminal 610.

The cloud computing service device 630 can access the cloud provider 640 via the communication network 620 using a virtual organization technique and register the resources provided by the cloud provider 640 have. Accordingly, developers can quickly develop a verification tool through an API (Application Programming Interface) provided by a service provider, that is, a cloud computing service device 630, without developing a specific verification tool or the like from the beginning. At this time, (630) manages the cloud provider (640). Here, the API refers to a language or a message format used for communication between an operating system and an application program.

Other than the above, the first terminal 600 and the second terminal 610 according to the second embodiment of the present invention include the first terminal 200 and the second terminal 600 according to the first embodiment of the present invention, The second terminal 210 is replaced with the contents of the second terminal 210 and will not be described further.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the inventions. Modifications and variations will be possible. Accordingly, the embodiments disclosed in the present invention are not intended to limit the scope of the present invention, but rather to illustrate the present invention. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of the same shall be included in the scope of the present invention.

The embodiments of the present invention are applicable to an application verification system, a terminal, and a screen capturing method in a terminal. According to an embodiment of the present invention, for example, an operation of an Android terminal or an application operation is stored as an image, It is used in the delivery process, so it can provide convenience to the developer or operator on the job. In addition, when a user wants to test an application using an application verification tool without having to install various tools and capture a screen provided at that time using a specific tool, It is convenient for users because it is possible to capture screen of terminal easily.

100, 211: control unit 110, 213:
120: General picture providing unit 130:
200, 600: first terminal 210, 610: second terminal
215: Apple (Appl.) Verification tool part 620:
630: a cloud computing service device 640: a cloud provider

Claims (9)

[Claim 1 has been abandoned due to the registration fee.] Wherein the verification tool is provided with a verification tool for verifying whether an operation state of the application needs verification when connecting to an apparatus including an arbitrary application and according to a determination result, A terminal for capturing the screen using a button to generate image information; And
And a cloud computing service device that provides the verification tool to the terminal and receives the image information, stores the image information, and provides the image information upon request of the terminal,
The verification tool has a Java Run-Time Environment (JRE) and a DDMS library (Dalvik Debug Monitoring Service Library) as a collection of capture-related programs in which command processing is performed on the JRE,

The DDMS library comprises:
Ddmlib part for storing the Android operating system's software development kit (SDK); And
And a screenshot unit for processing a command provided at the time of capturing the screen and transmitting the processed command to the ddmlib unit,
The screenshot unit is a Java program for interfacing command processing to a ddmlib unit through a command, generates a screen capture command by recognizing a selection of a screen capture button in the terminal, and transmits the generated screen capture command to the ddmlib unit, And the capture of the screen is performed.
A display unit for displaying installation states of a system including data transmitted and received by wired / wireless communication and a specific program on a screen;
Wherein the verification tool comprises a Java Run-Time Environment (JRE) and a DDMS library (Dalvik Debug Monitoring Service Library) as a collection of capture-related programs that execute command processing on the JRE A screen capture validation tool; And
And a control unit for controlling the display unit to display the data and the installed state of the system on a screen and controlling the capturing of the screen by driving the verification tool,

The DDMS library comprises:
Ddmlib part for storing the Android operating system's software development kit (SDK); And
And a screenshot unit for processing a command provided at the time of capturing the screen and transmitting the processed command to the ddmlib unit,
Wherein the display unit displays a screen capture button for capturing the screen when the verification tool is operated,
The screenshot unit is a Java program for interfacing command processing to the ddmlib unit through a command, generates a screen capture command by recognizing the selection of the screen capture button, and transmits the command to the ddmlib unit to execute an Android command through the ddmlib unit And the capture of the screen is performed.
delete delete [Claim 5 is abandoned upon payment of registration fee.] 3. The method of claim 2,
Wherein the verification tool further comprises an imgs portion,
Wherein the imgs unit stores image information of the captured screen. [Claim 6 is abandoned due to the registration fee.] An Apple validation judging unit for judging whether an operation state of the application needs to be verified when a device including an arbitrary application is connected;
A verification tool for verification or verification tool-related information is provided from the cloud computing service apparatus according to a result of the determination by the Apple verification determination unit, and the verification is performed using a screen capture button displayed on the screen according to the driving of the verification tool, A control unit for providing image information of a screen to the computing service apparatus and managing the image information; And
And a display unit for displaying an operation state of the application, the screen capture button, and the image information on the screen,
The verification tool has a Java Run-Time Environment (JRE) and a DDMS library (Dalvik Debug Monitoring Service Library) as a collection of capture-related programs in which command processing is performed on the JRE,

The DDMS library comprises:
Ddmlib part for storing the Android operating system's software development kit (SDK); And
And a screenshot unit for processing a command provided at the time of capturing the screen and transmitting the processed command to the ddmlib unit,
The screenshot unit is a Java program for interfacing command processing to a ddmlib unit through a command, generates a screen capture command by recognizing the selection of a screen capture button in the terminal, and transmits the generated screen capture command to the ddmlib unit, Command is executed to capture the screen.
A verification tool used for capturing a screen of a terminal includes a Java Run-Only Environment (JRE) and a verification tool having a DDMS library (Dalvik Debug Monitoring Service Library) corresponding to the capture-related program set in which the command processing is performed on the JRE And installing the verification tool in the terminal if the verification tool does not exist as a result of the determination;
Generating and displaying a screen capture button for driving the verification tool to execute the command processing; And
Performing the screen capture according to a command provided when the screen capture button is selected, and storing image information on the screen capture;
, ≪ / RTI &

The DDMS library comprises:
Ddmlib part for storing the Android operating system's software development kit (SDK); And
And a screenshot unit for processing a command provided at the time of capturing the screen and transmitting the processed command to the ddmlib unit,
The screenshot unit is a Java program for interfacing command processing to the ddmlib unit through a command, generates a screen capture command by recognizing the selection of the screen capture button, and transmits the command to the ddmlib unit to execute an Android command through the ddmlib unit And the screen is captured by the terminal.
delete [Claim 9 is abandoned upon payment of registration fee.] 8. The method of claim 7,
Wherein the storing the image information for the screen capture comprises:
And storing the image information in an imgs portion of the verification tool.

Images