KR20150134716A - System for servicing cloud streaming, method of servicing cloud streaming and server for the same - Google Patents

Abstract

A cloud streaming service system, a cloud streaming service method, and a server therefor are disclosed. Captures and encodes an execution screen corresponding to a current section of an application executed for a cloud streaming service to generate real-time data, captures and encodes an execution screen corresponding to a predetermined line capturing interval of the application, Transmitting the real-time data, and transmitting at least a part of the line capture data, thereby minimizing the delay time and improving the reaction speed.

Description

Technical Field [0001] The present invention relates to a cloud streaming service system, a cloud streaming service system, a cloud streaming service method, and a server for the cloud streaming service system,

The present invention relates to a cloud streaming service system, a cloud streaming service method, and a server for the same. More particularly, the present invention relates to a cloud streaming service system, A cloud streaming service system, a cloud streaming service method, and a server for the same.

Cloud computing refers to Internet-based computer technology, which allows users to use the Internet at any time without having to install the necessary software on their computers, and to easily share the expensive hardware required to run the software Service. In other words, an individual can access the Web and use high-end software such as Photoshop and Office, and the data is stored on the web. As a result, multiple users can connect to a single cloud computing server cluster to perform individual tasks.

As the IT technology and application markets evolve, the amount of data that users process through their own terminal devices is increasing rapidly. In this case, the cloud computing system can be a solution to this increase in data throughput. In addition, the cloud computing system can be a basis for miniaturization of the terminal device.

For example, in executing software requiring a large amount of image processing, the software is executed through a server based on cloud computing, and only the execution result screen is transmitted to the user's terminal using streaming technology, The user can use high-end software through the terminal.

As described above, the terminal device transmits a request for software execution to the cloud computing server using the terminal device of the user, and the cloud computing server transmits the execution screen of the software requested by the user to the user through streaming. Service.

In this case, the amount of transmission varies depending on the amount of change of the screen. If the change of the screen is large, the transmission time becomes longer, so that it takes more time until the client receives the screen after inputting by the user. . On the contrary, when the change of the screen is small, the transmission time is shortened and the spare band is generated until the next input of the user. Therefore, if additional data can be transmitted using the spare band, the delay time can be minimized.

Therefore, when a cloud streaming service is provided, there is a need for a new cloud streaming service technology capable of reducing the response time by transmitting a screen having a large screen change in advance, when there is a spare bandwidth.

Korean Patent Publication No. 10-2000-0040087A, published on July 5, 2000 (Name: Video playback speed control method using scene change distribution)

It is an object of the present invention to minimize the delay time when providing a cloud streaming service.

It is also an object of the present invention to minimize the delay time in a section where a screen change is large by recognizing a section in which a screen change is large and capturing and encoding the screen in advance and transmitting the screen in advance to the reserved band.

It is also an object of the present invention to improve the speed of the user's sensory response by transmitting only different parts when the line capture data transmitted in advance and the data to be actually transmitted are different.

According to an aspect of the present invention, there is provided a cloud streaming server including: a controller for capturing and encoding an execution screen corresponding to a current section of an application executed for a cloud streaming service to generate real-time data; A storage unit for storing pre-capture data obtained by capturing and encoding an execution screen corresponding to a predetermined pre-capture interval of the application; And a communication unit for transmitting the real-time data and transmitting at least a part of the line-capturing data.

In this case, the communication unit may transmit at least a part of the pre-transmission data that is not transmitted during the spare band until the next input is received after transmitting the real-time data corresponding to the current section.

At this time, if the communication unit enters the line capturing period before transmission of all of the line capturing data is performed and the transmission of the real-time data corresponding to the line capturing period is requested, Lt; / RTI >

In this case, when the real-time data to be transmitted and the line capture data are different, the communication unit may transmit only the portion of the real-time data that is different from the line capture data when the real-time data is entered.

In this case, the line capturing period may be a period in which a change in the screen, which is searched based on a user input scenario, is larger than a preset reference.

In this case, the line capturing period may be a period in which a screen change analyzed based on the execution history of the application is larger than a preset reference.

At this time, the line capturing period may be an interval of the user's entry, which is analyzed based on the execution history of the application, which is longer than the preset reference.

In addition, the terminal device according to the present invention may be configured such that real-time data generated by capturing and encoding an execution screen corresponding to a current section of an application executed in a cloud streaming server and an execution screen corresponding to a predetermined line capturing interval of the application are captured And a line capturing data generated by encoding; And a controller for providing the cloud streaming service by displaying any one of the real-time data and the pre-capture data on the screen.

At this time, the communication unit may receive at least a part of an unreceived portion of the line capture data during a spare band until receiving the real time data corresponding to the current section and transmitting the next input.

In this case, when the communication unit enters the line capturing period before receiving all the line capturing data, the communication unit can receive the unreceived portion of the line capturing data.

In this case, when the application enters the pre-capture period, the control unit may display the pre-capture data on the screen, and if not, display the real-time data on the screen.

According to another aspect of the present invention, there is provided a cloud streaming service method comprising: generating a line capture data by capturing and encoding an execution screen corresponding to a predetermined line capture interval of an application executed for a cloud streaming service; Capturing and encoding an execution screen corresponding to a current section of the application to generate real-time data; Transmitting the real-time data; And transmitting at least some of the pre-capture data.

At this time, the step of transmitting at least a part of the line capture data may transmit at least a part of the line capture data that has not been transmitted during the spare band until receiving the next input.

At this time, at least a part of the line capture data may be transmitted before the transmission of all of the line capture data is performed, and when the transmission of the line capture data is requested, It is possible to transmit an unexecuted portion.

According to another aspect of the present invention, there is provided a cloud streaming service method comprising: receiving real-time data generated by capturing and encoding an execution screen corresponding to a current section of an application executed in a cloud streaming server; Receiving at least a part of line capture data generated by capturing and encoding an execution screen corresponding to a predetermined line capturing interval of the application; And providing the cloud streaming service by displaying either the real-time data or the line-capturing data on the screen.

At this time, receiving at least a portion of the line capture data may receive at least a portion of the unreceived portion of the line capture data during an extra band before transmitting the next input.

At this time, the step of receiving at least part of the line capture data may receive the unreceived part of the line capture data when entering the line capture section before receiving all of the line capture data.

In this case, the step of providing the service may display the pre-capture data on the screen when the application enters the pre-capture period, and display the real-time data on the screen if not.

In addition, the cloud streaming service system according to the present invention may capture and encode an execution screen of an application executed for a cloud streaming service, and capture and encode an execution screen corresponding to the generated real- A cloud streaming server for transmitting at least any one of line capture data generated by the server; And a terminal device receiving at least one of the real-time data and the line-capturing data, and displaying the real-time data and the line-capturing data on a screen to provide a cloud streaming service.

According to the present invention, delay time can be minimized when providing a cloud streaming service.

In addition, the present invention recognizes a section having a large screen change, captures and encodes the screen in advance, and transmits the screen in advance to the reserved band, thereby minimizing a delay time in a section where a screen change is large.

In addition, the present invention improves the user's sensory response speed by transmitting only different parts when the line capturing data transmitted in advance differs from the actually transmitted data.

1 is a block diagram illustrating a cloud streaming service system according to an embodiment of the present invention.
2 is a block diagram illustrating an example of the cloud streaming server shown in FIG.
3 is a block diagram showing an example of the terminal device shown in FIG.
4 to 7 are views illustrating an example of a change of a cloud streaming service screen according to an embodiment of the present invention.
FIG. 8 is a flowchart illustrating an example of a cloud streaming service method (server perspective) according to an embodiment of the present invention.
FIG. 9 is an operational flowchart illustrating an example of a cloud streaming service method (terminal viewpoint) according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description and the accompanying drawings, detailed description of well-known functions or constructions that may obscure the subject matter of the present invention will be omitted. It should be noted that the same constituent elements are denoted by the same reference numerals as possible throughout the drawings.

The terms and words used in the present specification and claims should not be construed to be limited to ordinary or dictionary meanings and the inventor is not limited to the concept of terminology for describing his or her invention in the best way. It should be interpreted as meaning and concept consistent with the technical idea of the present invention. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention, and not all of the technical ideas of the present invention are described. Therefore, It is to be understood that equivalents and modifications are possible. Also, the terms first, second, etc. are used for describing various components and are used only for the purpose of distinguishing one component from another component, and are not used to define the components.

1 is a block diagram illustrating a cloud streaming service system according to an embodiment of the present invention.

Referring to FIG. 1, a cloud streaming service system according to an embodiment of the present invention includes a cloud streaming server 110, a terminal device 120, and a network 130.

The cloud streaming server 110 captures and encodes an execution screen corresponding to the current section of the application executed for the cloud streaming service to generate real-time data, and captures and displays an execution screen corresponding to a predetermined line capturing interval of the application Encoded, line capture data is stored, the real time data is transmitted, and at least some of the line capture data is transmitted.

At this time, the cloud-streaming server 110 transmits real-time data corresponding to the current section, and transmits at least a part of the line-capturing data that has not been transmitted during a spare band until receiving the next input .

At this time, the cloud streaming server 110 enters the line capture interval before transmission of all of the line capture data is performed, and when the transmission of the real-time data corresponding to the line capture interval is requested, Can be transmitted.

At this time, when the real-time data to be transmitted and the line capture data are different, the cloud streaming server 110 can transmit only the portion of the real-time data that is different from the line capture data when entering the line capture interval.

In this case, the line capturing period may be a period in which a change in the screen, which is searched based on a user input scenario, is larger than a preset reference.

Alternatively, the line capturing period may be a period in which a screen change analyzed based on the execution history of the application is larger than a preset reference.

Alternatively, the line capturing period may be an interval in which the user's entry, which is analyzed based on the execution history of the application, is larger than a predetermined reference.

The terminal device 120 captures and encodes an execution screen corresponding to the real-time data generated by capturing and encoding an execution screen corresponding to the current section of the application executed in the cloud streaming server and a predetermined line capturing interval of the application And displaying the real-time data and the line-capturing data on a screen to provide a cloud streaming service.

Hereinafter, the terminal device 120 will be described as an example of a mobile communication terminal connected to a communication network and capable of uploading or downloading content based on a cloud computing system. However, the terminal device 120 is limited to a mobile communication terminal The present invention can be applied to various terminals such as all information communication devices, multimedia terminals, wired terminals, fixed type terminals and IP (Internet Protocol) terminals. The terminal device 120 may be a mobile phone, a portable multimedia player (PMP), a mobile Internet device (MID), a smart phone, a desktop, a tablet PC, a notebook, A mobile terminal having various mobile communication specifications such as a net book, a personal digital assistant (PDA), a smart TV, an information communication device, and the like.

At this time, the terminal device 120 may receive at least a part of an unreceived portion of the pre-capture data during an extra band until the next input is transmitted after receiving the real-time data corresponding to the current section.

At this time, when the terminal device 120 enters the line capturing period before receiving all of the line capturing data, the terminal device 120 may receive the unreceived portion of the line capturing data.

At this time, the terminal device 120 may display the pre-capture data on the screen when the application enters the pre-capture interval, and display the real-time data on the screen if not.

The network 130 provides a path for transferring data between the cloud streaming server 110 and the terminal device 120, and is a concept covering both existing networks and future developable networks. For example, the network 130 may be a wired or wireless local area network that provides communication of various information devices within a limited area, a mobile communication network that provides communication between mobile objects and mobile objects outside the mobile object, Or a wired / wireless communication network, or a combination of two or more. Meanwhile, the transmission scheme standard of the network 130 is not limited to the existing transmission scheme standard, and may include all transmission scheme standards to be developed in the future.

2 is a block diagram illustrating an example of the cloud streaming server shown in FIG.

Referring to FIG. 2, the cloud streaming server shown in FIG. 1 includes a control unit 210, a storage unit 220, and a communication unit 230.

The control unit 210 may be an operating system (OS) and a process unit for driving each configuration. In particular, the controller 210 according to the present invention captures and encodes an execution screen corresponding to a current section of an application executed for a cloud streaming service to generate real-time data.

At this time, the real-time data may be the captured and encoded data of the current screen in which the executed application is executed according to the input of the user. That is, it is continuously generated in real time as the application is executed.

The storage unit 220 is a device for storing data, and includes a main storage device and an auxiliary storage device, and stores an application program required for a function operation of the cloud streaming server. The storage unit 220 may include a program area and a data area. In this case, when the cloud streaming server activates each function corresponding to the request of the user, the cloud streaming server executes the corresponding application programs under the control of the controller 210 to provide each function. In particular, the storage unit 220 according to the present invention stores pre-capture data, which is captured and encoded in an execution screen corresponding to a predetermined pre-capture period of the application.

In this case, the storage unit 220 may be an optical storage medium such as a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, a compact disk read only memory (CD-ROM), a digital video disk (ROM), a random access memory (RAM), a flash memory, and the like, such as a magneto-optical disk, a magneto-optical disk, and a floppy disk. .

According to an embodiment, the pre-capture interval may be a section that is searched based on a user input scenario, and the change of the screen is larger than a preset reference.

That is, it is possible to generate a scenario according to user input predicted for an application, and to set a section in which the amount of change of the screen is larger than a preset reference when the screen is changed according to the scenario, as a line capturing interval. For example, based on user input scenarios, a line capture interval can be set if more than 50 percent of the screen changes.

Alternatively, the line capturing period may be a period in which a screen change analyzed based on the execution history of the application is larger than a preset reference.

That is, an execution history, which is a history in which an application has been executed in the past, is stored, and an interval in which the screen is changed more than a predetermined reference in the execution history can be set as a line capture interval. For example, you can set the line capture interval to be the interval in which the execution history changes more than 50% of the screen.

Alternatively, the line capturing period may be an interval in which the user's entry, which is analyzed based on the execution history of the application, is larger than a predetermined reference.

That is, by analyzing the execution history, it is possible to set a section in which a lot of users enter, that is, a section with a lot of requests, as a line capture section.

Alternatively, a line capturing interval may be set by combining any one of the above three criteria.

The communication unit 230 performs a function of transmitting and receiving data to and from the cloud streaming server via the network. Here, the communication unit 230 includes RF transmitting means for up-converting and amplifying the frequency of the transmitted signal, RF receiving means for low-noise amplifying the received signal and down-converting the frequency. The communication unit 230 may include at least one of a wireless communication module (not shown) and a wired communication module (not shown). The wireless communication module is configured to transmit and receive data according to a wireless communication method. When the cloud streaming server uses wireless communication, the wireless communication module transmits data using either a wireless network communication module, a wireless LAN communication module, To the terminal device. The wired communication module is for transmitting / receiving data by wire. The wired communication module can connect to the network through a wired line and transmit / receive data to / from the terminal device. That is, the cloud streaming server connects to the network using a wireless communication module or a wired communication module, and can transmit and receive data to and from the terminal device through the network. In particular, the communication unit 230 according to the present invention transmits the real-time data and transmits at least a part of the line-capturing data.

At this time, the communication unit 230 can transmit and receive data through various communication methods including a wired method and a wireless method.

At this time, the communication unit 230 may include a plurality of communication modules each transmitting data according to different communication methods.

According to an embodiment, the communication unit 230 transmits real-time data corresponding to the current section, and then transmits at least a part of the line-capturing data that is not transmitted during the spare band until the next input is received .

That is, it is possible to transmit the captured real-time data first with the user's input from the terminal device, and transmit the captured line data if the remaining bandwidth remains until receiving the next input. If there is no spare band, only real-time data can be transmitted. At this time, even if all of the line capture data can not be transmitted, a part of the line capture data can be transmitted only to the spare band. Some untransmitted parts can receive real time data by receiving the next input, and can transmit parts that have not yet been transmitted when the spare band is left.

According to the embodiment, when the communication unit 230 enters the line capturing period before transmission of all of the line capturing data is performed and is requested to transmit real-time data corresponding to the line capturing period, Can be transmitted.

In other words, if all of the line capture data is transmitted when entering the line capture interval, the terminal device will provide the cloud streaming service using the received line capture data instead of the real time data, and since the cloud streaming server has no data to be transmitted There may be a spare band. On the other hand, if the line capturing data has not yet been transmitted after entering the line capturing period, the rest of the line capturing data that has not yet been transmitted is transmitted so that the terminal device can provide the cloud streaming service.

According to the embodiment, when the real-time data to be transmitted and the line capture data to be transmitted differ from each other when the line capturing section enters the communication section 230, the communication section 230 may transmit only the portion of the real-time data different from the line capture data.

At this time, the line capture data corresponding to the line capture interval, which is predicted based on the user input scenario or analyzed based on the execution history of the application, may not be exactly the same as the real time data actually requested. In this case, it may be more efficient to transmit only the different portions and provide the cloud streaming service in combination with the previously transmitted line capture data, rather than transmitting the entire real-time data. Therefore, when entering the line capturing section, it is possible to recognize different parts of real-time data and line capturing data, and transmit only different parts.

3 is a block diagram showing an example of the terminal device shown in FIG.

Referring to FIG. 3, the terminal shown in FIG. 1 includes a communication unit 310 and a control unit 320.

The communication unit 310 performs a function of transmitting and receiving data to and from the cloud streaming server through a network. Here, the communication unit 310 includes RF transmitting means for up-converting and amplifying the frequency of the transmitted signal, RF receiving means for low-noise amplifying the received signal and down-converting the frequency. The communication unit 310 may include at least one of a wireless communication module (not shown) and a wired communication module (not shown). The wireless communication module is configured to transmit and receive data according to a wireless communication method. When the terminal device uses wireless communication, the wireless communication module transmits data using any one of a wireless network communication module, a wireless LAN communication module, and a wireless fan communication module. It can send and receive to the cloud streaming server. The wired communication module is for transmitting / receiving data by wire. The wired communication module can connect to the network through a wired network and transmit / receive data to / from the cloud streaming server. That is, the terminal device can access the network using a wireless communication module or a wired communication module, and can exchange data with the cloud streaming server through the network. In particular, the communication unit 310 according to the present invention may be configured such that an execution screen corresponding to a current section of an application executed in a cloud streaming server is captured and encoded, and real-time data generated and an execution screen corresponding to a pre- And at least one of line capture data generated by capturing and encoding is received.

At this time, the communication unit 310 can transmit and receive data through various communication methods including a wired method and a wireless method.

At this time, the communication unit 310 may include a plurality of communication modules each transmitting data according to different communication methods.

At this time, the real-time data may be the captured and encoded data of the current screen in which the executed application is executed according to the input of the user. That is, it continues to receive in real time according to the execution of the application.

In this case, the line capturing period may be a period in which a change in the screen, which is searched based on a user input scenario, is larger than a preset reference.

That is, it is possible to generate a scenario according to user input predicted for an application, and to set a section in which the amount of change of the screen is larger than a preset reference when the screen is changed according to the scenario, as a line capturing interval. For example, based on user input scenarios, a line capture interval can be set if more than 50 percent of the screen changes.

Alternatively, the line capturing period may be a period in which a screen change analyzed based on the execution history of the application is larger than a preset reference.

That is, an execution history, which is a history in which an application has been executed in the past, is stored, and an interval in which the screen is changed more than a predetermined reference in the execution history can be set as a line capture interval. For example, an interval where more than 50 percent of the screen changes in the execution history may be set as a line capture interval.

Alternatively, the line capturing period may be an interval in which the user's entry, which is analyzed based on the execution history of the application, is larger than a predetermined reference.

That is, by analyzing the execution history, the user can enter a lot of times, that is, a lot of requests can be set as a line capture interval.

Alternatively, a line capturing interval may be set by combining any one of the above three criteria.

According to an embodiment, the communication unit 310 may receive at least a part of an unrecorded portion of the pre-capture data during a spare band until the next input is transmitted after receiving real-time data corresponding to the current section .

That is, it is possible to receive the real-time data captured and encoded with the input of the user and the line capture data if the extra band remains until the next input is transmitted. If no spare band is left, only real-time data can be received. At this time, even if all of the line capture data is not received, a part of the line capture data can be received only by the spare band. The part that has not received can receive the real time data by transmitting the next input, and can receive the part that has not yet received when the spare band is left.

According to an embodiment, when the communication unit 310 enters the line capturing period before receiving all of the line capturing data, the communication unit 310 may receive an unreceived portion of the line capturing data.

That is, if all of the line capture data is received when entering the line capture interval, the control unit 320 will provide the cloud streaming service using the received line capture data instead of the real time data, and the cloud streaming server There is no spare band. On the other hand, if the line capturing data has not yet been received yet, it is possible to provide the cloud streaming service by receiving the remainder of the line capture data that has not yet been received.

At this time, if the real-time data and the line capture data are different from each other, the communication unit 310 can receive only the different portion of the real-time data from the line capture data.

The control unit 320 may be an operating system (OS) and a process unit for driving each configuration. For example, the control unit 320 may control the entire process of connecting to the cloud streaming server. For example, when accessing a cloud streaming server through a separate service application, it is possible to control the entire process of executing the service application according to a request of the user, and to control the transmission of the service use request to the cloud streaming server at the same time At this time, it is possible to control so that terminal information necessary for user authentication is transmitted together. In particular, the controller 320 according to the present invention provides a cloud streaming service by displaying either the real-time data or the line capture data on the screen.

At this time, the display unit (not shown) displays information on a series of operation states, operation results, and the like that occur during the function of the terminal apparatus. Further, the display unit can display a menu of the terminal device and user data input by the user. Here, the display unit may be a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), a light emitting diode (LED), an organic light emitting diode (OLED) Active matrix OLED (OLED), retina display, flexible display, and 3-dimensional (3-dimension) display. At this time, when the display unit is configured as a touch screen, the display unit can perform some or all of the functions of the input unit (not shown). In particular, the display unit according to the present invention provides a cloud streaming service by displaying real-time data or line capture data on the screen under the control of the controller 320. [

According to an embodiment, when the application enters the pre-capture period, the control unit 320 displays the pre-capture data on the screen, and if not, displays the real-time data on the screen.

That is, when the line capture data corresponding to the line capture interval is available, the delay time can be minimized by displaying the line capture data.

At this time, when the real-time data and the line capture data are different from each other, the control unit 320 combines the part of the real-time data received by the communication unit 310, which is different from the line capture data, So that the cloud streaming service can be provided.

At this time, the line capture data corresponding to the line capture interval, which is predicted based on the user input scenario or analyzed based on the execution history of the application, may not be exactly the same as the real time data actually requested. In this case, it may be more efficient to receive a different portion than the entire real-time data and to provide the cloud streaming service in combination with previously received line capture data. Accordingly, when entering the line capturing section, the cloud streaming server recognizes different parts of the real-time data and line capturing data and transmits only different parts, and the controller 320 combines the different parts and the line capturing data to perform the cloud streaming service .

4 to 7 are views illustrating an example of a change of a cloud streaming service screen according to an embodiment of the present invention.

4 to 7, a cloud streaming service screen according to an embodiment of the present invention includes upper left portions 410, 510, 610 and 710, left lower portions 420, 520, 620 and 720, and right portions 430, 530, 630, 730).

Hereinafter, the case where the screen changes sequentially from FIG. 4 to FIG. 7 will be described as an example.

7, the right part changes from '1' 630 to '2' 730. Since about half of the screen changes, it is set as a line capturing interval based on the user input scenario or execution history . Hereinafter, it is assumed that a section changing from FIG. 6 to FIG. 7 is a line capturing section.

When changing from FIG. 4 to FIG. 5, the lower left portion changes from 'a' 420 to 'b' 520. Since the size of the lower left portion is small, the amount of change of the screen is small, and thus a spare band occurs. At this time, only a part of the line capture data '2' is transmitted as much as it can transmit during the spare band. This is called '2-1'.

When changing from FIG. 5 to FIG. 6, the upper left portion changes from 'A' 510 to 'B' 610. Since the upper left portion is also small in size, the amount of change in the screen is small, so a margin is generated. At this time, only a part of the line capture data '2' is transmitted as much as it can transmit during the spare band. This is called '2-2'.

The section changing from FIG. 6 to FIG. 7 is a line capturing section. However, since the line capture data '2' is not transmitted at all, the remaining untransmitted data is transmitted. This is called '2-3'.

If '2' is divided and some of '2-1' and '2-2' are not transmitted in advance, and '2' is transmitted in its entirety, a delay time may occur due to a large amount of data. However, according to the present invention, '2-1' and '2-2', which are part of the line capture data, are transmitted in advance, and when entering the line capture interval, only the remaining '2-3' The entire transmission of '2' can be completed, and the delay time can be minimized.

FIG. 8 is a flowchart illustrating an example of a cloud streaming service method (server perspective) according to an embodiment of the present invention.

Referring to FIG. 8, a cloud streaming service method according to an exemplary embodiment of the present invention generates and stores pre-capture data, which captures and encodes an execution screen corresponding to a preset pre-capture period of an application (S810).

According to an embodiment, the pre-capture interval may be a section that is searched based on a user input scenario, and the change of the screen is larger than a preset reference.

That is, it is possible to generate a scenario according to user input predicted for an application, and to set a section in which the amount of change of the screen is larger than a preset reference when the screen is changed according to the scenario, as a line capturing interval. For example, based on user input scenarios, a line capture interval can be set if more than 50 percent of the screen changes.

Alternatively, the line capturing period may be a period in which a screen change analyzed based on the execution history of the application is larger than a preset reference.

That is, an execution history, which is a history in which an application has been executed in the past, is stored, and an interval in which the screen is changed more than a predetermined reference in the execution history can be set as a line capture interval. For example, you can set the line capture interval to be the interval in which the execution history changes more than 50% of the screen.

Alternatively, the line capturing period may be an interval in which the user's entry, which is analyzed based on the execution history of the application, is larger than a predetermined reference.

That is, by analyzing the execution history, it is possible to set a section in which a lot of users enter, that is, a section with a lot of requests, as a line capture section.

Alternatively, a line capturing interval may be set by combining any one of the above three criteria.

In addition, the cloud streaming service method according to an embodiment of the present invention determines whether the user enters the pre-capture interval (S820). If the user does not enter the pre-capture interval, And captures and encodes an execution screen corresponding to the section to generate real-time data (S830).

At this time, the real-time data may be the captured and encoded data of the current screen in which the executed application is executed according to the input of the user. That is, it is continuously generated in real time as the application is executed.

In addition, the cloud streaming service method according to an embodiment of the present invention transmits real time data (S840).

At this time, if the size of the real-time data is small, a spare band may occur until the next input is received.

In addition, the cloud streaming service method according to an embodiment of the present invention transmits at least a part of the line capture data (S850).

According to an embodiment, the step of transmitting at least some of the pre-capture data may be performed after the step of transmitting real-time data corresponding to the current section, during transmission of the pre-capture data during an extra band until receiving the next input At least a portion of a portion that is not a part of the system.

That is, it is possible to transmit the captured real-time data first with the user's input from the terminal device, and transmit the captured line data if the remaining bandwidth remains until receiving the next input. If there is no spare band, only real-time data can be transmitted. At this time, even if all of the line capture data can not be transmitted, a part of the line capture data can be transmitted only to the spare band. Some untransmitted parts can receive real time data by receiving the next input, and can transmit parts that have not yet been transmitted when the spare band is left.

In addition, the cloud streaming service method according to an embodiment of the present invention receives the user's input again and determines whether or not the user enters the line capture interval (S820).

If all of the line capture data has not been transmitted, a portion of the line capture data that has not been transmitted is transmitted (S860).

In other words, if all of the line capture data is transmitted when entering the line capture interval, the terminal device will provide the cloud streaming service using the received line capture data instead of the real time data, and since the cloud streaming server has no data to be transmitted There may be a spare band. On the other hand, if the line capturing data has not yet been transmitted after entering the line capturing period, the rest of the line capturing data that has not yet been transmitted is transmitted so that the terminal device can provide the cloud streaming service.

Although not shown in FIG. 8, in the cloud streaming service method according to an embodiment of the present invention, when the real-time data to be transmitted and the line capture data are different when entering the line capture interval, Lt; RTI ID = 0.0 > a < / RTI >

At this time, the line capture data corresponding to the line capture interval, which is predicted based on the user input scenario or analyzed based on the execution history of the application, may not be exactly the same as the real time data actually requested. In this case, it may be more efficient to transmit only the different portions and provide the cloud streaming service in combination with the previously transmitted line capture data, rather than transmitting the entire real-time data. Therefore, when entering the line capturing section, it is possible to recognize different parts of real-time data and line capturing data, and transmit only different parts.

FIG. 9 is an operational flowchart illustrating an example of a cloud streaming service method (terminal viewpoint) according to an embodiment of the present invention.

Referring to FIG. 9, the cloud streaming service method according to an embodiment of the present invention transmits a user's input and determines whether the user enters a pre-capture interval (S910). If the user does not enter a pre-capture interval, The execution screen corresponding to the current section of the application to be executed is captured and encoded and the generated real-time data is received (S920).

At this time, the real-time data may be the captured and encoded data of the current screen in which the executed application is executed according to the input of the user. That is, it continues to receive in real time according to the execution of the application.

In addition, in the cloud streaming service method according to an embodiment of the present invention, at least a part of the line capture data generated by capturing and encoding an execution screen corresponding to a predetermined line capturing period of an application is received (S930).

In this case, the line capturing period may be a period in which a change in the screen, which is searched based on a user input scenario, is larger than a preset reference.

That is, it is possible to generate a scenario according to user input predicted for an application, and to set a section in which the amount of change of the screen is larger than a preset reference when the screen is changed according to the scenario, as a line capturing interval. For example, based on user input scenarios, a line capture interval can be set if more than 50 percent of the screen changes.

Alternatively, the line capturing period may be a period in which a screen change analyzed based on the execution history of the application is larger than a preset reference.

That is, an execution history, which is a history in which an application has been executed in the past, is stored, and an interval in which the screen is changed more than a predetermined reference in the execution history can be set as a line capture interval. For example, an interval where more than 50 percent of the screen changes in the execution history may be set as a line capture interval.

Alternatively, the line capturing period may be an interval in which the user's entry, which is analyzed based on the execution history of the application, is larger than a predetermined reference.

That is, by analyzing the execution history, the user can enter a lot of times, that is, a lot of requests can be set as a line capture interval.

Alternatively, a line capturing interval may be set by combining any one of the above three criteria.

According to an embodiment, the step of receiving at least some of the pre-capture data may include, after receiving the real-time data corresponding to the current section, at least a portion of the pre- Some can be received.

That is, it is possible to receive the real-time data captured and encoded with the input of the user and the line capture data if the extra band remains until the next input is transmitted. If no spare band is left, only real-time data can be received. At this time, even if all of the line capture data is not received, a part of the line capture data can be received only by the spare band. The part that has not received can receive the real time data by transmitting the next input, and can receive the part that has not yet received when the spare band is left.

In addition, the cloud streaming service method according to an embodiment of the present invention provides a cloud streaming service by displaying real-time data on a screen (S940).

In addition, the cloud streaming service method according to an embodiment of the present invention transmits the input of the user again, and determines whether or not the user enters the line capture interval (S910).

In addition, the cloud streaming service method according to an embodiment of the present invention enters a line capture interval, and if all of the line capture data has not been received, the unreceived portion of the line capture data is received (S950).

That is, if all of the line capture data is received when entering the line capture interval, the terminal device will provide the cloud streaming service using the received line capture data instead of the real time data, and since the cloud streaming server has no data to be transmitted There may be a spare band. On the other hand, if the line capturing data has not yet been received yet, it is possible to provide the cloud streaming service by receiving the remainder of the line capture data that has not yet been received.

In addition, the cloud streaming service method according to an embodiment of the present invention provides a cloud streaming service by displaying line capture data on a screen (S960).

That is, when the user enters the line capture section and can provide the cloud streaming service using the line capture data, the line capture data is displayed on the screen to provide the cloud streaming service.

Although not shown in FIG. 9, when the real-time data and the line capture data are different from each other, the cloud streaming service method according to an embodiment of the present invention receives only a different part from the real- .

At this time, the line capture data corresponding to the line capture interval, which is predicted based on the user input scenario or analyzed based on the execution history of the application, may not be exactly the same as the real time data actually requested. In this case, it may be more efficient to receive a different portion than the entire real-time data and to provide the cloud streaming service in combination with previously received line capture data. Therefore, when entering the line capturing section, the cloud streaming server recognizes different parts of the real-time data and the line capturing data and transmits only different parts, and the terminal device combines different parts and line capturing data to provide a cloud streaming service .

The steps shown in Figs. 8 and 9 may be performed in the order shown in Figs. 8 and 9, in reverse order, or concurrently.

The cloud streaming service method according to the present invention can be implemented as a program or a smartphone application that can be performed through various computer means. At this time, the program or smartphone application may be recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and configured for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Includes all types of hardware devices that are specially configured to store and execute magneto-optical media and program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions may include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. Such a hardware device may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, the cloud streaming service system, the cloud streaming service method, and the apparatus for the same according to the present invention are not limited to the configuration and method of the embodiments described above, All or some of the embodiments may be selectively combined.

The present invention recognizes an interval in which a screen change is large, captures and encodes the screen in advance, and transmits the screen in advance to the spare band, thereby minimizing a delay time in a section where a screen change is large, When the data is different, it is possible to improve the speed of the user's sensory reaction by transmitting only the different part. Therefore, by reducing the wasted time and resources when using the cloud streaming service, it is possible to activate the cloud streaming service industry and contribute to industrial development.

110: Cloud streaming server 120: Terminal device
130: Network 210:
220: storage unit 230: communication unit
310 communication unit 320 control unit

Claims (20)

A controller for capturing and encoding an execution screen corresponding to a current section of an application executed for the cloud streaming service to generate real time data;
A storage unit for storing pre-capture data obtained by capturing and encoding an execution screen corresponding to a predetermined pre-capture interval of the application; And
A communication unit for transmitting the real-time data and transmitting at least a part of the line-
Wherein the server comprises: The method according to claim 1,
The communication unit
And transmits at least a part of a portion of the pre-capture data that has not been transmitted during a spare band until the next input is received after transmitting real-time data corresponding to the current section. The method of claim 2,
The communication unit
And transmits the part of the line capture data that has not been transmitted, when it is requested to transmit the real-time data corresponding to the line capturing interval, before entering the line capturing interval before transmission of all the line capture data is performed A cloud-streaming server. The method of claim 2,
The communication unit
Wherein when the real-time data to be transmitted and the line-capture data differ from each other when the line-capturing period is entered, only the portion of the real-time data different from the line-capturing data is transmitted. The method of claim 2,
The line capture interval
Wherein the server is a section that is searched based on a user input scenario and the change of the screen is larger than a preset reference. The method of claim 2,
The line capture interval
And the change of the screen, which is analyzed based on the execution history of the application, is larger than a preset reference. The method of claim 2,
The line capture interval
Wherein the user's entry is longer than the preset reference time based on the execution history of the application. An execution screen corresponding to a current section of an application running in the cloud streaming server is captured and encoded, and real-time data generated by capturing and encoding an execution screen corresponding to a predetermined line capturing interval of the application, A communication unit for receiving either one; And
A controller for providing a cloud streaming service by displaying any one of the real-time data and the line capture data on a screen,
And a terminal device. The method of claim 8,
The communication unit
And receives at least a part of an unrecorded portion of the line capture data during a spare band until a next input is transmitted after receiving the real time data corresponding to the current section. The method of claim 9,
The communication unit
And receives a portion of the line capture data that has not been received when the line capture section enters the line capture section before receiving all of the line capture data. The method of claim 9,
The control unit
And displays the pre-capture data on the screen when the application enters the pre-capture interval, and displays the real-time data on the screen if not. Capturing and encoding an execution screen corresponding to a predetermined pre-capture interval of an application executed for a cloud streaming service to generate pre-capture data;
Capturing and encoding an execution screen corresponding to a current section of the application to generate real-time data;
Transmitting the real-time data; And
Transmitting at least some of the line capture data
The method of claim 1, The method of claim 12,
Wherein transmitting at least some of the line capture data comprises:
And transmits at least a part of the line capture data that has not been transmitted during an extra band until receiving the next input. 14. The method of claim 13,
Wherein transmitting at least some of the line capture data comprises:
And transmits a part of the line capture data, which is not transmitted, when the line capturing section enters the line capturing section and is requested to transmit the line capturing data before the transmission of the entire line capturing data is performed. Way. Receiving real-time data generated by capturing and encoding an execution screen corresponding to a current section of an application running on a cloud streaming server;
Receiving at least a part of line capture data generated by capturing and encoding an execution screen corresponding to a predetermined line capturing interval of the application; And
Providing the cloud streaming service by displaying any one of the real-time data and the line capture data on the screen
The method of claim 1, 16. The method of claim 15,
The step of receiving at least some of the line capture data
And receives at least a part of an unrecorded portion of the line capture data during an extra band until a next input is transmitted. 18. The method of claim 16,
The step of receiving at least some of the line capture data
And receiving a portion of the line capture data that has not been received when the line capture section enters the line capture section before receiving all of the line capture data. 18. The method of claim 16,
The step of providing the service
Displaying the pre-capture data on the screen when the application enters the pre-capture interval, and displaying the real-time data on the screen if not. A recording medium on which a program for executing the method according to any one of claims 12 to 18 is recorded. At least one of the real-time data generated by capturing and encoding an execution screen of an application executed for the cloud streaming service and the line capture data generated by capturing and encoding an execution screen corresponding to a predetermined line capture interval of the application A cloud streaming server; And
And a terminal device for receiving the at least one of the real-time data and the line-capturing data and displaying the real-time data and the line-capturing data on a screen to provide a cloud streaming service. system.

Images