JP7630996B2 - Information processing device, control method for information processing device, and program - Google Patents

Description

The present invention relates to an information processing device , a control method for an information processing device, and a program.

At present, communication terminals equipped with a web browser (hereinafter, referred to as a browser) and having a function for browsing web pages on the browser are in widespread use. By displaying a web page of an external service through the browser, the communication terminal can link with the external service.
Incidentally, there is a technology in which a browser running on a cloud server generates a rendering result of a web page, and transmits the rendering result to a communication terminal to display the web page on a terminal device that does not have a browser. Such a cloud-based browser runs on a virtual machine running on the cloud server. Various device resources required for a PC are virtually allocated to the virtual machine. Therefore, the browser running on the virtual machine can operate in the same way as when it runs on a PC. Patent Document 1 describes a cloud system that switches the type of browser depending on whether or not privacy-related information is handled.

JP 2014-200072 A

However, when a browser designed to be able to call the functions of a communication terminal is used on the cloud, there is a problem that the communication terminal cannot execute a specified function until it receives the drawing result. For example, consider a browser designed to sound a sound from the communication terminal when a display item generated by an element to which a disabled attribute is attached is pressed. The purpose of sounding is to make the user aware that the corresponding element cannot be operated. Here, assume that a Web page has multiple <button> elements that wait for user operation input, and one of the <button> elements has a disabled attribute attached. When a general built-in browser is used, when a user presses a button based on a <button> element to which a disabled attribute is attached, a sound is immediately sounded. However, when a browser on the cloud is used, a sound is sounded in accordance with the notification of the drawing result as the processing result of the Web page. Therefore, if it takes a long time to generate the drawing result, it takes a long time from when the user presses the button until the sound is sounded, which may confuse the user.

The present invention aims to improve the convenience of users when using a cloud-based browser.

The information processing device of the present invention is an information processing device capable of communicating with a communication terminal, and comprises a first transmission means for transmitting a drawing result of a Web page to the communication terminal, an acquisition means for acquiring information indicating an operation on the communication terminal for the drawing result of the Web page transmitted by the first transmission means, a second transmission means for updating the drawing of the Web page in accordance with the operation indicated by the information acquired by the acquisition means and transmitting the updated drawing result to the communication terminal, and a third transmission means for transmitting to the communication terminal, when the operation indicated by the information acquired by the acquisition means is an operation on a specified item displayed on the Web page, command information that is generated when the operation is performed on the specified item, and when the operation indicated by the information acquired by the acquisition means is an operation on the specified item displayed on the Web page, the third transmission means transmits the command information to the communication terminal in priority to the transmission of the updated drawing result by the second transmission means, and the second transmission means transmits the updated drawing result to the communication terminal after the transmission of the command information by the third transmission means .

The present invention can improve the convenience for users when using a cloud-based browser.

FIG. 2 illustrates an example of a hardware configuration of a virtual machine. FIG. 2 is a diagram illustrating an example of the hardware configuration of a communication terminal and a web server. FIG. 1 is a diagram illustrating an example of an overall configuration of an information processing system. 5 is a flowchart showing a flow of processing of the communication terminal of the first embodiment. 10 is a flowchart illustrating a flow of processing of a virtual machine according to the first embodiment. 1A and 1B are diagrams illustrating an example of a description of a Web page and a rendering result according to the first embodiment. FIG. 4 illustrates an example of a command table according to the first embodiment; 13 is a flowchart illustrating a flow of processing of a virtual machine according to the second embodiment. 13A and 13B are diagrams illustrating an example of a description of a Web page and a rendering result according to the second embodiment. FIG. 13 illustrates an example of a command table according to the second embodiment;

The following describes an embodiment of the present invention with reference to the drawings. Note that the following embodiment does not limit the scope of the present invention as defined by the claims, and not all of the combinations of features described in the present embodiment are necessarily essential to the solution of the present invention. Note that the same components are described with the same reference numerals.

First Embodiment
In the present embodiment, the virtual machine 100 operates a browser available on the communication terminal 110 on the cloud. When processing a Web page, if there is an execution command executable by the communication terminal 110, the virtual machine 100 provides the execution command to the communication terminal 110 in preference to the rendering result of the Web page. This makes it possible to promptly execute the operation on the communication terminal 110 even if it takes time to generate the rendering result. In this embodiment, an example will be described in which a sound is generated from the communication terminal 110 in response to a user operation on a specific element included in a Web page described in HTML format. Specifically, when a user presses a display item based on a <button> element or an <input> element to which a disable attribute or a readonly attribute is assigned, a sound is generated from the communication terminal. A Web page is an example of Web information. In this embodiment, the virtual machine 100 is configured to acquire an execution command when a specific operation is performed, but is not limited to this, and may be configured to acquire an execution command when an error notification or the like is received.

FIG. 1A is a diagram showing an example of the hardware configuration of a virtual machine 100 in this embodiment. The virtual machine 100 is configured on a cloud server and mainly includes a CPU 101, a ROM 102, a RAM 103, and an interface 104. These are connected to each other via a bus 105. The virtual machine 100 is an example of an information processing device. The CPU (Central Processing Unit) 101 controls the entire virtual machine 100. The CPU 101 executes the processing of the flowchart described below and various functions by reading and executing a program stored in the ROM 102, etc. The ROM (Read Only Memory) 102 stores the program executed by the CPU 101 and an instruction table 204 (FIG. 2). The RAM (Random Access Memory) 103 functions as a working area for the CPU 101 and also temporarily stores data used during program execution.

The interface 104 is a network interface for connecting to the gateway 201 (Figure 2). The interface 104 may also have a function for connecting to a display device that displays data stored in the ROM 102 or data supplied from the outside, or an input device for inputting data in response to a user's operation. The virtual machine 100 may also have a virtually installed hard disk, memory card, etc. The virtual machine 100 may also virtually access external storage devices including removable optical disks such as flexible disks (FDs) and compact disks (CDs), magnetic or optical cards, IC cards, memory cards, etc., to input and output data.

FIG. 1B is a diagram showing an example of the hardware configuration of the communication terminal 110 and the Web server 120 in this embodiment. The communication terminal 110 is a terminal device on which a user views and operates a screen, such as a PC (personal computer) or a tablet terminal. The communication terminal 110 may also be an MFP (multi-function peripheral). The Web server 120 is a server device that stores Web pages. Below, the configurations of the communication terminal 110 and the Web server 120 that are similar to each other will be described in terms of the communication terminal 110, and a description of the Web server 120 will be omitted.

The communication terminal 110 mainly comprises a CPU 111, a ROM 112, a RAM 113, a HDD 114, an interface 115, and a touch panel 116. These are interconnected via a bus 117. The CPU 111 controls the entire device. The CPU 111 reads out and executes programs stored in the ROM 112 and the like to execute the processes of the flowcharts described below and various functions. The ROM 112 stores the programs executed by the CPU 111. The RAM 113 functions as a working area for the CPU 111 and also temporarily stores data used during program execution. The HDD 114 stores various data, setting information, and the like. The HDD 114 of the web server 120 also has a database that stores web pages.

The interface 115 is a network interface for connecting to a network such as the Internet. The interface 115 of the communication terminal 110 also connects to peripheral devices such as a scanner and a printer. The communication terminal 110 executes scanning and printing under the control of the CPU 111.
The touch panel 116 has both a screen display function and a user operation input function. Under the control of the CPU 101, the communication terminal 110 displays the drawing result of the Web page on the touch panel 116 of the communication terminal 110. The touch panel 116 of the communication terminal 110 is an example of a display unit. Hereinafter, the touch panel 116 of the communication terminal 110 is referred to as a screen. The drawing result of the Web page includes display items (buttons, input fields, etc.) that accept input operations from the user. The touch panel 116 is equipped with a touch sensor. When a touch operation by a user's finger or the like is detected, a signal detected by the touch sensor is processed by a program for the touch sensor stored in the ROM 112, and the touched position is calculated as coordinate information on the touch panel 116.
Furthermore, a sound output device (not shown) and an LED lamp (not shown) are built into the communication terminal 110. The communication terminal 110 executes sound output and lighting of an LED lamp under the control of the CPU 101.

Next, an example of the overall configuration of the information processing system according to this embodiment will be described with reference to FIG. 2. In this system, an image generation system 200 consisting of a virtual machine 100 and a gateway 201, a communication terminal 110, and a Web server 120 can communicate with each other via a network. The image generation system 200 is a cloud system that acquires a Web page from the Web server 120 in response to a request from the communication terminal 110, and generates image data as a rendering result of the acquired Web page. When the image generation system 200 transmits the rendering result of the Web page to the communication terminal 110, the communication terminal 110 displays the rendering result received from the image generation system 200 on a screen. Furthermore, when the communication terminal 110 detects a touch operation on the screen on which the rendering result is displayed, it transmits coordinate information of the touched position to the image generation system 200.

The gateway 201 is connected to a network such as the Internet, and controls communication between the communication terminal 110 and the virtual machine 100, and communication between the web server 120 and the virtual machine 100. In the example of FIG. 2, the image generation system 200 is configured with one virtual machine 100, but it may also be configured with multiple virtual machines by arranging a load balancer to enable load distribution.

The virtual machine 100 performs processing to interpret the Web page received from the Web server 120, and transmits the processing result to the communication terminal 110. In this embodiment, the virtual machine 100 has the functions of a browser 202 and a command transmission unit 203.
The browser 202 performs a process of interpreting a Web page and generates image data (drawing result) to be displayed on the screen of the communication terminal 110. In this embodiment, when the browser 202 determines that a predetermined operation related to the Web page has been performed on the communication terminal 110, the browser 202 acquires an execution command to be transmitted. Here, the browser 202 determines that a predetermined operation has been performed when a display position of a predetermined element included in the Web page is pressed. The predetermined element here is a user interface element such as a <button> element or an <input> element to which a predetermined attribute such as a disable attribute or a readonly attribute is assigned. When the browser 202 receives coordinate information from the communication terminal 110, the browser 202 compares the received coordinate information with the coordinate information of the predetermined element to determine whether or not a predetermined operation has been performed. When it is determined that a predetermined operation has been performed, the browser 202 acquires an execution command associated with the predetermined operation. The contents of the operation and the contents of the execution command are associated with each other by the command table 204. The browser 202 reads out the command table 204 stored in the ROM 102 and acquires an execution command associated with the content of the operation. Then, the command transmission unit 203 transmits the execution command before the browser 202 generates a rendering result. That is, the virtual machine 100 transmits command information with priority over the rendering result of the Web page.

Next, the flow of processing executed in the information processing system will be described. FIG. 3 is a flowchart showing the flow of processing in the communication terminal 110 according to this embodiment. The processing in the flowchart in FIG. 3 is realized by the CPU 111 of the communication terminal 110 reading a program stored in the ROM 112 into the RAM 113 and executing it. In the following description, each process (step) is represented by adding an S to the beginning, and the notation of the process (step) will be omitted. The processing contents shown in the flowchart are started, for example, when a user inputs the URL of a web page that he or she wishes to view.

First, in S301, the communication terminal 110 transmits the URL of the input Web page to the virtual machine 100. Then, in S302, the communication terminal 110 displays the rendering result of the Web page received from the virtual machine 100. As a result, the user interface (display items) included in the Web page are displayed on the screen. Note that the Web page of this embodiment includes a video.
Next, in S303, the communication terminal 110 determines whether or not to end the screen display. If the communication terminal 110 determines to end the screen display, it transmits a display end instruction to the virtual machine 100, and the process of this flowchart ends. If the communication terminal 110 determines not to end the screen display, the process proceeds to S304.
In S304, the communication terminal 110 determines whether or not the screen has been pressed by the user. If the communication terminal 110 determines that the screen has been pressed (Yes in S304), the communication terminal 110 calculates coordinate information of the pressed position and transmits it to the virtual machine 100 (S305). On the other hand, if the communication terminal 110 determines that the screen has not been pressed (No in S304), the process proceeds to S306.

Next, in S306, the communication terminal 110 determines whether or not information has been received from the virtual machine 100. If the communication terminal 110 determines that information has been received (Yes in S306), the communication terminal 110 determines whether or not the information is an execution command (S307). On the other hand, if the communication terminal 110 determines that information has not been received (No in S306), the process returns to S304.
Next, when it is determined in S307 that the information received by the communication terminal 110 is an execution command (Yes in S307), the communication terminal 110 performs processing according to the execution command (S308). For example, the communication terminal 110 uses a sound output device to generate a sound.
On the other hand, if the communication terminal 110 determines in step S307 that the received information is not an execution command (No in step S307), the communication terminal 110 determines that the received information is a rendering result of a Web page, and the process returns to step S302. In this embodiment, the next frame of the video is displayed on the screen.

According to the above-described processing of the communication terminal 110, when a user performs a specific operation on a web page, the processing corresponding to the operation is executed promptly without waiting for the screen display to be updated. In other words, when using a cloud-based browser, delays in the response corresponding to the operation are suppressed, and the user is not confused.

Fig. 4 is a flowchart showing the flow of processing of the virtual machine 100 according to this embodiment. The processing of the flowchart in Fig. 4 is realized by the CPU 101 of the virtual machine 100 reading a program stored in the ROM 102 into the RAM 103 and executing it.
First, in S<b>401 , the virtual machine 100 receives a URL from the communication terminal 110 .
Next, in S402, the virtual machine 100 obtains the web page of the URL received in S401 from the web server 120. Here, the web page includes HTML documents, JavaScript (registered trademark), CSS files, external fonts, images, videos, etc. The virtual machine 100 transmits the rendering result of the web page indicated by the URL received from the communication terminal 110 to the communication terminal 110.
Next, in S403, the virtual machine 100 performs processing to interpret the Web page acquired in S402. The virtual machine 100 acquires information indicating an operation on the communication terminal 110 for the Web page transmitted to the communication terminal 110, and determines processing based on the information. For example, the virtual machine 100 determines whether or not the rendering of the Web page needs to be updated based on the information indicating the operation on the communication terminal 110.
Next, in S404, the virtual machine 100 determines whether or not it has received coordinate information (position information) indicating the pressed position on the screen from the communication terminal 110. If it has determined that the virtual machine 100 has received the coordinate information (Yes in S404), the virtual machine 100 determines whether or not a predetermined operation has been performed on the communication terminal 110 based on the received coordinate information (S405). On the other hand, if it has determined that the virtual machine 100 has not received the coordinate information (No in S404), the process proceeds to S407.

The process of S405 will now be described in detail with reference to an example of a web page shown in Fig. 5. Fig. 5(A) is a diagram showing an example of a description of an HTML file constituting a web page. Fig. 5(B) is a diagram showing the rendering result generated when the HTML file in Fig. 5(A) is processed. The rendering result in Fig. 5(B) includes two buttons 511 and 512, and a video area 513 in which a video is played.
Description code 501 in Fig. 5(A) indicates a <button> element to which a disable attribute has been assigned, and corresponds to button 511 in Fig. 5(B). Description code 502 in Fig. 5(A) indicates a <button> element to which a disable attribute has not been assigned, and corresponds to button 512 in Fig. 5(B). Description code 503 in Fig. 5(A) indicates a <video> element, and corresponds to video area 513 in Fig. 5(B).

Next, FIG. 6 shows an example of the command table 204. In the command table 204, "Web page process" indicating operation contents 601 related to a Web page is associated with "Device API" indicating command information 602 executable by the communication terminal 110. For example, since "Push disable element" and "beep01()" are associated, it can be seen that when a user presses a display item based on an element to which a disable attribute is assigned, a sound (beep01) is sounded in the communication terminal 110. That is, when the virtual machine 100 detects a press on an element on which pressing is not valid in the communication terminal 110, it instructs the communication terminal 110 to perform a process of outputting a sound (beep01) indicating an error. In the example of FIG. 5, when a user presses a button 511 on the screen, a sound is sounded from the communication terminal 110. Similarly, since "Push readonly element" and "beep02()" are associated, it can be seen that when the user presses a display item based on an element to which the readonly attribute has been assigned, a sound (beep02) will sound on the communication terminal 110. That is, when the virtual machine 100 detects a press on an element that is only permitted to be read on the communication terminal 110, it instructs the communication terminal 110 to perform a process of outputting a sound (beep02) indicating an error. Note that the command information 602 is not limited to sounding a sound, and may be, for example, turning on a light, as long as it is an execution command that can be executed by the communication terminal 110.

Returning to the explanation of FIG. 4, in S405, the virtual machine 100 determines whether or not an operation to be registered in the command table 204 has been performed. In the examples of FIGS. 5 and 6, the virtual machine 100 determines whether or not the button 511 has been pressed. If the virtual machine 100 determines that an operation to be registered in the command table 204 has been performed (Yes in S405), it is determined that a specific operation has been performed, and the virtual machine 100 obtains an execution command associated with the operation from the command table 204. In the examples of FIGS. 5 and 6, the virtual machine 100 obtains the execution command "beep01()". The virtual machine 100 then transmits the obtained execution command to the communication terminal 110 (S406). In this case, in the processing flow of the communication terminal 110, the information received in S307 is determined to be a command to be executed, and the execution command "beep01()" is executed in S306.

In this embodiment, the virtual machine 100 transmits an execution command to the communication terminal 110, but may also transmit the element name pressed by the user and the attributes assigned to the element name as command information to the communication terminal 110. In this case, the communication terminal 110 determines whether or not there is a command to be executed based on the command information it receives, and if there is a command to be executed, executes the command. A command table stored on the communication terminal 110 side is used to determine whether or not there is a command to be executed.

Next, in S407, the virtual machine 100 determines whether the process of interpreting the Web page has ended. If the virtual machine 100 determines that the process of interpreting the Web page has ended (Yes in S407), the virtual machine 100 generates a rendering result of the Web page (S408) and transmits the rendering result to the communication terminal 110 (S409). The virtual machine 100 updates the rendering of the Web page according to the operation indicated by the information indicating the operation on the Web page in the communication terminal 110. In this case, in the process flow of the communication terminal 110, the rendering result of the Web page is displayed on the screen in S302. That is, the virtual machine 100 transmits the updated rendering result to the communication terminal 110. On the other hand, if the virtual machine 100 determines that the process of interpreting the Web page has not ended (No in S407), the process returns to S403. In this way, the virtual machine 100 acquires information indicating an operation on the communication terminal 110 with respect to the web page, and transmits to the communication terminal 110 a processing instruction corresponding to the operation in priority to the transmission of the rendering result of the updated web page accordingly.
Next, in S410, the virtual machine 100 determines whether or not a display end instruction has been received from the communication terminal 110. If the virtual machine 100 determines that the display end instruction has been received (Yes in S410), the process of this flowchart ends. If the virtual machine 100 determines that the display end instruction has not been received (No in S410), the process returns to S403.

According to the first embodiment described above, the command to be executed by the communication terminal 110 is notified to the communication terminal 110 prior to the rendering result of the web page. As a result, when the user presses a specific button, for example, a sound is generated without waiting for the next frame of a video to be displayed, and the user can be promptly notified that the specific button cannot be pressed. In other words, when the user operates the screen of the communication terminal 110, the virtual machine 100 can display a screen and output a sound as if the user were operating a browser built into the communication terminal 110. This can improve the user's convenience when using a browser on the cloud.

Second Embodiment
In the first embodiment described above, an example is described in which, when the virtual machine 100 acquires an execution command executable by the communication terminal 110, the execution command is immediately transmitted to the communication terminal 110. Here, when the communication bandwidth connecting the communication terminal 110 and the image generating system 200 is tight, it is necessary to transmit execution commands that do not allow delays preferentially. For example, if the sound generated when the user operates the user interface of a Web page is delayed, the user is often confused. On the other hand, even if it takes several hundred ms (milliseconds) from when the user presses the print execution button in the Web page until printing starts, the user is rarely confused. Therefore, in the second embodiment, an example is described in which an instruction that needs to be linked to a user's operation is transmitted preferentially over an instruction that does not need to be linked to a user's operation. The configuration in this embodiment is the same as that in FIG. 1A, FIG. 1B, and FIG. 2. Also, the processing flow of the communication terminal 110 executed in this embodiment is the same as that in FIG. 3. Therefore, in this embodiment, the description of the same parts as those in the first embodiment is omitted.

Fig. 7 is a flowchart showing the flow of processing of the virtual machine 100 according to this embodiment. Note that the flowchart in Fig. 7 is a flowchart in which S406 in Fig. 3 is replaced with S701 to S703. Therefore, only S701 to S703 will be described, and descriptions of the other processes (steps) will be omitted.
First, a specific description will be given with reference to an example of a Web page shown in FIG. 8. FIG. 8(A) is a diagram showing a description example of an HTML file constituting a Web page. FIG. 8(B) is a diagram showing a rendering result generated when the HTML file of FIG. 8(A) is processed. The rendering result of FIG. 8(B) is the same as that of FIG. 5(B). The difference between FIG. 8(A) and FIG. 5(A) is that the description code 502 is replaced with the description code 801. The description code 801 of FIG. 8(A) indicates a <button> element in which "print()" is registered in the event handler, and corresponds to the button 512 of FIG. 8(B). The button 512 is a print execution button that instructs the communication terminal 110 to execute printing.

Next, an example of the command table 204 is shown in Fig. 9. The first difference between Fig. 9 and Fig. 6 is that data associating "Perform print()" with "print()" has been added. With this data added, when the user presses the print execution button, printing is executed by the communication terminal 110.
Here, if there is a delay between the user's button operation and the sound being emitted, the user is likely to be confused. That is, the sound being emitted is a process that needs to be linked to the user's operation. An execution command for such a process is referred to as first command information. Examples of the first command information include the emission of a sound and the turning on of a light. On the other hand, even if there is a delay between the user pressing the print execution button and the start of printing execution, the user is unlikely to be confused. That is, printing is a process that does not need to be linked to the user's operation. An execution command for such a process is referred to as second command information. Examples of the second command information include scanning, changing the settings of the communication terminal 110, and the like, in addition to printing.

9 and 6 is that an item "Delay" indicating a delay time 901 is further associated. The delay time 901 is time information for specifying the time from when an execution command is acquired to when it is transmitted. For example, when "Delay" is specified as 0 ms, the virtual machine 100 transmits the execution command immediately after acquiring it. When "Delay" is specified as 500 ms, the virtual machine 100 transmits the execution command 500 milliseconds after acquiring it. In this embodiment, the delay time 901 of the first command information is set shorter than the delay time 901 of the second command information. That is, the virtual machine 100 transmits the first command information with priority over the second command information. Note that the information set in the command table 204 is not limited to the delay time 901, as long as it is information that can determine the transmission order when there are multiple pieces of command information to be transmitted.

First, in S701, the virtual machine 100 registers in the timer a command transmission job, which is a job for transmitting an execution command obtained from the command table 204. Here, the virtual machine 100 obtains the delay time 901 of the execution command from the command table 204 and registers it in the timer. For example, since "Perform print()" has a "Delay" of 500 ms, it is registered so that the execution command "print()" is transmitted after 500 milliseconds have elapsed.
Next, in S702, the virtual machine 100 judges whether the elapsed time from the registration of the command transmission job has reached the designated time. If it is judged that the elapsed time has reached the designated time (Yes in S702), the virtual machine 100 executes the corresponding command transmission job (S703), and the process then proceeds to S407. On the other hand, if it is judged that the elapsed time has not reached the designated time (No in S702), the process proceeds to S407.

According to the second embodiment described above, when an execution command that needs to be linked to a user's operation and an execution command that does not need to be linked to a user's operation occur almost simultaneously, the execution command that needs to be linked can be transmitted preferentially over the execution command that does not need to be linked. Therefore, even if the communication bandwidth connecting the communication terminal 110 and the image generation system 200 is congested, when the user presses a specific button on the communication terminal 110, a sound is generated without delay, and the user can be promptly notified that the specific button cannot be pressed. That is, similar to the first embodiment, it is possible to improve the convenience for the user when using a browser on the cloud.

As a variation of the second embodiment, in FIG. 7, the drawing generation process (S408) is started after a specified time has elapsed, but it may be started simultaneously with timer registration of the command transmission job, or after a predetermined time has elapsed since timer registration. This makes it possible to transmit the drawing result to the communication terminal 110 as quickly as possible.

The present invention has been described above with reference to various embodiments, but the above embodiments are merely examples of concrete ways of implementing the present invention, and the technical scope of the present invention should not be interpreted in a limiting manner based on these. In other words, the present invention can be implemented in various forms without departing from its technical concept or main features.

Other Embodiments
The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

100: Virtual machine 100: Communication terminal, 120: Web server, 200: Image generation system, 202: Browser, 203: Command transmission unit, 204: Command table

Claims (7)

An information processing device capable of communicating with a communication terminal,
a first transmission means for transmitting a rendering result of the web page to the communication terminal;
an acquisition means for acquiring information indicating an operation on the communication terminal with respect to the rendering result of the Web page transmitted by the first transmission means;
a second transmission means for updating a drawing on the Web page in response to an operation indicated by the information acquired by the acquisition means, and transmitting the updated drawing result to the communication terminal;
a third transmission means for transmitting , when the operation indicated by the information acquired by the acquisition means is an operation on a predetermined item displayed on the Web page, command information resulting from the operation being executed on the predetermined item to the communication terminal ;
When the operation indicated by the information acquired by the acquisition means is an operation for the predetermined item displayed on the Web page, the third transmission means transmits the command information to the communication terminal in priority to the transmission of the updated drawing result by the second transmission means, and the second transmission means transmits the updated drawing result to the communication terminal after the transmission of the command information by the third transmission means.
23. An information processing apparatus comprising: The command information is information that instructs the execution of a process that needs to be executed in conjunction with an operation on the predetermined item.
2. The information processing apparatus according to claim 1, The command information is information instructing the execution of sound emission or light illumination.
3. The information processing apparatus according to claim 2. The predetermined item is a display item based on a <button> element or an <input> element to which a disable attribute or a readonly attribute is assigned on the Web page.
4. The information processing apparatus according to claim 1, wherein the information processing apparatus further comprises: the information acquired by the acquiring means includes position information related to an operation on the rendering result of the web page in the communication terminal,
The information processing device further includes a determination unit that determines whether an operation has been performed on the predetermined item based on position information regarding an operation on the drawing result of the Web page and position information of the predetermined item included in the Web page.
5. The information processing apparatus according to claim 1, wherein the information processing apparatus further comprises: a first input section; A method for controlling an information processing device capable of communicating with a communication terminal, comprising:
a first transmission step of transmitting a rendering result of the web page to the communication terminal;
an acquiring step of acquiring information indicating an operation on the communication terminal with respect to the rendering result of the Web page transmitted in the first transmitting step;
a second transmission step of updating a drawing on the Web page in response to an operation indicated by the information acquired in the acquisition step, and transmitting the updated drawing result to the communication terminal;
a third transmission step of transmitting, when the operation indicated by the information acquired in the acquisition step is an operation on a predetermined item displayed on the Web page, command information resulting from the operation being executed on the predetermined item to the communication terminal ;
When the operation indicated by the information acquired in the acquisition step is an operation for the predetermined item displayed on the Web page, the command information is transmitted to the communication terminal in the third transmission step in priority to the transmission of the updated drawing result in the second transmission step, and the updated drawing result is transmitted to the communication terminal in the second transmission step after the transmission of the command information in the third transmission step.
23. A method for controlling an information processing apparatus comprising: A program for causing a computer to function as each of the means of the information processing device according to any one of claims 1 to 5 .

Images