JP2023050546A - Image forming apparatus - Google Patents

Abstract

Kind Code: A1 An object of the present invention is to eliminate difficulty in viewing an image included in a remote screen in an image forming apparatus capable of receiving remote operation by an information processing apparatus, and to enhance user convenience. A firmware 20 of an MFP 10 is displayed as a preview image via a communication IF 16 when receiving an instruction from a PC 30 via a communication IF 16 that an operation on a file acquisition button included in a remote screen has been accepted. The electronic file of the received FAX image is transmitted to the PC 30 . As a result, when the operation of the file acquisition button is accepted on the remote screen, the MFP 10 transmits the transmission data indicating the FAX reception image to the PC 30 . [Selection drawing] Fig. 1

Description

The present invention relates to technology of an image forming apparatus capable of accepting remote operation by an information processing apparatus.

Japanese Patent Application Laid-Open No. 2002-200002 describes a technique for remotely operating an image forming apparatus by displaying a remote screen that virtually shows a user interface of the image forming apparatus on a remote information processing apparatus. there is

Japanese Patent Application Laid-Open No. 2020-10265

In the remote operation of the image forming apparatus described in Patent Document 1, it is assumed that the information processing apparatus displays a remote screen that virtually shows the user interface of the image forming apparatus. When the display target image is displayed on the user interface, the display target image is also displayed on the remote screen of the information processing device. At this time, depending on the size of the user interface and the display mode of the image on the user interface, the display target image displayed on the remote screen may be difficult to see. For example, when only part of the display target image is displayed on the user interface, only part of the display target image is also displayed on the remote screen. In addition to this, for example, when a display target image is reduced and displayed on the user interface, the reduced display target image is displayed on the remote screen.

An image forming apparatus disclosed as the present embodiment to solve the above problems includes a user interface, a communication interface, and a controller. When the controller receives a first request from a device connected via a communication interface, the controller executes a first transmission process of transmitting remote screen data to the request source device of the first request. The remote screen display request is a remote screen display request, the remote screen data is data for displaying the remote screen on the requesting device of the first request, and the remote screen is the screen displayed on the requesting device of the first request. It is a screen that virtually reproduces the user interface. The controller executes screen display processing for displaying a first operation screen on the user interface when a first operation is received via the user interface, and the first operation screen is a screen including an image to be displayed. Yes, after the first transmission process, the controller receives, via the communication interface, an instruction indicating that the first operation has been virtually performed on the remote screen from the request source device of the first request. and executing a second transmission process of transmitting the remote screen data of the second operation screen to the request source device of the first request via the communication interface, wherein the second operation screen is a screen capable of accepting the second operation. , and the second operation is an operation for transmitting data indicating an image to be displayed to the request source device of the first request. When the controller is instructed via the communication interface that the second operation has been received from the requesting device of the first request, the controller transmits data indicating the image to be displayed to the requesting device of the first request via the communication interface. Execute a third transmission process for transmitting to the device.

In the above configuration, the controller causes the user interface to display the first operation screen including the display target image when the first operation is received via the user interface. After transmitting the remote screen data to the request source device of the first request, the controller communicates an instruction indicating that the first operation has been virtually performed on the remote screen from the request source device of the first request. When the request is received via the interface, the remote screen data of the second operation screen, which is the remote screen corresponding to the first operation screen, is transmitted to the request source device of the first request via the communication interface. When the controller is instructed via the communication interface that the second operation has been received from the requesting device of the first request, the controller transmits data indicating the image to be displayed to the requesting device of the first request via the communication interface. Send to device. Accordingly, when the second operation is received on the second operation screen, which is the remote screen, the image forming apparatus transmits data indicating the image to be displayed to the request source apparatus of the first request. Therefore, the request source device of the first request can display the display target image based on the received data indicating the display target image. It is possible to display the target image on a separate screen, which enhances the user's convenience.

1 is a configuration diagram of an image forming system; FIG. FIG. 11 is a timing chart for explaining processing when requesting start of remote display control; FIG. It is a figure explaining an administrator screen. FIG. 10 is a flowchart for explaining processing in the MFP in remote display control; FIG. It is a figure explaining a remote screen. FIG. 5 is a flowchart for explaining the processing of S38 in FIG. 4; FIG. FIG. 10 is a diagram illustrating a remote screen corresponding to a FAX operation acceptance screen; FIG. 10 is a diagram illustrating a FAX execution screen displayed on the user IF; It is a figure explaining the remote screen corresponding to a FAX execution screen. FIG. 5 is a flowchart for explaining the processing of S40 of FIG. 4; FIG. 4 is a flowchart for explaining processing of a PC; FIG. 10 is a diagram illustrating a state in which the entire screen indicated by the electronic file is displayed together with the remote screen;

(First embodiment)
An image forming system 100 according to this embodiment will be described with reference to the drawings. The image forming system 100 shown in FIG. 1 includes an MFP 10 and PCs 30 and 50 . MFP is an abbreviation for multifunction peripheral. MFP 10 and PCs 30 and 50 are connected to network 200 and can communicate with each other through network 200 . Network 200 is a LAN or the Internet. In this embodiment, the MFP 100 is an example of an image forming apparatus.

Next, the configuration of the MFP 10 will be described. MFP 100 includes controller 11 , memory 12 , printer 13 , scanner 14 , FAX-IF 15 , communication IF 16 , user IF 17 and bus 18 . IF is an abbreviation for interface.

Communication IF 16 connects MFP 10 to network 200 in accordance with a predetermined communication protocol. The user IF 17 is an interface interposed between the user who directly operates the MFP 10 and the controller 11, and has a touch panel 171 and operation keys 172 which are physical keys.

The printer 13 executes a printing operation of printing an image on a recording medium such as a sheet or disk. As a recording method of the printer 13, an inkjet method, an electrophotographic method, or the like can be adopted. The scanner 14 performs a scanning operation of reading an image recorded on a document and generating image data. The FAX-IF 15 performs a FAX operation of transmitting and receiving image data in a manner conforming to the FAX protocol. Also, the MFP 10 may be capable of executing a composite action in which a plurality of actions are combined. A copy operation combining a print operation by the printer 13 and a scan operation by the scanner 14 is an example of a compound operation.

The controller 11 is composed of a CPU, ASIC (abbreviation for Application Specific Integrated Circuit), etc., and controls each operation of the printer 13 , scanner 14 , FAX-IF 15 , communication IF 16 , and user IF 17 . The memory 12 has a data storage area. The data storage area is an area for storing data required for executing programs and the like. The memory 12 is configured by combining RAM, ROM, SSD, HDD, and the like. A buffer included in the controller 11 that is used when executing various programs may also be regarded as part of the memory 12 . Note that the memory 12 may be a storage medium readable by the controller 11 . A storage medium readable by the controller 11 is a non-transitory medium. In addition to the above examples, non-transitory media include recording media such as CD-ROMs and DVD-ROMs. A non-transitory medium is also a tangible medium. On the other hand, an electrical signal that carries a program downloaded from a server on the Internet is a computer-readable signal medium, which is a kind of computer-readable medium, but is a non-transitory computer-readable storage. Not included in media.

Firmware 20 is stored in the memory 12 as a program executable by the controller 11 . In the following description, the controller 11 that executes the programs may be simply referred to as the program name. For example, the description "firmware" is used to mean "the controller 11 executing the firmware 20". This embodiment mainly shows the processing of the controller 11 according to the instructions written in the program. That is, the processes such as "judgment", "extraction", "selection", "calculation", "determination", "specification", "acquisition", "acceptance", and "control" in the following description are the processes of the controller 11. represents. Note that "acquisition" is used as a concept that does not require a request. That is, the process of receiving data without the controller 11 requesting it is also included in the concept of "the controller 11 acquires data." Also, "data" in this specification is represented by a bit string that can be read by the controller. Data having substantially the same meaning and content but different formats are treated as the same data. The same applies to "information" in this specification.

The firmware 20 also functions as a web server for displaying a predetermined web page on the PC 30 . The firmware 20 can also provide remote screen control for the PCs 30,50. The remote screen control is a function to remotely operate the MFP 10 by virtual operation on the remote screen by displaying a remote screen that simulates the user IF 17 of the MFP 10 on the PCs 30 and 50 .

Management information 25 is stored in the data storage area of the memory 12 . The management information 25 records login names and passwords, which are authentication information, in association with devices that can access the MFP 10 . Setting information 26 is stored in the data storage area of the memory 12 . The setting information 26 records information about settings for remote screen control.

Next, the configuration of the PC 30 will be explained. PC 30 includes communication IF 31 , memory 32 , controller 33 , display 34 and user IF 35 . Each unit 31, 32, 33, and 35 included in the PC 30 has the same configuration as the controller 11, memory 12, communication IF 16, and user IF 17 included in the MFP 10, and the description thereof will be omitted.

The memory 32 stores an OS 40 and a browser 41 . The browser 41 is a program that causes the controller 33 to display an image corresponding to web page data transmitted from the MFP 10 on the display 34 under the execution of the OS 40 . Note that the PC 50 has the same configuration as the PC 30, and the description thereof will be omitted.

Next, the procedure of processing when the PC 30 requests the start of remote screen control will be described with reference to FIG. The MFP 10 displays an operation screen on the user IF 17 , and changes the display of the operation screen according to the operation via the user IF 17 and the operation status of the MFP 10 . The process of changing the operation screen is executed in parallel with the process of FIG. The operation screens include an in-progress screen indicating that printing, scanning, etc., is in progress, an instruction screen for accepting execution instructions for copying, scanning, etc., a setting screen for changing various settings, a status screen indicating the state of the MFP 10, and an execution screen. There is a standby screen that waits for display instructions such as an instruction screen and a setting screen.

In FIG. 2, the browser 41 of the PC 30 transmits a request for web page data to the MFP 10 in step 10 (hereinafter step is simply referred to as "S"). The web page data requested in S10 is web page data for displaying the home screen when the firmware 20 functions as a web server. The browser 41 transmits a request to the firmware 20, for example, when receiving an input of a URL designating the firmware 20 by the user. Communication between the browser 41 and the firmware 20 is performed according to the http(s) protocol.

The firmware 20 transmits the web page data to the PC 30 in S11. Upon receiving the web page data, the browser 41 causes the display 34 to display the web page indicated by the web page data received in S12. In this embodiment, the browser 41 causes the display 34 to display the home screen as a web page.

When a login operation to the MFP 10 is performed on the home screen, the browser 41 transmits a login password and the like to the firmware 20 . Upon obtaining a log-in permission response from the MFP 10, the browser 41 causes the display 34 to display an administrator screen 300, which is a web page, as shown in FIG. The administrator screen 300 includes an item display area 301 and a function display area 302 .

When accepting an operation to select the "remote screen control" item 303 included in the item display area 301 via the user IF 35, the browser 41 requests the MFP 10 to start remote screen control in S13. Upon receiving the remote screen control start request, the firmware 20 transmits web page data for updating the web page in S14. This web page data includes an executable program that can be interpreted by the browser 41 . The execution program is a script program, such as JavaScript.

At S15, the MFP 10 is requested to issue a token. A token is information for authenticating a device that executes remote screen control, and is a one-time token created based on authentication information in this embodiment. The firmware 20 issues a token to the PC 30 upon receiving the token issue request. At this time, the firmware 20 may request authentication information from the PC 30 .

The firmware 20 issues a token to the PC 30 in S16. At this time, if information indicating that the token has been issued is stored in the memory 12, the firmware 20 may determine that the token has not yet been issued and may not transmit the token. Upon receiving the token issued by the MFP 10, the browser 41 requests display of the remote screen together with the issued token in S17. In this embodiment, the remote screen display request transmitted by the browser 41 in S17 is an example of the first request.

When the firmware 20 determines that the token sent from the PC 30 is correct, it responds in S18 with permission to display the remote screen. If the firmware 20 determines that the token sent is not correct, the firmware 20 responds by rejecting execution of the remote screen. For example, if the token has passed too much time since its issuance, or if the token is a forged token, the token is determined to be incorrect.

Next, a procedure for remote screen control executed between the MFP 10 and the PC 30 when remote screen display is permitted will be described. FIG. 4 shows the processing executed by the firmware 20 of the MFP 10 when the display of the remote screen is permitted.

In S30, a standby screen is displayed on the user IF 17. FIG. The standby screen includes a FAX instruction icon, a copy instruction icon, and a scan instruction icon. The FAX instruction icon is an icon that accepts an operation when causing the MFP 10 to perform a FAX operation. The copy instruction icon is an icon that accepts an operation when causing the MFP 10 to execute a copy operation. The FAX instruction icon is an icon that accepts an operation when causing the MFP 10 to perform a scanning operation. When any icon is operated on the standby screen, the standby screen is switched to a FAX operation reception screen, a copy operation reception screen, or a scan operation reception screen according to the operated icon.

In S31, it is determined whether or not an initial screen request has been received from the PC 30 via the communication IF 16. FIG. The initial screen request is a request for requesting transmission of remote screen data corresponding to the standby screen to the PC 30 that is the requesting device.

If the determination in S31 is affirmative, the process advances to S33 to execute initial screen transmission processing. The initial screen transmission process is a process for transmitting the html script and the remote screen data corresponding to the standby screen to the PC 30, which is the requesting device. The html script is a program for causing the browser 41 to execute various processes in accordance with operations received on the remote screen displayed on the PC 30 . After completing the process of S33, the process returns to S31.

Upon receiving the remote screen data corresponding to the standby screen and the HTML script from the MFP 10 via the communication IF 16, the PC 30 displays the remote screen 330 including the standby screen. FIG. 5 shows a remote screen 330 displayed on the display 34 of the PC 30 when the standby screen is displayed on the user IF 17 . Remote screen 330 is displayed in function display area 302 on administrator screen 300 . The remote screen 330 includes a screen display area 331 and an operation key display area 332 . The screen display area 331 displays the same screen as the operation screen currently displayed on the user IF 17 of the MFP 10 (here, the standby screen). In the operation key display area 332, button images imitating the operation keys 172, which are physical keys provided in the user IF 17, are displayed. Information indicating that a virtual operation to the user IF 17 has been performed on the remote screen 330 is notified to the MFP 10 . The remote screen 330 also includes an end button 333 .

The data indicating the operation screen, operation keys, and end button included in the remote screen data for displaying the remote screen 330 may be in the same data format such as raster data, or may be in a different data format. good too. Data indicating the operation screen, the operation key, and the end button may be in different data formats. In addition, the firmware 20 transmits only the data indicating the operation screen as the remote screen data to the browser 41, and the browser 41 interprets the execution program to superimpose the data indicating the operation key and the end button on the remote screen data. remote screen may be displayed. In addition to the above, the firmware 20 transmits data indicating an operation screen and operation keys to the browser 41 as remote screen data, and the browser 41 interprets the execution program to add data indicating an end button to the remote screen data. It may be superimposed. Furthermore, instead of sending the remote screen data to the browser 41, the firmware 20 may send web page data for displaying the entire administrator screen 300 including the remote screen 330 to the browser 41. good.

Returning to FIG. 4, if a negative determination is made in S31, the process advances to S32 to determine whether or not a screen update request has been received from the PC 30 via the communication IF 16. FIG. The screen update request is a request for requesting the MFP 10 for remote screen data for updating the remote screen 330 currently displayed on the PC 30 .

If the determination in S32 is affirmative, the process advances to S35 to execute screen data transmission processing. The screen data transmission process is a process for transmitting the html script and the remote screen data corresponding to the updated screen to the PC 30 . The remote screen data transmitted to the PC 30 in S35 is, for example, data generated in the process of S37 or S38, which will be described later. Upon receiving the remote screen data together with the html script, the PC 30 updates the currently displayed remote screen to the received new remote screen. After completing the process of S35, the process returns to S31.

If a negative determination is made in S32, the process advances to S34, in which it is determined whether or not a request including pressing information has been received from the PC 30 via the communication IF 16. FIG. The pressing information is information indicating that any position on the remote screen 330 displayed on the PC 30 has been pressed, and includes pressing coordinate information. The pressed coordinate information is information indicating a position pressed on the remote screen 330 .

If the determination in S34 is affirmative, the process advances to S37 to execute the pressing process. The pressing process is a process for causing the MFP 10 to execute a process according to the operation specified by the pressing coordinate information and for transmitting to the PC 30 an HTML script generated according to the specified operation. In the pressing process, it is determined whether or not the received pressed coordinate information is within the area of any operation icon or operation key on the remote screen 330 . Specifically, the pressed coordinate information is converted into coordinates indicating the pressed position on the user IF 17 of the MFP 10 , and the converted pressed coordinates correspond to the operation icon or the operation key 172 displayed on the touch panel 171 of the user IF 17 . decide whether to

When the pressed coordinates correspond to the operation icon on the touch panel 171, the corresponding operation icon displayed on the user IF 17 is switched to the pressing mode indicating the pressed state. For example, as an example of the pressing mode, the color of the operation icon is changed, or the shape of the operation icon is changed to a shape that looks like it is pressed.

Then, remote screen data virtually showing the current user IF 17 is generated and stored in the memory 12 . Specifically, remote screen data including the screen displayed on the user IF 17 in which the pressing mode has been changed is created. Furthermore, an http(s) response is sent to the PC 30 . When the pressed coordinates correspond to the operation icon or the operation key 172 on the touch panel 171, the body of the http(s) response includes a screen update script. The screen update script is a cgi script for instructing PC 30 to send an http(s) request, which is a request for screen update, to MFP 10 . After completing the process of S37, the process returns to S31.

If a negative determination is made in S34, the process advances to S36 to determine whether or not take-off information has been received from the PC 30 via the communication IF 16. The take-off information is information indicating that a take-off operation has been performed on the remote screen 330 displayed on the PC 30 . The takeoff information includes takeoff coordinate information. The take-off coordinate information is information indicating a position on the remote screen 330 from which the contacting indicator has been taken off. If the determination in S36 is affirmative, the process advances to S38 to execute the take-off process. The take-off process is a series of processes for executing the process according to the take-off coordinate information on the MFP 10 and transmitting the html script to the PC 30 . If a negative determination is made in S36, the process returns to S31.

Here, the take-off process executed in S38 will be described by taking as an example a case where the standby screen is displayed on the user IF 17 and the remote screen 330 shown in FIG. When the FAX instruction icon on remote screen 330 shown in FIG. 5 is operated, PC 30 transmits a request including take-off coordinate information to MFP 10 . The firmware 20 of the MFP 10 makes an affirmative determination in S36, and executes the release process in S38.

FIG. 6 is a flowchart for explaining the procedure of the take-off process of S38. At S<b>50 , it is determined whether or not the received take-off coordinate information is within the area of any operation icon or operation key on the remote screen 330 . If an affirmative determination is made in S50, the process proceeds to S51, in which it is determined whether or not the take-off operation within the area determined in S50 is an operation for switching the screen currently being displayed on the user IF 17. FIG. Since the FAX instruction icon is an icon that accepts a screen switching operation, an affirmative determination is made in S51 and the process proceeds to S52. In S52, the standby screen displayed on the user IF 17 is switched to a FAX operation acceptance screen (not shown).

When the process of S52 is completed, the process proceeds to S54, in which remote screen data corresponding to the screen of the user IF 17 switched by the process of S52 is generated and stored in the memory 12. FIG. In the above example, remote screen data corresponding to the FAX operation reception screen is generated.

At S<b>55 , an http(s) response including the screen update script is transmitted to the PC 30 via the communication IF 16 . The screen update script is a cgi script that instructs the PC 30 to request the MFP 10 for the remote screen data generated in S54.

Upon receiving the http(s) response from the MFP 10 in S55, the browser 41 of the PC 30 transmits a screen update request to the MFP 10 using the screen update script. Upon receiving the screen update request from the PC 30 (S32: YES), the firmware 20 of the MFP 10 performs screen data transmission processing for transmitting remote screen data in S35. When receiving the remote screen data, the PC 10 causes the display 34 to display a remote screen 330 corresponding to the FAX operation acceptance screen shown in FIG.

As shown in FIG. 7, the FAX operation reception screen 400 included in the remote screen 330 includes a send icon 401 and a receive icon 402. In FIG. A send icon 401 is an icon for receiving an operation by a user when sending an image to be sent by FAX. A reception icon 402 is an icon that receives a user's operation when receiving a fax reception image saved in a server (not shown) and storing it in the memory 12 . When the transmission icon 401 and the reception icon 402 are operated on the FAX operation acceptance screen displayed on the user IF 17 , the screen transition is the same as that of the operation accepted on the remote screen 330 . The http(s) response contains an electronic file acquisition script. The electronic file acquisition script will be described later.

On the other hand, the firmware 20 of the MFP 10 makes an affirmative determination in S50 and S51, and if the operation specified by the take-off information is not an operation for switching screens (S51: NO), the process proceeds to S53, and the pressing process proceeds to S53. The icon of the user IF 17 changed to the mode is changed to the normal mode. When proceeding to S55 after the processing of S50 or S53, the https response that does not include the screen update script is transmitted to the PC 30 via the communication IF 16 in S55.

When the reception icon 402 on the FAX operation acceptance screen 400 is operated to leave the remote screen 330 (S36: YES), the firmware 20 executes release processing in S38. 6 is affirmatively determined, the FAX operation reception screen displayed on the user IF 17 is switched to the FAX execution screen 410 shown in FIG. 8 in S52. The FAX execution screen 410 is a screen for receiving an instruction operation regarding FAX operation. In addition to this, when the receive icon 402 is operated on the remote screen 330, a list screen displaying a list of received FAX images is displayed, and an operation for selecting a received FAX image is accepted on this list screen. Alternatively, the FAX execution screen 410 may be displayed on the user IF 17 .

The FAX execution screen 410 includes a preview area 411 in which a portion of the received FAX image is displayed. The received FAX image displayed in the preview area 411 can be displayed by scrolling downward by operating the scroll key 412 . In other words, only a part of the received fax image is displayed on the fax execution screen 410, and the entire received fax image is not displayed.

When the process proceeds to S54 after the process of S52 is completed, remote screen data corresponding to the FAX execution screen 410 switched by the process of S52 is generated and stored in the memory 12 in S54. At S55, the http(s) response is transmitted to the PC30.

Upon receiving the http(s) response from the MFP 10, the browser 41 of the PC 30 transmits a screen update request to the MFP 10 using a screen update script. Upon receiving the screen update request from the PC 30 (S32: YES), the firmware 20 of the MFP 10 performs screen data transmission processing for transmitting remote screen data in S35. Upon receiving the remote screen data, the PC 10 causes the display 34 to display the remote screen 330 shown in FIG.

FIG. 9 shows remote screen 330 including FAX execution screen 420 . In the remote screen 330 shown in FIG. 9 , a FAX execution screen 420 corresponding to the FAX execution screen 410 displayed on the user IF 17 is displayed in the screen display area 331 . The FAX execution screen 420 includes a preview area 421 corresponding to the preview area 411 displayed on the user IF 17 . In this embodiment, a file acquisition button 430 as an additional icon is added below the screen display area 331 on the remote screen 330 . A file acquisition button 430 is an icon that is not included in the FAX execution screen 410 displayed on the user IF 17 . A file acquisition button 430 is operated by the user on the remote screen 330 to request acquisition of an electronic file of an image to be displayed (here, a FAX-received image) displayed in the screen display area 331 . ) is an icon that causes the MFP 10 to transmit a response. That is, the remote screen data generated in S54 is data for displaying the remote screen 330 with the file acquisition button 430 added to the FAX execution screen 410 currently displayed on the user IF 17 . In this embodiment, the FAX reception image displayed in the preview area is an example of the image to be displayed.

In this embodiment, the file acquisition button 430 is displayed on the remote screen 330 by the electronic file acquisition script included in the http(s) response. The electronic file acquisition script generates remote screen data for displaying the remote screen with the file acquisition button 430 added when the screen displayed on the user IF includes the preview area 411 . Therefore, the FAX execution screen 420 shown in FIG. 9 includes a file acquisition button 430 . On the other hand, since the preview area 411 is not included in the FAX operation reception screen displayed on the user IF 17, the file acquisition button 430 is not included in the remote screen 330 shown in FIG. Other than the operation on the file acquisition button 430 , the operation on the remote screen 330 to the FAX execution screen 420 performs the same screen transition as the operation on the user IF 17 to the FAX execution screen 410 displayed on the user IF 17 .

The browser 41 transmits an electronic file acquisition request to the MFP 10 by executing the electronic file acquisition script by operating the file acquisition button 430 on the remote screen 330 . Upon receiving the electronic file acquisition request (S39: YES), the firmware 20 of the MFP 10 advances to S40 and executes electronic file transmission processing.

Note that even when the screen displayed on the MFP 10 is switched by the operation of the user IF 17, remote screen data corresponding to the screen displayed on the user IF 17 is generated as in S54. At this time, if a screen including the preview area 411 is displayed on the user IF 17, the remote screen data of the remote screen to which the file acquisition button 430 is added is generated. However, S55 is not executed. A screen update request is periodically transmitted from the browser 41 of the PC 30 . Also when a periodic screen update request is received, an affirmative determination is made in S32. If the determination in S32 is affirmative, the process proceeds to S35, and remote screen data corresponding to the updated screen displayed on the user IF 17 is transmitted to the PC 30. is synchronized with

In the present embodiment, processing in which the firmware 20 transmits remote screen data corresponding to the standby screen in S33 in response to a remote screen display request is an example of the first transmission processing. The first transmission process may be a process of transmitting remote screen data in response to a remote screen display request. good.

A FAX execution screen 410 displayed on the user IF 17 is an example of the first operation screen. A remote screen 330 that virtually displays the FAX execution screen 410, and the FAX execution screen 420 including the preview area 421 and the file acquisition button 430 is an example of the second operation screen.

A remote screen that virtually displays the FAX execution screen 410 on a browser and includes the file acquisition button 430 but does not include the preview area 421 is also an example of the second operation screen. In addition to this, a screen that is a remote screen in which the FAX execution screen 410 is virtually displayed on a browser and does not include the file acquisition button 430 is also an example of the second operation screen.

An operation on the reception icon 402 of the FAX operation reception screen 400 on the remote screen 330 is an example of a virtual first operation. An operation of the user IF 17 on the reception icon on the FAX operation acceptance screen displayed on the user IF 17 is an example of the first operation. Processing for displaying the FAX execution screen 410 by an operation received by the user IF 17 is an example of screen display processing.

In the present embodiment, the process of transmitting the remote screen data corresponding to the FAX execution screen in S35 by operating the remote screen 330 on the FAX operation reception screen 400 is an example of the second transmission process. An operation on the remote screen 330 to the file acquisition button 430 of the FAX execution screen 420 is an example of the second operation.

In this embodiment, the remote screen 330 may display a log report screen including a preview area 421 containing the log report. A log report is an image stored in the memory 12 of the MFP 10 and created based on the operation log data of the MFP 10 . In this case, the remote screen including the log report screen is an example of the second operation screen, and the log report screen displayed on the user IF 17 is an example of the first operation screen. A log report is an example of an image to be displayed. An operation of instructing display of a log report on a remote screen to a log report screen is an example of a virtual first operation. An example of the second operation is the operation on the remote screen for the file acquisition button 430 included in the log report screen.

A setting list screen including a preview area 421 including a print setting list image may be displayed on the remote screen 330 . The setting list image is an image stored in the memory 12 of the MFP 10 and created based on the print settings of the MFP 10 . In this case, the remote screen including the setting list screen is an example of the second operation screen, and the setting list screen displayed on the user IF is an example of the first operation screen. A list image is an example of a display target image. An operation of instructing display of a list screen of print settings on the remote screen is an example of a virtual first operation. An example of the second operation is the operation on the remote screen for the file acquisition button 430 included in the setting list screen.

A preview screen having a preview area 421 containing a scan preview image may be displayed on the remote screen 330 . A scan preview image is an image that is generated by reading a document by scanning processing or copying processing by the MFP 10 and stored in the memory 12 . In this case, the remote screen including the preview screen is an example of the second operation screen, and the preview screen displayed on the user IF is an example of the first operation screen. A preview screen is an example of an image to be displayed. An operation of instructing scanning processing or an operation of instructing copying on the remote screen is an example of the second operation. An example of the second operation is the operation on the remote screen for the file acquisition button 430 included in the preview screen.

A download display screen having a preview area 421 including a preview image of download printing may be displayed on the remote screen 330 . MFP 10 downloads the image data from the server via communication IF 16 by download printing, stores the image data in memory 12, and prints the image data stored in memory 12. FIG. The download print preview image is an image created based on the downloaded image data. In this case, the remote screen including the download display screen is an example of the second operation screen, and the download display screen displayed on the user IF is an example of the first operation screen. An operation of instructing download printing on the remote screen is an example of the first operation. An example of the second operation is the operation on the remote screen for the file acquisition button 430 included in the download display screen.

FIG. 10 is a flowchart showing in detail the electronic file acquisition process executed by the firmware 20 in S40. In S60, it is determined whether or not the user IF 17 is displaying a preview of the image to be displayed (here, the image received by FAX). If an affirmative determination is made in S60, the process proceeds to S61, and the file of the image to be displayed is read out from the memory 12. FIG.

In S62, the number of pages of images included in the file read out in S61 is confirmed. In S63, using the read file, generation of a transmission file to be transmitted to the PC 30 is started. Specifically, the file for transmission is generated according to the communication protocol for transmitting the file for transmission to the PC 30 and the data format of the file for transmission. The communication protocol and the data format of the transmission file are stored in the setting information 26. FIG. The image data included in the transmission file is data representing the entire FAX-received image, unlike the partial image of the FAX-received image displayed in the preview area 411 on the FAX execution screen 410 .

In S64, it is determined whether or not there are any remaining pages in the file used to generate the transmission file. For example, if the file confirmed in S62 is composed of images of a plurality of pages, a negative determination is made in S64, and the process returns to S63 to continue generating the transmission file for the remaining pages.

If the determination in S64 is affirmative, the process proceeds to S65, and an http(s) response including the file for transmission generated in S63 is transmitted to the PC30. After completing the process of S65, the process returns to S31 of FIG. On the other hand, if the preview is not displayed on the user IF 17, a negative determination is made in S60, and the process proceeds to S66. In S66, an http(s) response including information indicating that the transmission file requested by the electronic file acquisition request does not exist is transmitted to the PC30. After completing the process of S66, the process returns to S31 of FIG. In this embodiment, the process of transmitting the transmission file to the PC 30 by the firmware 20 in S65 is an example of the third transmission process.

Next, processing executed by the browser of the PC 30 when it receives an http(s) response to the electronic file acquisition request from the MFP 10 will be described with reference to FIG.

At S70, the transmission file included in the body of the http(s) response is acquired. In S71, it is determined whether or not the transmission file acquired in S70 has a file format that can be displayed by the browser 41 of the PC30. If a negative determination is made in S71, the process of FIG. 11 ends. In this case, the browser 41 may cause the display 34 to display a notification screen indicating that the FAX reception image could not be displayed.

If the determination in S71 is affirmative, the process proceeds to S72, and the FAX reception image, which is the image to be displayed, is displayed on the display 34 using the file for transmission acquired in S70. In this embodiment, as shown in FIG. 12, the browser 41 superimposes another window W2 on the window W1 on which the remote screen 330 is currently displayed, and displays the FAX reception image 500 on this another window. For ease of explanation, FIG. 12 shows the entire FAX reception image 500 displayed in another window W2. That is, in this embodiment, the FAX reception image 500 that is the image to be displayed is displayed on a screen different from the remote screen 330 .

In S73, it is determined whether or not the file for transmission corresponding to the multiple pages of FAX reception images has been acquired in S70, and all pages of the FAX reception images can be displayed in another window W2. If a negative determination is made in S73, the process returns to S72, and the remaining pages of FAX reception images can be displayed in another window W2. For example, when displaying a plurality of pages of received FAX images in a separate window W2, by scrolling the separate window W2, the received FAX images of the next page are displayed under the received FAX images of one page.

If the determination in S73 is affirmative, the processing shown in FIG. 11 ends. In this case, the FAX reception image displayed in the separate window W2 is hidden when, for example, an operation to end the display of the separate window W2 is performed via the user IF35.

Further, upon receiving the user's operation input for the end button 333 , the browser 41 requests the firmware 20 to end remote screen control together with the token. Upon receiving a termination request from the PC, the firmware 20 terminates remote screen control on condition that the token is correct. When the firmware 20 terminates remote screen control, various information stored in the memory 12, such as information indicating the state of use of remote screen control, information indicating that a token has been issued, and information indicating the permission state of remote screen control. is deleted. The firmware 20 may terminate the remote screen control after deleting the information, or another program may delete the information using the termination of the remote screen control as a trigger. The firmware 20 ends the remote screen control in the same way as when the end button is pressed, even if there is no access from the browser 41 executing the execution program for a certain period of time after the start of the remote screen control.

In the embodiment described above, the following effects can be obtained.
Even if the preview image displayed on the remote screen is difficult to see, the PC 30 can display the received FAX image in a separate window W2, which is highly convenient for the user.

The user can display the preview image on the PC 30 simply by operating the file acquisition button 430 on the remote screen 330, which does not require complicated operations and is highly convenient for the user.

In a configuration for displaying an image in a preview area on a display 34 prior to receiving a FAX image, the user of the PC 30 can recognize the preview image even when the image displayed in the preview area on the remote screen is difficult to see. be able to.

The firmware 20 creates remote screen data for displaying a screen obtained by adding a file acquisition button 430 as an additional icon to the FAX execution screen 410 displayed on the user IF 17 . Thereby, the operability of the user who operates the PC 30 can be improved.

Even when the display target image indicates a plurality of pages, the display target image can be displayed in sequence on the PC 30 for each image of one page, so that the display target image can be displayed in a format that is easy for the user to see.

(Other embodiments)
The image forming apparatus is not limited to the above embodiments, and various modifications can be made without departing from the scope of the invention. In the above-described embodiment, the example in which S51 is not executed when the screen displayed on the MFP 10 is switched by the operation of the user IF 17 has been described. Alternatively, the remote screen data may be transmitted to the PC 30 when the screen displayed on the MFP 10 is switched by the operation of the user IF 17 .
In the above-described embodiment, an example has been described in which the MFP 10 that has created the remote screen data transmits the remote screen data to the PC 30 in response to receiving a screen update request from the PC 30 . Alternatively, the MFP 10 that created the remote screen data may transmit the remote screen data to the PC 30 without receiving the screen update request.
In the above-described embodiment, an example has been described in which the MFP 10 transmits previously created remote screen data to the PC 30 in response to receiving a screen update request from the PC 30 . Instead of this, the MFP 10 receives a screen update request from the PC 10 without creating the remote screen data in advance, and generates the remote screen data corresponding to the screen displayed by the MFP 10 at that time. The created remote screen data may be sent to the PC 30 .
In the above-described embodiment, the example in which S55 is not executed when the screen displayed on the MFP 10 is switched by the operation of the user IF 17 has been described. Alternatively, the remote screen data may be transmitted to the PC 30 when the screen displayed on the MFP 10 is switched by the operation of the user IF 17 .

In the first embodiment described above, the MFP 10 has been described as an example of an image forming apparatus, but the image forming apparatus may be a printer, a scanner, or a copier. Although the PC has been described as an example of the information processing apparatus, the image forming apparatus may be a mobile terminal such as a smart phone.

DESCRIPTION OF SYMBOLS 10... MFP, 11... Controller, 16... Communication IF, 17... User IF, 20... Firmware, 30... PC, 41... Browser, 100... Image forming system

Claims (11)

a user interface;
a communication interface;
a controller;
The controller, when receiving a first request from a device connected via the communication interface, executes a first transmission process of transmitting remote screen data to a request source device of the first request. The first request is a request to display a remote screen, the remote screen data is data for displaying the remote screen on the request source device of the first request, and the remote screen is a request for the first request. A screen displayed on the original device, which is a screen that virtually reproduces the user interface,
The controller executes screen display processing for displaying a first operation screen on the user interface when a first operation is received via the user interface, and the first operation screen displays an image to be displayed. is a screen containing
After the first transmission process, the controller transmits, via the communication interface, an instruction indicating that the first operation has been virtually performed on the remote screen from the request source device of the first request. and executing a second transmission process of transmitting the remote screen data of the second operation screen to the request source device of the first request via the communication interface, wherein the second operation screen receives the remote screen data via the communication interface. 2 operations, wherein the second operation is an operation for transmitting data indicating the display target image to the request source device of the first request;
The controller transmits data indicating the image to be displayed via the communication interface when instructed via the communication interface that the device requesting the first request has accepted the second operation. executing a third transmission process of transmitting to the request source device of the first request;
Image forming device. In the second transmission process, the remote screen data transmitted to the requesting device of the first request corresponds to the first operation screen, includes the display target image, and accepts the second operation. 2. The image forming apparatus according to claim 1, wherein the data is data indicating a possible screen. In the second transmission process, the remote screen data transmitted to the requesting device of the first request corresponds to the first operation screen, includes a portion of the display target image, and includes the second operation. is data indicating a screen that can accept
2. The image forming apparatus according to claim 1, wherein in the third transmission process, the data indicating the entire display target image transmitted to the requesting device of the first request is not data indicating the remote screen. In the screen display process, when the first operation is received via the user interface, the image to be displayed is displayed in a preview area included in the first operation screen, and the preview area is displayed on the screen. 4. The image forming apparatus according to claim 2, wherein an image that can be output by processing is displayed. In the screen display processing, a part of the display target image is displayed in the preview area;
5. The image forming apparatus according to claim 4, wherein in the third transmission process, data indicating the entire display target image is transmitted to the request source device of the first request via the communication interface. Equipped with a web server,
The controller causes the web server to transmit web page data to the device that has made the web page display request when a web page display request relating to the image forming apparatus is received, and the web page data is data for displaying the web page on a device that has requested to display the web page;
After transmitting the web page data, the controller executes the first transmission process when receiving the first request via the web page from a device to which the web page data is transmitted. The image forming apparatus according to any one of claims 1 to 5. In the second transmission process, when an instruction indicating that the first operation has been virtually performed on the remote screen is received from the request source device of the first request via the communication interface, creating the remote screen data for displaying, as the second operation screen, a screen obtained by adding an additional icon to the first operation screen, wherein the additional icon is for receiving the second operation on the second operation screen; icon and
In the third transmission process, when receiving an instruction from the request source device of the first request via the communication interface that the second operation on the additional icon has been received, the 6. The image forming apparatus according to any one of claims 1 to 5, wherein data indicating an image to be displayed is transmitted to the request source apparatus of the first request. In the third transmission process,
when the display target image is an image of a plurality of pages, creating data for sequentially displaying the images of the plurality of pages page by page for the request source device of the first request;
8. The image forming apparatus according to any one of claims 1 to 7, wherein the created data is transmitted to the request source apparatus of the first request via the communication interface. with memory,
In the screen display process, when the first operation is received via the user interface, an image whose data is stored in the memory is displayed on the first operation screen as the display target image;
In the third transmission process, when receiving an instruction that the second operation has been received from the request source device of the first request via the communication interface, the data of the image stored in the memory is transmitted to the 9. The image forming apparatus according to any one of claims 1 to 8, wherein the data indicating the image to be displayed is transmitted to the request source apparatus of the first request via the communication interface. In the screen display process, when the first operation is received via the user interface, image data is received via the communication interface, and the image for which the data is received is displayed as the display target image. 1 Display on the operation screen,
In the third transmission process, when an instruction that the second operation has been received is received from the request source device of the first request via the communication interface, in the screen display process, the second operation is received via the communication interface. 9. The image forming apparatus according to any one of claims 1 to 8, wherein data of the obtained image is transmitted to the request source device of the first request via the communication interface as data indicating the image to be displayed. a user interface;
a communication interface;
a controller;
The controller, when receiving a first request from a device connected via the communication interface, executes a first transmission process of transmitting remote screen data to a request source device of the first request. The first request is a request to display a remote screen, the remote screen data is data for displaying the remote screen on the request source device of the first request, and the remote screen is a request for the first request. A screen displayed on the original device, which is a screen that virtually reproduces the user interface,
The controller executes screen display processing for displaying a first operation screen on the user interface when a first operation is received via the user interface, and the first operation screen displays an image to be displayed. is a screen containing
The controller executes a third transmission process of transmitting data representing the display target image to the request source device of the first request via the communication interface.
Image forming device.

Images