JP6464767B2 - Image processing apparatus, content display control method and display control program in the same - Google Patents

Description

  The present invention relates to an image processing apparatus such as an MFP (Multi Function Peripherals) which is a multifunction digital image processing apparatus having functions such as a printer function, a facsimile function, and a scan function, a content display control method and a display control program in the apparatus. .

  When a web application having a link to an external site is linked to a credit card authentication site at a shopping site, which is an external site, or an authentication site for registration when using cloud storage, as shown in FIG. After the transition from the web application content screen D5 to the external site content screen D6, authentication is performed on the external site screen D6, and then the screen returns to the original web application screen D5 set by the redirect URL. Things are well done.

  Alternatively, the screen D8 of the external site is displayed by using the frame display (<frame> </ frame>) or the inline frame display (<iframe> </ frame>) while leaving the display of the original web application content screen D7. Display is also often done.

  When returning to the original web application with the redirect URL, it is of course possible to display the contents to be presented next to the user after the processing of the external site is completed. Even when displaying a frame, the menu of the web application is displayed in an area other than the frame where the content of the external site is displayed or the inline frame. Therefore, after the user is authenticated, the subsequent processing is displayed. It is possible to proceed according to the buttons and guidance.

  On the other hand, among external sites, there is a site where display in frame display or in-line frame display is prohibited by an HTML tag (X-Frame-Options) for preventing clicking.

  By the way, in the image processing apparatus as described above, since the size of the display screen of the operation panel is smaller than the screen size of a personal computer or the like, the display area is limited. In addition, in order to display a unique button for the web application in a limited area, or to prevent an unintended operation when the return button of the browser is executed after script execution, the image processing apparatus When displaying the contents of a web application or an external site on the display unit, it is common not to display the back button or tab of the browser toolbar.

  Therefore, as shown in FIG. 12, in the state where the screen D9 of the content of the web application executed by the web server built in the image processing apparatus is displayed, the frame display or the inline frame display is started from the link of the web application. When the user accesses an external site that is prohibited, and displays the content of the external site, for example, the authentication screen D10 on the display unit of the image processing apparatus, it must be displayed on the full screen. In that case, the content of the external site is only displayed on the browser, and the script of the web application cannot be operated as a matter of course. Therefore, the web application cannot be controlled, and the screen D11 after authentication In order to return control from the web application to the web application, there is a problem that the web application needs to be restarted.

  In Patent Document 1, the state of the network peripheral device is displayed on the web browser over the network, and the execution of the function provided by the network peripheral device can be instructed from the web browser over the network as follows. Technology is disclosed. That is, a network peripheral device connected to the network requests a first frame indicating a state of the network peripheral device and a second frame including a link to a web page for a function provided by the network peripheral device. Is transmitted from the information processing apparatus via the network, and in accordance with the received request, data for displaying the first frame and the second frame on the web browser is transmitted to the information processing apparatus via the network. Then, a web page request corresponding to the link selected in the second frame is received from the information processing apparatus via the network, and data indicating the web page is transmitted via the network according to the received request. A technique for transmitting to is disclosed.

  In Patent Document 2, when a child frame alone does not hold as a web page, or when it is not desired to display only a child frame alone, in order to prohibit display of a child frame alone, Such a system is disclosed. That is, a web page is divided into frames, displayed in a parent frame and one or more child frames, an HTML document as page data is received from a web server, and a Javascript included in the HTML document received from the web server (Java (registered trademark) Script), the web browser determines whether the parent frame is loaded on the same web page, and if the web page of the parent frame is loaded on the web browser, the web browser Discloses a print service system in which an HTML document sent from a web server is displayed as it is, and when the web page of the parent frame is not loaded in the web browser, the web browser executes an error display process.

JP 2006-164291 A JP 2005-284948 A

  However, the technology described in Patent Document 1 is a technology itself that displays device information and peripheral device information using frames, and the technology described in Patent Document 2 is a case where display of only child frames is prohibited. When an external site where frame display or inline frame display itself is prohibited is displayed in full screen from the link of the web application in the image processing device, control from the external site to the web application is performed. I couldn't solve the problem of having to restart the web application to get it back.

  The present invention has been made in view of such a technical background, and in a state where a screen of content of a web application executed by a built-in web server is displayed, from a link that the web application has, When accessing an external site where frame display or inline frame display is prohibited and displaying the content of the external site on the display unit, control can be returned to the web application without restarting the web application. It is an object of the present invention to provide an image processing apparatus, and a content display control method and display control program in the apparatus.

The above problem is solved by the following means.
(1) Display means, web server section, content by a web application executed by the web server section and having a link to an external site, and contents of the external site accessed by the link are displayed on the display means. Display control means for displaying, and execution means for executing scripts of the web application and the external site, wherein the display control means displays content by the web application and / or content of the external site. In the image processing apparatus for displaying on the display means such that bars and tabs in the periphery of the screen are not displayed, when the external site is prohibited from displaying frames and inline frames, the contents of the external site are Display on display means A display area generating means for generating a first display area for the web application and a second display area for the external site, and the display control means is configured to generate the first display area for the web application. An image processing apparatus that displays a display area and a second display area in a state in which the execution means can execute the scripts of the web application and the external site.
(2) The image processing according to item 1, wherein the generation of the first and second display areas by the display area generation unit is performed when a tag specified in advance is included in a link included in the web application. apparatus.
(3) The image processing apparatus according to (1) or (2), wherein the first display area and the second display area are divided and displayed on a screen.
(4) The image processing apparatus according to item 1 or 2, wherein the first display area and the second display area are displayed as separate windows on the screen.
(5) The image processing apparatus according to any one of (1) to (4), wherein the web application includes a script for confirming a processing status of the external site.
(6) The image processing apparatus according to item 1 or 2 , wherein the display ratio of the first display area is zero, and only the script is executed.
(7) The image processing according to any one of Items 1 to 6, wherein the web application detects that the processing at the external site is completed, and the display of the second display area is closed based on the detection. apparatus.
(8) The image processing apparatus according to any one of the preceding items 1 to 7, wherein the web application detects that the processing at the external site has been completed and changes the display of the first display area.
(9) Display control for displaying on the display means the content by the web application executed by the web server unit in the image processing apparatus and having a link to the external site, and the content of the external site accessed by the link And an execution step for executing a script possessed by the web application and the external site. In the display control step, the content by the web application and / or the content of the external site are displayed on the screen peripheral part. In the content display method in the image processing apparatus for displaying on the display means such that the bars and tabs are not displayed, a first display for the web application is displayed when the content of the external site is displayed on the display means. Territory And a display area generation step of generating a second display area for the external site, and in the display control step, the first display area and the second display area generated by the display area generation step are A content display control method in an image processing apparatus, wherein a web application and each script of the external site are displayed in an executable state.
(10) The content display according to item 9 above, wherein the generation of the first and second display areas in the display area generation step is performed when a tag specified in advance is included in a link included in the web application. Control method.
(11) The content display control method according to item 9 or 10, wherein the first display area and the second display area are divided and displayed on a screen.
(12) The content display control method according to item 9 or 10, wherein the first display area and the second display area are displayed as separate windows on the screen.
(13) The content display control method according to any one of Items 9 to 12, wherein the web application includes a script for confirming a processing status of the external site.
(14) The content display control method according to item 9 or 10, wherein the display ratio of the first display area is zero, and only the script is executed.
(15) The content display according to any one of Items 9 to 14, wherein the web application detects that the processing at the external site is completed, and the display of the second display area is closed based on the detection. Control method.
(16) The content display control method according to any one of Items 9 to 15, wherein the web application detects that the processing at the external site is completed and changes the display of the first display area.
(17) Display control for causing a display unit to display content by a web application executed by a web server unit in the image processing apparatus and having a link to an external site and content of the external site accessed by the link And executing an execution step for executing a script of the web application and the external site on the computer of the image processing apparatus, and in the display control step, the content by the web application and / or the external site In the content display control program for causing the computer to execute the process of displaying the content of the screen on the display means so that the bars and tabs at the periphery of the screen are not displayed, the content of the external site is displayed on the display means When displaying, the computer further executes a display area generation step of generating a first display area for the web application and a second display area for the external site, and in the display control step, the display area Content display control for causing the computer to execute a process of displaying the first display area and the second display area generated in the generation step in a state where the web application and each script of the external site are executable. program.
(18) The content display according to item 17 above, wherein the generation of the first and second display areas in the display area generation step is performed when a tag designated in advance is included in a link included in the web application. Control program.
(19) The content display control program according to item 17 or 18, wherein the first display area and the second display area are divided and displayed on a screen.
(20) The content display control program according to item 17 or 18, wherein the first display area and the second display area are displayed as separate windows on the screen.
(21) The content display control program according to any one of items 17 to 20, wherein the web application includes a script for confirming a processing status of the external site.
(22) The content display control program according to item 17 or 18, wherein the display ratio of the first display area is zero, and only the script is executed.
(23) The content display according to any one of Items 17 to 22, wherein the web application detects that the processing at the external site is completed and the display of the second display area is closed based on the detection. Control program.
(24) The content display control program according to any one of items 17 to 23, wherein the web application detects that the processing at the external site is completed, and changes the display of the first display area.

  According to the invention described in (1) above, when an external site is prohibited from displaying a frame and displaying an inline frame, the content for the external site is displayed on the display means when the display for the web application is performed. 1 display area and a second display area for the external site are generated, and the generated first display area and the second display area are displayed in a state where each script of the web application and the external site can be executed. Is done. In other words, even if the external site prohibits frame display and inline frame display, the content of the web application is displayed as the first display area and the script is executed. After the display by the site is completed, the control can be returned to the web application, and an operation for restarting the web application is unnecessary.

  According to the invention described in the preceding item (2), the first and second display areas can be generated by including a tag designated in advance in the link of the web application.

  According to the invention described in item (3) above, the first display area and the second display area are displayed divided on the screen, for example, vertically.

  According to the invention described in item (4), the first display area and the second display area are displayed in separate windows on the screen.

  According to the invention described in item (5) above, the processing status of the external site can be confirmed by the web application.

  According to the invention described in (6) above, executing the script on the web application side while ensuring a large display of the second display area by setting the display ratio of the first display area to zero. Can do.

  According to the invention described in item (7), the display of the second display area is closed when the web application detects that the processing at the external site is completed.

  According to the invention described in item (8) above, the web application can detect the completion of the processing at the external site and change the display of the first display area.

  According to the invention described in the preceding item (9), the operation can be returned to the web application after the display by the external site is finished without restarting the web application, and the web application is restarted. Is no longer necessary.

According to the invention described in the preceding item ( 17 ), the computer of the image processing apparatus executes processing that can return control to the web application after the display by the external site is completed without restarting the web application. Can be made.

1 is a configuration diagram of a network system in which an image processing apparatus according to an embodiment of the present invention is used. It is a block diagram which shows the internal structure of an image processing apparatus. It is explanatory drawing of a frame display when linking to the external site where frame display or inline frame display is not prohibited. It is a figure for demonstrating the method of the production | generation of a frame display screen. It is a figure which shows the frame display screen produced | generated by FIG. It is a figure for demonstrating the method of the production | generation of the display screen which concerns on this embodiment. It is a figure which shows the screen where the display part for web applications and the display part for external sites were displayed. It is a figure of the screen displayed when the process in an external site is completed. It is a flowchart which shows a process in case the web application side confirms by polling that the process in an external site is completed, and displays a "next" button. It is a figure when the screen of the display part for external sites when the process of an external site is completed is closed, and the service screen of the display part for web applications is displayed on a full screen. It is a figure for demonstrating the display screen when linking to the external site in which a frame display is possible. It is a figure which shows the conventional display screen when accessing the external site from which the frame display and an inline frame display are prohibited from the link which a web application has.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a configuration diagram of a network system in which an image processing apparatus according to an embodiment of the present invention is used.

  The network system includes one or a plurality of image processing apparatuses 11 and 12, one or a plurality of information processing apparatuses 21, 22, and 23 including a personal computer, a server 3 that provides content on an external site, Mobile terminal devices 4 are connected to each other via a network 5 such as the Internet.

  FIG. 2 is a block diagram showing the internal configuration of the image processing apparatuses 11 and 12. In this embodiment, the MFP described above is used as the image processing apparatuses 11 and 12. In the following description, the image processing apparatus is also referred to as an MFP. Since the MFPs 11 and 12 have the same internal configuration, the MFP 11 will be described unless otherwise specified, and the description of the MFP 12 will be omitted.

  As shown in FIG. 2, the MFP 11 includes an MFP system unit (MFP System) 11, an operating system (OS) that is basic software, a platform (p / f) unit 113 having a native application (NativeApp), a web server 114.

  The MFP system unit 111 controls the entire MFP 11 in an integrated manner, and includes a CPU 111a, a ROM 111b that stores an operation program of the CPU 111a, a RAM 111c that serves as a work area when the CPU 111a operates according to the operation program, and the like. ing.

  The web server 114 exhibits its function by executing one or a plurality of web applications (Web App1 to 3) 128 to 130. In the following description, an application is also simply referred to as an application. Display of content by the web applications 128 to 130 and external site content is performed by a browser application 127. The browser application 127 also performs display control when displaying content. The browser application is also simply called a browser.

  Further, the MFP 11 includes an installed application information storage area 118 that includes information about an installed application including a printer unit 115, a scanner unit 116, a facsimile unit 117, a hard disk device, and the like, an operation panel 140, and other hardware resources. 119, a web server hardware resource 120, and a network interface card (NIC) 121 are provided. The operation panel 140 includes a display unit 140a made of liquid crystal or the like, and a VRAM 140b in which an image displayed on the display unit 140a is developed.

  The box application 126 is an application for executing a box function using a box as a storage area, and the scan application 125 is for executing a scanning function by the scanner unit 116. An application, a copy application (Copy App) is an application for executing a copy function, and a menu application (Menu App) is an application for displaying a menu screen. Each application is installed in the MFP 11 by the installer 122.

  In order for the user of the MFP 11 to access the web server 114 built in the MFP 11 and use the service of the web application 128 having a link to an external site, for example, the content (web page) is displayed on the display unit 140a by the browser 127. It is assumed that the URL of the external site is accessed by a link and the content (web page) of the external site is displayed.

  For example, as shown in FIG. 12, in order to use the web application service, the user presses the “authenticate” button displayed on the web application screen D9 to access the external site and call the authentication screen D10. And

  If frame display or inline frame display is not prohibited, as shown in FIG. 3, based on the parent content frame html 201, the web application html 202 for displaying the content of the web application and the external site for displaying the content of the external site are displayed. An html 203 is created. Then, HTML rendering is performed, and as shown in FIG. 4, a web application display unit 301 and an external site (External Web Site) display unit 302 include a menu bar 303a which is an image of a browser, a status bar (Status Bar) 303b and tabs (Tabs) 303c and 303d are combined with VRAM 140b and displayed on display unit 140a as one screen as shown in FIG. Here, since the display size of the display unit 140a is small, the menu bar 303a, the status bar 303b, the tabs 303c and 303d (in the figure, the bars and tabs on the web application side are hatched) are displayed on the display unit 140a. It is not displayed in the screen 310. The display unit 140a displays a web application display unit 301 and an external site display unit 302 in a frame display.

  However, when frame display and inline frame display are prohibited on the external site, as described above, only the external site display unit 302 is displayed on the full screen, and even if the processing on the external site ends, the web application Returning to 128, processing cannot be performed.

  Therefore, when linked to such an external application, in this embodiment, as shown in FIG. 6, the web application display unit 301 and the external site display unit 302 are first expanded separately on the RAM 111c as a virtual VRAM. After that, the expanded display units 301 and 302 are combined on the VRAM 140 b and displayed by the browser 127.

  FIG. 7 shows a screen D1 of the display unit 104a on which the web application display unit 301 and the external site display unit 302 are displayed. On this screen, a web application display unit 301 having a message “Please authenticate. The service can be used when completed” is displayed in the upper area, and an external site display unit that is an authentication screen is displayed in the lower area. 302 is displayed. By performing such control that does not depend on the description of HTML, even if frame display and inline frame display are prohibited on an external site, the web application display unit 301 is displayed in the first display area on the screen of the display unit 104a. The external site display unit 302 can be displayed in the second display area on the screen of the display unit 104a.

In this embodiment, when an attempt is made to call an external site linked from a web application, a tag specified in advance in the link, for example, <a hrf = "http://aucentication.com" target = " The browser 127 determines whether or not a tag such as “blank”> is included, and if it is determined that the tag is included, the browser 127 separately displays the web application display unit 301 and the external site display unit 302. A process of expanding and combining and displaying is executed, and such a process can be easily executed by a tag.

  As described above, since the web application display unit 301 and the external site display unit 302 are first expanded on the RAM as the virtual VRAM and then synthesized on the VRAM, the scripts included in the web application 128 and the external site are executed. It is displayed on the display unit 104a in a possible state.

  As shown in FIG. 7, the web application display unit 301 and the external site display unit 302 may be displayed on the display unit 104a as, for example, a screen D1 that is divided vertically, or may be displayed as separate windows. good. In any case, since the web application display unit 301 remains on the screen, the web application can be controlled.

  In addition, the web application 128 executes a script to confirm that the processing at the external site is completed by polling. After confirming the completion, as shown in FIG. 8, along with the message “Please press the next button”, “Next” The “To” button 150 may be displayed. When the user presses the “Next” button 150, the service usage screen of the web application display unit 301 is displayed in full screen.

  FIG. 9 is a flowchart showing the process when the web application 128 confirms the completion of the process at the external site by polling and displays the “Next” button 150 as described in FIG.

  In step S01, it is determined whether or not the processing of the external site has been completed. If not completed (NO in step S01), the process waits until completion. When completed (YES in step S01), the display of the web application display unit 301 is switched in step S02, and a message and a “next” button 150 are displayed.

  In FIG. 7, the display rate of the web application display unit 301 may be set to zero, only the script by the web application may be executed, and the completion of processing of the external site may be confirmed by polling. In this case, the external site display unit 302 is displayed in full screen.

In this embodiment, the above-described tags can include designation of display positions and display ratios of the web application display unit 301 and the external site display unit 302. For example, <a hrf = "http://aucentication.com" target = " By displaying a unique tag such as blank "webapp.position =" 0,0,20,800 "site.position ="20,0,460,800>, display for web application with "webapp.position =" 0,0,20,800 "" The display position and display ratio of the part 301 are designated, and the display position and display ratio of the external site display part 302 can be designated by “site.position =“ 20,0,460,800 ”.

As shown in FIG. 10, when the processing of the external site is completed and the service screen D4 of the web application display unit 301 is displayed on the full screen, the browser 127 determines that the processing of the external site is completed and displays the external site display unit 302. Close the display. The user can use the selected function by selecting the desired button from the “Print”, “Scan”, and “Cloud” buttons displayed on the service usage screen D4. It becomes. As a method of closing the display of the external site, API (window.close (external site) or tab.close (external You can list how your web app executes your own definition).

  When the redirect URL is set and the web site is returned from the external site, the web application screen as the redirect screen is displayed on the external site display unit 302, and thus the display of the web application display unit 301 is erased. .

11, 12 Image processing apparatus 111 MFP system section 112 OS
114 Web server 127 Browser application 128-130 Web application 140a Display unit

Claims (24)

Display means;
A web server part,
Display control means for causing the display means to display content by a web application executed by the web server unit and having a link to an external site, and content of the external site accessed by the link;
Execution means for executing a script included in the web application and the external site, and the display control means displays content by the web application and / or content of the external site by a bar and a tab in a peripheral portion of the screen. In the image processing apparatus for displaying on the display means so as not to be displayed,
When displaying the contents of the external site on the display means when frame display and inline frame display are prohibited for the external site, the first display area for the web application and the external site are displayed. A display area generating means for generating a second display area;
The display control means displays the first display area and the second display area generated by the display area generation means in a state where the execution means can execute the scripts of the web application and the external site. An image processing apparatus characterized in that   The image processing apparatus according to claim 1, wherein the generation of the first and second display areas by the display area generation unit is performed when a tag designated in advance is included in a link included in the web application.   The image processing apparatus according to claim 1, wherein the first display area and the second display area are displayed separately on a screen.   The image processing apparatus according to claim 1, wherein the first display area and the second display area are displayed as separate windows on a screen.   The image processing apparatus according to claim 1, wherein the web application includes a script for confirming a processing status of the external site. The display ratio of the first display region is set to zero, the image processing apparatus according to claim 1 or 2 performs only script.   The image processing apparatus according to claim 1, wherein the web application detects that the process at the external site is completed, and the display of the second display area is closed based on the detection.   The image processing apparatus according to claim 1, wherein the web application detects the completion of processing at the external site and changes the display of the first display area. A display control step for displaying on the display means the content by the web application executed by the web server unit in the image processing apparatus and having the link to the external site, and the content of the external site accessed by the link;
An execution step for executing a script of the web application and the external site;
In the display control step, the content in the image processing apparatus displays the content by the web application and / or the content of the external site on the display means so that the bars and tabs on the periphery of the screen are not displayed. In the display method,
When displaying the content of the external site on the display means, executing a display area generation step of generating a first display area for the web application and a second display area for the external site;
In the display control step, the first display area and the second display area generated in the display area generation step are displayed in a state where the web application and the scripts of the external site can be executed. A content display control method in the image processing apparatus. The content display control method according to claim 9, wherein the generation of the first and second display areas by the display area generation step is performed when a tag designated in advance is included in a link included in the web application. . The content display control method according to claim 9 or 10, wherein the first display area and the second display area are divided and displayed on a screen. The content display control method according to claim 9 or 10, wherein the first display area and the second display area are displayed as separate windows on a screen. The content display control method according to claim 9, wherein the web application includes a script for confirming a processing status of the external site. The content display control method according to claim 9 or 10, wherein a display ratio of the first display area is set to zero and only a script is executed. The content display control method according to claim 9, wherein the web application detects that the processing at the external site is completed, and the display of the second display area is closed based on the detection. . The content display control method according to claim 9, wherein the web application detects that the processing at the external site is completed, and changes the display of the first display area. A display control step for displaying on the display means the content by the web application executed by the web server unit in the image processing apparatus and having the link to the external site, and the content of the external site accessed by the link;
An execution step for executing a script of the web application and the external site;
Is executed by the computer of the image processing apparatus, and in the display control step, the contents by the web application and / or the contents of the external site are displayed on the display means so that the bars and tabs in the periphery of the screen are not displayed. In a content display control program for causing the computer to execute processing to be performed,
Causing the computer to further execute a display area generating step of generating a first display area for the web application and a second display area for the external site when displaying the content of the external site on the display means; ,
In the display control step, the process of displaying the first display area and the second display area generated in the display area generation step in a state where the web application and each script included in the external site are executable. A content display control program to be executed by a computer. The content display control program according to claim 17, wherein the generation of the first and second display areas by the display area generation step is performed when a tag designated in advance is included in a link of the web application. . The content display control program according to claim 17 or 18, wherein the first display area and the second display area are divided and displayed on a screen. The content display control program according to claim 17 or 18, wherein the first display area and the second display area are displayed as separate windows on a screen. The content display control program according to any one of claims 17 to 20, wherein the web application includes a script for confirming a processing status of the external site. The content display control program according to claim 17 or 18, wherein a display ratio of the first display area is set to zero and only a script is executed. The content display control program according to any one of claims 17 to 22, wherein the web application detects that the processing at the external site is completed, and the display of the second display area is closed based on the detection. . The content display control program according to any one of claims 17 to 23, wherein the web application detects that the processing at the external site has been completed and changes the display of the first display area.

Images