JP6711053B2 - Image processing device, image processing system and program - Google Patents

Description

The present invention relates to an image processing apparatus such as an MFP (Multi-Functional Peripheral) and a technique related thereto.

In recent years, user-wearable terminal devices (hereinafter also referred to as wearable terminals or wearable devices) have become widespread. Further, in the wearable terminal, there is a device (also referred to as a biometric information detection device) that detects physical information (pulse wave or the like) of the user.

In addition, in an image processing apparatus such as an MFP, there is a technique for simplifying a login operation by using biometric information (specifically, fingerprint, iris, vein, etc.) for identifying an individual (see Patent Document 1). ).

JP 2008-33391 A

By the way, in an image processing apparatus such as an MFP, operations using various operation screens are performed. It is desired to improve the operability of these operation screens as needed.

However, it is not easy to collect information that leads to improvement of various operation screens. The technique described in Patent Document 1 is a technique for identifying an individual by using biometric information (specifically, a fingerprint, an iris, a vein, etc.) and simplifying a login operation in the MFP. It is not a technology that collects information that leads to.

Then, this invention makes it a subject to provide the technique which can collect the information linked to the improvement of an operation screen easily.

In order to solve the above-mentioned problems, the invention of claim 1 is an image processing apparatus, wherein a display means for displaying one of a plurality of operation screens and biometric information of a user who performs an operation using the operation screen. When an operation is performed on the first operation screen of the plurality of operation screens and an acquisition unit that acquires biological information that changes reflecting the state of the user, the first operation screen is displayed. The first biometric information acquired by the acquisition means in accordance with the operation and the information of the first operation screen are registered in association with each other, and an operation is performed on the second operation screen of the plurality of operation screens. Registration control means for controlling the operation of registering the second biometric information acquired by the acquisition means and the information of the second operation screen in association with each other in response to the operation on the second operation screen. And the acquisition unit acquires at least one biometric information item measured during a period corresponding to the display period of the operation screen, and the registration control unit immediately before the at least one biometric information item. It is characterized in that only the biometric information in which a change of a predetermined degree or more compared with the biometric information registered in is registered in association with the information on the operation screen.

According to a second aspect of the present invention, in the image processing apparatus according to the first aspect of the present invention, the operation screen information includes screen identification information of the operation screen, and the registration control unit controls the screen identification information and the user information. It is characterized in that biometric information is registered in association with each other.

According to a third aspect of the present invention, in the image processing apparatus according to the first aspect, the operation screen information includes screen identification information of the operation screen and operation information indicating operation contents in the operation screen, The registration control means may register the screen identification information, the operation information, and the biometric information of the user in association with each other.

According to a fourth aspect of the present invention, in the image processing apparatus according to any one of the first to third aspects, the acquisition unit includes the biological information measured by a wearable device worn by the user, It is characterized in that it is acquired from the wearable device through communication with the wearable device.

According to a fifth aspect of the present invention, in the image processing apparatus according to any one of the first to third aspects, the acquisition unit is transferred to a server after being measured by a wearable device worn by the user. The biometric information stored in the server is acquired from the server through communication with the server.

According to a sixth aspect of the present invention, in the image processing apparatus according to any one of the first to fifth aspects, the registration control unit associates the operation screen information with the biometric information of the user with each other. It is characterized in that the history information is transmitted to the server and stored therein.

According to a seventh aspect of the present invention, in the image processing apparatus according to any one of the first to sixth aspects, the fact that the state of the user within the display period of the operation screen is not normal is the biometric information of the user. And a determination unit that determines the operation screen as an improvement-needed screen.

The invention of claim 8 is an image processing apparatus, comprising: a display unit that displays one of a plurality of operation screens; and biometric information of a user who performs an operation using the operation screen, the state of the user. Acquiring means for acquiring the biometric information that changes by reflecting the above, and when the operation on the first operation screen among the plurality of operation screens is performed, the acquisition means according to the operation on the first operation screen. When the first biometric information acquired by the above and the information of the first operation screen are registered in association with each other and an operation is performed on the second operation screen of the plurality of operation screens, Registration control means for controlling the operation of registering the second biometric information acquired by the acquisition means and the information of the second operation screen in association with each other in response to an operation on the operation screen of The screen information includes screen identification information of the operation screen and operation information indicating the operation content in the operation screen, and the registration control unit includes the screen identification information, the operation information, and biometric information of the user. Are registered in association with each other, and the image processing device requires the operation screen when it is determined that the state of the user within the display period of the operation screen is not normal based on the biometric information of the user. A determination unit that determines an improvement screen and determines an operation button operated in the improvement-required screen as an improvement-required button, and the operation screen determined as the improvement-required screen is called again in response to a user operation. Output control means for outputting the guidance content regarding the improvement-needed button when the new operation screen is displayed.
The invention according to claim 9 is an image processing apparatus, comprising display means for displaying one of a plurality of operation screens, and biometric information of a user who performs an operation using the operation screen, the state of the user. Acquiring means for acquiring the biometric information that changes by reflecting the above, and when the operation on the first operation screen among the plurality of operation screens is performed, the acquisition means according to the operation on the first operation screen. When the first biometric information acquired by the above and the information of the first operation screen are registered in association with each other and an operation is performed on the second operation screen of the plurality of operation screens, Registration control means for controlling the operation of registering the second biometric information acquired by the acquisition means and the information of the second operation screen in association with each other in response to an operation on the operation screen of The information of the screen includes screen identification information of the operation screen and a plurality of operation information respectively indicating a plurality of operation contents in the operation screen, and the acquisition unit is at each time point corresponding to the plurality of operation contents. Acquiring a plurality of measured biometric information, the registration control unit registers the screen identification information, each of the plurality of operation information, and each of the plurality of biometric information in association with each other, and the image processing device. When the fact that the state of the user within the display period of the operation screen is not normal is determined based on the biometric information of the user, the operation screen is determined as the improvement required screen, and the improvement required screen is Determining means for determining an operation button operated in the area as an improvement required button, and when the operation screen determined as the improvement required screen is called again in response to a user operation and displayed as a new operation screen And output control means for outputting the guidance content regarding the button requiring improvement.

The invention according to claim 10 is an image processing apparatus, comprising: a display unit that displays one of a plurality of operation screens; and biometric information of a user who performs an operation using the operation screen, the state of the user. Acquiring means for acquiring the biometric information that changes by reflecting the above, and when the operation on the first operation screen among the plurality of operation screens is performed, the acquisition means according to the operation on the first operation screen. When the first biometric information acquired by the above and the information of the first operation screen are registered in association with each other and an operation is performed on the second operation screen of the plurality of operation screens, Registration control means for controlling the operation of registering the second biometric information acquired by the acquisition means and the information of the second operation screen in association with each other in response to an operation on the operation screen of The screen information includes screen identification information of the operation screen and operation information indicating the operation content in the operation screen, and the registration control unit includes the screen identification information, the operation information, and biometric information of the user. Are registered in association with each other, and the image processing device requires the operation screen when it is determined that the state of the user within the display period of the operation screen is not normal based on the biometric information of the user. While determining as an improvement screen, a determination means for determining an operation button operated in the improvement required screen as an improvement required button, and a display control means for displaying a menu screen, the display control means, After the presence of the improvement-needed button is determined, a call button for calling an operation screen relating to the improvement-needed button, or the improvement-needed button itself is added to the menu screen.
The invention according to claim 11 is an image processing apparatus, comprising display means for displaying one of a plurality of operation screens, and biometric information of a user who performs an operation using the operation screen, the state of the user. Acquiring means for acquiring the biometric information that changes by reflecting the above, and when the operation on the first operation screen among the plurality of operation screens is performed, the acquisition means according to the operation on the first operation screen. When the first biometric information acquired by the above and the information of the first operation screen are registered in association with each other and an operation is performed on the second operation screen of the plurality of operation screens, Registration control means for controlling the operation of registering the second biometric information acquired by the acquisition means and the information of the second operation screen in association with each other in response to an operation on the operation screen of The information of the screen includes screen identification information of the operation screen and a plurality of operation information respectively indicating a plurality of operation contents in the operation screen, and the acquisition unit is at each time point corresponding to the plurality of operation contents. Acquiring a plurality of measured biometric information, the registration control unit registers the screen identification information, each of the plurality of operation information, and each of the plurality of biometric information in association with each other, and the image processing device. When the fact that the state of the user within the display period of the operation screen is not normal is determined based on the biometric information of the user, the operation screen is determined as the improvement required screen, and the improvement required screen is And a display control means for displaying a menu screen, the display control means after the presence of the improvement-needed button is determined. In the above, the call button for calling the operation screen related to the improvement required button, or the improvement required button itself is added to the menu screen.
According to a twelfth aspect of the present invention, in the image processing device according to any one of the first to eleventh aspects, the biometric information is information that changes by reflecting a mental state and/or a physical condition of the user. Is characterized by.
A thirteenth aspect of the present invention is the image processing apparatus according to any one of the first to eleventh aspects, wherein the biological information is information relating to at least one of a pulse wave, an electrocardiogram, a body temperature, a heart rate, and a blood pressure. It is characterized by having.

According to a fourteenth aspect of the present invention, a computer incorporated in the image processing apparatus is provided with: a) biometric information of a user who performs an operation using an operation screen of the image processing apparatus, which changes according to a state of the user. A program for executing the step of acquiring information, and the step of b) executing the operation of registering the information of the operation screen and the biometric information of the user in association with each other. B-1) When an operation is performed on a first operation screen of a plurality of operation screens selectively displayed on the image processing apparatus, it is acquired according to the operation on the first operation screen. A step of registering the first biometric information and information of the first operation screen in association with each other; b-2) when an operation is performed on a second operation screen of the plurality of operation screens, A step of registering the second biometric information acquired according to the operation on the second operation screen and the information of the second operation screen in association with each other, and in the step a), the operation is performed. At least one biometric information measured during the period corresponding to the display period of the screen is acquired, and in the step b), the biometric information registered in the at least one biometric information is compared with the biometric information registered immediately before to a predetermined degree. Only the biometric information that has undergone the above changes is registered in association with the information on the operation screen.
According to a fifteenth aspect of the present invention, in the program according to the fourteenth aspect , the operation screen information includes screen identification information of the operation screen and operation information indicating operation contents in the operation screen, and the step In b), the screen identification information, the operation information, and the biometric information of the user are registered in association with each other.
According to a sixteenth aspect of the present invention, in the program according to the fourteenth aspect , the information of the operation screen is screen identification information of the operation screen and a plurality of operation information respectively indicating a plurality of operation contents in the operation screen. In the step b), a plurality of biometric information measured at each time point corresponding to the plurality of operation contents are acquired, and each of the screen identification information and the plurality of operation information and the plurality of biometrics are acquired. It is characterized in that each piece of information is registered in association with each other.
According to a seventeenth aspect of the present invention, a computer incorporated in the image processing apparatus is provided with: a) biometric information of a user who performs an operation using an operation screen of the image processing apparatus, which changes according to a state of the user. A program for executing the step of acquiring information, and the step of b) executing the operation of registering the information of the operation screen and the biometric information of the user in association with each other. B-1) When an operation is performed on a first operation screen of a plurality of operation screens selectively displayed on the image processing apparatus, it is acquired according to the operation on the first operation screen. A step of registering the first biometric information and information of the first operation screen in association with each other; b-2) when an operation is performed on a second operation screen of the plurality of operation screens, A step of registering the second biometric information acquired according to the operation on the second operation screen and the information of the second operation screen in association with each other, wherein the information of the operation screen is the operation In step b), the screen identification information, the operation information, and the biometric information of the user are registered in association with each other, including screen identification information of a screen and operation information indicating an operation content in the operation screen. , The program: c) when it is determined based on the biometric information of the user that the state of the user within the display period of the operation screen is not normal, the operation screen is determined to be an improvement required screen, and A step of determining an operation button operated in the improvement required screen as an improvement required button, and d) a new operation screen in which the operation screen determined as the improvement required screen is called again in response to a user operation. Is displayed, the step of outputting guidance content regarding the button requiring improvement is further executed by the computer.
In the invention of claim 18, a) a biometric information of a user who performs an operation using an operation screen of the image processing apparatus in a computer incorporated in the image processing apparatus, the biometric information changing according to a state of the user. A program for executing the step of acquiring information, and the step of b) executing the operation of registering the information of the operation screen and the biometric information of the user in association with each other. B-1) When an operation is performed on a first operation screen of a plurality of operation screens selectively displayed on the image processing apparatus, it is acquired according to the operation on the first operation screen. A step of registering the first biometric information and information of the first operation screen in association with each other; b-2) when an operation is performed on a second operation screen of the plurality of operation screens, A step of registering the second biometric information acquired according to the operation on the second operation screen and the information of the second operation screen in association with each other, wherein the information of the operation screen is the operation A plurality of pieces of operation information indicating a plurality of operation contents in the operation screen and a plurality of pieces of information measured at each time point corresponding to the plurality of operation contents. Biometric information is acquired, each of the screen identification information, each of the plurality of operation information, and each of the plurality of biometric information are registered in association with each other, and the program includes: When it is determined that the user's state is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and the operation button operated in the improvement required screen needs improvement. A step of determining as a button, and d) outputting guidance content regarding the improvement-requiring button when the operation screen determined to be the improvement-requiring screen is called again in response to a user operation and displayed as a new operation screen. And the step of performing are further executed by the computer.
According to a nineteenth aspect of the present invention, a computer incorporated in the image processing apparatus is provided with: a) biometric information of a user who performs an operation using an operation screen of the image processing apparatus, which changes according to a state of the user. A program for executing the step of acquiring information, and the step of b) executing the operation of registering the information of the operation screen and the biometric information of the user in association with each other. B-1) When an operation is performed on a first operation screen of a plurality of operation screens selectively displayed on the image processing apparatus, it is acquired according to the operation on the first operation screen. A step of registering the first biometric information and information of the first operation screen in association with each other; b-2) when an operation is performed on a second operation screen of the plurality of operation screens, A step of registering the second biometric information acquired according to the operation on the second operation screen and the information of the second operation screen in association with each other, wherein the information of the operation screen is the operation In step b), the screen identification information, the operation information, and the biometric information of the user are registered in association with each other, including screen identification information of a screen and operation information indicating an operation content in the operation screen. , The program: c) when it is determined based on the biometric information of the user that the state of the user within the display period of the operation screen is not normal, the operation screen is determined to be an improvement required screen, and The step of determining the operation button operated in the improvement required screen as the improvement required button, and the step of d) displaying the menu screen are further executed by the computer. After the presence of the improvement button is determined, a call button for calling the operation screen related to the improvement required button, or the improvement required button itself is added to the menu screen.
The invention according to claim 20 is characterized in that: a) a biometric information of a user who performs an operation using an operation screen of the image processing apparatus in a computer incorporated in the image processing apparatus, the biometric information changing according to a state of the user. A program for executing the step of acquiring information, and the step of b) executing the operation of registering the information of the operation screen and the biometric information of the user in association with each other. B-1) When an operation is performed on a first operation screen of a plurality of operation screens selectively displayed on the image processing apparatus, it is acquired according to the operation on the first operation screen. A step of registering the first biometric information and information of the first operation screen in association with each other; b-2) when an operation is performed on a second operation screen of the plurality of operation screens, A step of registering the second biometric information acquired according to the operation on the second operation screen and the information of the second operation screen in association with each other, wherein the information of the operation screen is the operation A plurality of pieces of operation information indicating a plurality of operation contents in the operation screen and a plurality of pieces of information measured at each time point corresponding to the plurality of operation contents. Biometric information is acquired, each of the screen identification information, each of the plurality of operation information, and each of the plurality of biometric information are registered in association with each other, and the program includes: When it is determined that the user's state is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and the operation button operated in the improvement required screen needs improvement. The step of determining as a button and the step of d) displaying a menu screen are further executed by the computer, and in the step d), after the presence of the improvement-requiring button is determined, the button regarding the improvement-requiring button is displayed. The call button for calling the operation screen or the improvement-needed button itself is added to the menu screen.
The invention according to claim 21 is the program according to any one of claims 17 to 20 , wherein in step a), at least one living body measured within a period corresponding to a display period of the operation screen. Information is acquired, and in the step b), among the at least one piece of biometric information, only the biometric information that has changed by more than a predetermined degree as compared with the biometric information registered immediately before is included in the information on the operation screen. It is characterized by being registered in association with each other.

The invention according to claim 22 is an image processing system, comprising: an image processing device; and a server, wherein the image processing device comprises a display unit for displaying one of a plurality of operation screens, and an operation screen. An acquisition unit that acquires biometric information of a user who performs an operation using, and that changes biometric information that reflects the state of the user, and an operation on a first operation screen of the plurality of operation screens is performed. When the first operation screen is operated, the first biometric information acquired by the acquisition unit in response to the operation on the first operation screen and the information of the first operation screen are registered in association with each other. When the second operation screen is operated, the second biometric information acquired by the acquisition unit according to the operation on the second operation screen and the information of the second operation screen are associated with each other. Registration control means for controlling the operation of registering, and transmission means for transmitting to the server operation screen history information in which information of the operation screen and biometric information acquired according to an operation on the operation screen are associated with each other, The server includes a receiving unit that receives the operation screen history information from the image processing apparatus, and a storage unit that stores the operation screen history information, and the acquisition unit is configured to store the operation screen history information . Obtaining at least one biometric information measured within a period corresponding to the display period, and the registration control means changes the biometric information registered in the at least one biometric information by a predetermined degree or more as compared with the biometric information registered immediately before. It is characterized in that only the biometric information in which the occurrence has occurred is registered in association with the information on the operation screen.
According to a twenty- third aspect of the present invention, in the image processing system according to the twenty-second aspect , the operation screen information includes screen identification information of the operation screen and operation information indicating operation contents in the operation screen. The registration control means may register the screen identification information, the operation information, and the biometric information of the user in association with each other.
According to a twenty-fourth aspect of the present invention, in the image processing system according to the twenty-second aspect , the information of the operation screen is a plurality of operations indicating screen identification information of the operation screen and a plurality of operation contents in the operation screen. Including information, the acquisition means acquires a plurality of biometric information measured at each time corresponding to the plurality of operation content, the registration control means, the screen identification information and the plurality of operation information Each of the plurality of pieces of biometric information is registered in association with each other.
The invention of claim 25 is an image processing system, comprising: an image processing device; and a server, wherein the image processing device comprises a display means for displaying one of a plurality of operation screens, and an operation screen. An acquisition unit that acquires biometric information of a user who performs an operation using, and that changes biometric information that reflects the state of the user, and an operation on a first operation screen of the plurality of operation screens is performed. When the first operation screen is operated, the first biometric information acquired by the acquisition unit in response to the operation on the first operation screen and the information of the first operation screen are registered in association with each other. When the second operation screen is operated, the second biometric information acquired by the acquisition unit according to the operation on the second operation screen and the information of the second operation screen are associated with each other. Registration control means for controlling the operation of registering, and transmission means for transmitting to the server operation screen history information in which information of the operation screen and biometric information acquired according to an operation on the operation screen are associated with each other, The server has a receiving unit that receives the operation screen history information from the image processing apparatus, and a storage unit that stores the operation screen history information, and the operation screen information is the operation Including screen identification information of the screen and operation information indicating the operation content in the operation screen, the registration control means, the screen identification information, the operation information and the biometric information of the user are registered in association with each other, When the image processing apparatus determines that the state of the user in the display period of the operation screen is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, Determination means for determining an operation button operated in the improvement required screen as an improvement required button, and the operation screen determined as the improvement required screen is called again according to a user operation and displayed as a new operation screen In this case, output control means for outputting the guidance content regarding the button requiring improvement is further provided.
The invention of claim 26 is an image processing system, comprising: an image processing device; and a server, wherein the image processing device comprises a display means for displaying one of a plurality of operation screens, and an operation screen. An acquisition unit that acquires biometric information of a user who performs an operation using, and that changes biometric information that reflects the state of the user, and an operation on a first operation screen of the plurality of operation screens is performed. When the first operation screen is operated, the first biometric information acquired by the acquisition unit in response to the operation on the first operation screen and the information of the first operation screen are registered in association with each other. When the second operation screen is operated, the second biometric information acquired by the acquisition unit according to the operation on the second operation screen and the information of the second operation screen are associated with each other. Registration control means for controlling the operation of registering, and transmission means for transmitting to the server operation screen history information in which information of the operation screen and biometric information acquired according to an operation on the operation screen are associated with each other, The server has a receiving unit that receives the operation screen history information from the image processing apparatus, and a storage unit that stores the operation screen history information, and the operation screen information is the operation Including a plurality of operation information indicating a plurality of operation contents in the operation screen and screen identification information of the screen, the acquisition means, a plurality of living bodies measured at each time corresponding to the plurality of operation contents The information is acquired, the registration control unit registers the screen identification information, each of the plurality of operation information and each of the plurality of biometric information in association with each other, and the image processing apparatus displays the operation screen. When it is determined that the state of the user within the period is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and the operation performed in the improvement required screen Determination means for determining a button as an improvement required button, and guidance regarding the improvement required button when the operation screen determined as the improvement required screen is recalled and displayed as a new operation screen in response to a user operation. And output control means for outputting the content.
The invention of claim 27 is an image processing system, comprising: an image processing device; and a server, wherein the image processing device comprises a display means for displaying one of a plurality of operation screens, and an operation screen. An acquisition unit that acquires biometric information of a user who performs an operation using, and that changes biometric information that reflects the state of the user, and an operation on a first operation screen of the plurality of operation screens is performed. When the first operation screen is operated, the first biometric information acquired by the acquisition unit in response to the operation on the first operation screen and the information of the first operation screen are registered in association with each other. When the second operation screen is operated, the second biometric information acquired by the acquisition unit according to the operation on the second operation screen and the information of the second operation screen are associated with each other. Registration control means for controlling the operation of registering, and transmission means for transmitting to the server operation screen history information in which information of the operation screen and biometric information acquired according to an operation on the operation screen are associated with each other, The server has a receiving unit that receives the operation screen history information from the image processing apparatus, and a storage unit that stores the operation screen history information, and the operation screen information is the operation Including screen identification information of the screen and operation information indicating the operation content in the operation screen, the registration control means, the screen identification information, the operation information and the biometric information of the user are registered in association with each other, When the image processing apparatus determines that the state of the user in the display period of the operation screen is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, The display control means further comprises: a determination unit that determines an operation button operated in the improvement-needed screen as a improvement-needed button; and a display control unit that displays a menu screen, and After the determination, the call button for calling the operation screen regarding the improvement-needed button, or the improvement-needed button itself is added to the menu screen.
The invention of claim 28 is an image processing system, comprising: an image processing device; and a server, wherein the image processing device comprises a display means for displaying one of a plurality of operation screens, and an operation screen. An acquisition unit that acquires biometric information of a user who performs an operation using, and that changes biometric information that reflects the state of the user, and an operation on a first operation screen of the plurality of operation screens is performed. When the first operation screen is operated, the first biometric information acquired by the acquisition unit in response to the operation on the first operation screen and the information of the first operation screen are registered in association with each other. When the second operation screen is operated, the second biometric information acquired by the acquisition unit according to the operation on the second operation screen and the information of the second operation screen are associated with each other. Registration control means for controlling the operation of registering, and transmission means for transmitting to the server operation screen history information in which information of the operation screen and biometric information acquired according to an operation on the operation screen are associated with each other, The server has a receiving unit that receives the operation screen history information from the image processing apparatus, and a storage unit that stores the operation screen history information, and the operation screen information is the operation Including a plurality of operation information indicating a plurality of operation contents in the operation screen and screen identification information of the screen, the acquisition means, a plurality of living bodies measured at each time corresponding to the plurality of operation contents The information is acquired, the registration control unit registers the screen identification information, each of the plurality of operation information and each of the plurality of biometric information in association with each other, and the image processing apparatus displays the operation screen. When it is determined that the state of the user within the period is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and the operation performed in the improvement required screen The display control means further comprises: a determination unit that determines the button as an improvement required button; and a display control unit that displays a menu screen, and the display control unit relates to the improvement required button after the presence of the improvement required button is determined. The calling button for calling the operation screen, or the improvement-needed button itself is added to the menu screen.
The invention of claim 29 is an image processing system according to the invention of any one of claims 28 to claim 25, wherein the acquisition means, at least one measured within a period corresponding to a display period of the operation screen The biometric information is acquired, and the registration control means sets only the biometric information that has changed by more than a predetermined degree as compared with the biometric information registered immediately before among the at least one biometric information to the information on the operation screen. The feature is that they are registered in association with each other.

According to the inventions of claims 1 to 29 , the biometric information of the user who performs an operation using the operation screen is acquired, and the biometric information and the information of the operation screen are registered in association with each other. It is possible to easily collect the information that leads to the improvement of the screen.

It is a figure which shows the image processing system which concerns on this invention. FIG. 3 is a diagram showing functional blocks of an MFP (image processing apparatus). It is a functional block diagram showing a schematic structure of a wearable terminal. It is a figure which shows the outline|summary of operation. 6 is a timing chart showing an operation related to a job. It is a figure which shows the operation screen history information with which the operation screen and biometric information were linked|related and registered. It is a figure which shows a main menu screen. It is a figure which shows a copy menu screen. It is a figure which shows the detailed setting screen of "Nin1." It is a figure which shows the operation screen history information with which the operation information was related. It is a figure which shows the operation screen history information in which only one part of several biometric information was registered. FIG. 6 is a diagram showing operation screen history information in which a plurality of pieces of biometric information acquired at fixed time intervals are associated with each operation screen. It is a figure which shows the time-dependent change of biometric information. It is a figure which shows an example of the guidance display regarding the improvement required button. It is a figure which shows a mode that the call button is added to the menu screen. It is a figure which shows a mode that MFP acquires biometric information via a server.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<1. First Embodiment>
<1-1. Configuration overview>
FIG. 1 is a diagram showing an image processing system 1 according to the present invention. As shown in FIG. 1, the image processing system 1 includes an MFP (image processing apparatus) 10, a wearable terminal 50, and a server computer 80.

The respective elements 10, 50, 80 in the system 1 are communicatively connected to each other via the network 108. The network 108 is configured by a LAN (Local Area Network), the Internet, and the like. The connection mode to the network 108 may be wired connection or wireless connection.

The MFP 10 and the wearable terminal 50 are wirelessly connected to each other using various wireless communication technologies. For example, for communication between the MFP 10 and the wearable terminal 50, communication by wireless LAN (IEEE 802.11 etc.) and short-range wireless communication can be used. As the near field wireless communication, for example, communication based on BLE (Bluetooth (registered trademark) Low Energy), near field wireless communication (NFC: Near field radio communication), or the like is used.

<1-2. Configuration of image processing device>
FIG. 2 is a diagram showing functional blocks of the image processing apparatus 10. Here, an MFP (Multi-Functional Peripheral) is exemplified as the image processing apparatus 10. In FIG. 2, functional blocks of the MFP 10 are shown.

The MFP 10 is a device (also referred to as a multi-function peripheral) having a scan function, a copy function, a facsimile function, a box storage function, and the like. Specifically, as shown in the functional block diagram of FIG. 2, the MFP 10 includes an image reading unit 2, a print output unit 3, a communication unit 4, a storage unit 5, an operation unit 6, a controller 9, and the like. Various functions are realized by operating each part of the above in a composite manner. The MFP 10 is also called an image forming apparatus.

The image reading unit 2 optically reads (that is, scans) a document placed at a predetermined position (ADF (Auto Document Feeder) or a glass surface) of the MFP 10 to scan the document. Is a processing unit for generating image data (also referred to as a document image or a scan image). The image reading unit 2 is also called a scanning unit.

The print output unit 3 is an output unit that prints out an image on various media such as paper based on the data regarding the print target.

The communication unit 4 is a processing unit capable of performing facsimile communication via a public line or the like. Furthermore, the communication unit 4 can also perform various wireless communications. Specifically, the communication unit 4 includes a wireless LAN communication unit 4a that performs wireless communication by wireless LAN (IEEE 802.11 etc.) and a BLE communication unit 4b that performs wireless communication by BLE.

The storage unit 5 is composed of a storage device such as a hard disk drive (HDD).

The operation unit 6 includes an operation input unit 6a that receives an operation input to the MFP 10 and a display unit 6b that displays and outputs various information.

The MFP 10 is provided with a substantially plate-shaped operation panel section 6c (see FIG. 1). Further, the operation panel unit 6c has a touch panel 25 (see FIG. 1) on its front side. The touch panel 25 functions not only as a part of the operation input unit 6a but also as a part of the display unit 6b. The touch panel 25 is configured by embedding various sensors and the like in a liquid crystal display panel, can display various information, and can accept various operation inputs from an operator.

The controller 9 is a control device that is built in the MFP 10 and controls the MFP 10 as a whole. The controller 9 is configured as a computer system including a CPU and various semiconductor memories (RAM and ROM). The controller 9 realizes various processing units by causing the CPU to execute a predetermined software program (hereinafter, also simply referred to as a program) stored in a ROM (for example, an EEPROM). The program (specifically, a program module group) may be recorded in a portable recording medium such as a USB memory, read from the recording medium, and installed in the MFP 10. Alternatively, the program may be downloaded via the network and installed in the MFP 10.

Specifically, as shown in FIG. 2, the controller 9 executes the above-mentioned program to cause the communication control unit 11, the input control unit 12, the display control unit 13, the voice input/output control unit 14, and the authentication processing unit 15 to operate. Various processing units including the job control unit 16, the biometric information acquisition unit 17, the registration control unit 18, and the determination unit 19 are realized.

The communication control unit 11 is a processing unit that controls a communication operation with another device (wearable terminal 50 or the like) in cooperation with the communication unit 4 or the like. The communication control unit 11 includes a transmission control unit that controls a transmission operation of various data and a reception control unit that controls a reception operation of various data.

The input control unit 12 is a control unit that controls an operation input operation on the operation input unit 6a (touch panel 25 or the like). For example, the input control unit 12 controls the operation of receiving an operation input (designated input from the user) on the operation screen displayed on the touch panel 25.

The display control unit 13 is a processing unit that controls a display operation on the display unit 6b (touch panel 25 or the like). The display control unit 13 causes the touch panel 25 to display an operation screen for operating the MFP 10.

The voice input/output control unit 14 includes a voice input unit (a microphone (not shown) incorporated in the image processing apparatus 10) for voice input processing, and a voice output unit (a speaker (not shown) incorporated in the image processing apparatus 10). Etc.) is a processing unit for controlling audio output processing and the like.

The authentication processing unit 15 is a processing unit that controls user authentication processing (login processing).

The job control unit 16 is a processing unit that controls operations related to various jobs (print output operation, image reading operation, etc.).

The biometric information acquisition unit 17 collaborates with the wearable terminal 50 on the biometric information of the user who operates the MFP 10 (and the user who wears the wearable terminal 50) using the operation screen displayed on the touch panel 25. It is a processing unit to acquire. The biometric information will be described later.

The registration control unit 18 performs an operation of registering information of the operation screen of the MFP 10 (specifically, identification information of the operation screen (screen ID or the like)) and biometric information of a user who performs an operation using the operation screen in association with each other. It is a processing unit that controls (registration operation). For example, the registration control unit 18 registers biometric information of the user in logs (history information) related to various operation screens in association with the information of each operation screen.

The determination unit 19 is a processing unit that determines whether or not the user's state is normal.

<1-3. Structure of wearable terminal 50>
Next, the configuration of the wearable terminal (also referred to as a wearable device) 50 will be described.

The wearable terminal 50 is a device capable of performing a cooperative operation with the MFP 10 (image processing device). Specifically, the wearable terminal 50 is an information input/output terminal device (information terminal) capable of wireless communication (short-range wireless communication and network communication) with the MFP 10.

The wearable terminal 50 is a biometric information detection device that detects (measures) biometric information of the user (more specifically, biometric information that changes reflecting the state of the user (so-called dynamic biometric information)). .. Here, as the wearable terminal 50, a device capable of detecting (measuring) the blood pressure of the user as the biometric information of the user is exemplified. However, the wearable terminal 50 is not limited to this, and may be a device that detects (measures) biological information other than blood pressure (for example, pulse wave, electrocardiogram, body temperature, and/or heart rate). The biometric information is information that changes with time, reflecting the mental state and/or physical condition of the user. The wearable terminal 50 is also referred to as a user state detection device or the like that detects a user's mental state or the like by using the biometric information of the user.

Here, as the wearable terminal 50, a wristband type (wrist-wearing type) device (apparatus) is exemplified. However, the device is not limited to this, and various types of devices can be used as the wearable terminal 50.

FIG. 3 is a functional block diagram showing a schematic configuration of the wearable terminal 50.

As shown in the functional block diagram of FIG. 3, the wearable terminal 50 includes a communication unit 54, a storage unit 55, a biometric information detection unit 57, a battery 58, a controller 59, and the like, and operates these units in a composite manner. By doing so, various functions are realized.

The communication unit 54 can perform various types of wireless communication (including wireless communication by BLE). Specifically, the communication unit 54 includes a wireless LAN communication unit 54a that performs wireless communication by wireless LAN (IEEE 802.11 etc.) and a BLE communication unit 54b that performs wireless communication by BLE.

The storage unit 55 is composed of a storage device such as a nonvolatile semiconductor memory.

The biometric information detection unit 57 includes various sensors for detecting biometric information such as blood pressure.

The battery 58 is a secondary battery (rechargeable battery) and supplies power to the wearable terminal 50.

The operation unit 56 includes an operation input unit 56a that receives an operation input to the wearable terminal 50 and a display unit 56b that displays and outputs various information. In this wearable terminal 50, a touch panel configured by embedding various sensors and the like in a liquid crystal display panel is provided. The touch panel functions not only as a part of the operation input section 56a but also as a part of the display section 56b.

The controller 59 in FIG. 3 is a control device that is built in the wearable terminal 50 and that controls the wearable terminal 50 as a whole. The controller 59 is configured as a computer system including a CPU and various semiconductor memories (RAM and ROM). The controller 59 realizes various processing units by executing a predetermined software program (program) stored in a storage unit (semiconductor memory or the like) in the CPU. The program (specifically, a program module group) may be recorded in a portable recording medium such as a USB memory, read from the recording medium, and installed in the wearable terminal 50. Alternatively, the program may be downloaded via a network or the like and installed in the wearable terminal 50.

The wearable terminal 50 has a program (cooperation program) for cooperating with the MFP 10 installed therein. The cooperation program is an application software program (also simply referred to as an application) that implements various processes (a process of detecting a user's state (biological information), a process of transmitting the user's state, and the like).

Specifically, the controller 59 implements various processing units including a communication control unit 61, an input control unit 62, a display control unit 63, a state detection unit 65, and an operation execution unit 66 by executing a cooperation program or the like. To do.

The communication control unit 61 is a processing unit that cooperates with the communication unit 54 and the like to control the communication operation with the MFP 10 and the like.

The input control unit 62 is a control unit that controls an operation input operation on the operation input unit 56a (touch panel or the like).

The display control unit 63 is a processing unit that controls a display operation on the display unit 56b (touch panel or the like).

The state detection unit 65 is a processing unit that cooperates with the biometric information detection unit 57 to detect (measure) biometric information of the user.

The operation execution unit 66 is a processing unit that collectively executes various cooperative operations with the MFP 10.

<1-4. Other devices>
The server computer 80 (also simply referred to as a server) stores registration information (“operation screen history information” or “operation screen information”) that associates information on an operation screen on the MFP 10 with biometric information of a user who performs an operation using the operation screen. "Also referred to as"). The operation screen history information generated by the MFP 10 is not only stored in the MFP 10 but also transmitted to the server 80 and stored (stored) in the server 80. It should be noted that the server 80 may be a server provided inside the business office where the MFP 10 is arranged, or may be a server (cloud server or the like) provided outside the business office.

<1-5. Operation overview>
<Job start>
FIG. 4 is a diagram showing an outline of the operation of the system 1, more specifically, the operation of various jobs (copy job, scan job, etc.). Further, FIG. 5 is a timing chart showing the operation. The operation related to the copy job will be described below.

In step S11 (FIG. 5), login processing is performed. Specifically, a user (for example, U1) wearing the wearable terminal 50 operates the operation panel unit 6c of the MFP 10 to input his/her user authentication information (for example, user ID and password) on the login screen. Upon confirming that the input user authentication information is authentic, the MFP 10 permits the login of the user U1.

Next, in step S12, the MFP 10 acquires the device information of the wearable terminal 50 worn by the user U1. Specifically, the user information in which the proper login information (user authentication information) of the user U1 and the device information of the wearable terminal 50 are associated in advance is stored in the MFP 10, and the MFP 10 is based on the user information. , Device information of the wearable terminal 50 of the login user U1 is acquired. Specifically, the device information (device identification information of the wearable terminal 50, etc.) stored corresponding to the logged-in user is extracted and acquired.

Note that, here, the user information in which the login information of the user U1 and the device information of the wearable terminal 50 are associated in advance is stored in the MFP 10, but the present invention is not limited to this, and the user information is stored in the server 80. May be. Then, the MFP 10 may communicate with the server 80 to obtain the user information (particularly device information) stored in the server 80 from the server 80.

Next, the user U1 places the original document to be copied on the MFP 10 (glass surface or ADF, etc.), and performs various setting operations related to the copy job on the operation screens C1 to C3 (210, 230, 250) (210, 230, 250) ( 7 to 9) and the like. For example, the user U1 presses the copy button 211 on the main menu screen 210 (see FIG. 7) to display the copy menu screen (copy menu screen) 230 (see FIG. 8), and also the copy menu screen 230. An appropriate setting button (“Nin1” button 232 or the like) is selected from the buttons and pressed to perform an operation such as calling the detailed setting screen 250 (see FIG. 9). As described below, in this embodiment, every time a screen transition of the operation screen occurs, the biometric information of the user is acquired from the wearable terminal 50 (steps S21 to S23) and registered in the operation screen history information. (Step S24).

<Operation on the operation screen C1 and registration process regarding the operation screen C1>
Specifically, the first operation screen C1 (for example, the main menu screen 210) (see FIG. 7) is displayed on the touch panel 25, and the operation on the first operation screen C1 is accepted. The user U1 selects and presses a desired option (for example, the copy button 211) from the plurality of options (operation buttons) 211 to 213 displayed on the operation screen C1 (210). In this way, the user U1 performs an operation using the operation screen C1. The pressing operation of the desired option is also expressed as a screen switching instruction to the next operation screen C2 (copy menu screen 230).

When the user U1 performs an operation using the operation screen C1 (specifically, the operation using the operation screen C1 is completed), the MFP 10 responds to the pressing operation (screen switching instruction) of the desired option. Communication with the wearable terminal 50 or the like is performed to obtain biometric information (biometric information of the user U1) corresponding to the operation screen C1 (steps S21 to S23).

Specifically, first, the MFP 10 transmits a biometric information notification request to the wearable terminal 50 (step S21). Next, when the wearable terminal 50 receives the biometric information notification request, the wearable terminal 50 measures (detects) the biometric information of the user U1 using the biometric information detection unit 57 (step S22). Then, the wearable terminal 50 transmits the measured biometric information (the biometric information of the user U1) to the MFP 10 (step S23). Note that the MFP 10 may communicate with the wearable terminal 50 using the device information received in advance in step S12.

In this way, the MFP 10 acquires biometric information measured by the wearable terminal 50 (wearable device) worn by the user U1 from the wearable terminal 50 through communication with the wearable terminal 50. In other words, the MFP 10 acquires from the wearable terminal 50 the biometric information measured immediately after the screen transition from the operation screen C1 to another operation screen. Here, the biometric information measured immediately after the screen transition from the operation screen C1 to another screen is biometric information that reflects the state of the user who is performing an operation using the operation screen C1. Therefore, in the present application, not only the biological information measured within the display period of the operation screen C1 but also the biological information measured immediately after the screen transition from the operation screen C1 to another screen is displayed on the operation screen C1. It is considered that the biometric information is measured within the period corresponding to the period. The same applies to the other operation screens C2 and C3 (described later).

Further, in the operation screen history information, the MFP 10 registers the biometric information received in step S23 in association with the operation screen C1 (step S24).

Specifically, the MFP 10 associates the information of the operation screen C1 to be operated with the biometric information of the user who performs an operation using the operation screen C1 as operation screen history information (operation screen information) of the MFP 10. Store (register) in the storage unit 5. Further, the MFP 10 transmits the operation screen history information to the server 80 and stores (registers) it in the server 80. In this way, the MFP 10 executes the operation of registering the operation screen history information in both the MFP 10 and the server 80.

FIG. 6 is a diagram showing an example of operation screen history information. As shown in FIG. 6, the operation screen history information includes the information of the operating user and the information of the operation screen (specifically, the screen ID of the operation screen), and the biometric information acquired in steps S21 to S23. Also has.

For example, in the first column from the top of FIG. 6, the following information regarding the first operation screen C1 (see FIG. 7) is registered. Specifically, information of a user who executes an operation using the operation screen (“user U1” (specifically, user ID thereof)), screen ID of the operation screen (screen ID indicating the operation screen C1) is registered. Has been done. Further, in addition to the information on the operation screen, the biological information measured corresponding to the operation screen C1 (for example, blood pressure=“120” (mmHg)) and the measurement time of the biological information (“2015/11/15 12 :” is registered. In other words, the information regarding the operation screen C1 and the biometric information of the user are registered in association with each other.

<Operation on the operation screen C2 and registration process regarding the operation screen C2>
When a desired option (for example, a copy button (copy menu display button) 211) is selected from a plurality of options on the first operation screen C1 (for example, the main menu screen 210) (see FIG. 7), The screen transits to the next operation screen C2 (for example, copy menu screen 230) (see FIG. 8) (step S15). Then, the operation on the operation screen C2 is accepted (step S15).

Specifically, the user U1 selects and presses a desired option (for example, the “Nin1” button 232) from a plurality of options (operation buttons) displayed on the operation screen C2. The pressing operation of the desired option is also expressed as a screen switching instruction to the next operation screen C3 (for example, the detail setting screen 250 of "Nin1").

When the user U1 performs an operation using the operation screen C2, the MFP 10 responds to a pressing operation (screen switching instruction) of the desired option (button 232 or the like), communicates with the wearable terminal 50, and operates. The biometric information (the biometric information of the user U1) corresponding to the screen C2 is acquired (steps S21 to S23).

Then, the MFP 10 registers the biometric information received in step S23 in the operation screen history information in association with the operation screen C2 (step S24).

For example, in the second column from the top of FIG. 6, the following information regarding the second operation screen C2 (see FIG. 8) is registered. Specifically, information of a user who executes an operation using the operation screen (“user U1” (specifically, user ID thereof)), screen ID of the operation screen (screen ID indicating the operation screen C2) is registered. Has been done. In addition to the information on the operation screen, the biometric information measured corresponding to the operation screen C2 (for example, blood pressure=“200” (mmHg)) and the measurement time of the biometric information (“2015/11/15 12 : 02”) is registered.

<Operation on Operation Screen C3 and Registration Process on Operation Screen C3>
When a desired option (for example, “Nin1” button 232) is selected from a plurality of options on the second operation screen C2 (for example, copy menu screen 230) (see FIG. 8), the next operation is performed. The screen changes to the screen C3 (for example, the detail setting screen 250 of "Nin1") (see FIG. 9) (step S17). Then, the operation on the operation screen C3 is accepted (step S17).

Specifically, the user U1 selects and presses a desired option (for example, the “4in1” button 252) from the plurality of options (operation buttons) 251 to 254 displayed on the operation screen C3.

When the user U1 performs an operation using the operation screen C3, the MFP 10 responds to the pressing operation (screen switching instruction) of the desired option (the button 252 or the like), communicates with the wearable terminal 50, and performs the operation. The biometric information (the biometric information of the user U1) corresponding to the screen C3 is acquired (steps S21 to S23).

Then, the MFP 10 registers the biometric information received in step S23 in the operation screen history information in association with the operation screen C3 (step S24).

For example, in the third column from the top of FIG. 6, the following information regarding the third operation screen C3 is shown. Specifically, the information of the user who executes the operation using the operation screen C3 (“user U1” (specifically, the user ID)), the screen ID of the operation screen (screen ID indicating the operation screen C3), It is registered. In addition to the information on the operation screen, the biometric information measured corresponding to the operation screen C3 (for example, blood pressure=“130” (mmHg)) and the measurement time of the biometric information (“2015/11/15 12 : 03”) is registered.

After that, the same operation is further executed, and when various setting operations regarding the copy job are completed, the user U1 issues a copy start instruction to the MFP 10 by pressing the start button (not shown) of the operation panel unit 6c. Give.

In response to the copy start instruction, the MFP 10 starts a copy process (a process of reading a document to generate a scan image and performing print output based on the scan image). After the copy process is completed, the user U1 executes the logout operation, and the MFP 10 executes the logout process according to the logout operation (step S19).

<1-6. Effects and the like of the embodiment of the present application>
As described above, in the above-described embodiment, regarding the plurality of operation screens in the copy job, each biometric information of the user (U1 or the like) operating each operation screen of the MFP 10 is registered in association with each operation screen. (See operation screen history information (FIG. 6)). Therefore, it is possible to easily collect information that leads to improvement of the operation screen. More specifically, since the mental state of the user who performs the operation using the operation screen can be known, the anxiety state, etc. of the user with respect to the operation screen (the user feels stress and/or dissatisfaction) with respect to the operation screen, etc. Status etc.) can be recognized. As a result, it is possible to discover that there is a problem with the operation screen (extract a problem related to the operation screen), and to study the improvement points of the operation screen. As a result, it is possible to improve customer satisfaction.

For example, as shown in FIG. 6, the user biometric information (blood pressure “200”) at the time of operating one operation screen C2 (copy menu screen 230) of the three operation screens C1, C2, C3 is not When it is understood that the operation screen (main menu screen 210 or the like) is higher than the user biometric information at the time of operation (and/or the deviation from the normal value is large), the operation screen C2 has room for improvement. It is estimated that In other words, it is determined whether the user's state is normal based on the user biometric information (operation screen history information), and if it is determined that the user's state is not normal, there is room for improvement in the corresponding operation screen. It is estimated that there is.

The information registered in the MFP 10 is also transmitted to the server 80 and registered. Furthermore, by repeating the same operation, a plurality of pieces of biometric information regarding a plurality of operation screens are accumulated in the server 80.

Particularly, by registering a plurality (preferably a large number) of biometric information relating to a plurality (preferably a large number) of operation screens of the same type or different types, the relationship between the plurality of biometric information and the plurality of operation screens can be improved. Based on this, it is possible to grasp the features such as the general mental state of the user on each operation screen. In other words, by gaining knowledge of the user state for each operation screen, improvements unique to a certain operation screen can be found.

The number of measurement subjects (users) for each operation screen may be one, but it is preferable that there be a plurality of persons. By registering the biometric information of a plurality of users, the tendency not to rely on a specific user but to depend on a specific user (trend of biometric information regarding a plurality of biological bodies) can be known. In other words, it is possible to eliminate the dependence on the user and obtain a more general tendency.

Further, in the above-described embodiment, the MFP 10 acquires each biometric information measured during the display period of each operation screen (more accurately, in the vicinity of the display period) when switching and displaying a plurality of operation screens. , The biometric information is registered in association with the information on the operation screen. Therefore, the MFP 10 can easily acquire the biometric information corresponding to each of the plurality of operation screens.

Further, in the above-described embodiment, each biometric information of the user regarding each operation screen indicates a specific timing (a specific stage) regarding each operation screen (more specifically, immediately after a screen transition from the operation screen to another screen). Time point). Therefore, it is possible to avoid variations in the measurement timing of biometric information on each operation screen. Consequently, it is possible to prevent the measurement result of the biometric information from varying due to the variation in the measurement timing. That is, it is possible to obtain a plurality of measurement results (biological information) for each operation screen under the same conditions.

<1-7. Modified Example of First Embodiment>
<Operation information about operation buttons>
In the above embodiment, only the screen ID of the operation screen is registered as the information of the operation screen, but the present invention is not limited to this, and other information (information indicating the operation content in the operation screen (“operation button B1 (Pressed down) etc.)) may also be registered (see FIG. 10). In other words, every time the operation button is pressed by the user in each operation screen, the biometric information of the user corresponding to the operation of the operation button is measured, and the biometric information is registered in association with the operation button operation. May be. By registering information (also referred to as operation information) indicating the operation content on the operation screen in association with the biometric information of the user, problems (improvement points) and the like for each operation content (each operation button) Can be found.

FIG. 10 is a diagram showing operation screen history information according to such a modification.

In the operation screen history information of FIG. 10, “depression of button B1” is registered as the operation content during the display period of the operation screen C1 (specifically, the screen 210). Further, the biometric information “120” measured in response to the pressing of the button B1 (211) (the biometric information measured at the time corresponding to the operation content “pressing the button B1”) is the information of the corresponding operation screen C1 (screen C1). Screen ID) and the corresponding operation button B1 are registered in association with each other.

In addition, "depression of button B3" is registered as the operation content during the display period of the operation screen C3 (specifically, the screen 250). Further, the biometric information “130” (biometric information measured at a time corresponding to the operation content “press button B3”) measured in response to the pressing of the button B3 (252) is the information of the corresponding operation screen C3 (screen C3). Screen ID) and the corresponding operation button B3 are registered in association with each other.

Further, it is registered that the two buttons B21 (“full color” button 231) and B22 (“Nin1” button 232) have been pressed within the display period of the operation screen C2 (specifically, the screen 230). In addition, the biometric information “160” measured in response to the pressing of the button B21 (the biometric information measured at the time corresponding to the operation content “pressing the button B21”) is the information of the corresponding operation screen C2 and the corresponding operation button B21. It is registered in association with. Similarly, the biometric information “200” measured in response to the pressing of the button B22 (the biometric information measured at the time corresponding to the operation content “pressing the button B22”) is the information of the corresponding operation screen C2 and the corresponding operation button B22. It is registered in association with the operation information indicating that was pressed. As described above, in the operation screen history information of FIG. 10, with respect to the operation screen C2, the screen ID (screen identification information), each of the plurality of operation information, and each of the plurality of biometric information are registered in association with each other.

As shown in FIG. 10, the user biometric information (for example, blood pressure) (“160” and “200” at one operation screen C2 (for example, copy menu screen 230) of the three operation screens C1, C2, C3. )) is higher than the user biometric information at the time of operating another type of operation screen (for example, the main menu) (large deviation from the normal value), the specific operation screen is displayed. It is estimated that there is room for improvement. Further, in particular, among the operation buttons (operation members) operated within the specific operation screen, the user biometric information (for example, blood pressure “200” when the button B22 (specifically, “Nin1” button 232) is pressed. )) deviates from the normal value by a predetermined amount or more. According to this, it is estimated that there is room for improvement in the operation of the operation button B22 of the plurality of operation buttons in the operation screen.

<Other specific measurement timing regarding biological information>
In addition, in the above-described embodiment and the like, the biometric information of the user is the specific timing (specific stage) described above (more specifically, the time immediately after the screen transition from the operation screen to another screen, and the operation screen. However, the biometric information of the user may be measured at another specific timing.

For example, the other specific timing may be a time when a predetermined time (for example, several seconds) has elapsed from the time when the display of the operation screen was started, or the like.

The biometric information of the user is also measured at the time of login (step S11), the time immediately after acquisition of the device information (step S12), and/or the time of logout (step S19), and at least one of these times. The information acquired at the time may also be registered in the operation screen history information.

<Register a part of biometric information on multiple operation screens>
Further, in the above embodiment and the like, when a plurality of biometric information is measured at a plurality of time points within an operation period using a plurality of operation screens, all of the plurality of biometric information are registered. Not limited. When a plurality of biometric information is measured at a plurality of time points within an operation period using one or a plurality of operation screens, only a part of the plurality of biometric information may be registered.

For example, when a plurality of biometric information is measured at a plurality of time points corresponding to each operation period using a plurality of operation screens, among at least one biometric information acquired within the operation period of one operation screen, Only the biometric information that has changed by a predetermined degree or more as compared with the biometric information registered immediately before may be registered in association with the information of one operation screen (corresponding operation screen). In short, only the biometric information at the time when a relatively large change occurs may be registered. FIG. 11 is a diagram showing an example of such registration. In the registration example of FIG. 11, when the information as shown in FIG. 10 exists as registration candidate information, only a part of the registration candidate information is registered.

Specifically, as shown in FIG. 11, the biometric information (biological information at login) “120” measured during the operation period of a certain operation screen is registered and is measured after the biometric information at login. Of the other biometric information, only the biometric information that has changed by a predetermined degree (for example, “50”) or more as compared with the biometric information registered immediately before may be registered. Specifically, the biometric information that has not changed by more than “50” with respect to the biometric information “120” registered first (the biometric information “160” when the button B21 is pressed) is not registered, but is registered first. The biometric information in which a change of “50” or more has occurred with respect to the biometric information “120” (the biometric information “200” when the button B22 is pressed) is registered next. Then, the biometric information in which the change of “50” or more has occurred with respect to the biometric information “200” registered immediately before (the biometric information “130” when the button B3 is pressed) is registered next. Thus, only three pieces of biometric information out of the four pieces of biometric information (specifically, the reference biometric information “120” and the biometric information “200” and “130” that have undergone a relatively large change thereafter). It may be registered.

According to this, it is possible to reduce the number of data to be registered.

<Measure biometric information at regular time intervals>
Further, in the above-described embodiment and the like, at a certain stage regarding each operation screen (a time immediately after the screen transition from the operation screen to another screen, a time immediately after the operation button in the operation screen is pressed, or the like). , The biometric information of the user is measured, but not limited to this.

For example, the biometric information of the user is a certain period related to one job (for example, a login period from the login time to the logout time, or a period from the operation start time of the first operation screen to the operation end time of the last operation screen). Etc.) may be measured at regular time intervals (for example, every several seconds to several tens of seconds). Then, each of the plurality of biometric information measured at a constant time interval may be registered in association with each corresponding operation screen.

FIG. 12 is a diagram showing operation screen history information having such registration contents. In the operation screen history information of FIG. 12, each of the plurality of biometric information measured at a constant time interval (here, 1 minute interval) is registered in association with each corresponding operation screen.

Note that, in FIG. 12, “operation information” (operation button press information and the like) is not registered, but the present invention is not limited to this, and “operation information” (operation button press information) corresponding to biometric information to be registered. Etc.) may also be registered together. More specifically, for example, the operation button pressed immediately after the measurement time (detection time) of each biometric information (blood pressure or the like) to be registered may be registered as the “operation information” of the biometric information.

<Register a part of a plurality of biometric information measured at regular time intervals>
Further, it is not necessary to register all of the plurality of pieces of biometric information measured at fixed time intervals, and only part of the plurality of pieces of biometric information may be registered.

For example, a part of the biometric information of a plurality of biometric information measured at a certain time interval (specifically, one biometric information having the largest difference from the normal value within the display period of each operation screen (maximum value Alternatively, only the minimum value) may be registered in association with each operation screen.

Alternatively, when a plurality of pieces of biometric information are measured at regular time intervals, one piece of biometric information among the plurality of pieces of biometric information is registered in association with information on one operation screen, and Among the at least one biometric information measured later, only the biometric information that has changed by a predetermined degree or more as compared with the biometric information registered immediately before is registered in association with the information of the one operation screen. Good. In short, only the biometric information at the time when a relatively large change occurs may be registered.

More specifically, in FIG. 12, the biometric information (biological information at login) “120” measured during the operation period of a certain operation screen is registered, and other biometric information measured after the biometric information at login is registered. Of the biometric information, only the biometric information that has changed by a predetermined degree (for example, “50”) or more as compared with the biometric information registered immediately before may be registered. Specifically, the biometric information “160” in which the change of “50” or more does not occur in the biometric information “120” registered first is not registered, and the biometric information “120” registered first is not registered. Then, the biometric information "200" that has changed by "50" or more is registered next. Then, the biometric information “130” in which the change of “50” or more occurs with respect to the biometric information “200” registered immediately before is registered next. Thus, of the four biometric information, only three biometric information (specifically, the reference biometric information “120” and the biometric information “200” and “130” that have undergone a relatively large change thereafter) May be registered.

According to this, it is possible to reduce the number of data to be registered.

<2. Second Embodiment>
The second embodiment is a modification of the first embodiment. Below, it demonstrates centering around difference with 1st Embodiment.

In the first embodiment, the operation screen history information (particularly, a relatively large number of operation information (operation history information) related to the operation screen) is accumulated, and the operation screen history information is statistically analyzed to obtain the operation screen history information. Although the technology that leads to the improvement has been mainly described, the technology is not limited to this.

In the second embodiment, a technique will be described in which the operation screen history information is used to improve the operation screen relatively early (in real time) and automatically.

In the second embodiment, the MFP 10 determines, based on the user biometric information (operation screen history information) measured by the wearable terminal 50, whether the state of the user who has performed an operation using each operation screen is a normal state. To be done. For example, it is determined whether or not the state of the user is a normal state, depending on whether or not the difference between the index value indicating the biometric information of the user (for example, blood pressure) and its normal value is more than a predetermined level. ..

More specifically, when the difference between the index value (measured blood pressure value, etc.) measured during the operation period related to the operation screen to be evaluated and the index value (normal blood pressure value, etc.) in the normal state of the user is equal to or greater than the threshold value. It is determined that the user's state is not normal (ie, abnormal). The index value (normal blood pressure value, etc.) in the normal state of the user may be measured and registered in advance for each user. Alternatively, a general user index value (average blood pressure value, etc.) may be registered as an index value (normal blood pressure value, etc.) in a normal state of each user.

FIG. 13 is a diagram showing changes over time in biometric information. In FIG. 13, biometric information (blood pressure (specifically, systolic blood pressure)) of the user is measured at regular time intervals (for example, every several seconds). Here, the maximum value in the operation period of each operation screen (the period corresponding to the display period of each operation screen) among the plurality of biological information (blood pressure, etc.) measured at fixed time intervals is compared with the normal value. Then, it is determined whether or not the user state related to the operation of each operation screen is normal.

Instead of (or in addition to) this, whether or not the user's state has changed by more than a predetermined amount during the operation period of each operation screen (the difference between the minimum value and the maximum value within the operation period is It may be determined whether or not the state of the user who performs an operation using each of the operation screens is a normal state, depending on whether or not it is equal to or more than a predetermined value.

Then, when it is determined based on the biometric information of the user that the state of the user within the operation period of the operation screen is not the normal state, the MFP 10 (determination unit 19 and the like) displays the operation screen as the “improvement screen required”. "(Screen requiring improvement)". Further, the MFP 10 determines the operation button operated in the “improvement required screen” as the “improvement required button” (button requiring improvement). More specifically, the operation button pressed immediately after the measurement time (detection time) of the abnormally determined biological information (blood pressure) is determined to be the “improvement button”.

For example, a large number of options are arranged on the operation screen C2 (screen 230). Therefore, each user (U1 or the like) may find it difficult (to feel anxiety) in finding a desired button during the operation of the operation screen C2 (screen 230) (see FIG. 8). Further, in such a situation, the blood pressure of the user tends to be a value that is far from the normal value. In this embodiment, such a situation can be detected by measuring biometric information of the user.

Specifically, in the case as shown in FIG. 13, the maximum value "215" of the blood pressure (maximum blood pressure) within the operation period of the operation screen C2 (screen 230) is higher than the normal value by a predetermined amount or more. In this case, it is determined that the state of the user U1 within the operation period of the operation screen C2 is not normal based on the biometric information (operation screen history information) of the user U1. Then, the MFP 10 determines the operation screen C2 as the “improvement screen”. The MFP 10 (determination unit 19 and the like) determines the operation button operated in the “improvement screen” C2 as the “improvement button” (button requiring improvement). More specifically, the operation button (for example, the “Nin1” button 232) recorded in the operation screen history information indicating that the operation button corresponds to the blood pressure value “215” is the “improvement button”. To be judged.

Further, in the MFP 10, when the operation screen C2 (here, the copy menu screen 230) determined to be the improvement required screen is called again in response to a user operation and is displayed on the touch panel 25 as a new operation screen, The guidance display (described below) regarding the improvement-needed button (“Nin1” button 232) is added to the new operation screen (230). That is, the guidance display is added in the next operation.

FIG. 14 is a diagram showing an example of the guidance display. As shown in FIG. 14, to the right of the “Nin1” button 232 (the operation button determined to be the improvement required button), there is a sentence explaining the operation button 232 (“This button is displayed on one sheet of paper”). It is a button to call the setting screen for setting the number of pages N to be allocated.").

According to this, when the user U1 uses the copy menu screen 230 from the next time onward, since the guidance display of the “Nin1” button 232 is displayed on the copy menu screen 230, the user U1 compares the buttons 232 with each other. It is possible to find out easily. Therefore, it is possible to improve the operability of the operation screen C2. Further, when the blood pressure value is increased because the user feels anxiety about the content of the button 232 itself, the anxiety may be alleviated by looking at the content (character string) of the guidance display. Even in this sense, it is possible to improve the operability of the operation screen C2. In other words, it is possible to improve the operability especially regarding the button 232.

Here, the guidance content of the operation button 232 (character string for explanation and the like) is displayed and output by the touch panel 25, the display control unit 13 and the like, but the present invention is not limited to this. For example, the guidance content of the operation button 232 may be output as voice by the voice output unit of the MFP 10, the voice input/output control unit 14, and the like.

Further, in the second embodiment, after the improvement-requiring screen and the improvement-requiring button (specifically, the fact that each button is present) is determined, the improvement-requiring screen is called again in response to the user operation. When displayed as a new operation screen, the guidance display regarding the button requiring improvement is additionally displayed on the new operation screen, but is not limited to this.

For example, after the improvement-needed screen and the improvement-needed button are determined, the call button 214 for calling the operation screen 250 (FIG. 9) related to the improvement-needed button 232 is the main menu screen 210 (see FIG. 7) as a shortcut key. May be added (see FIG. 15). FIG. 15 shows a state in which a call button (call key) 214 is additionally displayed on the main menu screen 210 as a shortcut key. The main menu screen 210 is a screen in a higher hierarchy than the copy menu screen 230. The main menu screen 210 is, for example, a screen that can be customized for each user. However, the present invention is not limited to this, and the call button 214 may be added to the main menu screen 210 commonly used by a plurality of users.

By using such a call button 214 (FIG. 15), the user U1 can access the “Nin1” detailed setting screen 250 directly from the main menu screen 210 without using the copy menu screen 230 (see FIG. 8). It is possible to call. In other words, among the three operation screens 210, 230, 250, the transition from the operation screen 210 of the highest layer (the highest layer) to the operation screen 250 of the lowest layer (the lowest layer) is the middle. It can be performed without using the operation screen 230 of the hierarchy. By not using the operation screen 230, which is relatively difficult to use, the user U1 can perform the operation without feeling great stress.

Here, although the call button 214 for calling the operation screen related to the improvement-requiring button (232) is added to the main menu screen 210, the present invention is not limited to this. For example, in the case where the improvement-requiring button is a button for immediately performing setting (without calling the operation screen) (for example, “full color” button 231, etc.), the relevant improvement-requiring button (231 etc.) itself is the main menu screen. 210 may be added.

<3. Modifications>
Although the embodiments of the present invention have been described above, the present invention is not limited to the above description.

Further, in each of the above-described embodiments and the like, the operation screen history information is registered in the MFP 10 and the server 80 almost at the same time, but the present invention is not limited to this, and each information (including biometric information) related to each operation screen is Alternatively, it may be temporarily registered in the MFP 10 at the end of the operation period of each operation screen and then registered in the server 80 at another timing thereafter. More specifically, the information relating to each operation screen is temporarily stored in the MFP 10 at the end of the operation period of each operation screen, and then at a certain transmission timing (for example, every day at 22:00). It may be transmitted from the MFP 10 to the server 80 and stored in the server 80.

Further, in each of the above-described embodiments and the like, here, the operation screen history information is registered in both the MFP 10 and the server 80, but the present invention is not limited to this, and is registered in only one of the MFP 10 and the server 80. Good.

Further, in each of the above-described embodiments and the like, the MFP 10 obtains biometric information measured by the wearable terminal 50 (wearable device) worn by the user U1 from the wearable terminal 50 via communication with the wearable terminal 50. However, the present invention is not limited to this (steps S21 to S23, etc.).

For example, the MFP 10 may obtain the biometric information measured by the wearable terminal 50 worn by the user U1 and transferred to and stored in the server 80 from the server 80 via communication with the server 80. Good.

FIG. 16 is a diagram showing such a modified example.

In this modified example, the wearable terminal 50 regularly transmits (transfers) the biometric information measured by the wearable terminal 50 to the server 80 (for example, a cloud server) regardless of whether there is a transmission request from the MFP 10. The server 80 distinguishes and stores the received biometric information for each user.

On the other hand, the MFP 10 basically executes the job by performing the same operation as in FIG. However, the MFP 10 transmits the transmission request of the biometric information of the user U1 (biometric information notification request (step S21)) to the server 80 instead of the wearable terminal 50. The transmission request includes information of the user U1 (user ID, password, etc.), measurement period information of biometric information to be transmitted, and the like. The measurement period information includes information about a specified period that specifies the measurement time point (measurement period) of the biological information to be transmitted (from any measurement time point (start of the specified period) to any measurement time point (end of the specified period)). Information that specifies whether or not to transmit the biometric information) is included. For example, the measurement period information includes information that specifies the start and end of the operation period of each operation screen.

Upon receiving the transmission request, the server 80 extracts the biometric information of the user U1 measured within the specified period from the biometric information stored in the server 80 according to the transmission request, and extracts the extracted biometric information. It is transmitted to the MFP 10. The MFP 10 receives and acquires the biometric information of the user U1 (specifically, biometric information corresponding to the operation period of each operation screen) from the server 80. Then, the MFP 10 generates operation screen history information based on the received biometric information.

Even in such a mode, the MFP 10 can acquire the biometric information of the user U1.

1 Image Processing System 6c Operation Panel 10 MFP (Image Processing Device)
25 Touch panel 50 Wearable terminal (wearable device)
80 server computer 108 network 210 main menu screen 230 copy menu screen 250 detailed setting screen

Claims (29)

An image processing device,
Display means for displaying one of the plurality of operation screens,
An acquisition unit that acquires biometric information of a user who performs an operation using the operation screen and that changes by reflecting the state of the user,
When an operation is performed on a first operation screen of the plurality of operation screens, the first biometric information acquired by the acquisition unit according to the operation on the first operation screen and the first operation Screen information is registered in association with each other, and when an operation is performed on the second operation screen among the plurality of operation screens, the acquisition unit acquires the operation information according to the operation on the second operation screen. Registration control means for controlling the operation of registering the second biometric information and the information of the second operation screen in association with each other;
Equipped with
The acquisition means acquires at least one biometric information measured within a period corresponding to the display period of the operation screen,
Of the at least one piece of biometric information, the registration control means may register only the biometric information that has changed more than a predetermined degree as compared with the biometric information registered immediately before, in association with the information on the operation screen. Characteristic image processing device. The image processing apparatus according to claim 1 ,
The operation screen information includes screen identification information of the operation screen,
The image processing apparatus, wherein the registration control unit registers the screen identification information and the biometric information of the user in association with each other. The image processing apparatus according to claim 1 ,
The information of the operation screen includes screen identification information of the operation screen and operation information indicating operation content in the operation screen,
The image processing apparatus, wherein the registration control unit registers the screen identification information, the operation information, and the biometric information of the user in association with each other. The image processing apparatus according to any one of claims 1 to 3 ,
The image processing apparatus, wherein the acquisition unit acquires the biometric information measured by a wearable device worn by the user from the wearable device via communication with the wearable device. The image processing apparatus according to any one of claims 1 to 3 ,
The acquisition means acquires the biometric information, which is measured by a wearable device worn by the user and then transferred to the server and stored in the server, from the server via communication with the server. Characteristic image processing device. The image processing apparatus according to any one of claims 1 to 5 ,
The image processing apparatus, wherein the registration control means transmits operation screen history information in which information on the operation screen and biometric information of the user are associated with each other to a server for storage. The image processing apparatus according to any one of claims 1 to 6 ,
When it is determined that the state of the user in the display period of the operation screen is not normal based on the biometric information of the user, the determination unit that determines the operation screen as the improvement required screen,
An image processing apparatus comprising: An image processing device,
Display means for displaying one of the plurality of operation screens,
An acquisition unit that acquires biometric information of a user who performs an operation using the operation screen and that changes by reflecting the state of the user,
When an operation is performed on a first operation screen of the plurality of operation screens, the first biometric information acquired by the acquisition unit according to the operation on the first operation screen and the first operation Screen information is registered in association with each other, and when an operation is performed on the second operation screen among the plurality of operation screens, the acquisition unit acquires the operation information according to the operation on the second operation screen. Registration control means for controlling the operation of registering the second biometric information and the information of the second operation screen in association with each other;
Equipped with
The information of the operation screen includes screen identification information of the operation screen and operation information indicating operation content in the operation screen,
The registration control means registers the screen identification information, the operation information, and the biometric information of the user in association with each other,
The image processing device,
When it is determined that the state of the user within the display period of the operation screen is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and in the improvement required screen. Determination means for determining the operation button operated as a button requiring improvement,
Output control means for outputting guidance content regarding the improvement-needed button when the operation screen determined as the improvement-needed screen is called again in response to a user operation and displayed as a new operation screen,
An image processing apparatus further comprising: An image processing device,
Display means for displaying one of the plurality of operation screens,
An acquisition unit that acquires biometric information of a user who performs an operation using the operation screen and that changes by reflecting the state of the user,
When an operation is performed on a first operation screen of the plurality of operation screens, the first biometric information acquired by the acquisition unit according to the operation on the first operation screen and the first operation Screen information is registered in association with each other, and when an operation is performed on the second operation screen among the plurality of operation screens, the acquisition unit acquires the operation information according to the operation on the second operation screen. Registration control means for controlling the operation of registering the second biometric information and the information of the second operation screen in association with each other;
Equipped with
The information of the operation screen includes screen identification information of the operation screen and a plurality of operation information respectively indicating a plurality of operation contents in the operation screen,
The acquisition means acquires a plurality of biological information measured at each time point corresponding to the plurality of operation contents,
The registration control unit registers each of the screen identification information, each of the plurality of operation information, and each of the plurality of biometric information in association with each other,
The image processing device,
When it is determined that the state of the user within the display period of the operation screen is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and in the improvement required screen. Determination means for determining the operation button operated as a button requiring improvement,
Output control means for outputting guidance content regarding the improvement-needed button when the operation screen determined as the improvement-needed screen is called again in response to a user operation and displayed as a new operation screen,
An image processing apparatus further comprising: An image processing device,
Display means for displaying one of the plurality of operation screens,
An acquisition unit that acquires biometric information of a user who performs an operation using the operation screen and that changes by reflecting the state of the user,
When an operation is performed on a first operation screen of the plurality of operation screens, the first biometric information acquired by the acquisition unit according to the operation on the first operation screen and the first operation Screen information is registered in association with each other, and when an operation is performed on the second operation screen among the plurality of operation screens, the acquisition unit acquires the operation information according to the operation on the second operation screen. Registration control means for controlling the operation of registering the second biometric information and the information of the second operation screen in association with each other;
Equipped with
The information of the operation screen includes screen identification information of the operation screen and operation information indicating operation content in the operation screen,
The registration control means registers the screen identification information, the operation information, and the biometric information of the user in association with each other,
The image processing device,
When it is determined that the state of the user within the display period of the operation screen is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and in the improvement required screen. Determination means for determining the operation button operated as a button requiring improvement,
Display control means for displaying a menu screen,
Further equipped with,
The display control means adds a call button for calling an operation screen related to the improvement-necessary button or the improvement-necessary-button itself to the menu screen after the presence of the improvement-needed button is determined. Image processing device. An image processing device,
Display means for displaying one of the plurality of operation screens,
An acquisition unit that acquires biometric information of a user who performs an operation using the operation screen and that changes by reflecting the state of the user,
When an operation is performed on a first operation screen of the plurality of operation screens, the first biometric information acquired by the acquisition unit according to the operation on the first operation screen and the first operation Screen information is registered in association with each other, and when an operation is performed on the second operation screen among the plurality of operation screens, the acquisition unit acquires the operation information according to the operation on the second operation screen. Registration control means for controlling the operation of registering the second biometric information and the information of the second operation screen in association with each other;
Equipped with
The information of the operation screen includes screen identification information of the operation screen and a plurality of operation information respectively indicating a plurality of operation contents in the operation screen,
The acquisition means acquires a plurality of biological information measured at each time point corresponding to the plurality of operation contents,
The registration control unit registers each of the screen identification information, each of the plurality of operation information, and each of the plurality of biometric information in association with each other,
The image processing device,
When it is determined that the state of the user within the display period of the operation screen is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and in the improvement required screen. Determination means for determining the operation button operated as a button requiring improvement,
Display control means for displaying a menu screen,
Further equipped with,
The display control means adds a call button for calling an operation screen related to the improvement-necessary button or the improvement-necessary-button itself to the menu screen after the presence of the improvement-needed button is determined. Image processing device. The image processing device according to any one of claims 1 to 11 ,
The image processing apparatus, wherein the biometric information is information that changes reflecting the mental state and/or physical condition of the user. The image processing apparatus according to any one of claims 1 to 12 ,
The image processing apparatus, wherein the biological information includes information on at least one of pulse wave, electrocardiogram, body temperature, heart rate, and blood pressure. In the computer built in the image processing device,
a) a step of acquiring biometric information of a user who performs an operation using the operation screen of the image processing apparatus, the biometric information changing by reflecting the state of the user,
b) a step of performing an operation of registering information of the operation screen and the biometric information of the user in association with each other;
Is a program for executing
The step b) includes
b-1) When an operation is performed on a first operation screen of a plurality of operation screens selectively displayed on the image processing apparatus, a first operation screen acquired in response to the operation on the first operation screen. A step of registering the first biometric information and the information of the first operation screen in association with each other;
b-2) When the operation is performed on the second operation screen of the plurality of operation screens, the second biometric information acquired according to the operation on the second operation screen and the second operation Registering the information on the screen in association with each other,
Have
In the step a), at least one biometric information measured within a period corresponding to the display period of the operation screen is acquired,
In the step b), of the at least one piece of biometric information, only the biometric information that has changed more than a predetermined degree as compared with the biometric information registered immediately before is registered in association with the information on the operation screen. A program characterized by that. The program according to claim 14 ,
The information of the operation screen includes screen identification information of the operation screen and operation information indicating operation content in the operation screen,
In the step b), the screen identification information, the operation information, and the biometric information of the user are registered in association with each other. The program according to claim 14 ,
The information of the operation screen includes screen identification information of the operation screen and a plurality of operation information respectively indicating a plurality of operation contents in the operation screen,
In the step b), a plurality of biometric information measured at each time point corresponding to the plurality of operation contents are acquired, and the screen identification information, the plurality of operation information, and the plurality of biometric information, respectively. A program in which and are registered in association with each other. In the computer built in the image processing device,
a) a step of acquiring biometric information of a user who performs an operation using the operation screen of the image processing apparatus, the biometric information changing by reflecting the state of the user,
b) a step of performing an operation of registering information of the operation screen and the biometric information of the user in association with each other;
Is a program for executing
The step b) includes
b-1) When an operation is performed on a first operation screen of a plurality of operation screens selectively displayed on the image processing apparatus, a first operation screen acquired in response to the operation on the first operation screen. A step of registering the first biometric information and the information of the first operation screen in association with each other;
b-2) When the operation is performed on the second operation screen of the plurality of operation screens, the second biometric information acquired according to the operation on the second operation screen and the second operation Registering the information on the screen in association with each other,
Have
The information of the operation screen includes screen identification information of the operation screen and operation information indicating operation content in the operation screen,
In the step b), the screen identification information, the operation information, and the biometric information of the user are registered in association with each other,
The program is
c) When it is determined that the state of the user within the display period of the operation screen is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and the improvement required screen is also determined. A step of determining the operation button operated in the area as a button requiring improvement,
d) outputting guidance content regarding the improvement-needed button when the operation screen determined as the improvement-needed screen is called again in response to a user operation and displayed as a new operation screen,
A program that further causes the computer to execute. In the computer built in the image processing device,
a) a step of acquiring biometric information of a user who performs an operation using the operation screen of the image processing apparatus, the biometric information changing by reflecting the state of the user,
b) a step of performing an operation of registering information of the operation screen and the biometric information of the user in association with each other;
Is a program for executing
The step b) includes
b-1) When an operation is performed on a first operation screen of a plurality of operation screens selectively displayed on the image processing apparatus, a first operation screen acquired in response to the operation on the first operation screen. A step of registering the first biometric information and the information of the first operation screen in association with each other;
b-2) When the operation is performed on the second operation screen of the plurality of operation screens, the second biometric information acquired according to the operation on the second operation screen and the second operation Registering the information on the screen in association with each other,
Have
The information of the operation screen includes screen identification information of the operation screen and a plurality of operation information respectively indicating a plurality of operation contents in the operation screen,
In the step b), a plurality of biometric information measured at each time point corresponding to the plurality of operation contents are acquired, and the screen identification information, the plurality of operation information, and the plurality of biometric information, respectively. And are registered in association with each other,
The program is
c) When it is determined that the state of the user within the display period of the operation screen is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and the improvement required screen is also determined. A step of determining the operation button operated in the area as a button requiring improvement,
d) outputting guidance content regarding the improvement-needed button when the operation screen determined as the improvement-needed screen is called again in response to a user operation and displayed as a new operation screen,
A program that further causes the computer to execute. In the computer built in the image processing device,
a) a step of acquiring biometric information of a user who performs an operation using the operation screen of the image processing apparatus, the biometric information changing by reflecting the state of the user,
b) a step of performing an operation of registering information of the operation screen and the biometric information of the user in association with each other;
Is a program for executing
The step b) includes
b-1) When an operation is performed on a first operation screen of a plurality of operation screens selectively displayed on the image processing apparatus, a first operation screen acquired in response to the operation on the first operation screen. A step of registering the first biometric information and the information of the first operation screen in association with each other;
b-2) When the operation is performed on the second operation screen of the plurality of operation screens, the second biometric information acquired according to the operation on the second operation screen and the second operation Registering the information on the screen in association with each other,
Have
The information of the operation screen includes screen identification information of the operation screen and operation information indicating operation content in the operation screen,
In the step b), the screen identification information, the operation information, and the biometric information of the user are registered in association with each other,
The program is
c) When it is determined that the state of the user within the display period of the operation screen is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and the improvement required screen is also determined. A step of determining the operation button operated in the area as a button requiring improvement,
d) a step of displaying a menu screen,
Further causes the computer to execute,
In step d), after the presence of the improvement-requiring button is determined, a call button for calling an operation screen regarding the improvement-requiring button or the improvement-requiring button itself is added to the menu screen. A program characterized by. In the computer built in the image processing device,
a) a step of acquiring biometric information of a user who performs an operation using the operation screen of the image processing apparatus, the biometric information changing by reflecting the state of the user,
b) a step of performing an operation of registering information of the operation screen and the biometric information of the user in association with each other;
Is a program for executing
The step b) includes
b-1) When an operation is performed on a first operation screen of a plurality of operation screens selectively displayed on the image processing apparatus, a first operation screen acquired in response to the operation on the first operation screen. A step of registering the first biometric information and the information of the first operation screen in association with each other;
b-2) When the operation is performed on the second operation screen of the plurality of operation screens, the second biometric information acquired according to the operation on the second operation screen and the second operation Registering the information on the screen in association with each other,
Have
The information of the operation screen includes screen identification information of the operation screen and a plurality of operation information respectively indicating a plurality of operation contents in the operation screen,
In the step b), a plurality of biometric information measured at each time point corresponding to the plurality of operation contents are acquired, and the screen identification information, the plurality of operation information, and the plurality of biometric information, respectively. And are registered in association with each other,
The program is
c) When it is determined that the state of the user within the display period of the operation screen is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and the improvement required screen is also determined. A step of determining the operation button operated in the area as a button requiring improvement,
d) a step of displaying a menu screen,
Further causes the computer to execute,
In step d), after the presence of the improvement-requiring button is determined, a call button for calling an operation screen regarding the improvement-requiring button or the improvement-requiring button itself is added to the menu screen. A program characterized by. The program according to any one of claims 17 to 20 ,
In the step a), at least one biometric information measured within a period corresponding to the display period of the operation screen is acquired,
In the step b), of the at least one piece of biometric information, only the biometric information that has changed more than a predetermined degree as compared with the biometric information registered immediately before is registered in association with the information on the operation screen. A program characterized by that. An image processing system,
An image processing device,
Server,
Equipped with
The image processing device,
Display means for displaying one of the plurality of operation screens,
An acquisition unit that acquires biometric information of a user who performs an operation using the operation screen and that changes by reflecting the state of the user,
When an operation is performed on a first operation screen of the plurality of operation screens, the first biometric information acquired by the acquisition unit according to the operation on the first operation screen and the first operation Screen information is registered in association with each other, and when an operation is performed on the second operation screen among the plurality of operation screens, the acquisition unit acquires the operation information according to the operation on the second operation screen. Registration control means for controlling the operation of registering the second biometric information and the information of the second operation screen in association with each other;
Transmission means for transmitting to the server operation screen history information in which information of the operation screen and biometric information acquired in response to an operation on the operation screen are associated with each other,
Have
The server is
Receiving means for receiving the operation screen history information from the image processing device;
Storage means for storing the operation screen history information,
Have
The acquisition means acquires at least one biometric information measured within a period corresponding to the display period of the operation screen,
Of the at least one piece of biometric information, the registration control means may register only the biometric information that has changed more than a predetermined degree as compared with the biometric information registered immediately before, in association with the information on the operation screen. Characteristic image processing system. The image processing system according to claim 22 ,
The information of the operation screen includes screen identification information of the operation screen and operation information indicating operation content in the operation screen,
The image processing system, wherein the registration control unit registers the screen identification information, the operation information, and the biometric information of the user in association with each other. The image processing system according to claim 22 ,
The information of the operation screen includes screen identification information of the operation screen and a plurality of operation information respectively indicating a plurality of operation contents in the operation screen,
The acquisition means acquires a plurality of biological information measured at each time point corresponding to the plurality of operation contents,
The image processing system, wherein the registration control unit registers the screen identification information, each of the plurality of operation information, and each of the plurality of biometric information in association with each other. An image processing system,
An image processing device,
Server,
Equipped with
The image processing device,
Display means for displaying one of the plurality of operation screens,
An acquisition unit that acquires biometric information of a user who performs an operation using the operation screen and that changes by reflecting the state of the user,
When an operation is performed on a first operation screen of the plurality of operation screens, the first biometric information acquired by the acquisition unit according to the operation on the first operation screen and the first operation Screen information is registered in association with each other, and when an operation is performed on the second operation screen among the plurality of operation screens, the acquisition unit acquires the operation information according to the operation on the second operation screen. Registration control means for controlling the operation of registering the second biometric information and the information of the second operation screen in association with each other;
Transmission means for transmitting to the server operation screen history information in which information of the operation screen and biometric information acquired in response to an operation on the operation screen are associated with each other,
Have
The server is
Receiving means for receiving the operation screen history information from the image processing device;
Storage means for storing the operation screen history information,
Have
The information of the operation screen includes screen identification information of the operation screen and operation information indicating operation content in the operation screen,
The registration control means registers the screen identification information, the operation information, and the biometric information of the user in association with each other,
The image processing device,
When it is determined that the state of the user within the display period of the operation screen is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and in the improvement required screen. Determination means for determining the operation button operated as a button requiring improvement,
Output control means for outputting guidance content regarding the improvement-needed button when the operation screen determined as the improvement-needed screen is called again in response to a user operation and displayed as a new operation screen,
An image processing system further comprising: An image processing system,
An image processing device,
Server,
Equipped with
The image processing device,
Display means for displaying one of the plurality of operation screens,
An acquisition unit that acquires biometric information of a user who performs an operation using the operation screen and that changes by reflecting the state of the user,
When an operation is performed on a first operation screen of the plurality of operation screens, the first biometric information acquired by the acquisition unit according to the operation on the first operation screen and the first operation Screen information is registered in association with each other, and when an operation is performed on the second operation screen among the plurality of operation screens, the acquisition unit acquires the operation information according to the operation on the second operation screen. Registration control means for controlling the operation of registering the second biometric information and the information of the second operation screen in association with each other;
Transmission means for transmitting to the server operation screen history information in which information of the operation screen and biometric information acquired in response to an operation on the operation screen are associated with each other,
Have
The server is
Receiving means for receiving the operation screen history information from the image processing device;
Storage means for storing the operation screen history information,
Have
The information of the operation screen includes screen identification information of the operation screen and a plurality of operation information respectively indicating a plurality of operation contents in the operation screen,
The acquisition means acquires a plurality of biological information measured at each time point corresponding to the plurality of operation contents,
The registration control unit registers each of the screen identification information, each of the plurality of operation information, and each of the plurality of biometric information in association with each other,
The image processing device,
When it is determined that the state of the user within the display period of the operation screen is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and in the improvement required screen. Determination means for determining the operation button operated as a button requiring improvement,
Output control means for outputting guidance content regarding the improvement-needed button when the operation screen determined as the improvement-needed screen is called again in response to a user operation and displayed as a new operation screen,
An image processing system further comprising: An image processing system,
An image processing device,
Server,
Equipped with
The image processing device,
Display means for displaying one of the plurality of operation screens,
An acquisition unit that acquires biometric information of a user who performs an operation using the operation screen and that changes by reflecting the state of the user,
When an operation is performed on a first operation screen of the plurality of operation screens, the first biometric information acquired by the acquisition unit according to the operation on the first operation screen and the first operation Screen information is registered in association with each other, and when an operation is performed on the second operation screen among the plurality of operation screens, the acquisition unit acquires the operation information according to the operation on the second operation screen. Registration control means for controlling the operation of registering the second biometric information and the information of the second operation screen in association with each other;
Transmission means for transmitting to the server operation screen history information in which information of the operation screen and biometric information acquired in response to an operation on the operation screen are associated with each other,
Have
The server is
Receiving means for receiving the operation screen history information from the image processing device;
Storage means for storing the operation screen history information,
Have
The information of the operation screen includes screen identification information of the operation screen and operation information indicating operation content in the operation screen,
The registration control means registers the screen identification information, the operation information, and the biometric information of the user in association with each other,
The image processing device,
When it is determined that the state of the user within the display period of the operation screen is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and in the improvement required screen. Determination means for determining the operation button operated as a button requiring improvement,
Display control means for displaying a menu screen,
Further equipped with,
The display control means adds a call button for calling an operation screen related to the improvement-necessary button or the improvement-necessary-button itself to the menu screen after the presence of the improvement-needed button is determined. Image processing system. An image processing system,
An image processing device,
Server,
Equipped with
The image processing device,
Display means for displaying one of the plurality of operation screens,
An acquisition unit that acquires biometric information of a user who performs an operation using the operation screen and that changes by reflecting the state of the user,
When an operation is performed on a first operation screen of the plurality of operation screens, the first biometric information acquired by the acquisition unit according to the operation on the first operation screen and the first operation Screen information is registered in association with each other, and when an operation is performed on the second operation screen among the plurality of operation screens, the acquisition unit acquires the operation information according to the operation on the second operation screen. Registration control means for controlling the operation of registering the second biometric information and the information of the second operation screen in association with each other;
Transmission means for transmitting to the server operation screen history information in which information of the operation screen and biometric information acquired in response to an operation on the operation screen are associated with each other,
Have
The server is
Receiving means for receiving the operation screen history information from the image processing device;
Storage means for storing the operation screen history information,
Have
The information of the operation screen includes screen identification information of the operation screen and a plurality of operation information respectively indicating a plurality of operation contents in the operation screen,
The acquisition means acquires a plurality of biological information measured at each time point corresponding to the plurality of operation contents,
The registration control unit registers each of the screen identification information, each of the plurality of operation information, and each of the plurality of biometric information in association with each other,
The image processing device,
When it is determined that the state of the user within the display period of the operation screen is not normal based on the biometric information of the user, the operation screen is determined as the improvement required screen, and in the improvement required screen. Determination means for determining the operation button operated as a button requiring improvement,
Display control means for displaying a menu screen,
Further equipped with,
The display control means adds a call button for calling an operation screen related to the improvement-necessary button or the improvement-necessary-button itself to the menu screen after the presence of the improvement-needed button is determined. Image processing system. The image processing system according to any one of claims 25 to 28 ,
The acquisition means acquires at least one biometric information measured within a period corresponding to the display period of the operation screen,
Of the at least one piece of biometric information, the registration control means may register only the biometric information that has changed more than a predetermined degree as compared with the biometric information registered immediately before, in association with the information on the operation screen. Characteristic image processing system.