JP6256134B2 - Electronic equipment and operation support program - Google Patents

Description

  The present invention relates to an electronic device and an operation support program that display help information when a user is unsure of an operation.

  In recent years, some electronic devices have a function of displaying help information such as an explanation of an operation method and a function, and a technique for assisting when a user is at a loss has been developed. For example, a technique has been proposed in which a stray motion by a user's line of sight is detected using a line-of-sight detection unit and help information is displayed (see, for example, Patent Document 1).

JP 08-328715 A

  However, the threshold value of whether or not the user is at a loss is ambiguous, and the conventional technique cannot detect the attraction according to the user.

  This invention is made | formed in view of the said subject, and it aims at providing the technique which can solve the said subject.

The electronic device may display a plurality of operation keys on the screen, a touch panel for accepting an operation to the operation key, a line-of-sight detection section for detecting the line of sight with respect to the touch panel, the sight line detection unit detects the sight line hesitation time to said operation key or until the line of sight is out is operated from a timer unit for measuring each user, if the lost time in the measurement by the time measurement unit exceeds a positive variation tolerance A determination unit that determines that the user is confused about the operation, and the operation key is operated until the sight line is detected from the screen until the sight line is detected. Until the first gaze time until the operation key is operated until the line of sight deviates from the operation key after the line of sight with respect to the operation key is detected. Characterized in that it comprises a lost time.
Further, the timing unit includes a first time measurement portion that measures a pre-Symbol first lost time, and a pre-Symbol second clock section for measuring a second lost time, the lost determination unit If the lost time during the measurement is the first lost time, if the first variation allowable range in the positive direction is exceeded, it is determined that the user is lost in the operation of the screen, If the lost time during measurement is the second lost time, even if it is determined that the user is lost in the operation of the operation key when the second variation allowable range in the positive direction is exceeded. Good.
Moreover, the said hesitation determination part may determine whether the said user is lost in operation based on the said hesitation time measured for every screen hierarchy.
Moreover, the said hesitation determination part may determine whether the said user is lost in operation based on the said hesitation time measured for every function.
In addition, the hesitation determination unit may determine whether the user is lost in operation based on the most recent specific number of times of hesitation.
The touch panel may display different help information depending on whether the first lost time or the second lost time.
In addition, the hesitation determination unit is configured to detect that the user has lost his or her operation based on the first hesitation time from when the line of sight with respect to the operation key is detected until the line of sight with respect to the operation key deviates from the operation key. It may be determined whether or not the user is lost in operation based on the second lost time while the second lost time is measured without determining whether or not the user is present.
Operation support program of the present invention, the electronic device displays a plurality of operation keys on the screen, an operation accepting step of accepting a touch panel operation on the operation key, and line-of-sight detection step of detecting a line of sight with respect to the touch panel, the time measuring step of measuring the stray time from the detection of the sight line detection step is the line of sight to said operation key or until the line of sight is out is operated for each user, the time counter lost time in the measurement in step a particular And a step of determining whether or not the user is confused in an operation when the allowable variation range in the positive direction is exceeded, and the confusing time is determined after the line of sight with respect to the screen is detected. First stray time until it is off the screen or until the operation key is operated, and a line of sight to the operation key is detected From being, wherein the line of sight and a second hesitation time until the operation key or until it is released from the operation key is operated.

  According to the present invention, it is possible to detect a hesitation according to a user.

1 is a block diagram illustrating a configuration of an image forming apparatus according to an embodiment of the present invention. It is an image figure which shows the 1st lost time and the 2nd lost time which the time measuring part shown in FIG. 1 measures. It is an image figure in which the hesitation determination part shown in FIG. 1 determines a user's hesitation based on the 1st hesitation time and the 2nd hesitation time. It is an example of the screen of the help information displayed on the operation panel shown in FIG. It is an example of the screen of the help information displayed on the operation panel shown in FIG. 3 is a flowchart illustrating a flow of a process for detecting a hesitation according to a user in the image forming apparatus illustrated in FIG. 1.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that, in the following embodiments, the same reference numerals are given to configurations showing similar functions.

  As shown in FIG. 1, the image forming apparatus 100 includes an operation panel 10, a line-of-sight detection unit 11, a timing unit 12, a communication unit 13, a control unit 14, a storage unit 15, a document reading unit 16, an image processing unit 17, and a printing unit. 18.

  The operation panel 10 includes a touch panel and operation buttons. The touch panel is provided with a transparent pressure-sensitive sensor on the surface of a display unit that displays various operation keys and image formation status, and functions as a display unit and an input unit. The touch panel detects a touch operation on the display surface and outputs a signal corresponding to the position where the touch operation is detected, thereby accepting an operation on the operation key displayed on the display unit. The operation buttons are a numeric keypad for inputting numerical values such as the number of prints, a reset key for inputting an instruction to initialize setting information, a stop key for stopping a copying operation, and an output instruction for starting a printing operation. Various operation keys such as a start key are provided.

  The line-of-sight detection unit 11 has a function of detecting the user's line of sight. Specifically, the line-of-sight detection unit 11 detects the user's line of sight with respect to the touch panel screen and the user's line of sight with respect to the operation keys in the touch panel screen. For example, the line-of-sight detection unit detects a user's eyes from image data captured by a camera, and calculates a point of interest that is an intersection of the user's line of sight and the touch panel. The line-of-sight detection unit 11 determines whether the attention point is in the touch panel screen and whether there is an operation key at the attention point. May be detected.

  The timer unit 12 measures the user's lost time from when the line-of-sight detection unit 11 detects the line of sight until the operation key is operated. Specifically, the timer unit 12 includes a first timer unit 121 and a second timer unit 122. As shown in FIG. 2, the first time measuring unit 121 measures the stray time (first stray time) from when the line of sight to the screen of the touch panel is detected until the operation key in the screen is operated. The second time measuring unit 122 measures a stray time (second stray time) from when the line of sight to the operation key in the screen is detected until the operation key is operated. That is, the first lost time is the lost time for the entire screen, and the second lost time is the lost time for the operation keys. The first timekeeping unit 121 and the second timekeeping unit 122 accumulate the measured first lost time and second lost time in the storage unit 15, respectively.

  The communication unit 13 has a function of transmitting / receiving various data to / from an external terminal via a network such as a LAN (Local Area Network).

  The storage unit 15 is a storage unit such as a semiconductor memory or an HDD (Hard Disk Drive), and stores the image data read by the document reading unit 16 and the image data received through the communication unit 13. It is.

  The document reading unit 16 emits light to a document fed by a document feeder (not shown) or a document placed on a platen glass by a user, and receives the reflected light to generate a document image. It is a scanner that reads and outputs image data.

  The image processing unit 17 is a unit that performs image processing on image data. In the image processing unit 17, for example, image improvement processing such as enlargement / reduction processing, density adjustment, and gradation adjustment is performed.

  The printing unit 18 is a printing unit that prints image data. For example, the printing unit 18 forms a latent image on the surface of the photosensitive drum based on the image data read from the storage unit 15, performs image formation using the latent image as a toner image with toner, and feeds it from a paper feeding unit (not shown). The toner image on the photosensitive drum is transferred to the conveyed recording paper, and the toner image is fixed on the recording paper and discharged.

  The control unit 14 is connected to the operation panel 10, the line-of-sight detection unit 11, the timing unit 12, the communication unit 13, the storage unit 15, the document reading unit 16, the image processing unit 17, and the printing unit 18, and is input from the operation panel 10. The operation control of the entire image forming apparatus 100 is executed in accordance with the designated information. The control unit 14 is an information processing unit such as a microcomputer including a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The ROM stores a control program for performing operation control of the image forming apparatus 100. The control program includes an operation support program for displaying help information by detecting a user's ambiguity in the present embodiment. The control unit 14 reads the control program stored in the ROM and develops the control program in the RAM, thereby controlling the entire apparatus according to the instruction information input from the operation panel 10. The control program may be stored in the ROM via a network (not shown) or a computer-readable recording medium (not shown).

Further, the control unit 14 calculates the standard deviation (σ) of the stray time accumulated in the storage unit 15, monitors the stray time being measured by the time measuring unit 12, and the stray time being measured varies in the positive direction. It functions as a hesitation determining unit 141 that determines whether or not the allowable range is exceeded. The allowable variation range in the positive direction may be set in advance, and may be, for example, the average value of stray times + 3σ. In addition, the user may be able to set the allowable variation range in the positive direction. If the measurement time during measurement exceeds the allowable variation range in the positive direction, it is determined that the user is confused about the operation, and help information is displayed. In addition, the ambiguity determination unit 141 calculates an average value and a standard deviation (σ ₁ , σ ₂ ) for each of the first ambiguity time and the second ambiguity time, and is measuring as shown in FIG. If the first stray time exceeds a positive variation permissible range (average value of first stray time + 3σ ₁ ) (first permissible range), or as shown in FIG. It is determined whether the second stray time has exceeded a positive variation allowable range (average value of second stray times + 3σ ₂ ) (second permissible range).

  In the case where the stray time during measurement exceeds the allowable range of variation in the positive direction, the touch panel displays, for example, a “refer to help information” button 80 as shown in FIG. Encourage users to get help. When the “refer to help information” button is pressed, for example, a help screen 81 shown in FIG. 5 is displayed, and the user can check various operation methods. In addition, for example, in the case of a job setting screen, it is recommended to switch to the workflow view where the screen transitions according to the setting procedure, or to switch to a screen where functions can be selected from the realized image. In addition, when a file search is in progress or a preview or trial copy is recommended, a search or filtering method may be displayed. The touch panel may display the help information with different contents depending on whether the lost time exceeding the variation allowable range is the first lost time or the second lost time. This is because the content of the lost time is different between the first lost time indicating the time lost to the operation of the entire screen and the second lost time indicating the time lost to operate the operation keys.

Next, with reference to FIG. 6, the flow of processing for detecting a nuisance according to the user will be described. The stray determination unit 141 uses the first stray time standard deviation σ ₁ and the second stray time standard deviation based on the first stray time and the second stray time accumulated in the storage unit 15. calculating σ ₂ and obtaining a first allowable range (average value of first stray time + 3σ ₁ ) and a second permissible range (average value of second stray time + 3σ ₂ ) And

  First, the line-of-sight detection unit 11 determines whether or not the user has seen the screen (step s11). If the user has not seen the screen (No in step s11), the process returns to step s11. When the gaze detection unit 11 detects that the user has seen the screen (Yes in step s11), the first time measuring unit 121 starts measuring the first stray time (step s12).

  Subsequently, the line-of-sight detection unit 11 determines whether or not the user has seen the operation key (step s13). If the user has not seen the operation key (No in step s13), the hesitation determination unit 141 is measuring. It is determined whether or not the first stray time exceeds the first allowable range (step s14).

  If the first stray time does not exceed the first allowable range (No in step s14), the line-of-sight detection unit 11 determines whether or not the line of sight is off the screen (step s15). If the line of sight is not deviated from the screen (No in step s15), the process returns to step s13. On the other hand, when the line of sight deviates from the screen (Yes in step s15), the first time measuring unit 121 stops measuring the first stray time and resets the measurement value (step s17), and detects the line of sight with respect to the screen. The process returns to step s11.

  On the other hand, when the first stray time exceeds the first allowable range (Yes in step s14), the touch panel displays help information related to the screen operation (step s16). When the touch panel displays help information, the first time measuring unit 121 stops the measurement of the first lost time, resets the measurement value (step s17), and returns the process to step s11. In this case, when the user returns his / her line of sight to the screen, the first lost time is newly measured.

  On the other hand, when the gaze detection unit 11 detects that the user has viewed the operation key in the screen (Yes in step s13), the second time measurement unit 122 starts measuring the second stray time (step s18) It is determined whether the operation key is pressed by the touch panel (step s19).

  When the operation key is not pressed (No in step s19), the determination unit 141 determines whether the second determination time during measurement exceeds the second allowable range (step s20). If the second stray time does not exceed the second allowable range (No in step s20), the line-of-sight detection unit 11 determines whether or not the line of sight has deviated from the operation key (step s21). If the line of sight is not deviated from the operation key, that is, if the operation key is being watched (No in step s21), the process returns to step s19 for determining whether the operation key is pressed. On the other hand, when the line of sight deviates from the operation key (Yes in step s21), the second time measuring unit 122 stops the measurement of the second lost time and resets the measured value (step s22). The process returns to step s14 where it is determined whether the time exceeds the second allowable range.

  On the other hand, when the second stray time exceeds the second allowable range (Yes in step s20), the touch panel displays help information related to the operation keys (step s23). When the help information regarding the operation key is displayed, the measurement of the first stray time by the first time measuring unit 121 and the measurement of the second stray time by the second time measuring unit 122 are stopped, and the respective measured values are displayed. The process is reset (step s24), and the process returns to step s11 for detecting the line of sight with respect to the screen.

  On the other hand, when it is detected that the operation key is pressed by the touch panel (Yes in step s19), the first time measuring unit 121 and the second time measuring unit 122 respectively measure the first lost time and the second time measuring unit. The measurement of the lost time is terminated and the measurement value is reset (step s25), and the measured first lost time and the second lost time are stored in the storage unit 15 (step s26). Subsequently, the control unit 14 performs a process according to the pressed operation key (step s27), and the process ends.

  As described above, the image forming apparatus 100 measures and accumulates, for each user, the user's lost time from when the line of sight to the screen of the touch panel or the operation key is detected until the operation key is pressed. When the time exceeds the allowable range of variation in the positive direction, it is determined that the user is confused about the operation, and help information is displayed. Therefore, according to the present embodiment, it can be determined whether or not the user is more lost than usual, and help information can be displayed according to the user's lost time. In addition, even when a plurality of users use the image forming apparatus 100 at a workplace or the like, it is possible to determine whether or not the user is at a loss for the operation according to each user. Note that login authentication can be used to identify individual users.

  The present invention is not limited to the above-described embodiment, and it goes without saying that various changes can be made without departing from the spirit of the present invention.

  For example, the image forming apparatus 100 measures and accumulates the first stray time and the second stray time for each screen hierarchy and each function, and whether or not the user is lost in operation according to the screen hierarchy or function. May be determined. This is because the operation contents vary depending on the screen hierarchy and functions. When it is necessary to check a long-time image such as a preview, the measurement of the first stray time and the second stray time may be stopped.

Further, the hesitation determination unit 141 determines whether the user is confused about the operation based on the most recent specific number of times, for example, several times or several tens of times of the first hesitation time and the second hesitation time. Also good. This is because if the number of specimens is too large, it is difficult to detect that the user is confused about the operation when the user operates a function that is not normally operated. Note that the default values of the first lost time and the second lost time may be stored in the storage unit 15 in order to use the image forming apparatus 100 without performing an initial operation or logging in.
In the above embodiment, the allowable variation range in the positive direction is the average value of the lost time + 3σ, but may be the average value of the lost time + 2σ or the average value of the lost time + σ.

  In the above-described embodiment, the image forming apparatus 100 is described as an example of an electronic device, but may be applied to an electronic device including a touch panel such as a smartphone or a tablet terminal.

DESCRIPTION OF SYMBOLS 10 Operation panel 11 Eye-gaze detection part 12 Timing part 13 Communication part 14 Control part 15 Storage part 16 Document reading part 17 Image processing part 18 Printing part 80 Button 81 Help screen 100 Image forming apparatus 121 1st time measuring part 122 2nd time measuring Part 141 Lost judgment part

Claims (8)

A touch panel that displays a plurality of operation keys in the screen and receives operations on the operation keys;
A sight line detecting section for detecting the line of sight with respect to the touch panel,
A timer unit for measuring the stray time from the sight line detection unit detects the sight line to said operation key or until the line of sight is out is operated for each user,
A hesitation determination unit that determines that the user is at a loss of operation when the stray time during measurement in the time measurement unit exceeds a permissible variation range in the positive direction ,
The lost time is
A first stray time from when the line of sight to the screen is detected until the line of sight departs from the screen or until the operation key is operated;
An electronic device , comprising: a second stray time from when a line of sight to the operation key is detected until the line of sight deviates from the operation key or until the operation key is operated . The timing unit is
A first clock section for measuring a pre-Symbol first lost time,
And a second clock section for measuring a pre-Symbol second lost time,
When the stray time during the measurement is the first stray time, the user is lost in the operation of the screen when the first variation allowable range in the positive direction is exceeded. When the measurement time during measurement is the second time, the user is lost in the operation of the operation key when the second variation allowable range in the positive direction is exceeded. The electronic device according to claim 1, wherein the electronic device is determined to be. The electronic device according to claim 1, wherein the hesitation determination unit determines whether the user is confused about an operation based on the hesitation time measured for each screen hierarchy. The electronic device according to any one of claims 1 to 3, wherein the hesitation determination unit determines whether the user is confused about an operation based on the hesitation time measured for each function. 5. The electronic device according to claim 1, wherein the hesitation determination unit determines whether the user is lost in an operation based on the most recent number of times of hesitation. The electronic device according to any one of claims 2 to 5, wherein the touch panel varies help information to be displayed according to whether the first lost time or the second lost time. . The hesitation determination unit
Between the time when the line of sight with respect to the operation key is detected and the time when the line of sight with respect to the operation key is disengaged from the operation key, based on the first lost time, it is not determined whether the user is lost in operation,
7. The device according to claim 1, wherein while the second lost time is being measured, it is determined whether or not the user is lost in operation based on the second lost time . Item 1. An electronic device according to item 1. Electronic equipment,
An operation receiving step of displaying a plurality of operation keys in the screen and receiving an operation on the operation keys by a touch panel ;
And line-of-sight detection step of detecting a line of sight with respect to the touch panel,
Time measuring step of measuring the stray time from the sight line detection step detects the line of sight to the operation key is operated or until the line of sight is out for each user,
When the stray time during measurement in the time measuring step exceeds a specific positive variation permissible range, a stray determination step for determining that the user is strayed is performed .
The lost time is
A first stray time from when the line of sight to the screen is detected until the line of sight departs from the screen or until the operation key is operated;
A second stray time from when the line of sight to the operation key is detected until the line of sight deviates from the operation key or until the operation key is operated.
An operation support program characterized by that .

Images