JP2010049432A - Display screen control device and method thereof, and information processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To efficiently recognize an input voice, and to improve operability in voice input by reducing the number of times that a user speaks until a desired display screen is displayed. <P>SOLUTION: A voice recognition part 23 sets a dictionary table DA to be referred when recognizing a voice for each display screen of a hierarchical structure displayed on a display part 11, and stores them in a storage device 22. The dictionary table DA for each display screen includes a first recognition candidate group for successively shifting the display screen of the display part 11 to the screen of a lower layer according to the hierarchical structure, and a second recognition candidate group for directly shifting the display screen of the display part 11 to a specific screen without following the hierarchical structure. A control part 24 is configured to shift the display screen on the display part 11 to the specific screen when the voice recognized by the voice recognition part 23 is included in the second recognition candidate group. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a display screen control apparatus and method, and an information processing apparatus that hold a plurality of display screens to be displayed on a display unit in a hierarchical structure, and change the display screen in the display unit according to the hierarchical structure.

  2. Description of the Related Art Conventionally, an information processing apparatus called a multifunction peripheral or an MFP (Multi Function Peripheral) includes an operation panel that can be operated by a user, and the operation panel is provided with a display unit such as a liquid crystal display device. Various information is displayed to the user in each mode such as copy mode, FAX mode, and scanner mode, for example, and the user operates the operation panel while viewing the display screen displayed on the display unit. In addition, it is possible to check the setting state and change the setting in each mode. In this case, the display screen displayed on the display unit of the operation panel holds a plurality of screens in a hierarchical structure in consideration of ease of user operation. Then, the display screen of each hierarchy is configured, for example, as a screen configuration in which selection items that can be selected by the user are arranged in a menu format, so that the user can perform a selection operation on each display screen of the hierarchical structure, so that the desired lowest layer You can get to the settings confirmation screen and setting change screen.

  Incidentally, in recent years, voice input devices are becoming popular as input devices for various information devices. For example, when performing voice recognition, a voice input from a plurality of recognition candidates is specified by referring to a dictionary table or the like. The techniques are known (for example, Patent Documents 1, 2, and 3). Therefore, such voice recognition technology is also applied to information processing apparatuses such as the above-described multifunction peripherals and MFPs, and input to the operation panel is performed by voice input even when the user's hand using the information processing apparatus is blocked. It is desired to be able to In this case, by performing voice input to the operation panel in the information processing apparatus, the display screen of the display unit is sequentially shifted to the lower layer screen in the same manner as when the user directly operates the operation panel with a finger. It becomes possible to go.

JP-A-8-202387 Japanese Patent Laid-Open No. 10-307039 Japanese Patent Laid-Open No. 11-337363

  When applying speech recognition technology to an information processing device, if only one dictionary table is prepared for reference during speech recognition, the number of recognition candidates included in the dictionary table will be enormous. It takes time to specify the input speech, and speech recognition cannot be performed efficiently.

  In addition, the voice input to the operation panel enables the display screen of the display unit to be sequentially shifted to the lower layer screen in the same manner as when the user directly operates the operation panel with a finger. If the display screen in the screen is shifted to the lower layer screen one screen at a time according to the hierarchical structure, the number of times the user utters the operation panel before reaching the lowest layer screen desired is increased, and the utterance is troublesome. There is a problem of becoming.

  Therefore, the present invention has been made in view of the above-described problems, and allows the user to efficiently perform the recognition processing of the input voice and before the user displays a desired display screen. The present invention provides a display screen control device, a method thereof, and an information processing device in which the operability by voice input is improved so that the number of utterances can be reduced.

  In order to achieve the above object, the invention according to claim 1 has display means for displaying various information, holds a plurality of display screens displayed on the display means in a hierarchical structure, and the display means according to the hierarchical structure. A display screen control apparatus for transitioning a display screen in which a speech input means for inputting speech and a dictionary table in which recognition candidate groups for recognizing input speech input to the speech input means are registered. Storage means for storing each display screen having a hierarchical structure, and the dictionary table corresponding to the display screen of the display means are read from the storage means, and the speech is selected from the recognition candidate group registered in the read dictionary table. A voice recognition unit for recognizing an input voice input to the input unit; and a display screen on the display unit based on the voice recognized by the voice recognition unit. A first recognition candidate group for sequentially transitioning the display screen of the display means to a lower layer screen according to the hierarchical structure, and the dictionary table according to the hierarchical structure. And a second recognition candidate group for directly transitioning the display screen of the display means to a specific screen, and the control means receives the voice recognized by the voice recognition means as the second recognition group. If the voice is included in the recognition candidate group, the display screen of the display means is changed to the specific screen.

  According to a second aspect of the present invention, in the display screen control apparatus according to the first aspect, the second recognition candidate group is a recognition candidate group that causes the display screen of the display means to transition to a lowermost screen in the hierarchical structure. And when the voice recognized by the voice recognition means is a voice included in the second recognition candidate group, the control means displays the display screen on the display means based on the recognized voice. It is characterized by making a transition to the screen.

  The invention according to claim 3 is the display screen control device according to claim 1 or 2, wherein the dictionary table corresponding to the display screen at the lowest layer in the hierarchical structure includes the second recognition candidate group as the second recognition candidate group. The recognition means for transitioning the display screen of the display means to another screen of the lowest layer in the hierarchical structure is included, and the control means is configured to display the sound when the display screen of the display means is the lowermost screen. If the voice recognized by the recognition means is a voice included in the second recognition candidate group, the display screen on the display means is changed to another screen on the lowest layer based on the recognized voice. It is said.

  According to a fourth aspect of the present invention, in the display screen control apparatus according to any one of the first to third aspects, when the control means transitions the display screen on the display means, screen information relating to the display screen before the transition. Is stored and saved, and when the voice recognized by the voice recognition means is a voice instructing to return to the display screen before transition, the screen information is read and the display screen on the display means is changed to It is characterized by a transition to the screen.

  According to a fifth aspect of the present invention, in the display screen control device according to any one of the first to fourth aspects, the control means stores and saves the setting information customized by the user and When the setting information name to be set is registered for the second recognition candidate group, and the voice recognized by the voice recognition unit is the setting information name registered in the second recognition candidate group The display screen of the display means is changed to a screen reflecting the setting information.

  According to a sixth aspect of the present invention, in the display screen control apparatus according to any one of the first to fifth aspects, a hierarchical structure of a plurality of display screens displayed on the display means is provided in the display means in the first mode. The dictionary having a first hierarchical structure for displaying and a second hierarchical structure for displaying on the display means in the second mode and corresponding to a display screen included in the first hierarchical structure The second recognition candidate group of the table includes a recognition candidate that causes the display screen of the display means to transition to a specific display screen included in the second hierarchical structure, and the control means When the speech recognized by the recognition unit is a recognition candidate for transitioning to a specific display screen included in the second hierarchical structure, the first mode display screen displayed on the display unit It is characterized by causing a transition to a particular display screen of the second mode.

  The invention according to claim 7 is a display screen control method for holding a plurality of display screens to be displayed on the display means in a hierarchical structure, and for transitioning the display screens in the display means according to the hierarchical structure. A voice input step for inputting voice via voice input means, and a dictionary table corresponding to the display screen of the display means are read from a predetermined storage means, and the recognition candidate group registered in the read dictionary table is A speech recognition step for recognizing an input speech input to the speech input means; and a control step for transitioning a display screen on the display means based on the speech recognized by the speech recognition means. A first recognition candidate group for sequentially changing the display screen of the display means to a lower layer screen according to the hierarchical structure, and according to the hierarchical structure Includes a second recognition candidate group for directly transitioning the display screen of the display means to a specific screen, and the control step is configured such that the voice recognized in the voice recognition step is the second recognition candidate group. When the voice is included in the recognition candidate group, the display screen of the display unit is changed to the specific screen.

  The invention according to claim 8 further includes an operation panel having display means for displaying various information and operation input means that can be manually operated by a user, and holds a plurality of display screens displayed on the display means in a hierarchical structure. And an information processing apparatus for sequentially changing the display screen on the display means from the uppermost screen to the lower layer screen according to the hierarchical structure each time manual operation is performed on the operation input means. Voice input means, a storage means for storing a dictionary table in which a recognition candidate group for recognizing the input voice input to the voice input means is registered for each display screen of the hierarchical structure, and a display screen of the display means The dictionary table corresponding to is read from the storage means and input to the speech input means from the recognition candidate group registered in the read dictionary table Voice recognition means for recognizing the input voice, and control means for transitioning the display screen on the display means based on the voice recognized by the voice recognition means, the dictionary table according to the hierarchical structure A first recognition candidate group for sequentially transitioning the display screen of the display means to a lower layer screen, and for directly transitioning the display screen of the display means to a specific screen without following the hierarchical structure And when the voice recognized by the voice recognition means is a voice included in the second recognition candidate group, the control means displays a display screen on the display means. It is characterized by making a transition to the specific screen.

  According to the present invention, a dictionary table in which recognition candidate groups for recognizing input speech input to the speech input means are stored for each display screen having a hierarchical structure, so that recognition when recognizing input speech is performed. The number of recognition candidates included in the candidate group can be suppressed, and speech recognition processing can be performed efficiently. Further, the dictionary table for each display screen includes a first recognition candidate group for sequentially changing the display screen of the display unit to a lower layer screen according to the hierarchical structure, and the display of the display unit without following the hierarchical structure. A second recognition candidate group for directly transitioning the screen to a specific screen, and when the voice recognized by the voice recognition is a voice included in the second recognition candidate group, display means Therefore, the number of times the user utters before the display screen desired by the user is displayed can be reduced, and the operability by voice input is improved.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. In the embodiments described below, members common to each other are denoted by the same reference numerals in each drawing, and repeated descriptions thereof are omitted.

  FIG. 1 is a perspective view illustrating an example of an external configuration of the information processing apparatus 1 according to the present embodiment. The information processing apparatus 1 is an apparatus referred to as a so-called multifunction machine or MFP, and has a plurality of functions such as a copy function, a FAX function, a printer function, and a scanner function. The information processing apparatus 1 is connectable to a network such as a LAN, outputs image data read from a document to another computer via the network, or inputs image data from another computer via the network. Print output can be performed based on the image data. In addition, the information processing apparatus 1 can be connected to a communication network such as a telephone line, and can transmit and receive FAX data via the communication network.

  The information processing apparatus 1 is provided with a scanner unit 2 for reading a document at the upper part of the apparatus main body 1 a, and further provided with an automatic document feeder (so-called ADF) 3 at the upper part of the scanner part 2. Therefore, for example, when the information processing apparatus 1 is instructed to read a document in a state where a plurality of documents are set on the automatic document feeder 3, the automatic document feeder 3 reads the plurality of documents one by one in the scanner unit. The scanner unit 2 reads the document and outputs image data.

  A printer unit 4 is provided in the approximate center of the apparatus main body 1 a of the information processing apparatus 1, and a paper feeding unit 5 is provided below the printer unit 4. The paper supply unit 5 stores a plurality of sheets as image forming media, and supplies the sheets to the printer unit 4 one by one. The printer unit 4 forms an image on the sheet fed from the sheet feeding unit 5 based on the input image data, and discharges the image-formed sheet from the sheet discharge port 6 to be placed on the printer unit 4. The paper discharge unit 7 is configured to be sequentially stacked.

  Furthermore, an operation panel 10 that can be operated by the user is provided on the front side (front side) of the apparatus main body 1a of the information processing apparatus 1. The user can log in to the information processing apparatus 1 by operating the operation panel 10. Further, the user operates the operation panel 10 to select a function to be used from among a plurality of functions of the information processing apparatus 1, perform various setting operations regarding the selected function, and perform the operation on the information processing apparatus 1. The job execution can be instructed.

  FIG. 2 is an enlarged view showing the operation panel 10 of the information processing apparatus 1. The operation panel 10 has a configuration in which a panel body 10a supported by the apparatus body 1a of the information processing apparatus 1 and an operation section 10b protruding from the lower side of the panel body 10a to the front side (front side) are integrally formed. It is. A display unit 11 configured by a liquid crystal display device or the like and capable of color display is provided in the approximate center of the panel body 10a, and a touch panel key 12 is disposed on the surface of the display unit 11. Further, a plurality of push button type operation keys 13 are provided around the display unit 11 in the panel body 10a and on the upper surface of the operation unit 10b. The touch panel keys 12 and the operation keys 13 are operation input means for a user to perform a manual input operation on the information processing apparatus 1 by directly operating with a hand or a finger. Therefore, the user can perform various input operations on the information processing apparatus 1 by manually operating the touch panel keys 12 and the operation keys 13 with a fingertip while referring to the display screen displayed on the display unit 11. it can.

  The plurality of operation keys 13 include a copy key 13a, a FAX / scan key 13b, a help key 13c, and a program key 13d. The copy key 13a is an operation key for the user to select the copy function and operate the information processing apparatus 1 in the copy mode. The FAX / scan key 13b is an operation key for the user to select the FAX function or the scanner function and operate the information processing apparatus 1 in the copy / scan mode. The help key 13c is an operation key for selecting and operating the information processing apparatus 1 in the help mode when the user is uncertain of operations and terms related to various functions. When the user manually operates the touch panel key 12 or the operation key 13 to customize the setting state in the information processing apparatus 1, the program key 13d registers the setting information in the information processing apparatus 1 as customization setting information, This is an operation key for calling setting information registered in advance.

  One end of an L-shaped support arm 14 is attached to the side surface of the operation unit 10 b of the operation panel 10, and a voice input device 15 such as a microphone is provided on the other end of the support arm 14. As shown in FIG. 2, the support arm 14 is rotatable in the R direction with respect to the operation panel 10, and rotates the voice input device 15 in the front-rear direction with respect to the operation panel 10. The voice input device 15 can be held at the position. When the user's voice is input via the voice input device 15, the information processing apparatus 1 is configured to change the display screen on the display unit 11 to another screen based on the input voice.

  Here, the configuration of the display screen displayed on the display unit 11 of the operation panel 10 in the information processing apparatus 1 will be described. The information processing apparatus 1 holds a plurality of display screens in a hierarchical structure as display screens of the display unit 11 that displays various types of information. FIG. 3 is a diagram showing a configuration example of the display screen in the help mode and the copy mode. As shown in FIG. 3, the information processing apparatus 1 holds a plurality of display screens in a hierarchical structure in each of the help mode and the copy mode.

  For example, in the help mode, a plurality of display screens A21, A22,... Transitioning from the display screen A10 are provided in the first intermediate layer one layer below the display screen A10 of the uppermost layer. In the second intermediate layer one layer below the display screen A21, a plurality of display screens A31, A32,... That transition from the display screen A21 are provided. A plurality of display screens A41, A42,... Transitioning from the display screen A31 are provided in the lower layer. It should be noted that a plurality of display screens are provided in the lower layer of the other display screens A22,... Of the first intermediate layer, and a plurality of display screens are provided in the lower layers of the other display screens A32,. However, these are not shown in the figure.

  In the copy mode, as in the help mode, a plurality of display screens B21, B22,... That transition from the display screen B10 are provided in the first intermediate layer one layer below the uppermost display screen B10. . In addition, a plurality of display screens B31, B32,... Transitioning from the display screen B21 are provided in the second intermediate layer one layer below the display screen B21. A plurality of display screens B41, B42,... Transitioning from the display screen B31 are provided in the lower layer. It should be noted that a plurality of display screens are provided in a lower layer of the other display screens B22,... Of the first intermediate layer, and a plurality of display screens are provided also in a lower layer of the other display screens B32,. However, these are not shown in the figure. FIG. 3 shows only the help mode and copy mode, but the same applies to other FAX / scan modes. Further, FIG. 3 illustrates the case where the display screen in each mode has four layers, but the number of layers is not particularly limited as long as it is three or more layers.

  In the present embodiment, the uppermost display screen B10 in the copy mode is set as the initial screen of the display unit 11. For example, when the user logs in to the information processing apparatus 1, the display unit 11 of the operation panel 10 displays the copy mode. A display screen B10 which is a top screen is displayed. However, it is also possible to set a top screen (uppermost layer screen) of another mode (for example, copy / scan mode) as the initial screen of the operation panel 10. If the user operates the above-described FAX / scan key 13b, help key 13c, or the like while the initial screen is displayed on the display unit 11, the information processing apparatus 1 shifts to each mode, and the operation panel 10 The display unit 11 displays a display screen of the top layer of the hierarchical structure in each mode.

  In the screen configuration as described above, for example, when the user operates the touch panel key 12 or the operation key 13 in a state where the uppermost display screens A10 and B10 in each mode are displayed on the display unit 11 of the operation panel 10, As shown by the solid line arrows in the figure, the display screen of the display unit 11 transitions to the first intermediate layer display screens A21, A22,... Or B21, B22,. Further, when the user operates the touch panel key 12 or the operation key 13 while the display screens A21 and B21 of the first intermediate layer are displayed on the display unit 11 of the operation panel 10, the display is performed as indicated by a solid line arrow in the figure. The display screen of the unit 11 transitions to the second intermediate layer display screen A31, A32,... Or B31, B32,. Further, when the user operates the touch panel key 12 or the operation key 13 while the second intermediate layer display screens A31 and B31 are displayed on the display unit 11 of the operation panel 10, the display is performed as indicated by solid arrows in the figure. The display screen of the section 11 transitions to the lowermost display screen A41, A42,... Or B41, B42,. As described above, when the user directly manually operates the touch panel key 12 or the operation key 13 of the operation panel 10, the information processing apparatus 1 changes the display screen of the display unit 11 to a lower layer display screen one layer at a time according to the hierarchical structure. Transition.

  On the other hand, when the user inputs voice to the voice input device 15, the information processing apparatus 1 performs voice recognition processing, and if necessary, the display screen of the display unit 11 on the operation panel 10 based on the recognized voice. Transition. In the present embodiment, two patterns are set as transition patterns of the display screen by voice input. As in the case where the touch panel key 12 and the operation key 13 are directly manually operated, the first transition pattern is displayed on the display screen of the display unit 11 one layer at a time according to the hierarchical structure, as indicated by a solid line arrow in FIG. This is a pattern for transition to the display screen. In addition, as shown by the broken line arrow in FIG. 3, the second transition pattern does not follow the hierarchical structure of the display screen of the display unit 11, skips one or more intermediate layers, and directly specifies a specific screen at the lowest layer. It is a pattern to make transition to. Further, when voice input is performed in a state where the lowermost display screen A41 is displayed on the display unit 11 of the operation panel 10, the second transition pattern does not return to the upper layer display screen, and the other mode in the same mode. It is possible to make a direct transition to the lowermost display screen A42 and to make a direct transition to the lowermost display screen B41 in another mode.

  FIG. 4 is a block diagram illustrating an example of a control mechanism for performing the above-described display screen control in the information processing apparatus 1. As shown in FIG. 4, the information processing apparatus 1 includes a display screen control unit 20 that controls the display screen of the display unit 11 provided on the operation panel 10, and a job control unit that controls the execution of various jobs in the information processing apparatus 1. 29, and the display screen control unit 20 is configured to send a command to the job control unit 29 based on a job setting or execution command input by the user. By controlling the driving of the scanner unit 2 and the printer unit 4 based on commands input from the screen control unit 20, the execution of jobs in the copy mode and FAX / scan mode is controlled. The display screen control unit 20 may be provided with all the constituent members inside the operation panel 10, or a part of the constituent members may be provided inside the apparatus main body 1 a of the information processing apparatus 1.

  The display screen control unit 20 includes the display unit 11, the touch panel key 12, the operation key 13, and the voice input device 15 provided on the operation panel 10. Furthermore, the display screen control unit 20 analyzes a voice input from the voice input device 15 and a CPU 21 that executes various processes based on input signals from the touch panel keys 12, the operation keys 13, or the voice analysis unit 16. And a storage device 22 for storing various types of information composed of storage means such as a semiconductor memory and a magnetic disk device.

  The voice analysis unit 16 performs A / D conversion, filtering, and the like on the signal input from the voice input device 15, and outputs a voice signal obtained by extracting only the voice component of the user to the CPU 21. The CPU 21 executes a predetermined program, thereby recognizing the input speech uttered by the user based on the speech signal extracted by the speech analysis unit 16, and the input specified by the speech recognition unit 23. It functions as a control unit 24 that executes processing according to voice. The control unit 24 functions as a process specifying unit 25 and a process execution unit 26, and the process execution unit 26 is further configured to function as a setting registration unit 26a. The process specifying unit 25 is a processing unit for specifying a process associated with the input voice specified by the voice recognition unit 23, and the process executing unit 26 is a processing unit for executing the specified process.

  The storage device 22 includes a dictionary table DA that is referred to when the voice recognition unit 23 recognizes the input voice, and a process specification table DB that is referred to when the process specifying unit 25 specifies a process corresponding to the recognized input voice. Is stored, and an information storage unit 27 is provided as a storage area for storing various other information.

  The dictionary table DA is composed of a plurality of table data set for each display screen having a hierarchical structure, and a recognition candidate group for recognizing input speech corresponding to each display screen is registered in each table data. . Therefore, when the voice recognition unit 23 inputs a voice signal from the voice analysis unit 16, the voice recognition unit 23 reads the dictionary table DA corresponding to the display screen displayed on the display unit 11 from the storage device 22, and registers the dictionary table DA in the read dictionary table DA. The input voice input to the voice input device 15 is recognized from the recognized recognition candidate group.

  Similarly to the dictionary table DA, the processing specification table DB is composed of a plurality of table data set for each display screen having a hierarchical structure, and each table data includes a recognized voice and a corresponding voice corresponding to each display screen. , Information in which processing to be executed is associated with each other is registered. Therefore, when the voice identified by the voice recognition unit 23 is input, the process identification unit 25 reads the process identification table DB corresponding to the display screen displayed on the display unit 11 from the storage device 22, and the read process identification is performed. A process corresponding to the voice recognized based on the information registered in the table DB is specified. The process specifying unit 25 also receives input signals from the touch panel keys 12 and the operation keys 13, and when the user operates the touch panel keys 12 and the operation keys 13, the process specifying unit 25 also specifies a process corresponding to the operation. Can be done. When the process specifying unit 25 specifies a process to be executed as described above, the process specifying unit 25 notifies the process execution unit 26 of the contents of the process and sends a process execution command.

  When the execution command is input from the process specifying unit 25, the process execution unit 26 executes a process specified based on the content of the process received together with the execution command. For example, when the content of the process specified by the process specifying unit 25 is a process of changing the display screen of the display unit 11, the process executing unit 26 specifies the display screen displayed on the display unit 11 from the process specifying unit 25. Screen transition is performed by updating to the displayed screen. In addition, when the process execution unit 26 changes the display screen of the display unit 11, the process execution unit 26 sends the screen information G <b> 2 related to the display screen before the transition to the storage device 22, and stores and saves it in the screen information storage unit 27 a of the information storage unit 27. When the process specifying unit 25 instructs to return the display screen of the display unit 11 to the display screen before the transition, the process execution unit 26 reads the screen information G2 from the information storage unit 27 of the storage device 22, and displays the display unit. The display screen in 11 is changed to the screen before the transition to return to the original display screen.

  The process execution unit 26 is configured to feed back the screen information G1 related to the display screen displayed on the display unit 11 to the voice recognition unit 23 and the process specifying unit 25 when the display screen of the display unit 11 is changed. Has been. Therefore, the voice recognition unit 23 reads the dictionary table DA from the storage device 22 based on the screen information G1 fed back from the process execution unit 26, thereby corresponding to the display screen displayed on the display unit 11. It becomes possible to refer to the dictionary table. In the process specifying unit 25, the process specifying table DB is read from the storage device 22 based on the screen information G1 fed back from the process executing unit 26, thereby corresponding to the display screen displayed on the display unit 11. It becomes possible to refer to the process specific table.

  Further, when the content of the process specified by the process specifying unit 25 is a process of registering the customization setting information input by the user, the process execution unit 26 causes the setting registration unit 26a to function and the setting information G3 customized by the user. Is sent to the storage unit 22 and stored in the setting information storage unit 27b of the information storage unit 27. When the user assigns an arbitrary setting information name to the setting information G3 customized by the user, the setting registration unit 26a stores the dictionary table DA and the processing specification table DB stored in the storage device 22, respectively. On the other hand, an item (character string) corresponding to the setting information name is additionally registered. Thereby, the voice recognition unit 23 can recognize the setting information name given by the user, and the process specifying unit 25 stores the setting information name given by the user in the information storage unit 27 as a process corresponding to the setting information name given by the user. A process for reading the setting information G3 and reflecting it in the information processing apparatus 1 can be specified.

  Further, the process execution unit 26 is configured to send a command for instructing the execution of the job to the job control unit 29 when the execution of the job is instructed from the process specifying unit 25.

  Next, an example of a specific operation in the information processing apparatus 1 configured as described above will be described. FIG. 5 is a diagram showing a configuration example of the hierarchical display screens A10, A21, A31, and A41 in the help mode. First, as shown in FIG. 5 (a), a plurality of selection items P11, P12, P13, and P14 that can be selected by the user are displayed in a menu format on the uppermost display screen A10 in the help mode. Different character strings are displayed in the selection items P11 to P14. For example, a character string “Search by function” is displayed in the selection item P11, and when the user performs an operation of directly pressing the selection item P11 with a finger or the like, the touch panel key 12 in that portion detects the character string and specifies the process. A detection signal is output to the unit 25. Based on this detection signal, the process specifying unit 25 recognizes that the selection item P11 has been pressed, and causes the process execution unit 26 to display the first intermediate layer display screen A21 corresponding to “search by function”. The execution command is sent. As a result, the display screen of the display unit 11 transitions from the display screen A10 shown in FIG. 5A to the display screen A21 one level below shown in FIG.

  On the display screen A21 shown in FIG. 5B, a plurality of selection items P21, P22, P23, P24, and P25 that can be selected by the user are displayed in a menu format. The selection items P21 to P24 include information processing devices. A character string corresponding to each function 1 is displayed. In the selection item P25, a character string “close” indicating that the display screen of the display unit 11 is returned to the previous screen is displayed. Here, for example, when the user directly presses the selection item P21 on which the character string “copy” is displayed with a finger or the like, the touch panel key 12 in that portion is detected, and a detection signal is output to the processing specifying unit 25. Based on this detection signal, the process specifying unit 25 recognizes that the selection item P21 has been pressed, and causes the process execution unit 26 to execute the process so as to display the second intermediate layer display screen A31 corresponding to “copy”. Send a command. As a result, the display screen of the display unit 11 transitions from the display screen A21 shown in FIG. 5B to the display screen A31 one level lower shown in FIG.

  In the display screen A31 shown in FIG. 5C, a plurality of selection items P31 to P38 that can be selected by the user are displayed in a menu format, and the selection items P31 to P37 include character strings such as various terms relating to the copy function. Is displayed. In the selection item P38, a character string “close” indicating that the display screen of the display unit 11 is returned to the previous screen is displayed. Here, for example, when the user directly presses the selection item P31 on which the character string “finished” is displayed with a finger or the like, the touch panel key 12 in that portion detects the selected item P31 and outputs a detection signal to the process specifying unit 25. Based on this detection signal, the process specifying unit 25 recognizes that the selection item P31 has been pressed, and sends a process execution command to the process execution unit 26 to display the lowermost display screen A41 corresponding to “finish”. Send it out. As a result, the display screen of the display unit 11 transitions from the display screen A31 shown in FIG. 5C to the lowermost display screen A41 shown in FIG.

  On the display screen A41 shown in FIG. 5D, a help information display column L1 related to “finish” selected by the user is displayed, and a description about “finish” is displayed in text inside the help information display column L1. Therefore, when the lowermost display screen A41 is displayed on the display unit 11, the user can obtain desired help information. A plurality of selection items P41 and P42 that can be selected by the user are displayed at the bottom of the display screen A41. The selection item P41 displays a character string “close” indicating that the display screen of the display unit 11 is returned to the previous screen, and the selection item P42 displays the display screen of the display unit 11 as the uppermost display screen A10. A character string “END” is displayed to indicate that it is to be returned to. Therefore, if the user presses the selection item P41, the display screen of the display unit 11 returns to the previous display screen A31. If the user presses the selection item P42, the display screen of the display unit 11 is the top screen in the help mode. Returning to the display screen A10 of FIG.

  As described above, when the user directly operates the operation panel 10 with a finger or the like, the front screen of the display unit 11 transitions to the lower-layer display screen one layer at a time according to the hierarchical structure shown in FIG. . On the other hand, when the user performs voice input to the voice input device 15, screen transition is performed based on the dictionary table DA stored in the storage unit 22, so that the display screen of the display unit 11 is displayed. According to the hierarchical structure, it is possible to transit to the lower layer display screen one layer at a time, and for example, it is possible to transit directly from an arbitrary display screen to the lowermost display screen.

  Here, the dictionary table DA and the processing specification table DB set for each display screen having a hierarchical structure will be described. 6 to 9 show the dictionary table DA and the process specification table DB set for each of the display screens A10, A21, A31, and A41 shown in FIG. First, FIG. 6 is a diagram showing a dictionary table DA10 corresponding to the uppermost display screen A10 and a process specifying table DB10. As shown in FIG. 6A, in the dictionary table DA10, the first recognition candidate group 31 corresponding to the selection items P11 to P14 (see FIG. 5) on the display screen A10 and the first items not corresponding to the selection items P11 to P14 are displayed. 2 recognition candidate groups 32 are included. In the first recognition candidate group 31, as in the case where the user directly operates the operation panel 10 with a finger or the like, the display screen of the display unit 11 is sequentially shifted to a lower layer screen according to the hierarchical structure. And a plurality of recognition candidates are included. These recognition candidates are the same character strings as the character strings of the plurality of selection items P11 to P14 displayed on the display screen A10. The second recognition candidate group 32 is a recognition candidate group for directly changing the display screen of the display unit 11 to the lowermost display screen without following the hierarchical structure. Includes a plurality of different recognition candidates. When the user inputs a voice to the voice input device 15 while the display screen A10 as shown in FIG. 5A is displayed on the operation panel 10, the voice recognition unit 23 includes a plurality of voices included in the dictionary table DA10. One input speech is identified from the recognition candidates.

  As shown in FIG. 6B, the process specification table DB 10 is a table in which the voice specified by the voice recognition unit 23 is associated with the process to be executed corresponding to the voice. The item column “recognized speech” includes the same character string as the recognition candidates included in the dictionary table DA10. In the process identification table DB 10, a first process table 41 including the same character strings as the first recognition candidate group 31 and a second process table 42 including the same character strings as the second recognition candidate group 32 are provided. ing. In the “execution process” column of the first process table 41, a process is set in which the display screen of the display unit 11 is sequentially shifted to the lower layer screen one layer at a time according to the hierarchical structure. In addition, as a process corresponding to “close”, a process for returning the display screen to the initial screen is set. In the “execution process” column of the second process table 42, a process for directly changing the display screen of the display unit 11 to the lowermost display screen without following the hierarchical structure is set.

  Therefore, when the display screen A10 as shown in FIG. 5A is displayed on the operation panel 10, for example, when the user inputs a voice “search by function”, the voice recognition unit 23 is included in the dictionary table DA10. A character string “search by function” is specified from the first recognition candidate group 31, and the process specifying unit 25 performs “display screen” as a process to be executed based on the specified character string (recognized voice). “Transition to A21” is specified. Then, when the specified processing is executed by the processing execution unit 26, the display unit 11 of the operation panel 10 transitions from the uppermost display screen A10 to the display screen A21 one level lower (see FIG. 5B). To do.

  On the other hand, when the display screen A10 as shown in FIG. 5A is displayed on the operation panel 10, for example, when the user inputs a voice “finished”, the voice recognition unit 23 is included in the dictionary table DA10. A character string “finished” is specified from the second recognition candidate group 31, and the process specifying unit 25 performs “to display screen A 41” as a process to be executed based on the specified character string (recognized voice). Is specified. Then, when the specified processing is executed by the processing execution unit 26, the display unit 11 of the operation panel 10 transitions from the uppermost display screen A10 to the lowermost display screen A41 (see FIG. 5D). .

  Next, FIG. 7 is a diagram showing the dictionary table DA21 corresponding to the display screen A21 of the first intermediate layer and the process specifying table DB21. As shown in FIG. 7 (a), the dictionary table DA21 is similar to the dictionary table DA10 described above, and the display screen of the display unit 11 is sequentially shifted to the lower layer screen one by one according to the hierarchical structure. 1 recognition candidate group 31 and a second recognition candidate group 32 for directly changing the display screen of display unit 11 to the lowermost display screen without following the hierarchical structure. Further, as shown in FIG. 7B, the processing specification table DB 21 also includes the first processing table 41 including the same character string as the first recognition candidate group 31 and the second processing specification table DB 10 as described above. A second processing table 42 including the same character string as the recognition candidate group 32 is provided, and a table in which a voice specified by the voice recognition unit 23 is associated with a process to be executed corresponding to the voice. It has become. Therefore, when the display screen A21 as shown in FIG. 5B is displayed on the operation panel 10, for example, when the user inputs the voice “copy”, the voice recognition unit 23 includes the first one included in the dictionary table DA21. The character string “copy” is identified from the recognition candidate group 31 of the recognition process, and the process identifying unit 25 performs “transition to display screen A31” as a process to be executed based on the identified character string (recognized speech). Is specified. When the specified processing is executed by the processing execution unit 26, the display unit 11 of the operation panel 10 causes the display screen A21 of the first intermediate layer to the display screen A31 of the second intermediate layer (see FIG. 5C). ). On the other hand, for example, when the user inputs the voice “finished”, the voice recognition unit 23 specifies the character string “finished” from the second recognition candidate group 31 included in the dictionary table DA21, and the process specifying unit 25 specifies “transition to display screen A41” as a process to be executed based on the specified character string (recognized voice). When the specified processing is executed by the processing execution unit 26, the display unit 11 of the operation panel 10 changes from the first intermediate layer display screen A21 to the lowermost display screen A41 (see FIG. 5D). Transition.

  When the user inputs a voice “Close” while the display screen A21 as shown in FIG. 5B is displayed on the operation panel 10, the voice recognition unit 23 performs the first recognition included in the dictionary table DA21. The character string “close” is specified from the candidate group 31, and the process specifying unit 25 performs “previous” as a process to be executed from the process specifying table DB 21 based on the specified character string (recognized voice). Specify “transition to screen”. Therefore, in this case, the process execution unit 26 reads the screen information G2 from the information storage unit 27 of the storage device 22, changes the display screen in the display unit 11 to the screen before the transition, and returns to the original display screen.

  Next, FIG. 8 is a diagram showing a dictionary table DA31 corresponding to the second intermediate layer display screen A31 (see FIG. 5C) and a process specifying table DB31. As shown in FIG. 8A, the dictionary table DA31 includes a first recognition candidate group 31 for sequentially shifting the display screen of the display unit 11 to a lower layer screen one layer at a time according to the hierarchical structure. Yes. In the present embodiment, since the display screen A31 of the second intermediate layer is located on one layer of the lowermost layer, if the display screen A31 is shifted down one layer, the screen of the lowermost layer is reached, so this dictionary table DA31 In particular, the second recognition candidate group 32 need not be provided. However, if there is a deeper screen depending on the item selected by the user, it is preferable to provide a second recognition candidate group 32 for making a direct transition to that screen as necessary. . Further, as shown in FIG. 8B, the process specification table DB 31 also includes a first process table 41 that includes the same character strings as the first recognition candidate group 31. Further, when the dictionary table DA31 includes the second recognition candidate group 32, the processing specification table DB31 also includes the second processing table 42 corresponding thereto. Then, when the display screen A31 as shown in FIG. 5C is displayed on the operation panel 10, for example, when the user inputs a voice “finished”, the voice recognition unit 23 includes the first one included in the dictionary table DA31. A character string “finished” is identified from the recognition candidate group 31, and the process identifying unit 25 performs “transition to display screen A 41” as a process to be executed based on the identified character string (recognized speech). Is identified. When the specified process is executed by the process execution unit 26, the display unit 11 of the operation panel 10 changes from the display screen A31 of the second intermediate layer to the display screen A41 of the lowermost layer (see FIG. 5D). Transition. When the dictionary table DA31 includes the second recognition candidate group 32, when the user inputs a voice included in the second recognition candidate group 32, the voice recognition unit 23 stores the second recognition candidate group 32 in the dictionary table DA31. The character string is identified from the recognition candidate group 31 of the recognition, and the process identifying unit 25 identifies the process to be executed based on the identified character string (recognized speech). Then, when the specified processing is executed by the processing execution unit 26, the display unit 11 of the operation panel 10 transitions from the display screen A31 of the second intermediate layer to the specific screen.

  When the user inputs a voice “Close” while the display screen A31 as shown in FIG. 5C is displayed on the operation panel 10, the voice recognition unit 23 performs the first recognition included in the dictionary table DA31. The character string “closed” is identified from the candidate group 31, and the process identification unit 25 executes “previous” as a process to be executed from the process identification table DB 31 based on the identified character string (recognized voice). Specify “transition to screen”. Therefore, in this case, the process execution unit 26 reads the screen information G2 from the information storage unit 27 of the storage device 22, changes the display screen in the display unit 11 to the screen before the transition, and returns to the original display screen.

  Next, FIG. 9 is a diagram showing a dictionary table DA41 corresponding to the lowermost display screen A41 and a process specifying table DB41. As shown in FIG. 9A, the dictionary table DA41 includes a first recognition candidate group 31 corresponding to the selection items P41 and P42 on the display screen A41 (see FIG. 5D) and selection items P41 and P42. A non-corresponding second recognition candidate group 32 is included. The first recognition candidate group 31 is a recognition candidate group for changing the display screen of the display screen of the display unit 11 according to the hierarchical structure, as in the case where the user directly operates the operation panel 10 with a finger or the like. In this example, two recognition candidates “end” and “close” are included. These recognition candidates are the same character strings as the character strings of the plurality of selection items P41 and P42 displayed on the display screen A10. The second recognition candidate group 32 is a recognition candidate group for directly changing the display screen of the display unit 11 to the display screen of the lowest layer without following the hierarchical structure. A plurality of recognition candidates different from the first recognition candidate group 31 are included. For example, a description about “finish” is displayed in a text in the help information display field L1 of the display screen A41, and a keyword (for example, “staple” or “punch”) in the text is displayed in the second recognition candidate group 32. Is included as a recognition candidate. In the second recognition candidate group 32 in the dictionary table DA41, there is a recognition candidate 32a for making a mode transition directly from the lowermost display screen A41 in the help mode to the lowermost display screen B41 in the copy mode. include.

  Further, as shown in FIG. 9B, the process specification table DB 41 is a table in which the voice specified by the voice recognition unit 23 is associated with the process to be executed corresponding to the voice. A first processing table 41 including the same character string as the first recognition candidate group 31 and a second processing table 42 including the same character string as the second recognition candidate group 32 are provided. In the “execution process” column of the first process table 41, a process for changing the screen of the display unit 11 according to the hierarchical structure is set. In this example, a process for returning the display screen to the initial screen is set as a process corresponding to “end”, and a process for returning to the previous screen is set as a process corresponding to “close”. Therefore, when the user inputs a voice “End”, the display screen of the display unit 11 returns to the initial screen, and when the user inputs a voice “Close”, the display screen of the display unit 11 returns to the display screen before the transition. . In the “execution process” column of the second process table 42, a process for directly changing the display screen of the display unit 11 to another lowermost display screen without following the hierarchical structure is set. Therefore, in the present embodiment, when the display screen of the display unit 11 displays the lowermost display screen A41, the user inputs the character string included in the second recognition candidate group 32 of the dictionary table DA41 by voice. Accordingly, the display screen can be directly changed between the lowest layers in the same mode, and the display screen can be directly changed between different modes.

  FIG. 10 is a diagram illustrating an example of direct transition between the lowest layers in the same mode. For example, when the display screen A41 shown in FIG. 10A is displayed on the display unit 11 of the operation panel 10, the user utters the word “staple” displayed in the help information display field L1. The voice recognition unit 23 specifies a character string “staple” from the second recognition candidate group 32 included in the dictionary table DA41, and the processing specification unit 25 is based on the specified character string (recognized voice). The process specifying table DB 41 is searched and “transition to the display screen A 42” is specified as the process to be executed. Then, when the specified process is executed by the process execution unit 26, the display unit 11 of the operation panel 10 transitions to a display screen A42 shown in FIG. On the display screen A42 shown in FIG. 10B, a help information display field L2 regarding “staples” is displayed, and a description regarding “staples” is displayed inside the help information display field L2. Therefore, when the display screen A42 is displayed on the display unit 11, the user can obtain desired help information. A plurality of selection items P43 and P44 that can be selected by the user are displayed at the bottom of the display screen A42. The selection item P43 displays a character string “close” indicating that the display screen of the display unit 11 is returned to the previous screen, and the selection item P44 displays the display screen of the display unit 11 as the uppermost display screen A10. A character string “END” is displayed to indicate that it is to be returned to. For this reason, if the user presses the selection item P41 or produces a voice “Close”, the display screen of the display unit 11 returns to the previous display screen A41 and either presses the selection item P42 or “End”. Is displayed, the display screen of the display unit 11 returns to the display screen A10 of FIG. 5A which is the top screen in the help mode.

  Here, for example, when the user directly operates the operation panel 10 with a finger or the like to display another lowermost screen in the same mode or a lowermost screen in a different mode on the display unit 11, Since the 11 display screens need to be returned to the display screen at least one level higher, the user needs to perform at least two operations. On the other hand, in the case of voice input, since the display screen is shifted directly between the lowest layers by one voice input, the number of voice utterances can be reduced, so that the operability by voice input is improved.

  Next, FIG. 11 is a diagram illustrating an example of direct transition between different modes. For example, when the lowermost display screen A41 corresponding to “finish” in the help mode as shown in FIG. 11A is displayed on the display unit 11 of the operation panel 10, the user calls “finish”. When the voice is uttered, the voice recognition unit 23 identifies the character string “finished” from the second recognition candidate group 32 included in the dictionary table DA41, and the process identification unit 25 recognizes the identified character string (recognized). The process specifying table DB 41 is searched based on the “sound (voice)”, and “transition to the display screen B 41” is specified as the process to be executed. Here, the display screen B41 is the lowermost display screen in the hierarchical structure of another mode (copy mode) (see FIG. 3). Then, when the specified process is executed by the process execution unit 26, the display unit 11 of the operation panel 10 transitions to a display screen B41 shown in FIG. A display screen B41 shown in FIG. 11B is a setting screen for performing finish settings relating to the copy mode. Therefore, when the display screen B41 is displayed on the display unit 11, the user can perform finish settings such as stapling and punching by manual input or voice input. A selection item P45 including the character string “OK” is displayed at the bottom of the display screen B41. If the user presses the selection item P45 or makes a sound “OK”, the display unit 11 is displayed. Transition to the display screen B10 which is the top screen (top layer screen) in the copy mode, for example.

  In this way, when a display screen other than the lowest layer is displayed on the display unit 11 in a certain mode, the recognition candidate for transitioning to the lowermost display screen in the same mode is the lowermost display screen of the same mode. When displayed on the display unit 11, it is used as a recognition candidate for transitioning to the lowermost display screen of another mode, so that the user can switch the operation mode of the information processing apparatus 1 with a single voice input. It is possible to promptly display a desired display screen. For example, when the display screen A41 related to “finish” is displayed in the help mode as described above, if the user says “finish”, not only the display screen B41 related to “finish” in the copy mode is displayed, When the display screen B41 related to “finish” is displayed in the copy mode, if the user utters “finish”, the display transitions to the display screen A41 related to “finish” in the help mode in order to display help information related to “finish”. When configured to do so, the operability is further improved.

  Next, screen transition when the user registers customization setting information will be described. FIG. 12 is a diagram illustrating an example of direct transition when the user registers customization setting information. FIG. 12A shows the uppermost display screen B10 in the copy mode, which can be selected when the user instructs to execute a plurality of selection items P15 to P18 that can be set when using the copy function. The selected item (execution button) P19 is displayed. FIG. 12B shows a display screen B45 for calling the setting information registered by the user in advance with customization settings. A plurality of setting information registered in advance is displayed as selection items P51 to P54, respectively. A plurality of selection items P55 and P56 that can be selected to determine whether or not to call the setting are displayed. Here, in each of the selection items P51 to P54, a character string of a setting information name arbitrarily set by the user is individually displayed. For example, “Setting 1” is displayed on the selection item P51.

  For example, when the uppermost display screen B10 is displayed in the copy mode, when the user inputs the voice “setting 1” to the voice input device 15, the display screen of the display unit 11 is displayed as shown in FIG. The display screen B45 shown in FIG. 4B is displayed, and the selection item P51 corresponding to “setting 1” among the plurality of selection items P51 to P54 is reflected in the selected state.

  FIG. 13 is a diagram showing the dictionary table DA50 corresponding to the uppermost display screen B10 in the copy mode and the process specifying table DB50. As shown in FIG. 13A, the dictionary table DA50 includes the first recognition candidate group 31 corresponding to the selection items P15 to P18 (see FIG. 12A) on the display screen B10 and the selection items P15 to P18. A non-corresponding second recognition candidate group 32 is included. In the first recognition candidate group 31, as in the case where the user directly operates the operation panel 10 with a finger or the like, the display screen of the display unit 11 is sequentially shifted to a lower layer screen according to the hierarchical structure. And a plurality of recognition candidates are included. These recognition candidates are the same character strings as the character strings of the plurality of selection items P15 to P18 displayed on the display screen B10. In addition, the second recognition candidate group 32 is a recognition candidate group for directly changing the display screen of the display unit 11 without following the hierarchical structure, and a plurality of recognition candidates different from the first recognition candidate group 31. Candidates are included. In the second recognition candidate group 32, when the user registers customization setting information, a third recognition candidate group 33 is additionally registered by the setting registration unit 26a. In the illustrated example, character strings such as “setting 1”, “8 in 1”, and “program 1” are additionally registered in the dictionary table DA50 as the third recognition candidate group 33, and these additional registered character strings are information. This corresponds to each setting information name of the setting information G3 stored and stored in the storage unit 27.

  Further, as shown in FIG. 13B, the process specification table DB 50 is a table in which the voice specified by the voice recognition unit 23 is associated with the process to be executed corresponding to the voice. The item column “recognized speech” includes the same character string as the recognition candidates included in the dictionary table DA50. Therefore, in this process specification table DB 50, there are a first process table 41 including the same character string as the first recognition candidate group 31 and a second process table 42 including the same character string as the second recognition candidate group 32. A third processing table 43 including the same character string as that of the additionally registered third recognition candidate group 33 is additionally registered in the second processing table 42. In the “execution process” column of the first process table 41, a process for sequentially changing the display screen of the display unit 11 to a lower-layer screen one by one according to the hierarchical structure is set. In 42, a process for directly changing the display screen is set. In particular, in the third processing table 43 included in the second processing table 42, processing for changing the display screen of the display unit 11 to the display screen B45 for setting call is set, and the setting information name is supported. The setting information G3 to be reflected is set to be reflected in the selected state.

  Therefore, for example, when the display screen B10 as shown in FIG. 12A is displayed on the operation panel 10, for example, when the user inputs the voice “setting 1”, the voice recognition unit 23 is included in the dictionary table DA50. A character string “setting 1” additionally registered from the second recognition candidate group 32 is specified, and the process specifying unit 25 performs processing to be executed based on the specified character string (recognized speech). “Transition to display screen B45 to specify“ setting 1 ”selection” is specified. When the specified processing is executed by the processing execution unit 26, the display unit 11 of the operation panel 10 directly changes from the uppermost display screen A10 to the display screen B45 which is a setting call screen, and at the same time, the display screen In B45, the selection item P51 corresponding to “Setting 1” is selected.

  By the way, for example, when the uppermost display screen B10 is displayed in the copy mode, when the user presses the program key 13d provided on the operation panel 10 with a finger or the like, the display screen of the display unit 11 is displayed as shown in FIG. The display screen B45 of FIG. 12 (b) is transitioned to. In this case, the display screen B45 does not enter a state in which any of the plurality of selection items P51 to P54 is selected, and the user further sets a desired setting information name. It is necessary to perform an operation of selecting a selection item on which is displayed. Therefore, in the case of voice input, there is an advantage that the setting information can be called more efficiently than in the case of manual input.

  In the above description, the transition from the uppermost display screen B10 in the copy mode is described as an example of the screen transition when the user registers the customization setting information. However, the screen transition described above is an arbitrary layer structure in the copy mode. Can be done on the screen. Further, the present invention is not limited to the screen transition under the copy mode, and can be applied under other modes such as the FAX / scan mode.

  Next, a processing procedure in the display screen control unit 20 of the present embodiment will be described. FIG. 14 is a flowchart illustrating a processing procedure of the display screen control unit 20 in the information processing apparatus 1. First, the display screen control unit 20 is in a standby state until voice input is performed by the user (step S10). When a voice input is made to the voice input device 15, the voice analysis unit 16 extracts a voice signal and outputs it to the voice recognition unit 23 (step S11). Then, the voice recognition unit 23 of the CPU 21 functions. The speech recognition unit 23 reads the dictionary table DA corresponding to the display screen displayed on the display unit 11 from the storage device 22 (step S12), compares the speech analysis result with the dictionary table DA, and recognizes the input speech. The candidate group is identified (step S13). The control unit 24 of the CPU 21 functions, and in the control unit 24, the process specifying unit 25 reads the process specifying table DB corresponding to the display screen from the storage device 22 (step S14), and the specified input voice, the process specifying table DB, Are identified by the information processing apparatus 1 (step S15). Accordingly, in the case of the process of transitioning the display screen, the transition destination display screen is specified at this time.

  Then, the process execution unit 26 of the control unit 24 functions, and the process execution unit 26 determines whether or not the process specified by the process specifying unit 25 is a process involving screen transition (step S16). If the process involves screen transition, the screen information G2 before transition, which is the current display screen, is stored and saved in the screen information storage unit 27a of the information storage unit 27 (step S17). On the other hand, if the process does not involve screen transition, step S17 is skipped. In step S18, the process executing unit 26 executes the process specified by the process specifying unit 25. Therefore, in the case of the process of changing the display screen, the display screen of the display unit 11 is switched to the specified screen at this time. When the execution of the process is completed, the procedure of this flowchart ends, and thereafter, the procedure from step S10 is repeated.

  As described above, in the information processing apparatus 1 according to the present embodiment, the dictionary table DA for recognizing input speech when the user performs speech input is set for each display screen having a hierarchical structure. As a result, the number of recognition candidates included in the dictionary table DA referred to during speech recognition can be reduced, so that the time required to specify the input speech can be shortened and speech recognition can be performed efficiently. .

  The dictionary table DA includes a first recognition candidate group 31 for sequentially changing the display screen of the display unit 11 to a lower layer screen according to a preset hierarchical structure, and a display unit that does not follow the hierarchical structure. 11 includes a second recognition candidate group 32 for directly changing the display screen of FIG. 11 to a specific screen, and the voice recognized by the voice recognition unit 23 is included in the second recognition candidate group 32. In this case, the control unit 24 is configured to directly change the display screen on the display unit 11 to a specific screen. Therefore, in order to display a specific screen desired by the user, the number of times the user utters the operation panel 10 can be reduced, and the troublesomeness caused by the increased number of utterances can be eliminated. The operability of the operation panel 10 by voice input can be improved. In particular, in the case of the present embodiment, since the screen transition according to the hierarchical structure is performed by the manual input operation, it is necessary to perform the manual operation a plurality of times until the user reaches the desired screen. In operation, since it is possible to change the screen directly without following the hierarchical structure, there is an advantage that voice input is superior to manual input in terms of operability.

  In the present embodiment, when the control unit 24 changes the display screen of the display unit 11, the screen information G <b> 2 related to the display screen before the transition is stored in the information storage unit 27 and is recognized by the voice recognition unit 23. If the received voice is a voice instructing to return to the display screen before the transition, the screen information G2 stored in the information storage unit 27 is read, and the display screen in the display unit 11 is changed to the screen before the transition. Therefore, even when an instruction to return the display screen to the previous screen is made after the direct transition of the display screen is performed, it is possible to return to the original display screen before the direct transition. In the above description, the information storage unit 27 is provided in the storage device 22. However, the information storage unit 27 may be provided in a storage unit different from the storage device 22.

  As mentioned above, although one Embodiment regarding this invention was described, this invention is not limited to the thing of the content mentioned above. For example, in the present embodiment, the case where the information processing apparatus 1 is an apparatus referred to as a multifunction peripheral or an MFP is illustrated, but the information processing apparatus to which the present invention is applicable is not limited to this, and other The present invention can be applied to various information processing apparatuses.

  In the above embodiment, the case of direct transition mainly to the display screen of the lowest layer of the hierarchical structure is exemplified as the transition form of the display screen by voice input, but the screen that is the transition destination of the direct transition by voice input is The display screen is not necessarily the lowermost display screen in the hierarchical structure, and may be a screen provided in an intermediate layer. For this reason, in the present invention, it is only necessary to set transition to a specific screen directly without following the hierarchical structure.

  Although not particularly mentioned in the above, an operation switch that is operated when the user performs voice input is provided, and the voice input to the voice input device 15 is received while the user is operating the operation switch. May be. In this case, in the flowchart shown in FIG. 14, for example, when it is detected that the user has operated the operation switch, the processing is started in response thereto. Further, such a switch may be configured by a non-contact type detection sensor that detects that the user is positioned in front of the information processing apparatus 1.

It is a perspective view which shows an example of the external appearance structure of information processing apparatus. It is a figure which expands and shows the operation panel of information processing apparatus. It is a figure which shows the structural example of the hierarchical display screen in help mode and copy mode. It is a block diagram which shows an example of the control mechanism for performing display screen control in information processing apparatus. It is a figure which shows an example of the hierarchical display screen in help mode. It is a figure which shows the dictionary table and process specific table corresponding to the uppermost display screen. It is a figure which shows the dictionary table and process specific table corresponding to the display screen of a 1st intermediate | middle layer. It is a figure which shows the dictionary table and process specific table corresponding to the display screen of a 2nd intermediate | middle layer. It is a figure which shows the dictionary table and process specific table corresponding to the display screen of the lowest layer. It is a figure which shows an example of the direct transition between the lowest layers in the same mode. It is a figure which shows an example of the direct transition between different modes. It is a figure which shows an example of the direct transition when a user registers customization setting information. It is a figure which shows the dictionary table and process specific table corresponding to the display screen of the uppermost layer in copy mode. It is a flowchart which shows the process sequence of the display screen control part in information processing apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Information processing apparatus 10 Operation panel 11 Display part (display means)
12 Touch panel keys (operation input means)
13 Operation keys (operation input means)
15 Voice input device (voice input means)
16 Speech analysis unit 21 CPU
22 Storage device (storage means)
23 Voice recognition unit (voice recognition means)
24 Control unit (control means)
25 Process identification unit 26 Process execution unit 27 Information storage unit

Claims (8)

A display screen control device having display means for displaying various information, holding a plurality of display screens displayed on the display means in a hierarchical structure, and transitioning the display screens in the display means according to the hierarchical structure. ,
Voice input means for inputting voice;
Storage means for storing a dictionary table in which a recognition candidate group for recognizing input speech input to the speech input means is registered for each display screen of the hierarchical structure;
Speech recognition means for reading out the dictionary table corresponding to the display screen of the display means from the storage means and recognizing input speech input to the speech input means from among the recognition candidate groups registered in the read dictionary table When,
Control means for transitioning the display screen in the display means based on the voice recognized by the voice recognition means;
With
The dictionary table includes a first recognition candidate group for sequentially changing the display screen of the display unit to a lower layer screen according to the hierarchical structure, and the display screen of the display unit without following the hierarchical structure. And a second recognition candidate group for directly transitioning to a specific screen,
The control means causes the display screen on the display means to transition to the specific screen when the voice recognized by the voice recognition means is voice included in the second recognition candidate group. Screen control device. The second recognition candidate group is a recognition candidate group that causes the display screen of the display means to transition to the lowermost screen in the hierarchical structure,
When the voice recognized by the voice recognition means is a voice included in the second recognition candidate group, the control means changes the display screen on the display means to a lowermost screen based on the recognized voice. The display screen control apparatus according to claim 1, wherein the display screen control apparatus performs transition. In the dictionary table corresponding to the lowermost display screen in the hierarchical structure, recognition candidates that cause the display screen of the display means to transition to another lowermost screen in the hierarchical structure are included as the second recognition candidate group. Included,
In the case where the display screen of the display means is a lowermost screen, the control means displays on the display means if the voice recognized by the voice recognition means is a voice included in the second recognition candidate group. The display screen control device according to claim 1, wherein the screen is changed to another screen in the lowest layer based on the recognized voice.   The control means stores and saves screen information related to the display screen before the transition when transitioning the display screen on the display means, and the voice recognized by the voice recognition means returns to the display screen before the transition. 4. The display screen control apparatus according to claim 1, wherein when the voice is instructed, the screen information is read, and the display screen on the display means is changed to a screen before the transition.   The control means stores and saves the setting information customized by the user, registers a setting information name set for the setting information in the second recognition candidate group, and stores the voice recognition means. The display screen in the display means is changed to a screen in which the setting information is reflected when the voice recognized by the step is the setting information name registered in the second recognition candidate group. The display screen control apparatus according to any one of 1 to 4. The hierarchical structure of the plurality of display screens displayed on the display means includes a first hierarchical structure for displaying on the display means in the first mode and a second structure for displaying on the display means in the second mode. And a hierarchical structure of
In the second recognition candidate group of the dictionary table corresponding to the display screen included in the first hierarchical structure, the display screen of the display means is changed to a specific display screen included in the second hierarchical structure. Recognition candidates to be included,
When the voice recognized by the voice recognition unit is a recognition candidate for transitioning to a specific display screen included in the second hierarchical structure, the control unit is configured to display the first displayed on the display unit. 6. The display screen control device according to claim 1, wherein a transition is made from the display screen in the second mode to the specific display screen in the second mode. A display screen control method for holding a plurality of display screens to be displayed on a display unit in a hierarchical structure, and transitioning the display screen in the display unit according to the hierarchical structure,
A voice input step of inputting voice via a predetermined voice input means;
A speech recognition step of reading a dictionary table corresponding to the display screen of the display means from a predetermined storage means, and recognizing an input speech input to the speech input means from among recognition candidate groups registered in the read dictionary table; ,
A control step of transitioning the display screen in the display means based on the voice recognized by the voice recognition means;
Have
The dictionary table includes a first recognition candidate group for sequentially changing the display screen of the display unit to a lower layer screen according to the hierarchical structure, and the display screen of the display unit without following the hierarchical structure. And a second recognition candidate group for directly transitioning to a specific screen,
In the control step, when the voice recognized in the voice recognition step is a voice included in the second recognition candidate group, the display screen in the display means is changed to the specific screen. Screen control method. An operation panel having display means for displaying various information and operation input means that can be manually operated by a user is provided, and a plurality of display screens to be displayed on the display means are held in a hierarchical structure, and manual operation on the operation input means An information processing device that sequentially transitions the display screen on the display unit from the uppermost screen to the lower layer screen according to the hierarchical structure,
Voice input means for inputting voice;
Storage means for storing a dictionary table in which a recognition candidate group for recognizing input speech input to the speech input means is registered for each display screen of the hierarchical structure;
Speech recognition means for reading out the dictionary table corresponding to the display screen of the display means from the storage means and recognizing input speech input to the speech input means from among the recognition candidate groups registered in the read dictionary table When,
Control means for transitioning the display screen in the display means based on the voice recognized by the voice recognition means;
With
The dictionary table includes a first recognition candidate group for sequentially changing the display screen of the display unit to a lower layer screen according to the hierarchical structure, and the display screen of the display unit without following the hierarchical structure. And a second recognition candidate group for directly transitioning to a specific screen,
The control means changes the display screen on the display means to the specific screen when the voice recognized by the voice recognition means is voice included in the second recognition candidate group. Processing equipment.

Images