JPH07129356A - Multi windows system - Google Patents

Abstract

(57) [Summary] [Purpose] When multiple audio programs run on multiple windows and each audio program requests audio output at the same time, multi-windows can arbitrate those requests with an input device. Provide the system. [Structure] The operator uses a mouse as an input device to display a window A to which a voice program section A203 belongs.
Alternatively, by merely moving the mouse cursor to the display position of the window B to which the audio program section B204 belongs and performing an input operation, the audio output arbitration section 205, which receives an instruction from the window instructing section 202, makes a selection based on the instruction. Then
The voice output unit 206 can realize the voice output by notifying the voice program unit A 203 or the voice program unit B 204 of the permission of the selection, and the operator can visually control the voice output and the voice program that outputs the voice. The window to which the department belongs can be visually confirmed.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a voice output management system in a computer multi-windows system.

[0002]

2. Description of the Related Art With the recent spread of bitmap displays and pointing devices, the only display in the system is divided into a plurality of rectangular areas called windows, and each window is regarded as one virtual terminal. Computer systems having a multi-window function for selecting a plurality of windows on a display and using it as a terminal and a voice output function are widely used.

FIG. 1 is a block diagram showing a conventional computer system. In FIG. 1, 101 is a voice program section A, 102 is a voice program section B, 103 is a voice output arbitration section, and 104 is a voice output section.

The operation of the computer system configured as described above will be described below with reference to FIG.

Each voice program section A101 and voice program section B10 in the multi-windows system
Reference numeral 2 belongs to a certain window and requests the audio output arbitration unit 103 to output audio. Then, the audio output unit 104 through the audio output arbitration unit 103 gives permission for any one of the audio output requests. Then, either the audio program unit A 101 or the audio program unit B 102 that has obtained permission for the audio output request outputs audio data to the audio output unit 104.

The voice output arbitration unit 103 selects one voice output request from the two voice output requests from the voice program unit A101 and the voice program unit B102. Then, the audio output arbitration unit 103 outputs the selected audio output request to the audio output unit 104.

The voice output unit 104 receives the voice output request selected and outputted by the voice output arbitration unit 103 first,
Output permission is issued to the audio output arbitration unit 103 in response to the request. Upon receiving the output permission, the audio output arbitration unit 103 notifies the received output permission to the audio program unit (A101 or B102) that is one of the audio output request sources selected earlier. To do.

Therefore, when the voice output arbitration unit 103 selects and outputs the voice output request, the voice output unit 104 selects one of the voice output request sources selected by the voice output arbitration unit 103. The output permission is notified to the audio program unit (A101 or B102) which is the source of the audio output request, and the audio program A101 or audio program unit B102 which has received the output permission outputs the audio data to the audio output unit 1
Output to 04. The audio output unit 104 receives the output audio data and outputs the audio.

[0009]

However, in the above conventional configuration, the audio output arbitration unit 103 outputs one of the two audio output requests requested by the audio program unit A101 or the audio program unit B102. When the voice output unit 104 is notified to the voice output unit 104, the voice output arbitration unit 103 receives the voice output from another input device during the period from the selected time until the voice output unit processes the voice output related to the selected voice output request. It was irrelevant to the input request.
As a result, for example, the audio output arbitration unit 103 selects the audio output request of the audio program unit A101, and the audio output unit 10
4 once issues an output permission to the voice program section A 101, the operator
Even if the user wants to output the voice of the voice program 102 and uses the input device to select the window to which the voice program unit B102 belongs, the voice of the voice program unit A101 is output instead of the voice of the voice program unit B102. Was.

In order to solve the above problems, the present invention is directed to a case where a plurality of voice programs operate on a plurality of windows in a multi-window system, and each voice program requests voice output at the same time. , It is an object of the present invention to provide a multi-windows system that can arbitrate those requests even based on input using an input device.

[0011]

SUMMARY OF THE INVENTION According to the present invention, a plurality of program execution units for executing a plurality of programs corresponding to multi-windows, a priority instruction unit for outputting a priority instruction, the priority instruction, and the plurality of the plurality of program execution units. A control unit capable of receiving a plurality of voice data output requests generated in the execution process of the program and controlling output of a plurality of voice data generated in the execution process of the plurality of program execution units, and the plurality of control units controlled by the control unit. The multi-windows system is provided with an output unit that outputs voice based on the output of voice data.

[0012]

In the multi-windows system of the present invention, the plurality of program execution units execute the plurality of programs corresponding to the multi-windows, the priority instruction means outputs the priority instruction, and the control unit executes the plurality of programs. In response to a plurality of audio data output requests generated in the process, the output unit controls the output of the plurality of audio data generated in the execution process of the plurality of program execution units by using the priority instruction in some cases, and the output unit is controlled by the control unit. Since the voice is output based on the output of the plurality of voice data, the voice of the voice program corresponding to the window instructed by the priority instructing means can be output.

[0013]

DESCRIPTION OF THE PREFERRED EMBODIMENTS A multi-windows system according to an embodiment of the present invention will be described below with reference to FIGS. 2, 3 and 4.

FIG. 2 shows a block diagram of a multi-windows system in an embodiment of the present invention. 3 and 4 show the positional relationship between the window in this embodiment and the mouse cursor indicating the pointing position of the mouse which is the input device.

In FIG. 2, 201 is an input device section which is an example of priority instructing means, 202 is a window designating section, 203 is a voice program section A, 204 is a voice program section B, 205 is a voice output arbitration section, and 206 is a voice output arbitration section. An audio output unit 207 is a window display unit.

The operation of the multi-windows system configured as described above will be described below with reference to FIGS. 2, 3 and 4.
Will be explained.

The voice program section A203 is shown in FIGS.
If it belongs to the window A indicated by, and there is an output request, the audio output arbitration unit 205 is requested to output the audio and the fact that it belongs to the window A is notified.

The voice program section B204 is shown in FIGS.
If it belongs to the window B indicated by and there is an output request, the audio output arbitration unit 205 is requested to output the audio and the fact that it belongs to the window B is notified.

When the positional relationship between the mouse cursor indicating the pointing position of the mouse, which is the input device, and the windows A and B is shown in FIG.
Outputs the position information of the mouse to the window instruction unit 202 based on the input of the mouse operated by the operator. The window instruction unit 202 outputs to the audio output arbitration unit 205 that the operator has selected the window A based on the mouse position information obtained from the input device unit 201.

When the audio output arbitration unit 205 receives the selection output of the window A from the window instruction unit 202, the audio output arbitration unit 205 accepts the audio output request of the audio program unit A 203 belonging to the window A, and outputs the audio output request to the audio output unit 206. It outputs that the audio output request source is the window A. Upon receiving the output, the audio output unit 206 grants permission for the audio output request of the window A to the audio output arbitration unit 205.
Output to.

When the audio output unit 206 obtains permission for the audio output request of the window A, the audio output arbitration unit 20.
5 notifies the audio program unit A203 of permission. The audio program unit A 203, which has received the permission notification from the audio output arbitration unit 205, outputs audio data to the audio output unit 206, and the audio output unit 206 outputs the audio program unit A.
After receiving the audio data from 203, notifying the window display unit 207 of the audio output and the fact that the audio output source is the window A, the audio data is output as audio. The window display unit 207 has a voice output unit 206.
The fact that the audio output has started and that the audio start is the window A are notified from this, and as shown in FIG. 3, during the audio output period, a window frame indicating the audio output period is displayed at the window A position.

At this time, since the voice from the voice program section A203 is being output, the voice program section B204 is
Cannot get permission for voice output request. Therefore, even if an audio output request from the audio program unit B204 belonging to the window B is issued, the permission for the request is not notified, so that the audio program unit B204 is in the waiting state and the audio is not displayed at the window B position. The window frame showing the output period is not displayed.

Then, the voice output unit 206 notifies the window display unit 207 that the voice output of the window A is finished when the voice output from the voice program unit A 203 is finished, and the window display unit 207 is notified. Indicates that the audio output has ended and the end
Is notified from the audio output unit 206, the display of the window frame indicating that the audio output period at the position of the window A was being displayed is erased.

However, if the positional relationship between the mouse cursor indicating the pointing position of the mouse, which is the input device, and the window A and the window B is shown in FIG. 4 even when the audio from the audio program unit A203 is being output. When an input operation similar to the above based on the mouse input operated by the operator is performed, the voice output unit 206 preferentially receives the voice data from the voice program unit B204, outputs the voice data as voice, and displays the window. The part 207 is
As shown in FIG. 4, the voice program section B20 is placed at the window B position.
4 displays a window frame indicating that the voice output period is in progress.

As described above, in the multi-windows system of this embodiment, the voice program section A203,
When the voice program section B204 requests the output of voice at the same time, if the operator uses the mouse to move the mouse cursor to the position of the window A to which the voice program section A203 belongs and perform an input operation, the input device section 2
01 detects the input from the mouse, and the window instruction unit 2
02 selects the window A to which the audio program unit A 203 belongs based on the mouse position information obtained from the input device unit 201, and instructs the audio output arbitration unit 205 to specify the window A. The requested audio can be output, and the audio output unit 206 notifies the window display unit 207 that the audio output is started and ended and that the audio output source is the window A, and is displayed on the display. A window frame indicating the audio output period can be displayed at the position of window A.

In other words, the operator simply uses the mouse to move the mouse cursor to the position of the window A to which the voice program section A 203 belongs or the window B to which the voice program section B 204 belongs and perform an input operation. The voice output from the program unit A203 or the voice program unit B204 can be realized, and the operator can visually control the voice output, and the operator can visually recognize the window to which the voice program unit performing the voice output belongs. It becomes possible to confirm.

In the above embodiment, the position of the mouse cursor is used as the input information from the mouse which is the input device. However, the present invention is not limited to this, and any information can be input from the input device. Information may be used.

Further, in the above embodiment, the window designating section designates the window displayed at the position of the mouse cursor, but the present invention is not limited to such a rule, and the input device is used. Based on the input of
The window may be indicated according to another rule.

Further, although the mouse is used as the input device in the above embodiment, the present invention is not limited to this, and a device such as a keyboard, a trackball, a joystick or the like may be used as long as it is a device capable of inputting information necessary for pointing a window. An input device may be used.

Further, in the above embodiment, the window frame is displayed at the display position of the window for audio output as a method for indicating the audio output period, but the present invention is not limited to this.

Further, in the above embodiment, the window display section was present, but the window display section may not be provided, and if there is no window display section, the audio output arbitration section is selected for the audio output section. Information that the window is the window A or the window B may not be notified.

Further, as a method for inputting an instruction by the priority instructing means of the multi-windows system of the present invention to the control section, if it is a method that is easy for an operator to operate, a method of using a window display position or the like may be used. Of course good.

The output unit of the multi-windows system of the present invention outputs a voice based on the output of a plurality of voice data controlled by the control unit, and further outputs visual information about the voice based on the voice data. You may.

[0034]

As is apparent from the above description, the multi-windows system of the present invention, when a plurality of voice programs operate on a plurality of windows and each voice program requires output of voice, those requests are output. Can be arbitrated based on the input using the input device.

Further, according to the present invention, the operator can visually control the audio output by using the input device to selectively input the window to which the desired audio program section belongs.

Further, according to the present invention, the operator can visually recognize the operation of the audio program by outputting a specific display indicating the audio output period at the position showing the window outputting the audio. It can be confirmed through the window display position.

[Brief description of drawings]

FIG. 1 is a configuration diagram of a conventional multi-windows system.

FIG. 2 is a configuration diagram of an embodiment of a multi-windows system of the present invention.

FIG. 3 is a schematic diagram showing a positional relationship between a window and a mouse cursor indicating a designated position of a mouse as an input device in the present embodiment.

FIG. 4 is a schematic diagram different from FIG. 3 showing a positional relationship between a window and a mouse cursor indicating a pointing position of a mouse as an input device in the present embodiment.

[Explanation of symbols]

 101 voice program section A 102 voice program section B 103 voice output arbitration section 104 voice output section 201 input device section 202 window instruction section 203 voice program section A 204 voice program section B 205 voice output arbitration section 206 voice output section 207 window display section

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Aki Yoneda 1006 Kadoma, Kadoma City, Osaka Prefecture Matsushita Electric Industrial Co., Ltd.

Claims (4)

[Claims] 1. A plurality of program executing units for executing a plurality of programs corresponding to multi-windows, a priority instructing unit for outputting a priority instruction, the priority instruction, and a plurality of programs generated in the execution process of the plurality of programs. A control unit capable of controlling an output of a plurality of audio data generated in the execution process of the plurality of program execution units in response to an audio data output request, and a voice based on the output of the plurality of audio data controlled by the control unit. A multi-windows system comprising: an output unit for outputting. 2. The multi-windows system according to claim 1, wherein the output unit further outputs visual information regarding the voice based on the voice data. 3. An input device unit for outputting input information from an input device operated by an operator, and selecting one window in the multi-windows system based on the output from the input device unit, and outputting the selected window by voice. A window instruction unit for instructing the arbitration unit, window information corresponding to a plurality of windows, and window information indicating which window it corresponds to, and an audio output request are output to the audio output arbitration unit, and the audio output request is output. A plurality of audio program units that output audio data to the audio output unit when permission is obtained, and the audio of the audio program unit corresponding to the window output from the window instruction unit based on the window information. The output request is received and output to the audio output unit, and If the permission is obtained, the voice output arbitration unit that notifies the voice program unit of the voice output request source of the permission, and the permission is issued when the voice output request is received, and the voice output arbitration is performed. A multi-windows system comprising: a voice output unit that receives the voice data output by the voice program unit notified of the permission through the unit and outputs the voice data. 4. The voice output arbitration unit, instead of the voice output arbitration unit according to claim 3, receives a voice output request from the voice program unit corresponding to the window output from the window instruction unit, and outputs the voice output. The request and the window information indicating the window are output to the voice output unit, and when the permission for the voice output request is obtained, the permission is notified to the voice program unit that has accepted the voice output request. The audio output unit, in place of the audio output unit according to claim 3, issues a permission when the voice output request and the window information are received, and the voice program unit notified of the permission. Which receives the audio data output by the device, outputs the audio output information indicating the start and end of the audio output, and the window information, and outputs the audio. 4. The multi-windows according to claim 3, further comprising a window display unit that receives the voice output information and the window information, and specifically displays that the window represented by the window information is in the voice output period. system.