JPH06149469A - Computer system - Google Patents

Abstract

PURPOSE:To easily perform an input operation without extensively moving hands in order to operate an input device such as a mouse or the like or the other input devices in the case of giving an instruction on a screen for input. CONSTITUTION:The view point of an operator is detected by a spectacle type sensor 15 and view point information is transformed to a coordinate position on the screen of a CRT 12 by a coordinate transformation module 16. Thus, a specific point on the screen can be instructed and the coordinate can be reported to a work station 11 just by moving the view point by the operator without moving the hands or operating the mouse 14 or the like and the input operation is simplified.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a computer system equipped with computer equipment such as a personal computer, a workstation, or a large-scale computer used for consumer or general industry. It relates to the structure of the means for performing.

[0002]

2. Description of the Related Art A workstation will be described as an example of computer equipment provided in a computer system.
FIG. 11 is an equipment configuration diagram of a conventional computer system. In FIG. 11, 11 is a workstation, 12 is a CRT as a display device, 13 is a keyboard as an input device for inputting information, and 14 is a mouse as an input device.

FIG. 12 is a flow chart showing a typical input procedure for a conventionally used workstation. FIG. 13 is a diagram showing a screen display example displayed on the CRT screen of the workstation. In the figure, 31 is an operation button displayed on the CRT screen.

Next, the operation of this conventional example will be described with reference to FIGS. 11, 12 and 13. For the information displayed on the screen of the CRT 12 of the workstation 11 (step 21), the operator usually considers the next step such as "I want to see another content" or "I want to delete this screen because it is unnecessary". . To do this, use the mouse 14 to CR
Whether the operation button 31 displayed on the screen of the T screen 12 should be clicked or YES / NO should be input by the keyboard 13 is determined (step 2).
2). Operation button 3 on the screen of CRT 12 with mouse 14
When the operator determines that 1 should be clicked, the operator operates the mouse 14 on the screen of the CRT 12 and operates the operation button 3
1 is moved to the position shown (step 23), and the mouse 14 is clicked (step 24). By this operation, the workstation 11 performs the operation expected by the operator such as updating the screen of the CRT 12 (step 2
1), the operator repeats a series of operations of thinking again about the next step (step 22).

[0005]

Since the conventional computer system has the above-mentioned configuration, it is necessary to move the mouse to a desired point on the CRT screen during input operation, which makes the operation complicated. Moreover, even when using other input devices such as a panel with a touch sensor, it is necessary to move a hand or a dedicated tool to a place where an instruction is required, which is troublesome.

The present invention has been made to solve the above problems, and is for operating an input device such as a mouse and other input devices when it is desired to give an instruction on the screen for computer input. The purpose is to obtain a computer system that enables input operations without having to move the hands significantly.

[0007]

According to a first aspect of the present invention, there is provided a computer system comprising a sensor 15 for illuminating a pupil of an operator's eye with reference light and detecting the scattered light to detect a viewpoint of the operator. The module 16 converts the viewpoint information from the sensor 15 into coordinate positions on the screen of the display device (CRT 12).

According to a second aspect of the present invention, a computer system irradiates the pupil of the operator's eyes with scattered light and detects the scattered light to detect the operator's viewpoint, and the viewpoint information is displayed on a display device ( A sensor 45 having a function of converting to a coordinate position on the screen of the CRT 12) is provided.

According to a third aspect of the present invention, there is provided a computer system in which a pupil of the operator's eyes is irradiated with scattered light and the scattered light is detected to detect the operator's viewpoint, and a computer main body (workstation). 11) which is incorporated in 11) and converts the viewpoint information from the sensor 15 into coordinate positions on the screen of the display device (CRT 12).

According to a fourth aspect of the present invention, a computer system irradiates a pupil of the operator's eye with reference light and detects scattered light to detect the operator's viewpoint, and a computer main body (workstation). 11) and software 66 having a function of converting the viewpoint information from the sensor 15 into the coordinate position on the screen of the display device (CRT 12).

A computer system according to a fifth aspect of the present invention illuminates the pupil of the operator's eye with reference light and detects scattered light to detect the operator's viewpoint, and a sensor 15 from the sensor 15. A module 16 for converting viewpoint information into coordinate positions on the screen of the display device (CRT 12) and a confirmation input device 77 for confirming the input of information are provided.

A computer system according to a sixth aspect of the present invention illuminates the pupil of the operator's eye with reference light and detects the scattered light to detect the operator's viewpoint, and a sensor 15 from the sensor 15. A module 16 for converting viewpoint information into coordinate positions on the screen of the display device (CRT 12) and a confirmation input voice input device 18 for confirming the input of information by voice.
And are provided.

A computer system according to a seventh aspect of the present invention provides a character string 1 expected to be input on the screen of a display device (CRT 12).
21, software for displaying 21, a sensor 15 for detecting the operator's viewpoint by irradiating the pupil of the operator's eye with the reference light and detecting the scattered light, and a display device for displaying the viewpoint information from the sensor ( A module 16 for converting the coordinate position on the screen of the CRT 12) is provided.

In the computer system according to the present invention, software for displaying the virtual keyboard 131 on the screen of the display device (CRT 12) and the pupil of the operator's eye are irradiated with the reference light and the scattered light is detected. By doing so, a sensor 15 for detecting the viewpoint of the operator and a module 16 for converting the viewpoint information from the sensor 15 into the coordinate position on the screen of the display device (CRT 12) are provided.

[0015]

According to the first aspect of the invention, the operator's viewpoint is detected by the sensor 15, and the viewpoint information is the module 1
6 is converted into the coordinate position on the screen of the display device (CRT 12).

According to the second aspect of the present invention, the sensor 45 detects the viewpoint of the operator and the display device (CRT).
12) It is converted into the coordinate position on the screen.

In the third aspect of the invention, the operator's viewpoint is detected by the sensor 15, and the viewpoint information is coordinated on the screen of the display device (CRT 12) by the module 56 incorporated in the computer main body (workstation 11). Converted to position.

In the invention of claim 4, the operator's viewpoint is detected by the sensor 15, and the viewpoint information is coordinated on the screen of the display device (CRT 12) by the software 66 installed in the computer main body (workstation 11). Converted to position.

In the fifth aspect of the invention, the viewpoint of the operator is detected by the sensor 15, and the viewpoint information is converted by the module 16 into the coordinate position on the screen of the display device (CRT 12). Confirmation of information input is performed by the confirmation input device 77.

According to the sixth aspect of the present invention, the viewpoint of the operator is detected by the sensor 15, and the viewpoint information is converted into the coordinate position on the screen of the display device (CRT 12) by the module 16. Confirmation of the input of information is performed by the confirmation input voice input device 18.

In the invention of claim 7, the display device (C
The character string 121 expected to be input is displayed by software on the screen of RT12). The operator's point of view is the sensor 1.
5, the viewpoint information is converted into a coordinate position on the screen of the display device (CRT 12) by the module 16.

In the invention of claim 8, the display device (C
The virtual keyboard 131 is displayed by software on the screen of RT12). The operator's viewpoint is detected by the sensor 15, and the viewpoint information is converted into the coordinate position on the screen of the display device (CRT 12) by the module 16.

[0023]

EXAMPLES Example 1. (Corresponding to Claim 1) FIG. 1 is an equipment configuration diagram of a computer system according to Embodiment 1 of the present invention. In FIG. 1, components corresponding to those shown in FIG. 11 are designated by the same reference numerals, and their description will be omitted. In FIG. 1, reference numeral 15 denotes a spectacle-type sensor that detects the viewpoint of the operator by irradiating the pupil of the operator's eye with reference light and detecting the scattered light, and 16 indicates the viewpoint information from the sensor 15 on the CRT 12 It is a coordinate conversion module for converting to the upper coordinate position.

FIG. 2 is a flowchart of an input procedure for the workstation 11 according to the first embodiment. FIG. 3 is an example of a screen display displayed on the screen of the CRT 12 of the workstation 11.

Next, the operation of the first embodiment will be described with reference to FIGS. CR of workstation 11
For the information displayed on the screen of T12 (Step 5
1) The operator considers the next step such as "I want to see another content" or "I want to delete this screen because it is unnecessary".
Further, for that purpose, it is judged whether or not the operation button 61 displayed on the screen of the CRT 12 should be pressed (step 52). Further, from the eyeglass-type sensor 15 worn by the operator, information regarding the viewpoint is sent to the coordinate conversion module 16.
Then, the information is converted into coordinate positions on the screen of the CRT 12 and output to the workstation 11. CRT1
When the operator determines that the operation button 61 on the screen of No. 2 should be pressed, the operator wearing the glasses-type sensor 15 keeps staring at the position where the operation button 61 on the screen of the CRT 12 is displayed. (Step 53), keyboard 13
Any key is pressed (step 54). By this operation, the workstation 11 can obtain the position information instructed by the operator, and then perform the operation expected by the operator, such as updating the screen of the CRT 12, and a series of operations are repeated.

Although not mentioned in the first embodiment,
In the present invention, not only workstations but also various computer equipment such as personal computers and large-scale computers can be used as computer equipment.

Example 2. (Corresponding to claim 2) In the first embodiment, independent hardware is used as the coordinate conversion module 16, but as the second embodiment, FIG.
It is possible to incorporate the function into the spectacles type sensor 45 as shown in, and to output the coordinate information directly from the spectacles type sensor 45.

Example 3. (Corresponding to Claim 3) In the first embodiment, the independent hardware is used as the coordinate conversion module 16, but as the third embodiment, FIG.
As shown in, the coordinate conversion module 56 itself is incorporated in the workstation 11 (computer main body) in the form of a board, and the viewpoint information from the glasses-type sensor 15 input from the communication port in the workstation 11 is coordinated on the board. It is possible to transfer the coordinate information to the workstation 11 by converting the coordinate information into information and outputting the coordinate information to another input port of the workstation 11.

Example 4. (Corresponding to Claim 4) In the first embodiment, the independent hardware is used as the coordinate conversion module 16, but as the fourth embodiment, FIG.
As shown in, the function of the coordinate conversion module is realized as software 66 of the workstation 11, and the viewpoint information from the spectacle-type sensor 15 input to the workstation 11 is automatically converted into coordinate information by the software 66. It can also be configured.

Example 5. (Corresponding to claim 5) Although the keyboard 13 is used as the confirmation device after the coordinate designation in the first to fourth embodiments, a handheld confirmation input device 77 as shown in FIG. It can be configured to be used. This input device 77 is provided with an operation button (not shown) to be pressed at the time of confirmation, and by using this input device 77, at the time of input confirmation, it is possible to perform an input operation at hand without moving the hand to the keyboard 13. Therefore, the operation becomes easy.

Example 6. (Claim 6) Although the keyboard 13 is used as the confirmation device after the coordinate designation in the first to fourth embodiments, the confirmation input voice input device 18 is used as shown in FIG. 8 as the sixth embodiment. It is possible to By using this voice input device 18, since it is not necessary to move the hand at all when confirming the input, it is possible to input to the computer main body (workstation 11) without moving the hand at all through the input operation. It will be easy.

Example 7. (Claim 7) In the first embodiment, the operation button 61 is displayed on the CRT screen.
Is displayed, and the key of the keyboard 13 is pressed by using the coordinate position based on the viewpoint information from the eyeglass-type sensor 15, but in the case where the character string to be input by the keyboard 13 is determined in advance as the seventh embodiment. By displaying the character string 121 to be input on the CRT screen by software processing as shown in FIG. 9, it is possible to input the character string to the computer main body (workstation 11) with the same system configuration. Become.

Example 8. (Claim 8) In the first embodiment, the operation button 61 is displayed on the CRT screen.
Is displayed, and the key of the keyboard 13 is pressed using the coordinate position based on the viewpoint information from the spectacle-type sensor 15. However, as shown in FIG.
Keyboard layout on RT screen, ie virtual keyboard 13
By preparing 1 by software processing,
An arbitrary character string can be input with the same system configuration.

[0034]

As described above, according to the invention of claim 1,
A sensor that detects the operator's viewpoint by irradiating the pupil of the operator's eyes with reference light and detecting the scattered light, and a module that converts viewpoint information from the sensor into coordinate positions on the screen of the display device. Since it has been configured with and, without moving the input device such as a mouse or other input devices to a large extent, it is possible to point a specific point on the screen of the display device simply by moving the viewpoint, The coordinates can be transmitted to the computer main body, and the effect of simplifying the input operation is obtained.

According to the second aspect of the invention, the operator's viewpoint is detected by irradiating the pupil of the operator's eyes with the reference light and detecting the scattered light, and the viewpoint information is displayed on the screen of the display device. Since the sensor having the function of converting to the upper coordinate position is provided and configured, the same effect as the invention of claim 1 can be obtained.

According to the third aspect of the invention, the sensor for detecting the operator's viewpoint by irradiating the pupil of the operator's eyes with the reference light and detecting the scattered light, and the sensor incorporated in the computer body. The present invention has the same effect as the invention of claim 1 because it is configured by including a module for converting the viewpoint information from the above into a coordinate position on the screen of the display device.

According to the invention of claim 4, a sensor for detecting the operator's viewpoint by irradiating the pupil of the operator's eyes with the reference light and detecting the scattered light, and the sensor incorporated in the computer main body. Since the software having a function of converting the viewpoint information from the above into the coordinate position on the screen of the display device is provided, the same effect as that of the invention of claim 1 can be obtained, and the case where the coordinate conversion module is provided is more preferable. Also has the effect of simplifying the hardware configuration.

According to the invention of claim 5, the sensor for detecting the operator's viewpoint by irradiating the pupil of the operator's eye with the reference light and detecting the scattered light, and the viewpoint information from the sensor are provided. Since the module for converting the coordinate position on the screen of the display device and the input device for confirmation input for confirming the input of information are provided, the same effect as the invention of claim 1 can be obtained. By using the input device for confirmation input, when confirming the input, it is possible to perform the input operation at hand without moving the hand up to the keyboard, which has the effect of further simplifying the input operation.

According to the invention of claim 6, the sensor for detecting the viewpoint of the operator by irradiating the pupil of the operator's eye with the reference light and detecting the scattered light, and the viewpoint information from the sensor are provided. Since the module for converting into the coordinate position on the screen of the display device and the confirmation input voice input device for confirming the input of information by voice are provided, the same effect as the invention of claim 1 can be obtained. At the same time, by using the confirmation input voice input device, there is no need to move the hand at the time of confirming the input, and the input operation is further simplified.

According to the invention of claim 7, software for displaying a character string expected to be input on the screen of the display device,
A sensor that detects the operator's viewpoint by irradiating the pupil of the operator's eyes with reference light and detecting the scattered light, and converts the viewpoint information from the sensor into coordinate positions on the screen of the display device. Since the module is provided, the same effect as the invention of claim 1 can be obtained, and when the character string to be input by the keyboard is determined in advance, the character string to be input can be displayed on the screen. There is also an effect that a character string can be input with the same system configuration.

According to the invention of claim 8, the software for displaying the virtual keyboard on the screen of the display device and the pupil of the operator's eye are irradiated with the reference light and the scattered light is detected to detect the scattered light. Since the sensor for detecting the viewpoint and the module for converting the viewpoint information from the sensor into the coordinate position on the screen of the display device are provided, the same effect as the invention of claim 1 can be obtained. A virtual keyboard can be prepared on the screen of the display device, which also has an effect that an arbitrary character string can be input with the same system configuration.

[Brief description of drawings]

FIG. 1 is an equipment configuration diagram of a computer system according to a first embodiment of the present invention.

FIG. 2 is a flowchart showing the operation of the first embodiment.

FIG. 3 is a diagram showing a screen display example in the first embodiment.

FIG. 4 is an equipment configuration diagram of a computer system according to a second embodiment of the present invention.

FIG. 5 is an equipment configuration diagram of a computer system according to a third embodiment of the present invention.

FIG. 6 is an equipment configuration diagram of a computer system according to a fourth embodiment of the present invention.

FIG. 7 is an equipment configuration diagram of a computer system according to a fifth embodiment of the present invention.

FIG. 8 is an equipment configuration diagram of a computer system according to a sixth embodiment of the present invention.

FIG. 9 is a diagram showing a screen display example according to the seventh embodiment of the present invention.

FIG. 10 is a diagram showing an example of screen display according to an eighth embodiment of the present invention.

FIG. 11 is an equipment configuration diagram of a conventional computer system.

FIG. 12 is a flowchart showing the operation of this conventional example.

FIG. 13 is a diagram showing a screen display example in this conventional example.

[Explanation of reference numerals] 11 workstation (computer main body) 12 CRT (display device) 13 keyboard (input device) 14 mouse (input device) 15,45 eyeglass type sensor 16,56 coordinate conversion module 18 voice input device for confirmation input 66 software 77 input device for confirmation input 121 character string 131 virtual keyboard

Claims (8)

[Claims] 1. A computer system comprising a display device such as a CRT or a liquid crystal panel for displaying information and an input device such as a keyboard or a mouse for inputting information, and irradiates the pupil of an operator's eye with reference light. And a sensor system for detecting the viewpoint of the operator by detecting the scattered light, and a module for converting viewpoint information from the sensor into coordinate positions on the screen of the display device. . 2. A computer system comprising a display device such as a CRT or a liquid crystal panel for displaying information and an input device such as a keyboard or a mouse for inputting information, and illuminates the pupil of the operator's eye with reference light. A computer system comprising a sensor having a function of detecting the scattered light and detecting the viewpoint of the operator and converting the viewpoint information into coordinate positions on the screen of the display device. 3. A computer system comprising a display device such as a CRT or a liquid crystal panel for displaying information and an input device such as a keyboard or a mouse for inputting information, and irradiates the pupil of the operator's eye with reference light. A sensor that detects the viewpoint of the operator by detecting the scattered light, and a module that is incorporated in the computer main body and converts the viewpoint information from the sensor into coordinate positions on the screen of the display device. Characteristic computer system. 4. A computer system comprising a display device such as a CRT or a liquid crystal panel for displaying information and an input device such as a keyboard or a mouse for inputting information, and irradiates the pupil of the operator's eye with reference light. A sensor for detecting the viewpoint of the operator by detecting the scattered light, and software installed in the computer main body for converting the viewpoint information from the sensor into coordinate positions on the screen of the display device. A computer system characterized by that. 5. A computer system equipped with a display device such as a CRT or a liquid crystal panel for displaying information and an input device such as a keyboard or a mouse for inputting information, and irradiates the pupil of the operator's eye with reference light. , A sensor for detecting the viewpoint of the operator by detecting the scattered light, a module for converting the viewpoint information from the sensor into coordinate positions on the screen of the display device, and for confirming the input of information. A computer system comprising an input device for confirmation input. 6. A computer system comprising a display device such as a CRT or a liquid crystal panel for displaying information and an input device such as a keyboard or a mouse for inputting information, and irradiates the pupil of the operator's eye with reference light. , A sensor for detecting the viewpoint of the operator by detecting the scattered light, a module for converting the viewpoint information from the sensor into coordinate positions on the screen of the display device, and confirmation of the input of information by voice. A computer system comprising a confirmation input voice input device. 7. A computer system comprising a display device such as a CRT or a liquid crystal panel for displaying information, and an input device such as a keyboard or mouse for inputting information, characters expected to be input on the screen of the display device. Software for displaying rows, a sensor for detecting the operator's viewpoint by irradiating the pupil of the operator's eyes with reference light, and detecting the scattered light, and the viewpoint information from the sensor are displayed on the screen of the display device. A computer system provided with a module for converting to the upper coordinate position. 8. A computer system comprising a display device such as a CRT or a liquid crystal panel for displaying information, and an input device such as a keyboard or mouse for inputting information, wherein a virtual keyboard is displayed on the screen of the display device. Software, a sensor for detecting the viewpoint of the operator by irradiating the pupil of the operator's eyes with the reference light and detecting the scattered light, and the viewpoint information from the sensor are coordinate positions on the screen of the display device. A computer system comprising a module for converting to.