JPH09154089A - Information input method - Google Patents

Abstract

(57) Abstract: In a system that provides user-requested video information and the like to a screen, the user can accurately and quickly instruct the position on the screen with a small amount of operation. SOLUTION: A user irradiates a desired position with infrared rays from a remote controller 1 to image information presented on a screen 2. This irradiation position is measured by the optical sensor unit 5 and the coordinate value conversion unit 7, and the cursor is displayed at the coordinate on the screen 2 in response to a request from the communication control unit 7. When the user moves the irradiation position by operating the remote controller 1 because the position of the cursor is not the desired position, the user similarly measures the irradiation position, and the communication control unit 7 determines the moving distance of the irradiation position. If it is calculated and less than the threshold value, the cursor is not moved, and if it is more than the threshold value, the cursor is displayed at a position on the screen 2 according to the movement of the irradiation position. When the user designates the position and requests the process, the communication control unit 7 performs the corresponding process.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information providing system, and more particularly to an information input method in an information providing system for providing still image, moving image information or multimedia information including these image information according to a user's request. It is about.

[0002]

2. Description of the Related Art In a conventional information providing system, as a means for a user to input information, there is, for example, a remote controller.

The remote controller includes a remote controller having a function of emitting a visible light semiconductor laser (hereinafter referred to as a visible light remote controller) and a remote controller having a function of emitting an infrared ray (hereinafter, referred to as a remote controller).
There is a conventional infrared remote control).

In an information providing system using a visible light remote controller as an input means, the system projects video information from a video projector onto a screen and presents it to the user.
The user irradiates visible light to a desired position using the visible light remote controller, and the system assumes that the irradiation position of the visible light is specified by the user. For example, menu search, scroll destination specification, hypermedia search, etc. I am trying to process it.

Further, in an information providing system using a conventional infrared remote controller as an input means, the system projects video information from a video projector onto a screen or the like and presents it to the user, and also displays a cursor on the screen. In order to move the cursor to the desired position, for example, "front", "rear", "left",
“Right” four arrow keys are provided and the arrow keys are appropriately pressed to move the cursor, or a trackball is provided on the remote controller and the trackball is rotated in an appropriate direction to move the cursor. The user made a processing request at the desired cursor position.

[0006]

However, in the conventional information providing system that uses the visible light remote controller as the input means, since the position where the visible light is irradiated is considered to be designated by the user, the user who has the remote controller operates. There are problems that the desired position cannot always be designated or that the image presented by the beam of visible light is difficult to see due to the hand shaking or the like.

Further, in an information providing system using a conventional infrared remote controller as an input means, an arrow key or a trackball provided on the remote controller is depressed or rotated to perform a cursor operation. Since the cursor is moved to the desired position, there is a problem that it takes time for the cursor to reach the desired position and the operation amount of the user increases.

The present invention has been made to solve the above problems, and in an information providing system that provides various information including corresponding video information in response to a user's request, the position desired by the user The object of the present invention is to make it possible to accurately instruct or promptly instruct, and to reduce the amount of operation by the user.

[0009]

To achieve the above object, the present invention provides an information providing system for providing various information including video information corresponding to a user's request,
The step of projecting the image information from the projection means to the screen and presenting it to the user, and the step on the projected screen desired by the user illuminated by the user with the hand operation means having the function of emitting the visible line. When the irradiation position is detected and the cursor is displayed at the irradiation position, and when the user moves the irradiation position of the visible line, the movement amount of the irradiation position is detected and if the movement amount is less than a threshold value. For example, if the cursor is kept at the display position and the detected movement amount of the irradiation position is equal to or more than a threshold value, the display position of the cursor is moved according to the movement amount of the irradiation position, and the user performs processing. When a request is made, performing a process corresponding to the display position of the cursor at the time of requesting the process,
An information input method characterized by having:

Here, the threshold value of the movement amount of the irradiation position of the visible external line is determined by the range of camera shake of the user who has a hand operation means such as a remote controller. When the user operates the hand operation means while being directly in front of the screen, a threshold value may be, for example, a circle having a radius r centered on the position desired by the user. Generally, r is greater than 0, but r = 0
It is also possible. That is, when r = 0, the control by the threshold value is not performed, but when designating the component image information larger than the range of camera shake, r = 0 may be sufficient.

Alternatively, as the threshold value of the movement amount of the irradiation position of the visible external line, a threshold value determined by the information providing system by measuring the environment in which the user operates the information providing system and determining according to the measured value. Is applied, or the display position of the cursor is stopped or moved according to the amount of movement of the irradiation position of the visible external line by the user, at the stage of moving, the operation history information of the hand operation means is collected for the user and the operation history information Based on the above, the threshold of the amount of movement of the irradiation position of the visible external line is determined and maintained, and the user who operates the hand operation means is identified and the threshold of the user is applied. It is suitable in that the property is further improved.

As another means for solving the problem, the present invention is an information providing system for providing various information including corresponding video information in response to a user's request. The step of presenting and detecting the irradiation position on the projected screen desired by the user, which is irradiated by the user with the hand operation means having the function of emitting an external visible line, and displays the cursor at the irradiation position. And, when the user requests the cursor to be fixed, the display position of the cursor is fixed, and when the user moves the irradiation position of the visible line, the moving direction of the irradiation position is detected and the movement is performed. Direction of moving the display position of the cursor by a predetermined unit distance, and when the user requests processing, at the time when the processing is requested. Adopting the information inputting method characterized by comprising the steps of performing a process corresponding to the display position of the cursor that, the.

Here, the environment in which the user operates the information providing system is the distance between the user and the screen, the angle between the user and the screen, lighting, and the like.

Further, as a means for solving another problem, the present invention is an information providing system which provides various information including corresponding video information in response to a user's request, and projects the video information from the projection means on a screen to the user. Part present at the irradiation position by detecting the irradiation position on the projected screen desired by the user, which is irradiated by using a hand operation means having a function of emitting a visible ray from the user. When there is no image information or component image information at the irradiation position, a step of displaying a cursor on the component image information near the irradiation position, and when the user moves the irradiation position of the visible external line, Detecting the moving direction and moving the display position of the cursor to the component image information existing in the moving direction; To employ an information input method and having a the steps of performing a process corresponding to the display position of the cursor at the time of the request of the processing.

Here, the part image information means one part which constitutes the image information. For example, in the image information of a family having a meal, a father, a child, a dining table, a bowl, etc. Is the part image information.

As the substance of the hand operation means in the above information input method, for example, a laser pointer used in a presentation using an OHP, in which emitted electromagnetic waves use infrared rays instead of visible light, Alternatively, a remote controller such as a television equipped with such a function of emitting infrared rays can be used. In this way, the use of infrared rays as the visible rays does not affect the human body or the like (especially the eyes or the like) like ultraviolet rays, and is preferable in terms of safety.

According to the present invention, in an information providing system for providing various information including corresponding video information in response to a user's request, the system projects the video information from a video projector onto a screen and presents it to the user. Irradiate the desired position using a hand-operated device such as a remote controller that has a function of emitting light, the system displays a cursor at the irradiation position, and moves the cursor depending on whether the irradiation position moves below a threshold value or above. By controlling the cursor, the input device with a small amount of operation is used, the cursor does not react to the shaking of the user's hand, and the desired position can be easily specified.

Alternatively, by moving the cursor by a unit distance or by moving the cursor by a component image unit, while using the input means with a small operation amount,
It is less susceptible to camera shake and allows the desired position to be specified easily.

[0019]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 shows a configuration example of a terminal for implementing the information input method according to the embodiment of the present invention. In the figure,
1 is a remote controller, 2 is a screen, 3 is a video projector, 4 is a display control unit, 5 is an optical sensor unit, 6 is a coordinate value conversion unit, 7 is a communication control unit, 8 is a line control unit, 9 is an information receiving unit, Reference numeral 10 represents a speaker.

The remote controller 1, the screen 2, in the terminal
An example of arrangement of the video projector 3 and the optical sensor unit 5 is shown in FIG.
Shown in In front of the screen 2, there is a remote controller 1 operated by the user, and behind the screen 2, infrared rays emitted from the video projector 3 for projecting an image on the screen 2 and the remote controller 1 pass through the screen 2 and are irradiated. The optical sensor unit 5 is arranged.

The screen 2 and the video projector 3 are
It may be a so-called rear projection type display device housed in a single housing. Further, it may be a front projection type that projects from the front of the screen. In the front projection type, if the optical sensor unit 5 is arranged behind the screen 2 as shown in FIG. 2, a screen made of the same material as that in FIG. 2 can be used, but it is arranged in front of the screen 2. In this case, it is necessary to use a screen having a good reflection property for infrared rays.

Here, the substance of the remote controller 1 is, for example, a laser pointer used in a presentation using an OHP, in which emitted electromagnetic waves use infrared rays instead of visible light, or,
A remote controller for a television or the like, which has such a function of emitting infrared rays, can be given. Note that visible visible rays other than infrared rays can be used, but infrared rays are preferable from the viewpoint of safety for the human body and the like. As the infrared output device, various devices such as an infrared light emitting diode can be used, but it is preferable to use an infrared semiconductor laser device in terms of excellent light converging property. That is, the condensing optical system for emitting infrared rays of the remote controller 1 can be simplified.

A configuration example of the remote controller 1 is shown in FIG. In the figure,
The button "P" is a button for emitting infrared rays for specifying a position, and while the user is pressing the button, infrared rays are emitted from the screen transmission window 1a. The button "C" is a button for the user to request the system to perform processing regarding the current position of the cursor displayed by pressing the button "P". The buttons “1”, “2”, ..., “0” are buttons for inputting numbers, and the button “R” is a button for notifying the completion of inputting numbers. Button "C", button "1", "2", ...
When "0" and the button "R" are pressed, infrared rays different from the above are emitted from the processor-use transmission window 1b and transmitted to the information receiving section 9.

The optical sensor unit 5 is a block for measuring the two-dimensional position where the emitted infrared rays are irradiated on the screen 2, and as shown in FIG. 4, a lens for collecting the diffused infrared rays. 5a, a filter 5b for removing unnecessary electromagnetic waves, a light receiving surface 5c irradiated with infrared rays,
And a controller 5d for measuring the coordinate value irradiated on the light receiving surface 5c. The positions of the lens 5a and the filter 5b may be reversed.

The terminal is connected to the center through a line controller 8 by a communication network or the like. The center has still images,
It stores multimedia information such as moving images and sounds.
Here, the terminal itself may be a stand-alone type that holds such multimedia information.

After the connection is established between the terminal and the center, the menu request command is transferred from the terminal to the center. Upon receiving the menu request command, the center transfers a menu confirmation response to the terminal.

FIG. 5 shows an example of the structure of the menu request command and the menu confirmation response. As the parameter of the menu confirmation response, in addition to the total number of options and the menu body, there are option numbers that exist corresponding to the options and layout information that the options should be arranged on the screen.

When the terminal receives the menu confirmation response, the line controller 8 notifies the communication controller 7 of the menu confirmation response. The notification control unit 7 holds the option number and layout information that exist corresponding to the options for the parameters of the menu confirmation response, and the menu body notifies the display control unit 4. The display control unit 4 notifies the video projector 3 of the menu body. The video projector 3 projects the menu body concerned on the screen 2.

When the user looks at the menu displayed on the screen 2 and finds a desired option, he or she uses the remote controller 1 to emit infrared rays toward the option.

Here, FIG. 6 shows an example of inter-block interface information relating to infrared irradiation processing in the terminal. In the figure, a to o represent interfaces between blocks. Infrared irradiation processing in the terminal will be described below with reference to FIG.

The emitted infrared rays pass through the screen 2. The optical sensor unit 5 collects the infrared rays and removes unnecessary electromagnetic waves other than the infrared rays. Then, when the infrared ray is applied to the light receiving surface in the optical sensor unit 5, the optical sensor unit 5 measures the coordinate value in the light receiving surface to which the infrared ray is applied, and the coordinate value is applied to the coordinate value converting unit 6. Notify (A).

When the infrared ray is irradiated on the light receiving surface in the optical sensor section 5, the optical sensor section 5 always measures the coordinate value in the light receiving surface on which the infrared ray is irradiated, and coordinates the coordinate value. Notify the value conversion unit 6.

The coordinate value conversion unit 6 converts the coordinate value on the light receiving surface notified from the optical sensor unit 5 into the coordinate value on the screen 2, and notifies the communication control unit 7 of the coordinate value generated by the conversion. (I).

The communication control unit 7 requests the display control unit 4 to display the cursor at the position of the coordinate value notified above (c).

The display control unit 4 notifies the video projector 3 (D).

The video projector 3 projects the cursor on the screen 2 (e).

The communication control unit 7 calculates the distance between the subsequent coordinate value notified from the coordinate value conversion unit 6 and the immediately preceding coordinate value, and if the distance is less than a predetermined threshold value. If so, the coordinate value is ignored. If the distance is greater than or equal to the threshold value, the display control unit 4 is requested to move the cursor to the position of the coordinate value. The display control unit 4 notifies the video projector 3 of it. Video projector 3
Projects the cursor at the coordinate value on the screen 2.

The user looks at the cursor displayed on the screen 2 and, if the cursor is not at the desired position, emits infrared rays toward the remote controller 1 at the desired position on the screen 2.

Here, the terminal controls the display of the cursor with respect to the irradiated infrared rays in the same manner as described above.

The user looks at the cursor displayed on the screen 2 and, if the cursor is at the desired position, presses the button "C" on the remote controller to make a processing request.

When receiving the processing request from the user, the information receiving section 9 notifies the communication control section 7. Communication control unit 7
Extracts the option number and the layout information held in the above, checks which option the coordinate value of the cursor currently displayed corresponds to, and extracts the option number of the corresponding option. Then, the communication control unit 7 edits the search request command designating the option number, and the line control unit 8
Notify. The line control unit 8 transfers the search request command to the center.

In the above description, the communication control unit 7 ignores the coordinate value when there is no option corresponding to the coordinate value notified from the coordinate value conversion unit 6.

Here, FIG. 7 shows an example of a flowchart relating to the menu search processing in the terminal. In the figure, S1
S9 is the step number of the process.

First, when the center receives the search request command, it extracts the option number from the search request command, performs a search based on the option number, calls the corresponding multimedia information from the database, and confirms the search. Edit the response and transfer the search confirmation response to the terminal.

The structure of the search request command and the search confirmation response is shown in FIG. As parameters of the search confirmation response, in addition to the media type, the number of component videos, the video information body, and the sound information body, the component video numbers and the component videos that exist corresponding to the component videos that make up the video information are arranged on the screen. There is layout information to be done.

When the terminal receives the search confirmation response (S1), the line controller 8 notifies the communication controller 7 of the search confirmation response. Regarding the parameter of the search confirmation response, the communication control unit 7 holds the component video number and the layout information of the component video that are present in correspondence with the component video, and the video information body notifies the display control unit 4. The display control unit 4 notifies the video projector 3 of the image information body. The video projector 3 projects the image information body on the screen 2 (S2). Further, if there is a sound information body, the communication control unit 7 outputs the sound information body to the speaker 10.

When the user looks at the image information displayed on the screen 2 and finds a desired component image, he or she uses the remote controller 1 to emit infrared rays toward the component image.

The emitted infrared rays pass through the screen 2. The optical sensor unit 5 collects the infrared rays and removes unnecessary electromagnetic waves other than the infrared rays. Then, when the infrared ray is applied to the light receiving surface in the optical sensor unit 5, the optical sensor unit 5 measures the coordinate value in the light receiving surface to which the infrared ray is applied, and the coordinate value is applied to the coordinate value converting unit 6. Notice.

The optical sensor section 5 always measures the coordinate value in the light receiving surface irradiated with the infrared ray when the infrared ray is irradiated to the light receiving surface in the optical sensor section 5, and the coordinate value is coordinated. Notify the value conversion unit 6.

The coordinate value conversion unit 6 converts the coordinate value on the light receiving surface notified from the optical sensor unit 5 into the coordinate value P1 on the screen 2, and the coordinate value P1 generated by the conversion.
To the communication control unit 7.

The communication control unit 7 requests the display control unit 4 to display the cursor at the position of the coordinate value P1 notified above. The display control unit 4 notifies the video projector 3 of it. The video projector 3 projects the cursor on the screen 2 (S3).

The communication control unit 7 calculates the distance from the immediately preceding coordinate value regarding the subsequent coordinate value Pn measured by the optical sensor unit 5 and notified from the coordinate value conversion unit 6 (S4) (S4).
5) If the distance is less than a predetermined threshold value, the coordinate value is ignored (S6: YES). If the distance is equal to or greater than the threshold value, the communication control unit 7 requests the display control unit 4 to move the cursor to the position of the coordinate value (S6: NO). The display control unit 4 notifies the video projector 3 of it. The video projector 3 projects the cursor at the position of the coordinate value Pn on the screen 2 (S7).

The user looks at the cursor displayed on the screen 2 and, if the cursor is not at the desired position, emits infrared rays to the remote controller 1 toward the desired position on the screen 2 (S8). : NO).

Here, the terminal controls the display of the cursor with respect to the irradiated infrared rays in the same manner as described above.

The user looks at the cursor displayed on the screen 2 and makes a processing request if the cursor is at the desired position (S8: YES).

When receiving the processing request from the user, the information receiving unit 9 notifies the communication control unit 7. Communication control unit 7
Extracts the component video number and the layout information held in the above, checks which component video the coordinate value of the cursor currently displayed corresponds to, and extracts the component video number of the corresponding component video. Then, the communication control unit 7 edits the search request command specifying the component video number and notifies the line control unit 8 of it. The line controller 8 transfers the search request command to the center (S9).

The above is an example of the menu search processing in the terminal.

Upon receiving the search command from the terminal, the center extracts the part video number from the search request command, performs a search based on the part video number, and stores the multimedia information related to the part video in the database. Read the search confirmation response, edit the search confirmation response, and transfer the search confirmation response to the terminal.

When the terminal receives the search confirmation response, the line controller 8 notifies the communication controller 7 of the search confirmation response. The communication control unit 7 extracts the video information body from the parameters of the search confirmation response and notifies the display control unit 4 of the video information body. The display control unit 4 displays the main body of the image information in the video projector 3
Notify. The video projector 3 projects the image information body on the screen 2. Further, the communication control unit 7
The sound information body is output to the speaker 10.

In the above embodiment, the threshold value is fixed irrespective of the environment in which the user operates the system, but the threshold value may be changed depending on the environment in which the user operates the system. In the case of changing the, the system holds in advance the correspondence relationship between various environments operated by the user and the thresholds under the environment, and the environment operated by the user when the user accesses the system. Alternatively, it can be realized by adding a function of measuring using a sensor.

Further, in the above-described embodiment, the embodiment in which the threshold value is fixed regardless of the user has been described. However, in the case of setting the threshold value corresponding to the user, the system moves to the cursor corresponding to the user. History information about the movement locus of the cursor and the position of the cursor at the time when the user makes a processing request, and calculates the distance from the position of the cursor at the time when the user makes a processing request to set a threshold value. Once determined and the user has access to the system, the system can be implemented by adding the ability to identify the user and apply the user's threshold.

Further, in the above-described embodiment, the embodiment in which the cursor is moved to an arbitrary position by using the threshold value has been described. However, the cursor is fixed and the distance is set to 1 in a predetermined distance unit. When moving by units, a cursor lock button and a cursor lock release button (to release the status "Cursor lock") are added to the remote control to function as follows. First, when the user presses the cursor fixing button, infrared rays are emitted from the processor transmission window, and the cursor fixing is transmitted to the information receiving unit 9. Upon receiving the cursor fixation, the information reception unit 9 notifies the communication control unit 7, and the communication control unit 7 sets the state to “cursor fixation”, and in this state, detects the movement direction of the irradiation position and moves the movement. Move the cursor one unit in the direction. It can be realized by having the above functions.

Further, in the case of moving the cursor in units of component image information, the distance between the irradiation position and the component image information is calculated based on the irradiation position and the layout information of the component image information, and the component image information with the minimum distance is calculated. This can be realized by displaying the cursor at the position, detecting the moving direction of the irradiation position, extracting the component image information existing in the moving direction, and moving the cursor to the component image information.

[0065]

As described above, according to the present invention,
In an information providing system that provides various kinds of information including corresponding video information on a screen in response to a user's request, the user can accurately and quickly instruct a desired position and control the user's operation amount. It is possible to reduce.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration example of a terminal for implementing an information input method according to an embodiment of the present invention.

FIG. 2 is a diagram showing an arrangement example of blocks in the terminal.

FIG. 3 is a diagram showing a configuration example of a remote controller in the terminal.

FIG. 4 is a diagram showing a configuration example of an optical sensor unit in the terminal.

FIG. 5 is a diagram showing a configuration example of a menu request command and a menu confirmation response transferred between the terminal and the sensor.

FIG. 6 is a diagram showing an example of inter-block interface information relating to infrared irradiation processing in the terminal.

FIG. 7 is a flowchart showing an example of a menu search process in the terminal.

FIG. 8 is a diagram showing a configuration example of a search request command and a search confirmation response transferred between the terminal and the sensor.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Remote control 2 ... Screen 3 ... Video projector 4 ... Display control part 5 ... Optical sensor part 6 ... Coordinate value conversion part 7 ... Communication control part 8 ... Line control part 9 ... Information receiving part 10 ... Speaker

Claims (6)

[Claims] 1. An information providing system for providing various information including corresponding video information according to a user's request, a step of projecting the video information from a projection means to a screen and presenting it to the user, and the user emitting a visible line. Detecting the irradiation position on the projected screen desired by the user, which is irradiated by using the hand operation means having a function, and displaying a cursor at the irradiation position, and the user irradiating position of the visible external line Is moved, the amount of movement of the irradiation position is detected, and if the amount of movement is less than the threshold value, the cursor is held at the display position, and the detected amount of movement of the irradiation position is greater than or equal to the threshold value. For example, the step of moving the display position of the cursor according to the movement amount of the irradiation position, and the step of moving the cursor at the time when the process is requested when the user requests the process. Information input method and having a the steps of performing a process corresponding to the shown position. 2. The threshold value of the movement amount of the irradiation position of the visible line is a threshold value determined by the information providing system by measuring the environment in which the user operates the information providing system and determining the value according to the measured value. The information input method according to claim 1, wherein 3. The operation history information of the hand-held operation means is collected for the user at the stage of stopping or moving the display position of the cursor according to the amount of movement of the irradiation position of the visible external line by the user. The threshold value of the amount of movement of the irradiation position of the visible external line is determined and maintained based on the above, and the user operating the hand operation means is identified and the threshold value of the user is applied. The information input method described in item 1. 4. An information providing system for providing various information including corresponding video information according to a user's request, a step of projecting the video information from a projection means to a screen and presenting it to the user, and the user emitting a visible line. The step of detecting the irradiation position on the projected screen desired by the user irradiated by using the hand operation means having a function and displaying the cursor at the irradiation position, and the case where the user requests the cursor fixation In addition, while fixing the display position of the cursor, when the user moves the irradiation position of the visible external line, the moving direction of the irradiation position is detected and the display position of the cursor in the moving direction is a predetermined unit. The step of moving by the distance and the process corresponding to the display position of the cursor at the time of requesting the process when the user requests the process. Information input method and having a and performing. 5. An information providing system for providing various information including corresponding video information according to a user's request, a step of projecting the video information from a projection means to a screen and presenting it to the user, and the user emitting a visible line. Presence of part image information existing at the irradiation position or part image information existing at the irradiation position by detecting the irradiation position on the projected screen desired by the user irradiated by using the hand operation means having a function. If not, the step of displaying the cursor on the image information of the part close to the irradiation position, and when the user moves the irradiation position of the visible line, the moving direction of the irradiation position is detected and the part existing in the moving direction is detected. The step of moving the display position of the cursor to the video information, and, when the user requests processing, the cursor at the time of requesting the processing. Information input method and having the steps, the performing a process corresponding to the display position. 6. The information input method according to claim 1, wherein the visible external line is infrared rays.