JP4736605B2 - Display device, information processing device, and control method thereof - Google Patents

Description

  The present invention relates to a display device having a display screen for displaying various types of information, and more particularly to a display device having a function of performing predetermined input by designating an image displayed on the display screen with a finger or a pointing device.

  Conventionally, in a display device provided in a personal computer, a coordinate detection device is arranged on a display screen, and an icon displayed on the display screen is designated by a pen input device such as a tablet, thereby detecting the designated position. A device having a pen input interface function that is detected by a device and switches a display screen according to the designated content or performs voice synthesis output of a message corresponding to the designated content is known.

However, since a conventional display device having a pen input interface function is a feedback interface by visual and auditory senses, for example, in providing information of digital content oriented to reality, such as three-dimensional stereoscopic expression, quality and operation Since there is a limit to the nature, it is desirable to realize a more intuitive reality.
Further, in the above-described conventional display device, the touch feeling between the screen and the pen tip is uniform, slippery and hard, so there is a sense of incongruity and uncertainty compared to the actual paper and pen touch feeling as a metaphor. There are many users who are not familiar with pen input.

Accordingly, an object of the present invention is to provide a display device, an information processing device, and a control method thereof that can realize a more realistic interface function at a low voltage in addition to an interface mechanism using simple visual means and auditory means. It is in.

In order to achieve the above object, the present invention provides a display device having a display screen for displaying various image information, contact position detection means for detecting a contact position on the display screen by a predetermined contact means, and the contact position detection. Movement determination means for determining the moving speed of the contact position by the contact means detected by means, vibration generation means for vibrating the display screen, and vibration control means for controlling the vibration generation means, The vibration control means vibrates the display screen by outputting a signal corresponding to the vibration according to the determination result by the movement determination means to the vibration generation means.
According to the present invention, in an information processing apparatus having a display screen for displaying various types of image information, a contact position detection unit that detects a contact position on the display screen by a predetermined contact unit, and a detection by the contact position detection unit A movement determination unit that determines a moving speed of the contact position by the contact unit; a vibration generation unit that vibrates the display screen; and a vibration control unit that controls the vibration generation unit, the vibration control unit Is characterized in that the display screen is vibrated by outputting a signal corresponding to the vibration according to the determination result by the movement determining means to the vibration generating means.
Further, the present invention is a control method for a display device having a display screen for displaying various information, a contact position detecting step of detecting a contact position to the display screen by the predetermined contact means, detected by the contact position detection step A movement determination step for determining a moving speed of the contact position by the contact means, a vibration generation step for vibrating the display screen, and a vibration control step for controlling the vibration generation step , the vibration control step. Is characterized in that the display screen is vibrated by outputting a signal corresponding to the vibration corresponding to the determination result in the movement determination step to the vibration generation step.
Further, the present invention provides a method for controlling an information processing apparatus having a display screen for displaying various types of information, by a contact position detection step for detecting a contact position on the display screen by a predetermined contact means, and the contact position detection step . A vibration determination step for determining a moving speed of the contact position by the contact means to be detected; a vibration generation step for vibrating the display screen; and a vibration control step for controlling the vibration generation step; The step is characterized in that the display screen is vibrated by outputting a signal corresponding to the vibration according to the determination result in the movement determination step to the vibration generation step.

Display device, the information processing apparatus of the present invention, and the control method thereof, the vibration signal for detecting a contact position on the display screen, to determine the moving speed of the contact position, corresponding to the response Ji vibration on the determination result Since the display screen is vibrated by outputting to the generation means, for example, when a specific position of the display screen is designated by a contact means such as a finger or a pen, vibration corresponding to the moving speed of the contact position is displayed on the display screen. by providing a transmitted to the operator via the vibration contact means in response to operation of the operator. As a result, the touch sensation that has been inorganic in the past can be improved and sensory reality can be provided to the operator.

Embodiments of the display device according to the present invention will be described below.
FIG. 1 is a perspective view showing an example of the appearance of a display device according to the present invention, and FIG. 2 is an exploded perspective view showing the configuration of the display device shown in FIG.
The display device of this example includes a display panel 100, a vibration element 200, a position sensor sheet 300, and a wiring board 400, and designates a display area on the display panel 100 with, for example, a pen 500 or fingers. is there.
The display panel 100 constitutes an LCD display screen, and displays various images and character strings.
The vibration element 200 is composed of, for example, a piezoelectric element or the like, and supports the display panel 100 so as to be finely movable from both sides thereof, and applies vibration to the display panel 100.

The position sensor sheet 300 detects a contact position of the pen 500 or the like with respect to the display panel 100 by a principle such as an electromagnetic induction method or an electrostatic coupling method.
The wiring board 400 is provided with a control circuit 410 that inputs a signal from a personal computer (not shown) to output display information on the display panel 100 and processes a detection signal from the position sensor sheet 300.
In addition, the wiring board 400 is provided with a signal conversion circuit 420 that outputs a drive signal for the vibration element 200 based on a control signal from the control circuit 410.

In the display device configured as described above, the control circuit 410 displays an image on the display panel 100 based on various commands and data from the personal computer. This image display includes an image in which options to be selected by the operator with the pen 500 are displayed using windows, icons, etc., and an image for the operator to perform arbitrary drawing with the pen 500.
In a state where such image display control is performed, the position sensor sheet 300 detects the position of the pen 500 that is in contact with the display panel 100. Then, the position sensor sheet 300 outputs this position detection data to the control circuit 410.

Based on the position detection data from the position sensor sheet 300, the control circuit 410 recognizes, for example, a selection instruction by an operator, and performs various processes such as screen switching and data acquisition based on the instruction.
Further, the control circuit 410 collates the position detection data from the position sensor sheet 300 with the position data of a specific image (object) displayed on the display panel 100. The vibration corresponding to is determined in real time based on a predetermined algorithm. In this determination, a table in which the vibration type is associated with the position data of the object is stored in advance in the memory of the control circuit 410, and the vibration type may be determined with reference to this table. .

Then, the control circuit 410 outputs a control signal corresponding to the determined vibration to the signal conversion circuit 420. The signal conversion circuit 420 outputs a drive signal to the vibration element 200 in response to the control signal. Thereby, the vibration element 200 operates to vibrate the display panel 100.
Then, by changing the frequency, amplitude, etc. when vibrating the display panel 100, vibration corresponding to the object can be transmitted to the operator via the pen 500 or the like, and a more realistic interface function can be obtained. .

Next, a specific example of the correspondence relationship between the object type and the vibration type will be described.
FIG. 3 is an explanatory diagram showing an example of changing the intensity and waveform of vibration according to the contrast of an object.
As shown in FIG. 3A, the display panel 100 includes a stripe image 10A having a clear outline, a thin stripe image 10B having a clear outline, a stripe image 10C having a clear outline, and a thick stripe having a clear outline. An image 10D is displayed.

When the pen 50 is advanced so as to cross these stripe images 10A to 10D, the outline of the stripe images 10A to 10D is synchronized with the displacement of the contact point as shown in FIG. Vibrations 12 </ b> A to 12 </ b> D corresponding to the strength and width of the sound are generated and transmitted to the operator via the pen 500.
Thus, when the operator operates the pen 500 on each of the stripe images 10A to 10D, the operator can feel a certain sense of resistance by receiving vibration according to the stripe images 10A to 10D.
As a result, it is possible to give a more realistic operational feeling as compared to operating the pen 500 with an inorganic and uniform contact feeling. Therefore, a more realistic interface function can be achieved by linking the change in operational feeling caused by vibration received from the pen 500, the visual effect by switching the display image, and the auditory effect by voice synthesis. Obtainable.

  In addition to the image contrast described above, the image color, meaning, image attribute, and the like can be used as the image condition for selecting vibration. Here, the meaning of the image is, for example, changing vibration between an image representing the sun and an image representing the moon, or changing vibration between an image representing a person and an image representing a dog. The image attribute is to change the vibration depending on, for example, whether the display image is a character string image or a picture or graphic image.

4 and 5 are explanatory diagrams showing examples of tactile sensation conversion of various objects as described above.
In FIG. 4B, the intensity of the vibration is indicated by the height of the mountain, and the vibration having the intensity as shown in FIG. 4B is applied to the visual display image as shown in FIG. The resistance when the pen 500 is moved can be changed according to the strength of the generated light.
Further, in FIG. 5B, the type of vibration is shown by the type of diagonal lines, and the vibration is changed as shown in FIG. 5B with respect to the visual display image as shown in FIG. 5A. Thus, the resistance when the pen 500 is moved can be changed.
The tactile sensation conversion of various objects can be performed by such a change in vibration, and the object can be recognized as a three-dimensional object.

In the above example, the contact position of the pen 500 is detected and vibration is generated according to the contact position. However, instead of the position sensor sheet 300 described above, for example, a transparent surface is formed on the upper surface of the display panel 100. The pressure sensor sheet or the sensor sheet capable of detecting the contact surface may be provided, and the vibration may be changed based on the detection result by detecting the contact pressure of the pen 500 and the size of the contact surface.
For example, FIG. 6 is an explanatory diagram illustrating an example in which the type of the pen 500 is identified based on the contact pressure of the pen 500 and the size of the contact surface, and the strength and waveform of the vibration are changed according to the identification result.

As shown in FIG. 6A, by distinguishing the drawing 20A by the felt pen, the drawing 20B by the chalk, and the drawing 20C by the crayon, as shown in FIG. 6B, 22A corresponding to each writing instrument. ˜22C is generated and transmitted to the operator via the pen 500.
In addition to the writing instrument, it is of course possible to assume other materials (for example, fingers) and change the vibration accordingly. Similarly, the contact pressure by the pen 500 can be detected, and the vibration can be changed according to the contact pressure.

Further, the movement speed of the material can be determined by detecting the contact position, and the vibration can be changed according to the result. Furthermore, the vibration may be changed by a combination of the material type, contact pressure, and moving speed.
Further, by combining the position detection sensor and the pattern analysis device, it is possible to recognize the attribute and meaning of the image being input, and to change the vibration based on the recognition result.
For example, for a certain option, in a system in which a circle is selected by YES and a cross is selected by inputting a pen 500 with NO, whether the locus of the pen 500 is round or cross is determined in real time during the input, and this determination is made. It is also possible to adopt a configuration in which the vibration intensity is gradually changed accordingly.

It is a perspective view which shows the example of an external appearance of the display apparatus by this invention. It is a disassembled perspective view which shows the structure of the display apparatus shown in FIG. FIG. 2 is an explanatory diagram illustrating an example in which vibration is changed according to the contrast of an object in the display device illustrated in FIG. 1. FIG. 2 is an explanatory diagram illustrating an example of tactile sensation conversion of an object in the display device illustrated in FIG. 1. FIG. 10 is an explanatory diagram illustrating another example of tactile sensation conversion of an object in the display device illustrated in FIG. 1. In the display apparatus shown in FIG. 1, it is explanatory drawing which shows the example which changes a vibration based on the contact pressure of a pen, and the magnitude | size of a contact surface.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Display panel, 200 ... Vibration element, 300 ... Position sensor sheet, 400 ... Wiring board, 410 ... Control circuit, 420 ... Signal conversion circuit, 500 ... Pen.

Claims (7)

In a display device having a display screen for displaying various image information,
Contact position detection means for detecting a contact position on the display screen by a predetermined contact means;
A movement determination means for determining a moving speed of the contact position by the contact means detected by the contact position detection means;
Vibration generating means for vibrating the display screen;
Vibration control means for controlling the vibration generation means,
The vibration control means vibrates the display screen by outputting a signal corresponding to vibration according to a determination result by the movement determination means to the vibration generation means.
A display device characterized by that.   The display device according to claim 1, wherein the movement determination unit further determines a locus of the contact position by the contact unit.   The display device according to claim 1, wherein the vibration generating unit is configured to support the display screen so that the display screen can be finely moved from both sides thereof. Further comprising a contact pressure detecting means for detecting the contact pressure which the display screen is subjected, the vibration control means, in response to more detected contact pressure to the contact pressure detected hand stage to produce the vibration generating means The display device according to claim 1, wherein the vibration is changed. In an information processing apparatus having a display screen for displaying various image information,
Contact position detection means for detecting a contact position on the display screen by a predetermined contact means;
A movement determination means for determining a moving speed of the contact position by the contact means detected by the contact position detection means;
Vibration generating means for vibrating the display screen;
Vibration control means for controlling the vibration generation means,
The vibration control means vibrates the display screen by outputting a signal corresponding to vibration according to a determination result by the movement determination means to the vibration generation means.
An information processing apparatus characterized by that. In a control method of a display device having a display screen for displaying various information,
A contact position detection step of detecting a contact position on the display screen by a predetermined contact means;
A movement determination step of determining a movement speed of the contact position by the contact means detected by the contact position detection step ;
A vibration generating step of vibrating the display screen;
A vibration control step for controlling the vibration generation step ,
The vibration control step vibrates the display screen by outputting a signal corresponding to vibration according to a determination result by the movement determination step to the vibration generation step.
A control method for a display device. In a control method of an information processing apparatus having a display screen for displaying various information,
A contact position detection step of detecting a contact position on the display screen by a predetermined contact means;
A movement determination step of determining a movement speed of the contact position by the contact means detected by the contact position detection step ;
A vibration generating step of vibrating the display screen;
A vibration control step for controlling the vibration generation step,
The vibration control step vibrates the display screen by outputting a signal corresponding to vibration according to a determination result by the movement determination step to the vibration generation step.
A method for controlling an information processing apparatus.

Images