JP2004046792A - Display input device, display input system, method for controlling the system, and man-machine interface device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display input device for inputting analog data with a simple and intuitive operation, and also to provide a display input system provided with the device. <P>SOLUTION: The display input device includes: a display part (20) having flexibility; a shape change detecting part (30) for detecting displacement caused by the flexibility as the change of an electric characteristic. The display input system includes: a display driving part for giving a picture display signal to the display part; and a signal determining part for determining input data corresponding to the displacement based on the change of the electric characteristic in the shape change detecting part, to input first data by giving the displacement to the display input device. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a display input device and a display input system, in particular, not only digital information but also analog information or vector information by combining a display unit having flexibility with respect to shape change and an input unit capable of detecting shape change. The present invention relates to a display input device capable of inputting information and a display input system including the same.
[0002]
[Prior art]
As a currently widely used input device combined with a display device, for example, a “touch panel” can be given. In this method, for example, a matrix signal input mechanism is formed on a display screen, and signal input is performed by detecting the presence or absence of a signal input and its coordinate position. That is, when the user contacts the detection unit at the position corresponding to the button display on the display device side, the device side can detect the position information and the presence or absence of the input.
[0003]
In such an input method, the coordinate position can be detected, but the signal is substantially limited to an on / off binary signal. This is because it is not easy for the user to make contact while controlling the pressing force precisely. For this reason, when inputting multi-value information or analog information, it is necessary to separately combine, for example, a numerical selection type input or a ten-key input as a signal amount corresponding to the button display position. That is, from the viewpoint of the user, in the case of multi-value or analog value input, it is necessary to separately select an input item and input an analog value.
[0004]
On the other hand, in recent years, research and development of a display member having both advantages of paper and electronic display, which are called paper-conscious electronic paper, have been performed (for example, Patent Document 1), and have not yet reached commercialization. Nevertheless, prototype-level devices are becoming available.
[0005]
[Patent Document 1]
JP-A-2002-72257
[0006]
[Problems to be solved by the invention]
However, in particular, in the case of a device that emphasizes portability, it is desirable that a large amount of information can be input by an operation as simple as possible from the viewpoint of the usage form. An example of such a portable device is an “electronic book” that is currently under development. When a content such as a novel, a magazine, or a newspaper is reproduced using an electronic book, turning over a page or scrolling a display screen is a main operation. For this operation, it is also possible to use a touch panel type input method as in the conventional example. However, in the case of contents such as magazines and newspapers, since the contents are diversified and discrete, random access over several pages or dozens of pages is required. Multi-value or analog value input function is required. At this time, the operability and the portability of the conventional ten-key input and numerical selection type input are limited.
[0007]
In addition, in information displayed in a large area such as a map, a part of the information is displayed from the viewpoint of the area and definition of the display device, and a method of searching for a position desired by a user by a scroll function or the like is widely used. Have been. At this time, in a device having an input device such as a mouse or a pointing device, the scroll direction and the movement amount can be input in analog form. However, in a portable device, since a touch panel is mainly used as an input device, it is difficult to easily input an arbitrary screen scroll direction and an amount of movement thereof.
[0008]
As described above, in the input device added to the conventional display device, since there is no simple method of inputting the signal amount as an analog value, for example, when switching the display across several tens of pages, When inputting, both hands are required and many operations are required of the user side, and the burden on the user side is increasing.
[0009]
The present invention has been made based on the recognition of such a problem, and a purpose thereof is to provide a display input device capable of performing input of analog data and vector data by a simple and intuitive operation based on an original idea. It is an object of the present invention to provide a display input system provided with this.
[Means for Solving the Problems]
In order to achieve the above object, a cover input device of the present invention includes a display unit having flexibility, a first shape change detection unit capable of detecting a displacement caused by the flexibility as a change in electrical characteristics, It is characterized by having.
[0010]
According to the above configuration, it is possible to provide a display input device capable of inputting analog data and vector data by a simple and intuitive operation.
[0011]
Here, the first shape change detection unit may be stacked on the display unit.
In addition, the first shape change detection unit may extend close to a display surface of the display unit.
Further, the change in the electrical characteristic may be dependent on the amount of the displacement.
Further, the first shape change detection unit has a pair of conductive layers and a sensing layer provided therebetween, and when the displacement is applied, the resistance between the pair of conductive layers is reduced. It can change.
The first shape change detection unit may include a plurality of divided areas, and each of the divided areas can independently detect the displacement.
[0012]
Further, the apparatus may further include a first shape change detection unit or a second shape change detection unit stacked on the display unit.
Further, the display section has a pair of substrates made of a flexible material, and the shape change detection section has a pair of substrates made of a flexible material, and the display section and the shape change detection. The part may be bonded.
[0013]
The display unit may include a pair of substrates made of a flexible material, and the shape change detection unit may be provided between the pair of substrates.
[0014]
On the other hand, a first display input system according to the present invention includes the first display input device, a display drive unit that supplies an image display signal to the display unit, and the electrical characteristic in the first shape change detection unit. And a signal determination unit that determines input data corresponding to the displacement based on a change in the first input data by applying the displacement to the display input device. And
[0015]
According to the above configuration, it is also possible to provide a display input system capable of inputting analog data and vector data by a simple and intuitive operation.
[0016]
Also, in this system, the change in the electrical characteristic may be dependent on the amount of the displacement.
[0017]
In this system, the first shape change detecting section or the second shape change detecting section stacked on the display section is further provided, and the first shape change is detected by applying the displacement. It is possible to enable input of first data depending on a difference in change in electrical characteristics between the detection unit and the second shape change detection unit.
[0018]
Here, the signal determination unit may determine the input data based on the speed or acceleration of the displacement.
[0019]
In addition, a data input unit capable of inputting second data by a user's operation is further provided, and based on the second data input to the data input unit, whether or not the first data can be input is determined. Can be determined.
[0020]
In addition, the apparatus further includes a posture change detection unit that detects a change in posture of the display input device, and the signal determination unit determines the input data in consideration of the change in the posture detected by the posture change detection unit. Things.
[0021]
Further, the shape change detection unit may extend close to a display surface of the display unit.
[0022]
In the specification of the present application, “displacement due to flexibility” refers to a displacement associated with a shape change such as “bending”, “rounding”, “turning”, and “twisting”. In the case of data input by touching the sensor surface as in a conventional touch panel sensor, the sensor surface may be slightly depressed by strongly pressing the sensor surface. However, such a slight depression is not included in the “displacement due to flexibility” in the present specification.
[0023]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0024]
FIG. 1 is a conceptual diagram illustrating a display input system according to an embodiment of the present invention. That is, the display input system of the present embodiment includes the display input device 10 and the drive determination unit 12.
[0025]
The display input device 10 has, for example, a structure in which a display unit 20 and a shape change detection unit 30 are stacked. As a display method of the display unit 20, for example, a method using liquid crystal, a method using EL (electroluminescence), or various methods including an ECD (electrochromic device) method can be used. Also, various driving methods such as a simple matrix method, an active matrix method using two-terminal elements, and an active matrix method using three-terminal elements can be used for driving each display unit.
[0026]
On the other hand, the shape change detection unit 30 has, for example, a structure in which a sensing layer whose resistance value changes due to stress applied between a pair of electrode layers is inserted. When deformation such as “bending”, “rounding”, “turning”, and “twisting” is applied to the flexible display input device 10, the shape change detection unit 30 electrically converts such deformation. It can be detected as a change in characteristic.
[0027]
As will be described in detail later, the display unit 20 and the shape change detection unit 30 may be partially shared, or the shape change detection unit 30 may be incorporated in the display unit 20, or conversely, The display unit 20 may be incorporated in the detection unit 30.
[0028]
Furthermore, the display unit 20 and the shape change detection unit 30 do not need to be completely stacked as shown in FIG. As will be described later with reference to FIG. 14 and the like, the shape change detection unit 30 may be stacked only on a part of the display unit 20. Further, as described with reference to FIG. 51 and the like, the display unit 20 and the shape change detection unit 30 may not be stacked and may be arranged close to each other.
[0029]
On the other hand, the drive determination unit 12 includes a display drive unit 120 and a signal determination unit 130. The display driving unit 120 has a role of outputting an image display signal to the display unit 20 to display a predetermined image. On the other hand, signal determination section 130 determines input information based on a signal received from shape change detection section 30. The display drive unit 120 and the signal determination unit 130 may be integrated as a part of the display input device 10 or may be provided outside the display input device 10 as a separate element.
[0030]
The display unit 20 and the shape change detection unit 30 have flexibility for “bending”. In the present invention, in order to input predetermined data, a stress such as “bending” B is applied to the display input device 10 by applying an external stress. Then, the shape change detection unit 30 detects the “bending” B and outputs a signal relating to the direction and the amount of stress. That is, an analog output corresponding to the amount of “bending” is provided. The signal determination unit 130 determines the input data by converting the analog signal into a signal suitable for output to an external device such as a voltage value and outputting the signal.
[0031]
Here, the location where the “bend” B is added may be an image display area (not shown) of the display unit 20 or an area other than the image display unit. However, as will be described in detail later, if the "bending" B can be detected in the image display area, various data inputs in which the image display and the data input position are linked can be performed.
[0032]
The place where the “bend” B is added may be near the center of the display input device. Alternatively, a “bend” may be added so as to be concave or convex over the entire display input device 10.
[0033]
When a substrate made of an organic material such as a plastic film is used as a support substrate for the display unit 20 and the shape change detection unit 30, not only weight reduction and improvement in impact resistance but also excellent flexibility against "bending" can be achieved. Become. That is, by applying an external stress, the shape change detection unit 30 can be deformed by applying “bending”. The user of the display / input device can hold the display / input device 10 with one hand or both hands and adjust the position to apply “bending”, the degree of bending, the area to be bent, and the like by an arbitrary amount.
[0034]
For example, in a case where the user holds the A4 size film-shaped display input device 10 with the left hand, for example, a “bend” is added near the upper end on the left side of the film or a “bend” is set near the lower end. Can be input in analog form as the degree of force applied when “bending” is applied, the curvature at the time of bending, the speed or acceleration at the time of bending, and the like. Such information is detected by a function of the shape change detection unit 30 capable of converting an electric signal, and the signal is processed by the signal determination unit 130, so that the information input by the user with the left hand can be determined.
[0035]
FIG. 2 is a schematic view illustrating a basic cross-sectional configuration of the display input device of the present invention. That is, as illustrated in FIG. 7A, the shape change detection unit 30 can be stacked on the back surface side of the display unit 20 when viewed from the user 200. In this case, for example, when the reflection type liquid crystal mode or the like is used for the display unit 20, the shape change detection unit 30 does not need to have a light transmitting property, and thus can be formed of a light shielding material.
[0036]
On the other hand, as illustrated in FIG. 2B, the shape change detection unit 30 may be stacked on the surface side of the display unit 20 when viewed from the user 200. In this case, the shape change detection unit 30 needs to have a predetermined translucency so as not to block the display of the display unit 20.
[0037]
FIG. 3 is a schematic diagram illustrating a principle of performing an analog input in the present invention. That is, this figure is a perspective view showing one end of the display input device of the present invention.
[0038]
In a state where “bending” is not applied, the display input device (shape change detection unit 30) is assumed to be in a substantially flat state 30A. When a stress having a magnitude indicated by an arrow -a is applied downward from this state, a state 30B is obtained in which a predetermined amount of “bending” is applied. On the other hand, when a stress having a magnitude represented by the arrow -b is also applied downward, a state 30C in which a larger “bend” is applied is formed. In the present invention, for example, the magnitude and the area of the amount of displacement caused by the “bending” or the product of them enables input of analog information corresponding thereto.
[0039]
On the other hand, in the present invention, it is also possible to input information by the speed or acceleration of “bending” separately from the displacement amount accompanying “bending”. For example, as shown in FIG. 4, when “bending” is applied from the initial state 30 </ b> A to the final state 30 </ b> C, when “bending” is applied slowly over a long time (arrow-b 1), The amount of information input can be changed when "bending" is added quickly. Specifically, for example, when "bending" is quickly added (arrow -b2), the input amount may be increased.
[0040]
The speed or acceleration of such “bending” can be detected by examining the change over time of the displacement amount.
[0041]
FIG. 5 is a schematic diagram illustrating the principle of distinguishing inputs according to the direction of “bending” in the present invention. That is, this figure is also a perspective view showing one end of the display input device of the present invention.
[0042]
As illustrated in the figure, when "bending" is applied to the end of the display input device 10, it can be bent in the direction of arrow + a, that is, upward (30B), or bent in the direction of arrow -a, that is, downward (30C). ) You can also. Then, according to the direction of the “bending”, it is possible to distinguish the sign of the input data, expand the range, or increase the types.
[0043]
For example, if the data is bent in the direction of the arrow + a, the data is identified as positive data. If the data is bent in the direction of the arrow -a, the data is identified as negative. Can be.
[0044]
Further, the range of data that can be arbitrarily selected by the user may be continuously associated from the arrow + a to the arrow -a.
[0045]
Also, the case where bending is performed in the direction of arrow + a corresponds to the first data range that can be selected by the user, and the case where bending is performed in the direction of arrow -a is a second data range different from the first data range. May be used.
[0046]
As a method for identifying the direction of such “bending”, for example, two shape change detection units 30 may be stacked as described later in detail. When a plurality of shape change detection units 30 are stacked and “bent” is applied, the curvature change, stress, displacement amount, and the like are different between the upper and lower shape change detection units. Accordingly, the signal determination unit 130 (see FIG. 1) can determine the direction of “bending” by detecting the difference between these parameters between the upper and lower shape change detection units 30.
[0047]
FIG. 6 is a conceptual diagram illustrating the structure of the shape change detection unit 30. That is, the electrode patterns 33 and 34 are formed on the inner surfaces of the pair of flexible substrates 31 and 32, respectively. The sensing layer 35 is provided between these electrode patterns. The sensing layer 35 is a layer having a property in which electrical properties are changed by at least one of stress and displacement. By utilizing this property, it is possible to detect the applied stress or the amount of displacement in each area divided in a matrix by the upper and lower electrode patterns 33 and 34.
[0048]
As the substrates 31 and 32, a plate or a film made of a flexible resin or the like can be used. The electrode patterns 33 and 34 may be formed by forming a metal or conductive material by printing, plating, sputtering, vapor deposition, or the like, and processing the shape using a photoetching process or the like.
[0049]
As the sensing layer 35, for example, an organic material, an inorganic material, and a semiconductor material whose resistivity is variable by pressure, and an organic material, an inorganic material, and a semiconductor material whose resistance value is variable by a volume change are appropriately selected and used. it can. Alternatively, a piezoelectric material or a dielectric material may be used. Specifically, polyvinylidene fluoride (PVDF) may be used as the resistive material, or liquid polyvinyl alcohol may be sealed. Alternatively, the electrode patterns may be held in a state of being separated from each other by a predetermined distance via a spacer.
[0050]
Further, the sensing layer 35 does not necessarily need to be provided separately for each divided region of the matrix, and may be formed continuously between the substrates 31 and 32. For example, when the sensing layer 35 is formed of a resistive film, the resistance value in the horizontal direction (in-plane direction of the substrate 31) is generally much higher than that in the vertical direction (the film thickness direction). Is negligible.
[0051]
FIG. 7 is a schematic diagram illustrating the operation of the sensing layer 35 using a resistive material. That is, when a resistive sensing layer 35 is provided between the substrates 31 and 32 via an electrode (not shown) as illustrated in FIG. This is equivalent to the variable resistance shown in b). The resistance varies depending on the stress (pressure) P applied in the thickness direction of the sensing layer 35.
[0052]
FIG. 8 is a graph illustrating the response characteristics of the cell shown in FIG. That is, the abscissa in the figure represents the stress applied in the thickness direction of the sensing layer 35, and the ordinate represents the current flowing when a constant voltage is applied between the electrodes 33 and 34. As described above, when a compressive stress is applied to the sensing layer 35, the current between the electrodes increases, that is, the resistance decreases. By detecting such a resistance change, the applied stress or displacement can be detected.
[0053]
Further, by examining the temporal first derivative and the second derivative of such a resistance change, the speed or acceleration of “bending” as described above with reference to FIG. 4 can be found.
[0054]
Although FIG. 8 illustrates a case where the current continuously changes depending on the magnitude of the stress or the amount of displacement, the present invention is not limited to this. For example, depending on the physical properties of the sensing layer 35, even when the stress or the amount of displacement is continuously changed, the changes in the physical properties may occur discretely. Such a thing can be included in the present invention, and is referred to as “analog” in the present application.
[0055]
FIG. 9 is a conceptual diagram illustrating a state where “bending” is applied to the shape change detection unit 30. That is, as shown in FIG. 7A, when the shape change detection unit 30 is flat, each of the sensing layers 35 provided in a matrix is substantially uniform.
[0056]
On the other hand, when "bending" is applied as illustrated in FIG. 9B, stress is applied to the sensing layer 35A in the deformed portion, and physical properties such as a resistance value change. By detecting this change, "bending" can be detected.
[0057]
For example, when compressive stress in the film thickness direction is applied to the sensing layer 35A in the portion where “bending” is applied, in the case of a resistive material, the resistance between the opposing electrodes decreases as illustrated in FIG. I do. Since the amount of reduction has a correlation with the amount of deformation, among the sensing layers 35A that have changed, the sensing layer 35A with the largest amount of deformation shows the largest reduction in resistance.
[0058]
Then, as illustrated in FIG. 9C, when a larger “bending” is applied, the displaced portion expands, and more sensing layers 35A show a change. Further, the amount of change indicated by these sensing layers 35A is further increased.
[0059]
As described above, the amount of “bending” can be quantitatively detected based on the number of the sensing layers 35 showing the change and the amount of the change. Further, by examining the time derivative of the change in the physical property value, the speed or acceleration of the “bending” as described above with reference to FIG. 4 can be obtained.
[0060]
However, in the present invention, each of the plurality of sensing layers 35 shown in FIG. 9 may exhibit a so-called “digital” response. That is, each of the sensing layers 35 may be such that the physical quantity changes discretely when a stress or displacement of a certain level or more is applied. At this time, the response characteristics of the respective sensing layers 35 may be those that show a binary response to one threshold value or those that change multi-valued according to the stress level.
[0061]
Further, in order to prevent a small change during operation from being detected as a signal, a signal smaller than a certain signal amount may not be regarded as a signal input, and may be output as an analog signal.
[0062]
When such a sensing layer 35 is used, as can be seen from FIG. 9, the number of sensing layers 35 that changes varies according to the amount of “bending”. That is, the signal from the shape change detection unit 30 obtained by summing them is not a continuous signal but a discrete signal even when the amount of “bending” is continuously changed.
[0063]
The present invention includes such an input, and is referred to as "analog" input in the present application.
[0064]
FIG. 10 is a schematic diagram illustrating the circuit configuration of the shape change detection unit 30. That is, in the case of this specific example, the electrodes 33 and 34 wired in a vertical and horizontal matrix can be switched for each electrode line by the scanning circuits 33S and 34S. As described above, if the upper and lower electrode lines can be sequentially scanned, it is possible to detect which of the sensing layers 35 the stress is applied between the opposing electrodes, and quantitatively detect the change amount and the change speed. It is possible to do.
[0065]
FIG. 11 is a schematic diagram illustrating another circuit configuration of the shape change detection unit 30. That is, in the case of this specific example, each of the electrodes 33 and 34 wired in a vertical and horizontal matrix is commonly connected, and a voltage is applied between the electrodes by a voltage source V to measure a current. As described above, when the upper and lower electrodes 33 and 34 are commonly connected, it is difficult to detect the position of the “bending” applied to the shape change detection unit 30, but the amount and speed of the “bending” are difficult. Alternatively, it is easy to quantitatively detect acceleration. Further, since it is not necessary to provide the scanning circuits 33S and 34S as shown in FIG. 10 around the electrodes 33 and 34, it is extremely easy to form the shape change detecting section 30 on a substrate such as a film.
[0066]
FIG. 12 is a schematic diagram illustrating another configuration of the shape change detection unit 30. That is, the electrodes 33 and 34 constituting the shape change detection unit 30 do not necessarily need to be patterned in a stripe shape or the like, and may be formed on the entire surface of the substrates 31 and 32. Then, the sensing layer 35 may be continuously inserted between the entire surface electrodes 33 and 34.
[0067]
That is, in the present invention, the shape change detection unit 30 may detect only the amount of “bending”, its speed and acceleration, and need not detect its position. In such a case, the shape change detection unit 30 does not need to adopt a so-called matrix structure.
[0068]
FIG. 13 is a schematic diagram illustrating a display input device in which the shape change detection unit 30 is provided separately. That is, in the case of this specific example, the shape change detection unit 30 includes four divided regions 30A to 30D when viewed in plan. Each of these divided regions may have a structure in which the upper and lower electrodes 33 and 34 are commonly connected, for example, as illustrated in FIG. Alternatively, each of the divided regions may have a structure in which neither the electrodes 33 and 34 nor the sensing layer 35 is divided and patterned as illustrated in FIG.
[0069]
When the shape change detection unit having the structure shown in FIG. 11 or FIG. 12 is employed, it is difficult to specify the position of “bending” in each of the divided regions 30A to 30D. However, since it is known in which divided area the “bend” is applied, this is often sufficient in practical use.
[0070]
For example, a selection screen is appropriately displayed on the display unit 20 in association with the divided areas 30A to 30D, and “A” is displayed on any one of the upper right, lower right, upper left, and lower left corners of the display input device. Depending on whether a "bend" is added, it is possible to select any of the four types of data items and input them in an analog manner according to the amount of the "bend" or the rate of change at the same time. Then, by bending any two or more of the four corners at the same time, it becomes possible to simultaneously input data of different items.
[0071]
Such functions can provide extremely comfortable operability even when applied to, for example, screen scrolling or various games. For example, by applying a “bending” of a predetermined amount or a predetermined speed to any one or two of the divided areas 30A to 30D, the display area displayed on the display unit 20 can be changed in an arbitrary direction in an arbitrary direction. Scroll by volume or speed. Alternatively, it is possible to easily input a moving direction and a moving amount or a moving speed of a character such as a person, a vehicle, or an aircraft displayed on the screen.
[0072]
Note that FIG. 13 is merely an example, and the number of divided regions of the shape change detection unit 30 can be appropriately determined according to the use and purpose of the display input device. That is, the number of divided areas is not limited to four, and can be divided into any number equal to or more than two.
[0073]
FIG. 14 is also a schematic diagram illustrating a display input device in which the shape change detection unit 30 is provided separately. However, in the case of these specific examples, the shape change detection unit 30 is not provided so as to cover the entire surface of the device 10 in plan view.
[0074]
That is, in the specific example shown in FIG. 14A, the four divided regions 30A to 30D are provided only near the four corners of the display input device 10, and the shape change detection unit 30 is not provided near the center. . When the position where "bending" for data input is applied is limited to any one of the four corners of the apparatus, the shape change detection units 30A to 30D may be provided only in the vicinity of the four corners.
[0075]
When the shape change detection unit 30 is provided only in a part of the device 10 as described above, the other parts may be configured so that the flexibility with respect to “bending” is reduced. That is, in the display input device 10, only the portion where the shape change detection units 30A to 30D are provided has flexibility for "bending", and the other regions may have high mechanical rigidity. For this purpose, for example, a plate-like reinforcing body having high strength can be provided. With this configuration, it is possible to apply “bending” only to the shape change detection units at the four corners, while maintaining a flat state near the center of the display unit on the screen.
[0076]
On the other hand, as illustrated in FIG. 14B, the shape change detection unit 30 may be provided only near the center of the display input device 10. That is, when “bending” is applied near the center of the device, the shape change detection unit 30 may be provided in a limited manner near the center. In this case, the “bending” may be applied locally only near the center, or the entire device may be curved in a convex or concave shape.
[0077]
FIG. 15 is a schematic view illustrating a display input device in which a plurality of shape change detection units are stacked. That is, in the case of this specific example, the shape change detection units 30A and 30B are stacked on the upper and lower sides of the display unit 20, respectively. Each of these shape change detection units 30A and 30B may be composed of a plurality of divided regions as illustrated in FIG.
[0078]
From these shape change detection units 30A and 30B, analog signal outputs 1 and 2 can be respectively extracted as illustrated in FIG. These analog signal outputs 1 and 2 can be used, for example, by adding them to increase the detection sensitivity of the display input device 10 against “bending”.
[0079]
Further, as illustrated in FIG. 17, it is also possible to perform a signal processing on the analog signal outputs 1 and 2 in the processing unit SP to obtain an analog output and a digital output. For example, as described above with reference to FIG. 5, as a method of determining the direction of “bending”, there is a method of detecting a difference in curvature, displacement, or stress between the upper and lower shape change detection units 30A and 30B. That is, when a part of the display input device 10 is bent upward or downward, the curvature is larger on the inner side than on the outer side, and displacement and stress are often increased.
[0080]
Therefore, by comparing the analog signal outputs 1 and 2, it is possible to determine in which direction "bending" has been applied. Information about this direction can be obtained as a digital output. For example, the case where "bending" is applied upward is "1", and the case where bending is applied downward is "0". Then, an analog output is determined according to the amount of “bending”.
[0081]
The digital output in this case may then be used to indicate the sign of the analog output data, ie, plus or minus, or may be used as data for specifying other options.
[0082]
FIG. 18 is a schematic diagram illustrating a modification of the stacked display input device. That is, in the case of this specific example, two shape change detection units 30A and 30B are stacked only on the front side or the back side of the display unit 20. When these shape change detection units 30A and 30B are provided on the back surface side, there is obtained an advantage that display of the display unit 20 is not hindered even if a light-shielding material is used.
[0083]
Also in the case of this specific example, as illustrated in FIG. 19, analog signal outputs 1 and 2 obtained from each of the shape change detection units 30A and 30B can be processed to obtain an analog output and a digital output. The details of these outputs are the same as those described above with reference to FIG. 17, and a description thereof will be omitted.
[0084]
FIG. 20 is a schematic diagram illustrating the display input device of the present invention combined with a touch panel. That is, in the case of this specific example, the touch panel 50 is provided on the front side of the display unit 20, and the shape change detection unit 30 is provided on the back side. The touch panel 50 can have a structure in which a plurality of switch elements are arranged in a matrix. Then, a digital signal output indicating which switch element is turned on (or off) is given. On the other hand, the shape change detection unit 30 on the back side provides an analog signal output as described above with reference to FIGS.
[0085]
These outputs can be used separately as illustrated in FIG. That is, when the user selects a predetermined switch on the touch panel 50 and applies “bending” to the display input device, data can be input in an analog manner. For example, the user can input the amount of the data by selecting the type of data to be input on the touch panel and adding “bending”. However, the input to the touch panel 50 and the input by “bending” to the shape change detection unit 30 need not always be performed at the same time.
[0086]
On the other hand, as illustrated in FIG. 22, a digital output from the touch panel 50 and an analog output 1 from the shape change detection unit 30 can be processed to obtain an analog output 2. In this case, the digital output from the touch panel 50 can be used, for example, to give a sign (plus or minus) to the analog output 1.
[0087]
Alternatively, the digital output from the touch panel 50 can be used as a multiple (or divisor) of the analog output 1 or the like. That is, the analog output 2 is obtained by multiplying the analog output 1 by a multiple assigned to the switch element according to which switch element of the touch panel 50 is turned on. By setting the multiple options of the touch panel 50 in a wide range, an extremely wide analog output 2 can be obtained.
[0088]
20 to FIG. 22, the configuration in which the touch panel 50, the display unit 20, and the shape change detection unit 30 are stacked in this order is exemplified, but the present invention is not limited to this. In addition, for example, the touch panel 50, the shape change detection unit 30, and the display unit 20 may be stacked in this order, or a structure in which the shape change detection unit 30, the touch panel 50, and the display unit 20 are stacked in this order is also possible. .
[0089]
Further, the touch panel 50 may be provided on the back side of the device when viewed from the user. For example, when the display input device is held with both hands or one hand and touch input is performed with a finger on the back side, the shape change detection unit 20, the display unit 30, and the touch panel 50 are stacked in this order from the viewpoint of the user. Alternatively, the display unit 30, the shape change detection unit 20, and the touch panel 50 may be stacked in this order.
[0090]
The basic configuration example of the display device of the present invention has been described above with reference to FIGS.
[0091]
Hereinafter, embodiments of the present invention will be described in more detail with reference to examples.
[0092]
(First embodiment)
First, as a first embodiment of the present invention, a display input device having a structure shown in FIG. 1 was manufactured. Here, a liquid crystal display device formed on a flexible substrate was formed as the display unit 20, and an analog input device having a sensing layer made of a resistive material was formed as the shape change detection unit 30.
[0093]
First, regarding a liquid crystal display device, it is necessary to secure flexibility for adding "bending" to the peripheral portion of the display input device. Therefore, in order to reduce the number of extraction electrodes, a liquid crystal display device using a polysilicon thin film transistor in which a part of a driver (drive circuit) can be introduced into the display unit 20 is provided. Hereinafter, the structure of the liquid crystal display device will be described with reference to a manufacturing method thereof.
[0094]
23 to 25 are process cross-sectional views illustrating the main part of the manufacturing process of the liquid crystal display device used in this example.
[0095]
First, for example, a plasma-excited chemical vapor deposition (PECVD) method using silane gas or the like as a raw material is applied to a sufficiently cleaned alkali-free glass substrate 51 to prevent alkali components from eluting from the glass substrate. A silicon oxide film or a silicon nitride film 52 serving as an intended undercoat layer was deposited. Next, for example, after growing an amorphous silicon film by using the PECVD method, the film was irradiated with an excimer laser using KrF or the like, instantaneously melted, crystallized, and then polycrystallized. Then, for example, an element structure of the polycrystalline silicon layer was separated by a photoetching process using a reactive ion etching method (RIE method) using a fluorine-based gas to form an island structure 53 (FIG. 23A).
[0096]
Next, a silicon oxide film or a silicon nitride film to be the gate insulating film 54 was formed using, for example, a plasma-enhanced chemical vapor deposition (PECVD) method. Then, a metal film such as Mo, W, Ta, or an alloy thereof was deposited on the alumina film by using, for example, a sputtering method. After that, a method of applying a photoresist on the metal film and forming a resist pattern by using a photolithography method, for example, using a method of impregnating with a solvent and selectively removing the metal film in a portion without the resist pattern is used. Thereby, the shapes of the gate electrode 55 and the gate line group were processed (FIG. 23B).
[0097]
Next, impurities were introduced into the thin film transistor to form a junction surface in the semiconductor layer (FIG. 23C). In this embodiment, phosphorus (P) is used as an impurity. At this time, using the gate electrode 55 as a mask, an ion concentration of 10 ²² cm ^-3 And heat treatment was performed so that the introduced phosphorus (P) was activated.
[0098]
Next, a silicon oxide film or a silicon nitride film to be the interlayer insulating film 56 was formed by, for example, normal pressure chemical vapor deposition (APCVD). Thereafter, through holes for making contact between the source and drain electrodes and the semiconductor layer via the interlayer insulating film 56 and the gate insulating film 54 were formed using a photoetching process (FIG. 23D).
[0099]
Next, after depositing a metal such as Mo, Ta, W, Al, or Ni, an alloy thereof, a laminated film, or the like by using, for example, a sputtering method, a photo-etching process is performed in the same manner as in forming the gate electrode. Then, a source electrode 57, a signal line group, and a drain electrode 58 were formed (FIGS. 23E and 23A).
[0100]
Then, a pixel electrode (not shown) was formed so as to be connected to the source electrode 57. In this series of thin film transistor and wiring forming processes, for example, a heat step of 500 ° C. or more is present. However, in the alkali-free glass substrate 51 used in this embodiment, it is used without any problem when forming an active matrix structure. it can.
[0101]
Next, a step of transferring the active matrix substrate to a flexible substrate such as a plastic substrate is started.
[0102]
That is, first, on the surface of the formed body thus obtained, for example, an adhesive excellent in hydrofluoric acid resistance such that the adhesive strength is weakened by irradiating ultraviolet light, without any gaps, to form a temporary adhesion layer 61, At a position facing the non-alkali glass substrate with the temporary adhesion layer 61 interposed therebetween, for example, a fluorine-based resin sheet 62 excellent in hydrofluoric acid resistance coated on the bonding surface side to improve the adhesiveness with an organic material is disposed. (FIG. 24 (b)).
[0103]
Next, this laminate was polished from the back side of the non-alkali glass substrate 51 using an abrasive to a thickness of about 0.1 mm while adjusting the roughness of the abrasive. Further, the substrate was impregnated with a hydrofluoric acid-based solvent to dissolve the alkali-free glass substrate 63 to a thickness of about 30 μm (FIG. 24C).
[0104]
At this time, after the glass substrate 51 is thinned, it is desirable to use a hydrofluoric acid-based solution to which, for example, ammonium is added and to adjust the etching rate. After sufficient washing, an adhesive layer 64 was formed on the entire surface of the etched non-alkali glass substrate 51 using an adhesive having excellent adhesion. Then, a polyetheramide resin (PES) film of about 0.1 mmt was bonded as a support substrate 65 to the back surface side of the adhesive layer 64 by using a lamination technique (FIG. 25A).
[0105]
In this embodiment, a PES substrate is used as the support substrate 65. However, in the present invention, another plastic substrate or the like can be used. For example, it has been confirmed that a polyethylene terephthalate resin film (PET) of 0.1 mmt can be formed.
[0106]
Thereafter, a process of irradiating ultraviolet light UV from the resin sheet 62 side to weaken the adhesive force of the temporary adhesion layer 63 was performed (FIG. 25B).
[0107]
Then, the resin sheet 62 used as the support substrate was slowly peeled off to expose the surface of the active matrix layer such as the interlayer insulating film layer 56 (FIG. 25C). At this time, since the residual components of the temporary adhesion layer 64 are generated, the residual components are removed by using, for example, an organic cleaning method such as isopnopanol to expose the cleaning surface.
[0108]
Then, using a film in which a transparent conductive film such as indium tin is deposited on a flexible active matrix substrate using polysilicon formed in this way as a counter substrate, a liquid crystal display is performed using a normal film liquid crystal cell process. The device was made.
[0109]
Next, the shape change detection unit 30 was manufactured. A transparent conductive film such as indium tin oxide (ITO) was formed on a 0.05 mmt polyethylene terephthalate resin film (PET) and patterned in a lattice pattern. An analog shape change detector was manufactured.
[0110]
Then, the shape change detection unit 30 was bonded to the liquid crystal display device using an adhesive.
[0111]
In the conventional touch panel, a mechanism for performing detection for each grid is added in order to perform position detection. However, in this embodiment, since the amount of current between two opposing films is analog-detected, There is no problem with the shape being contacted. In other words, the commonly connected electrodes are extracted one by one from the two opposing films.
[0112]
The liquid crystal display device to which the analog input mechanism is added has flexibility as a display input device. For example, by bending one end of each of the four corners, a stress is applied to the shape change detection unit 30. Since the conductivity between the films changes in the portion subjected to the stress, the stress is compared with the case where the horizontal is maintained. This makes it easier for the current to flow. At this time, since the larger the bending stress and the larger the bent area, the larger the amount of current flowing between the films, the user manipulates the amount of current flowing between the films in an analog manner by an arbitrary method. be able to.
[0113]
(Second embodiment)
Next, as a second embodiment of the present invention, a stacked display input device illustrated in FIG. 15 was manufactured. That is, in the present embodiment, a liquid crystal display device formed on a flexible substrate is used as the display unit 20, and the shape change detection units 30A and 30B are provided on both surfaces of the display unit 20 so that analog input and its Enables signal input.
[0114]
When analog input is performed using the flexibility of the display input device, for example, a case where a concave stress is applied to the display surface and a case where a convex stress is applied can be divided. For example, when viewing a content such as a magazine, from the open page, to return to the previous page, go to the display surface side (concave). By applying stress to the side (convex), the intention of the observer can be reflected.
[0115]
The structure and manufacturing method of the liquid crystal display device used as the display unit 20 in the present embodiment are the same as those described above as the first embodiment, and thus description thereof will be omitted.
[0116]
Also, as in the first embodiment, a transparent conductive film such as indium tin oxide (ITO) is formed on a 0.05 mmt polyethylene terephthalate resin film (PET), and the shape change detectors 30A and 30B are formed in a grid pattern. The layered product was used in which the sensitive resin was disposed between layers of the layered product facing each other.
[0117]
Then, the shape change detection units 30A and 30B were bonded to both surfaces of the liquid crystal display device, that is, to the display unit side and the opposite surface side.
[0118]
The display input device of the present embodiment also has flexibility as the display input device as in the first embodiment. For example, when one end of each of the four corners is bent, a stress is also applied to the shape change detection units 30A and 30B, and the conductivity between the films changes in the portion subjected to the stress. The current is easier to flow than in. At this time, the larger the stress applied to the sensing layer by the “bending” applied to the display input device, and the larger the bent area, the larger the amount of current flowing between the films. Utilizing this effect, the user can adjust the amount of current flowing between the films in an analog manner by an arbitrary method.
[0119]
Further, in the present embodiment, the shape change detection units 30A and 30B are added to both sides of the display unit 20. By adopting such a laminated configuration, with respect to the display surface of the display input device, when the user is bent so that the display surface is inside, and when the user is bent so that the display surface is outside, Can be divided.
[0120]
For example, when the display surface is bent so that the display surface is on the inside, the shape change detection unit 30A added on the display surface side and the shape change detection unit 30B added on the outside have different curvatures. As a result, the detected current value differs between the shape change detection units 30A and 30B. Therefore, the input direction can be detected by calculating the difference between the output signals from the shape change detection units 30A and 30B on both surfaces.
[0121]
For example, in the case where a content such as a magazine is considered, when moving from a certain page to the next interesting page, there may be a case where the next page is over the number of pages and a case where the page is previous. In the case of the display input device of the present embodiment, for example, by setting the inside of the display surface to the front page side and setting the opposite side to the back page side, it is possible to perform analog input of the direction and number of pages before and after the page. Become.
[0122]
(Third embodiment)
Next, as a third embodiment of the present invention, as illustrated in FIG. 20, a display input device in which a touch panel 50 is provided on a front side of a flexible display unit 20 and a shape change detection unit 30 is provided on a back side. Will be described.
[0123]
In the display input device described above as the first embodiment, it is possible to input an analog signal, but when there are a large number of items to which data is to be input, it is necessary to select separately. For example, when viewing a content such as a map while scrolling, it is necessary to separately provide not only the scroll amount but also data regarding directions such as east, west, north and south. In this case, from the touch panel 50 on the display surface side, data on the direction is input by selecting the switch element, and data on the moving distance (the amount of scrolling) is input by the stress of “bending” given to the shape change detection unit 30. It is possible to respond.
[0124]
The structure and manufacturing method of the liquid crystal display device used as the display unit 20 in the present embodiment are also the same as those described above as the first embodiment, and thus description thereof will be omitted.
[0125]
Also, as in the case of the first embodiment, a transparent conductive film such as indium tin oxide (ITO) was formed on a 0.05 mmt polyethylene terephthalate resin film (PET) and patterned in a grid pattern as in the first embodiment. The thing in which the sensitive resin was arrange | positioned between the layers of the thing opposingly arranged was used.
[0126]
On the other hand, as the touch panel 50, a transparent conductive film such as indium tin oxide (ITO) is formed on a polyethylene terephthalate resin film (PET) of 0.05 mmt and patterned in a grid pattern. Was formed. However, in the touch panel 50, the resistance of the cell can be detected for each lattice of the conductive film.
[0127]
In the display input device of this embodiment, for example, the necessity of analog input can be selected. That is, a required function is selected on the touch panel 50 on the display surface side, and an analog amount can be input by the shape change detection unit 30 on the display back side for the analog input value.
[0128]
For example, in the case where a content such as a magazine is considered, when moving from a certain page to the next interesting page, there may be a case where the next page is over the number of pages and a case where the page is previous. In the case of the display input device of the present embodiment, a touch button for selecting the previous page or the rear page is set inside the display surface, and the analog input of the number of pages can be performed by the stress applied to the shape change detection unit 30.
[0129]
(Fourth embodiment)
Next, as a fourth embodiment of the present invention, a display input device in which the shape change detection unit 30 is incorporated in the display unit 20 will be described.
[0130]
FIG. 26 is a schematic diagram illustrating a cross-sectional structure of the display input device of the present embodiment.
FIG. 27 is a schematic diagram showing a planar arrangement relationship of the main part.
[0131]
In the case of the present embodiment, the shape change detection unit 30 is incorporated on the counter substrate side of the liquid crystal display device. That is, an indium tin film formed in a stripe shape is formed on the counter substrate 70 to form the electrode layer 71. A polyvinylidene fluoride (PVDF) layer 72 is uniformly formed thereon by coating. Further, an indium tin film is formed thereon in a stripe shape at a position orthogonal to the electrode layer 71 to form an electrode layer 73.
[0132]
The electrode layer 71 and the electrode layer 73 located with the PVDF layer 72 interposed therebetween constitute the shape change detection unit 30.
[0133]
Further, an interlayer insulating film 74 is formed using an acrylic resin or the like. At this time, the interlayer insulating film 74 needs to have sufficient film quality to suppress the coupling capacitance between the counter electrode 75 and the electrode 73 and the like.
[0134]
On the other hand, a pixel electrode 78 and a thin film transistor 77 are formed on a support substrate 79, and a liquid crystal layer 76 is sealed between the pixel electrode 78 and a counter substrate.
[0135]
Note that the electrode layer 71 and the electrode layer 73 were formed in a shape including the pixel electrode 78 so as not to affect the display performance of the liquid crystal display device. That is, as illustrated in FIG. 27, the electrodes 71 and 73 are formed of stripes wider than the width of the pixel electrode 78.
[0136]
In the present embodiment, the electrode layer 71 and the electrode layer 73 are processed into a stripe shape in order to prevent the substrate from being deformed or the film from being peeled off due to stress. However, the shape change detector
As for 30, it is not a necessary condition that the indium tin films (71, 73) are bunnyed into a shape such as a stripe shape. In this embodiment, PVDF 72 is used as the resistance film. However, the material is not particularly limited as long as it can be used as a resistance film.
[0137]
Further, in this embodiment, the shape change detection unit 30 is incorporated on the counter substrate side, but may be incorporated on the support substrate side on which a thin film transistor is formed, for example.
[0138]
(Fifth embodiment)
Next, as a fifth embodiment of the present invention, a specific example of a display input system using the display input device of the present invention will be described.
[0139]
FIG. 28 is a block diagram of a display input system according to a fifth embodiment of the present invention, and FIG. 29 is an external view of the display input system.
[0140]
The display input device according to the present embodiment has a display unit 20 that is flexible and is thin like paper and capable of electronically displaying information, and a geometric change such as a shape change and a posture change of the display unit 20. And a data input unit 50 capable of acquiring a position or content input by the user 200 on the display unit 20 using a finger or a pen. And a control unit 12 for controlling display contents of the display unit 20 based on the geometric change information determined by the geometric change detection unit 300 and / or the input information acquired by the data input unit 50, and holding the information. And a communication unit 600 that communicates with the external coordination device 1000.
[0141]
As shown in FIG. 29, this display input system is entirely sheet-shaped and flexible, and is provided with a control unit 12, a storage unit 500, a communication unit 600, various wirings and the like at an edge of a side end where no stress is applied. Are formed in a circuit section 900 in which are integrated.
[0142]
Note that the arrangement of each unit in the image diagram of FIG. 29 is merely an example, and the present invention is not limited to this.
[0143]
First, the display unit 20 will be described.
[0144]
The display unit 20 is thin and lightweight, such as paper, and can electronically display characters, figures, images, and the like. Preferably, it is made of a member that can be freely bent and stretched, such as paper.
[0145]
The display unit 20 is specifically realized using, for example, a material generally called “electronic paper (or a flexible display)”. “Electronic paper” is a general term for materials that realize electronic “paper” that can freely rewrite and display documents and images, and is a next-generation display medium that combines the advantages of paper and electronic displays. This “electronic paper” includes, for example, (1) control of molecular arrangement by cholesteric (chiral nematic) liquid crystal, ferroelectric liquid crystal, polymer dispersed liquid crystal, (2) color material movement using electrophoresis, etc. It is realized by using various techniques such as 3) chemical change of leuco dye and the like, (4) organic EL (electroluminescence), and (5) ECD (electrochromic device).
[0146]
“Electronic paper” has various realization methods as described above, but in general, (1) no power supply is required to maintain the display (or it can be maintained with very low power consumption). (2) Rewriting is possible, (3) It is thin as paper. In addition, a feature that the paper can be freely bent and stretched (a flexible shape) like paper is realized by the realization method.
[0147]
Note that the display unit 20 is not limited to the above-described realization method, and may be configured using other material / realization technologies as long as they have the same characteristics.
[0148]
On the other hand, the shape change detection unit 30 is for detecting a shape change of the display unit 20 caused by deformation such as bending, rolling, turning, pulling, twisting, and the like performed by the user on the display unit 20.
[0149]
Specifically, the shape change detection unit 30 includes a plurality of bending sensors and the like arranged on the back surface of the display unit 20 as described later in detail, and uses a sensing result obtained from the plurality of bending sensors. To identify shape changes. The bending sensor can usually detect displacement and curvature with one degree of freedom based on a change in a resistance value that is a sensor output. By arranging a plurality of these on the back surface of the display unit 20 in a lattice pattern, it is possible to determine whether the display unit 20 is bent or stretched.
[0150]
Note that the sensing method described above is merely an example, and the present invention is not limited to this. For example, a sensor capable of detecting displacement, curvature, acceleration, etc. using a change in the amount of light due to bending and stretching of an optical fiber called a “shape sensor” may be similarly arranged on the back surface of the display unit 20, Another sensing technology may be used. Further, the method of arranging the sensors is not limited to the lattice shape, and can be freely changed according to a change in the shape to be acquired. For example, when the portion where the shape change is desired to be detected is limited, it is not necessary to dispose the sensor on the entire back surface of the display unit 20, but only on the necessary portion. Further, if there is a portion where the curvature of deformation or the like is to be detected in detail, it is possible to devise an arrangement such as placing a large portion in the portion.
[0151]
On the other hand, the posture change detection unit 40 is generated by an operation performed by the user 200 with respect to the display unit 20, such as moving a hand while holding the device, grasping some part of the device, lifting up, or shaking. This is for detecting a change in the attitude of the display unit 20.
[0152]
The posture change detection unit 40 can be configured with a plurality of acceleration sensors, gyro sensors, and the like disposed on the back surface of the display unit 20 (and / or other parts of the device), and sensing obtained from these sensors can be used. The results are used to identify posture changes. Thereby, the posture of the device when the user 200 is holding the device, such as "the right side of the device is lifted (rather than the left side)", or "the device is swung right and left". It is possible to detect a change in the state of the device caused by an action performed on the device by the user 200.
[0153]
In the present embodiment, the description has been given that the shape change detection unit 30 and the posture change detection unit 40 can be subdivided, but the present invention is not limited to this. It is also possible to appropriately add another detection unit capable of acquiring a geometric change other than the shape change and the posture change.
[0154]
Next, the data input unit 50 will be described.
[0155]
The data input unit 50 is for acquiring the position and content input by the user 200 on the display unit 20 using a finger or a pen. The data input unit 50 includes, for example, a transparent pressure-sensitive touch panel disposed on the display unit 20. Thereby, it is possible to acquire which part of the display unit 20 the user 200 is touching with the finger of the hand, the locus of the pen tip of the pen held by the user 200, and the like. That is, the data input unit 50 has a role similar to that of the touch panel 50 described above with reference to FIGS.
[0156]
Note that the data input unit 50 is not limited to a touch panel. For example, as shown in FIG. 29, an ultrasonic wave or the like is transmitted from a circuit unit 900 disposed on a side edge of the display unit 20, and a reflected wave that is reflected back on a finger or the like of a hand is returned to the circuit unit again. The data input unit 50 may be configured to detect the input position by detecting at 900. Alternatively, a pen that emits ultrasonic waves may be used, ultrasonic waves transmitted from the pen may be detected by a plurality of microphones, and the position of the pen may be calculated using the principle of triangulation. In addition, it is also possible to calculate a position from a magnetic field change caused by generating a magnetic field on the display unit 20 and placing a finger or a pen on the magnetic field. Further, these methods can be used in appropriate combination. Further, a sensing technology other than that used here may be used.
[0157]
Next, the storage unit 500 will be described.
[0158]
The storage unit 500 stores various information such as contents to be displayed on the display unit 20 and an internal state of the display input system in the present embodiment. The storage unit 500 is typically configured using a semiconductor memory. In some cases, the storage unit 500 can be detached from the display input system in this embodiment. In this case, it is desirable to use an existing standard semiconductor memory medium such as a memory stick, smart media, compact flash, SD card, or the like. When the storage unit 500 is detachable, there is an advantage that the storage unit 500 is connected to an external device and data can be input / output to / from the storage unit 500.
[0159]
Next, the communication unit 600 will be described.
[0160]
The communication unit 600 is for communicating with the external cooperation device 1000. The communication unit 600 communicates with the external cooperation device 1000 using wireless communication means such as Bluetooth, for example. Thereby, data is input from the external cooperation device 1000 to the display / input system in the present embodiment, data is output from the display / input system to the external cooperation device 1000 in the present embodiment, and the control unit 12 to be described later is connected to the external cooperation device 1000. Various types of communication, such as transmission of control information and reception of control information from the external cooperation device 1000 to the control unit 12 described below, can be performed. The communication means is not limited to Bluetooth, but may use a wireless LAN defined by IEEE802.11a / b / g, infrared communication, RF communication, and other wireless communication systems. By using wireless communication, the information device of the present embodiment is not restricted by an external device by a cable, and can be carried around as if holding paper.
[0161]
It is preferable that the communication unit 600 use a wireless communication unit, but a wired communication unit such as a serial communication may be used. In this case, it is preferable that the communication unit be detached from the display / input system of this embodiment except when communicating with the external cooperation apparatus 1000. By doing so, the user is not restricted by the external device except during communication, and can be freely carried during normal use.
[0162]
Finally, the control unit 12 will be described.
[0163]
The control unit 12
(1) Geometric change information determined by the geometric change detection unit 300 and / or an input acquisition unit
The display content of the display unit 20 is controlled based on the input information obtained in step 3.
(2) Controlling reading and writing of data stored in the storage unit 500
(3) Control the communication contents, communication method, timing, etc. in the communication unit 600
(4) In addition, a predetermined operation of the display input system is controlled.
(See FIG. 28).
[0164]
According to the display input system of the present embodiment described above, the user 200 can change the shape of the display unit 20 (this is almost the same as replacing the display input system itself) or change the posture. Can be used to operate the display input system in this embodiment. In addition, the user 200 can operate the display input system according to the present embodiment by appropriately combining finger movement, pen input, and the like with the above-described operations.
[0165]
Next, an operation realized by the display input system in the present embodiment will be described with reference to some specific examples.
[0166]
First, an example in which the display input system according to the present embodiment is applied as an electronic book reader terminal will be described.
[0167]
Now, assume that a page with a novel is displayed on the display unit 20. At this time, as shown in FIG. 30, the user 200 performs the operation of turning the page by holding the right side of the display unit 20 (that is, the display input system) with the right hand and adding “bending” to the left side. In this case, the content displayed on the display unit 20 is advanced by one page. Conversely, as shown in FIG. 31, when the user turns the left side of the display unit 20 (that is, the display input system) and turns the page by adding “bending” to the right side, the display unit 20 displays the image. The user 200 can operate the display input system as if turning a paper book by controlling the control unit 12 so as to return the contents of the content by one page.
[0168]
At this time, the position held by the hand and the position of the hand attached to turn the page are detected by the data input unit 50, and the deformation state obtained by the turning operation and the display input system at that time are detected. The posture change is detected by the geometric change detection unit 300. When it is detected from these detection results that “the right side of the display unit 20 (that is, the display input system) is held with the right hand and the left side is turned”, the storage unit is controlled via the control unit 12. The data of the next page held in 500 is acquired, and the display content of the display unit 20 is updated.
[0169]
If a matrix structure as illustrated in FIG. 10 or a split-type structure as illustrated in FIGS. 13 and 14 is employed as the shape change detection unit 30, it is possible to determine which portion “bend” is added. It can also be detected.
[0170]
As described above, in the conventional display input system, an operation such as page turning had to be performed by using a button or the like. Then, it is possible to operate as if the user is operating a novel book). Thus, even a person who has never touched the computer device does not feel uncomfortable with the operation of the display input system, and anyone can operate the display input system intuitively.
[0171]
At this time, as described above with reference to FIG. 4, the amount of advance of the page can be changed according to the speed or acceleration at which the “bending” is applied. That is, when "bending" is added quickly, the amount of advance of the page can be increased, and when "bending" is applied slowly, the amount of advance of the page can be reduced. In this way, a very intuitive operation becomes possible.
[0172]
In the above, an example has been shown in which the page turning is realized using the geometrical change of the display unit 20 (that is, the display input system), but the operation is not limited to this. For example, as shown in FIG. 32A, an operation of winding up the display unit 20 (that is, the display input system), or an operation of folding the display unit 20 in two as shown in FIG. Then, the power supply of the display input system is turned off, and conversely, it is turned on when the display input system is extended to a plane. As shown in FIG. 33, a menu is displayed by slightly turning the upper left portion of the display unit 20 and adding a “bend”, and a menu is displayed by adding a “bend” to the upper right portion (bookmark function). ) Or fiddle with paper media.
[0173]
Next, an example in which the display input system according to the present embodiment is applied as an electronic memo terminal will be described.
[0174]
According to the display input system in this embodiment, it is possible to perform handwriting input using a pen (which itself does not output ink (for example, a stylus)) as shown in FIG. The trajectory of the pen tip position detected by the unit 50 is processed as stroke data by the control unit 12, and the content is reproduced as it is on the display unit 20. At this time, as shown in FIG. When the user performs an operation of pinching and shaking a part of the display unit 20 (that is, the display input system), the control unit 12 controls to clear the contents displayed on the display unit 20 to make the display white. By doing so, the user 200 can intuitively delete the contents.
[0175]
At this time, the position held by the hand is detected by the data input unit 50, and the posture change of the device obtained by the shaking operation is detected by the posture change detection unit 40 provided in the geometric change detection unit 300. In this way, the user 200 can also freely perform a certain gesture input to the display input system.
[0176]
Next, an example in which the display input system according to the present embodiment is applied as an electronic map viewer will be described. That is, an electronic map system can be realized by storing map information in the storage unit 500 or obtaining map information from the outside via the communication unit 600 and displaying the map information on the display unit 20.
[0177]
Also in this case, as shown in FIG. 3, FIG. 4, FIG. 5, FIG. 30, FIG. 31, or FIG. It is possible to scroll in the direction. For example, as shown in FIG. 30, when the user 200 makes a “bend” to the left, the map displayed on the display unit 20 can be shifted to the left.
[0178]
The display magnification can also be changed by adding “bending”. For example, if a “bend” is made convex toward the user 200, the map is enlarged, while if a “bend” is made concave toward the user 200, the map is reduced. Such operations are possible.
[0179]
Furthermore, by combining with the posture change detection unit 40, it becomes more convenient. For example, when the user 200 tilts the display input system in a predetermined direction, the display content can be scrolled in that direction.
[0180]
In this case, if such a scroll function always operates, the display contents are always scrolled due to an inadvertent inclination, which is inconvenient. Then, it is good to combine with the data input by the data input part 50. That is, when the user 200 touches a predetermined switch provided in the display input system, the data input unit 50 detects the touch and turns on the scroll function. The user 200 can scroll the display content in a desired direction by inclining the display input system in a predetermined direction in this state. At this time, the scroll amount (or scroll speed) can be changed according to the tilt amount. For example, it is possible to scroll at a high speed when the inclination is large, and to scroll slowly when the inclination is small.
[0181]
When the content of the display unit 20 is scrolled and a desired map is displayed, the user 200 releases his hand from a predetermined switch portion. Then, the data input unit 50 detects this and turns off the scroll function. In this state, even if the display input system is tilted, the display contents are not scrolled. With this configuration, the display input system can be easily scrolled by inclining the display input system in a predetermined direction only when scrolling is desired.
[0182]
As described above, when this embodiment is applied to an electronic map viewer, a desired portion in a large display area can be intuitively and quickly displayed by performing a “bend” or “tilt” operation. . A similar application is not limited to a map. For example, it is also possible to quickly display a predetermined article portion from the entire newspaper.
[0183]
As described above, by using the display input system according to the present embodiment, the user 200 can turn on / off the power of the apparatus using the geometric change of the apparatus itself and / or the input using the finger or the pen. It is possible to intuitively perform a predetermined operation of the apparatus such as OFF, change of display contents, selection of operation contents, menu operation, etc., as if touching a paper medium.
[0184]
(Modification of the fifth embodiment)
In the fifth embodiment, the description has been given on the assumption that the display unit 20 is configured by a member (flexible shape) that can be freely bent and stretched like paper. However, as shown in FIG. 36, it is also possible to use a non-flexible display unit 20 by newly adding a flex auxiliary unit 400 to the configuration of the first embodiment.
[0185]
The flex assist unit 400 will be described. The flex assisting section 400 is formed of a member (flexible shape) that can freely bend and stretch like paper, and is used by the user 200 to perform deformation such as bending and stretching instead of the display section 20. belongs to. The same operation is performed by arranging this in the vicinity of the display unit 20 and detecting the deformation of the flex assist unit 400 by the geometric deformation detection unit 2 as described in the first embodiment. .
[0186]
The flex assist unit 400 is formed of, for example, a transparent thin film, and is placed on the display unit 20. Then, the user 200 operates the display input system by performing a deformation operation such as a flipping operation on the film on the display unit 20.
[0187]
It should be noted that the method of implementing the flex assisting section 400 is not limited to this. An opaque thin film that is slightly larger than the display unit 20 may be attached so as to protrude below the display unit 20, and the device may be operated using the shape change of the protruding portion. Further, the flex assisting section 400 may be arranged next to the display section 20 in the same size as the display section 20, and that portion may be used. Other configuration methods may be used as long as the deformation of the flex auxiliary part 400 can be used.
[0188]
(Sixth embodiment)
Next, a sixth embodiment of the present invention will be described.
[0189]
FIG. 37 is an overall configuration diagram of the display input system according to the sixth embodiment of the present invention.
[0190]
The display input system according to the present embodiment includes a first display unit 20A and a second display unit 20B having similar functions, instead of the display unit 20 described with respect to the fifth embodiment. Further, the control unit 12 in the present embodiment individually controls the display contents of the first display unit 20A and the display contents of the second display unit 20B based on the input information acquired by the data input unit 50. Is possible. Otherwise, the geometric change detection unit 300, the data input unit 50, the control unit 12, the storage unit 500, and the communication unit 600 can be substantially the same as in the fifth embodiment.
[0191]
The first display unit 20A and the second display unit 20B will be described.
[0192]
The first display unit 20A and the second display unit 20B are each thin and light like paper, and can display electronic information, like the display unit 20 described in the fifth embodiment. Preferably, it is made of a member that can be freely bent and stretched, such as paper. The first display unit 20A and the second display unit 20B are typically arranged at positions on the front and back of the paper as shown in FIG.
[0193]
Next, the control unit 12 will be described.
[0194]
The control unit 12
(1) The display content of the first display unit 20A is controlled based on the geometric change information determined by the geometric change detection unit 300 and / or the input information obtained by the data input unit 50. Do
(2) The display content of the second display unit 20B is controlled based on the geometric change information determined by the geometric change detection unit 300 and / or the input information obtained by the data input unit 50. Do
(3) Controlling reading and writing of data stored in the storage unit 500
(4) Control the communication content, communication method, timing, etc. in the communication unit 600
(5) In addition, it is for controlling a predetermined operation of the device (see FIG. 37).
[0195]
According to the display input system according to the present embodiment described above, the user 200 can operate the first display unit 20A (because the second display unit 20B is disposed on the back side of the first display unit 20A). The display input system in the present embodiment can be operated using the deformation of the shape of the display unit 20B) and the change in the posture. In addition, the user 200 can operate the display input system according to the present embodiment by appropriately combining finger movement, pen input, and the like with the above-described operation. In addition, while referring to the information displayed on the first display unit 20A, the “bending” as shown in FIG. The information displayed on a part of the second display unit 20B can be peeped.
[0196]
Now, the operation realized by the display input system in the present embodiment will be described with reference to some specific examples.
[0197]
First, an example in which the display input system according to the present embodiment is applied as an electronic book reader terminal will be described.
[0198]
Now, it is assumed that a page with a novel is displayed on the first display section 20A. At this time, it is assumed that a word in the novel has been noted. Notes are typically put together at the end of the chapter, so if you are reading a regular book, you may need to turn a few pages, You have to find the page you are on. However, instead of this, as shown in FIG. 38, when the turning operation is performed so that a part of the second display unit 20B is made visible, the control unit is displayed so that a note is displayed at that part. Control is performed at 12. In this way, the display input system according to the present embodiment can be used as if the information on the back side of the double-sided printed paper is peeped.
[0199]
Further, by pushing this forward, when the meaning of a certain word in the sentence displayed on the first display unit 20A is not understood, the displayed part of the word is touched with the finger of the hand, When the user turns the pen around the word and then refers to the second display unit 20B by flipping, a part of the dictionary in which the meaning of the word is written can be displayed in that part. It becomes. In addition, an English translation of the text on the first display unit 20A can be displayed on the second display unit 20B.
[0200]
At this time, when the turning operation is performed in the direction shown in FIG. 38, it is necessary to display the second display unit 9 in a direction opposite to the top and bottom of the first display unit 20A. This is because, in the turning operation in this direction, the display unit viewed from the user 200 is turned upside down. The control unit 12 also considers such a situation, and in such a case, performs control to display the image upside down.
[0201]
Next, an example in which the display input system according to the present embodiment is applied as a map display terminal will be considered.
[0202]
Now, the address of a place (for example, a restaurant) to be visited is input to the first display section 20A. Thereafter, as shown in FIG. 38, when the operation of turning the lower side is performed, it is possible to provide a service in which a map around the input address is displayed on the turning portion of the second display unit 20B. it can. In addition, when the direction of the turn is changed, when turning from the top, a schematic map showing the route to the point to go to the turning portion of the second display unit 20B is displayed. It is also possible to change the contents to be peeped depending on how to turn over, such as the menu information and the degree of crowding being displayed.
[0203]
The operation of the display input system in the present embodiment described above will be summarized.
By using the display input system in the present embodiment, the user 200 refers to information on the surface of the display input system, or inputs information to the surface while involving a geometric change of the cover input device itself such as a turning operation. By performing the operation, it is possible to display the related information corresponding to the back side and peep the related information on the back side.
[0204]
(Seventh embodiment)
Next, a seventh embodiment of the present invention will be described.
[0205]
FIG. 39 is an overall configuration diagram of a display input system according to a seventh embodiment of the present invention, and FIG. 40 is an external view of the display input system according to the present embodiment.
[0206]
The display input system according to the present embodiment includes a plurality of input / output units 10 (10a, 10b... In FIG. 39) in which the display unit 20, the geometric change detection unit 300, and the data input unit 50 are integrated into one. A position change detection unit 700 that can newly detect a position change of the input / output unit 10 and a positional relationship between the plurality of input / output units 10; The control unit 12 includes the control unit 12, the storage unit 500, and the communication unit 600 which have already been described with respect to the embodiment.
[0207]
The control unit 12, the storage unit 500, and the communication unit 600 basically have the same functions as those in the fifth embodiment, but there is input / output from a plurality of input / output units 10a, 10b,. The points are different.
[0208]
As shown in FIG. 40, the control unit 12, the storage unit 500, and the communication unit 600 are combined into one inside a ring 710 similar to, for example, a bundle of wordbooks. A plurality of input / output units 10a, 10b, ... are bundled.
First, the position change detection unit 700 will be described.
[0209]
Normally, when operating a paper deck, as shown in FIG. 41, turn over the paper currently present at the top, make a round along the ring 710, and then hold it at the bottom. Turning the page turns the page. When returning the page, the reverse operation is performed, that is, the lowermost paper is moved along the ring 710 in the reverse direction to bring it to the uppermost position. When referring to the paper of the overlapping portion, the overlapping paper is shifted to expose the target paper portion. The position change detection unit 700 is capable of performing the operation of the same concept as above with the input / output units 10a, 10b,... In the present embodiment.
[0210]
Specifically, the position change detection unit 700 attaches a sensor to a portion where the input / output units 10a, 10b,... Pass, and determines whether or not the input / output units 10a, 10b,. It detects the passing speed and the relative positional relationship between the input / output units 10a, 10b,....
[0211]
The sensor can be realized by, for example, a combination of an LED and a photodiode. In this method, near-infrared light is emitted by an LED, and the reflected light is obtained by a photodiode.If there is nothing on the sensor, the reflected light does not return, so nothing is obtained by the photodiode. However, at the moment when the input / output unit 10 passes over the sensor, the reflected light to the input / output unit 10 is obtained, and therefore, it can be detected using this. Also, by using a plurality of sensors and using a time difference of detection between the sensors, it is possible to know a passing direction, a speed, and the like.
[0212]
Also, by attaching identification tags such as IR tags to the input / output units 10a, 10b,... And detecting them, the position change detection unit 700 can be similarly realized. These only describe one technique for realization, and are not limited to this. For example, in the above embodiment, the ring 710 is used as a unit for bundling the input / output units 10a, 10b,..., But the bundling shape is not limited to a ring shape.
[0213]
Next, the control unit 12 will be described.
[0214]
The control unit 12
(1) Each of the geometric change information obtained as an output from the input / output units 10a, 10b,... And / or each of the input / output units 10a, 10b,. Control the display contents of the display
(2) The display contents of the respective display units in the input / output units 10a, 10b,... Are controlled based on the detection result of the position change detection unit 700.
(3) Controlling reading and writing of data stored in the storage unit 500
(4) Control the communication content, communication method, timing, etc. in the communication unit 600
(5) In addition, it is for controlling a predetermined operation of the device (see FIG. 39).
[0215]
The control unit 12, in addition to the functions described with respect to the fifth and sixth embodiments described above, and based on the detection result of the position change detection unit 700, each of the input / output units 10a, 10b,. Controls the display content on the display. Specifically, the display of the input / output unit currently at the top is updated in accordance with the page turning result detected by the position change detection unit 700.
[0216]
According to the display input system in the present embodiment described above, the user 200 can operate the display input system in the present embodiment with the same feeling as operating a real paper deck. That is, even a person who does not know the concept of the conventional computer (WIMP metaphor) can intuitively operate the display input system as if he or she were touching a paper word book.
[0219]
(Modification of Seventh Embodiment)
In the above-described seventh embodiment, as shown in FIG. 39, the geometric change detection unit 300 and the data input unit 50 are individually provided inside the input / output unit 10, but they are separately provided to the control unit. 12, the storage unit 500 and the communication unit 600 are changed so as to be provided externally, and the geometric change detection unit 300 and the data input unit 50 detect the geometric change of the plurality of input / output units 10a, 10b,. Alternatively, a modification may be made to acquire the input information.
[0218]
(Eighth embodiment)
Next, an eighth embodiment of the present invention will be described.
[0219]
FIG. 42 is an overall configuration diagram of the display input system according to the present embodiment.
[0220]
The display input system of the present embodiment has a configuration in which a position management unit 802, a position presentation unit 804, and a feedback unit 806 are added to the fifth embodiment. The position management unit 802 manages the position of the information presented on the display unit 20. The position presentation unit 804 has a role of presenting a position managed by the position management unit 802. The feedback unit 806 has a role of performing feedback by sound or vibration when the position presentation unit 804 is touched with a hand or the like.
[0221]
Hereinafter, the position management unit 802, the position presentation unit 804, and the feedback unit 806 added in the present embodiment will be described.
[0222]
First, the position management unit 802 will be described.
[0223]
The position management unit 802 manages the position of the information currently displayed on the display unit 20 among all information to be displayed on the display unit 20. For example, suppose that the fourth page of a novel composed of nine pages is displayed on the display unit 20. In this case, management is performed such that the total number of pages is 9, the current position is the fourth page, and this is 4/9 of the whole.
[0224]
Next, the position presentation unit 804 will be described.
[0225]
The position presentation unit 804 presents the position managed by the position management unit 802 on the display unit 20. The position presenting unit 804 uses, for example, the lower part of the display unit 20 to represent a page in a tab shape as shown in FIG. 43A, and displays the total number of pages, the current page position, and other pages. Is presented in a format that allows the user 200 to intuitively image the user. Further, as shown in FIG. 43B, an image of accumulated paper (see also FIG. 44) may be provided on the left side of the display unit 20. In any case, the position presenting unit 804 displays the total number of pages, the current page position, the presence of other pages, and the like to the user 200 in such a manner that the user 200 can easily image the actual book or the like. The position of the information displayed in 20 is visually presented.
[0226]
Next, the feedback unit 806 will be described.
[0227]
The feedback unit 806 performs feedback by sound or vibration when the user touches the position presenting unit 804 with a hand or the like, and the user 200 intuitively senses the content presented by the position presenting unit 804 by tactile sense, auditory sense, or the like. To understand.
[0228]
Hereinafter, feedback by vibration will be described as an example, but feedback is not limited to this.
[0229]
When turning the pages of an actual book, usually, as shown in FIG. 44, the fingers are often slipped over the edge of the paper to flip the pages. At this time, the finger of the hand receives tactile feedback for each page due to friction when the page passes by the turning operation, so that it is possible to intuitively know how much the page has been turned at present. . The feedback unit 806 is for introducing this feeling to the paper-type electronic device according to the present embodiment.
[0230]
More specifically, as shown in FIG. 45, when a finger is slipped on the position presentation unit 804, vibration is generated when the finger passes over a page boundary indicated by the position presentation unit 804. As shown in FIG. 46A, it is effective to change the amount of vibration as illustrated in FIG. 46B according to the position of the page touched by the user 200. For example, when the finger of the hand is at the boundary between the first and second pages, a small vibration is gradually given as the position of the page increases, so that the finger of the hand is located at the current position. Can be intuitively known. Also, by increasing the vibration around the current page as the distance from this page increases, the distance from the current page to the page corresponding to the position where the finger is located can be intuitively known.
[0231]
When the finger of the hand is released, the control unit 12 controls the display unit 20 to display a page corresponding to the position, so that page turning can be performed intuitively and easily. It becomes possible.
[0232]
According to the display input system in the present embodiment described above, the user 200 can position the information displayed on the display input system in the present embodiment in the same sense as turning a real book with his / her finger. Can be changed to operate. Specifically, when the display input system according to the present embodiment such as an electronic book reader is applied, the page can be turned using the fingers of the hand. At this time, feedback such as vibration can be obtained with the same feeling as obtained from an actual book. As a result, even a person who does not know the concept of the conventional computer (WIMP metaphor) can intuitively operate the display input system as if touching a paper book.
[0233]
(Ninth embodiment)
Next, a ninth embodiment of the present invention will be described.
[0234]
FIG. 47 is an overall configuration diagram of the display input system according to the present embodiment.
[0235]
The display input system according to the present embodiment includes a first display unit 20A and a second display unit 20B having similar functions, instead of the display unit 20 described in regard to the fifth embodiment. Further, the control unit 12 in the present embodiment individually controls the display contents of the first display unit 20A and the display contents of the second display unit 20B based on the input information acquired by the data input unit 50. Is possible. Further, based on the position managed by the first display unit 20A, the position management unit 820 that manages the position of the information presented on the second display unit 20B, and the first The weight distribution control unit 822 for controlling the weight distribution of the display unit 20A and the second display unit 20B is added.
[0236]
Otherwise, the geometric change detection unit 300, the data input unit 50, the control unit 12, the storage unit 500, and the communication unit 600 can be substantially the same as in the fifth embodiment.
[0237]
First, the first display unit 20A and the second display unit 20B will be described.
[0238]
FIG. 48 is a plan view illustrating the arrangement of these display units. The first display unit 20A and the second display unit 20B are the same as those described in regard to the sixth embodiment, but differ in the positional relationship between them. That is, the first display unit 20A and the second display unit 20B are typically arranged at left and right positions, such as two pages of a book.
[0239]
Next, the position management unit 820 will be described.
[0240]
The position management unit 820 manages the positions of the information displayed on the first display unit 20A and the second display unit 20B in the same manner as described above with reference to the eighth embodiment.
[0241]
Next, the weight distribution control unit 822 will be described.
[0242]
The weight distribution control unit 822 controls the weight distribution of the first display unit 20A and the second display unit 20B based on the position managed by the position management unit 820. Specifically, by preparing a spherical weight movable over both the first display unit 20A and the second display unit 20B and controlling the position thereof, the first weight is obtained. The weight distribution in the display unit 20A and the second display unit 20B is changed. It should be noted that the method of changing the weight distribution is merely one method, and is not limited to this.
[0243]
By changing the weight distribution described above, it is possible to perform control such as making the side of the first display unit 20A heavier than the side of the second display unit 20B by%.
[0244]
Consider a situation in which an actual book is being read as shown in FIG. At this time, at the initial stage of reading the book, or when reading a text relatively at the beginning of the book, as shown in FIG. And the right page is heavier.
[0245]
Conversely, as you read through the document of the book or refer to the text at the end of the book, the left page becomes lighter and the right page becomes heavier (FIG. 49 (b) )reference). Thus, when reading a book, the reader feels without knowing its weight distribution. When reading a novel, not only does it give visual information that the number of pages will decrease as the reading progresses, but also feels intuitively the weight reduction associated with the decrease in the number of pages. In addition, when accessing arbitrary information such as a dictionary, the weight distribution on the left and right sides is intuitively felt, and it is considered that the user unconsciously performs "Sure, the left page must have been heavier".
[0246]
As described above, the weight change of the book is also considered to be one of important information for intuitively accessing the information to the user 200. The display input system according to the present embodiment intuitively gives the user 200 the feeling of the weight change. According to the display input system in the present embodiment described above, the user 200 can change the current distribution of the weights of the first and second display means provided from the device according to the information presentation position. You can intuitively know the location of the information you are accessing.
[0247]
(Modification of the ninth embodiment)
In the ninth embodiment, the first display unit 205 and the second display unit 206 are arranged on the left and right like two facing pages of a book. This can be changed to include only one of the display units 20 as described in the fifth embodiment.
[0248]
FIG. 50 is a plan view illustrating the display unit 50 in the display input system of this variation.
[0249]
In this case, the display area of the display unit 20 is divided into two, and the information of two pages that are divided and displayed on the first display unit 20A and the second display unit 20B respectively are displayed on the display unit 20. It is sufficient to display all of them. Then, the weight distribution control unit 822 may control the weight distribution in the display unit 20 to be changed.
[0250]
(Tenth embodiment)
Next, a tenth embodiment of the present invention will be described.
[0251]
FIG. 51 is a conceptual diagram illustrating the entire configuration of the display input system according to the present embodiment.
[0252]
FIGS. 52 to 54 are schematic diagrams showing the usage state.
[0253]
That is, the display input device 10 according to the present embodiment also includes the display unit 20 and the shape change detection unit 30. However, the shape change detection unit 30 does not cover the entire surface of the display unit 20 and is selectively provided below the display unit 20. The shape change detecting unit 30 has a role of detecting “bending” applied to the display input device 10 and switching the display.
[0254]
Furthermore, it has first and second data input units 50A and 50B. The first data input unit 50A is used to control ON / OFF of the display switching function. The second data input unit 50B is used to select a state after switching the display.
[0255]
The display input system of the present embodiment has, for example, a size such that an A4 size vertical document can be seen at a glance. The user 200 is designed to operate the button with the thumb while supporting the lower central portion of the display input device 10 therebetween. Although not shown in FIGS. 51 and 52, the display input device 10 also includes a control unit 12, a storage unit 500, a communication unit 600, and the like as necessary. The first and second data input units 50A and 50B may be provided by being appropriately moved in the vertical and horizontal directions according to the convenience.
[0256]
Then, the user 200 deforms the display input device 10 temporarily in the order of FIG. 52A, FIG. 52B, and FIG. 52A while pressing the first data input unit 50A, and temporarily bends the display input device 10. This “bending” is detected by the shape change detection unit 30. Then, the display on the display unit 20 is switched to one of the displays shown in FIGS. 53A to 53D. For example, FIG. 52A illustrates a state in which option A is activated, and FIG. 52B illustrates a state in which option B is activated. As shown in FIG. 52A and FIG. 52B, an active option can be switched by an operation of adding “bending” once and returning to the original state. In FIG. 52, a case where four options A to D are prepared for simplicity is illustrated, but the number and arrangement of the options and the display style when active can be variously changed.
[0257]
By repeatedly performing the operation of temporarily adding “bending” as shown in FIG. 52, the menu is scrolled to activate a desired option, and then, as shown in FIG. 54, the second data input unit 50B Select the activated option by pressing. All of the above operations can be performed with one hand. In addition, it is possible to cope with a hierarchical menu by selecting in multiple stages.
[0258]
According to the present embodiment, the input by “bending” can be performed only while the first data input unit 50A is being pressed, so that an erroneous operation can be avoided. Further, by pressing the second data input unit 50B, an active option can be selected.
[0259]
That is, when scrolling the menu, the operation can be performed with a rough feeling without worrying about the button position, and the user can be conscious only when deciding an option. Therefore, it is possible to provide a user interface that prompts a simple and accurate operation.
After the "bending" is applied as shown in FIG. 52B, the entire device may be slightly bent in a state where the device is returned to the flat state as shown in FIG. 52A. In particular, as illustrated in FIG. 52B, when bending deformation is slightly applied around the long axis of the display unit 20, bending deformation in a direction perpendicular to the long axis (along the long axis) is suppressed. For this reason, the operation is stabilized when the first and second data input units 50A and 50B are pressed.
[0260]
(Eleventh embodiment)
Next, an eleventh embodiment of the present invention will be described.
[0261]
FIG. 55 is a schematic diagram showing another display input system according to the present invention.
[0262]
56 to 58 are conceptual diagrams showing the operation procedure.
[0263]
That is, the display input device 10 of this embodiment also has a structure similar to that of the tenth embodiment. However, a touch panel is provided as the second data input unit 50B. That is, the touch panel 50B is stacked on the display unit 20 and can be used to determine an activated option.
[0264]
Also in the present embodiment, while pressing the first data input unit 50A, “bending” is applied in a one-hand holding state as shown in FIG. Then, every time a “bend” is added, one of the options A to D becomes active in order. For example, FIG. 57A illustrates a state in which option A is activated, and FIG. 57B illustrates a state in which option B is activated.
[0265]
As described above, by repeatedly performing the operation of temporarily bending the display input device 10, the options A to D on the menu bar are scrolled. Then, after activating the desired option, as shown in FIG. 58, the instruction means 210 selects a small item in the option. At this time, an input is made on the touch panel 50B. Here, the indicating means 210 is not limited to a pen-type stylus, and may be directly touched with a finger. Further, instead of the touch panel, the input may be performed by a visual line detection method.
[0266]
Since most of the series of operations can be performed with one hand, the operability in an environment where both hands are not always available, such as when used in a vehicle such as a train or a bus with strong shaking, is improved.
[0267]
(Twelfth embodiment)
Next, a twelfth embodiment of the present invention will be described.
[0268]
FIG. 59 is a schematic diagram illustrating the display input system according to the present embodiment.
[0269]
FIG. 60 is a conceptual diagram showing the operation procedure.
[0270]
The display input device 10 of the present embodiment has a shape change detection unit 30 and a jog wheel type data input unit 50 that are sized to fit in the palm. The data input unit 50 also functions as ON / OFF switching of the bending detection and a selection button. That is, while the data input unit 50 is pressed, the bending input function is turned on. By pressing the data input unit 50, an active option can be selected. On the other hand, by rotating the wheel of the data input unit 50, the selection items and the display screen can be scrolled.
[0271]
In the drawings, the case where the jog wheel-shaped data input unit 50 is operated with the thumb while being sandwiched and supported by the left palm is illustrated, but conversely, the operation may be performed on the right palm. Good.
[0272]
When operating the display input device 10 of the present embodiment, the user 200 temporarily holds the display input device 10 while holding down the data input unit 50 in one hand holding state as shown in FIG. 60A → FIG. 60B → FIG. 60A. Switch to the menu display by bending.
[0273]
Then, by rotating the wheel of the data input unit 50, one of the options is activated. Thereafter, by pressing the data input unit 50 again, the activated option can be selected.
[0274]
(Thirteenth embodiment)
Next, a thirteenth embodiment of the present invention will be described.
[0275]
FIG. 61 is a schematic diagram illustrating the display input system according to the present embodiment.
[0276]
FIGS. 62 and 63 are conceptual diagrams showing the operation procedure.
[0277]
Similarly to the twelfth embodiment, the display input device 10 of the present embodiment is also a device that can fit in the palm. The first data input unit 50A is provided on the side of the device, and the second data input unit 50B is provided on the back of the device.
[0278]
The first data input unit 50A is an ON / OFF switch for a “bending” detection function. The second data input unit 50B is a button-type switch for selecting a final state. These can be operated by pressing them with different fingers.
[0279]
The second data input unit 50B may be constituted by a button having directivity in a pressing direction, a jog dial, a jog wheel, a tracking pad, or the like, instead of a simple push button.
[0280]
The user 200 applies a temporary “bend” to the display input device 10 as shown in FIG. 62 in a one-hand holding state while pressing the first data input unit 50A, so that the display on the display unit 20 is displayed. Can be switched. For example, each time “bend” is added, options A to D as shown in FIG. 63 are activated in order. FIG. 63 illustrates a state in which option B is activated.
[0281]
In this state, by pressing the second data input unit 50B, an active option can be selected.
[0282]
(14th embodiment)
Next, a fourteenth embodiment of the present invention will be described.
[0283]
FIG. 64 is a schematic diagram illustrating the display input system according to the present embodiment. The display input device 10 of the present embodiment has a posture change detection unit 40 on both sides of the upper end. The display input device 10 can be used, for example, as an electronic viewer capable of browsing book content over multiple pages at high speed. Below the display unit 20, a first data input unit 50A and a second data input unit 50B are provided. Further, a shape change detection unit 30 is provided therein.
[0284]
The user 200 can perform a page turning operation by, for example, adding a temporary “bend” to the display input device 10 as illustrated in FIG. 64B while pressing the first data input unit 50A.
[0285]
Further, in a state where “bending” is applied while pressing the first data input unit 50A, the whole is tilted as shown in FIG. 65A. Then, the posture change detection unit 40 detects this inclination, and the display unit 20 turns the page from right to left.
[0286]
Conversely, when the whole is inclined as shown in FIG. 65B, the pages are turned from left to right.
[0287]
The posture change detection unit 40 may detect the absolute value of the inclination, or may detect the speed or acceleration of the inclination. Further, only one posture change detection unit 40 may be provided. However, in the case where an acceleration sensor or the like is used as the posture change detection unit 40, the inclination in the left-right direction can be detected with high sensitivity by providing the sensor on the left and right sides of the device 10, respectively.
[0288]
According to the level of the detection signal obtained from the posture change detection unit 40, a stepwise operation can be performed from a value less than the threshold value (page turning stop) to a high-speed page turning mode exceeding the upper limit value. Further, the page turning may be forcibly stopped when the button of the first data input unit 50A is released, so that the high-speed page turning mode can be instantaneously shifted to the stop state.
[0289]
In addition, using the second data input unit 50B, it is possible to perform operation selection such as replacement of contents.
[0290]
(Fifteenth embodiment)
Next, a fifteenth embodiment of the present invention will be described.
[0291]
FIG. 66 is a schematic diagram illustrating the display input system according to the present embodiment. The display input device 10 according to the present embodiment is obtained by changing the position of the posture change detecting unit 40 according to the fourteenth embodiment.
[0292]
That is, in the present embodiment, as shown in FIG. 67, by turning the apparatus 10 back and forth, it is possible to perform page turning in a vertical direction (an operation similar to that performed on a daily calendar). Other operation methods can be substantially similar to those of the fourteenth embodiment.
[0293]
Also in the present embodiment, the posture change detection unit 40 may detect the absolute value of the inclination, or may detect the speed or acceleration of the inclination. Further, only one posture change detection unit 40 may be provided. However, when an acceleration sensor or the like is used as the posture change detection unit 40, it is possible to detect the inclination in the up-down direction with high sensitivity by providing them at the top and bottom of the device 10, respectively.
[0294]
The embodiment of the invention has been described with reference to the examples. However, the present invention is not limited to the specific examples described above.
[0295]
For example, the structures of the display unit 20 and the shape change detection unit 30 used in the present invention are not limited to the specific examples described above, and those skilled in the art can appropriately design the shape, material, dimensions, conductivity type, and the like of each element. Modifications are included in the scope of the present invention as long as they have the features of the present invention.
[0296]
For example, the semiconductor layer used in the present invention can be formed of amorphous silicon, that is, amorphous silicon.
[0297]
In addition to the liquid crystal display device as described above, various self-luminous display devices such as EL and the like, which can be used as the display unit 20 in the present invention, can provide flexibility. Various display devices can be given.
[0298]
Further, the touch panel used in the present invention is not limited to the specific examples described above, and a touch panel having any structure that can be appropriately selected by those skilled in the art can be similarly used.
[0299]
The above embodiments and their modifications can be implemented in appropriate combinations. Further, in each of the above embodiments, the display input device or the display input system having the display unit has been described as an example. However, these are not limited to the control of the display contents, but also include the operation such as ON / OFF of the system itself. These can be applied as a new man-machine interface device.
[0300]
The various processes used in the embodiments of the present invention may be implemented by a computer-executable program, and the program may be stored in a computer-readable storage medium and provided.
[0301]
The storage unit according to the present invention can store programs such as a magnetic disk, a flexible disk, a hard disk, an optical disk (CD-ROM, CD-R, DVD, etc.), a magneto-optical disk (MO, etc.), a semiconductor memory, etc., and As long as the storage unit is readable by the computer or the embedded system, the storage form may be any form.
[0302]
Also, an OS (operation system) running on the computer, database management software, MW (middleware) such as a network, etc. realize the present embodiment based on instructions of a program installed in the computer or the embedded system from the storage unit. May be performed.
[0303]
Further, the storage unit in the present invention is not limited to a medium independent of a computer or an embedded system, but also includes a storage unit that downloads a program transmitted through a LAN, the Internet, or the like and stores or temporarily stores the program.
[0304]
Further, the number of storage units is not limited to one, and a case where the processing in this embodiment is executed from a plurality of storage units is also included in the storage unit in this embodiment, and the configuration of the medium may be any configuration. .
[0305]
The computer or the embedded system according to the present invention is for executing each process in the present embodiment based on a program stored in the storage unit, and includes a device such as a personal computer, a microcomputer, etc. The device may have any configuration such as a system connected to a network.
[0306]
Further, the computer in the present invention is not limited to a personal computer, but also includes an arithmetic processing unit, a microcomputer, and the like included in an information processing device, and is a general term for devices and devices capable of realizing the functions of the present invention by a program. .
[0307]
Note that the present invention is not limited to the above-described embodiment, and can be variously modified in an implementation stage without departing from the gist of the invention. Furthermore, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some components are deleted from all the components shown in the embodiment, (at least one of) the problems described in the column of the problem to be solved by the invention can be solved, and the effect of the invention can be solved. In the case where (at least one of) the effects described in (1) is obtained, a configuration from which this component is deleted can be extracted as an invention.
[0308]
That is, the present invention is not limited to each specific example, and various modifications can be made without departing from the scope of the invention, and all of them are included in the scope of the present invention.
[0309]
【The invention's effect】
As described above in detail, according to the present invention, based on a completely different idea, a display input device capable of inputting analog data by a simple and intuitive operation, and a display input device including the same The system can be provided, and the industrial advantages are great.
[Brief description of the drawings]
FIG. 1 is a conceptual diagram showing a display input system of the present invention.
FIG. 2 is a schematic view illustrating a basic cross-sectional configuration of the display input device of the present invention.
FIG. 3 is a schematic diagram illustrating the principle of analog input in the present invention.
FIG. 4 is a schematic diagram illustrating a case where the speed of “bending” is changed.
FIG. 5 is a schematic diagram illustrating the principle of distinguishing inputs according to the direction of “bending” in the present invention.
FIG. 6 is a conceptual diagram illustrating the structure of a shape change detection unit 30;
FIG. 7 is a schematic view illustrating the operation of a sensing layer 35 using a resistive material.
FIG. 8 is a graph illustrating a response characteristic of the cell shown in FIG. 7;
FIG. 9 is a conceptual diagram illustrating a state where “bending” is applied to the shape change detection unit 30.
FIG. 10 is a schematic diagram illustrating a circuit configuration of a shape change detection unit 30;
11 is a schematic diagram illustrating another circuit configuration of the shape change detection unit 30. FIG.
FIG. 12 is a schematic diagram illustrating another configuration of the shape change detection unit 30.
FIG. 13 is a schematic diagram illustrating a display input device in which a shape change detection unit 30 is provided separately.
FIG. 14 is a schematic diagram illustrating a display input device in which a shape change detection unit 30 is provided separately.
FIG. 15 is a schematic view illustrating a display input device in which a plurality of shape change detection units are stacked.
FIG. 16 is a schematic diagram illustrating an embodiment in which analog signal outputs 1 and 2 are extracted.
FIG. 17 is a schematic diagram illustrating an embodiment in which analog signal outputs 1 and 2 are processed in a processing unit SP to obtain an analog output and a digital output.
FIG. 18 is a schematic diagram illustrating a modified example of a stacked display input device.
FIG. 19 is a schematic diagram illustrating an embodiment in which analog signal outputs 1 and 2 are processed to obtain an analog output and a digital output.
FIG. 20 is a schematic diagram illustrating a display input device of the present invention combined with a touch panel.
FIG. 21 is a schematic diagram illustrating an embodiment in which outputs from a touch panel and a shape change detection unit are separately used.
FIG. 22 is a schematic diagram illustrating an embodiment in which a digital output from the touch panel 50 and an analog output 1 from the shape change detection unit 30 are processed to obtain an analog output 2.
FIG. 23 is a process cross-sectional view illustrating a main part of a manufacturing process of the liquid crystal display device used in the example of the present invention.
FIG. 24 is a process cross-sectional view illustrating a main part of a manufacturing process of the liquid crystal display device used in the example of the present invention.
FIG. 25 is a process sectional view illustrating a main part of a manufacturing process of the liquid crystal display device used in the example of the present invention.
FIG. 26 is a schematic diagram illustrating a cross-sectional structure of a display input device according to an embodiment of the present invention.
FIG. 27 is a schematic diagram illustrating a planar arrangement relationship of a main part of the display input device according to the embodiment of the present invention.
FIG. 28 is a block diagram schematically illustrating a configuration example of a display input system according to a fifth embodiment of the present invention.
FIG. 29 is an external view for explaining an image of a display input system according to a fifth embodiment of the present invention.
FIG. 30 is a diagram illustrating a change in the shape of the display unit.
FIG. 31 is a diagram illustrating a change in the shape of the display unit.
FIG. 32 is a diagram for describing a change in the shape of the display unit.
FIG. 33 is a diagram for describing a change in the shape of the display unit.
FIG. 34 is a diagram for describing handwriting input.
FIG. 35 is a diagram for describing a change in the attitude of the display unit.
FIG. 36 is a block diagram schematically showing a configuration example of a display input system according to a modification of the fifth embodiment of the present invention.
FIG. 37 is a block diagram schematically illustrating a configuration example of a display input system according to a sixth embodiment of the present invention.
FIG. 38 is a diagram for explaining a turning operation.
FIG. 39 is a block diagram schematically illustrating a configuration example of a display input system according to a seventh embodiment of the present invention.
FIG. 40 is an external view for explaining an image of a display input system according to a seventh embodiment of the present invention.
FIG. 41 is a diagram illustrating an operation in a word book.
FIG. 42 is a block diagram schematically showing a configuration example of a display input system according to an eighth embodiment of the present invention.
FIG. 43 is an external view for describing a position presentation unit.
FIG. 44 is a diagram for explaining a page turning operation of a book.
FIG. 45 is a diagram for explaining a page turning operation with a finger of the hand.
FIG. 46 is a diagram for explaining a feedback method.
FIG. 47 is a block diagram schematically showing a configuration example of a display input system according to a ninth embodiment of the present invention.
FIG. 48 is a schematic diagram of an appearance of a display input system according to a ninth embodiment of the present invention.
FIG. 49 is a diagram for explaining a change in weight distribution in a book.
FIG. 50 is a schematic diagram of an appearance of a display input system according to a modification of the ninth embodiment of the present invention.
FIG. 51 is a conceptual diagram showing an overall configuration of a display input system according to a tenth example of the present invention.
FIG. 52 is a schematic diagram illustrating a use state of the display input system according to the tenth example of the present invention.
FIG. 53 is a schematic diagram illustrating a use state of the display input system according to the tenth example of the present invention.
FIG. 54 is a schematic diagram illustrating a use state of the display input system according to the tenth example of the present invention.
FIG. 55 is a schematic diagram illustrating a display input system according to an eleventh example of the present invention.
FIG. 56 is a conceptual diagram showing an operation procedure of the display input system according to the eleventh example of the present invention.
FIG. 57 is a conceptual diagram showing an operation procedure of the display input system according to the eleventh example of the present invention.
FIG. 58 is a conceptual diagram showing an operation procedure of the display input system according to the eleventh example of the present invention.
FIG. 59 is a schematic diagram illustrating a display input system according to a twelfth embodiment of the present invention.
FIG. 60 is a conceptual diagram showing an operation procedure of the display input system according to the twelfth embodiment of the present invention.
FIG. 61 is a schematic diagram showing a display input system according to a thirteenth embodiment of the present invention.
FIG. 62 is a conceptual diagram showing an operation procedure of the display input system according to the thirteenth embodiment of the present invention.
FIG. 63 is a conceptual diagram showing an operation procedure of the display input system according to the thirteenth embodiment of the present invention.
FIG. 64 is a schematic diagram illustrating a display input system according to a fourteenth embodiment of the present invention.
FIG. 65 is a conceptual diagram showing an operation procedure of the display input system according to the fourteenth embodiment of the present invention.
FIG. 66 is a schematic diagram showing a display input system according to a fifteenth embodiment of the present invention.
FIG. 67 is a conceptual diagram showing an operation procedure of the display input system according to the fifteenth embodiment of the present invention.
[Explanation of symbols]
10 Display input device
12 Control judgment part
20, 20A, 20B display unit
30 Shape change input section
30A Shape change detector
33 electrodes
33S scanning circuit
35 Sensing layer
40 Posture change detection unit
50 Data input section
51 glass substrate
52 silicon nitride film
53 island structure
54, 55 insulating film
56 interlayer insulating film
57 source electrode
58 Drain electrode
61 Temporary adhesion layer
62 resin sheet
63 Temporary layer
64 adhesive layer
65 Support substrate
70 Counter substrate
71 electrodes
72 layers
73 electrodes
74 interlayer insulating film
75 Counter electrode
76 liquid crystal layer
77 thin film transistor
78 pixel electrode
79 Support substrate
1000 External link device
120 Display driver
130 signal judgment unit
200 users
205, 206 display unit
210 indicating means
300 Geometric change detector
400 Flex assistant
500 storage unit
600 Communication unit
700 Position change detector
710 ring
802 Location Management Department
802 The location management unit
804 Position presentation unit
806 Feedback section
820 Location Management Department
822 Weight distribution control unit
900 circuit section
SP processing unit
UV UV light
V voltage source

Claims (16)

A display unit having flexibility;
A first shape change detection unit capable of detecting a displacement caused by the flexibility as a change in electrical characteristics,
A display input device comprising: The display input device according to claim 1, wherein the first shape change detection unit is stacked on the display unit. The display input device according to claim 1, wherein the first shape change detection unit extends close to a display surface of the display unit. The display input device according to any one of claims 1 to 3, wherein the change in the electrical characteristic depends on the amount of the displacement. The first shape change detection unit includes a pair of conductive layers and a sensing layer provided therebetween, and the resistance between the pair of conductive layers changes when the displacement is applied. The display input device according to any one of claims 1 to 4, wherein: The said 1st shape change detection part consists of several divided area | regions, and each of these divided area | regions can detect the said displacement independently, The Claim 1 characterized by the above-mentioned. Display input device. The display input device according to any one of claims 1 to 6, further comprising a second shape change detection unit stacked on the first shape change detection unit or the display unit. The display unit has a pair of substrates made of a flexible material,
The shape change detection unit has a pair of substrates made of a flexible material,
The display input device according to claim 1, wherein the display unit and the shape change detection unit are bonded. The display unit has a pair of substrates made of a flexible material,
The display input device according to claim 1, wherein the shape change detection unit is provided between the pair of substrates. A display input device according to claim 1,
A display drive unit that provides an image display signal to the display unit;
A signal determination unit that determines input data corresponding to the displacement based on a change in the electrical characteristic in the first shape change detection unit;
With
A display input system, wherein the first data can be input by applying the displacement to the display input device. A display input device according to claim 4,
A display drive unit that provides an image display signal to the display unit;
A signal determination unit that determines input data corresponding to the displacement based on a change in the electrical characteristic in the first shape change detection unit;
With
A display input system, wherein the electrical characteristics that continuously change in accordance with the amount of the displacement are converted into numerical data to obtain first data. A display input device according to claim 7,
A display drive unit that provides an image display signal to the display unit;
A signal determination unit that determines input data corresponding to the displacement based on the change in the electrical characteristic in the first shape change detection unit and the second shape change detection unit;
With
By applying the displacement, it is possible to input first data depending on a difference in change in electrical characteristics between the first shape change detection unit and the second shape change detection unit. Display input system. The display input system according to claim 10, wherein the signal determination unit determines the input data based on a speed or an acceleration of the displacement. It further includes a data input unit capable of inputting second data by a user operation, and determines whether to input the first data based on the second data input to the data input unit. The display input system according to any one of claims 10 to 12, wherein: The display input device further includes a posture change detection unit that detects a change in posture, wherein the signal determination unit determines the input data in consideration of the change in the posture detected by the posture change detection unit. The display input system according to any one of claims 10 to 12, wherein The display input system according to any one of claims 10 to 12, wherein the shape change detection unit extends near a display surface of the display unit.

Images