JP6316607B2 - Display device and display method - Google Patents

Description

  The present invention relates to a display device and a display method.

  2. Description of the Related Art Conventionally, a technique for correcting and recording camera shake in an apparatus that captures and records an image is known.

  For example, Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique for detecting a movement due to camera shake of an image recording apparatus using an acceleration sensor or the like, performing image stabilization on an image, and recording the image.

  Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique for recording a moving image by performing camera shake correction by using a displacement amount of the position of a feature point in an image as a correction amount for camera shake correction.

JP 2007-116633 A JP 2012-49871 A

  In the above-described conventional technique, only camera shake correction is performed on an image to be recorded, and the visibility of the displayed image cannot be improved when the apparatus is moved.

  SUMMARY An advantage of some aspects of the invention is that it provides a display device and a display method capable of improving the visibility of a displayed image.

In order to solve the above problems, a first aspect of the display device according to the present invention includes a display unit that displays an image, a detection unit that detects movement of the device, and the display based on the detected movement of the device. A calculation unit that calculates a movement amount of the image displayed on the unit, and moves the display position of the image based on the movement amount calculated from the calculation unit so that the image is fixed in space. the and a table Shimesuru display control unit on the display unit.

  Moreover, the 2nd aspect of the display apparatus which concerns on this invention is a display apparatus in the said 1st aspect whose said detection part is an acceleration sensor which detects the acceleration of the said display apparatus.

  According to a third aspect of the display device of the present invention, in the first aspect, the detection unit is an imaging unit that captures an image.

  According to a fourth aspect of the display device of the present invention, in the third aspect, the imaging unit captures an image of the user's eyes.

  According to a fifth aspect of the display device of the present invention, in the first aspect, the calculation unit detects a period of movement of the display device, and the display control unit is calculated from the calculation unit. Based on the amount of movement, the display position of the image is moved and displayed with a delay of a natural number times the movement period.

  According to a sixth aspect of the display device of the present invention, in the first aspect, the display control unit is configured to display the image when the display position indicated by the movement amount exceeds the display range of the display unit. Is not displayed, and a mark indicating that the image is not displayed is displayed.

  According to a seventh aspect of the display device of the present invention, in the first aspect, the display control unit is configured to display the image when the display position indicated by the movement amount exceeds the display range of the display unit. Is displayed at the end of the display section.

  According to an eighth aspect of the display device of the present invention, in the first aspect, the display control unit reduces the image.

  According to a ninth aspect of the display device of the present invention, in the ninth aspect, the display control unit determines a reduction ratio of the image based on a maximum movement amount of the image.

  According to a tenth aspect of the display device of the present invention, in the first aspect, the display control unit sets a predetermined maximum movement amount as the movement amount of the image.

  An eleventh aspect of the display device according to the present invention is the display device according to the first aspect, wherein the calculation unit calculates the same amount as the detected movement of the device as the movement amount of the image. The unit displays the image so as not to move spatially with respect to the movement of the display device by moving the image from the position before the display device is moved by the amount of movement.

Further, a first aspect of the display method according to the present invention includes a display step of displaying an image on the display unit, a detection step of detecting movement of the device, and the display unit based on the detected movement of the device. A calculation step for calculating a movement amount of the image to be displayed; and a movement step for moving the display position of the image based on the movement amount calculated in the calculation step. In the detection step, the movement of the display device is performed. A period is detected, and in the movement step, the display position of the image is moved with a natural number of delays of the movement period based on the movement amount calculated in the calculation step .

  The present invention can provide a display device and a display method capable of improving the visibility of a displayed image with the above configuration.

1 is an external view of a mobile phone that is a first embodiment of a display device according to the present invention. 1 is an external view of a mobile phone that is a first embodiment of a display device according to the present invention. 1 is a functional block diagram of a mobile phone which is a first embodiment of a display device according to the present invention. It is a flowchart of operation | movement of the mobile telephone which is 1st Embodiment of the display apparatus which concerns on this invention. It is a flowchart of operation | movement of the mobile telephone which is 1st Embodiment of the display apparatus which concerns on this invention. It is the schematic of operation | movement of the mobile telephone which is 1st Embodiment of the display apparatus which concerns on this invention. It is a flowchart of operation | movement of the mobile telephone which is 2nd Embodiment of the display apparatus which concerns on this invention. It is the schematic of operation | movement of the mobile telephone which is 2nd Embodiment of the display apparatus which concerns on this invention. It is a flowchart of operation | movement of the mobile telephone which is 3rd Embodiment of the display apparatus which concerns on this invention. It is the schematic of operation | movement of the mobile telephone which is 3rd Embodiment of the display apparatus which concerns on this invention. It is a flowchart of operation | movement of the mobile telephone which is 4th Embodiment of the display apparatus which concerns on this invention. It is the schematic of operation | movement of the mobile telephone which is 4th Embodiment of the display apparatus which concerns on this invention. It is a functional block diagram of the mobile telephone which is 5th Embodiment of the display apparatus which concerns on this invention. It is the schematic of operation | movement of the mobile telephone which is 6th Embodiment of the display apparatus which concerns on this invention. It is a flowchart of operation | movement of the mobile telephone which is 6th Embodiment of the display apparatus which concerns on this invention. It is the schematic of operation | movement of the mobile telephone which is the 7th Embodiment of the display apparatus which concerns on this invention. It is a flowchart of operation | movement of the mobile telephone which is 7th Embodiment of the display apparatus which concerns on this invention. It is the schematic of operation | movement of the mobile telephone which is 8th Embodiment of the display apparatus which concerns on this invention. It is a flowchart of operation | movement of the mobile telephone which is 8th Embodiment of the display apparatus which concerns on this invention. It is a flowchart of operation | movement of the mobile telephone which is 8th Embodiment of the display apparatus which concerns on this invention. It is the schematic of operation | movement of the mobile telephone which is 9th Embodiment of the display apparatus which concerns on this invention. It is a flowchart of operation | movement of the mobile telephone which is 9th Embodiment of the display apparatus which concerns on this invention.

Hereinafter, embodiments of a display device and a display method of the present invention will be described with reference to the drawings. The following description of the embodiment of the display device according to the present invention is merely an example, and can be appropriately changed without departing from the spirit of the present invention. The description of each embodiment of the display device according to the present invention described below also serves as a description of each embodiment of the display method according to the present invention.
(First embodiment)
1 and 2 are external views of a mobile phone 100 according to a first embodiment of a display device according to the present invention. The mobile phone 100 is a so-called smartphone. 1 is a front view of the mobile phone 100, and FIG. 2 is a rear view of the mobile phone 100. The mobile phone 100 includes an in-camera 101 that captures an image in the same direction as the image display surface of the touch panel 107 formed on the front upper portion of the mobile phone, and a receiver 103 that outputs sound when a user makes a call or the like. A main key 105 for performing an input operation, a touch panel 107 capable of displaying an image and inputting information by a touch operation with a finger or the like, and an out-camera 109 for capturing an image formed on the back surface of the mobile phone 100 And have.

  The in-camera 101 is mainly used when taking an image of a user of the mobile phone 100 or the like.

  The touch panel 107 displays a still image or a moving image output from each application. The touch panel 107 enables an input operation when the user touches the displayed image with a finger or the like.

  Next, functions of the mobile phone 100 shown in FIG. 1 will be described with reference to FIG. FIG. 3 is a functional block diagram of the mobile phone 100 shown in FIG.

  The mobile phone 100 includes a CPU 301 that controls the overall operation of the mobile phone 100 and an acceleration sensor 303 that detects the acceleration of the mobile phone 100. The acceleration sensor 303 is a sensor that can detect three-axis accelerations of the X axis, the Y axis, and the Z axis.

  In addition, the mobile phone 100 includes a touch panel 107 that can display an image and can input information by a touch operation with a finger or the like, and a memory 305 that records application programs and various data.

  In addition, the mobile phone 100 includes an audio output unit 307 including a receiver 103 that outputs call voice and the like.

  In addition, the mobile phone 100 includes a communication unit 309 that transmits and receives information to and from an external network via an antenna.

  The mobile phone 100 also includes an imaging unit 311 that captures images such as still images and moving images. The imaging unit 311 includes an in camera 101 and an out camera 109.

  In addition, the mobile phone 100 includes an input unit 313 including a main key 105 and a volume adjustment button (not shown).

  The touch panel 107 emits display light, a touch pad 315 that detects a change in capacitance when a finger or the like touches the touch panel 107 and detects a contact position, an LCD (Liquid Crystal Display) 317 that displays an image, and the like. And a backlight 319.

  The acceleration sensor 303, the touch panel 107, the memory 305, the audio output unit 307, the communication unit 309, the imaging unit 311, and the input unit 313 illustrated in FIG. 3 are each connected to the CPU 301.

  Next, the operation of the mobile phone which is the first embodiment of the display device according to the present invention will be described with reference to FIGS. 4 and 5 are flowcharts of the operation of the mobile phone that is the first embodiment of the display device according to the present invention, and FIG. 6 is the operation of the mobile phone that is the first embodiment of the display device according to the present invention. FIG.

  Whether the correction mode for moving the image displayed on the touch panel 107 is turned on in response to the movement of the mobile phone when the spatial position moves due to shaking of the mobile phone 100 or the like. Judging. Note that the correction mode is turned ON or OFF when the user performs an operation to set the correction mode on the menu screen of the mobile phone 100, for example.

  If the correction mode is ON (Yes), the CPU 301 proceeds to step S403, and if the correction mode is not ON (No), the CPU 301 proceeds to step S401.

  Next, the CPU 301 calculates an image movement amount from the output of the acceleration sensor 303 (step S403). The image movement amount calculation operation in step S403 shown in FIG. 4 will be described with reference to FIG.

  When the correction mode is turned on, the CPU 301 turns on the acceleration sensor 303 (step S501). Next, the CPU 301 calculates an image movement amount that is a movement amount of an image displayed on the screen of the touch panel 107 from the output of the acceleration sensor 303 (step S503).

  Next, the CPU 301 moves the image displayed on the screen of the touch panel 107 based on the calculated image movement amount (step S405). The direction in which the image is moved is a direction in which the image is as if it is fixed in space. For example, when the mobile phone 100 moves in the positive X-axis direction, the mobile phone 100 moves in the negative X-axis direction.

  Thereafter, the CPU 301 determines whether or not the correction mode has ended. If it has ended (Yes), the CPU 301 ends the operation. If it has not ended (No), the CPU 301 proceeds to step S403 (step S407). .

  The operation of the flowchart shown in FIGS. 4 and 5 will be described with reference to FIG. In the example shown in FIG. 6, the mobile phone 100 is moved by a distance L in the X-axis direction of the acceleration sensor 303, and the screen of the touch panel 107 of the mobile phone 100 is facing the Z-axis direction of the acceleration sensor 303. And

  In this case, the CPU 301 detects the acceleration of the moving mobile phone 100 from the output value of the acceleration sensor 303 (step S503), and calculates the movement amount L of the mobile phone 100 from the detected acceleration. For example, the movement amount L is obtained by the CPU 301 integrating the acceleration twice over time.

  Next, based on the detected movement amount L, the CPU 301 moves the image 601 displayed on the screen of the touch panel 107 before moving the mobile phone within the screen. The image 601 is a triangle in the example shown in FIG. 6, but this is an example, and the image may be another figure, one or more figures, a web page or a text It may be the entire display screen or a part thereof, such as a part or all of an image.

  In the example shown in FIG. 6, since the mobile phone 100 is moving to the right side (X axis positive direction) in the drawing, the image 601 is detected on the left side (X axis negative direction) on the screen of the touch panel 107. It is moved by the movement amount L. In FIG. 6, an image 603 indicated by a dotted line is displayed for convenience in order to show the position of the moved image 601 on the screen of the touch panel 107 before the movement, and an actual mobile phone screen. It is not displayed above.

  As is clear from the above description, in the mobile phone 100 that is the first embodiment of the display device according to the present invention, even when the mobile phone 100 moves due to shaking or the like, the image 601 moves in space. In order to prevent the display position of the image 601 from being moved by the amount of movement of the mobile phone 100 on the screen, the visibility of the displayed image can be improved.

  For example, when the user uses the mobile phone 100 that is the first embodiment of the display device according to the present invention while holding it in a vehicle, the user holding the mobile phone 100 shakes. . In this case, the user's head (eyes) and the hand holding the mobile phone 100 do not move completely synchronized. However, even in this case, in the mobile phone 100 which is the first embodiment of the display device according to the present invention, the image on the screen of the mobile phone 100 held in the hand is fixed in space. Thus, the visibility of the displayed image can be improved.

  Moreover, according to the mobile phone 100 which is the first embodiment of the display device according to the present invention, when used in a vehicle, the image on the screen of the mobile phone 100 is fixed in the space. Thus, even if there is a character or the like in the image on the screen even in a moving vehicle, it can be easily read and visibility is improved.

In addition, according to the mobile phone 100 that is the first embodiment of the display device according to the present invention, an image on the screen of the mobile phone 100 is provided for a user whose hand holding the mobile phone 100 shakes due to circumstances such as aging or illness. Becomes fixed in the space, and visibility is improved.
(Second Embodiment)
Next, a mobile phone which is a second embodiment of the display device according to the present invention will be described with reference to FIGS. FIG. 7 is a flowchart of the operation of the mobile phone which is the second embodiment of the display device according to the present invention, and FIG. 8 is a schematic diagram of the operation of the mobile phone which is the second embodiment of the display device according to the present invention. It is. In the following description of the second embodiment, differences from the above-described first embodiment will be described.

  The mobile phone which is the second embodiment of the display device according to the present invention is imaged by the camera, whereas the first embodiment described above calculates the amount of movement due to the shaking of the mobile phone by the output of the acceleration sensor. The amount of movement of the mobile phone is calculated from the amount of movement of the image.

  The CPU 301 performs the process shown in FIG. 7 instead of the image movement amount calculation process in step S403 shown in FIG. That is, the CPU 301 turns on the out-camera 109 as shown in FIG. 7 instead of the image movement amount calculation processing in step S403 shown in FIG. 4 (step S701). In the mobile phone which is the second embodiment of the display device according to the present invention, the out camera 109 is taken as an example of the camera to be used, but the in camera 101 may be used. Further, an image captured when the out camera is turned on is a moving image. However, the out camera may be turned on, and still images may be taken continuously to calculate the amount of image movement.

  Next, the CPU 301 calculates the amount of movement of the reference image from the image captured by the out camera 109 (step S703). Next, the CPU 301 calculates the amount of movement of the mobile phone from the image captured by the out camera 109 (step S705). The mobile phone movement amount calculation processing from the output of the out-camera 109 by the CPU 301 in steps S703 and S705 will be described with reference to FIG.

  In the example shown in FIG. 8, the mobile phone has moved a distance L from the state B before movement indicated by the dotted line to the state A after movement indicated by the solid line on the left side (X-axis negative direction) in the drawing. Suppose that the touch panel surface of the mobile phone 100 faces the Z-axis direction of the acceleration sensor.

  First, the CPU 301 recognizes the reference image 803 in the captured image 801 a captured by the out camera 109. For example, the reference image 803 is set to have the highest luminance among the captured images 801a. Note that the method of setting the reference image 803 is not limited to the highest brightness among the captured images 801a, and in addition, the image of a person in the captured image 801a and a predetermined shape are included. An appropriate image such as an image having a predetermined color, an image having a predetermined color, or an image having a predetermined image data value such as contrast can be used as the reference image. At this time, the CPU 301 recognizes the coordinate position X1 of the reference image 803 in the captured image 801a.

  Next, the CPU 301 recognizes the reference image 803 in the captured image 801 b captured by the out-camera 109 after the mobile phone 100 moves the distance L. At this time, the CPU 301 recognizes the coordinate position X2 of the reference image 803 in the captured image 801b.

  Then, the CPU 301 calculates the movement amount L of the mobile phone 100 from X2-X1 that is the movement amount of the reference image in the captured image.

  Next, based on the calculated movement amount L, the CPU 301 moves an image 601 that is a display object displayed before the mobile phone moves on the screen of the touch panel. The image 601 is a triangle in the example shown in FIG. 8, but this is only an example, and the image may be another figure, one or more figures, a web page or a text image. The display screen may be the entire display screen or a part of the display screen.

  In the example shown in FIG. 8, the mobile phone moves from the state B before movement indicated by the dotted line to the state A after movement indicated by the solid line by a distance L on the left side (X-axis negative direction) on the drawing. Yes. Therefore, the CPU 301 moves the image 601 to the right (X-axis positive direction) by the calculated movement amount L. In FIG. 8, an image 603 indicated by a dotted line is displayed for convenience in order to show the position of the moved image 601 before moving, and is displayed on the screen of an actual mobile phone. It is not a thing.

As is clear from the above description, according to the second embodiment of the display device according to the present invention, the same effect as in the first embodiment described above can be obtained.
(Third embodiment)
Next, a mobile phone which is a third embodiment of the display device according to the present invention will be described with reference to FIGS. FIG. 9 is a flowchart of the operation of the mobile phone which is the third embodiment of the display device according to the present invention, and FIG. 10 is a schematic diagram of the operation of the mobile phone which is the third embodiment of the display device according to the present invention. It is. In the following description of the third embodiment, differences from the above-described first embodiment will be described.

  The mobile phone which is the third embodiment of the display device according to the present invention uses the in-camera, whereas the above-described first embodiment calculates the amount of movement due to the mobile phone's shaking by the output of the acceleration sensor. The amount of movement of the mobile phone is calculated based on the amount of movement of the imaged position of the user's eye image.

  As illustrated in FIG. 9, the CPU 301 performs an image movement amount calculation process illustrated in FIG. 9 instead of the image movement amount calculation process in step S <b> 403 illustrated in FIG. 4. That is, the CPU 301 turns on the in-camera 101 as shown in FIG. 9 instead of the image movement amount calculation processing in step S403 shown in FIG. 4 (step S901). An image captured when the in-camera 101 is turned on is a moving image. However, the in-camera 101 may be turned on, and still images may be continuously captured to calculate the amount of image movement.

  Next, the CPU 301 calculates the movement amount of the eye position from the captured image of the in-camera 101 (step S903). Processing for calculating the movement amount of the eye position from the output of the in-camera 101 by the CPU 301 in step S903 will be described with reference to FIG.

  In the example shown in FIG. 10, the mobile phone has moved a distance L from the state B before movement indicated by a dotted line to the state A after movement indicated by a solid line on the left side (X-axis negative direction) in the drawing. Suppose that the touch panel surface of the mobile phone 100 faces the Z-axis direction of the acceleration sensor.

  First, the CPU 301 recognizes the reference eye image 1003 in the captured image 1001 a captured by the in-camera 101. At this time, the CPU 301 recognizes the coordinate position X1 of the eye image 1003 in the captured image 1001a.

  Next, the CPU 301 recognizes the eye image 1003 in the captured image 1001b captured by the in-camera 101 after the mobile phone 100 moves the distance L. At this time, the CPU 301 recognizes the coordinate position X2 of the eye image 1003 in the captured image 1001b.

  Then, the CPU 301 calculates the movement amount L of the mobile phone 100 from X2-X1 that is the movement amount of the eye image in the captured image.

  Next, based on the calculated movement amount L, the CPU 301 moves the image 601 displayed on the screen of the touch panel 107 before moving the mobile phone. The image 601 is a triangle in the example shown in FIG. 10, but this is an example, and the image may be another figure, one or a plurality of figures, a web page or a text image. The entire display screen or a part of the display screen may be used.

  In the example shown in FIG. 10, since the mobile phone 100 is moved to the left side (X axis negative direction) in the drawing, the image 601 is moved to the right side (X axis positive direction) by the calculated movement amount L. . In FIG. 10, an image 603 indicated by a dotted line is displayed for convenience in order to show the position of the moved image 601 before moving, and is displayed on the screen of an actual mobile phone. It is not a thing.

As is apparent from the above description, according to the third embodiment of the display device according to the present invention, the same effect as in the first embodiment described above can be obtained.
(Fourth embodiment)
Next, a mobile phone which is a fourth embodiment of the display device according to the present invention will be described with reference to FIGS. FIG. 11 is a flowchart of the operation of the mobile phone that is the fourth embodiment of the display device according to the present invention, and FIG. 12 is a schematic diagram of the operation of the mobile phone that is the fourth embodiment of the display device according to the present invention. It is. In the following description of the fourth embodiment, differences from the above-described first embodiment will be described.

  The mobile phone which is the fourth embodiment of the display device according to the present invention controls the timing for moving an image in the first embodiment described above. That is, the mobile phone that is the fourth embodiment of the display device according to the present invention detects the periodicity of the movement of the mobile phone and moves the image with a delay of at least one cycle.

  As shown in FIG. 11, the mobile phone which is the fourth embodiment of the display device according to the present invention has a cycle calculation processing step S1105 added to the operation of the first embodiment shown in FIG. 4. ing.

  The CPU 301 first determines whether or not the correction mode is ON (step S1101). Note that the correction mode is turned ON or OFF when the user performs an operation to set the correction mode on the menu screen of the mobile phone 100, for example.

  If the correction mode is ON (Yes), the CPU 301 proceeds to step S1103. If the correction mode is not ON (No), the CPU 301 proceeds to step S1101.

  The CPU 301 calculates the image movement amount from the output of the acceleration sensor 303 (step S1103). The image movement amount calculation process in step S403 shown in FIG. 4 is the same as the process described with reference to FIG. In addition to the image movement amount calculation processing in step S403 shown in FIG. 4, the image movement amount calculation processing in step S1103 shown in FIG. 11 includes the image described with reference to FIG. 7 and FIG. The movement amount calculation process may be performed.

  Next, the CPU 301 calculates the movement period T of the mobile phone 100 based on the output of the acceleration sensor 303 (step S1105). The calculation of the movement period T of the mobile phone 100 based on the output of the acceleration sensor 303 is performed, for example, when the CPU 301 detects the peak value of acceleration.

  Next, the CPU 301 moves the image with a delay of a natural number n times the period T based on the calculated image movement amount and the movement period T of the mobile phone 100 (step S1107). Here, n is 1.

  Thereafter, the CPU 301 determines whether or not the correction mode has ended. If the correction mode has ended (Yes), the CPU 301 ends the operation. If not (No), the CPU 301 proceeds to step S1103 (step S1109). .

  The operation of FIG. 11 will be described with reference to FIG. In FIG. 12, the horizontal axis represents time t, and the vertical axis represents the movement amount x in the X-axis direction. As shown in FIG. 12, it is assumed that the mobile phone 100 moves with a period T in the X-axis direction of the acceleration sensor 303. The CPU 301 detects the movement of the mobile phone when the correction mode is turned on, and calculates the period T. In the example shown in FIG. 12, the mobile phone 100 shows an example in which the mobile phone 100 is moved by the same distance in the X-axis direction of the acceleration sensor 303. The mobile phone 100 may be moved at different distances in the X-axis direction of the acceleration sensor 303.

  Then, the mobile phone 100 performs image display correction corresponding to the movement of the mobile phone at time t1 at time t2, which is delayed by a period T from t1. That is, the mobile phone 100 is moved from the image display 603 to the image display 601 at time t2 with a movement amount corresponding to the movement of the mobile phone at time t1. Similarly, the mobile phone 100 performs the correction of the image display of the movement amount corresponding to the movement of the mobile phone at the time t2 at the time t3 delayed by a period T from the time t2, and the movement amount corresponding to the movement of the mobile phone at the time t3. The image display correction is performed at time t4, which is delayed by a period T from time t3, and so on.

  In FIG. 12, an image 603 indicated by a dotted line is displayed for convenience in order to show the position of the moved image 601 before moving, and is displayed on the screen of an actual mobile phone. It is not a thing.

As is clear from the above description, according to the fourth embodiment of the display device of the present invention, the same effect as in the first embodiment described above can be obtained. Furthermore, according to the fourth embodiment of the display device according to the present invention, in the first embodiment described above, the timing for moving the image is controlled, the periodicity is calculated for the movement of the mobile phone 100, and at least 1 By moving the image with a delay of a period or more, the delay between the movement of the image and the movement of the mobile phone 100 can be reduced, and the visibility of the image can be further improved.
(Fifth embodiment)
Next, a mobile phone which is a fifth embodiment of the display device according to the present invention will be described with reference to FIG. FIG. 13 is a functional block diagram of a mobile phone 1300 which is the fifth embodiment of the display device according to the present invention.

  In the first embodiment, the numerical value read by the acceleration sensor 303 is input to the CPU 301, and the data obtained by the CPU 301 calculating the movement amount of the image is output to the touch panel 107. However, in the fifth embodiment, FIG. 13, a computer 1301 is provided between the CPU 301 and the touch panel 107, and causes the computer 1301 to perform a part of the processing of the CPU 301 described in the above embodiment.

  That is, the acceleration sensor 303 outputs the detected acceleration data to the computer 1301, and the computer 1301 calculates the movement amount of the mobile phone 1300 based on the acceleration data output from the acceleration sensor 303.

  The computer 1301 corrects the movement amount of the mobile phone calculated from the output of the acceleration sensor 303 with respect to the display information of the image output from the CPU 301 and outputs the corrected information to the touch panel 107. Similar to the first embodiment, this correction is such that the screen display of the mobile phone 1300 is fixed in space.

  Therefore, in the present embodiment, on the touch panel 107, an image in which the movement amount with respect to the movement of the mobile phone 1300 is corrected is displayed, so that the screen display of the mobile phone 1300 is fixed in the space as in the first embodiment. As a result, the visibility of the displayed image can be improved.

  Note that, as shown in the second and third embodiments described above, when the movement amount L of the mobile phone 1300 is calculated from the image captured by the in-camera 101 or the out-camera 109, FIG. Similarly to the acceleration sensor 303 shown, the output of the in-camera 101 or the out-camera 109 may be output to the computer 1301. In this case, the in-camera 101 or the out-camera 109 outputs a captured image to the computer 1301. Further, the computer 1301 corrects the display information of the image output from the CPU 301 with the movement amount with respect to the movement of the mobile phone 1300 calculated from the captured image output from the in-camera 101 or the out-camera 109, and displays the information on the touch panel 107. Output.

As is apparent from the above description, according to the mobile phone 1300 of the fifth embodiment of the display device according to the present invention, the same effects as those of the first embodiment described above can be obtained. In this embodiment, since the computer 1301 corrects the amount of movement of the mobile phone 1300 to the display information of the image input from the CPU 301 and outputs the corrected information to the touch panel 107, the time for the point to move and display the image. Less delay.
(Sixth embodiment)
Next, the operation of the mobile phone which is the sixth embodiment of the display device according to the present invention will be described with reference to FIGS. FIG. 14 is a schematic diagram of an operation of a mobile phone that is the sixth embodiment of the display device according to the present invention, and FIG. 15 is an operation of the mobile phone that is the sixth embodiment of the display device according to the present invention. It is a flowchart of. In the following description of the sixth embodiment, differences from the above-described first embodiment will be described.

  In the present embodiment, the moving amount L of the mobile phone 100 is increased, and the image 601 that was initially displayed moves to the position of the end E of the screen.

  As shown in FIG. 14, the movement amount L of the mobile phone 100 is increased, and the image 601 that was initially displayed has moved to the position of the end E of the screen. 601 is not displayed. In FIG. 14, the display image 601 after the mobile phone 100 has moved is illustrated outside the mobile phone 100, but this is conceptually illustrated for easy understanding of the description. Such a display is not made.

  Then, as shown in FIG. 14, the CPU 301 increases the moving amount L of the mobile phone 100, and as a result of the image 601 that was initially displayed moving beyond the position of the edge E of the screen, Instead of displaying the image 601 on the screen, a mark S indicating that the image 601 is no longer displayed is displayed. This mark S may be, for example, a mark indicating the direction in which the initially displayed image 601 is hidden from the screen.

  Next, the operation of the present embodiment will be described with reference to FIG. FIG. 15 is a process executed in place of step S405 in the flowchart of the first embodiment shown in FIG.

  First, the CPU 301 moves the image 601 based on the calculated image movement amount. The direction in which the image is moved is a direction in which the image is as if it is fixed in space. For example, when the mobile phone 100 moves in the positive X-axis direction, it moves in the negative X-axis direction (S1501).

  Next, the CPU 301 determines whether or not the image 601 exceeds the end E of the display screen D of the LCD 317 as a result of moving the image 601 (S1503). If the image 301 moves beyond the end E of the display screen D of the LCD 317 (Yes) as a result of moving the image (Yes), the CPU 301 proceeds to step S1505, and the image 601 is displayed on the LCD 317 as a result of moving the image. If the end E of the screen D has not been reached (No), the process ends.

  Next, in step S1505, the CPU 301 does not display the image 601 from the display screen D and displays a mark S indicating that the image 601 is no longer displayed.

  In addition to the image movement amount calculation process of step S403 shown in FIG. 4, the image movement amount calculation process described with reference to FIG. 7 and FIG. You can do it.

As is apparent from the above description, according to the sixth embodiment of the present invention, the same effects as those of the first embodiment described above can be obtained, and the movement amount L of the mobile phone 100 is increased, so that the initial display is performed. As a result of the moved image 601 moving beyond the position of the edge E of the screen, the image 601 is not displayed on the display screen of the mobile phone 100 and a mark S indicating that the image 601 is no longer displayed is displayed. Therefore, the movement of the image 601 relative to the movement of the mobile phone 100 is made more conceptually correct, and the user can easily understand that the image 601 is not displayed on the screen due to the movement.
(Seventh embodiment)
Next, the operation of the mobile phone which is the seventh embodiment of the display device according to the present invention will be described with reference to FIGS. FIG. 16 is a schematic diagram of an operation of a mobile phone which is the seventh embodiment of the display device according to the present invention, and FIG. 17 is an operation of the mobile phone which is the seventh embodiment of the display device according to the present invention. It is a flowchart of. In the following description of the seventh embodiment, differences from the above-described first embodiment will be described.

  In the present embodiment, as shown in FIG. 16, the movement amount L of the mobile phone 100 becomes large, and the calculation result when the initially displayed image 601 is moved beyond the position of the edge E of the screen is obtained. It is an embodiment.

  In the present embodiment, as shown in FIG. 16, when the movement amount L of the mobile phone 100 increases and the calculation result of moving the initially displayed image 601 beyond the position of the edge E of the screen is obtained, The movement of 601 is stopped at the edge E of the screen.

  Next, the operation of the present embodiment will be described with reference to FIG. FIG. 17 is a process executed in place of step S405 in the flowchart of the first embodiment shown in FIG.

  First, the CPU 301 moves the image 601 based on the calculated image movement amount. The direction in which the image is moved is a direction in which the image is as if it is fixed in space. For example, when the mobile phone 100 moves in the positive direction of the X axis, it is moved in the negative direction of the X axis (S1701).

  Next, the CPU 301 determines whether or not the moving position of the image 601 has exceeded the end E of the display screen D of the LCD 317 as a result of moving the image 601 (S1703). If the movement position of the image 601 exceeds the end E of the display screen D of the LCD 317 (Yes) as a result of moving the image, the CPU 301 proceeds to step S1705, and as a result of moving the image, the image If the movement position of 601 does not exceed the end E of the display screen D of the LCD 317 (No), the process is terminated.

  Next, the CPU 301 stops the movement of the image 601 at the position of the end E of the display screen D and displays the image 601 in step S1705. That is, when the image movement amount L becomes larger than the distance from the position of the image 601 before the mobile phone 100 moves to the end E of the display screen D, the CPU 301 moves the image 601 all of the movement amount L. Instead, the image 601 is stopped at the position of the end E of the display screen D and displayed.

  In addition to the image movement amount calculation process of step S403 shown in FIG. 4, the image movement amount calculation process described with reference to FIG. 7 and FIG. You can do it.

As is clear from the above description, the cellular phone 100 which is the seventh embodiment of the display device according to the present invention can obtain the same effects as those of the first embodiment. Furthermore, in the mobile phone 100 that is the seventh embodiment of the display device according to the present invention, when the image 601 has reached the end E of the display screen D of the LCD 317 as a result of moving the image, the image 601 is displayed. The movement is stopped at the position of the end E of the display screen D and displayed. Thereby, in the mobile phone 100 which is the seventh embodiment of the display device according to the present invention, the image 601 is not made invisible by the movement of the mobile phone 100, and the convenience can be further improved.
(Eighth embodiment)
Next, the operation of the mobile phone which is the eighth embodiment of the display device according to the present invention will be described with reference to FIG. 18, FIG. 19 and FIG. FIG. 18 is a schematic diagram of the operation of a mobile phone which is the eighth embodiment of the display device according to the present invention, and FIGS. 19 and 20 are mobile phones which are the eighth embodiment of the display device according to the present invention. It is a flowchart of operation | movement of a telephone. In the following description of the eighth embodiment, differences from the above-described first embodiment will be described.

  One embodiment of the display device according to the eighth embodiment is an embodiment in which the amount of movement of an image due to movement of the mobile phone 100 is set to a maximum W regardless of the amount of movement of the mobile phone 100. As this W, for example, 3 mm can be given, but in the present invention, W is not limited to 3 mm, and other appropriate values can be taken.

  In the present embodiment, as shown in FIG. 18, when the correction mode is turned on, the screen 601 that has been displayed is reduced and displayed. As a result of reducing the image 601, an image non-display area B is formed with W being the distance between the display screen edge and the image 601.

  In the present embodiment, the movement amount of the image 601 is limited to the maximum movement amount W. Therefore, when the mobile phone 100 moves L (> W) in the positive direction of the X axis, the display image 601 moves by W in the negative direction of the X axis. Further, when L (= <W) moves in the positive direction of the X axis, the display image 601 moves by L in the negative direction of the X axis.

  Here, since the display image 601 is reduced and displayed so that the distance from the screen edge becomes W when the correction mode is turned on in advance, even if the image 601 moves, the screen is displayed on the display unit. There is no hiding outside.

  Next, the operation of the present embodiment will be described with reference to the flowcharts of FIGS. If the correction mode is ON (Yes), the CPU 301 proceeds to step S1903. If the correction mode is not ON (No), the CPU 301 proceeds to step S1901.

  Next, the CPU 301 reduces the currently displayed image (step S1903). This reduction is reduction with the distance between the display screen edge and the image 601 as W as a result of the reduction of the image 601 (S1903).

  Next, the CPU 301 calculates an image movement amount from the output of the acceleration sensor 303 (step S1905). The image movement amount calculation operation in step S1905 shown in FIG. 19 is the same as that described with reference to FIG.

  Next, the CPU 301 moves the image displayed on the screen of the touch panel 107 based on the calculated image movement amount (step S1907). The direction in which the image is moved is a direction in which the image is as if it is fixed in space. For example, when the mobile phone 100 moves in the positive X-axis direction, the mobile phone 100 moves in the negative X-axis direction.

  Thereafter, the CPU 301 determines whether or not the correction mode has ended. If it has ended (Yes), the CPU 301 ends the operation. If it has not ended (No), the CPU 301 proceeds to step S1903 (step S1909). .

  Next, the image moving operation in step S1907 of this embodiment will be described with reference to FIG. FIG. 20 shows processing that is performed in place of step S405 in the flowchart of the first embodiment shown in FIG.

  First, the CPU 301 moves the image 601 based on the calculated image movement amount. The direction in which the image is moved is a direction in which the image is as if it is fixed in space. For example, when the mobile phone 100 moves in the positive direction of the X axis, it is moved in the negative direction of the X axis (S2001).

  Next, the CPU 301 determines whether or not the movement amount exceeds a predetermined set value W as a result of moving the image 601 (S2003). If the movement amount of the image 601 exceeds W (Yes) as a result of moving the image (Yes), the CPU 301 proceeds to step S2005, and as a result of moving the image, the image 601 becomes an end of the display screen D of the LCD 317. If E has not been reached (No), the process is terminated.

  Next, the CPU 301 stops the movement amount of the image 601 at the maximum movement amount W in step S2005. In this case, as described above, since the distance between the reduced image 601 and the edge of the screen is W, the movement of the image 601 stops at the edge of the display screen.

  In addition to the image movement amount calculation process of step S403 shown in FIG. 4, the image movement amount calculation process described with reference to FIG. 7 and FIG. You can do it. Note that the setting value W of the present embodiment may be set in advance or may be set by the user.

As is clear from the above description, in the mobile phone 100 that is the eighth embodiment of the display device according to the present invention, the same effects as those in the first embodiment can be obtained, and the mobile phone 100 can be shaken. Even when the movement amount L exceeds the predetermined setting value W, the image 601 is reduced in advance so as to be displayed at a distance W from the screen edge, and the movement amount of the image 601 is the maximum W. Thus, the moved image 601 can be prevented from being hidden outside the screen, and the visibility can be further improved.
(Ninth embodiment)
Next, the operation of the mobile phone which is the ninth embodiment of the display device according to the present invention will be described with reference to FIGS. FIG. 21 is a schematic diagram of the operation of the mobile phone which is the ninth embodiment of the display device according to the present invention, and FIG. 22 is the operation of the mobile phone which is the ninth embodiment of the display device according to the present invention. It is a flowchart of. In the following description of the ninth embodiment, differences from the above-described first embodiment will be described.

  In the present embodiment, the amount of movement L of the mobile phone 100 is large, and L is an embodiment in which L exceeds the maximum moving distance W of the image that was initially set.

  As shown in FIG. 21, when the movement amount L of the mobile phone 100 increases and the image 601 that is initially displayed moves to the maximum movement distance W, the movement of the image 601 stops. In FIG. 21, as a result of the movement of the image 601 between the display image 601 and the display screen after the mobile phone 100 has moved, the distance between the display screen edge and the image 601 is set as W, and no image is displayed. Region B is formed.

  Next, the operation of the present embodiment will be described with reference to FIG. FIG. 22 is a process executed in place of step S405 in the flowchart of the first embodiment shown in FIG.

  First, the CPU 301 moves the image 601 based on the calculated image movement amount. The direction in which the image is moved is a direction in which the image is as if it is fixed in space. For example, when the mobile phone 100 moves in the positive X-axis direction, it moves in the negative X-axis direction (S2201).

  Next, the CPU 301 determines whether or not the moving amount L of the image 601 exceeds a predetermined set value W as a result of moving the image 601 (S1503). If the image movement amount L exceeds W (Yes), the CPU 301 proceeds to step S2205. If the image movement amount L does not exceed W as a result of moving the image (No), the CPU 301 performs processing. Exit.

  Next, in step S2205, the CPU 301 moves the image 601 by the distance W, and then stops the movement of the image 601.

  In addition to the image movement amount calculation process of step S403 shown in FIG. 4, the image movement amount calculation process described with reference to FIG. 7 and FIG. You can do it. Note that the setting value W of the present embodiment may be set in advance or may be set by the user.

  As is apparent from the above description, according to the ninth embodiment of the present invention, the same effect as that of the first embodiment described above can be obtained, and the movement amount L of the mobile phone 100 is increased, and a predetermined amount is obtained. When the set value W is exceeded, since the moving amount of the image 601 is limited to W, the rate at which the image 601 is hidden outside the screen is limited, and the visibility can be further improved.

  The display device according to the present invention is not limited to the above embodiments, and various modifications can be made.

  For example, the above embodiments can be implemented in combination as appropriate. In addition, the user's mode setting and on / off of operations of the combined embodiments may be switched.

  For example, in the description of the above embodiment, the mobile phone is moved by the distance L in the X-axis direction of the acceleration sensor, and the touch panel surface of the mobile phone is facing the Z-axis direction of the acceleration sensor. It is not limited to such a case. That is, the mobile phone may move in an arbitrary direction, and the touch panel surface of the mobile phone may face the arbitrary direction.

  In this case, the CPU 301 detects the orientation of the touch panel surface from the output of the acceleration sensor 303 based on the value of gravitational acceleration. Then, the amount of movement of the image is detected based on the X-axis, Y-axis, and Z-axis outputs of the acceleration sensor 303 when the mobile phone is moved, and the detected orientation of the touch panel surface. Move it so that it is fixed in space.

  In the present invention, the direction in which the image is moved can be only one axis such as the direction of gravity. In this case, it is only necessary to perform image movement processing in one axial direction, so the processing burden on the apparatus is reduced.

  Further, in the present invention, when the spatial position of the display device remains moved due to shaking or the like, the moved image is moved to the position before the movement over a predetermined time after the movement of the display device. A process of returning may be performed. This predetermined time may be changed according to the moving speed of the display device. That is, when the display device moves slowly, the predetermined time for returning the image may be lengthened, and when the display device moves quickly, the predetermined time for returning the image may be shortened.

  In the above embodiment, the LCD 317 is used in the touch panel 107, but an organic EL (Organic Electro-Luminescence: OEL) may be used instead of the LCD 317. In this case, since the organic EL generally has better response performance than the LCD, the image can be moved quickly.

  In the above embodiment, except for the fourth embodiment, timing control for moving the image relative to the movement of the mobile phone is not specified, but the delay time for moving the image relative to the movement of the mobile phone is set by the user. May be adjustable. In this case, the movement of the image with respect to the movement of the mobile phone can be adapted to each user's preference.

  In each of the above embodiments, the touch panel 107 is exemplified as a display unit that displays an image. However, the display unit is not limited to the touch panel, and may be an LCD or an organic EL other than the touch panel. .

  Further, in the sixth embodiment, when the moving amount L of the mobile phone 100 increases and the image 601 that was initially displayed has moved beyond the position of the edge E of the screen, the CPU 301 simply passes the mobile phone 100. The image 601 may not be displayed on the display screen, and the mark S may not be displayed.

  Moreover, in the said embodiment, although the mobile phone (smartphone) was mentioned as an example as an example of a display apparatus, this invention is not limited to such a case, Other mobile phones, such as a future phone, PDA It can be applied to a suitable display device having an image display function, such as a personal computer, a game machine, a music player, a car navigation system, a wristwatch, a tablet terminal.

DESCRIPTION OF SYMBOLS 100 Mobile phone 101 In camera 103 Receiver 105 Main key 107 Touch panel 109 Out camera 301 CPU
303 Acceleration sensor 305 Memory 307 Audio output unit 309 Communication unit 311 Imaging unit 313 Input unit 601 Image 603 Image 801a Imaging screen 801b Imaging screen 803 Reference image 1001a Imaging screen 1001b Imaging screen 1003rd image 1300 Mobile phone 1301 Computer B Image non-display Area D Display screen E Edge of screen S mark

Claims (12)

A display for displaying an image;
A detection unit for detecting movement of the device;
A calculation unit that calculates a movement amount of an image to be displayed on the display unit based on the detected movement of the device ;
A display control unit that displays the image on the display unit such that the display position of the image is moved based on the movement amount calculated from the calculation unit and the image is fixed in space , and
The calculation unit detects a period of movement of the display device,
The display control unit displays the image by moving the display position of the image by delaying the natural number times the movement period based on the movement amount calculated by the calculation unit. The detector is
The display device according to claim 1, wherein the display device is an acceleration sensor that detects acceleration of the display device.   The display device according to claim 1, wherein the detection unit is an imaging unit that captures an image.   The display device according to claim 3, wherein the imaging unit captures an image of a user's eyes. The display control unit
When the display position indicated by the movement amount exceeds the display range of the display unit,
The display device according to claim 1, wherein the image is not displayed and a mark indicating that the image is not displayed is displayed. The display control unit
When the display position indicated by the movement amount exceeds the display range of the display unit,
The display device according to claim 1, wherein the image is displayed at an end of the display unit. The display control unit
The display device according to claim 1, wherein the image is reduced. The display control unit
The display device according to claim 7 , wherein a reduction ratio of the image is determined based on a maximum movement amount of the image. The display control unit
The display device according to claim 1, wherein a predetermined maximum movement amount is set as the movement amount of the image.   The calculation unit calculates the same amount as the detected movement of the device as the movement amount of the image, and the display control unit moves the image from the position before the display device is moved by the movement amount. The display device according to claim 1, wherein the image is displayed so as not to move spatially with respect to the movement of the display device.   The display device according to claim 1, wherein the display control unit returns the image whose display position has been moved to the display position before the movement over a predetermined time corresponding to the speed of the movement after the movement of the device is finished. . A display step of displaying an image on the display unit;
A detection process for detecting movement of the device;
A calculation step of calculating a movement amount of an image to be displayed on the display unit based on the detected movement of the device;
A moving step of moving the display position of the image based on the moving amount calculated in the calculating step,
In the detection step, a period of movement of the display device is detected,
In the moving step, the display position of the image is moved with a natural number multiple of the cycle of the movement based on the moving amount calculated in the calculating step.

Images