JP5174704B2 - Image processing apparatus and image processing method - Google Patents

Description

  The present invention relates to a technique for displaying an image such as a map image.

  In recent years, in a device such as a mobile phone or a PDA (Personal Data Assistant), an example of adopting a touch panel as a user interface in order to operate an image such as a map image displayed on a screen is increasing.

  In Patent Document 1, in a device that uses a touch panel, when a user brings a finger close to an arbitrary position on a map image displayed on a screen, the name of a building displayed small near the fingertip is enlarged and displayed. (See FIG. 19 of Patent Document 1). Further, this Patent Document 1 discloses a technique for moving the display position of a name when the name of the enlarged building is hidden under the fingertip. However, in the technique described in Patent Document 1, only when the name of the building is displayed under the fingertip, the display position can only be moved. Even if an image representing the image is hidden under the fingertip, the display position of the image cannot be moved.

JP 2008-250948 A

  Considering the above-described problems, the problem to be solved by the present invention is to improve the visibility of an image hidden under a fingertip in an apparatus that accepts an image operation using a touch panel or the like.

SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms or application examples.
A first aspect of the present invention is an image processing apparatus provided with a display device,
A first display unit that displays a first image in a predetermined display area of the display device;
A position detector for detecting a designated position in the display area;
A second image within a predetermined range including the position detected by the position detection unit is duplicated from the first image, and the second image is detected on the first image as the detected position. A second display for displaying at a predetermined position away from
With
The second display unit displays the second image when the position detection unit detects that the designation of the position has been performed for a predetermined time or more,
When the first display unit detects that the designated position has been moved within the display area using the position detection unit, the first display unit follows the movement of the designated position and moves the first display unit. Are displayed on the display device,
The second display unit detects designation of a position longer than the predetermined time regardless of whether or not the first image is displayed following the movement of the designated position.
An image processing apparatus.
In the case of the image processing apparatus having such a configuration, when the position in the display area of the display apparatus is designated by a fingertip or the like, an image (second image) hidden under the fingertip is originally displayed. Duplicate from the image (first image) and display it at another position. Therefore, an image hidden under the fingertip can be displayed at another position regardless of the type of the displayed image. As a result, it becomes possible to improve the visibility of the image hidden under the fingertip. Further, with such a configuration, the first image can be displayed following the designated position even during the counting of a predetermined time for determining whether or not to display the second image. Therefore, the operation for displaying the first image following the designated position and the operation for displaying the second image can be performed as an integrated operation, and the convenience of the user can be improved. It becomes possible.

Application Example 1 An image processing apparatus including a display device, wherein a first display unit that displays a first image in a predetermined display area of the display device, and a position specified in the display area A position detection unit to detect and a second image within a predetermined range including the position detected by the position detection unit are duplicated from the first image, and the second image is copied onto the first image. An image processing apparatus comprising: a second display unit configured to display at a predetermined position away from the detected position.

  In the case of the image processing apparatus having such a configuration, when the position in the display area of the display apparatus is designated by a fingertip or the like, an image (second image) hidden under the fingertip is originally displayed. Duplicate from the image (first image) and display it at another position. Therefore, an image hidden under the fingertip can be displayed at another position regardless of the type of the displayed image. As a result, it becomes possible to improve the visibility of the image hidden under the fingertip.

Application Example 2 In the image processing device according to Application Example 1, the second display unit detects the first display when the position detection unit detects that the position is specified for a predetermined time or more. An image processing apparatus that displays two images. With such a configuration, it is not necessary to display the second image every time the position is designated. As a result, the processing burden on the image processing apparatus can be reduced.

Application Example 3 In the image processing apparatus according to Application Example 2, in the first display unit, the designated position is continuously moved in the display area by the position detection unit. When detected, the first image is scrolled and displayed on the display device following the movement of the designated position, and the second display unit displays whether or not the first image is scrolled. Regardless of this, an image processing apparatus that detects designation of a position that is longer than the predetermined time. With such a configuration, the first image can be scrolled even during the counting of a predetermined time for determining whether or not to display the second image. Therefore, the operation for scrolling the first image and the operation for displaying the second image can be performed as an integrated operation, and the convenience for the user can be improved.

Application Example 4 In the image processing apparatus according to Application Example 3, the second display unit may be configured to scroll the first image by the first display unit when displaying the second image. An image processing apparatus that moves the second image by following the movement. With such a configuration, the first image and the second image can be scrolled at the same time while the second image is displayed, so that the image hidden under the fingertip is displayed outside the screen. It is possible to easily compare with an image.

Application Example 5 In the image processing device according to Application Example 4, in the second display unit, the display position of the second image is out of the display area due to the movement of the second image. In this case, the image processing apparatus changes the display position of the second image to a position in the display area. With such a configuration, the second image can be prevented from disappearing outside the screen.

Application Example 6 In the image processing device according to any one of Application Examples 3 to 5, the first display unit includes a scrollable display of the first image and a user interface that cannot be scrolled. The interface image can be displayed, and the second display unit displays the second image including the interface image at the predetermined position even when the interface image is included in the predetermined range. An image processing apparatus. With such a configuration, regardless of whether the displayed image is an image that can be scroll-displayed or an image that cannot be scroll-displayed, if the fingertip touches the image, the second image including the image is included. This image can be displayed at other positions. As a result, for example, when a fingertip touches a button or the like fixedly displayed in the display area, an image representing the button or the like is also displayed at a position away from the position of the fingertip. Therefore, it is possible to easily confirm whether or not the button has been operated reliably.

  In addition to the configuration as the image processing apparatus described above, the present invention can also be configured as an image processing method and a computer program. The computer program may be recorded on a computer-readable recording medium. As the recording medium, for example, various media such as a flexible disk, an optical disk, a magneto-optical disk, a memory card, a flash memory, and a hard disk can be used.

1 is a front view of an image processing apparatus 10 as an embodiment of the present invention. 2 is a block diagram showing an internal configuration of the image processing apparatus 10. FIG. It is a flowchart of a partial image display processing routine. It is a figure which shows a display state when a fingertip touches the touch panel. It is a figure which shows the display state after sliding a fingertip on the touch panel. It is a figure which shows the example by which the partial image was displayed on the upper right of the fingertip. It is a figure which shows the state which slid the fingertip on the touch panel 12 in the state where the partial image was displayed. It is a figure which shows the example in which the menu button was displayed as a partial image. It is a figure which shows the example of a display in which the display position of the partial image was reversed to the left side. It is a figure which shows the example of a display in which the display position of the partial image was reversed below. It is a figure which shows the example by which the map image and the partial image were rotated and displayed. It is a figure which shows the example of a display of the partial image at the time of touching the touch panel 12 with two fingers of a right hand. It is a figure which shows the example of a display of the partial image at the time of touching the touch panel 12 with two fingers of the left hand.

Hereinafter, embodiments of the present invention will be described in the following order based on examples.
A. Mobile phone configuration:
B. Partial image display processing:
C. Variations:

A. Mobile phone configuration:
FIG. 1 is a front view of an image processing apparatus 10 as an embodiment of the present invention. As shown in FIG. 1, in this embodiment, a mobile phone is applied as the image processing apparatus 10. The image processing apparatus 10 of this embodiment includes a liquid crystal display 14 as a display device. In the display area within the liquid crystal display 14, for example, an image such as a map image or a photographic image is displayed. FIG. 1 shows an example in which a map image is displayed on the liquid crystal display 14. The liquid crystal display 14 is provided with a light transmissive touch panel 12 in an overlapping manner. The user can perform various operations on the image displayed on the liquid crystal display 14 by bringing the touch panel 12 into contact with various pens such as a fingertip and a stylus pen. As the touch panel 12, various types such as a capacitance type and a resistance film type can be adopted, for example.

  FIG. 2 is a block diagram showing an internal configuration of the image processing apparatus 10. As shown in FIG. 2, the image processing apparatus 10 includes a CPU 16, a RAM 18, and a ROM 20. The touch panel 12 is connected to the CPU 16, and further, a GPS receiver 22 that measures the current position, a wireless communication circuit 26 that performs communication control such as voice communication and data communication via the antenna 24, a telephone number, and the like. An operation button 28 for inputting, an attitude detection circuit 30 for detecting the attitude of the image processing apparatus 10, an image memory 32 for temporarily storing image data to be displayed on the liquid crystal display 14, and image data read from the image memory 32 to read liquid crystal A display control circuit 34 for displaying on the display 14 is connected. Although not shown in FIG. 2, the image processing apparatus 10 includes a microphone and a speaker for operating as a mobile phone, a circuit for controlling incoming and outgoing voices, and the like.

  The CPU 16 loads the control program stored in the ROM 20 into the RAM 18 and executes it, thereby controlling the overall operation of the image processing apparatus 10, as well as the map image display unit 36 (first display unit) It functions as an image display unit 38 (second display unit).

  The map image display unit 36 realizes processing for displaying a map image on the liquid crystal display 14. Specifically, when the map image display unit 36 acquires the longitude and latitude indicating the current position from the GPS receiver 22, the map image display unit 36 accesses an external server (not shown) using the wireless communication circuit 26, and the longitude and latitude are obtained. Map image data of a predetermined range (for example, a range corresponding to nine display areas of the liquid crystal display 14) is received. This map image data is vector format data. When acquiring the map image data from the server, the map image display unit 36 stores the acquired map image data in the RAM 18. The map image display unit 36 converts the map image data for the display area of the liquid crystal display 14 out of the map image data stored in the RAM 18 into a raster format and transfers it to the image memory 32. The display control circuit 34 reads raster-format map image data from the image memory 32, converts it into an electrical signal, and drives the liquid crystal display 14. The map image display unit 36 can display the map image on the liquid crystal display 14 by performing these processes.

  When the user operates the touch panel 12, the partial image display unit 38 reproduces an image hidden under the fingertip of the user and displays the image at a position away from the position of the fingertip. A specific description of this process will be described later.

  The image processing apparatus 10 includes an attitude detection circuit 30 as shown in FIG. The posture detection circuit 30 includes an acceleration sensor, and detects the installation angle (direction in which the image processing apparatus 10 is installed) with respect to the direction of gravity by using the acceleration sensor. When the CPU 16 detects that the image processing apparatus 10 has been rotated by a predetermined angle or more (for example, 70 ° or more) from the state shown in FIG. 1 using the posture detection circuit 30, the CPU 16 controls the display control circuit 34. Thus, the display direction of the map image is rotated by 90 ° and displayed on the liquid crystal display 14. That is, the image processing apparatus 10 can switch the display direction of the liquid crystal display 14 between the horizontal direction and the vertical direction according to the direction in which the user holds the image processing apparatus 10.

B. Partial image display processing:
FIG. 3 is a flowchart of a partial image display processing routine executed by the map image display unit 36 and the partial image display unit 38 of the CPU 16. In this partial image display processing routine, when the user operates the touch panel 12, an image hidden under the fingertip of the user is moved to another position and displayed.

  When this image display processing routine is executed, the CPU 16 first detects whether the user's fingertip has touched the touch panel 12 (step S100). When detecting that the user's fingertip has touched the touch panel 12, the CPU 16 starts counting of the timer (step S102).

  After the timer starts counting, the CPU 16 acquires the coordinates at which the user's fingertip touches from the touch panel 12 (step S104). When the coordinates are acquired, the CPU 16 uses the map image display unit 36 to scroll and display the map image according to the acquired coordinates (step S106). That is, according to this process, when the user slides the fingertip on the touch panel 12, the map image can be scrolled following the movement of the fingertip. Of course, if the coordinates acquired in step S104 do not vary from the previous coordinates, the map image is not scrolled and its display position does not change. 4 and 5 show an example in which the map image is scrolled following the movement of the fingertip. 4 shows a display state when the fingertip touches the touch panel 12, and FIG. 5 shows a display state after the fingertip is slid on the touch panel 12. In the process of step S106, when a partial image to be described later is displayed on the map image, this partial image is also scrolled in accordance with the movement of the user's fingertip.

  Subsequently, the CPU 16 determines whether or not the value of the timer that has started counting in step S102 has reached 0.5 seconds or more (step S108). If the timer value is 0.5 seconds or more, the CPU 16 copies a partial image (for example, an image corresponding to 1 cm × 1 cm) centered on the coordinates acquired in step S104 from the image memory 32 (step S110). Then, the copied partial image is displayed superimposed on the map image at the upper right position separated by a predetermined distance (for example, a distance equivalent to 1 cm) from the coordinates acquired in step S104 (step S112). FIG. 6 shows an example in which a partial image is displayed on the upper right of the fingertip in this way. In the present embodiment, when the fingertip is slid on the touch panel 12 in a state where the partial image is displayed as shown in FIG. 6, the map image and the partial image follow the movement of the fingertip by the process of step S106 described above. Scroll simultaneously. FIG. 7 shows an example in which the map image and the partial image are simultaneously scrolled from the display state shown in FIG. As described above, when the map image and the partial image are simultaneously scrolled following the movement of the fingertip, the images in the partial image do not fluctuate before and after scrolling.

  In the processing of step S110 and step S112 described above, even when a finger is touched for 0.5 seconds or longer on a user interface such as a menu button that is fixedly displayed on the screen (that is, not scrolled), The user interface is displayed in the partial image. FIG. 8 shows an example in which the menu button is displayed in the partial image. However, when the menu button is displayed in the partial image as shown in FIG. 8, if the fingertip is slid to another position on the menu button, the menu button is naturally deleted from the partial image. Become. In addition, in this embodiment, when the menu button is pressed by the user via the touch panel 12, the state in which the button is depressed is displayed by animation. In the present embodiment, the menu button in the partial image is also displayed in an animated manner in the same way as the original animation display of the menu button. In this way, if the menu button in a partial image is animated as well as the original menu button, it can be easily confirmed by the display state of the button in the partial image whether the button is actually pressed. become. Such an effect is particularly effective when the image representing the user interface is small enough to be hidden behind the fingertip. However, in this embodiment, when the fingertip is slid from another position onto the menu button, the menu button is displayed in the partial image, but it is not handled that the menu button is operated. Therefore, in such a case, neither the original menu button nor the menu button in the partial image is displayed with animation.

  When the partial image is superimposed and displayed on the map image in step S112, the CPU 16 determines whether or not the displayed partial image protrudes from the right end of the display area of the liquid crystal display 14 (step S114). When it protrudes from the right end, the display position of the partial image is reversed in the horizontal direction and moved to the left side (step S116). If it does not protrude from the right end, the process of step S116 is skipped. FIG. 9 shows an example in which the display position of the partial image is reversed to the left side. Subsequently, the CPU 16 determines whether or not the displayed partial image protrudes from the upper end of the display area of the liquid crystal display 14 (step S118). When it protrudes from the upper end, the display position of the partial image is reversed in the vertical direction and moved downward (step S120). If it does not protrude from the upper side, the process of step S120 is skipped. FIG. 10 shows an example in which the display position of the partial image is inverted downward. According to steps S114 to S120 described above, the partial image can always be displayed in the display area of the liquid crystal display 14. FIG. 10 shows an example in which the partial image is displayed in reverse on the left side and further displayed in reverse on the lower side. Therefore, a partial image is displayed at the lower left of the fingertip. On the other hand, when the partial image is displayed on the right side and the partial image protrudes from the upper end, the display position of the partial image is the lower right of the fingertip.

  By the way, when it is not detected in step S100 that the user's fingertip touches the touch panel 12, the CPU 16 determines whether the partial image has already been displayed (step S122). If the partial image is already displayed, the CPU 16 deletes the partial image (step S124) and resets the timer (step S126). If the partial image is not displayed, these processes (steps S124 and S126) are skipped. According to the processing in steps S122 to S126 described above, when the fingertip is separated from the touch panel 12, the already displayed partial image can be erased from the screen.

  When the posture detection circuit 30 detects that the posture of the image processing apparatus 10 has been changed during the execution of the partial image display processing routine described above, the CPU 16 controls the display control circuit 34. Switch the display direction of the entire screen. Therefore, if the user switches the direction in which the image processing apparatus 10 is held from the vertical direction to the horizontal direction, the display directions of map images, partial images, menu buttons, etc. all change by 90 ° as shown in FIG. It will be.

  In the case of the image processing apparatus 10 according to the present embodiment described above, even if the image is hidden under the fingertip of the user by the operation of the touch panel 12, the image under the fingertip is moved to another position. Can be displayed as a partial image. Therefore, the visibility of the image displayed under the fingertip can be improved.

  In this embodiment, not only an image such as a map image but also other objects hidden under the fingertip, such as menu buttons, are displayed as partial images at other positions. Therefore, not only an image such as a map image, but also the visibility of all images displayed under the fingertips including the user interface can be improved. Further, in this embodiment, when the menu button is pressed and displayed as an animation, the menu button displayed in the partial image is also displayed as an animation. Therefore, it is possible to easily confirm whether the user interface has been reliably operated.

  In addition, in this embodiment, even when the partial image is being displayed, when the fingertip moves on the touch panel 12, the map image and the partial image are scroll-displayed following the movement. That is, it is possible to scroll both the map image and the partial image while displaying the partial image. As a result, it is possible to easily compare the image hidden under the fingertip with the image displayed outside the screen. In addition, even when the partial image protrudes from the edge of the screen as a result of the scroll display, in this embodiment, the display position of the partial image is changed on the opposite side of the edge, that is, in the display area. To do. For this reason, the partial image itself does not protrude from the edge of the screen and become invisible. Further, in this embodiment, the map image can be scrolled even during the counting of the time of 0.5 seconds when the display of the partial image is started. Therefore, the operation for performing the scroll display and the operation for displaying the partial image can be performed as an integrated operation, so that the convenience for the user can be improved.

  In addition, as described above, in this embodiment, after the user touches the touch panel 12 with a finger, the image under the fingertip is displayed as a partial image at another position after a predetermined time. Therefore, it is not necessary to display a partial image every time the touch panel 12 is operated. As a result, the processing load on the CPU 16 is reduced, so that the power consumption of the image processing apparatus 10 can be reduced.

C. Variations:
As mentioned above, although one Example of this invention was described, it cannot be overemphasized that this invention is not limited to such an Example, but can take a various structure in the range which does not deviate from the meaning. For example, a function realized by software may be realized by hardware. In addition, the following modifications are possible.

  The above embodiment has been described on the assumption that the coordinate acquired from the touch panel 12 is one point. That is, in the above embodiment, it is assumed that the touch panel 12 is operated with one finger. However, the touch panel 12 may be able to acquire a plurality of coordinates, for example, two coordinates. At this time, for example, the partial image may be displayed based on the previously acquired coordinates among the coordinates of the two points. If the acquired coordinates of the two points are in a right-up relationship, it is determined that the operation is performed with the right hand, and a partial image may be displayed on the upper left as shown in FIG. Conversely, if the acquired coordinates of the two points are in a right-down relationship, it may be determined that the left hand is operating and a partial image may be displayed on the upper right as shown in FIG. In this way, if the display position of the partial image is switched according to whether the operating hand is the left hand or the right hand, it is possible to suppress the partial image from being hidden between the two fingers. Become. Further, in the case where the coordinates of two points can be acquired, for example, the map image may be rotated and displayed with the first acquired coordinate as the center and following the acquired coordinate. In this case, for example, the first acquired coordinate, that is, the image of the center of the circle can be displayed as a partial image at another position. In this way, it is possible to easily confirm which position is used as the center for rotating the image.

  In the above embodiment, when the posture of the image processing apparatus 10 changes from the vertical direction to the horizontal direction (or vice versa), the display direction of the map image or the partial image is rotated by 90 °. On the other hand, the image processing apparatus 10 may include a mechanism that allows only the liquid crystal display 14 (and the touch panel 12) to rotate. In this case, it is determined whether or not the liquid crystal display 14 is rotated by providing a mechanical or optical switch for detecting that the liquid crystal display 14 is rotated instead of the acceleration sensor in the main body portion. can do.

  In the above embodiment, the image hidden under the fingertip is duplicated and displayed as a partial image at another position. That is, the image in the partial image is an image with the same magnification as the image hidden under the fingertip. On the other hand, an image hidden under the fingertip can be enlarged and displayed as a partial image. Thus, if the image under the fingertip is enlarged and displayed, the details of the image under the fingertip can be easily confirmed. Conversely, the image under the fingertip and the image including the periphery of the image can be reduced and displayed as a partial image. In this way, if the image under the fingertip and the image including the periphery thereof are reduced and displayed, it is possible to easily confirm which position in the map image the position of the image under the fingertip corresponds to. It becomes possible.

  In the above embodiment, a mobile phone is applied as the image processing apparatus 10. However, an apparatus applicable as the image processing apparatus 10 is not limited to a mobile phone. For example, various devices including a display device and a touch panel, such as a PDA, a PND (Personal Navigation Device), a navigation system, a personal computer, and a street terminal, can be applied as the image processing device 10.

  In the above embodiment, when the fingertip touches the normal position in the screen, the partial image is displayed at the upper right position of the fingertip. However, the display position of the partial image in the normal time is not limited to this. For example, it may be displayed on the upper left, lower left, lower right, or up, down, left, or right of the fingertip. Which direction is normally displayed can be determined as an indicator that the display is not hindered by the fingertip.

  In the above embodiment, the partial image is displayed when the fingertip touches the screen for a predetermined time or more. On the other hand, a partial image may be displayed when it is detected that a gesture indicating a predetermined graphic shape is performed by the fingertip while the fingertip is in contact with the screen.

DESCRIPTION OF SYMBOLS 10 ... Image processing apparatus 12 ... Touch panel 14 ... Liquid crystal display 16 ... CPU
18 ... RAM
20 ... ROM
DESCRIPTION OF SYMBOLS 22 ... GPS receiver 24 ... Antenna 26 ... Wireless communication circuit 28 ... Operation button 30 ... Attitude detection circuit 32 ... Image memory 34 ... Display control circuit 36 ... Map image display part 38 ... Partial image display part

Claims (6)

An image processing apparatus provided with a display device,
A first display unit that displays a first image in a predetermined display area of the display device;
A position detector for detecting a designated position in the display area;
A second image within a predetermined range including the position detected by the position detection unit is duplicated from the first image, and the second image is detected on the first image as the detected position. and a second display unit for displaying a predetermined position away from,
The second display unit displays the second image when the position detection unit detects that the designation of the position has been performed for a predetermined time or more,
When the first display unit detects that the designated position has been moved within the display area using the position detection unit, the first display unit follows the movement of the designated position and moves the first display unit. Are displayed on the display device,
The image processing apparatus, wherein the second display unit detects designation of a position that is longer than the predetermined time regardless of whether the first image is displayed following the movement of the designated position . The image processing apparatus according to claim 1 ,
When the second display unit displays the second image, the second display unit moves the second image following the tracking of the first image to the designated position by the first display unit. Image processing device. The image processing apparatus according to claim 2 ,
The second display unit sets the display position of the second image in the display area when the display position of the second image is outside the display area due to the movement of the second image. An image processing apparatus to be changed to. An image processing apparatus according to any one of claims 1 to 3,
The first display unit, together with the pre-Symbol first image is capable of displaying an interface image representing a user interface that is fixed to the display area,
The second display unit displays the second image including the interface image at the predetermined position even when the interface image is included in the predetermined range. An image display method by an image processing apparatus provided with a display device,
A first display step of displaying a first image in a predetermined display area of the display device;
A position detection step of detecting a designated position in the display area;
A second image within a predetermined range including the detected position is duplicated from the first image, and the second image is set to a predetermined distance from the detected position on the first image. A second display step of displaying at the position of
In the second display step, when it is detected by the position detection step that the designation of the position has been made for a predetermined time or longer, the second image is displayed,
In the first display step, when it is detected by the position detection step that the designated position has been moved within the display area, the first image is caused to follow the movement of the designated position. Is displayed on the display device,
An image display method in which, in the second display step, designation of a position at a predetermined time or more is detected regardless of whether or not the first image is displayed following the movement of the designated position . A program for displaying an image by a computer having a display device,
A first display function for displaying a first image in a predetermined display area of the display device;
A position detection function for detecting a designated position in the display area;
A second image within a predetermined range including the detected position is duplicated from the first image, and the second image is set to a predetermined distance from the detected position on the first image. And a second display function for displaying at the position of the computer .
The second display function displays the second image when the position detection function detects that the position is specified for a predetermined time or more,
The first display function causes the first display function to follow the movement of the designated position when the position detection function is used to detect that the designated position is moved within the display area. Are displayed on the display device,
The second display function is a program for detecting designation of a position that is equal to or longer than the predetermined time regardless of whether or not the first image is displayed following the movement of the designated position .

Images