JP6672561B2 - Touch panel type mobile terminal, display control method thereof, and computer program - Google Patents

Description

  The present invention relates to a touch panel mobile terminal, a display control method thereof, and a computer program, and in particular, operates a tablet personal computer (hereinafter, referred to as a tablet PC) having a larger screen than a smartphone in a stable state while holding it with both hands. The present invention relates to a touch panel mobile terminal, a display control method thereof, and a computer program capable of performing the same.

  When using a tablet PC with a larger screen than a smartphone as a computer for controlling the measuring instrument, "operation while holding with one hand", which increases the risk of operation errors and falls, is a barrier. A typical operation of the tablet PC is a touch panel operation called a tap corresponding to a mouse click operation.

  In the case of the tablet PC 1 having a large display (the touch panel 10 in the figure) as shown in FIG. 1, the most stable way of holding the tablet PC 1 with both hands 2 and 4 is to hold the image or moving image file embedded in the display screen. In the case of reproduction, it is necessary to tap the play button 16 of the image icon or the moving image with a finger as shown in FIG. 2, and it is difficult to operate the tablet PC 1 without releasing one hand (the right hand 2 in the example of FIG. 2). .

  With a tablet PC having a large display (touch panel), it is difficult to hold it with one hand for a long time, and even when performing a tap operation, the fixing of the touch panel is unstable, so that an operation error easily occurs. In addition, in a state where the tablet PC is held with one hand, there is always a high risk of dropping the tablet PC.

  Since the state of holding the tablet PC with both hands is the most stable, if these operations can be performed without releasing the hand from the tablet PC, not only stability is increased but also accidents such as dropping the tablet PC can be reduced.

  Although the present invention does not enable operation with both hands as in the present invention, the operability when touch input is performed with the other hand while holding the mobile terminal with a small screen size with one hand is not described. As an enhancement technique, Patent Document 1 discloses a technique of detecting a position where a (parent) finger is in contact with a touch panel when a portable terminal is held with one hand, and changing a position of a user interface to a position close to the contact position. It is described that it is displayed.

  In addition, similar to Patent Literature 1, Patent Literatures 2 and 3 disclose techniques for facilitating an operation performed by holding with one hand.

  On the other hand, Patent Literature 4 discloses a portable terminal that includes a three-dimensional distance sensor that outputs a three-dimensional position from a shift due to parallax between images obtained from left and right imaging elements in order to facilitate an input operation with both hands. The document describes that an operation target is moved to a position where the operation target is easily operated on a portable terminal using three-dimensional position information of a face or a hand obtained from the three-dimensional distance sensor.

JP 2013-125471 A JP-A-2002-73249 JP 2010-79442 A JP 2012-155480 A

  However, the technology described in Patent Document 1 makes it easier to operate when the user interface is displayed near the thumb when the other four fingers support the back of the mobile terminal and the thumb can be moved freely. And a mobile terminal having a small screen size is assumed. Similarly, Patent Literatures 2 and 3 do not allow operation with both hands unlike the present invention. Patent Literature 4 requires the provision of a three-dimensional distance sensor, and has a complicated configuration and cost. There was a problem of becoming high.

  SUMMARY OF THE INVENTION The present invention has been made to solve the above-described conventional problem, and has an object to enable a stable operation while holding a mobile terminal with both hands without complicating the configuration, eliminating the need for a tap operation. And

The present invention relates to a touch panel type mobile terminal adapted to perform display and input operations using a touch panel, a contact sensor for detecting that the mobile terminal is held by both hands, and fingers of both hands of the operator. A drag operation detecting unit that detects a first two-finger drag operation of dragging toward the center of the touch panel and a second two-finger drag operation of dragging toward an edge of the touch panel while both being pressed against the touch panel; A display control unit for controlling an image to be displayed on the touch panel in accordance with a first two-finger drag operation or a second two-finger drag operation , wherein the display control unit performs the first or second drag operation . When the two-finger drag operation is detected, an image in a non-display state embedded in the screen is displayed, and the first or second image is displayed again while the image is displayed. When the two-finger drag operation is detected, the image is enlarged. When the second or first two-finger drag operation is detected while the image is being enlarged, the enlarged image is displayed. When the second or first two-finger drag operation is detected in a state where the image is displayed, the image is set to a non-display state, and the first or second two-finger is used during video playback. When a drag operation is detected, the reproduction of the moving image is started. When the first or second two-finger drag operation is detected during the reproduction of the moving image, the moving image being reproduced is enlarged. When the second or first two-finger drag operation is detected, the moving image is reduced. When the second or first two-finger drag operation is detected during the reproduction of the moving image, the reproduction of the moving image is temporarily stopped. Stop and again drag the second or first finger When operation is detected, so as to stop playing the video, it is obtained by solving the above problems.

Here, the display and enlargement of the image can be performed stepwise.

  Further, non-display or reduction of the image can be performed at a stretch.

When a plurality of images are embedded, the image displayed in the display range can be enlarged or reduced by scrolling the left and right fingers while holding the portable terminal with both hands. .

  Further, the touch panel type mobile terminal can be connected to the measuring device so as to be freely communicable.

The present invention also provides a display control method for a touch panel type mobile terminal which performs display and input operations using a touch panel, wherein the mobile terminal detects that the mobile terminal is held by both hands, Detecting a first two-finger drag operation of dragging toward the center of the touch panel and a second two-finger drag operation of dragging toward the edge of the touch panel while pressing both of the fingers on the touch panel . Alternatively, when the second two-finger drag operation is detected, a non-display state image embedded in the screen is displayed, and the first or second two-finger drag operation is performed again while the image is displayed. When detected, the image is enlarged. When the second or first two-finger drag operation is detected while the image is enlarged, the enlarged image is reduced, and the image is enlarged. When the second or first two-finger drag operation is detected in a state where is displayed, the image is set to the non-display state, and the first or second two-finger drag operation is detected during video playback. At this time, the playback of the moving image is started. When the first or second finger drag operation is detected during the playback of the moving image, the moving image being played is enlarged. When the two-hand drag operation is detected, the moving image is reduced, and when the second or first two-finger drag operation is detected during the moving image reproduction, the reproduction of the moving image is paused, and the moving image is paused. When the second or first two-finger drag operation is detected again, the reproduction of the moving image is stopped, and the display control method of the touch panel mobile terminal further solves the above problem. is there.

The present invention also relates to a computer program for controlling display of a touch panel mobile terminal adapted to perform display and input operations using a touch panel, wherein the computer holds the mobile terminal with both hands. , A first two-finger drag operation of dragging toward the center of the touch panel while both fingers of the operator are pressed against the touch panel, and a second two-hand drag operation toward the edge of the touch panel A process of detecting a finger drag operation, a process of displaying an image in a non-display state embedded in the screen when the first or second finger drag operation is detected, and a state of displaying the image. When the first or second two-finger drag operation is detected again, the process of enlarging the image and the second or first process while the image is being enlarged are performed. When a finger drag operation is detected, the process of reducing the enlarged displayed image is performed. When the second or first double finger drag operation is detected while the image is displayed, the image is reduced. In addition to performing the process of setting the display to a non-display state, when the first or second two-finger drag operation is detected during the reproduction of the moving image, the process of starting the reproduction of the moving image is performed. When the two-hand drag operation is detected, the process of enlarging the moving image being reproduced is performed. When the second or first two-finger drag operation is detected during the expansion of the moving image, the process of reducing the moving image is performed. When the second or first two-finger drag operation is detected during the reproduction of the moving image, the process of temporarily stopping the reproduction of the moving image and the second or first two-finger drag operation again during the pause are performed. when it is detected, the processing to stop the reproduction of the moving image By a computer program, characterized in that for the execution, it is obtained by solving the above problems as well.

  ADVANTAGE OF THE INVENTION According to this invention, since it becomes possible to operate selection of an image, reproduction | regeneration of a moving image, etc. in a stable state, without releasing both hands from a portable terminal, the following effects can be expected.

(1) Improvement of Usability The touch panel user interface of the present invention can eliminate the need for tap operations for selecting images and playing back moving images, thereby improving browsing operability, reducing operation errors, and using a tablet. The operability and convenience of the PC can be improved.

(2) Improving Safety By reducing the number of operations that require releasing both hands holding the tablet PC, it is possible to reduce accidents such as dropping the tablet PC. This point is effective not only in industry but also in general users. For example, when operated by a child or an elderly person having a small holding force, a very unstable state is caused by holding with one hand, and the danger of falling is increased. In addition, when operating while lying down on a bed in a hospital room, since it is difficult for an adult to hold one hand, it is important in terms of safety to reduce the frequency of the one-hand holding operation of the tap operation.

Front view showing a state in which a tablet PC is held with both hands for explaining a conventional problem. Front view showing the same tap operation Front view of an embodiment of the present invention Block diagram showing the same hardware configuration Block diagram showing the same functional configuration FIG. 2 is a front view showing the operation state of the first embodiment. Flow chart showing the processing procedure Similarly, a front view showing an operation state of the second embodiment. Flow chart showing the processing procedure

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The present invention is not limited by the contents described in the following embodiments and examples. In addition, constituent elements in the embodiments and examples described below include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those that are in a so-called equivalent range. Furthermore, the constituent elements disclosed in the embodiments and examples described below may be appropriately combined, or may be appropriately selected and used.

  In the embodiment of the present invention, the present invention is applied to a tablet PC 1 having a substantially rectangular outer shape as illustrated in FIG. As shown in FIG. 3, the so-called frame portion surrounding the touch panel 10 is narrow, and most of the front surface is occupied by the touch panel 10.

  The tablet PC 1 is provided with a contact sensor 20 (not shown in FIG. 3; see FIGS. 4 and 5) for detecting contact of an object with its peripheral portion. The contact sensor 20 can detect the contact position and the number of the contact positions with such a resolution that it is possible to determine whether the contact position is held by both hands or one hand.

  Although not shown, various interfaces and mechanical elements such as a power switch, a volume operation unit, a lens window of a camera, a ventilation unit for audio output by a speaker, a connector, and a jack are provided on the outer surface of the tablet PC 1. Is arranged.

  The tablet PC 1 is connected to a measuring device 100 such as an image measuring device by wireless or wired, and is used for inputting an instruction regarding measurement, displaying a measurement result, and the like.

  As shown in FIG. 4, the tablet PC 1 has a communication circuit 22, a storage 24, a control circuit 30, and other components (not shown) in addition to the touch panel 10 and the contact sensor 20 described above. The communication circuit 22 is used for wireless communication and wired communication between the tablet PC 1 and an external device. The storage 24 is a hard disk drive (HDD) or a solid state drive (SSD), and is used for storing and temporarily storing various data. The control circuit 30 includes a CPU (Central Processing Unit) 32 as a computer for executing a control program and various applications, a RAM (Random Access Memory) 34 as a work area for executing the program, and a non-volatile memory for storing control setting values. It has a memory 36.

  FIG. 5 shows a functional configuration related to display control in such a tablet PC 1. As shown in FIG. 5, the tablet PC 1 has a drag operation detection unit 40 and a display control unit 42. These components are realized by the CPU 32 of the control circuit 30 executing the control program.

  The drag operation detection unit 40 includes a first two-finger drag operation of dragging toward the center of the touch panel 10 while pressing both fingers of the operator against the touch panel 10, and a second drag operation of dragging toward the edge of the touch panel 10. Detect a two-hand drag operation.

  The display control unit 42 controls display according to the drag operation detected by the drag operation detection unit 40.

  Hereinafter, display control in the tablet PC 1 will be described with a specific example of display.

  In the first embodiment of the present invention, the present invention is applied to an operation at the time of displaying an image. In the case of an image, usually, the image is embedded in the screen, and only the icon is displayed and the image itself is not displayed. By tapping the screen, a preview is often displayed on the entire screen.

Therefore, as illustrated in FIG. 6A, the image embedded in the screen can be enlarged without a tap operation by the first two-hand finger drag operation according to the present invention. The expansion may be a stepwise expansion or a continuous expansion. Also, the image is reduced by the second two-hand drag operation shown in FIG. 6B. The reduction may be stepwise or continuous as in the case of the enlargement, but may be returned to the original size by one reduction operation. When a plurality of images are embedded, the image displayed in the display range may be enlarged and displayed by a scroll operation. The assignment to the first two-hand drag operation and the second two-finger drag operation may be reversed.

  Hereinafter, an example of a specific processing procedure of the first embodiment will be described with reference to FIG.

  First, in step 100, it is determined whether the first two-finger drag operation has been performed. If the determination result is positive, the process proceeds to step 110, where an image is displayed as illustrated in FIG.

  Next, the routine proceeds to step 120, where it is determined whether or not the first two-finger drag operation has been performed again. If the determination result is positive, the process proceeds to step 130, where the image is enlarged and displayed.

  Next, the routine proceeds to step 140, where it is determined whether or not the second two-finger drag operation has been performed. If the determination result is positive, the process proceeds to step 150, where the image is reduced and displayed.

  After the end of step 150, or when the result of the determination in step 140 is negative, the process returns to step 120.

  On the other hand, if the decision result in the step 120 is negative, the process proceeds to a step 160 and it is determined whether or not the second two-finger drag operation has been performed. If the determination result is positive, the process proceeds to step 170, and the image is embedded as illustrated in FIG. 6B.

  After the end of step 170, or when the result of the determination in step 160 is negative, the process returns to step 100.

  Next, a description will be given of a second embodiment of the present invention applied to an operation at the time of reproducing a moving image. In the case of a video, you must tap to play it. Also, in order to display a full screen, the user must also tap the full screen button. These two operations are realized by a two-hand drag operation according to the present invention, as illustrated in FIG.

  First, as shown in FIG. 8A, the reproduction of a moving image is started by the first drag operation of the first two fingers, and the broken line is drawn by the first drag operation of the two fingers in FIG. 8A. As shown in FIG. Alternatively, reproduction of a moving image and full-screen display may be simultaneously performed by the first first two-hand finger drag operation. Alternatively, the reproduction of the moving image may be started simultaneously with the start of the first two-finger drag operation, and the moving image window may be displayed in an enlarged manner. good.

  The stopping of the moving image is performed by the operation of FIG. 8B. First, the moving image may be returned from the full screen to the original display size, or may be stopped when the operation of FIG. 8B is continued. Also, returning to the original size and stopping the moving image may be performed simultaneously. During the reproduction of the moving image, the pause and the reproduction may be switched by performing the second two-finger drag operation in FIG. 8B and the first two-finger drag operation in FIG. 8A. The assignment to the first two-hand drag operation and the second two-finger drag operation may be reversed.

  FIG. 9 shows an example of a specific processing procedure of the second embodiment.

  First, in step 200, it is determined whether the first two-finger drag operation has been performed. If the determination result is positive, the process proceeds to step 210, and the moving image reproduction is started as illustrated in FIG. 8A.

  Next, the routine proceeds to step 220, where it is determined whether or not the first two-hand drag operation has been performed again during the reproduction of the moving image. If the determination is positive, the process proceeds to step 230, where a full screen display is performed.

  Then, the process proceeds to a step 240, wherein it is determined whether or not the second two-finger drag operation is performed during the full screen display. If the determination result is positive, the process proceeds to step 250, and the moving image window is resized and returned to the original size.

  After step 250 is completed, or when the result of the determination at step 240 is negative, the process returns to step 220.

  On the other hand, when it is determined in step 220 that the first two-finger drag operation has not been performed, the process proceeds to step 260, and it is determined whether the second two-finger drag operation has been performed. If the result of the determination is positive, the process proceeds to step 270, where the reproduction of the moving image is temporarily stopped.

  Next, the routine proceeds to step 280, where it is determined whether or not the second two-finger drag operation has been performed continuously. If the result of the determination is positive, the process proceeds to step 290, where the reproduction of the moving image is stopped.

  After the end of step 290, or when the determination results in steps 260 and 280 are negative, the process returns to step 200.

  According to the embodiment, the following effects can be obtained.

(I) Browsing while standing When the tablet PC is placed on the desk or while the tablet PC is placed on the lap while sitting, one hand can be used freely, so there is stability and operation without worrying about falling Often can. However, when using it on a mobile device, you need to consider standing still. For example, in Internet browsing, image display, video playback, and enlargement display operations are performed after scrolling and tapping hyperlinks, but at present, those operations are always performed by touch operation or multi-operation with one finger. A touch operation needs to be performed, during which time the tablet PC must be held with one hand. In the case of a tablet PC having a large display, if it is difficult to operate the tablet PC with one hand due to its weight, it may be necessary to operate the tablet PC only by placing it on one open hand. This state was very unstable, and an operation error was likely to occur, and the risk of dropping the tablet PC during the operation was high. According to the present invention, most browsing operations can be performed while holding the tablet PC with both hands, and safety and stability can be increased, and usability can be significantly improved.

(Ii) Browsing while lying down When browsing while lying on the back, it is necessary to hold the tablet PC with both hands, and it is almost impossible to release one hand. Even if the tablet PC is placed on the chest, the longer the operation of releasing one hand, the longer the operation cannot be performed. When lying down sideways with the dominant arm down, tapping becomes difficult, and when lying down sideways with the dominant arm up, the holding time with one hand cannot be extended. In order to operate the tablet PC while sleeping like an inpatient, it is important to increase the number of operations while holding the tablet PC with both hands, and the present invention can significantly improve the usability of the tablet PC. is there.

(Iii) Browsing in a swaying car When operating a tablet PC in a swaying car such as a train or car, it is very difficult to operate the tablet PC with one hand away. According to the present invention, the number of operations with both hands can be increased, and stable browsing can be performed even in a swinging vehicle.

(Iv) Browsing While Walking For example, when a user walks toward a destination while holding a tablet PC with both hands and looking at a map or the like, there is almost no situation where one hand can be released. However, there are cases where it is necessary to check the surrounding situation by scaling. At present, it is necessary to sit down somewhere to secure stability and then release one hand, reducing convenience. According to the present invention, since enlargement / reduction operation can be performed while holding the tablet PC with both hands, the operation can be easily performed while walking.

(V) Browsing Photos and Movies Taken by Rear Cameras Many tablet PCs have a high-resolution camera on the back, and many users use them instead of digital cameras and video cameras. However, in order to check the result on the spot where the image was taken, a tap operation is required to select an image to be previewed and to play back a moving image, so that the operation cannot be easily performed. All you have to do is sit somewhere or kneel down and place your tablet PC on your lap and tap. According to the present invention, since the enlargement of an image and the reproduction of a moving image can be performed while holding the tablet PC with both hands, the image can be immediately confirmed on a digital camera, a video camera, and a large-screen display that cannot be compared with the liquid crystal screen of a smartphone. And the use scene can be greatly expanded.

  In the above-described embodiment, the case where the present invention is connected to the measuring device is illustrated. However, the touch panel mobile terminal according to the present invention is not limited to such an example, and is generally used for mobile terminals including a touch panel PC. The same applies.

  As a result, the following effects can be expected.

(I) Expansion of Users It is possible to provide a tablet PC, which was often shunned by children and elderly people with low grip strength, as a usable terminal for a wide range of users.

(II) Expansion of Tablet PC Usage Scenes In the following usage scenes in which the advantage of a large screen cannot be utilized due to the difficulty of holding one hand, it is expected that usage will be expanded in a wide range of age groups.
・ Pupils hold tablet PCs in elementary schools etc. ・ Orientation and sports coaching with tablet PCs when taking a walk in Noyama at the Geriatric Society ・ Encyclopedia of tablet PCs in aquariums and zoos etc. Reference and observation records ・ Investigating the authors and works of exhibits using tablet PCs in museums, etc. ・ Confirming map information (using GPS, etc.) and sightseeing spots using tablet PCs, etc.

1. Tablet PC
2, 4 ... hand 10 ... touch panel 20 ... contact sensor 22 ... communication circuit 24 ... storage 30 ... control circuit 32 ... CPU
34 ... RAM
36 nonvolatile memory 40 drag operation detection unit 42 display control unit 100 measuring device

Claims (7)

In a touch panel mobile terminal adapted to perform display and input operations using a touch panel,
A contact sensor for detecting that the mobile terminal is held by both hands,
A first two-finger drag operation of dragging toward the center of the touch panel and a second two-finger drag operation of dragging toward the edge of the touch panel are detected while both fingers of the operator are pressed against the touch panel. A drag operation detection unit,
A display control unit for controlling an image to be displayed on the touch panel according to the first two-hand drag operation or the second two-finger drag operation;
Equipped with a,
The display control unit displays an image in a non-display state embedded in a screen when the first or second two-finger drag operation is detected,
When the first or second finger drag operation is detected again while the image is displayed, the image is enlarged,
When the second or first two-finger drag operation is detected while the image is being enlarged, the enlarged and displayed image is reduced,
When the second or first two-finger drag operation is detected while the image is displayed, the image is set to a non-display state,
When the first or second two-finger drag operation is detected during video playback, video playback is started,
When the first or second finger drag operation is detected during video playback, the video being played is enlarged,
When the second or first two-finger drag operation is detected during the enlargement of the moving image, the moving image is reduced,
When the second or first two-finger drag operation is detected during video playback, video playback is paused,
When the second or first finger drag operation is detected again during the pause, the reproduction of the moving image is stopped . The touch panel mobile terminal according to claim 1 , wherein the display and the enlargement of the image are performed in a stepwise manner. 2. The touch panel mobile terminal according to claim 1 , wherein the non-display or reduction of the image is performed at a stretch. When a plurality of images are embedded, the image displayed in the display range is enlarged or reduced by scrolling the left and right fingers when holding the mobile terminal with both hands, the touch panel type portable terminal according to any one of claims 1 to 3. The touch panel type portable terminal according to any one of claims 1 to 4, characterized in the measuring device and being communicably connected. In a display control method of a touch panel type mobile terminal configured to perform display and input operation using a touch panel,
Detecting that the mobile terminal is held by both hands,
A first two-finger drag operation of dragging toward the center of the touch panel and a second two-finger drag operation of dragging toward the edge of the touch panel are detected while both fingers of the operator are pressed against the touch panel. ,
When the first or second two-finger drag operation is detected, a non-display state image embedded in the screen is displayed,
When the first or second finger drag operation is detected again while the image is displayed, the image is enlarged,
When the second or first two-finger drag operation is detected while the image is being enlarged, the enlarged and displayed image is reduced,
When the second or first two-finger drag operation is detected while the image is displayed, the image is set to a non-display state,
When the first or second two-finger drag operation is detected during video playback, video playback is started,
When the first or second finger drag operation is detected during video playback, the video being played is enlarged,
When the second or first two-finger drag operation is detected during the enlargement of the moving image, the moving image is reduced,
When the second or first two-finger drag operation is detected during video playback, video playback is paused,
A display control method for a touch-panel type mobile terminal, characterized by stopping the reproduction of a moving image when the second or first two-finger drag operation is detected again during a pause . In a computer program for controlling the display of a touch panel type mobile terminal adapted to perform display and input operations using a touch panel,
A process of detecting that the mobile terminal is held by both hands;
A first two-finger drag operation of dragging toward the center of the touch panel and a second two-finger drag operation of dragging toward the edge of the touch panel are detected while both fingers of the operator are pressed against the touch panel. Processing,
A process of displaying an image in a non-display state embedded in a screen when the first or second two-finger drag operation is detected;
When the first or second two-finger drag operation is detected again while the image is displayed, a process of enlarging the image;
When the second or first two-finger drag operation is detected in a state where the image is enlarged, a process of reducing the image that is enlarged and displayed;
When the second or first two-finger drag operation is detected in a state where the image is displayed, a process of hiding the image is performed, and
When the first or second two-finger drag operation is detected during video playback, processing to start video playback;
When the first or second finger drag operation is detected during the reproduction of the moving image, a process of enlarging the moving image being reproduced;
When the second or first two-finger drag operation is detected during the enlargement of the moving image, a process of reducing the moving image;
When the second or first two-finger drag operation is detected during the reproduction of the moving image, a process of temporarily stopping the reproduction of the moving image;
A computer program for executing a process of stopping reproduction of a moving image when the second or first two-hand drag operation is detected again during a pause .