WO2018083765A1 - Input operation method, input operation device, display controller, and information content receiving system - Google Patents

Abstract

An input operation method using an instruction medium 13 for inputting a user's instruction and a touch panel 11 for detecting static capacitance that corresponds to the degree of contact with a touch surface, said method acquiring instructed position information that includes two-dimensional information in a touch plane pertaining to an instructed point 14 at which the touch panel 11 has detected the instruction medium and information that indicates the degree of contact of the instruction medium 13 with the touch plane, determining the size of a display pointer 33 on the basis of the information that indicates the degree of contact, referring to operation display information in which the two-dimensional coordinate system of a display screen and a two-dimensional coordinate system in the touch plane are correlated, and displaying two-dimensional position information pertaining to the instructed point 14, with the center of the display pointer of the determined size adjusted to a point on the display screen that is converted into the two-dimensional coordinate system.

Description

Input operation method, input operation device, display control device, and information content receiving system

The present invention relates to an input operation method, an input operation device, a display control device, and an information content receiving system, and more particularly to an input operation technique using a touch panel.

As a background art of this technical field, Patent Document 1 discloses that “a processing unit displays image data on a display device, and a cursor is positioned at one of a plurality of objects arranged in a display area of the image data. The control unit detects the movement of the designated position on the touch panel from the start to the end of the drag operation on the touch panel, and determines the movement direction of the cursor based on the detected movement of the designated position. The processing unit selects one of a plurality of objects based on the movement direction of the cursor output from the control unit, and displays the position of the selected object with the cursor (summary extract). There is a description of the input operation device.

International Publication No. 2015/108155

In Patent Document 1, after the touch-down operation “down” is registered as the starting point of the touch position, and in the drag operation “move”, the direction and distance in which the user's instruction medium moves the touch panel is calculated according to a predetermined procedure. The cursor moves between objects on the display screen. The determination of object movement is performed for each adjacent object, and multiple determinations are required to move to an arbitrary object.

Such an operation requires a plurality of drag operations, calculation processes, and determinations until the cursor is moved to a remote object desired by the user, and there is a problem with user instruction responsiveness.

The present invention has been made in view of the above points, and an object thereof is to provide an input operation technique that realizes a simple and intuitive object selection method.

In order to solve the above-described problems, the present invention has the configuration described in the claims. As an example thereof, the present invention provides a display pointer that indicates a range that is an input operation target on a display screen using a touch panel that detects capacitance according to the degree of contact between an instruction medium for inputting a user instruction and a touch surface. Is an input operation method for displaying a position of the pointing medium with respect to the touch surface, the coordinates of the pointing point being the position where the pointing medium is detected on the touch surface. 2D position information represented by a 2D coordinate system in the touch surface, and indication position information including information indicating a degree of contact between the indication medium and the touch surface when the indication medium is detected are acquired. Determining a size of a display pointer indicating a range to be an input operation target in the display screen based on the information indicating the degree of contact; and A point obtained by converting the two-dimensional position information of the indicated point into the two-dimensional coordinate system of the display screen by referring to the operation display system information that associates the two-dimensional coordinate system of the screen with the two-dimensional coordinate system in the touch surface. And displaying the center of the display pointer of the determined size in alignment with each other.

According to the present invention, it is possible to provide an input operation technique that realizes a simple and intuitive object selection method. The purpose, configuration, and effects other than those described above will be clarified below.

The block diagram which shows schematic structure of the information content receiving system which concerns on 1st embodiment. Schematic configuration diagram of the input operation device 1 Hardware structure of information content Side view of the touch sensor during user selection Top view of the touch sensor during user selection The figure which shows the operation screen at the time of user selection operation It is a flowchart which shows the flow of the process which concerns on 1st embodiment, Comprising: The flowchart of the example which performs automatically whether the operation screen is superimposed on a main screen, or not The flowchart which shows the flow of a process of an information content receiver and a display apparatus The figure which shows the operation screen when the distance of a touch panel and a user instruction | indication medium is comparatively large The figure which shows the operation screen when the distance of a touch panel and a user instruction | indication medium is comparatively small The figure which shows the menu operation screen of the state where the ground wave is selected Diagram showing the terrestrial broadcast operation screen The figure which shows the menu operation screen of the state in which SNS was selected The figure which shows the screen of the state in which the SNS login screen was displayed on the main screen The figure which shows the input operation apparatus which concerns on 2nd embodiment. The flowchart which concerns on the input operation process part which concerns on 2nd embodiment. The figure which shows the input operation apparatus which concerns on 3rd embodiment. The figure which shows the information content receiving system which connected the tablet terminal and the projector

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<First embodiment>
FIG. 1 is a block diagram showing a schematic configuration of an information content receiving system according to the first embodiment. FIG. 2A is a schematic configuration diagram of the input operation device 1. FIG. 2B is a hardware configuration diagram of the information content receiving device 2. The information content receiving system according to the present embodiment includes an input operation device 1, an information content receiving device 2, and a display device 3, which are connected by wired communication or wireless communication. In this embodiment, it is assumed that a wireless communication connection is established. Although the input operation device 1 has a function as a remote controller for the information content receiving device 2, the input operation device 1 of the present embodiment includes a touch panel 11 in addition to the input keys 12 to enable various operations. .

As shown in FIG. 2A, the input operation device 1 is configured by accommodating in the main body 10 an input operation control unit 110 and a communication unit 120 that transmits and receives information to and from an external device.

The input operation control unit 110 is configured by connecting a CPU 101, a ROM 102, a RAM 103, and an I / F 105 to a bus 106. A touch panel 11, input keys 12, and a communication unit 120 are connected to the I / F 105. The communication unit 120 may include a Bluetooth interface for transmitting / receiving a signal to / from an external device (in this embodiment, the information content receiving device 2) using, for example, Bluetooth (registered trademark).

The CPU 101 is a control unit for controlling the input operation device 1 and executes predetermined processing according to a program stored in advance in the ROM 102, for example. One of the predetermined processes is, for example, a process of discriminating or analyzing a user operation on the touch panel 11 and / or the input key 12 and generating information corresponding to the operation. The information generated by the CPU 101 is output to the communication unit 120 via the I / F 105, and is transmitted from the communication unit 120 to the information content receiving device 2 wirelessly using Bluetooth or the like. Information on operations on the touch panel 11 and / or the input keys 12 and / or information generated by the CPU 101 may be output to the RAM 103 via the I / F 105 and temporarily stored in the RAM 103.

A touch panel 11 (corresponding to a touch sensor) and one or more input keys 12 are provided on the upper surface of the main body 10 (see FIG. 1).

The touch panel 11 is indicated by an instruction point 14 (indicated by X in the drawing) indicated by a user instruction medium (for example, a finger, a stylus pen, etc.) 13 used for transmitting a user's operation intention. 2, and is not actually provided in the input operation device 1), and the input operation device 1 uses the acquired two-dimensional position information as the information content reception device 2. Send to. This two-dimensional position information is expressed by a two-dimensional coordinate system in the touch surface of the touch panel 11. The instruction point 14 indicates a position where the touch panel 11 detects the user instruction medium 13 while the user instruction medium 13 is not in contact with the touch panel 11 and a state where the user instruction medium 13 is in contact with the touch panel 11. May indicate a position where the user instruction medium 13 is detected.

The touch panel 11 is configured using a touch sensor that detects capacitance according to the degree of contact or proximity between the user instruction medium 13 and the touch surface, and the user instruction medium and the touch surface when the user instruction medium 13 is detected. Outputs information indicating the degree of contact or approach. This degree of contact or approach includes both the size of the separation distance between the touch panel 11 and the user instruction medium 13 in a non-contact state, and the contact state. The input operation method according to the present embodiment is executed by detecting an action in which the user instruction medium 13 is brought close to the touch panel 11 and brought into contact with the touch panel 11.

The two-dimensional coordinate system in the touch surface of the indication point 14 and information indicating the degree of contact or approach are collectively referred to as indication position information. The input operation control unit 110 outputs the designated position information output from the touch panel 11 to the communication unit 120, and the communication unit 120 transmits the designated position information to the information content receiving device 2.

The information content receiver 2 is connected to the information storage device 4, the broadcast receiving medium 5 that receives broadcast waves, the communication network 6, and the display device 3 in addition to the input operation device 1. Then, the information content receiving device 2 receives at least one information content from the information storage device 4, the broadcast receiving medium 5, and the communication network 6 in accordance with the instruction of the input operation device 1, performs the processing described later, Is displayed on the display device 3.

The information content receiving apparatus 2 includes a storage information input / output unit 24, a broadcast receiving unit 25, a network transmission / reception unit 26, which constitute a functional unit that receives information content. And a display control device that performs the above.

The display control device includes, for example, an input operation processing unit 21, an operation screen generation unit 22, a central control unit 23, and a display output unit 27.

The input operation processing unit 21 receives the instruction position information of the instruction point 14 transmitted from the input operation device 1 by radio using, for example, Bluetooth, and demodulates the modulation performed for the radio transmission. If the indicated position information is encoded, a decoding process is performed. The input operation processing unit 21 outputs the demodulated / decoded instruction position information to the display pointer processing unit 23a of the central control unit 23, and outputs a control signal in response to or based on reception of the instruction position information. 22 to output.

The stored information input / output unit 24 reads the information content stored in the information storage device 4 and sends the information content to the central control unit 23.

As an example, the information content is a moving image, a photograph, or a sound. Since the information content has a large amount of information in the original state and is not suitable for storage, it is generally subjected to code compression processing specified by MPEG (Motion Picture Experts Group) for moving images and JPEG (Joint Photographic Experts Group) for photographs. ing.

The central control unit 23 performs a decoding / decompression process on the code-compressed information content, restores the original information form, and outputs it to the display output unit 27.

The broadcast receiving unit 25 receives terrestrial and satellite broadcast signals from the broadcast receiving medium 5, demodulates them, and obtains information content code-compressed by MPEG or the like. The central control unit 23 restores the information content to the form of the original information and outputs it to the display output unit 27.

The network transmission / reception unit 26 receives information content that is code-compressed from the communication network 6 according to a well-known communication protocol such as HTTP (Hypertext Transfer Protocol) or RTP (Real-time Transport Protocol). The central control unit 23 restores the information content to the form of the original information and outputs it to the display output unit 27.

The central control unit 23 can also store the information content obtained by the broadcast receiving unit 25 and the network transmission / reception unit 26 as they are or re-encode them in the information storage device 4 via the stored information input / output unit 24.

Furthermore, the central control unit 23 can handle information contents other than moving images, photographs, and sounds. For example, the central control unit 23 processes web information such as HTML (Hyper Text Markup Language) via the network transmission / reception unit 26 and the communication network 6. The central control unit 23 also outputs the processed web information to the display output unit 27.

The central control unit 23 includes a display pointer processing unit 23a. The display pointer processing unit 23 a determines the display position of the display pointer in the display screen of the display device 3 based on the indicated position information output from the input operation processing unit 21. Further, the display pointer processing unit 23a determines the size of the display pointer based on information indicating the degree of contact or approach included in the designated position information. Here, the display pointer 33 indicates a range in the display screen selected by the user through the input operation. Further, the display pointer processing unit 23a refers to the operation display system information in which the two-dimensional coordinate system of the display screen of the display device 3 is associated with the two-dimensional coordinate system in the surface of the touch panel 11, and the two-dimensional position of the indication point 14 Display pointer information for displaying the information 36 converted into the two-dimensional coordinate system of the display screen and the center 36 of the display pointer 33 having the determined size is output to the operation screen generation unit 22. An area covered by the display pointer 33 in the screen is a range to be input by the user.

The operation screen generation unit 22 generates a base screen on which a plurality of objects 34 are arranged using the control signal output from the input operation processing unit 21 as a trigger. Further, the operation screen generation unit 22 generates an operation screen 32 by combining the base screen with the display pointer 33 generated based on the display pointer information output from the central control unit 23.

The display output unit 27 synthesizes the operation screen 32 from the operation screen generation unit 22 and the main screen 31 from the central control unit 23 and outputs them to the display device 3 via, for example, an HDMI interface. In the present embodiment, the entire screen area of the display device 3 is referred to as a main screen 31, and the operation screen 32 is described using an example of a screen area smaller than the main screen 31. The operation screen 32 may be configured using the entire screen area of the display device 3. In the present embodiment, a display pointer 33 is displayed in the operation screen 32. Therefore, the operation screen generation unit 22 outputs information indicating the size of the generated operation screen 32 to the display pointer processing unit 23a, and the display pointer processing unit 23a determines the display position of the display pointer 33 in the operation screen 32. To do.

The display device 3 displays information content on the main screen 31 and input operation information on the operation screen 32.

On the operation screen 32, one or more objects 34 corresponding to the determined execution processes are arranged, and a display pointer center 36 (indicated by X in the figure, which coincides with the instruction point 14 of the input operation device 1). The display pointer 33 of a finite area including the display pointer 33 is displayed for convenience of explanation and is not actually displayed on the operation screen 32, and the inside of the object in the area of the display pointer 33 is displayed. As a result, one or more highlighted objects 35 are displayed differently from the other objects. The display output unit 27 compares the position of the object on the operation screen 32 with the position of the display pointer 33 superimposed thereon, identifies the object on which the display pointer 33 overlaps, and highlights the object. Highlight display is an aspect in which an object on which a display pointer is superimposed is displayed in a different display mode from an object on which a display pointer is not superimposed. For example, it is a blinking display that blinks an object on which a display pointer is superimposed. May be.

The highlighted object 35 is an object that is a candidate for user selection, and the input operation is completed when the user selects the highlighted object 35.

This selection operation is performed when the degree of approach between the touch panel 11 and the user instruction medium 13 gradually increases, the size of the display pointer decreases accordingly, and the number of objects on which the display pointer is superimposed becomes one. The output unit 27 may output a selection operation signal indicating that one object has been selected to the central control unit 23, and the central control unit 23 may determine the object as the object selected by the user. .

FIG. 2B is a diagram illustrating a hardware configuration example of the information content receiving apparatus. The information content receiving device 2 includes a control bus 201 and an I / O bus 210. The control bus 201 is connected to a graphic board 202, a video / audio board 203, a CPU 204, a RAM 205, and a ROM 206. A CPU 204, USB I / F 211, tuner 212, LAN I / F 213, communication unit 215, and power supply unit 214 are connected to the I / O bus 210. An HDMI signal is input to the graphic board 202.

The power supply unit 214 supplies power to each unit such as the graphic board 202, the video / audio board 203, the CPU 204, the RAM 205, the ROM 206, the USB I / F 211, the tuner 212, the LAN I / F 213, and the communication unit 215. The USB I / F 211 corresponds to the stored information input / output unit 24 in FIG. 1, and reads information content from the information storage device 4 such as an external HDD having a USB terminal, for example, and transmits it to the CPU 204. The tuner 212 corresponds to the broadcast receiving unit 25, and receives information content transmitted by digital broadcast through the broadcast receiving medium 5 such as an antenna, for example, demodulates and decodes as necessary, and transmits it to the CPU 204. The LAN I / F 213 corresponds to the network transmission / reception unit 26 of FIG. 1 and accesses a desired Web site via the communication network 6 to acquire information content.

The CPU 204 corresponds to the central control unit 23 in FIG. 1, and the encoded video / audio data included in the information content received or acquired by the USB I / F 211, the tuner 212, and the LAN I / F 213 is converted into the video / audio board 203. And decoding using the RAM 205. The decryption program is stored in the ROM 206, for example, and the CPU 204 reads the program stored in the ROM 206 and executes the decryption process. Further, the CPU 204 performs frame rate conversion processing, scaling processing, brightness correction processing, contrast enhancement processing, and the like using the audio / video board 203 and / or the RAM 205 as necessary.

The communication unit 215 corresponds to the input operation processing unit 21 in FIG. 1 and includes, for example, a Bluetooth I / F for communicating with the input operation device 1 in FIG. 1 by Bluetooth. The communication unit 215 receives the designated position information transmitted from the input operation device 1 by radio, performs demodulation / decoding conforming to the Bluetooth standard or specification, and outputs the demodulated information to the CPU 204. Further, the CPU 204 generates a control signal based on the indicated position information and transmits it to the graphic board 202.

The CPU 204 further includes the display pointer processing unit 23a shown in FIG. 1, and executes the process for determining the display position and size of the display pointer 33 described above using the indicated position information from the communication unit 215. The graphic board 202 corresponds to the operation screen generation unit 22 in FIG. 1 and has a part of the function of the display output unit 27. The graphic board 202 generates an operation screen 32 including the object 34 and the display pointer 33 using the control signal from the CPU 204, the indicated position information, and the information on the display pointer 33 from the CPU 204. The graphic board 202 receives information content received or acquired by the USB I / F 211, the tuner 212 or the LAN I / F 213 and decrypted by the CPU 204. The information content is used as a main screen 31, and the main screen 31 is operated. A process for synthesizing the screen 32 is performed and output to the HDMII / F216. The processing of the CPU 204 and the processing of the graphic board 202 are executed using a program stored in the ROM 206.

The HDM II / F 216 has a part of the function of the display output unit 27 of FIG. 1, and a format that conforms to the HDMI standard or specification of an image obtained by combining the operation screen 32 output from the graphic board 202 and the content. Or it converts into a signal form and outputs to the display apparatus 3. FIG. The HDMII / F 216 includes a CEC line, and commands or messages may be exchanged with the display device 3 via the CEC line.

3A to 3C are diagrams showing a relationship between the touch panel 11 of the input operation device 1 and the operation screen 32 of the display device 3 according to the first embodiment of the user selection operation. 3A shows a side view of the touch sensor unit. FIG. 3B shows a top view of the touch sensor unit. FIG. 3C shows an operation screen.

FIG. 3A shows a vertical distance d between the touch panel 11 provided in the input operation device 1 and the user instruction medium 13. This distance d is a parameter indicating the degree of contact or approach between the touch panel 11 and the user instruction medium 13. The touch panel 11 uses a touch sensor having a configuration for detecting a change in capacitance according to the distance d from the user instruction medium 13. Thus, even in a hover state, that is, in a state where the user instruction medium 13 is not in contact with the touch panel 11 and the touch panel 11 detects the movement of the user instruction medium 13, the touch panel 11 responds as the distance d decreases. The value of the capacitance increases, and the user instruction medium 13 is approaching the touch surface. The display pointer processing unit 23a decreases the size of the display pointer 33 as the distance d decreases.

The detection of the degree of contact or approach between the touch panel 11 and the user instruction medium 13 is performed by measuring the level of pressure applied to the touch panel 11 by the user instruction medium 13 in addition to the method of detecting by the change in capacitance as described above. There is also a method to detect. Either of them may be used, or both may be used in combination. When the method of detecting by pressure is used alone, the degree of contact or approach can be detected by converting the pressure level into distance d. Further, in the case of using both the method of detecting by electrostatic capacity and the method of detecting by pressure, the change in electrostatic capacity is set to a positive value of the distance d, and the change of pressure is set to a negative value of the distance d. It is also possible to represent both values with variables.

As shown in FIG. 3B, when the touch panel 11 is viewed from the top, the touch panel 11 has its rectangular area represented by four coordinate points (0, 0), (0, 1), (1, 0), and (1, 1). I can express.

The indicated position information which is the position information of the user indicating medium 13 with respect to the touch panel 11 is the coordinates (a, b) of the xy coordinates on the two-dimensional plane including the touch surface (where 0 ≦ a ≦ 1, 0 ≦ b ≦ 1). And the distance d from the touch surface.

FIG. 3C is a diagram showing the operation screen 32, and is a diagram showing how the indicated position information is used. The area of the operation screen 32 is also represented by four coordinate points (0, 0), (0, s), (t, 0), and (t, s), similar to the touch surface of the touch panel 11.

The display pointer processing unit 23a has operation display system information that associates the xy coordinates of the two-dimensional plane including the touch surface with the xa-ya coordinates that specify the position on the screen displayed on the display device 3. The point on the screen of the display device 3 corresponding to the coordinates (a, b) of the indication point 14 acquired from the input operation device 1 is calculated. In FIG. 3C, the point corresponding to the indication point 14 is the center 36 of the display pointer. The center 36 of the display pointer can be represented by the coordinates (A, B) of the area of the operation screen 32. Here, A and B are obtained by the following equation (1).

In the above equation (1), the operation display system information corresponds to each value of t and s and equation (1). By using the above formula (1), an arbitrary point on the operation screen 32 can be indicated on the touch panel 11 regardless of hardware restrictions such as the shape of the touch panel 11.

FIG. 4 is a flowchart showing the flow of processing according to the present embodiment, and an input operation control unit of the input operation device 1 for automatically determining whether or not the operation screen 32 is superimposed on the main screen 31. The flow of processing in 110 is shown.

As shown in this flowchart, first, when the touch panel 11 detects the movement of the user instruction medium 13 (S101 / YES), the input operation control unit 110 generates a detection signal indicating that the user instruction medium 13 is detected, and the communication unit The information is output to the information content receiving apparatus 2 via 120 (S102).

When the input operation processing unit 21 of the information content receiving apparatus 2 receives the detection signal, the input operation processing unit 21 outputs the detection signal or a control signal based on the detection signal to the operation screen generation unit 22 and the central control unit 23. The operation screen generator 22 outputs a display ON signal for turning on the display of the operation screen 32 to the display output unit 27 using a detection signal or a control signal based on the detection signal as a trigger.

Next, a setting for detecting the user operation time interval, for example, a timer built in the input operation device 1 is initialized, and measurement of the elapsed time T since the user operated most recently is started (S103).

When the touch panel 11 detects that the next user operation has been performed (S104 / YES), the input operation control unit 110 transmits operation information indicating the content of the detected user operation to the information content receiving device 2 ( S105), the input operation processing unit 21 of the information content receiving device 2 receives the information. Thereafter, processing according to the operation information is executed by the information content receiving device 2. If this operation information is the indicated position information, display pointer display processing is executed.

Thereafter, the process returns to the user operation interval detection setting (S103) again. This process is repeated while a user operation is performed.

In the state where the user operation is not detected (S104 / NO), the magnitude of the elapsed time T and the threshold value (Td) since the most recent user operation is determined (S106). In S106, when the elapsed time T is equal to or less than the threshold value (Td) (T = <Td), the user operation is further waited.

In S106, when the elapsed time T is larger than the threshold value (Td) (T> Td), the input operation device 1 sends a display OFF signal to the information content receiving device 2 to turn off the display of the operation screen 32 (S107). ). Then, the input operation processing unit 21 of the information content receiving device 2 sends a display OFF signal to the display output unit 27 via the operation screen generation unit 22.

As a result, when no user operation is performed, the operation screen 32 is not displayed superimposed on the main screen 31, and part of the information content displayed on the main screen 31 is not required to be viewed on the operation screen 32. Will not be disturbed.

Next, processing of the information content receiving device 2 and the display device 3 will be described. FIG. 5 is a flowchart showing a processing flow of the information content receiving device 2 and the display device 3.

When the input operation processing unit 21 receives a display ON signal from the input operation device 1 (YES in S201), the input operation processing unit 21 outputs a display ON signal to the operation screen generation unit 22, and the operation screen generation unit 22 The operation screen 32 is displayed superimposed on the main screen 31 via the display output unit 27 (S202). If the input operation processing unit 21 does not receive the display ON signal (NO in S201), it waits.

When the input operation processing unit 21 receives the designated position information (YES in S203), the display pointer processing unit 23a reads the distance d from the designated position information and determines the size of the display pointer (S204). Since a circular display pointer is used in this embodiment, the display pointer processing unit 23a determines the radius of the display pointer according to the value of the distance d. More specifically, the radius of the display pointer is increased when the distance d is large, and the radius of the display pointer is decreased when the distance d is small.

Further, the display pointer processing unit 23 a reads the two-dimensional position information of the instruction point 14 from the instruction position information, calculates a point corresponding to the coordinates of the instruction point 14 on the operation screen 32, and sets this point as the center 36 of the display pointer 33. The data is output to the display output unit 27.

Further, when the center 36 of the display pointer is aligned with a point corresponding to the instruction point 14 on the operation screen 32, the object 34 included in the display pointer 33, that is, inside the circular display pointer 33 is specified and the display output unit 27 is identified. (S205).

The display output unit 27 displays the specified object 34 in a highlighted manner while aligning and displaying the center 36 of the display pointer 33 at a position corresponding to the instruction point 14 on the operation screen 32 (S206).

If the display OFF signal is not received, the process returns to S203 to continue the processing of the display pointer 33 in the operation screen 32. If the display OFF signal is received, the operation screen 32 is displayed and the display pointer 33 is displayed accordingly. Exit.

Hereafter, some screen display examples will be explained. FIG. 6 is a diagram showing two operation screens 32 when the distance d between the touch panel 11 and the user instruction medium 13 is different. FIG. 6A shows a case where the distance d is relatively large, and FIG. 6B shows a case where the distance d is relatively small. Show the case.

6A, the area of the display pointer 33a is relatively large, and a plurality of objects 34 are included in the area of the display pointer 33a. Among these objects 34, there are a plurality of highlighted objects 35. In this example, the object 34 that is entirely included in the area of the display pointer 33a is the highlighted object 35.

At this time, the user brings the user instruction medium 13 closer to the touch panel 11 in order to select a desired object. This is shown in FIG. 6B.

In FIG. 6B, the user has brought the user instruction medium 13 closer to the touch panel 11, and the area of the display pointer 33b is small. This is a result of adjusting the position of the user instruction medium 13 so that the highlighted object 35 is a desired object, so that the highlighted object 35 is one in the area of the display pointer 33b. . The user further presses the user instruction medium 13 in contact with the touch panel 11 to select the highlighted object 35.

Thereby, the size of the area of the display pointer 33 is changed according to the user selection operation, and the display pointer 33 is narrowed down closer to the target, and the cooperation with the user operation is further improved.

As another example, when only one object is included in the display pointer 33b, the object may be selected.

Next, a specific display example and operation example of the object 34 will be described with reference to FIG. FIG. 7A is a diagram showing a menu operation screen in a state where terrestrial waves are selected. FIG. 7B is a diagram showing a terrestrial broadcast operation screen.

As shown in FIG. 7A, the menu operation screen 32a includes an object for selecting terrestrial broadcast, an object for selecting satellite broadcast, an object for selecting a BD (Blu-ray Disc) / DVD (Digital Versatile Disk) device, An object 34 for selecting contents to be displayed such as news, movies, music, and photos is arranged.

In the example shown in FIG. 7A, the object 35 highlighted by the display pointer 33 is selected. This object 35 is a terrestrial broadcast object. As a result, the terrestrial broadcast application operation screen 32b shown in FIG. 7B is displayed, that is, the menu operation screen 32a is changed to the terrestrial broadcast application operation screen 32b.

In the operation screen 32b of the terrestrial broadcast application in FIG. 7B, a channel selection object of 1CH to 12CH and an object that can directly select a program guide or data broadcast are arranged. Also, the objects indicated by the arrow symbols (←, →) are objects that are paged to the previous page or the next page, and the number of objects that can be displayed at one time can be limited to improve the visibility of the user. The object indicated by the arrow symbol (←, →) is also in FIG. 7A.

FIG. 8 is also a diagram showing an example of the operation screen. FIG. 8A shows a state where the SNS is selected on the menu operation screen 32a, and FIG. 8B shows that the SNS (Social Network Service) login screen is displayed on the main screen 31. Indicates the state.

When the SNS application is selected, an SNS login screen 31a appears on the main screen 31, as shown in FIG. 8B. At this time, the menu operation screen 32a is automatically hidden. The main screen 31 includes a character input frame 37 such as an ID (Identification) input frame and a password input frame, a login execution button 38, and a cursor 39 used to select the character input frame 37 and the execution button 38. Be placed.

The SNS login screen 31a is similar to a screen used in a PC (Personal Computer) or the like, and the character input frame 37, the execution button 38, and the cursor 39 have the same functions.

In the character input frame 37, characters are input by the input key 12 of the input operation device 1. The cursor 39 can be moved by moving the user instruction medium 13 on the touch panel 11 as described above. At this time, the touch panel 11 and the main screen 31 may move the cursor based on the relative movement information of the user instruction medium 13 without making the coordinate system identical.

According to this example, not only an object selection from the menu screen of the operation screen 32 but also an application that requires character input or the like can be input.

Thus, in this embodiment, the coordinate expression of the area of the operation screen 32 has a one-to-one correspondence with the coordinate expression of the area of the touch panel 11, and the center 36 of the display pointer corresponds to one coordinate corresponding to the indication point 14. Determined to position.

Furthermore, in the present embodiment, the size of the display pointer 33 changes according to the degree of contact or approach between the touch panel 11 and the user instruction medium 13, that is, the distance d from the upper surface of the touch panel 11 to the user instruction medium 13. In the drawing, the display pointer when the distance d is relatively far is indicated by reference numeral 33a, and the display pointer when the distance d is relatively close is indicated by reference numeral 33b. As shown in the figure, the display pointer 33 increases when the distance d is long, and decreases when the distance d is short.

Thus, the degree of contact or approach between the touch panel 11 and the user instruction medium 13 is represented by the size of the display pointer 33 on the operation screen 32, and gives intuitive visibility to the user.

In the figure, the shape of the display pointer 33 is described as being based on a circle. However, other shapes such as a polygon based or an anime character shape may be more familiar to the user. . Further, the display pointer 33 is preferably translucent as shown in the figure, and is colored so as to be easily distinguished from the background.

The display pointer 33 includes several objects 34 in the area of the display pointer 33 when the degree of contact or proximity between the touch panel 11 and the user instruction medium 13 is medium. In this example, among these several objects 34, an object close to the center 36 of the display pointer is highlighted as the highlighted object 35, so that the user can easily understand whether the object is a desired object.

When the highlighted object 35 is a desired object, the user performs a selection operation by pressing the user instruction medium 13 on the touch panel 11. If the highlighted object 35 is not a desired object, the user instruction medium 13 is moved on the touch panel 11 so that the desired object becomes the highlighted object 35.

If the user feels that the area of the display pointer 33 is large, the number of objects 34 included in the area is large, and the highlighted object 35 is difficult to determine as a desired object, the user instruction medium By bringing 13 to the touch panel 11, the size of the display pointer 33 can be reduced.

When one object 34 is selected by such a selection operation, the highlighted object 35 can be displayed in a different display form, for example, by changing the color or displaying the 3D display. Useful for showing to.

Thus, the user can operate his / her selection operation while viewing the operation screen 32 of the display device 3 with the display pointer 33 and the highlighted object 35. There is no need to look directly at the touch panel 11 or the user instruction medium 13. The operation screen 32 is displayed in multiple on the main screen 31 on which the information content is displayed, and it is not necessary to keep an eye on the information content in the selection operation.

Also, the present embodiment is effective for shaking of the user instruction medium 13. When the user performs an object selection operation on the user instruction medium 13, the shaking of the user's own movement directly shakes the user instruction medium 13. In this case, the display pointer 33 fluctuates. However, in this embodiment, since the highlighted object 35 is presented to the user, the amount of fluctuation or movement is within the range of the object size. It is possible to continue the highlighted object 35 being the same. The size of the shake or movement is compared with the size of the object, and the highlighted object 35 may be made different only when the size of the shake or movement is larger than the size of the object.

At this time, reducing the shaking of the display pointer 33 by filtering the fine movement of the shaking is also effective for improving the visibility of the user.

<Second embodiment>
The second embodiment will be described with reference to FIGS. 9 and 10. The second embodiment is an example different from the first embodiment in that the operation screen 32 is manually turned on and off. FIG. 9 is a diagram illustrating the input operation device according to the second embodiment. FIG. 10 is a flowchart according to the input operation processing unit 21 according to the second embodiment.

FIG. 9 shows an input operation device 1a applied to the second embodiment, and the input operation device 1 shown in FIG.

The holding sensor 15 is installed outside the main body 10 of the input operation device 1a and is realized by, for example, a pressure sensor. The user grasps the input operation device 1a with the intention of operating the information content receiving device 2. Detect motion. When the user holds the input operation device 1a, the user's hand comes into contact with the holding sensor 15. Therefore, the holding sensor 15 detects the contact and outputs a detection signal. Based on the detection signal, the CPU 101 (see FIG. 2A) generates holding information indicating that the user holds the input operation device 1a, and the information content receiving device 2 from the input operation device 1a via the communication unit 120. Send to. The holding sensor 15 is configured to continue outputting the detection signal or to output at a constant period while detecting that the user holds the input operation device 1a. For this reason, while the user is holding the input operation device 1a, the held information is continuously or periodically transmitted to the information content receiving device 2 from the input operation device 1a.

FIG. 10 is a flowchart showing a processing operation in the present embodiment of the input operation processing unit 21 of the information content receiving device 2.

When the input operation processing unit 21 receives the hold information from the input operation device 1a in a state where the operation screen 32 is OFF (S108a / YES), the input operation processing unit 21 displays the operation screen to turn on the display of the operation screen 32. A display ON signal is sent to the display output unit 27 via the generation unit 22 to display the operation screen 32 (S112).

When instruction information by a user operation is received from the input operation device 1a in this state (S114 / YES), the instruction information is acquired and processed by the operation screen generation unit 22, the display pointer processing unit 23a, and the central control unit 23. A display suitable for the user operation is performed (S115).

While the holding state of the input operation device 1a continues, that is, while the input operation processing unit 21 receives the holding information (S108b / YES), the process returns to the user operation detection (S114) and the display of the operation screen 32 continues. .

When the transmission of the holding detection signal from the input operation device 1a is interrupted (S108b / NO), the input operation processing unit 21 outputs a display OFF signal to the display output unit 27 via the operation screen generating unit 22, and the operation screen 32 is displayed. Hide (S117).

Also in the present embodiment, when no user operation is performed, the operation screen 32 is not displayed superimposed on the main screen 31, and a part of information content is unnecessarily prevented from being viewed by the operation screen. Disappear.

Further, in this embodiment, since the user's direct action of grasping the input operation device 1a is detected and the operation screen can be displayed using this detection state, the operability can be further improved.

<Third embodiment>
A third embodiment will be described with reference to FIG. FIG. 11 is a diagram illustrating an input operation device according to the third embodiment. In the input operation device 1b shown in FIG. 11, the same components as those of the input operation device 1 shown in FIG.

As shown in FIG. 11, the input operation device 1b according to the third embodiment includes a display panel 16 with a touch panel and a home button 17.

In the present embodiment, the touch panel 11 and the input key 12 are configured on one display panel 16 with a touch panel. The touch panel-equipped display panel 16 is, for example, electronic paper or an LCD (Liquid Crystal Display) with a built-in touch cell.

The touch panel 11 and the input key 12 divide the display panel 16 with a touch panel and are arranged in each divided area. In FIG. 11, the upper part is an area where the input keys 12 are arranged, and the lower part is an area corresponding to the touch panel 11.

The touch panel of the display panel 16 with a touch panel is uniformly provided over the entire upper surface area of the input operation device 1b, and the area where the input keys 12 are arranged and the area corresponding to the touch panel 11 are an integrated touch panel. Can be created. For this reason, this embodiment can implement | achieve the input operation apparatus 1b as an application of the apparatus used also for other applications, such as a smart phone and an electronic book, for example.

The home button 17 is provided to make a transition to a higher screen when the input operation device 1b is applied to other applications.

In the above embodiment, the input operation device 1, the information content receiving device 2, and the display device 3 have been described as separate devices. However, in the embodiment of the present invention, the three devices are configured separately as described above. However, the information content receiving device 2 and the display device 3 may be integrated.

Further, the input operation device 1 and the information content receiving device 2 may be configured as an integrated device, and the display device 3 may be configured as a separate device. The other examples will be described with reference to FIG. FIG. 12 is a diagram showing an information content receiving system in which a tablet terminal and a projector are connected. In addition, when displaying the information content produced with the tablet terminal 7, for example, the moving image, drawing, and illustration which were image | photographed with the tablet terminal 7, you may call it an information content display system.

The tablet terminal 7 shown in FIG. 12 includes a touch panel that can measure capacitance. The tablet terminal 7 has the same configuration as that of the input operation device 1 and the information content receiving device 2 in FIG. 1, and receives and stores information content. Then, the tablet terminal 7 and the projector 8 may be connected to each other by wireless communication, for example, Bluetooth (registered trademark), and information based on the input operation received by the tablet terminal 7 may be transmitted to the projector 8 and displayed. In this case, the tablet terminal 7 corresponds to a device in which the input operation device 1 and the information content receiving device 2 are configured as an integrated device, and the projector 8 corresponds to the display device 3.

The above embodiments are not intended to limit the present invention, and for example, a part of the configuration of one embodiment can be replaced with another embodiment. In addition, the configuration of another embodiment can be added to the configuration of a certain embodiment. These all belong to the category of the present invention. Furthermore, numerical values, messages, and the like appearing in sentences and drawings are merely examples, and the use of different ones does not impair the effects of the present invention.

Still further, some or all of the functions and the like of the present invention described above may be realized by hardware by designing, for example, an integrated circuit. Alternatively, the microprocessor unit or the like may be realized by software by interpreting and executing an operation program that realizes each function or the like. Furthermore, hardware and software may be used together.

DESCRIPTION OF SYMBOLS 1 Input operation apparatus 2 Information content receiver 3 Display apparatus 4 Information storage apparatus 5 Broadcast receiving medium 6 Communication network 7 Tablet terminal 8 Projector 11 Touch sensor part 12 Input key 13 User instruction | indication medium 14 Instruction point 15 Holding | maintenance sensor part 16 Display with touch panel Panel 17 Home button 21 Input operation processing unit 22 Operation screen generation unit 23 Central control unit 24 Accumulated information input / output unit 25 Broadcast reception unit 26 Network transmission / reception unit 27 Display output unit 31 Main screen unit 32, 32a, 32b Operation screen unit 33, 33a, 33b Display pointer 34 Object 35 Highlighted object 36 Center of display pointer 37 Character input frame 38 Run button 39 Cursor

Claims (10)

1. An input operation method for displaying a display pointer indicating an input operation target range on a display screen using a touch panel for detecting a degree of contact or approach between an instruction medium for inputting a user instruction and a touch surface,
   Indicated position information for specifying the position of the pointing medium with respect to the touch surface, and the coordinates of the pointing point at which the pointing medium is detected on the touch surface are represented by a two-dimensional coordinate system in the touch surface. Obtaining indicated position information including two-dimensional position information and information indicating a degree of contact or approach between the pointing medium and the touch surface when the pointing medium is detected;
   Determining a size of a display pointer indicating a range to be an input operation target in the display screen based on the information indicating the degree of contact or approach; and
   The operation display system information that associates the two-dimensional coordinate system of the display screen with the two-dimensional coordinate system in the touch surface is referred to, and the two-dimensional position information of the indication point is converted into the two-dimensional coordinate system of the display screen. A step of displaying the determined size with the center of the display pointer of the determined size,
   The input operation method characterized by including.
2. The input operation method according to claim 1,
   The information indicating the degree of contact or approach is information indicating the distance between the pointing medium and the touch surface,
   The display pointer size is determined to be smaller as the distance is smaller.
   An input operation method characterized by the above.
3. The input operation method according to claim 1,
   The information indicating the degree of contact or approach is information indicating the magnitude of the pressure with which the pointing medium presses the touch surface,
   The larger the pressure is, the smaller the size of the display pointer is determined.
   An input operation method characterized by the above.
4. The input operation method according to claim 1,
   The display screen further displays at least one object that is a candidate for the user to select,
   When the display pointer is superimposed on the object and displayed, the object on which the display pointer is superimposed is displayed in a display mode different from the object on which the display pointer is not superimposed.
   An input operation method characterized by the above.
5. The input operation method according to claim 4,
   When the degree of contact or approach between the touch panel and the pointing medium is increased and the size of the display pointer is reduced accordingly, and the object on which the display pointer is superimposed becomes one, the object is moved to the user. Further comprising the step of determining as the selected object,
   An input operation method characterized by the above.
6. A touch panel for detecting the degree of contact or approach between an instruction medium for inputting a user instruction and the touch surface;
   Indicated position information for specifying the position of the pointing medium with respect to the touch surface, and the coordinates of the pointing point at which the pointing medium is detected on the touch surface are represented by a two-dimensional coordinate system in the touch surface. An input operation control unit that outputs two-dimensional position information and pointing position information including information indicating a degree of contact or approach between the pointing medium and the touch surface when the pointing medium is detected;
   A communication unit that transmits the indicated position information to a display control device that determines a size of a display pointer indicating a range to be input on the display screen and a display position in the display screen based on the indicated position information. When,
   An input operation device comprising:
7. The input operation device according to claim 6, wherein
   A main body including the input operation control unit and the communication unit, wherein the touch surface is disposed on an upper surface of the main body;
   A holding sensor that is disposed on a side surface of the main body and detects that the user holds the main body;
   When the input operation control unit obtains a holding detection signal for detecting that the user holds the main body from the holding sensor, the holding operation signal is transmitted from the communication unit to the display control device.
   An input operation device characterized by that.
8. A display control apparatus that displays a display pointer indicating a range to be input by a user on a display screen,
   The indication position information outputted by the touch panel for detecting the degree of contact or approach between the indication medium for inputting the user's instruction and the touch surface, the indication point being the position where the indication medium is detected on the touch surface Indicated position including two-dimensional position information representing coordinates in a two-dimensional coordinate system in the touch surface, and information indicating a degree of contact or approach between the indicating medium and the touch surface when the indicating medium is detected An input operation processing unit for acquiring information;
   Based on the information indicating the degree of contact or approach, a size of a display pointer indicating a range that is an input operation target in the display screen is determined, and a two-dimensional coordinate system of the display screen and a two-dimensional display in the touch surface Refer to the operation display system information associated with the coordinate system, and align the center of the display pointer of the determined size with the point obtained by converting the two-dimensional position information of the indication point into the two-dimensional coordinate system of the display screen. A display pointer processing unit to be displayed;
   A display control apparatus comprising:
9. In an information content receiving system in which an input operation device that accepts a user's input operation, an information content receiving device that receives information content, and a display device that has a display screen that displays information content are connected in communication.
   The input operation device includes:
   A touch panel for detecting the degree of contact or approach between an instruction medium for inputting a user instruction and the touch surface;
   Indicated position information for specifying the position of the pointing medium with respect to the touch surface, and the coordinates of the pointing point at which the pointing medium is detected on the touch surface are represented by a two-dimensional coordinate system in the touch surface. An input operation control unit that outputs two-dimensional position information and pointing position information including information indicating a degree of contact or approach between the pointing medium and the touch surface when the pointing medium is detected;
   A communication unit for transmitting the indicated position information to the information content receiving device;
   With
   The information content receiving device includes:
   At least one of a broadcast receiving unit that receives broadcast waves, a network transmission / reception unit that receives information content from a network connected to communication, or a storage information input unit that receives input of the information content from an information storage device that stores information content;
   A display control device for displaying on the display screen a display pointer indicating a range to be input by the user,
   The display control device includes:
   The indication position information outputted by the touch panel for detecting the degree of contact or approach between the indication medium for inputting the user's instruction and the touch surface, the indication point being the position where the indication medium is detected on the touch surface Indicated position including two-dimensional position information representing coordinates in a two-dimensional coordinate system in the touch surface, and information indicating a degree of contact or approach between the indicating medium and the touch surface when the indicating medium is detected An input operation processing unit for acquiring information;
   An operation screen generating unit that generates an operation screen in which at least one object to be selected by the user is arranged;
   Based on the information indicating the degree of contact or approach, a size of a display pointer indicating a range to be an input operation in the operation screen is determined, and a two-dimensional coordinate system of the display screen and a two-dimensional in the touch surface Refer to the operation display system information associated with the coordinate system, and align the center of the display pointer of the determined size with the point obtained by converting the two-dimensional position information of the indication point into the two-dimensional coordinate system of the display screen. A display pointer processing unit to be displayed;
   A display output unit that displays the object on which the display pointer is superimposed in the operation screen in a display mode different from the object on which the object is not superimposed,
   An information content receiving system.
10. In the information content receiving system of claim 9,
    The input operation device is a main body including the input operation control unit and the communication unit, and a main body in which the touch panel is disposed on an upper surface of the main body,
    A holding sensor that is disposed on a side surface of the main body and detects that the user holds the main body;
    When the input operation control unit obtains a holding detection signal for detecting that the user holds the main body from the holding sensor, the holding operation signal is transmitted from the communication unit to the display control device,
    The operation screen generation unit generates the operation screen when receiving the holding detection signal, and starts displaying the operation screen.
    An information content receiving system.

Images