JP5751163B2 - Pointer position detection device and pointer position detection program - Google Patents

Description

  The present case relates to an indicator position detection device and an indicator position detection program.

  In recent years, in presentations, meetings, school education, and the like, a technique has been introduced in which an image signal from a personal computer terminal is enlarged and displayed on a large monitor, and the display is changed in accordance with an operation of a pointing tool (such as a pen) by a user. Yes. In this case, the user can execute the display software by directly touching the projected image with the pointing tool, select an icon with the pointing tool, or draw characters, diagrams, pictures, etc. You can do that.

  As a method for detecting the position (absolute coordinates) of the pointing tool, a detection method using infrared blocking is known (see, for example, Patent Documents 1 and 2). A method of detecting the position of the electronic pen based on information received by the electronic pen is also known (see, for example, Patent Document 3).

JP 2000-284895 A JP 2003-263274 A JP-A-11-282628

  When the monitor is large, a detection method using the infrared blocking is often used as a method for detecting the position of the pointing tool. However, since the detection method using infrared blocking detects the position where the pointing device blocks the light, when a part of the user's hand or clothes (sleeves, etc.) touches the screen, a plurality of light blocking portions are detected. There is a possibility that the position of the pointing tool cannot be detected correctly.

  The object of the present invention is to provide an indicator position detection device and an indicator position detection program capable of accurately detecting the position of an indicator.

  The pointing device position detection device described in the present specification irradiates a plurality of lights having a first wavelength in the first direction from one side in the first direction of the display surface of the display device, and An irradiation unit configured to irradiate a plurality of lights having a second wavelength different from the first wavelength toward the second direction from one side in the second direction intersecting with the one direction; and on the other side of the display surface in the first direction. A light receiving unit that receives the plurality of lights having the first wavelength and receives the plurality of lights having the second wavelength on the other side in the second direction of the display surface; and an indicator. Based on the light reception intensity detection unit that receives the light of the wavelength and the light of the second wavelength and detects the light reception intensity of each light, the light reception result of the light reception unit, and the detection result of the light reception intensity detection unit And a position detection unit for detecting the position of the pointing tool with respect to the display device.

  The pointing tool position detection program according to the present specification provides a plurality of lights having a first wavelength irradiated in the first direction from one side in the first direction of the display surface of the display device. And a plurality of lights having the second wavelength irradiated in the second direction from one side in the second direction intersecting the first direction of the display surface are received on the other side in the second direction of the display surface. And obtaining the light reception intensity of each light when the indicator receives the light of the first wavelength and the light of the second wavelength, and obtaining the light reception result and the light reception intensity. A program for causing a computer to execute a process of detecting a position of the pointing tool with respect to the display device based on a result.

  The pointing tool position detection device and the pointing tool position detection program described in this specification have an effect that the position of the pointing tool can be detected with high accuracy.

1 is a diagram schematically illustrating a configuration of a display system according to an embodiment. It is a figure which shows the structure of the display system of FIG. 1 in detail. It is a figure which shows the specific structure of an indicator. It is a hardware block diagram of a detection and control apparatus. FIG. 5A is a diagram showing a flow of light emission level adjustment processing (processing of the matrix detection unit), and FIG. 5B is a diagram showing a flow of light emission level adjustment processing (processing of the light emission level adjustment control unit). It is. It is the figure which showed the correlation of the light reception intensity level and position in a X-axis direction at the time of adjusting light reception intensity level substantially constant. It is the figure which showed the correlation of the light reception intensity level and position in a Y-axis direction at the time of adjusting light reception intensity level substantially constant. FIG. 8A is a diagram showing a lookup table (X axis), and FIG. 8B is a diagram showing a lookup table (Y axis). It is a figure which shows a calibration process flow. FIG. 10A is a diagram illustrating a lookup table (X axis) after the calibration process, and FIG. 10B is a diagram illustrating a lookup table (Y axis) after the calibration process. It is a figure which shows a position coordinate detection process (indicator process) flow. It is a figure which shows the position coordinate detection process (process of a detection and control apparatus). FIGS. 13A and 13B are diagrams illustrating an example in the case where there are a plurality of light-shielding detection locations. FIG. 14A to FIG. 14C are diagrams for explaining the processing of FIG.

  Hereinafter, a display system 100 according to an embodiment will be described in detail with reference to FIGS. FIG. 1 is a diagram schematically showing a configuration of a display system 100 of the present embodiment.

  As shown in FIG. 1, the display system 100 includes a display monitor 10, a matrix type detection unit 20, an indicator 30, a detection / control device 70, and a PC 80. In the present embodiment, the matrix-type detection unit 20, the pointing tool 30, and the detection / control device 70 realize the function as the pointing tool position detecting device. In FIG. 1, it is assumed that the horizontal direction (long side direction) of the display monitor 10 is the X-axis direction, and the vertical direction (short side direction) is the Y-axis direction.

  The display monitor 10 is a plasma monitor, a liquid crystal monitor, a rear projection projector, an electronic board, or the like. For example, a monitor that is generally commercially available can be used.

  The matrix detection unit 20 is a frame-shaped (frame-shaped) unit provided around the display surface (screen) 10a of the display monitor 10 as shown in FIG. The matrix type detection unit 20 is a unit that detects the position of the support 30 using infrared blocking, and as shown in FIG. 2, an X-axis infrared light emitting unit 22X1 and a Y-axis infrared light emitting unit as an irradiation unit. 22Y1, and an X-axis infrared light receiving unit 22X2 and a Y-axis infrared light receiving unit 22Y2 as light receiving units.

The X-axis infrared light emitting unit 22X1 includes a plurality (m pieces in FIG. 2) of light emitting elements D _{x1 to} D _xm and a light emission driving unit 24X1.

Emitting element D _x1 to D _xm are arranged at predetermined intervals along the X-axis direction in the Y-axis direction one side (+ Y side) of the display monitor 10, from each light-emitting element D _x1 to D _xm, Y axis Infrared rays are emitted in a direction parallel to the. In addition, the width | variety (element pitch) of a general light emitting element is about 4-5 mm, and the number (m pieces) of the light emitting elements which can be arrange | positioned along an X-axis is this screen and the screen of the display monitor 10. It depends on the size. For example, when the screen size of the display monitor 10 is a 50V type, about 276 light emitting elements can be arranged along the X axis. The light emitting elements D _{x1 to} D _xm emit infrared rays having a wavelength λ1.

Emission driving unit 24X1 adjusts the supplying forward current to the light emitting element D _x1 to D _xm, controls the light emission intensity of the infrared rays emitted from the light emitting element D _x1 to D _xm. The light emission drive unit 24X1 adjusts the forward current supplied to the light emitting elements D _{x1 to} D _xm based on an instruction from a light emission level adjustment control unit 74 of the detection / control device 70 described later.

The Y-axis infrared light emitting unit 22Y1 includes a plurality (n in FIG. 2) of light emitting elements D _{y1 to} D _yn and a light emission driving unit 24Y1.

The light emitting elements D _{y1 to} D _yn are arranged at predetermined intervals along the Y axis direction on one side in the X axis direction (−X side) of the display monitor 10, and from each of the light emitting elements D _{y1 to} D _yn , Infrared rays parallel to the axis are emitted. Since the light emitting elements D _{y1 to} D _yn are arranged in the same manner as the light emitting elements D _{x1 to} D _xm , for example, when the screen size of the display monitor 10 is 50 V type, About 156 light-emitting elements can be arranged along. The light emitting elements D _{y1 to} D _yn emit infrared rays having a wavelength λ2 different from the wavelength λ1 described above.

Similarly to the light emission drive unit 24X1, the light emission drive unit 24Y1 adjusts the forward current supplied to the light emitting elements D _{y1 to} D _yn based on an instruction from the light emission level adjustment control unit 74, and the light emission elements D _{y1 to} D _yn Controls the intensity of emitted infrared light.

  In addition, according to the X-axis and Y-axis infrared light emitting units 22X1 and 22Y1, infrared rays along the X-axis and the Y-axis are emitted in a lattice shape (matrix shape).

The X-axis infrared light receiving unit 22X2 is provided at a position facing the X-axis infrared light emitting unit 22X1 in the Y-axis direction. The X-axis infrared light receiving unit 22X2 includes a plurality (m) of light receiving elements T _{x1 to} T _xm and a light receiving level conversion unit 24X2. The light receiving elements T _{x1 to} T _xm are provided on the other side (−Y side) of the display monitor 10 in the Y-axis direction, receive infrared rays emitted from the light emitting elements D _{x1 to} D _xm , and receive light signals (light receiving intensity levels). Is output. The received light level converter 24X2 performs A / D conversion to quantify the received light intensity level (analog value) output from the light receiving elements (T _{x1 to} T _xm ), and converts the converted digital value (received light intensity level value). ) Is output to the detection / control device 70.

The Y-axis infrared light receiving unit 22Y2 is provided at a position facing the Y-axis infrared light emitting unit 22Y1 in the X-axis direction. The Y-axis infrared light receiving unit 22Y2 includes a plurality (n pieces) of light receiving elements T _{y1 to} T _yn and a light receiving level conversion unit 24Y2. The light receiving elements T _{y1 to} T _yn are provided on the other side (+ X side) of the display monitor 10 in the X-axis direction, receive infrared rays emitted from the light emitting elements D _{y1 to} D _yn , and receive light reception signals (light reception intensity levels). Output. The received light level conversion unit 24Y2 performs A / D conversion to quantify the received light intensity level (analog value) output from the light receiving elements (T _{y1 to} T _ym ), and converts the converted digital value (received light intensity level value). ) Is output to the detection / control device 70.

  Returning to FIG. 1, the pointing tool 30 is an instrument used by a user to draw characters and diagrams or select an icon. The indicator 30 has a structure as shown in FIG. Specifically, as shown in FIG. 3, the pointing tool 30 includes an exterior body 46, a condensing prism 32, a spectroscopic prism 34, an X-axis infrared light receiving element 36 </ b> X, a Y-axis infrared light receiving element 36 </ b> Y, A level conversion unit 38, a writing pressure sensor 40, a data transfer control unit 42, and a communication control unit 44 are provided.

The exterior body 46 has a pen shape, and a space capable of accommodating each part of the indicator 30 is formed therein. The condensing prism 32 includes infrared rays (wavelength λ1) emitted from any of the light emitting elements D _{x1 to} D _xm when the tip of the pointing tool 30 (the lower end in FIG. 3) is in contact with or close to the display monitor 10. Infrared rays (wavelength λ2) emitted from any one of the light emitting elements D _{y1 to} D _yn are condensed. The spectroscopic prism 34 distributes infrared light of each wavelength in two directions.

  The X-axis infrared light receiving element 36 </ b> X receives infrared light having a wavelength λ <b> 1 and transmits a light reception signal (light reception intensity level) to the light reception level conversion unit 38. The Y-axis infrared light receiving element 36 </ b> Y receives infrared light having a wavelength λ <b> 2 and transmits a light reception signal (light reception intensity level) to the light reception level conversion unit 38.

  The received light level conversion unit 38 A / D converts the received light intensity level (analog value) transmitted from the X-axis and Y-axis infrared light receiving elements 36X and 36Y, and the quantified digital value (received light intensity level value). The data is transmitted to the data transfer control unit 42. The X-axis infrared light receiving element 36X, the Y-axis infrared light receiving element 36Y, and the light reception level conversion unit 38 realize a function as a light reception intensity detection unit.

  The pen pressure sensor 40 is a sensor that detects the pen pressure (the tip of the pointing tool 30 is in contact with the display monitor 10) by detecting the movement of the condensing prism 32. The writing pressure detection sensor 40 notifies the data transfer control unit 42 when writing pressure is detected.

  The data transfer control unit 42 temporarily stores the received light intensity level value transmitted from the received light level conversion unit 38. Further, the data transfer control unit 42 outputs the light reception intensity level value temporarily stored to the communication control unit 44 when notified from the writing pressure sensor 40.

  The communication control unit 44 converts the received light intensity level value output from the data transfer control unit 42 into a transmission protocol, and then transmits it to the detection / control device 70 by wireless communication or infrared communication at a predetermined transfer cycle. Send.

  Returning to FIG. 1, the detection / control device 70 is connected to the matrix detection unit 20 and the PC 80. FIG. 4 shows a hardware configuration of the detection / control apparatus 70. As shown in FIG. 4, the detection / control device 70 includes a CPU 90, a ROM 92, a RAM 94, a storage unit (here, HDD (Hard Disk Drive)) 96, a communication interface 97, a portable storage medium drive 99, and the like. Yes. Each component of the detection / control device 70 is connected to a bus 98. In the detection / control apparatus 70, a program (pointer position detection program) stored in the ROM 92 or the HDD 96 or a program (pointer position detection program) read by the portable storage medium drive 99 from the portable storage medium 91 is stored. When executed by the CPU 90, the function of each unit shown in FIG. 2 is realized. Note that FIG. 2 also shows the lookup table 68 stored in the HDD 96 or the like.

  As shown in FIG. 2, in the detection / control apparatus 70, the functions of the acquisition unit 72, the light emission level adjustment control unit 74, the communication control unit 76, and the position detection unit 78 are realized by the CPU 90 executing a program. Yes.

  The acquisition unit 72 acquires the light reception intensity level value transmitted from the X-axis infrared light reception unit 22X2 and the Y-axis infrared light reception unit 22Y2, and transmits the light reception intensity level value to the light emission level adjustment control unit 74 and the position detection unit 78.

The light emission level adjustment control unit 74 acquires the received light intensity level value transmitted from the X-axis and Y-axis infrared light receiving units 22X2 and 22Y2. The light emission level adjustment control unit 74 then adjusts the X axis and Y axis so that the received light intensity levels of the respective light receiving elements T _{x1 to} T _xm and T _{y1 to} T _yn are based on the respective received light intensity levels. An instruction is given to the infrared light emitting units 22X1 and 22Y1. That is, the light emission level adjustment control unit 74 controls the light emission drive units 24X1 and 24Y1 of the X-axis and Y-axis infrared light emission units 22X1 and 22Y1.

  The communication control unit 76 acquires the received light intensity level value transmitted from the communication control unit 44 of the pointing tool 30 by wireless communication or infrared communication, and transmits it to the position detection unit 78.

  Based on at least the received light intensity level value received from the acquisition unit 72 among the received light intensity level value received from the acquisition unit 72 and the received light intensity level value received from the communication control unit 76, the position detection unit 78 indicates the indicator 30. The position (coordinates) of is detected. Here, the position detection unit 78 refers to the lookup table 68 when detecting the position (coordinates) of the pointing tool 30. Details of the lookup table 68 will be described later. The position detection unit 78 converts the format of the detected position (coordinates) of the pointing tool 30 and transmits it to the PC 80 as a coordinate signal.

  The PC 80 generates an image to be displayed on the display monitor 10 and displays it on the screen 10 a on the display monitor 10. In this case, the PC 80 displays characters and pictures on the screen 10a or changes the image on the screen 10a based on the coordinate signal transmitted from the position detection unit 78 of the detection / control device 70.

  Next, the process of the display system 100 of this embodiment is demonstrated in detail based on FIGS.

(Light emission level adjustment process)
First, FIG. 5 (a), along in FIG. 5 (b), the light-emitting elements D _x1 to D _xm, will be described in detail emission level adjusting process of D _y1 to D _yn. FIG. 5A is a diagram illustrating a processing flow of the light emission driving units 24X1 and 24Y1 and the light reception level conversion units 24X2 and 24Y2. FIG. 5B is a diagram illustrating a processing flow of the light emission level adjustment control unit 74. It is. In the present embodiment, as an example, these processes are performed when the display system 100 is activated.

In the process of FIG. 5A, first, in step S10, the light emission drive units 24X1 and 24Y1 emit infrared light from the light emitting elements D _{x1 to} D _xm and D _{y1 to} D _yn . In this case, infrared light having a wavelength λ1 is emitted from the light emitting elements D _{x1 to} D _xm , and infrared light having a wavelength λ2 is emitted from the light emitting elements D _{y1 to} D _yn .

Next, in step S12, the light receiving level converters 24X2 and 24Y2 obtain light receiving signals output from the light receiving elements T _{x1 to} T _xm and T _{y1 to} T _yn . Next, in step S14, the received light level conversion units 24X2 and 24Y2 perform A / D conversion for quantifying the received light intensity level (analog value) of the acquired received light signal, and acquire the received light intensity level value (digital value). To do.

  Next, in step S16, the light reception level conversion units 24X2 and 24Y2 transmit the light reception intensity level value acquired in step S14 to the detection / control device 70 (acquisition unit 72).

  With the above processing, the entire processing in FIG. When the process of FIG. 5A ends, the process of FIG. 5B is started.

  5B, first, in step S20, the acquisition unit 72 transmits the received light intensity level values transmitted from the received light level conversion units 24X2 and 24Y2 to the light emission level adjustment control unit 74. Next, in step S22, the light emission level adjustment control unit 74 compares the received light reception intensity level value with a reference value.

In this case, the light emission level adjustment control unit 74 compares the preset reference value Px (BL) in the X-axis direction with the light reception intensity level values of the light receiving elements T _{x1 to} T _xm . Further, the light emission level adjustment control unit 74 compares a preset reference value Py (BL) in the Y-axis direction with the light reception intensity level values of the light receiving elements T _{y1 to} T _yn .

  Next, in step S24, the light emission level adjustment control unit 74 determines whether each received light intensity level substantially matches the reference value (Px (BL) or Py (BL)), that is, the received light intensity level value of each light receiving element. And whether the difference between the reference value and the reference value is within a predetermined range.

  If the determination here is affirmative, that is, if the received light intensity levels of all the light receiving elements substantially coincide with the reference value, the entire processing of FIG. On the other hand, if the determination in step S24 is negative, that is, if the light reception intensity level of at least one light receiving element does not substantially match the reference value, the process proceeds to step S26.

  When the process proceeds to step S <b> 26, the light emission level adjustment control unit 74 obtains a difference between the light reception intensity level and the light reception level reference value for the light emitting element whose light reception intensity level does not substantially match the reference value. And the light emission level adjustment control part 74 transmits the correction value data preset for every difference with respect to the light emission drive part 24X1 or 24Y1. Note that the light emission drive unit 24X1 or 24Y1 performs D / A conversion on the correction value data, and changes the forward current of the light emitting element based on the D / A conversion. As a result, it is possible to make the received light intensity level of infrared rays emitted from the light emitting element whose forward current is changed substantially coincide with the reference value (Px (BL) or Py (BL)).

By doing as described above, all of the light receiving intensity levels of the light receiving elements T _{x1 to} T _xm can be substantially matched with the reference value Px (BL), and the light receiving intensity levels of the light receiving elements T _{y1 to} T _yn are set. Can be substantially matched with the reference value Py (BL).

  FIG. 6 is a diagram showing the correlation between the received light intensity level and the position in the X-axis direction when the received light intensity level is adjusted to be substantially constant. FIG. 7 is a diagram showing the correlation between the received light intensity level and the position in the Y-axis direction when the received light intensity level is adjusted to be substantially constant.

In FIG. 6, the received light intensity level P changes according to the logarithmic relationship of the relative light emission output / distance characteristic (Po / R) of the light emitting element (however, the graph of FIG. 6 is displayed as a straight line for simplicity). Here, for example, the received light intensity level of infrared rays emitted from the light emitting element _Dy1 is Pe (y1) at coordinates (Xe, y1), Pf (y1) at coordinates (Xf, y1), and at coordinates (Xg, y1). Suppose that it changes to Pg (y1). The received light intensity level of the infrared rays emitted from the light emitting element _Dyn is Pe (yn) at coordinates (Xe, yn), Pf (yn) at coordinates (Xf, yn), and Pg (yn) at coordinates (Xg, yn). ). In this case, the received light intensity level at the X coordinate Xe is set to Pe (y1) ≈Pe by adjusting the received light intensity level in each light receiving element to be almost constant by performing the above-described processing of FIGS. 5 (a) and 5 (b). Pe (yn) = Pxe. The received light intensity level when the X coordinate is Xf can be set to Pf (y1) ≈Pf (yn) = Pxf. Further, the received light intensity level when the X coordinate is Xg can be set to Pg (y1) ≈Pg (yn) = Pxg.

Similarly, in FIG. 7, the received light intensity level P is in accordance with the logarithmic relationship of the relative light emission output / distance characteristic (Po / R) of the light emitting element (however, the graph of FIG. 6 is displayed as a straight line for simplicity). Change. Here, for example, the received light intensity level of the infrared rays emitted from the light emitting element D _x1 is Ph (x1) at coordinates (x1, Yh), Pi (x1) at coordinates (x1, Yi), and at coordinates (x1, Yj). Suppose that it changes to Pj (x1). The received light intensity level of infrared rays emitted from the light emitting element D _xm is Ph (xm) at coordinates (xm, Yh), Pi (xm) at coordinates (xm, Yi), and Pj (xm) at coordinates (xm, Yj). ). In this case, by performing the processes shown in FIGS. 5A and 5B and adjusting the light receiving intensity level of each light receiving element to be substantially constant, the light receiving intensity level when the Y coordinate is Yh is set to Ph (x1) ≈ Ph (xm) = Pyh. Further, the received light intensity level when the Y coordinate is Yi can be set to Pi (x1) ≈Pi (xm) = Pyi. Further, the received light intensity level when the Y coordinate is Yj can be set as Pj (x1) ≈Pj (xm) = Pyj.

  A table showing the relationship between the X-coordinate values (light-receiving intensity level values) when the light-receiving intensity levels Pxe, Pxf, Pxg... Are A / D converted is a lookup table (X) in FIG. Axis). Further, a table showing the relationship between the values (light reception intensity level values) when the light reception intensity levels Pyh, Pyi, Pyj... Are A / D converted and the Y coordinates is a lookup table (Y) in FIG. Axis).

(Calibration process)
Next, a calibration process necessary for using the lookup table 68 for detecting the position (coordinates) of the pointing tool 30 will be described with reference to FIG. This calibration process is performed when the display system 100 is activated.

The calibration processing includes the light reception intensity level detected using the light receiving elements T _{x1 to} T _xm and T _{y1 to} T _yn and the light reception intensity detected using the X-axis and Y-axis infrared light receiving elements 36X and 36Y. This is a process for calibrating the error from the level. This error occurs because the infrared rays pass through the condensing prism 32, the spectral prism 34, etc. before the infrared rays reach the X-axis and Y-axis infrared light receiving elements 36X and 36Y, and the infrared intensity is attenuated by these members.

  In the process of FIG. 9, first, in step S <b> 30, the position detection unit 78 instructs the user to touch the screen 10 a with the pointing tool 30. In this case, the position detection unit 78 displays the instruction on the screen 10 a of the display monitor 10 via the PC 80. Note that the position touched by the pointing tool 30 may be a predetermined reference point (such as a corner of the screen 10a) or an arbitrary point.

  Next, in step S <b> 32, the position detection unit 78 acquires the position (coordinates) where the infrared rays are shielded by the pointing tool 30 from the outputs of the light receiving level conversion units 24 </ b> X <b> 2 and 24 </ b> Y <b> 2, and the acquired position is the position of the pointing tool 30. Specify as coordinates.

  Next, in step S34, the position detector 78 acquires the received light intensity level value (A / D converted value of the received light intensity level in the X-axis and Y-bearing optical elements 36X and 36Y) transmitted from the pointing tool 30. .

  Next, in step S36, the position detection unit 78 acquires the difference between the acquired light reception intensity level value and the light reception intensity level value of the lookup table corresponding to the position coordinate specified in step S32.

  Next, in step S38, the position detection unit 78 reflects the difference acquired in step S36 on the lookup table 68. In this case, for example, the position detection unit 78 shifts the received light intensity level value and the coordinates of the lookup table 68 by the difference obtained in step S36 (as shown in FIGS. 10A and 10B). In addition, the column of “coordinates” may be shifted upward or downward relative to the column of “light reception intensity level value” by the difference).

  With the above process, the calibration process of FIG. 9 is completed. After this process is completed, the position coordinate detection process of FIGS. 11 and 12 is executed. In the processes of FIGS. 11 and 12, the lookup tables (FIGS. 10A and 10B) obtained by the calibration process are used.

(Position coordinate detection processing)
Hereinafter, the position coordinate detection process will be described with reference to FIGS. 11 and 12. FIG. 11 and FIG. 12 are diagrams showing a flow of processing that is always performed after the display system 100 is activated. The process of FIG. 11 (the process of the pointing tool 30) and the process of FIG. 12 (the process of the detection / control apparatus 70) are executed in parallel. In addition, it is assumed that infrared rays are constantly emitted from the light emitting elements D _{x1 to} D _xm and D _{y1 to} D _yn while the processes of FIGS. 11 and 12 are performed.

  In the process of FIG. 11, first, in step S50, the light reception level conversion unit 38 has received light on at least one of the X-axis and Y-axis infrared light receiving elements 36X and 36Y, that is, the light reception intensity from each infrared light receiving element 36X and 36Y. Determine whether a level has been output. If the determination is negative, step S50 is repeated. If the determination is positive, the process proceeds to step S52.

  In step S52, the light reception level conversion unit 38 acquires the light reception intensity levels (analog values) output from the infrared light receiving elements 36X and 36Y.

  Next, in step S54, the light reception level conversion unit 38 A / D converts the light reception intensity level (analog value) into a digital value (quantification) to obtain a light reception intensity level value (digital value).

  Next, in step S56, the light reception level conversion unit 38 determines whether or not the light reception intensity level values of both the X and Y axes have been acquired. When judgment here is denied, it returns to step S50. On the other hand, if the determination in step S56 is affirmative, the process proceeds to step S58.

  In step S <b> 58, the light reception level conversion unit 38 transmits the light reception intensity level value to the data transfer control unit 42. The data transfer control unit 42 temporarily stores the received light intensity level value.

  Next, in step S60, the data transfer control unit 42 determines whether or not the writing pressure detection sensor 40 has sensed at the timing when the received light intensity level is acquired by the received light level conversion unit 38 (timing of step S52). When judgment here is denied, it transfers to step S62. In step S62, the data transfer control unit 42 deletes the temporarily received light intensity level value and returns to step S50. On the other hand, if the determination in step S60 is affirmative, the process proceeds to step S64.

  When the process proceeds to step S64, the light reception level conversion unit 38 transmits the light reception intensity level value obtained in step S54 to the communication control unit 44. Then, the communication control unit 44 transmits the received light intensity level value to the acquisition unit 72 of the detection / control device 70. Thereafter, the process returns to step S50.

  In the process of FIG. 11, the light receiving intensity level values (X axis and Y axis) in the pointing tool 30 when the pointing tool 30 comes into contact with the screen 10 a of the display monitor 10 by repeating the above steps S50 to S64 are acquired. Will be sent to.

Next, the process of FIG. 12 will be described. In the processing of FIG. 12, first, in step S12, the position detection unit 78 performs A / D conversion of the received light intensity levels detected by the light receiving elements T _{x1 to} T _xm and T _{y1 to} T _ym via the acquisition unit 72. The later value (received light intensity level value) is acquired. Next, in step S81, it is determined whether or not the light reception intensity level in any one of the light receiving elements T _{x1 to} T _xm and T _{y1 to} T _ym has become 0, that is, whether or not light shielding has been detected. While the determination here is negative, the processes and determinations of steps S80 and S81 are repeated, but if the determination of step S81 is affirmative, the process proceeds to step S82.

  When the light shielding is detected and the process proceeds to step S82, the position detecting unit 78 determines whether or not there are a plurality of light shielding detection locations (coordinates corresponding to the light receiving elements whose light receiving intensity level is substantially 0). Here, when there are a plurality of light-shielding detection locations, as shown in FIG. 13A, the case where the hand opposite to the hand holding the pointing tool 30 touches the display monitor 10 is included. It is. Further, when there are a plurality of light-shielding detection points, as shown in FIG. 13B, a case where a hand or clothes holding the pointing tool 30 touches the display monitor 10 is included. In FIGS. 13A and 13B, the position of the pointing tool 30 among the plurality of detection points is indicated by a circle, and the position other than the pointing tool 30 is indicated by a cross.

  Returning to FIG. 12, if the determination in step S82 is negative, that is, if the number of light-shielding detection points is one, the process proceeds to step S84. In step S <b> 84, the position detection unit 78 sets the light-shielding detection location as the true position coordinate of the pointing tool 30, converts the format of the position coordinate, and transmits the coordinate signal to the PC 80. Thereafter, the process returns to step S80.

  On the other hand, if the determination in step S82 is affirmative, that is, if there are a plurality of light-shielding detection locations, the process proceeds to step S86. In step S86, the position detection unit 78 refers to the received light intensity level value transmitted from the pointing tool 30. In addition, the position detection unit 78 uses the lookup table 68 to determine the X-axis coordinate and the Y-axis coordinate based on the received light intensity level value transmitted from the pointing tool 30. Here, for example, as shown in FIG. 14A, it is assumed that coordinates (Xa ′, Ya ′) have been determined.

  Next, in step S88, the position detection unit 78 collates the location where the light shielding is detected with the coordinates (Xa ′, Ya ′) determined in step S86. Here, for example, it is assumed that the locations where light shielding is detected are the three locations (coordinates (Xa, Ya), (Xs, Yt), (Xq, Yr)) shown in FIG.

  Next, in step S90, the position detection unit 78 determines the coordinates of the light-shielding detection location closest to the coordinates (Xa ′, Ya ′) determined in step S86 based on the collation result as true coordinates. In the case of FIGS. 14A and 14B, the coordinates (Xa, Ya ′) closest to the coordinates (Xa ′, Ya ′) among the coordinates (Xa, Ya), (Xs, Yt), (Xq, Yr) are used. Ya) is the true coordinate. As a method for obtaining the nearest light shielding detection location, a method of calculating the distance between the coordinates (Xa ′, Ya ′) and the coordinates of each light shielding detection location can be used. Further, in order to reduce the amount of calculation, a method may be used in which the coordinates of the light-shielding detection location existing within a predetermined range (for example, within a circle with a predetermined radius) from the coordinates (Xa ′, Ya ′) are the closest.

  After the true coordinates are determined as described above, in step S92, the position detection unit 78 performs format conversion of the true coordinates and transmits the converted coordinate signal to the PC 80. Thereafter, the process returns to step S80.

  In the processing of FIG. 12, when the processing / determination of steps S80 to S92 is repeated, when there is one light shielding detection location, the coordinates (coordinate signal) of the light shielding detection location are transmitted from the position detection unit 78 to the PC 80. When there are a plurality of light shielding detection locations, true coordinates (coordinate signals) determined in consideration of the detection result of the pointing tool 30 are transmitted from the position detection unit 78 to the PC 80. The PC 80 displays characters and pictures and changes images based on the coordinate signal transmitted from the detection / control device 70 (position detection unit 78).

  When the user performs pointing such as pointing, the position detection unit 78 may perform coordinate determination by detecting light shielding of the light receiving element. Which function the user intends to use may be determined based on whether the indication tool 30 is effective based on the detection result of the writing pressure detection sensor 40 or whether the received light intensity level value is transmitted.

  As described above in detail, according to the present embodiment, the matrix detection unit 20 outputs a plurality of infrared rays having the wavelength λ1 from the Y axis direction one side (+ Y side) of the screen 10a of the display monitor 10 in the Y axis direction. An X-axis infrared light emitting unit 22X1 that irradiates the screen 10a, and a Y-axis infrared light emitting unit 22Y1 that irradiates a plurality of infrared rays having a wavelength λ2 toward the X-axis direction from one side (−X side) of the screen 10a in the X-axis direction; The X-axis infrared light receiving unit 22X2 that receives a plurality of infrared rays having the wavelength λ1 on the other side in the Y-axis direction (−Y side) of the screen 10a, and the wavelength λ2 on the other side in the X-axis direction (+ X side) of the screen 10a. A Y-axis infrared light receiving unit 22Y2 that receives a plurality of infrared rays. The X-axis, Y-axis infrared light receiving elements 36X and 36Y, and the light reception level converting unit 38 of the pointing tool 30 are used for infrared rays having wavelengths λ1 and λ2. The received light intensity is detected. The position detection unit 78 detects the position (coordinates) of the pointing tool 30 relative to the display monitor 10 based on the light reception results of the X-axis and Y-axis infrared light receiving units 22X2 and 22Y2 and the detection result of the pointing tool 30. To do. Thereby, in this embodiment, even if it is a case where a some light shielding location is detected by the matrix system detection unit 20 as shown to Fig.13 (a) and FIG.13 (b), the detection result in the pointing tool 30 is detected. The position (coordinates) of the pointing tool 30 with respect to the display monitor 10 can be accurately detected from among the plurality of detection points. Thereby, it is possible to suppress the drawing of characters or pictures not intended by the user or the recognition of the operation not intended by the user by the PC 80, thereby improving the usability for the user.

  Further, in the present embodiment, the light emission level adjustment control unit 74 causes the light reception results in the X-axis infrared light reception unit 22X2 to be within a predetermined range (≈Px (BL)) and the light reception results in the Y-axis infrared light reception unit 22Y2. Infrared irradiation in the X-axis and Y-axis infrared light emitting units 22X1 and 22Y1 is controlled so that each is within a predetermined range (≈Py (BL)). This makes it possible to easily detect the position (coordinates) of the pointing tool 30 using one type of lookup table 68 (FIGS. 10A and 10B).

  In the present embodiment, the data transfer control unit 42 outputs the received light intensity level value to the communication control unit 44 only when there is a notification from the writing pressure detection sensor 40. Thereby, before or after the pointing device 30 contacts the display monitor 10, an unnecessary line (trailing) is generated on the movement locus of the pointing device 30 by the infrared rays received by the X-axis and Y-axis infrared light receiving elements 36X and 36Y. It is possible to prevent drawing.

In the above-described embodiment, the light emission level adjustment process for each of the light emitting elements D _{x1 to} D _xm and D _{y1 to} D _yn in FIGS. 5A and 5B is performed when the display system 100 is activated. However, it is not limited to this. For example, it may be performed every predetermined time or whenever the light reception results of the light receiving elements T _{x1 to} T _xm and T _{y1 to} T _yn are acquired via the acquisition unit 72. By periodically performing the light emission level adjustment process in this way, a constant light reception intensity level can be obtained in each light receiving element. Further, the feedback control of the light emitting elements can suppress the influence of variation in characteristics of each light emitting element and aging deterioration.

  In the above embodiment, the case where the detection / control device 70 and the PC 80 are separate devices has been described, but the present invention is not limited to this. For example, the functions of the detection / control apparatus 70 described in the above embodiment may be realized by the CPU of the PC 80 executing a program (indicator position detection program). Further, the PC 80 may realize some functions of the detection / control device 70.

  The above processing functions can be realized by a computer. In that case, a program describing the processing contents of the functions that the processing apparatus should have is provided. By executing the program on a computer, the above processing functions are realized on the computer. The program describing the processing contents can be recorded on a computer-readable recording medium.

  When the program is distributed, for example, it is sold in the form of a portable recording medium such as a DVD (Digital Versatile Disc) or a CD-ROM (Compact Disc Read Only Memory) on which the program is recorded. It is also possible to store the program in a storage device of a server computer and transfer the program from the server computer to another computer via a network.

  The computer that executes the program stores, for example, the program recorded on the portable recording medium or the program transferred from the server computer in its own storage device. Then, the computer reads the program from its own storage device and executes processing according to the program. The computer can also read the program directly from the portable recording medium and execute processing according to the program. Further, each time the program is transferred from the server computer, the computer can sequentially execute processing according to the received program.

  The above-described embodiment is an example of a preferred embodiment of the present invention. However, the present invention is not limited to this, and various modifications can be made without departing from the scope of the present invention.

In addition, the following additional notes are disclosed regarding the above description.
(Supplementary Note 1) A plurality of lights having a first wavelength are emitted from one side of the display surface of the display device in the first direction toward the first direction, and the second direction intersects the first direction of the display surface. An irradiation unit for irradiating a plurality of lights having a second wavelength different from the first wavelength in the second direction from the side;
A light receiving unit that receives a plurality of lights having the first wavelength on the other side in the first direction of the display surface and receives a plurality of lights having the second wavelength on the other side in the second direction of the display surface. When,
A light-receiving intensity detector that is provided on the indicator and receives the light of the first wavelength and the light of the second wavelength and detects the light-receiving intensity of each light;
An indicator position detection device comprising: a position detection unit that detects a position of the indicator relative to the display device based on a light reception result of the light receiving unit and a detection result of the light reception intensity detection unit.
(Supplementary Note 2) When there are a plurality of position candidates of the pointing tool detected from the light reception result of the light receiving unit, the position detection unit, based on the detection result of the light reception intensity detection unit, The indicator position detecting device according to appendix 1, wherein one of the indicators is selected as the position of the indicator.
(Supplementary Note 3) Each of the light receiving results of the plurality of lights having the first wavelength in the light receiving unit has a value within a predetermined range, and each of the light receiving results of the plurality of lights having the second wavelength in the light receiving unit has a predetermined range. The pointing device position detection apparatus according to appendix 1 or 2, further comprising a control unit that controls irradiation by the irradiation unit so as to have a value of.
(Additional remark 4) The light reception result which received the some light of the 1st wavelength irradiated to the said 1st direction from the 1st direction one side of the display surface of a display apparatus on the said 1st direction other side of the said display surface, and the said display A light receiving result obtained by receiving a plurality of lights having a second wavelength irradiated in the second direction from one side in the second direction intersecting the first direction of the surface on the other side in the second direction of the display surface;
Obtaining the received light intensity of each light when receiving the light of the first wavelength and the light of the second wavelength in the indicator,
A pointing tool position detection program for causing a computer to execute a process of detecting the position of the pointing tool with respect to the display device based on the light reception result and the acquisition result of the light reception intensity.
(Additional remark 5) In the process which detects the position of the said indicator, when there exist multiple position candidates of the said indicator detected from the said light reception result, based on the acquisition result of the said light reception intensity, these several position candidates The indicator position detection program according to appendix 4, wherein one of the indicators is selected as the position of the indicator.
(Supplementary Note 6) Each of the light reception results of the plurality of lights having the first wavelength has a value in a predetermined range, and each of the light reception results of the plurality of lights of the second wavelength has a value in the predetermined range. 6. The pointing tool position detection program according to appendix 4 or 5, further causing the computer to execute processing for controlling irradiation of light having a wavelength.

10 Display monitor (display device)
10a screen (display surface)
20 Matrix type detection unit (part of pointing device position detection device)
22X1 X-axis infrared light emitter (irradiator)
22Y1 Y-axis infrared light emitter (irradiator)
22X2 X-axis infrared receiver (receiver)
22Y2 Y-axis infrared receiver (receiver)
30 Pointer (part of the pointer position detector)
36X X-axis infrared light receiving element (part of received light intensity detector)
36Y Y-axis infrared light receiving element (part of received light intensity detector)
38 Received light level converter (part of received light intensity detector)
70 Detection / control device (part of pointing device position detection device)
78 Position detector

Claims (4)

From the first direction side of the display surface of the display device, a plurality of lights having the first wavelength are emitted toward the first direction, and from the second direction side intersecting the first direction of the display surface, An irradiation unit configured to irradiate a plurality of lights having a second wavelength different from the one wavelength in the second direction;
A light receiving unit that receives a plurality of lights having the first wavelength on the other side in the first direction of the display surface and receives a plurality of lights having the second wavelength on the other side in the second direction of the display surface. When,
A light-receiving intensity detector that is provided on the indicator and receives the light of the first wavelength and the light of the second wavelength and detects the light-receiving intensity of each light;
An indicator position detection device comprising: a position detection unit that detects a position of the indicator relative to the display device based on a light reception result of the light receiving unit and a detection result of the light reception intensity detection unit.   When there are a plurality of position candidates of the pointing tool detected from the light reception result of the light receiving unit, the position detection unit selects one of the plurality of position candidates based on the detection result of the light reception intensity detection unit. 2. The pointing device position detection device according to claim 1, wherein the pointing device position is selected and set as the position of the pointing device.   Each of the light receiving results of the plurality of lights having the first wavelength in the light receiving unit has a value within a predetermined range, and each of the light reception results of the plurality of lights having the second wavelength in the light receiving unit has a value in the predetermined range. As described above, the pointing device position detection apparatus according to claim 1, further comprising a control unit that controls irradiation by the irradiation unit. A light reception result of receiving a plurality of lights having a first wavelength irradiated in the first direction from the first direction side of the display surface of the display device on the other side in the first direction of the display surface, and a first of the display surface A light reception result obtained by receiving a plurality of lights having a second wavelength irradiated in the second direction from one side in the second direction intersecting the direction on the other side in the second direction of the display surface, and
Obtaining the received light intensity of each light when receiving the light of the first wavelength and the light of the second wavelength in the indicator,
A pointing tool position detection program for causing a computer to execute a process of detecting the position of the pointing tool with respect to the display device based on the light reception result and the acquisition result of the light reception intensity.

Images