CN101452349B - Cursor control device, method and image system on image display device - Google Patents

Abstract

A cursor control device on an image display device comprises a first sensing device, a second sensing device and a switching device. The first sensing device detects a first movement amount of the cursor control device relative to the surface, and calculates a first coordinate change of a cursor on the image display device according to the first movement amount; the second sensing device senses an object, detects a second movement amount of the cursor control device relative to the object, and calculates a second coordinate change of the cursor on the image display device according to the second movement amount; the switching device selects to output the first coordinate change or selects to output the second coordinate change. The invention also provides a cursor control method on the image display device and an image system.

Description

Cursor control device, method and image system on image display device

technical field

The invention relates to a cursor control device, method and video system on an image display device. The invention realizes cursor control on the image display device in two ways by using a switching mechanism.

Background technique

Existing image display devices, such as computer screens, can use optical navigation sensors, such as a mouse, to judge the optical navigation sensor according to the images captured at different times and compare the correlation of the images captured at different times. Manipulate the displacement of the sensor on the plane, thereby relatively controlling the movement of the cursor on the image display device. If the user wants to execute such as a gun shooting game on the image display device, he must additionally purchase a cursor positioning device, such as a "photographic pointer device" disclosed in Taiwan Patent No. 267754, which is provided with a control circuit, so The control circuit is respectively connected with a video camera, a computing unit and a communication interface; the communication interface is connected to the host computer, a filter is arranged in front of the video camera, and a display screen for the video camera is provided on the display screen of the image display device. A plurality of light-emitting elements; when the user uses the photographic indicator device to carry out the program executed by the host, the camera can be used to take pictures of the display screen, and because the camera is equipped with a filter, the light-emitting elements can be Light sources other than the emitted light source wavelength are filtered out, so only the light source of the light-emitting element appears in the picture captured by the camera, and then the calculation unit is used to calculate the coordinate value of the camera's aiming point in the picture, and It is sent to the host, so that the host can use the coordinates to control the cursor of the image display device.

However, in actual use, the additional installation of the indicator device will not only increase the cost, but also the problem that the indicator device needs to be packed when not in use. Based on the above reasons, it is indeed still necessary to further improve the above-mentioned cursor control device and method of the existing image display device, so as to increase the practicability of the image display device.

Contents of the invention

An object of the present invention is to provide a cursor control device and a cursor control method on an image display device. The device and method can control the cursor on the image display device in two ways through a switching mechanism, thereby Increase the practicability of the image display device.

Another object of the present invention is to provide an imaging system that combines the two control methods into one cursor control device, thereby simplifying the system architecture and reducing the cost.

In order to achieve the above object, the present invention provides a cursor control device on an image display device, the device includes a first sensing device, a second sensing device and a switching device. The first sensing device is used to detect a first movement amount of the cursor control device relative to the surface, and calculate a first coordinate change of the cursor on the image display device according to the first movement amount; the first The second sensing device is used to sense an object, and detect a second movement amount of the cursor control device relative to the object, and calculate a second coordinate change of the cursor on the image display device according to the second movement amount ; The switching device is used to select to output the first coordinate change or select to output the second coordinate change.

According to another feature of the present invention, the present invention also provides an image system, which includes an image display device, at least one object, a cursor control device, and a coordinate processor. The image display device has a screen for displaying image frames, and a cursor is displayed on the image frames. The cursor control device includes a first sensing device for detecting a first movement amount of the cursor control device relative to the surface, and calculating a first coordinate change of the cursor according to the first movement amount; a second sensing device A detection device for sensing the object and detecting a second movement amount of the cursor control device relative to the object, and calculating a second coordinate change of the cursor according to the second movement amount; a switching device for Selecting to output the first coordinate change or selecting to output the second coordinate change; and a transmission interface unit for transmitting the first or second coordinate change selected and output by the switching device. The coordinate processor is used to receive the first or second coordinate change transmitted by the transmission interface unit, and combine the first or second coordinate change with the coordinate of the cursor on the image display device, so that the cursor control device The movement of the cursor on the screen can be controlled relatively.

According to another feature of the present invention, the present invention also provides a cursor control method on an image display device, the method includes the following steps: providing a cursor control device, the cursor control device has a first sensing device and a second sensing device detection device; detect the first movement amount of the cursor control device relative to the surface through the first sensing device, and calculate the first coordinate change of the cursor on the image display device according to the first movement amount; through the The second sensing device senses an object, and detects a second movement amount of the cursor control device relative to the object, and calculates a second coordinate change of the cursor on the image display device according to the second movement amount; and A decision is made to output the first coordinate change or to output the second coordinate change.

According to another feature of the present invention, the present invention also provides a cursor control method on an image display device, the method includes the following steps: providing a cursor control device, the cursor control device has a first sensing device and a second sensing device measuring device; detect the first movement amount of the cursor control device relative to the surface through the first sensing device, and calculate the first coordinate change of the cursor on the image display device according to the first movement amount; determine whether outputting the first coordinate change, if yes, selecting to output the first coordinate change; and sensing an object by the second sensing device and detecting a second movement amount of the cursor control device relative to the object, calculating a second coordinate change of the cursor on the image display device according to the second movement amount, and selecting and outputting the second coordinate change.

The cursor control device and cursor control method on the image display device of the present invention can be applied to the cursor control on various image display devices, for example: the cursor control on the computer screen, the game machine screen or the projection screen, the user can use two kinds of control One of the methods controls the image display device, thereby effectively improving the practicability of the image display device.

Description of drawings

FIG. 1a is a schematic diagram of an imaging system according to an embodiment of the present invention;

FIG. 1b is another schematic diagram of an imaging system according to an embodiment of the present invention;

2 is a schematic diagram of a cursor control device according to a first embodiment of the present invention;

3 is a block diagram of a cursor control device according to a first embodiment of the present invention;

4 is a flowchart of a cursor control method according to the first embodiment of the present invention;

5a is a schematic diagram of image pixels of a first frame sensed by a first sensor of the cursor control device according to an embodiment of the present invention;

5b is a schematic diagram of image pixels of a second frame sensed by the first sensor of the cursor control device according to an embodiment of the present invention;

6 is a flow chart of calculating a second coordinate change by the second sensor of the cursor control device according to an embodiment of the present invention;

7a is a schematic diagram of an image of an object sensed by a second sensor of the cursor control device according to an embodiment of the present invention;

7b is another schematic diagram of an image of an object sensed by the second sensor of the cursor control device according to an embodiment of the present invention, wherein the second sensor is rotated by an angle of θ during operation;

8 is a schematic diagram of images of objects sensed by the second sensor of the cursor control device according to an embodiment of the present invention at different distances from the object;

9 is a schematic diagram of images of objects sensed when the second sensor of the cursor control device points to different positions according to an embodiment of the present invention;

10 is a block diagram of a cursor control device according to a second embodiment of the present invention;

FIG. 11 is a flowchart of a cursor control method according to a second embodiment of the present invention;

FIG. 12 shows that the image brightness of the one-dimensional sensing array of the first sensor of the cursor control device according to the embodiment of the present invention has fluctuations;

13 is a schematic diagram of a cursor control device according to another embodiment of the present invention;

FIG. 14 is a schematic diagram of a cursor control device according to another embodiment of the present invention.

Description of main component symbols

1 Image system 2 Image display device

20 screen 21 cursor

22, 24, 26 objects 3 cursor control device

300 shell 30 first sensing device

302 light source 304 first sensor

306 first processing unit 308 lens

31 second sensing device 312 filter

314 second sensor 316 second processing unit

318 lens 32 switching device

33 storage unit 34 transmission interface unit

35 processing units 37 rolling balls

810 first picture frame 820 second picture frame

1000～7100 steps v _i , u _j pixels

A Sensible Range S Surface

L, distance between 1 object image ΔS image position change

i ₂₂ , i ₂₄ object image coordinates U ₁ , peak on U ₂

D ₁ , D ₂ lower peak M, m edge pixels

D, the distance between the average coordinates of the d object image and the center point of the sensing array

，I₂₄   物件影像I ₂₂ , I ₂₄ , I ₂₂ ′, I ₂₄ ′, I ₂₂ ″, I ₂₄ ″, I ₂₂

, I ₂₄ object image

(X ₀ , Y ₀ ), (X, Y) object image center coordinates

Detailed ways

In order to make the above and other objects, features and advantages of the present invention more apparent, the following specifically lists the embodiments of the present invention, together with the accompanying drawings, for a detailed description. In addition, in the description of this specification, similar components are denoted by the same reference numerals.

Please refer to FIG. 1a and FIG. 1b . FIG. 1a and FIG. 1b show an image system 1 according to an embodiment of the present invention, the system has an image display device 2 and a cursor control device 3 . Embodiments of the image display device 2 include computer screens, game machine screens, projection screens and any other devices for displaying images; relative to the image display device 2, embodiments of the cursor control device 3 include a mouse devices and game control devices, etc., and the cursor control device 3 can be placed on the surface S to move, such as a mouse pad, a desktop, etc., as shown in Figure 1a, so as to relatively control the movement of the cursor on the image display device 2; in addition , the cursor control device 3 can also be held by a user (not shown), as shown in FIG. 1 b , so as to position and control the cursor 21 on the image display device 2 . The cursor control device 3 can be connected to the image display device 2 in a wired or wireless manner.

The image display device 2 has a screen 20 for displaying image images. The screen 20 preferably has a cursor 21. The cursor 21 allows the user to control the setting or display status of the image display device 2, for example, through Application software (software) such as a user interface or a game interface controls the display setting or game setting and operation of the image display device 2 . Through the optional coordinate processor (not shown) built in the image display device 2, the coordinate change of the cursor 21 calculated by the cursor control device 3 is combined with the coordinates of the cursor 21 and displayed on the on the screen, thereby relatively controlling the movement of the cursor 21 . A reference object 26 is provided near the screen 20 of the image display device 2, and the reference object 26 can be a light source, such as a light source composed of at least one light-emitting diode; although in this embodiment, the object 26 is It is shown as a circle, but it is only one embodiment, and the object 26 can also be in other different shapes; in another embodiment, the screen 20 of the image display device 2 can display a reference object 22, 24. The reference object may be a graphic of a specific shape that is continuously displayed on the screen 20 and does not affect the display of the screen, for example, two star-shaped objects 22 and 24 are displayed at the corners of the screen in the figure, In other embodiments, it can also be displayed in other arbitrary shapes or in other positions. In other embodiments, the object 26 can also be selectively disposed near the image display device 2 instead of being combined thereon. The objects 22 , 24 and 26 serve as reference points for positioning and controlling the cursor 21 , and the details will be described in the following paragraphs.

Please refer to FIG. 2 and FIG. 3. FIG. 2 and FIG. 3 respectively show a schematic diagram and a block diagram of a cursor control device 3 according to a first embodiment of the present invention. The cursor control device 3 includes a housing 300, and the housing The body 300 is provided with a first sensing device 30, a second sensing device 31, a switching device 32, a storage unit 33 and a transmission interface unit 34. The first sensing device 30 is used to detect the first movement amount of the cursor control device 3 relative to the surface S, and calculate the first coordinate change of the cursor 21 according to the first movement amount. The measurement device transmits to the coordinate processor in a wireless or wired manner through the transmission interface unit 34 and combines the coordinates of the cursor 21 on the screen 20 to relatively control the display and setting of the image display device 2; the second The second sensing device 31 is used to sense the object 26 or the objects 22, 24, and detect the second movement amount of the cursor control device 3 relative to the object 22, 24 or 26, and calculate according to the second movement amount The second coordinate change of the cursor 21 is also transmitted to the coordinate processor in a wireless or wired manner through the transmission interface unit 34 and combined with the coordinates of the cursor 21 on the screen 20, thereby relatively controlling the display of the image display device 2 and setting; wherein various parameters in the process of calculating the first coordinate change and the second coordinate change and the first coordinate and the second coordinate change can be temporarily stored in the storage unit 33 . The switching device 32 is used to switch between the first sensing device 30 and the second sensing device 31, and the switching device 32 can enable the user to choose to use the first sensing device 30 and the second sensing device 31. One of the second sensing devices 31 controls the display and setting of the image display device 2; the embodiment of the switching device 32 includes a button switch, a mercury switch, an acceleration sensor (G-sensor), a light sensor switch, a resistor Pressure sensitive switches, capacitive pressure sensitive switches and other switching devices that can be used to select one of the two.

Please refer to FIG. 2, FIG. 3 and FIG. 4. FIG. 4 shows a flowchart of a cursor control method on an image display device 2 according to an embodiment of the present invention. The cursor control method includes the following steps: through the first The sensing device 31 detects the first movement amount of the cursor control device 3 relative to the surface S, and calculates the first coordinate change of the cursor 21 on the image display device 2 according to the first movement amount; Coordinate change, if so, choose to output the first coordinate change; and sense the object 22, 24 or 26 through the second sensing device 30, and detect the cursor control device 3 relative to the object 22, 24 or a second movement amount of 26, calculate the second coordinate change of the cursor 21 on the image display device 2 according to the second movement amount, and select to output the second coordinate change; wherein, it is judged whether to output the first coordinate A variant implementation can be realized by judging whether the switching device 32 is triggered. For example, the switching device 32 is a pressure switch, when the cursor control device 3 leaves the surface S and triggers the pressure switch, then it is judged to output the second coordinate change; otherwise, when the cursor control device 3 does not leave the surface S , then judge and output the first coordinate change. However, this is only an implementation manner, and is not intended to limit the present invention.

Please refer to FIG. 2 and FIG. 3 again. In the first embodiment, the first sensing device 30 includes a light source 302 , a first sensor 304 , a first processing unit 306 and a lens 308 . The light source 302 illuminates the surface S through the hole below the housing 300. Embodiments of the light source 302 include light-emitting diodes and laser diodes, such as infrared light-emitting diodes or infrared laser diodes. Embodiments of the first sensor 304 include a charge coupled device image sensor (CCD image sensor), a complementary metal oxide semiconductor image sensor (CMOS image sensor) and any other image sensor, the The first sensor 304 is used to continuously capture at least two frames of the first image reflected by the surface S; the first processing unit 306 calculates according to the image change of the first image between frames The first movement amount of the cursor control device 3 relative to the surface S, and calculate the first coordinate change of the cursor 21 according to the first movement amount; the lens 308 is arranged in front of the first sensor 304 for The light-sensing efficiency of the first sensor 304 is increased, but when the light-sensing efficiency of the first sensor 304 is sufficient, the lens 308 is not necessarily provided.

Referring to FIG. 2 , FIG. 3 , FIG. 5a and FIG. 5b , an implementation manner for calculating the first moving amount is given below. First, the first sensor 304 is used to capture the first frame 810 and the second frame 820 of the surface S, the first frame 810 has a plurality of image pixels u ₁ , u ₂ , . . . , _ur , u _r+1 ,..., u _r×s , each pixel is u _i , where i=1 to r×s, the image pixels at least include coordinate information and intensity information, as shown in Figure 5a; the second Frame 820 has a plurality of image pixels v ₁ , v ₂ , ..., v _m , v _m+1 , ..., v _m×n , and each pixel is v _j , where j=1 to m×n, so The image pixels at least include coordinate information and intensity information, as shown in FIG. 5b. The motion estimation device (such as the first processing unit 306) determines the action of the second frame 820 relative to the first frame 810, and the motion estimation device calculates the first frame 810 and the second The maximum value of the probability density function (probability density function) between the frame 820 is used to determine the action parameter, and the action parameter is the maximum value obtained according to the conditional probability (conditional probability) function in Bayes' theorem (Bayes' theorem), As a relative motion of the second image frame 820 relative to the first image frame 810 . For details, please refer to the applicant's commonly-owned US Patent Application No. 11/420715, entitled "Apparatus and Method for Estimating Relative Motion Using Maximum Probability". It must be noted that the calculation method mentioned above is only an embodiment, and is not intended to limit the present invention. Any device that can be used to calculate the relative movement of the control device 3 on the surface S does not depart from the present invention. In spirit, the embodiment of the first sensing device 30 includes an optical mouse, an optical navigation sensor, and the like.

Please refer to Fig. 1a, Fig. 1b, Fig. 2 and Fig. 3, the second sensing device 31 of the first embodiment includes a filter 312, a second sensor 314, a second processing unit 316 and a lens 318. Examples of the second sensor 314 include CCD image sensors, CMOS image sensors and any other image sensors, the second sensor 314 is used to sense the object 22, 24 or 26 and continuously capture at least two frames of the image of the object; the second processing unit 316 calculates the change of the image of the object between the frames, so as to calculate the position of the cursor control device relative to the object 22, 24 or 26 of the second movement amount, and calculate the second coordinate change of the cursor 21 according to the second movement amount. The optical filter 312 is used to filter out the spectrum other than the preset spectrum. An embodiment of the optical filter 312 can be an infrared filter (IR filter), and the preset spectrum can be an infrared spectrum, for example, to The second sensor 314 only receives the light signal from the object 22 , 24 or 26 , thereby simplifying the image recognition process. The lens 318 is arranged in front of the second sensor 314 to increase the light-sensing efficiency of the second sensor 314, but when the light-sensing efficiency of the second sensor 314 is sufficient, it does not The lens 318 must be provided. In addition, it can be understood that, in order for the second sensor 314 to sense the light signal from the object 22 , 24 or 26 , the front portion of the casing 300 is preferably made of a light-transmitting material.

Please refer to Fig. 1b, Fig. 2, Fig. 3 and Fig. 6 to Fig. 9, an implementation manner for calculating the second coordinate change is listed below, the method includes the following steps: providing at least two object to generate a preset spectrum, and define a preset range (step 1000); provide a sensor to point to the preset range (step 2000); use the sensor to receive the preset spectrum to form a digital image (step 3000); determine the imaging position and shape of the object on the digital image, and generate a first parameter (step 4000); perform distance and angle compensation for the first parameter (step 5000); in the moving the pointing position of the sensor within a preset range, and generating a second parameter (step 6000); and calculating the object on the digital image according to the compensated first parameter and the second parameter The moving distance of the imaging position is changed relative to the coordinates of the calculation cursor (step 7000); wherein, in step 7000, distance and angle compensation are performed on the second parameter at the same time (step 7100).

The cursor control device 3 is preferably pre-set with preset imaging position parameters and preset imaging distance parameters in the storage unit 33 before leaving the factory. The parameters can be the sensor (such as the second sensor) The preset parameters obtained by capturing the preset object images I ₂₂ and I 24 of the objects 22, 24 when the preset distance (for example, 3 meters) from the objects 22, ₂₄ is obtained by the detector 314), as shown in FIG. 7a As shown, thus as a reference for subsequent distance and angle compensation, the set preset imaging position parameter and preset imaging distance parameter can be represented in the plane space formed by the sensing array of the second sensor 314 In the coordinate system, for example, the center “+” of the sensing array is set as the plane coordinate system formed by the origin, and the sensing array is represented by a 7×7 pixel array here. For example: the preset imaging position parameter may be the center coordinates (X ₀ , Y ₀ ) of the preset images I ₂₂ and I ₂₄ formed by the objects 22 and 24 in the plane space coordinate system; The imaging distance parameter can be the distance L between the preset images I ₂₂ and I 24 formed by the objects 22 and ₂₄ and the distance D between the centers of the images I ₂₂ and I ₂₄ and the center point “+”.

First, it is assumed that the objects 22 and 24 generate preset spectral signals, for example, in this embodiment, the preset spectral signals are infrared light spectral signals, and it is assumed that the area of the object 22 is larger than the area of the object 24, so According to the viewing angle range of the second sensor 314 and the light-emitting angle of the objects 22, 24, the detectable range "A" can be determined around the objects 22, 24 (step 1000); then, the The second sensor 314 of the cursor control device 3 points to any place within the detectable range "A" (step 2000), since the second sensor 314 used in the present invention is provided with a filter device 312, so only digital images of the objects 22, 24 are formed on the sensing array of the second sensor 314 (step 3000), as shown in FIG. 7a I ₂₂ ′ and I ₂₄ ′, and in this In the embodiment, it is assumed that when the cursor control device 3 is used to capture the digital image, the cursor control device 3 is rotated by an angle θ along the arrow direction (clockwise direction) shown in FIG. ₂₂ ′ and I ₂₄ ′ and the object images I ₂₂ and I ₂₄ captured by the second sensor 314 at the aforementioned preset distance will have relative deviations in the θ rotation angle, thus causing the object images I ₂₂ ′ and The center coordinates (X, Y) of I ₂₄ ′ and the center coordinates (X ₀ , Y ₀ ) of the preset object images I ₂₂ and I ₂₄ are images taken when the second sensor 314 points to the same position , but with different coordinates.

After the digital image signal is sent to the second processing unit 316, the second processing unit 316 determines the position and shape of the object images I ₂₂ ′ and I ₂₄ ′, and generates the first imaging position parameters, A first imaging distance parameter and an imaging shape parameter (step 4000). The second processing unit 316 is based on the first imaging position parameter (such as the center coordinates of the object images I ₂₂ ′ and I ₂₄ ′ and the inclination angle of their connecting line) and the preset imaging position parameter (such as The angular deviation θ between the preset object images I ₂₂ and I ₂₄ and the inclination angle of their connecting lines) is subjected to angle compensation (step 5000), and the compensation method is realized by formula (1):

$\left[\begin{array}{c}{\mathrm{<span\; class="notranslate">\; x</span>}}^{<span\; class="notranslate">\; \&prime;</span>}\\ {\mathrm{<span\; class="notranslate">\; Y</span>}}^{<span\; class="notranslate">\; \&prime;</span>}\end{array}\right]<span\; class="notranslate">\; =</span>\left[\begin{array}{cc}\mathrm{<span\; class="notranslate">\; cos</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; \&theta;</span>}<span\; class="notranslate">\; )</span>& <span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; sin</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; \&theta;</span>}<span\; class="notranslate">\; )</span>\\ \mathrm{<span\; class="notranslate">\; sin</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; \&theta;</span>}<span\; class="notranslate">\; )</span>& \mathrm{<span\; class="notranslate">\; cos</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; \&theta;</span>}<span\; class="notranslate">\; )</span>\end{array}\right]\left[\begin{array}{c}\mathrm{<span\; class="notranslate">\; x</span>}\\ \mathrm{<span\; class="notranslate">\; Y</span>}\end{array}\right]<span\; class="notranslate">\; -</span><span\; class="notranslate">\; -</span><span\; class="notranslate">\; -</span><span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; 1</span>}<span\; class="notranslate">\; )</span>$

Wherein, θ represents the rotation angle deviation between the first imaging position parameter and the preset imaging position parameter, X, Y represent the center coordinates of the first imaging position parameter before angle compensation, and X′, Y′ (not shown Shown) represent the center coordinates of the imaging position parameters of the object after compensation. Therefore, the image formed by the object 22, 24 after compensation is the position obtained under the same reference, that is, when the user takes a picture at the same distance from the object 22, 24, the second image sense The same result can be obtained when the detector 314 is operated at any angle of rotation.

However, if the deviation angle θ is greater than 180 degrees to form object images I _{22 ″} and I _{24 ″} , as shown in FIG. ), it will not be possible to determine that the object images I ₂₂ ″ and I ₂₄ ″ are formed by rotating the object images I ₂₂ ′ and I ₂₄ ′ ( FIG. 7 a ), or are formed by the object images I ₂₂ ′ and I ₂₄ ' formed by the translation. Therefore, the present invention uses two objects 22, 24 with different areas, and first recognizes the images formed by the objects 22, 24 according to the imaging shape parameters obtained by the second processing unit 316 (such as the area size of the object images). each position, and then perform angle compensation. Therefore, even if the rotation angle of the second image sensor 314 exceeds 180 degrees, the calculation of the second coordinate change of the cursor 21 can still be performed correctly.

Please refer to FIG. 8 , which shows the way of distance compensation in this embodiment. When using the second image sensor 314 of the cursor control device 3 to capture the images of the objects 22 and 24, if the distance between the cursor control device 3 and the objects 22 and 24 gradually increases, The images acquired by the second image sensor 314 will gradually become smaller, and the center coordinates between the images will be closer to the center “+” of the image sensing array, but this deviation does not mean that the user has changed The pointing position of the cursor control device 3, so when calculating the center coordinates (X, Y) of the imaging of the objects 22 and 24, a misjudgment will be formed. If it is not corrected, it may be misjudged due to the change of the imaging distance. It is judged as the case of horizontal movement. In this embodiment, assuming that the preset imaging distance parameter is L, the distance between the imaging center coordinates (X ₀ , Y ₀ ) and the center “+” of the sensing array is D; the first imaging distance parameter is 1, the distance between the center coordinates of the imaging and the center "+" of the sensing array is d, so the proportional relationship of the following formula (2) can be used to compensate the deviation caused by the difference in the imaging distance (step 5000):

$\frac{\mathrm{<span\; class="notranslate">\; D.</span>}}{\mathrm{<span\; class="notranslate">\; L</span>}}<span\; class="notranslate">\; =</span>\frac{\mathrm{<span\; class="notranslate">\; d</span>}}{\mathrm{<span\; class="notranslate">\; l</span>}}<span\; class="notranslate">\; -</span><span\; class="notranslate">\; -</span><span\; class="notranslate">\; -</span><span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; 2</span>}<span\; class="notranslate">\; )</span>$

Please refer to FIG. 9 , assuming that the imaging position of the object is i ₂₂ and i ₂₄ after compensation, and the i ₂₂ and i ₂₄ are parameters obtained under a preset benchmark, then the sensory Move the pointing position of the cursor control device 3 within the range "A" (step 6000), at this time, the second image sensor 314 continues to transmit the digital image signal sensed by it to the second processing unit 316, the second processing unit 316 generates a second parameter according to the digital image signal, and the parameter includes the first position of the object 22, 24 on the digital image after moving the pointing position of the second sensor 314 The second imaging position parameter and the second imaging distance parameter. The second imaging position parameter can be represented on the plane space formed by the sensing array of the second sensor 314, for example, the plane space formed with the center of the sensing array as the origin, the image formed by the object Center coordinates; the second imaging distance parameter may be the distance between images formed by the object in the plane space formed by the second sensor 314 . The second processing unit 316 continuously calculates the moving distance ΔS (second moving amount) of the object images _i22 and _i24 according to the compensated first imaging position parameter and the second parameter, and the calculated At the same time, the above-mentioned compensation method must be used to continuously compensate the angle and distance deviation for the second parameter (step 7100), so as to obtain the correct cursor coordinate change. Since the compensation method of the second parameter is the same as that of the first parameter, here No longer. For details on calculating the second coordinate change, please refer to Taiwan Patent Application No. 095149408, titled "Cursor Control Method and Device Using the Method", co-owned by the applicant. It must be noted that the calculation method mentioned above is only an implementation mode, and is not intended to limit the present invention. Any method for calculating and obtaining the second coordinate change of the cursor control device 3 does not depart from the present invention. the spirit of.

Please refer to FIG. 10, which shows a block diagram of a cursor control device 3 according to a second embodiment of the present invention, the cursor control device 3 includes a first sensing device 30, a second sensing device 31, a switching device 32 . A storage unit 33 , a transmission interface unit 34 and a processing unit 35 . The difference between the second embodiment and the first embodiment is that in the second embodiment, the user chooses to use one of the first sensing device 30 and the second sensing device 31 to control the image display device 2 The method of the cursor 21 is that the processing unit 35 first passes through the image analysis, and then controls the switching device 32 to select one of the first sensing device 30 and the second sensing device 31. A change of the first or second coordinate of the output cursor 21 .

Please refer to FIG. 11 . FIG. 11 shows the cursor control method of the image display device 2 according to this embodiment. The method includes the following steps: detecting that the cursor control device 3 is relatively The first movement amount on the surface S, and calculate the first coordinate change of the cursor 21 on the image display device 2 according to the first movement amount; sense the objects 22, 24 or 26, and detect the second movement amount of the cursor control device 3 relative to the object 22, 24 or 26, and calculate the second coordinate change of the cursor 21 on the image display device 2 according to the second movement amount ; and determining to output the first coordinate change or output the second coordinate change; one of the ways to determine to output the first coordinate change or to output the second coordinate change is by means of image analysis, For example, when the second sensing device 31 senses the image of the object 22, 24 or 26, the processing unit 35 controls the switching device 32 to select the second sensing device 31 to output the cursor 21. The second coordinate changes. In addition, the first sensing device 30 also includes a light source 302 , a first sensor 304 and a lens 308 ; the second sensing device 31 also includes a filter 312 , a second sensor 314 and a lens 318 .

Please refer to FIG. 10 and FIG. 12. FIG. 10 and FIG. 12 show a method for the processing unit 35 in this embodiment to analyze the image quality sensed by the first sensor 304. The figure shows The image brightness of the one-dimensional sensing array of the first sensor 304 has fluctuations, that is, there is at least one brightness peak in the image brightness. The quality of the one-dimensional image can be determined by the crest of the brightness of the image, where the crest is defined as follows:

Upper peak: when there is a pixel in the one-dimensional pixel of the video image, the brightness of the pixels on both sides is smaller than the brightness of this pixel to a certain extent, then it is judged that the brightness of this pixel is an upper peak, such as U1 shown in Figure 12, U2.

Lower peak: when there is a pixel in the one-dimensional pixel of the video screen, the brightness of the pixels on both sides is greater than the brightness of this pixel to a certain extent, then it is judged that the brightness of this pixel is a lower peak, such as D1 shown in Figure 12, D2.

In the one-dimensional pixels of the image screen, even if the brightness of the edge pixels is the maximum value, such as M shown in Figure 12, it will not be judged as an upper peak; even if the brightness of the edge pixels is the minimum value, such as in Figure 12 The m shown is also not judged as the lower peak. The number of upper peaks or the number of lower peaks can be regarded as the number of peaks of a one-dimensional pixel. When the number of peaks of a one-dimensional pixel is greater than the critical number of peaks, it is defined that the number of peaks of a one-dimensional pixel meets the requirements. It can be understood that the critical peak The number varies with different sensing array sizes.

After the optical mouse (such as the first sensor 304) reads a two-dimensional image, the number of peaks of a two-dimensional image has been calculated. Whether the number of peaks of a two-dimensional image frame meets the requirements depends on the use requirements. If at least one row of pixels or one column of pixels meets the requirements, or each row of pixels meets the requirements, or each column of pixels meets the requirements, then it is judged that this two-dimensional image meets the requirements and is a good image; otherwise, it is judged that this two-dimensional The video frame does not meet the requirements, it is a bad frame. When the processing unit 35 judges that the image sensed by the first sensor 304 is a good picture, it controls the switching device 32 to select the first sensor 304 to output the first coordinate change of the cursor 21; When it is judged that the image sensed by the first sensor 304 is a bad picture, the switching device 32 is controlled to select the second sensor 314 to output the second coordinate change of the cursor 21. For details on judging the image quality sensed by the first sensor 304, please refer to Taiwan Patent No. 526662, titled "A Method for Immediately Judging Image Quality", which is jointly owned by the applicant. It must be noted that the above-mentioned judging method is only an implementation manner, and is not intended to limit the present invention. Any method used to analyze the state of the image sensed by the first sensor 304 and make the processing unit 35 The way of controlling the switching device 32 to select and output the first coordinate change or the second coordinate change according to the image analysis result does not deviate from the spirit of the present invention.

Please refer to FIG. 13 . FIG. 13 shows an image control device 3 according to another embodiment of the present invention, wherein the first sensing device 30 is a wheel mouse, which is used to detect the relative position of the image control device 3 . The first movement amount of the surface S, and calculate the first coordinate change of the cursor 21 according to the first movement amount. The roller mouse is provided with a roller ball 37 on the lower inner side of the housing 300, and rollers (not shown) are respectively arranged at the positions of the X-axis and the Y-axis beside the roller ball 37. When moving on the surface S, the rolling ball 37 is rolled to drive the two rollers to produce a two-dimensional axial relative rotation, thereby generating a two-dimensional coordinate position signal, thereby generating a first coordinate change to relatively control the movement of the cursor 21 on the screen 20 . In addition, the housing 300 is also provided with the second sensing device 31, the second sensing device 31 includes a filter 312, a second sensor 314 and a lens 318, the functions of the components and The actions are similar to those described in the above paragraphs, and will not be repeated here.

Please refer to FIG. 14 . FIG. 14 shows an image control device 3 according to another embodiment of the present invention, wherein the first sensing device 30 is another wheel type mouse for detecting the image control The first movement amount of the device 3 relative to the surface S, and calculate the first coordinate change of the cursor 21 according to the first movement amount. The first sensing device 30 includes a light source 302, a rolling ball 37, a first sensor 304 and a lens 308, wherein the light source 302 can be a laser diode; the image control device 3 utilizes the light emitted by the light source 302 The spherical surface of the rolling ball 37 is irradiated, and the first sensor 304 senses the laser reflected from the spherical surface of the rolling ball 37. When the rolling ball moves, the first sensor 304 can sense the reflection The laser interference image is analyzed to determine the relative movement direction and distance between the spherical surface of the rolling ball 37 and the surface S to obtain the first coordinate change. In addition, the housing 300 is also provided with the second sensing device 31, the second sensing device 31 includes a filter 312, a second sensor 314 and a lens 318, the functions and actions of the components are the same as The descriptions in the above paragraphs are similar and will not be repeated here.

To sum up, because the existing image display device has to purchase additional cursor positioning device when playing a shooting game, for example, it has the problems of increasing cost and system complexity. Using the cursor control device on the image display device of the present invention (as shown in Figure 1a and Figure 1b), the device can use two modes to control the display and setting of the image display device by using the switching mechanism, and the user does not need to purchase another one. A set of systems can achieve the effect of simplifying the system and reducing costs.

Although the present invention has been disclosed by the foregoing preferred embodiments, the embodiments are not intended to limit the present invention, and any person skilled in the technical field to which the present invention belongs should be able to make Various changes and modifications. Therefore, the protection scope of the present invention should be determined by the scope defined in the appended claims.

Claims (32)

1. the cursor control device of an image display; Said cursor control device can place the surface go up to move or by user's handling detect with reference to object with the cursor on the said image display of relative control; Said with reference to using object to be arranged on the screen periphery of said image display or being the figure of the given shape that shown on the screen of said image display; It is characterized in that said cursor control device comprises:

First sensing apparatus; In order to press close to said when surface at said cursor control device; Capture at least two picture frames of the image that reflects on said surface continuously; And, calculate first changes in coordinates of the cursor on the said image display according to said first amount of movement according to first amount of movement of the said cursor control device of image change calculations of this image between picture frame with respect to said surface;

Second sensing apparatus; Said in order to sensing with reference to using object; And detect said cursor control device with respect to second amount of movement of said reference with object; Calculate second changes in coordinates of the cursor on the said image display according to said second amount of movement, wherein said with reference to having spacing distance between object and said second sensing apparatus;

Switching device shifter is in order to select said first changes in coordinates of output or to select said second changes in coordinates of output; And

Processing unit; Crest in order to the image brilliance of analyzing one dimension that said first sensing apparatus captured or bidimensional image; And when the crest number of one dimension pixel is counted greater than critical crest; Control said switching device shifter and select to utilize said first sensing apparatus to export said first changes in coordinates, select to utilize said second sensing apparatus to export said second changes in coordinates otherwise control said switching device shifter.

2. cursor control device according to claim 1 is characterized in that said cursor control device also comprises storage unit, in order to temporary said first changes in coordinates and said second changes in coordinates.

3. cursor control device according to claim 1 is characterized in that said cursor control device also comprises the transmission interface unit, is sent to said image display in order to said first changes in coordinates or second changes in coordinates that will export.

4. cursor control device according to claim 3 is characterized in that, said transmission interface unit is wire transmission interface or wireless transmission interface.

5. cursor control device according to claim 1 is characterized in that, said first sensing apparatus comprises:

Light source is in order to illuminate said surface to form first image; And

First sensor is in order to capture at least two picture frames of said first image that reflects on said surface; And

First processing unit, first amount of movement of said cursor control device with respect to said surface calculated in the variation between picture frame according to said first image, and calculates first changes in coordinates of the cursor on the said image display according to said first amount of movement.

6. cursor control device according to claim 5 is characterized in that, said first sensing apparatus is that optical mouse or optics are handled inductor.

7. cursor control device according to claim 5 is characterized in that, said light source is light emitting diode or laser diode.

8. cursor control device according to claim 7 is characterized in that, said light emitting diode is the infrared light light emitting diode; Said laser diode is the infrared light laser diode.

9. cursor control device according to claim 5 is characterized in that, said first sensing apparatus also comprises lens, and said lens are arranged on the place ahead of said first sensor, in order to promote the light receiving efficiency of said first sensor.

10. cursor control device according to claim 5 is characterized in that, said first sensor is CMOS CIS or CCD CIS.

11. cursor control device according to claim 1 is characterized in that, said second sensing apparatus comprises:

Second sensor also captures at least two picture frames of said reference with the image of object in order to the said reference of sensing with object continuously; And

Second processing unit; Calculate said cursor control device with respect to second amount of movement of said reference according to said reference with the variation of image between picture frame of object, and calculate second changes in coordinates of the cursor on the said image display according to said second amount of movement with object.

12. cursor control device according to claim 11 is characterized in that, said second sensing apparatus also comprises lens, is arranged on the place ahead of said second sensor, in order to promote the light receiving efficiency of said second sensor.

13. cursor control device according to claim 11 is characterized in that, said second sensing apparatus also comprises optical filtering, is arranged on the place ahead of said second sensor, in order to the spectrum beyond the preset spectrum of filtering.

14. cursor control device according to claim 13 is characterized in that, said optical filtering is the infrared light optical filtering, and said preset spectrum is infrared light spectrum.

15. cursor control device according to claim 11 is characterized in that, said second sensor is CMOS CIS or CCD CIS.

16. cursor control device according to claim 1 is characterized in that, said first sensing apparatus is the roller type mouse.

17. an image system is characterized in that, said system comprises:

Image display, said device comprises screen, in order to the show image picture, and shows cursor on the said image frame;

At least one is with reference to using object, and is said with reference to using object to be arranged on the screen periphery of said image display or being the figure of the given shape that shown on the screen of said image display;

Cursor control device, said cursor control device can place the surface go up to move or by user's handling detect said with reference to object with the cursor on the said image display of relative control, said cursor control device comprises:

First sensing apparatus; In order to press close to said when surface at said cursor control device; Capture at least two picture frames of the image that reflects on said surface continuously; And according to first amount of movement of the image change calculations said cursor control device of this image between picture frame, and calculate first changes in coordinates of said cursor according to said first amount of movement with respect to said surface;

Second sensing apparatus; Said in order to sensing with reference to using object; And detect said cursor control device with respect to second amount of movement of said reference with object; Calculate second changes in coordinates of said cursor according to said second amount of movement, wherein said with reference to having spacing distance between object and said second sensing apparatus;

Switching device shifter is in order to select said first changes in coordinates of output or to select said second changes in coordinates of output;

Processing unit; Crest in order to the image brilliance of analyzing one dimension that said first sensing apparatus captured or bidimensional image; And when the crest number of one dimension pixel is counted greater than critical crest; Control said switching device shifter and select to utilize said first sensing apparatus to export said first changes in coordinates, select to utilize said second sensing apparatus to export said second changes in coordinates otherwise control said switching device shifter; And

The transmission interface unit is in order to transmit said first changes in coordinates or second changes in coordinates of the selected output of said switching device shifter; And

The coordinate processor; In order to receive said first changes in coordinates or second changes in coordinates that said transmission interface unit is transmitted; And said first changes in coordinates or second changes in coordinates be incorporated into the coordinate of said the above cursor of image display, so that said cursor control device can be controlled the location of said cursor on said screen relatively.

18. image system according to claim 17 is characterized in that, said image display is wherein one in the group that is made up of computer screen, projection screen and game machine screen.

19. image system according to claim 17 is characterized in that, said cursor control device is mouse or game control device.

20. image system according to claim 17 is characterized in that, and is said with reference to being rearranged by at least one light source with object.

21. image system according to claim 20 is characterized in that, said light source is a light emitting diode.

22. image system according to claim 17 is characterized in that, be built in the said image display in the said coordinate processor, and the transmission interface unit of said cursor control device is connected to said coordinate processor with wireless or wired mode.

23. the cursor control method on the image display; Utilize cursor control device place the surface go up to move or by user's handling detect with reference to object with the cursor on the said image display of relative control; Said with reference to using object to be arranged on the screen periphery of said image display or being the figure of the given shape that shown on the screen of said image display, said method comprises the following step:

Cursor control device is provided, and said cursor control device has first sensing apparatus and second sensing apparatus;

Press close to said when surface through said first sensing apparatus at said cursor control device; Capture at least two picture frames of the image that reflects on said surface continuously; And according to first amount of movement of the image change calculations said cursor control device of this image between picture frame, and calculate first changes in coordinates of the cursor on the said image display according to said first amount of movement with respect to said surface;

Said through said second sensing device senses with reference to using object; And detect said cursor control device with respect to second amount of movement of said reference with object; Calculate second changes in coordinates of the cursor on the said image display according to said second amount of movement, wherein said with reference to having spacing distance between object and said second sensing apparatus; And

Processing unit and switching device shifter are provided; Analyze the crest of the image brilliance of one dimension that said first sensing apparatus captured or bidimensional image through this processing unit; And when the crest number of one dimension pixel is counted greater than critical crest; Control said switching device shifter and select to utilize said first sensing apparatus to export said first changes in coordinates, select to utilize said second sensing apparatus to export said second changes in coordinates otherwise control said switching device shifter.

24. cursor control method according to claim 23, said method also comprises the following step:

Said first changes in coordinates or second changes in coordinates that transmit output arrive said image display.

25. cursor control method according to claim 23 is characterized in that, in the step of calculating said first changes in coordinates, said step comprises the following step:

Illuminate said surface to form first image;

Capture at least two picture frames of said first image that reflects on said surface continuously; And

First amount of movement of said cursor control device with respect to said surface calculated in variation between picture frame according to said first image, and calculates first changes in coordinates of the cursor on the said image display according to said first amount of movement.

26. cursor control method according to claim 23 is characterized in that, in the step of calculating said second changes in coordinates, said step comprises the following step:

The said reference of sensing is with object and continuous at least two picture frames that capture said reference with the image of object; And

Calculate said cursor control device with respect to second amount of movement of said reference according to said reference with the variation of image between picture frame of object, and calculate second changes in coordinates of the cursor on the said image display according to said second amount of movement with object.

27. cursor control method according to claim 23; It is characterized in that; Said is in order to produce the light source of preset spectrum with reference to using object; The step of calculating said second changes in coordinates also comprises the following step: in said second sensing device senses said with reference to the image of object the time spectrum beyond the said preset spectrum of filtering so that said second sensing apparatus only can receive said reference with spectral signal that object produced.

28. the cursor control method on the image display; Utilize cursor control device place the surface go up to move or by user's handling detect with reference to object with the cursor on the said image display of relative control; Said with reference to using object to be arranged on the screen periphery of said image display or being the figure of the given shape that shown on the screen of said image display, said method comprises the following step:

Cursor control device is provided, and said cursor control device has first sensing apparatus and second sensing apparatus;

Press close to said when surface through said first sensing apparatus at said cursor control device; Capture at least two picture frames of the image that reflects on said surface continuously; And according to first amount of movement of the image change calculations said cursor control device of this image between picture frame, and calculate first changes in coordinates of the cursor on the said image display according to said first amount of movement with respect to said surface;

Processing unit and switching device shifter are provided; Analyze the crest of the image brilliance of one dimension that said first sensing apparatus captured or bidimensional image through this processing unit; And when the crest number of one dimension pixel is counted greater than critical crest, control said switching device shifter and select to utilize said first sensing apparatus to export said first changes in coordinates; And

If do not export said first changes in coordinates; Said through said second sensing device senses with reference to using object; And detect said cursor control device with respect to second amount of movement of said reference with object; Calculate second changes in coordinates of the cursor on the said image display according to said second amount of movement, and export said second changes in coordinates, wherein said reference is with having spacing distance between object and said second sensing apparatus.

29. cursor control method according to claim 28 is characterized in that, in the step of calculating said first changes in coordinates, said step comprises the following step:

Illuminate said surface to form first image;

Capture two picture frame at least of said first image that reflects on said surface continuously; And

Change according to the image of said first image between picture frame and to calculate first amount of movement of said cursor control device, and calculate first changes in coordinates of the cursor on the said image display according to said first amount of movement with respect to said surface.

30. cursor control method according to claim 28 is characterized in that, in the step of calculating said second changes in coordinates, said step comprises the following step:

The said reference of sensing is with object and continuous at least two picture frames that capture said reference with the image of object; And

Calculate said cursor control device with respect to second amount of movement of said reference according to said reference with the variation of image between picture frame of object, and calculate second changes in coordinates of the cursor on the said image display according to said second amount of movement with object.

31. cursor control method according to claim 28; It is characterized in that; Said is in order to produce the light source of preset spectrum with reference to using object; The step of calculating said second changes in coordinates also comprises the following step: in said second sensing device senses said with reference to the image of object the time spectrum beyond the said preset spectrum of filtering so that said second sensing apparatus only can the said reference of sensing with spectral signal that object produced.

32. cursor control method according to claim 28 is characterized in that, said method also comprises the following step: said first coordinate or second changes in coordinates that transmit output arrive said image display.

Images