CN104217415B - Interactive projection system and interactive image detection method - Google Patents

Abstract

The present invention provides an interactive projection system and an interactive image detection method. The interactive projection system includes an electronic device, a projection device and an interactive module. The electronic device is configured to generate a first image signal. The projection device is connected to the electronic device to receive the first image signal and project the first image according to the first image signal. The interactive module includes a processing unit and a storage unit connected to the processing unit, an image extraction unit and a communication unit. The storage unit stores calibration data. The image extraction unit extracts the first image and the light spot image. The processing unit generates absolute coordinate information according to the light spot image and the calibration data. The communication unit transmits the absolute coordinate information to the electronic device so that the electronic device generates an output signal using the absolute coordinate information. This can avoid repeated image calibration, thereby achieving the effect of reducing manpower and time costs.

Description

Interactive projection system and interactive image detection method

technical field

The invention relates to an interactive projection system, in particular to an interactive projection system and an interactive image detection method.

Background technique

With the rapid development of digital technology and electronic products, people rely on various electronic products to make various data sorting and information presentation in daily life, academic research or workplace faster and more convenient. Among them, electronic presentations are the most common. Users can freely edit electronic presentations on electronic devices. Through the simple and easy-to-use presentation layout software, users can set visual effects, add music, sound effects, and even video clips in the presentations. Significantly increase viewer interest, which in turn increases presentation effectiveness.

Generally speaking, the presentation of the electronic presentation is mostly to project the pre-made electronic presentation stored in the electronic device on the projection screen through a projection system. To enhance the liveliness of a presentation, presenters expect to be able to move around freely or interact with the audience without restriction. In view of this, the industry has developed an interactive projection system, which aims to use the control device of the interactive projection system to perform specific operations on electronic devices, so that the presenter can be freed from the limitation of wires, and can directly control the project with only a hand-held control device. The electronic device performs actions such as playing the operation briefing and guiding the text of the briefing.

For example, a traditional interactive projection system usually has a camera, a projector and an infrared interactive pen. A common interactive projection system uses a camera to extract the bright spot image emitted by the user operating the infrared interactive pen on the projection screen, and then transmits the image to the electronic device, and uses the pre-installed background software inside the electronic device for image analysis to obtain The real position of the highlight image on the projection screen, and then the position information is sent back to the electronic device to achieve an interactive effect.

However, this method still has defects. Since the calibration data of the projector must be stored in the electronic device, when other users want to use the projector and the interactive projection system for electronic presentations or other purposes, each user must The background software must be pre-installed and image calibration must be performed to make the projector operate normally on different electronic devices, and the plug-and-play effect cannot be achieved. In other words, when users use the interactive projection system, they often have to perform image calibration before starting to use it. Not only is it very inconvenient, but it also causes a waste of meeting time, which also leads to an increase in labor costs and time costs. .

Therefore, how to develop an interactive projection system and an interactive image detection method that can improve the above-mentioned deficiencies in the prior art, avoid the inconvenience caused by repeated installation and setting between different electronic devices, and reduce manpower and time costs , is an unresolved problem.

Contents of the invention

The main purpose of the present invention is to provide an interactive projection system and an interactive image detection method to solve the problem of repeated software installation and image calibration between different electronic devices in the existing interactive projection system, and the increase in manpower and time costs, etc. shortcoming.

Another object of the present invention is to provide an interactive projection system and an interactive image detection method. By means of the interactive module for image extraction and absolute coordinate information calculation, the projection device can be applied to different electronic devices without pre-installing software. Between devices, and avoid repeated image calibration, thereby achieving the effects of reducing labor and time costs.

Another object of the present invention is to provide an interactive projection system and an interactive image detection method. Icon positioning is performed through absolute coordinate information, so that the projection device can be directly applied to various resolutions without recalibration.

In order to achieve the above purpose, a wider implementation aspect of the present invention is to provide an interactive projection system, which at least includes: an electronic device configured to generate a first image signal; a projection device connected to the electronic device, Used to receive the first image signal and project a first image according to the first image signal; and an interactive module, including: a processing unit; a storage unit connected to the processing unit for storing a calibration data; An image extraction unit connected to the processing unit for extracting the first image and at least one spot image, and the processing unit calculates and generates at least one absolute coordinate information according to the spot image and the calibration data; and a The communication unit is connected with the electronic device and the processing unit, and is used for transmitting the absolute coordinate information to the electronic device, so that the electronic device generates an output signal by using the absolute coordinate information.

In order to achieve the above purpose, another broad implementation aspect of the present invention is to provide an interactive image detection method, which at least includes the steps of: (a) providing an electronic device, a projection device and an interactive module; (b) judging the Whether the interactive module has a calibration data corresponding to the projection device; (c) extracting an image; (d) judging whether the image includes a spot image; (e) generating an absolute coordinate information; (f) transmit the absolute coordinate information to the electronic device; and (g) use the absolute coordinate information to generate an output signal; wherein, when the judgment result of step (b) is yes, in the step (b) Then execute the step (c), when the judgment result of the step (d) is yes, execute the step (e) after the step (d), and when the judgment result of the step (d) is no, then The step (c) is performed after the step (d).

The present invention provides an interactive projection system and an interactive image detection method. Through the interactive module for image extraction and absolute coordinate information calculation, the projection device can be applied between different electronic devices without pre-installing software, and Avoid repeated image calibration, thereby achieving the effects of reducing manpower and time costs.

Description of drawings

FIG. 1 is a structural diagram of an interactive projection system in a preferred embodiment of the present invention.

FIG. 2 is a flowchart of an interactive image detection method according to a preferred embodiment of the present invention.

FIG. 3 is a detailed flowchart of the interactive image detection method of the present invention.

FIG. 4 is a schematic diagram of multiple calibration point images.

FIG. 5 is another detailed flowchart of the interactive image detection method of the present invention.

FIG. 6 is a schematic diagram of multiple calibration images.

FIG. 7 is a structural diagram of an interactive projection system according to another embodiment of the present invention.

Wherein, the reference signs are explained as follows:

1, 2: Interactive projection system

11, 21: Electronic devices

12, 22: Projection device

13, 221: Interactive module

131, 2211: processing unit

132, 2212: image extraction unit

133, 2213: communication unit

134, 2214: storage unit

14, 24: projection area

15, 25: Control device

C1～C9: Calibration point image

P1: first calibration image

P2: second calibration image

P3: The third calibration image

P4: Fourth calibration image

S100～S700: Steps

S210～S295: steps

Detailed ways

Some typical embodiments embodying the features and advantages of the present invention will be described in detail in the description in the following paragraphs. It should be understood that the present invention can have various changes in different aspects, all of which do not depart from the scope of the present invention, and the description and drawings therein are used as illustrations in nature rather than limiting the present invention .

Please refer to FIG. 1 , which is a structural diagram of an interactive projection system according to a preferred embodiment of the present invention. As shown in FIG. 1 , the interactive projection system 1 of the present invention at least includes an electronic device 11 , a projection device 12 and an interactive module 13 . Wherein, the electronic device 11 is configured to generate the first image signal, and may be, but not limited to, a personal computer, a notebook computer, a tablet computer, or a smart phone. The projection device 12 is connected with the electronic device 11 for receiving a first image signal and projecting a first image according to the first image signal. The projection device 12 can be any kind of optical projector to project the first image or other projected images to the projection area 14, wherein the projection area 14 is preferably a flat plane, but not limited thereto. The interaction module 13 includes a processing unit 131 , an image capturing unit 132 , a communication unit 133 and a storage unit 134 . In this embodiment, the storage unit 134 is connected to the processing unit 131 for storing calibration data; the image extraction unit 132 is connected to the processing unit 131 for extracting the first image and at least one spot image, and the processing unit 131 According to the light spot image and the calibration data, absolute coordinate information is generated through calculation. The communication unit 133 is connected with the electronic device 11 and the processing unit 131, and is used to transmit the absolute coordinate information to the electronic device 11, so that the electronic device 11 uses the absolute coordinate information to generate an output signal, such as a second image signal or a sound signal, etc., But not limited to this. In this way, the projection device 12 can further receive the second image signal, and project a second image according to the second image signal, or directly output an audio signal from the electronic device 11 . Therefore, the present invention can apply the projection device 12 between different electronic devices 11 without pre-installing software, and avoid repeated image calibration, thereby achieving the effects of reducing manpower and time costs.

According to the concept of the present invention, the first image signal includes a first icon position signal, and the second image signal includes a second icon position signal, such as but not limited to a mouse cursor position signal or a virtual button position signal, and the second The icon position signal is generated according to absolute coordinate information. In some embodiments, the absolute coordinate information is formed in a logical data format, and the defined range may be, for example but not limited to, 0 to 0x7FFF in hexadecimal. Taking the above as an example, the absolute coordinate information mainly uses the definition of the USB HID class to enable the communication unit 133 to register with the electronic device 11 through the USB protocol: the transmitted data format will be the logic Type (LOGICAL) data format, and the range of registered data is 0 to 0x7FFF. When a piece of absolute coordinate information is sent to the electronic device 11, the electronic device 11 will automatically perform corresponding mapping in the range of 0 to 0x7FFF according to the screen resolution. For example, when the screen resolution of the electronic device is 1280×1024 and the received absolute coordinate information is (0x800, 0x700), the electronic device 11 can directly convert the absolute coordinate information to its actual coordinates on the screen (80 ,56), the conversion calculation is as follows:

X coordinate=0x800/0x7FFF×1280=80

Y coordinate=0x700/0x7FFF×1024=56

Through the introduction of absolute coordinate information, the generation of the second icon position signal in the present invention can be generated directly according to the absolute coordinate information without referring to the first icon position signal, so that the projection device 12 can be directly applied to various electronic devices 11 and Multiple resolution situations without recalibration.

According to the idea of the present invention, the processing unit 131 of the interactive module 13 can be a digital signal processor (DSP), a central processing unit (CPU) or a microprocessor (MCU), etc., and the image extraction unit 132 can be a complementary metal oxide semiconductor A photosensitive element (CMOS) or a photosensitive coupling element (CCD), etc., and the communication unit 133 can be a universal serial bus (USB) communication unit, a Bluetooth (Bluetooth) communication unit, a wireless fidelity (Wi-Fi) communication unit or other Wired/wireless transmission units, however, are not limited thereto. The storage unit 134 can be a flash memory (Flash Memory), an electrically erasable programmable read-only memory (EEPROM) or other storage units similar to magnetic disks, memories, and solid-state hard disks, but is not limited thereto.

According to the idea of the present invention, the interactive projection system 1 of the present invention further includes a control device 15 configured to generate and project a spot image, and at least partially overlap the spot image with the first image. In some embodiments, the control device 15 can be a pen type (not shown), and includes a light-emitting diode and a switch element, for the user to press the switch element to short-circuit, so that the light-emitting diode emits light to generate and project The point image, but not limited thereto.

Please refer to FIG. 2 together with FIG. 1 , wherein FIG. 2 is a flowchart of an interactive image detection method in a preferred embodiment of the present invention. As shown in FIG. 1 and FIG. 2 , the interactive image detection method of the present invention at least includes the following steps S100 to S700 . The process begins at step S100, providing the electronic device 11, the projection device 12 and the interactive module 13; then, as shown in step S200, it is determined whether the storage unit 134 of the interactive module 13 has calibration data corresponding to the projection device 12; when step S200 When the judging result is yes, step S300 is executed after step S200, and the image extraction module 132 of the interactive module 13 extracts an image; then, as shown in step S400, it is judged whether the image includes a spot image; when the judgment of step S400 When the result is no, step S300 is executed after step S400 to re-extract the image, and determine whether to include the light point image for continuous detection and extraction of the light point image; and when the judgment result of step S400 is yes, in step Step S500 is executed after S400, the processing unit 131 of the interactive module 13 generates absolute coordinate information according to the light point image calculation and the calibration data; then, as shown in step S600, the communication unit 133 of the interactive module 13 transmits the absolute coordinate information to the electronic device 11 ; Finally, as shown in step S700, the electronic device 11 uses the absolute coordinate information to generate an output signal.

In some embodiments, when the judgment result of step S200 is negative, step S210 is executed after step S200, and the electronic device 11 performs an image calibration operation, and obtains calibration data corresponding to the projection device 12; then, as shown in step S295 , store the calibration data in the storage unit 134 . In this way, after step S295 is executed, since the interactive module 13 has already stored the calibration data corresponding to the projection device 12, step S300 can be directly executed after step S295, and the subsequent process is the same as the above-mentioned embodiment, and will not be described here. Let me repeat.

According to the conception of the present invention, the image calibration operation in step S210 can be a manual image calibration operation. For the detailed process, please refer to FIG. 3 together with FIG. 4, wherein FIG. 3 is a detailed flow chart of the interactive image detection method of the present invention, And FIG. 4 is a schematic diagram of multiple calibration point images. As shown in FIG. 3 and FIG. 4 , the process of manual image calibration operation starts at step S220, and the manual calibration mode is activated; then, as shown in step S230, a plurality of calibration point images are sequentially displayed, for example, nine calibration point images C1, C2, . . . , C9, and extract a plurality of calibration light point images emitted by the user through the control device 15 . In other words, the user only needs to emit the calibration light points through the control device 15, and sequentially map the calibration light points to the calibration point images C1-C9, and extract these calibration light points into the calibration light point images to complete this step. It should be noted that the number of calibration points mentioned above is not intended to limit this embodiment, and the number can be adjusted according to actual needs; then, as shown in step S240, analyze multiple calibration point images and multiple calibration points The light point image is compared with the theoretical position of the calibration point image and the actual position of the calibration light point image to obtain calibration data; finally, as shown in step S250, it is determined whether the calibration data is valid. Wherein, when the judgment result of step S250 is yes, step S295 is executed after step S250, that is, the calibration data is stored in the storage unit 134; otherwise, if the judgment result of step S250 is no, the calibration is returned after step S250 Failure information, and directly end the manual calibration mode, for the user to choose to re-execute the manual calibration mode, change to the automatic calibration mode or not perform any action, but not limited thereto.

In some embodiments, the image calibration operation in step S210 can be an automatic image calibration operation. Please refer to FIG. 5 and FIG. 6 for the detailed flow chart, wherein FIG. 5 is another detailed flow chart of the interactive image detection method of the present invention , and FIG. 6 is a schematic diagram of multiple calibration images. As shown in FIG. 5 and FIG. 6, the process of automatic image calibration operation starts at step S260, and the automatic calibration mode is started; then, as shown in step S270, a plurality of calibration images are displayed in sequence, for example at least four calibration images, that is, the first A calibration image P1, a second calibration image P2, a third calibration image P3, and a fourth calibration image P4, and a plurality of real images generated by projection of these calibration images are extracted. It should be understood here that the real images are calibration images The actual image/image produced by the projection device, rather than the image file or the image signal of the image, etc.; then, as shown in step S280, analyze multiple calibration images and multiple real images, and calculate the theoretical position of the calibration image Compare with the actual position of the real image to obtain calibration data; finally, as shown in step S290, determine whether the calibration data is valid. Wherein, when the judgment result of step S290 is yes, step S295 is executed after step S290, that is, the calibration data is stored in the storage unit 134; otherwise, if the judgment result of step S290 is no, the calibration is returned after step S290 Failure information, and directly end the automatic calibration mode, for the user to choose to restart the automatic calibration mode, select the manual calibration mode instead, or do nothing, but not limited thereto.

In some embodiments, the first calibration image P1 and the second calibration image P2 are mutually inverted images, the third calibration image P3 is an image with different appearances when flipped upside down, sideways upside down, and upside down lefty sideways, and the fourth calibration image It is an image that can be calibrated as a comparison spot position. In this way, the above-mentioned automatic calibration operation can perform comparison and brightness analysis based on the first calibration image P1 and the second calibration image P2, and perform projection screen direction analysis (such as up-down flip, left-right flip, up-down, left-right flip, etc.) based on the third calibration image P3. ), and perform calibration data analysis etc. according to the fourth calibration image P4, but not limited thereto. In a preferred embodiment, the first calibration image P1 is a black image, the third calibration image P3 is composed of the first calibration image P1 and five light spots, and the fourth calibration image P4 is composed of the first calibration image P1 and It consists of nine light spots; the number of light spots mentioned above can be set according to actual needs, and is not limited to the above five or nine light spots. The order of the aspects of the first calibration image P1 to the fourth calibration image P4 is not limited to the above, for example, the third calibration image P3 and the fourth calibration image P4 can be mutually inverted images, and the second calibration image P2 can be As the calibration image for comparing the positions of the light spots, the first calibration image may be an image with different appearances when it is flipped upside down, flipped sideways, or flipped upside down and lefty. The same is true for other aspect orders.

Please refer to FIG. 7 , which is a structural diagram of an interactive projection system according to another embodiment of the present invention. As shown in FIG. 7 , the interactive projection system 2 of the present invention at least includes an electronic device 21 and a projection device 22 . Wherein, the projection device 22 has an interaction module 221 , and the interaction module 221 includes a processing unit 2211 , an image extraction unit 2212 , a communication unit 2213 and a storage unit 2214 . In this embodiment, the electronic device 21, the projection device 22, the interactive module 221, the processing unit 2211, the image extraction unit 2212, the communication unit 2213 and the storage unit 2214 are all similar to the foregoing embodiments, but the interactive module 221 of this embodiment is integrated The projection device 22 is different from the interactive module 13 of the foregoing embodiment which is independent from the projection device 12 , and will not be repeated here.

To sum up, the present invention provides an interactive projection system and an interactive image detection method. The interactive module performs image extraction and absolute coordinate information calculation, and the projection device can be applied to different electronic devices without pre-installing software. Between devices, and avoid repeated image calibration, thereby achieving the effects of reducing labor and time costs. In addition, the positioning of icons through absolute coordinate information can achieve the effect that the projection device can be directly applied to various electronic devices and various resolutions without recalibration.

Even though the present invention has been described in detail by the above-mentioned embodiments, various modifications can be devised by those skilled in the art without departing from the protection scope of the appended claims.

Claims (3)

1. An interactive image detection method, comprising at least the steps of: (a) providing an electronic device, a projection device and an interactive module; (b) judging whether the interactive module has calibration data corresponding to the projection device, the calibration data being a comparison between the theoretical position of the projected image of the projection device and the actual position of the real image; (c) extracting an image; (d) judging whether the image includes a spot image; (e) The processing unit of the interactive module calculates and generates absolute coordinate information according to the spot image and the calibration data; (f) the communication unit of the interactive module transmits the absolute coordinate information to the electronic device; and (g) generating an output signal using the absolute coordinate information; Wherein, when the judgment result of the step (b) is yes, the step (c) is executed after the step (b), and when the judgment result of the step (d) is yes, the step (d) is executed after the step (d) Step (e), and when the determination result of the step (d) is no, the step (c) is performed after the step (d); When the judgment result of the step (b) is no, the steps are executed after the step (b): (b1) performing an image calibration operation and obtaining the calibration data corresponding to the projection device; and (b2) storing the calibration data; Wherein the step (b1) also includes the steps of: (b11) starting a manual calibration mode; (b12) sequentially displaying a plurality of calibration point images and extracting a plurality of calibration light point images emitted by the user through a control device; (b13) analyzing the plurality of calibration point images and the plurality of calibration light point images to obtain the calibration data; and (b14) judging whether the calibration data is valid; Wherein, when the judgment result of the step (b14) is yes, the step (b2) is executed after the step (b14). 2. An interactive image detection method, comprising at least the steps of: (a) providing an electronic device, a projection device and an interactive module; (b) judging whether the interactive module has calibration data corresponding to the projection device, the calibration data being a comparison between the theoretical position of the projected image of the projection device and the actual position of the real image; (c) extracting an image; (d) judging whether the image includes a spot image; (e) The processing unit of the interactive module calculates and generates absolute coordinate information according to the spot image and the calibration data; (f) the communication unit of the interactive module transmits the absolute coordinate information to the electronic device; and (g) generating an output signal using the absolute coordinate information; Wherein, when the judgment result of the step (b) is yes, the step (c) is executed after the step (b), and when the judgment result of the step (d) is yes, the step (d) is executed after the step (d) Step (e), and when the determination result of the step (d) is no, the step (c) is performed after the step (d); When the judgment result of the step (b) is no, the steps are executed after the step (b): (b1) performing an image calibration operation and obtaining the calibration data corresponding to the projection device; and (b2) storing the calibration data; Wherein the step (b1) also includes the steps of: (b11) starting an automatic calibration mode; (b12) sequentially displaying a plurality of calibration images and extracting a plurality of real images produced by projecting the plurality of calibration images; (b13) analyzing the plurality of calibration images and the plurality of real images to obtain the calibration data; and (b14) judging whether the calibration data is valid; Wherein, when the judgment result of the step (b14) is yes, the step (b2) is executed after the step (b14). 3. The interactive image detection method according to claim 2, wherein the plurality of calibration images are a first calibration image, a second calibration image, a third calibration image and a fourth calibration image, wherein the first The calibration image and the second calibration image are mutually inverted images, the third calibration image is an image having a different appearance when reversed, and the fourth calibration image is an image calibrated as a comparison point position.