WO2017206316A1 - Interactive projection method and system - Google Patents
Interactive projection method and system Download PDFInfo
- Publication number
- WO2017206316A1 WO2017206316A1 PCT/CN2016/093418 CN2016093418W WO2017206316A1 WO 2017206316 A1 WO2017206316 A1 WO 2017206316A1 CN 2016093418 W CN2016093418 W CN 2016093418W WO 2017206316 A1 WO2017206316 A1 WO 2017206316A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- projection
- area
- content
- infrared
- infrared image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
Definitions
- Embodiments of the present invention relate to the field of projection technologies, and in particular, to a method and system for interactive projection.
- a projector is a device that can project an image or video onto a projection screen.
- the image or video projected onto the projection screen is multiplied or tens of times in magnification to facilitate viewing. It also gives people an open view. Therefore, projectors are very popular among users, especially in teaching, conferences, speeches, and defenses.
- the projector itself does not have an interactive function, and there is no way to interactively process the displayed image.
- Some interactive processing devices such as Microsoft's XBOX game console, Sony's PS3 game console and so on.
- the gesture recognition is based on data glove technology, and the data glove technology can accurately sense and recognize the small movements of the hand, but need to wear special data gloves, use trouble, and the user experience is not good.
- the game-based data glove-based interaction technology can be ported to the projection field, it still avoids the hassle of wearing specialized data gloves.
- the technical problem to be solved by the embodiments of the present invention is to provide a method and system for interactive projection, which can not only realize interactive projection based on visual technology, but also facilitate interactive operation; in addition, the interactive operation body does not block the projection image and affect the projection image.
- the actual projection effect is to provide a method and system for interactive projection, which can not only realize interactive projection based on visual technology, but also facilitate interactive operation; in addition, the interactive operation body does not block the projection image and affect the projection image. The actual projection effect.
- a technical solution adopted by an embodiment of the present invention is to provide an interactive projection method, including: causing an infrared projection device to project an infrared to a projection area. Line, and collecting an initial infrared image of the projection area by the infrared image acquisition device;
- the infrared image capturing device collects the deformed infrared image of the projection area; and identifies a different difference region between the deformed infrared image and the initial infrared image according to the preset recognition algorithm; Describe the difference area, adjust the projection content, and input the adjusted projection content to the content projector, and return to the step of causing the content projector to project a projection screen according to the input projection content to the projection area.
- the step of adjusting the projected content according to the different area includes: calculating a quantity of the difference area; acquiring an interaction instruction corresponding to the quantity of the difference area, and adjusting the location according to the obtained interaction instruction The projection content.
- the step of adjusting the projected content according to the different area includes: identifying a shape formed by the different area, and identifying an interaction position of the different area in the deformed infrared image; acquiring the difference An interactive instruction corresponding to the shape formed by the region, and identifying the controlled object that the projection screen exists at the interaction position; adjusting the projection content according to the acquired interaction instruction and the controlled object.
- the step of adjusting the projected content according to the different area includes: calculating an area of the different area; acquiring an interaction instruction corresponding to an area of the different area, and adjusting the location according to the obtained interaction instruction The projection content.
- the method further includes: receiving motion data sent by the motion sensor disposed on the interaction operating body; Data, determining whether the interactive operation body stops moving; if yes, entering the step of acquiring a deformed infrared image of the projection area by the infrared image acquisition device; if not, returning the receiving and setting on the interactive operation body The steps of the motion data sent by the motion sensor.
- an interactive projection system including: a processor, an infrared projection device, and a content projection. And an infrared image capturing device; the processor is respectively connected to the infrared projection device, the content projector and the infrared image capturing device; the processor is configured to: control the infrared projection device to project to the projection area, and pass the infrared
- An image acquisition device acquires an initial infrared image of the projection area; and inputs a projection content to the content projector to cause the content projector to project a projection image according to the projection content to the projection area; during the projection of the content projector, and Forming a deformed infrared image of the projected area by the infrared image capturing device when the interactive operating body between the infrared projection device and the projection area performs an interactive operation; identifying the deformed infrared image and the initial infrared according to a preset recognition algorithm a different distinguish
- the processor is configured to adjust the projected content according to the different area, where the processor is configured to calculate the number of the different areas, obtain an interaction instruction corresponding to the number of the different areas, and The obtained interactive instruction adjusts the projected content.
- the processor is configured to adjust the projected content according to the different area, where the processor is configured to identify a shape formed by the different area, and identify the different area in the deformed infrared image.
- the interaction position in the intersection is obtained by the interaction position corresponding to the shape of the difference area, and the controlled object existing on the interaction position of the projection picture is identified, and is adjusted according to the acquired interaction instruction and the controlled object.
- the projected content is configured to adjust the projected content according to the different area, where the processor is configured to identify a shape formed by the different area, and identify the different area in the deformed infrared image.
- the step of adjusting the projected content according to the distinguishing area includes: the processor, configured to calculate an area of the different area, and obtain an interaction instruction corresponding to an area of the different area, And adjusting the projected content according to the obtained interactive instruction.
- the system further includes a motion sensor; the motion sensor is configured to sense motion data of the interaction operator, and send the motion data to the processor; the processor is further configured to receive the motion data, And determining, according to the motion data, whether the interaction operator stops moving, and if so, entering the step of acquiring the deformed infrared image of the projection area by the infrared image acquisition device, and if not, returning to the receiving the action Step of data Step.
- an initial infrared image formed by the infrared projection device projecting infrared rays to the projection area is acquired in advance, and the projection screen is projected on the projection area by the content projector.
- the infrared image capturing device collects the deformed infrared image of the projected area, and the difference between the deformed infrared image and the initial infrared image is different.
- the difference area is equivalent to the mapping of the interactive operation body, and when the interaction operation body performs different interaction operations, the difference areas are different, and therefore, the deformation infrared
- the difference between the image and the initial infrared image is different, the projection content is adjusted, the interactive projection based on the visual technology is realized, and the interactive operation is very convenient; in addition, the interactive operation body only blocks part of the infrared light projected by the infrared projection device, and is not blocked. Inside The projected light of the projector does not affect the actual projected image, and does not affect the effect of other users viewing the projected image.
- FIG. 1 is a flow chart of an embodiment of a method for interactive projection of the present invention
- FIG. 2 is a schematic diagram of a deformed infrared image in an embodiment of the method for interactive projection of the present invention
- FIG. 3 is a schematic diagram of an embodiment of a system for interactive projection of the present invention.
- the method of interactive projection includes:
- Step S201 causing the infrared projection device to project infrared rays to the projection area, and collecting an initial infrared image of the projection area by the infrared image capturing device;
- the initial infrared image refers to an image formed when the infrared projection device projects to the projection area when there is no obstacle in the projection direction of the infrared projection device.
- the infrared rays projected by the infrared projection device can also form an infrared image, and the infrared projection device can also be an infrared projector.
- the initial infrared image can also be measured in advance.
- Step S202 inputting the projection content to the content projector
- Step S203 causing the content projector to project a projection image to the projection area according to the input projection content
- the projected light used by the content projector is different from the infrared light projected by the infrared projection device, so that the projected light of the content projector and the infrared light projected by the infrared projection device interfere with each other. Wherein, the projected image and the initial infrared image are completely overlapped.
- Step S204 acquiring a deformed infrared image of the projection area by the infrared image capturing device during the projection of the content projector and when the interactive operation between the infrared projection device and the projection area performs an interactive operation;
- part of the infrared rays projected by the infrared projection device is blocked, so that the image formed by the infrared projection device projected to the projection area changes to form a deformed infrared image, as shown in FIG. 2 .
- Step S205 Identify, according to a preset recognition algorithm, a different difference region between the deformed infrared image and the initial infrared image;
- the deformed infrared image and the initial infrared image are also completely overlapped, and the different distinguishing region between the deformed infrared image and the initial infrared image is caused by the interactive operating body blocking part of the infrared rays projected by the infrared projection device.
- Step S206 According to the difference area, adjust the projection content, and input the adjusted projection content to the content projector, and return to step S203;
- the projection screen is adjusted according to the interaction operation of the interactive operation body on the projection screen, and the interactive projection is realized.
- the interactive operation body only blocks part of the infrared light projected by the infrared projection device, and does not block the projected light of the content projector, and has no influence on the actual projection picture, and does not affect the effect of other users viewing the projection picture.
- the initial infrared image and the deformed infrared image are equivalent to an infrared layer superimposed on the projected image, but the infrared rays are not visible to the naked eye, which does not affect the actual projected image.
- the difference between the initial infrared image and the deformed infrared image is caused by the partial infrared rays projected by the infrared projection device when the interactive operation body performs the interaction operation, and the different interaction operations.
- different distinguishing regions can be created, and therefore, interactive commands represented by interactive operations can be defined by distinguishing regions.
- the interaction instruction may be defined according to the number of the different areas.
- the step of adjusting the projection content according to the difference area in step S205 is specifically: calculating the number of the difference areas, acquiring the interaction instruction corresponding to the number of the difference areas, and acquiring according to the number of the difference areas.
- the correspondence between the number of the distinguishing areas and the interaction instruction is pre-established, for example, one difference area corresponds to the switching instruction, and the two different areas correspond to the closing instruction.
- the shape of the distinguishing area defines an interaction instruction
- the distinguishing area is the mapping of the interactive operating body in the deformed infrared image
- the step of adjusting the projected content according to the distinguishing area in step S205 is specifically: identifying the shape formed by the distinguishing area, and Identifying an interaction position of the difference area in the deformed infrared image, acquiring an interaction instruction corresponding to the shape formed by the difference area, and identifying the controlled object existing on the interaction position of the projection picture, according to the acquired interaction instruction and the controlled object, Adjust the projection content.
- the controlled object of the projected image at the interactive position is an object that the interactive operator wants to operate, and the projection content is adjusted according to the acquired interactive instruction and the controlled object. Operate different objects in the projected image to improve the user experience.
- the correspondence between the formation of the distinguishing area and the interactive instruction is also established in advance.
- the interaction instruction is defined by the area of the difference area
- the step of adjusting the projection content according to the difference area in step S205 is specifically: calculating an area of the difference area, acquiring an interaction instruction corresponding to the area of the difference area, and according to the acquired Interactive instructions to adjust the projection content.
- the correspondence between the area of the distinguishing area and the interactive instruction is also pre-established.
- the adjustment of the projection content is not limited to the three modes mentioned above.
- the initial infrared image and the deformed infrared image are displayed in the form of a red line grid, and the infrared grid in the difference area is calculated by calculation.
- the corresponding interactive instruction is defined by the change range of the coordinates of the intersection point, the inner angle of the grid or the length of the grid line.
- experimental data of various deformed infrared images can also be established, and the experimental data is trained by using a machine learning method.
- the method further includes: receiving motion data sent by the motion sensor disposed on the interaction operator, and determining, according to the motion data, whether the interaction operator stops moving, and if so, acquiring the deformed infrared image of the projection area by using the infrared image collection device. If there is no, the step of receiving the motion data transmitted by the motion sensor provided on the interactive operating body is described. The motion sensor is used to sense whether the interactive operator is moving.
- an initial infrared image formed by the infrared projection device projecting infrared rays to the projection area is acquired in advance, and the interaction between the infrared projection device and the projection area is performed during the projection of the projection image by the content projector to the projection area.
- the infrared image capturing device collects the deformed infrared image of the projected area, and the different distinguishing region between the deformed infrared image and the initial infrared image is a part of the infrared light projected by the interactive operation body to block the infrared projection device.
- the difference area is equivalent to the mapping of the interaction operator, and the difference area is different when the interaction body performs different interaction operations.
- the projection can be adjusted according to the different difference between the deformed infrared image and the initial infrared image.
- Content realize interactive projection based on visual technology, and interactive operation is very convenient; in addition, the interactive operation body only blocks part of the infrared light projected by the infrared projection device, and does not block the projected light of the content projector, and has no influence on the actual projection image. Does not affect the effect of other users viewing the projected picture.
- the invention further provides a system implementation of interactive projection.
- the interactive projection system 30 includes a processor 31, an infrared projection device 32, a content projector 33, and an infrared image acquisition device 34.
- the processor 31 is connected to the infrared projection device 32, the content projector 33, and the infrared image acquisition device 34, respectively.
- the processor 31 is configured to: control the infrared projection device 32 to project to the projection area, and acquire an initial infrared image of the projection area by the infrared image acquisition device 34; input the projection content to the content projector 33, so that the content projector 33 according to the projection content Cast to the projection area Projecting a projection image; during the projection of the content projector 33, and when the interactive operation between the infrared projection device 32 and the projection area performs an interactive operation, the infrared image acquisition device 34 acquires the deformed infrared image of the projection area;
- the preset recognition algorithm identifies a different difference region between the deformed infrared image and the initial infrared image; adjusts the projected content according to the distinguishing region, and inputs the adjusted projected content to the content projector 33, and returns to the content projector 33 according to the input.
- the step of projecting the projected content onto the projection area is configured to: control the infrared projection device 32 to project to the projection area, and acquire an initial infrared
- the interactive operation body When the interactive operation body performs an interactive operation, the interactive operation body blocks a part of the infrared rays projected by the infrared projection device 32, so that the image projected by the infrared projection device 32 to the projection area changes to form a deformed infrared image, and the contrast infrared image and the initial infrared are compared.
- the image obtains a different distinguishing region between the deformed infrared image and the initial infrared image, wherein the distinguishing region is formed by blocking the partial infrared rays projected by the infrared projection device 32, and the deformed infrared image and the initial infrared image may be formed.
- the difference between the areas is adjusted to the projected picture to achieve interactive projection.
- the difference area is equivalent to the mapping of the interaction operator.
- the difference areas are different. Therefore, different difference areas can be defined to represent different interaction instructions.
- different numbers of different regions may be used to represent different interaction instructions, and the processor 31 is configured to adjust the projection content according to the difference region, where the processor 31 is configured to calculate the number of the difference regions.
- the interaction instruction corresponding to the number of the difference regions is obtained, and the projection content is adjusted according to the acquired interaction instruction.
- different interaction instructions may be represented by different shapes of the distinguishing regions, and the processor 31 is specifically configured to identify a shape formed by the distinguishing region, and identify the distinguishing region in the deformed infrared image.
- the interaction position acquires the interaction instruction corresponding to the shape of the difference area, and identifies the controlled object that exists on the interaction position of the projection picture, and adjusts the projection content according to the acquired interaction instruction and the controlled object. It should be noted that when there are multiple different regions, it is also possible to combine different shapes of different regions to represent different interactive instructions.
- different interactive instructions may be represented by different areas of the distinguishing area, and the processor 31 adjusts the step of projecting the content according to the different area.
- the processor 31 is specifically configured to calculate an area of the distinguishing area, obtain an interaction instruction corresponding to the area of the difference area, and adjust the projection content according to the obtained interaction instruction.
- the system further includes a motion sensor.
- the motion sensor is for sensing motion data of the interactive body and transmitting motion data to the processor 31.
- the processor 31 is further configured to receive the motion data, and determine, according to the motion data, whether the interaction operator stops moving, and if yes, enter a step of acquiring the deformed infrared image of the projection area by the infrared image collection device 34, and if not, return to the receiving station. The steps of the action data.
- the lens of the infrared image capturing device 34 may be provided with a narrow band filter, which only allows infrared rays to enter, and filters out visible natural light other than infrared light to prevent visible natural light from affecting the infrared image capturing device 34. Capture images.
- an initial infrared image formed by the infrared projection device 32 projecting infrared rays to the projection area is acquired in advance, and is located in the infrared projection device 32 and the projection area during the projection of the projection image by the content projector 33 toward the projection area.
- the deformed infrared image of the projection area is acquired by the infrared image capturing device 34, and the different distinguishing region between the deformed infrared image and the initial infrared image is the infrared projection device 32 blocked by the interactive operation body image.
- the difference area is equivalent to the mapping of the interactive operation body, and when the interaction operation body performs different interaction operations, the difference areas are different, and therefore, the difference between the deformed infrared image and the initial infrared image may be different.
- Differentiating the area, adjusting the projection content, realizing the interactive projection based on the visual technology, and the interactive operation is very convenient; in addition, the interactive operation body only blocks part of the infrared light projected by the infrared projection device 32, and is not the projection light of the content projector 33. Actual projection screen is not Impact, without affecting other users viewing the projected image.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
- Projection Apparatus (AREA)
Abstract
Description
本发明实施方式涉及投影技术领域，特别是涉及一种交互投影的方法及系统。Embodiments of the present invention relate to the field of projection technologies, and in particular, to a method and system for interactive projection.
投影仪，是一种可以将图像或视频投射到投影屏幕上的设备，其投影到投影屏幕上的图像或者视频在保持清晰度的情况下呈现数倍或者数十倍进行放大，方便人们观看，也给予人们开阔的视野，因此，投影仪深受用户的欢迎，尤其是在教学、会议、演讲、答辩等场合。A projector is a device that can project an image or video onto a projection screen. The image or video projected onto the projection screen is multiplied or tens of times in magnification to facilitate viewing. It also gives people an open view. Therefore, projectors are very popular among users, especially in teaching, conferences, speeches, and defenses.
但是投影仪本身并没有交互功能，没有办法对其所显示的图像进行交互处理。目前也出现一些交互处理的设备，例如：微软的XBOX游戏主机，索尼的PS3游戏主机等等。其手势动作识别是基于数据手套的技术，而数据手套技术可以较为准确的感应和识别手部的细微动作，但需要佩戴专门的数据手套，使用麻烦，用户体验不好。虽然游戏主机的基于数据手套的交互技术可以移植至投影领域，但是其仍然避免不了佩戴专门的数据手套的麻烦。However, the projector itself does not have an interactive function, and there is no way to interactively process the displayed image. There are also some interactive processing devices, such as Microsoft's XBOX game console, Sony's PS3 game console and so on. The gesture recognition is based on data glove technology, and the data glove technology can accurately sense and recognize the small movements of the hand, but need to wear special data gloves, use trouble, and the user experience is not good. Although the game-based data glove-based interaction technology can be ported to the projection field, it still avoids the hassle of wearing specialized data gloves.
发明内容Summary of the invention
本发明实施方式主要解决的技术问题是提供一种交互投影的方法及系统，不仅能够实现基于视觉技术的交互投影，并且交互操作非常方便；另外，交互操作体不会遮挡投影画面，影响投影画面的实际投影效果。The technical problem to be solved by the embodiments of the present invention is to provide a method and system for interactive projection, which can not only realize interactive projection based on visual technology, but also facilitate interactive operation; in addition, the interactive operation body does not block the projection image and affect the projection image. The actual projection effect.
为解决上述技术问题，本发明实施方式采用的一个技术方案是：提供一种互动投影的方法，包括：使红外线投射装置向投影区域投射红外 线，并且通过所述红外图像采集装置采集所述投影区域的初始红外图像；In order to solve the above technical problem, a technical solution adopted by an embodiment of the present invention is to provide an interactive projection method, including: causing an infrared projection device to project an infrared to a projection area. Line, and collecting an initial infrared image of the projection area by the infrared image acquisition device;
向内容投影仪输入投影内容，并且使所述内容投影仪根据输入的投影内容向投影区域投射投影画面；在所述内容投影仪投影的过程中，以及在位于所述红外线投射装置与投影区域之间的交互操作体执行交互操作时，通过所述红外图像采集装置采集投影区域的变形红外图像；根据预设识别算法识别所述变形红外图像与初始红外图像之间不相同的区别区域；根据所述区别区域，调整所述投影内容，并且向所述内容投影仪输入调整后的投影内容，返回所述使所述内容投影仪根据输入的投影内容向投影区域投射投影画面的步骤。Inputting the projection content to the content projector, and causing the content projector to project a projection image to the projection area according to the input projection content; during the projection of the content projector, and in the infrared projection device and the projection area When the inter-operating body performs the inter-operation, the infrared image capturing device collects the deformed infrared image of the projection area; and identifies a different difference region between the deformed infrared image and the initial infrared image according to the preset recognition algorithm; Describe the difference area, adjust the projection content, and input the adjusted projection content to the content projector, and return to the step of causing the content projector to project a projection screen according to the input projection content to the projection area.
其中，所述根据所述区别区域，调整所述投影内容的步骤包括：计算所述区别区域的数量；获取所述区别区域的数量所对应的交互指令，并且根据获取到的交互指令，调整所述投影内容。The step of adjusting the projected content according to the different area includes: calculating a quantity of the difference area; acquiring an interaction instruction corresponding to the quantity of the difference area, and adjusting the location according to the obtained interaction instruction The projection content.
其中，所述根据所述区别区域，调整所述投影内容的步骤包括：识别所述区别区域所构成的形状，并且识别所述区别区域在所述变形红外图像中的交互位置；获取所述区别区域所构成的形状对应的交互指令，并且识别所述投影画面在所述交互位置上所存在的被控制对象；根据获取到的交互指令和所述被控制对象，调整所述投影内容。The step of adjusting the projected content according to the different area includes: identifying a shape formed by the different area, and identifying an interaction position of the different area in the deformed infrared image; acquiring the difference An interactive instruction corresponding to the shape formed by the region, and identifying the controlled object that the projection screen exists at the interaction position; adjusting the projection content according to the acquired interaction instruction and the controlled object.
其中，所述根据所述区别区域，调整所述投影内容的步骤包括：计算所述区别区域的面积；获取所述区别区域的面积所对应的交互指令，并且根据获取到的交互指令，调整所述投影内容。The step of adjusting the projected content according to the different area includes: calculating an area of the different area; acquiring an interaction instruction corresponding to an area of the different area, and adjusting the location according to the obtained interaction instruction The projection content.
其中，在所述通过所述红外图像采集装置采集投影区域的变形红外图像的步骤之前，所述方法还包括：接收设置于所述交互操作体上的动作传感器发送的动作数据；根据所述动作数据，判断所述交互操作体是否停止移动；若是，则进入所述通过所述红外图像采集装置采集投影区域的变形红外图像的步骤；若否，返回所述接收设置于所述交互操作体上的动作传感器发送的动作数据的步骤。Before the step of acquiring the deformed infrared image of the projection area by the infrared image capturing device, the method further includes: receiving motion data sent by the motion sensor disposed on the interaction operating body; Data, determining whether the interactive operation body stops moving; if yes, entering the step of acquiring a deformed infrared image of the projection area by the infrared image acquisition device; if not, returning the receiving and setting on the interactive operation body The steps of the motion data sent by the motion sensor.
为解决上述技术问题，本发明实施方式采用的另一个技术方案是：提供一种互动投影的系统，包括：处理器、红外线投射装置、内容投影 仪和红外图像采集装置；所述处理器分别与红外线投射装置、内容投影仪和红外图像采集装置连接；所述处理器用于：控制所述红外线投射装置向投影区域进行投影，并且通过所述红外图像采集装置采集所述投影区域的初始红外图像；向内容投影仪输入投影内容，以使所述内容投影仪根据投影内容向投影区域投射投影画面；在所述内容投影仪投影的过程中，以及在位于所述红外线投射装置与投影区域之间的交互操作体执行交互操作时，通过所述红外图像采集装置采集投影区域的变形红外图像；根据预设识别算法识别所述变形红外图像与初始红外图像之间不相同的区别区域；根据所述区别区域，调整所述投影内容，并且向所述内容投影仪输入调整后的投影内容，并返回所述使所述内容投影仪根据输入的投影内容向投影区域投射投影画面的步骤。In order to solve the above technical problem, another technical solution adopted by the embodiment of the present invention is to provide an interactive projection system, including: a processor, an infrared projection device, and a content projection. And an infrared image capturing device; the processor is respectively connected to the infrared projection device, the content projector and the infrared image capturing device; the processor is configured to: control the infrared projection device to project to the projection area, and pass the infrared An image acquisition device acquires an initial infrared image of the projection area; and inputs a projection content to the content projector to cause the content projector to project a projection image according to the projection content to the projection area; during the projection of the content projector, and Forming a deformed infrared image of the projected area by the infrared image capturing device when the interactive operating body between the infrared projection device and the projection area performs an interactive operation; identifying the deformed infrared image and the initial infrared according to a preset recognition algorithm a different distinguishing region between the images; adjusting the projected content according to the distinguishing region, and inputting the adjusted projected content to the content projector, and returning the projected content of the content projector according to the input The step of projecting a projected picture to the projection area.
其中，所述处理器用于根据所述区别区域，调整所述投影内容包括：所述处理器，用于计算所述区别区域的数量，获取所述区别区域的数量所对应的交互指令，并且根据获取到的交互指令，调整所述投影内容。The processor is configured to adjust the projected content according to the different area, where the processor is configured to calculate the number of the different areas, obtain an interaction instruction corresponding to the number of the different areas, and The obtained interactive instruction adjusts the projected content.
其中，所述处理器用于根据所述区别区域，调整所述投影内容包括：所述处理器，具体用于识别所述区别区域所构成的形状，并且识别所述区别区域在所述变形红外图像中的交互位置获取所述区别区域的形状所对应的交互指令，并且识别所述投影画面在所述交互位置上所存在的被控制对象，根据获取到的交互指令和所述被控制对象，调整所述投影内容。The processor is configured to adjust the projected content according to the different area, where the processor is configured to identify a shape formed by the different area, and identify the different area in the deformed infrared image. The interaction position in the intersection is obtained by the interaction position corresponding to the shape of the difference area, and the controlled object existing on the interaction position of the projection picture is identified, and is adjusted according to the acquired interaction instruction and the controlled object. The projected content.
其中，所述处理器根据所述区别区域，调整所述投影内容的步骤包括：所述处理器，具体用于计算所述区别区域的面积，获取所述区别区域的面积所对应的交互指令，并且根据获取到的交互指令，调整所述投影内容。The step of adjusting the projected content according to the distinguishing area, the processor includes: the processor, configured to calculate an area of the different area, and obtain an interaction instruction corresponding to an area of the different area, And adjusting the projected content according to the obtained interactive instruction.
其中，所述系统还包括动作传感器；所述动作传感器用于感应交互操体的动作数据，并且向所述处理器发送所述动作数据；所述处理器，还用于接收所述动作数据，并且根据所述动作数据，判断所述交互操作体是否停止移动，若是，则进入所述通过所述红外图像采集装置采集投影区域的变形红外图像的步骤，若否，返回所述接收所述动作数据的步 骤。The system further includes a motion sensor; the motion sensor is configured to sense motion data of the interaction operator, and send the motion data to the processor; the processor is further configured to receive the motion data, And determining, according to the motion data, whether the interaction operator stops moving, and if so, entering the step of acquiring the deformed infrared image of the projection area by the infrared image acquisition device, and if not, returning to the receiving the action Step of data Step.
本发明实施方式的有益效果是：区别于现有技术的情况，本发明实施方式，预先获取红外线投射装置向投影区域投射红外线所形成的初始红外图像，在内容投影仪向投影区域投射投影画面的过程中，当位于红外线投射装置与投影区域之间的交互操作体执行交互操作时，通过红外图像采集装置采集投影区域的变形红外图像，而变形红外图像与初始红外图像之间不相同的区别区域是由交互操作体映遮挡红外线投射装置所投射的部分红外线形成，区别区域相当于交互操作体的映射，而交互操作体执行不同交互操作时，区别区域是不相同的，因此，可以根据变形红外图像与初始红外图像之间不相同的区别区域，调整投影内容,实现基于视觉技术的交互投影，并且交互操作非常方便；另外，交互操作体只是遮挡红外线投射装置所投射的部分红外光，不是遮挡内容投影仪的投射光线，对实际的投影画面不存在影响，不影响其它用户观看投影画面的效果。The beneficial effects of the embodiments of the present invention are different from the prior art. In the embodiment of the present invention, an initial infrared image formed by the infrared projection device projecting infrared rays to the projection area is acquired in advance, and the projection screen is projected on the projection area by the content projector. During the process, when the interactive operating body between the infrared projection device and the projection area performs an interactive operation, the infrared image capturing device collects the deformed infrared image of the projected area, and the difference between the deformed infrared image and the initial infrared image is different. It is formed by the interactive operation body occlusion of part of the infrared rays projected by the infrared projection device, and the difference area is equivalent to the mapping of the interactive operation body, and when the interaction operation body performs different interaction operations, the difference areas are different, and therefore, the deformation infrared The difference between the image and the initial infrared image is different, the projection content is adjusted, the interactive projection based on the visual technology is realized, and the interactive operation is very convenient; in addition, the interactive operation body only blocks part of the infrared light projected by the infrared projection device, and is not blocked. Inside The projected light of the projector does not affect the actual projected image, and does not affect the effect of other users viewing the projected image.
图1是本发明交互投影的方法实施方式的流程图；1 is a flow chart of an embodiment of a method for interactive projection of the present invention;
图2是本发明交互投影的方法实施方式中变形红外图像的示意图；2 is a schematic diagram of a deformed infrared image in an embodiment of the method for interactive projection of the present invention;
图3是本发明交互投影的系统实施方式的示意图。3 is a schematic diagram of an embodiment of a system for interactive projection of the present invention.
下面结合附图和实施方式对本发明进行说明。The invention will now be described with reference to the drawings and embodiments.
请参阅图1，交互投影的方法包括：Referring to Figure 1, the method of interactive projection includes:
步骤S201：使红外线投射装置向投影区域投射红外线，并且通过红外图像采集装置采集投影区域的初始红外图像；Step S201: causing the infrared projection device to project infrared rays to the projection area, and collecting an initial infrared image of the projection area by the infrared image capturing device;
初始红外图像是指在红外线投射装置的投射方向不存在任何阻挡物时，红外线投射装置投射至投影区域时形成的图像。其中，红外线投射装置所投射的红外线也可以形成红外线图像，则红外线投射装置也可以为红外投影仪。当然，初始红外图像也可以预先测量好的。 The initial infrared image refers to an image formed when the infrared projection device projects to the projection area when there is no obstacle in the projection direction of the infrared projection device. Wherein, the infrared rays projected by the infrared projection device can also form an infrared image, and the infrared projection device can also be an infrared projector. Of course, the initial infrared image can also be measured in advance.
步骤S202：向内容投影仪输入投影内容；Step S202: inputting the projection content to the content projector;
步骤S203：使内容投影仪根据输入的投影内容向投影区域投射投影画面；Step S203: causing the content projector to project a projection image to the projection area according to the input projection content;
需要说明的是：内容投影仪所以采用的投射光线与红外线投射装置投射的红外光是不相同的，避免内容投影仪的投射光线与红外线投射装置投射的红外光相互干扰。其中，投影画面与初始红外图像是完成重叠的。It should be noted that the projected light used by the content projector is different from the infrared light projected by the infrared projection device, so that the projected light of the content projector and the infrared light projected by the infrared projection device interfere with each other. Wherein, the projected image and the initial infrared image are completely overlapped.
步骤S204：在内容投影仪投影的过程中，以及在位于红外线投射装置与投影区域之间的交互操作体执行交互操作时，通过红外图像采集装置采集投影区域的变形红外图像；Step S204: acquiring a deformed infrared image of the projection area by the infrared image capturing device during the projection of the content projector and when the interactive operation between the infrared projection device and the projection area performs an interactive operation;
交互操作体在执行交互操作时，会遮挡红外线投影装置投射的部分红外线，使得红外线投影装置投射至投影区域所形成的图像会产生变化形成变形红外图像，如图2所示。When the interactive operation body performs the interactive operation, part of the infrared rays projected by the infrared projection device is blocked, so that the image formed by the infrared projection device projected to the projection area changes to form a deformed infrared image, as shown in FIG. 2 .
步骤S205：根据预设识别算法识别变形红外图像与初始红外图像之间不相同的区别区域；Step S205: Identify, according to a preset recognition algorithm, a different difference region between the deformed infrared image and the initial infrared image;
变形红外图像与初始红外图像也是完全重叠的，而变形红外图像与初始红外图像之间不相同的区别区域是由于交互操作体遮挡红外线投影装置投射的部分红外线所造成的。The deformed infrared image and the initial infrared image are also completely overlapped, and the different distinguishing region between the deformed infrared image and the initial infrared image is caused by the interactive operating body blocking part of the infrared rays projected by the infrared projection device.
步骤S206：根据区别区域，调整投影内容，并且向内容投影仪输入调整后的投影内容，并返回步骤S203；Step S206: According to the difference area, adjust the projection content, and input the adjusted projection content to the content projector, and return to step S203;
在内容投影仪根据调整后的投影内容进行投影时，实现根据交互操作体对投影画面的交互操作调整投影画面，实现交互投影。另外，交互操作体只是遮挡红外线投射装置所投射的部分红外光，不是遮挡内容投影仪的投射光线，对实际投影画面不存在影响，不影响其它用户观看投影画面的效果。When the content projector performs projection according to the adjusted projection content, the projection screen is adjusted according to the interaction operation of the interactive operation body on the projection screen, and the interactive projection is realized. In addition, the interactive operation body only blocks part of the infrared light projected by the infrared projection device, and does not block the projected light of the content projector, and has no influence on the actual projection picture, and does not affect the effect of other users viewing the projection picture.
初始红外图像和变形红外图像相当于叠加于投影画面上的一层红外线图层，但是红外线对肉眼是不见，其不影响真实的投影画面。初始红外图像和变形红外图像之间的区别区域是由于交互操作体进行交互操作时遮挡红外线投射装置所投射的部分红外线造成的，不同交互操 作，可以造成不同区别区域，因此，可以通过区别区域定义交互操作代表的交互指令。The initial infrared image and the deformed infrared image are equivalent to an infrared layer superimposed on the projected image, but the infrared rays are not visible to the naked eye, which does not affect the actual projected image. The difference between the initial infrared image and the deformed infrared image is caused by the partial infrared rays projected by the infrared projection device when the interactive operation body performs the interaction operation, and the different interaction operations As a result, different distinguishing regions can be created, and therefore, interactive commands represented by interactive operations can be defined by distinguishing regions.
具体的，可以根据区别区域的数量定义交互指令，则步骤S205中根据区别区域，调整投影内容的步骤具体为：计算区别区域的数量，获取区别区域的数量所对应的交互指令，并且根据获取到的交互指令，调整投影内容。其中，区别区域的数量与交互指令之间的对应关系预先建立的，例如：一个区别区域对应切换指令，两个区别区域对应关闭指令。Specifically, the interaction instruction may be defined according to the number of the different areas. The step of adjusting the projection content according to the difference area in step S205 is specifically: calculating the number of the difference areas, acquiring the interaction instruction corresponding to the number of the difference areas, and acquiring according to the number of the difference areas. Interactive instructions to adjust the projection content. The correspondence between the number of the distinguishing areas and the interaction instruction is pre-established, for example, one difference area corresponds to the switching instruction, and the two different areas correspond to the closing instruction.
或者，区别区域的形状定义交互指令，其中，区别区域是交互操作体在变形红外图像中映射，则步骤S205中根据区别区域，调整投影内容的步骤具体为：识别区别区域所构成的形状，并且识别区别区域在变形红外图像中的交互位置，获取区别区域所构成的形状对应的交互指令，并且识别投影画面在交互位置上所存在的被控制对象，根据获取到的交互指令和被控制对象，调整投影内容。由于变形红外图像也是与投影画面完成重叠的，因此，投影画面在交互位置上的被控制对象为交互操作体想操作的对象，通过根据获取到的交互指令和被控制对象，调整投影内容，实现对投影画面中不同对象进行操作，提高用户体验。当然，区别区域的形成与交互指令之间的对应关系也是预先建立的。Alternatively, the shape of the distinguishing area defines an interaction instruction, wherein the distinguishing area is the mapping of the interactive operating body in the deformed infrared image, and the step of adjusting the projected content according to the distinguishing area in step S205 is specifically: identifying the shape formed by the distinguishing area, and Identifying an interaction position of the difference area in the deformed infrared image, acquiring an interaction instruction corresponding to the shape formed by the difference area, and identifying the controlled object existing on the interaction position of the projection picture, according to the acquired interaction instruction and the controlled object, Adjust the projection content. Since the deformed infrared image is also overlapped with the projected image, the controlled object of the projected image at the interactive position is an object that the interactive operator wants to operate, and the projection content is adjusted according to the acquired interactive instruction and the controlled object. Operate different objects in the projected image to improve the user experience. Of course, the correspondence between the formation of the distinguishing area and the interactive instruction is also established in advance.
又或者，通过区别区域的面积定义交互指令，则步骤S205中根据区别区域，调整投影内容的步骤具体为：计算区别区域的面积，获取区别区域的面积所对应的交互指令，并且根据获取到的交互指令，调整投影内容。其中，区别区域的面积与交互指令之间的对应关系也是预先建立的。Or, the interaction instruction is defined by the area of the difference area, and the step of adjusting the projection content according to the difference area in step S205 is specifically: calculating an area of the difference area, acquiring an interaction instruction corresponding to the area of the difference area, and according to the acquired Interactive instructions to adjust the projection content. The correspondence between the area of the distinguishing area and the interactive instruction is also pre-established.
当然，根据区别区域，调整投影内容也不限于上述提及的三种方式，在其它替代实施方式中，初始红外图像和变形红外图像以红线网格的形式显示，通过计算区别区域内红外网格交点坐标、网格内角或者网格线长度各参数的改变范围来定义对应的交互指令。Of course, according to the difference area, the adjustment of the projection content is not limited to the three modes mentioned above. In other alternative embodiments, the initial infrared image and the deformed infrared image are displayed in the form of a red line grid, and the infrared grid in the difference area is calculated by calculation. The corresponding interactive instruction is defined by the change range of the coordinates of the intersection point, the inner angle of the grid or the length of the grid line.
进一步的，为了提高识别区别区域的速度和准确度，也可以建立各种变形红外图像的实验数据，利用机器学习方法对实验数据进行训练。Further, in order to improve the speed and accuracy of identifying the distinguishing region, experimental data of various deformed infrared images can also be established, and the experimental data is trained by using a machine learning method.
当交互操作体在移动的过程中识别交互操作时，容易造成识别到错 误的交互操作，例如：在交互操作体移到红外图像采集装置的投射方向的过程中，此时交互操作体尚未进行任何交互操作，若此时也进行交互操作识别，则会识别到错误的交互操作。为了减少识别到错误的交互操作，优选在交互操作体做出交互操作动作，并且停止移动时，才进行采集变形红外图像进行识别，则在通过红外图像采集装置采集投影区域的变形红外图像的步骤之前，方法还包括：接收设置于交互操作体上的动作传感器发送的动作数据，并且根据动作数据，判断交互操作体是否停止移动，若是，则进通过红外图像采集装置采集投影区域的变形红外图像的步骤，若否，返述接收设置于交互操作体上的动作传感器发送的动作数据的步骤。动作传感器用于感应交互操作体是否在移动。When the interactive operator recognizes the interactive operation during the moving process, it is easy to cause the recognition to be wrong. Mis-interaction, for example, in the process of moving the interactive body to the projection direction of the infrared image capturing device, the interactive operating body has not yet performed any interactive operation, and if the interactive operation is recognized at this time, an error is recognized. Interaction. In order to reduce the recognition of the wrong interaction, it is preferred to collect the deformed infrared image for recognition when the interactive operation body performs the interactive operation and stops the movement, and then the step of acquiring the deformed infrared image of the projection area by the infrared image acquisition device The method further includes: receiving motion data sent by the motion sensor disposed on the interaction operator, and determining, according to the motion data, whether the interaction operator stops moving, and if so, acquiring the deformed infrared image of the projection area by using the infrared image collection device. If there is no, the step of receiving the motion data transmitted by the motion sensor provided on the interactive operating body is described. The motion sensor is used to sense whether the interactive operator is moving.
在本发明实施方式中，预先获取红外线投射装置向投影区域投射红外线所形成的初始红外图像，在内容投影仪向投影区域投射投影画面的过程中，当位于红外线投射装置与投影区域之间的交互操作体执行交互操作时，通过红外图像采集装置采集投影区域的变形红外图像，而变形红外图像与初始红外图像之间不相同的区别区域是由交互操作体映遮挡红外线投射装置所投射的部分红外线形成，区别区域相当于交互操作体的映射，而交互操作体执行不同交互操作时，区别区域是不相同的，因此，可以根据变形红外图像与初始红外图像之间不相同的区别区域，调整投影内容,实现基于视觉技术的交互投影，并且交互操作非常方便；另外，交互操作体只是遮挡红外线投射装置所投射的部分红外光，不是遮挡内容投影仪的投射光线，对实际投影画面不存在影响，不影响其它用户观看投影画面的效果。In the embodiment of the present invention, an initial infrared image formed by the infrared projection device projecting infrared rays to the projection area is acquired in advance, and the interaction between the infrared projection device and the projection area is performed during the projection of the projection image by the content projector to the projection area. When the operating body performs the interactive operation, the infrared image capturing device collects the deformed infrared image of the projected area, and the different distinguishing region between the deformed infrared image and the initial infrared image is a part of the infrared light projected by the interactive operation body to block the infrared projection device. Forming, the difference area is equivalent to the mapping of the interaction operator, and the difference area is different when the interaction body performs different interaction operations. Therefore, the projection can be adjusted according to the different difference between the deformed infrared image and the initial infrared image. Content, realize interactive projection based on visual technology, and interactive operation is very convenient; in addition, the interactive operation body only blocks part of the infrared light projected by the infrared projection device, and does not block the projected light of the content projector, and has no influence on the actual projection image. Does not affect the effect of other users viewing the projected picture.
本发明又提供交互投影的系统实施方式。请参阅图3，交互投影的系统30包括处理器31、红外线投射装置32、内容投影仪33和红外图像采集装置34。处理器31分别与红外线投射装置32、内容投影仪33和红外图像采集装置34连接。The invention further provides a system implementation of interactive projection. Referring to FIG. 3, the
处理器31用于：控制红外线投射装置32向投影区域进行投影，并且通过红外图像采集装置34采集投影区域的初始红外图像；向内容投影仪33输入投影内容，以使内容投影仪33根据投影内容向投影区域投
射投影画面；在内容投影仪33投影的过程中，以及在位于红外线投射装置32与投影区域之间的交互操作体执行交互操作时，通过红外图像采集装置34采集投影区域的变形红外图像；根据预设识别算法识别变形红外图像与初始红外图像之间不相同的区别区域；根据区别区域，调整投影内容，并且向内容投影仪33输入调整后的投影内容，并返回使内容投影仪33根据输入的投影内容向投影区域投射投影画面的步骤。The
在交互操作体进行交互操作时，交互操作体会遮档红外线投射装置32所投射的部分红外线，使得红外线投射装置32投影到投影区域的图像发生变化形成变形红外图像，通过对比变形红外图像和初始红外图像，获取变形红外图像和初始红外图像之间不相同的区别区域，其中，区别区域是由于交互操作体映遮挡红外线投射装置32所投射的部分红外线形成的，可以根据变形红外图像与初始红外图像之间不相同的区别区域调整投影画面，实现交互投影。When the interactive operation body performs an interactive operation, the interactive operation body blocks a part of the infrared rays projected by the
区别区域相当于交互操作体的映射，而交互操作体执行不同交互操作时，区别区域是不相同的，因此，可以将不同的区别区域定义代表不同的交互指令，具体的The difference area is equivalent to the mapping of the interaction operator. When the interaction operation performs different interaction operations, the difference areas are different. Therefore, different difference areas can be defined to represent different interaction instructions.
在本实施方式的一种实现中，可以以区别区域的不同数量代表不同的交互指令，则处理器31用于根据区别区域，调整投影内容包括：处理器31，用于计算区别区域的数量，获取区别区域的数量所对应的交互指令，并且根据获取到的交互指令，调整投影内容。In an implementation of the embodiment, different numbers of different regions may be used to represent different interaction instructions, and the
在本实施方式的另一种实现中，可以以区别区域的不同形状代表不同的交互指令，则处理器31，具体用于识别区别区域所构成的形状，并且识别区别区域在变形红外图像中的交互位置获取所述区别区域的形状所对应的交互指令，并且识别投影画面在交互位置上所存在的被控制对象，根据获取到的交互指令和被控制对象，调整投影内容。需要说明的是：当存在多个区别区域时，也可以以不同区别区域的形状组合代表不同的交互指令。In another implementation of the embodiment, different interaction instructions may be represented by different shapes of the distinguishing regions, and the
在本实施方式的又一种实现中，可以以不同的区别区域的面积代表不同的交互指令，则处理器31根据区别区域，调整投影内容的步骤包
括：处理器31，具体用于计算区别区域的面积，获取区别区域的面积所对应的交互指令，并且根据获取到的交互指令，调整投影内容。In still another implementation of this embodiment, different interactive instructions may be represented by different areas of the distinguishing area, and the
为了减少识别到错误的交互操作，在交互操作体做出交互操作动作，并且停止移动时，才进行采集变形红外图像进行识别，则系统还包括动作传感器。动作传感器用于感应交互操体的动作数据，并且向处理器31发送动作数据。处理器31，还用于接收动作数据，并且根据动作数据，判断交互操作体是否停止移动，若是，则进入通过红外图像采集装置34采集投影区域的变形红外图像的步骤，若否，返回接收所述动作数据的步骤。In order to reduce the recognition of the wrong interaction, when the interactive operation body performs the interactive operation action and stops the movement, the acquisition of the deformed infrared image is performed for recognition, and the system further includes a motion sensor. The motion sensor is for sensing motion data of the interactive body and transmitting motion data to the
值得说明的是：红外图像采集装置34的镜头可以设置有窄带滤光片，窄带滤光片只允许红外线进入，并且过滤滤除红外光以外的可见自然光,避免可见自然光影响到红外图像采集装置34采集图像。It should be noted that the lens of the infrared
在本发明实施方式中，预先获取红外线投射装置32向投影区域投射红外线所形成的初始红外图像，在内容投影仪33向投影区域投射投影画面的过程中，当位于红外线投射装置32与投影区域之间的交互操作体执行交互操作时，通过红外图像采集装置34采集投影区域的变形红外图像，而变形红外图像与初始红外图像之间不相同的区别区域是由交互操作体映遮挡红外线投射装置32所投射的部分红外线形成，区别区域相当于交互操作体的映射，而交互操作体执行不同交互操作时，区别区域是不相同的，因此，可以根据变形红外图像与初始红外图像之间不相同的区别区域，调整投影内容,实现基于视觉技术的交互投影，并且交互操作非常方便；另外，交互操作体只是遮挡红外线投射装置32所投射的部分红外光，不是遮挡内容投影仪33的投射光线，对实际投影画面不存在影响，不影响其它用户观看投影画面的效果。In the embodiment of the present invention, an initial infrared image formed by the
以上所述仅为本发明的实施方式，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。 The above is only the embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the invention and the drawings are directly or indirectly applied to other related technologies. The fields are all included in the scope of patent protection of the present invention.
Claims (10)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610378343.0 | 2016-05-31 | ||
| CN201610378343.0A CN106095133B (en) | 2016-05-31 | 2016-05-31 | A kind of method and system of alternative projection |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2017206316A1 true WO2017206316A1 (en) | 2017-12-07 |
Family
ID=57230740
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2016/093418 Ceased WO2017206316A1 (en) | 2016-05-31 | 2016-08-05 | Interactive projection method and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106095133B (en) |
| WO (1) | WO2017206316A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110942092A (en) * | 2019-11-21 | 2020-03-31 | 大庆思特传媒科技有限公司 | Graphic image recognition method and recognition system |
| CN112912829A (en) * | 2018-11-01 | 2021-06-04 | 索尼公司 | Information processing apparatus, information processing method, and program |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106774827B (en) * | 2016-11-21 | 2019-12-27 | 歌尔科技有限公司 | Projection interaction method, projection interaction device and intelligent terminal |
| CN106775557A (en) * | 2016-11-28 | 2017-05-31 | 墨宝股份有限公司 | The interactive system and method for a kind of intelligent robot and virtual 3D |
| CN107015650B (en) * | 2017-03-28 | 2020-10-27 | 联想(北京)有限公司 | Interactive projection method, device and system |
| CN107272423A (en) * | 2017-05-25 | 2017-10-20 | 珠海格力电器股份有限公司 | Equipment control method and device and household appliance |
| CN114326832B (en) * | 2021-12-29 | 2023-10-20 | 北京西普阳光科技股份有限公司 | Projector position control system that determines projection position by image scanning |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030210230A1 (en) * | 2002-05-09 | 2003-11-13 | Waters Richard C. | Invisible beam pointer system |
| US20040102247A1 (en) * | 2002-11-05 | 2004-05-27 | Smoot Lanny Starkes | Video actuated interactive environment |
| CN201181561Y (en) * | 2008-04-24 | 2009-01-14 | 黄振武 | Interactive glass image system |
| CN101533316A (en) * | 2009-04-10 | 2009-09-16 | 梁雨时 | Interactive electric whiteboard system and method for using same |
| CN101907954A (en) * | 2010-07-02 | 2010-12-08 | 中国科学院深圳先进技术研究院 | Interactive projection system and interactive projection method |
| CN103201679A (en) * | 2010-11-12 | 2013-07-10 | 3M创新有限公司 | Interactive polarization-selective projection display |
| CN204129723U (en) * | 2014-09-25 | 2015-01-28 | 广州大学 | A kind of classroom multimedia teaching apparatus mutual based on Kinect somatosensory |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB0921461D0 (en) * | 2009-12-08 | 2010-01-20 | Qinetiq Ltd | Range based sensing |
| CN102314259B (en) * | 2010-07-06 | 2015-01-28 | 株式会社理光 | Method for detecting objects in display area and equipment |
| CN102455779B (en) * | 2010-10-15 | 2016-03-02 | 联想(北京)有限公司 | Messaging device and method |
| CN102156859B (en) * | 2011-04-21 | 2012-10-03 | 刘津甦 | Perception method of hand posture and spatial position |
| CN103019457A (en) * | 2011-09-23 | 2013-04-03 | 原相科技股份有限公司 | Optical touch system |
| WO2013088442A1 (en) * | 2011-12-15 | 2013-06-20 | Pebbles Ltd. | Controllable optical sensing |
| US10019843B2 (en) * | 2013-08-08 | 2018-07-10 | Facebook, Inc. | Controlling a near eye display |
-
2016
- 2016-05-31 CN CN201610378343.0A patent/CN106095133B/en active Active
- 2016-08-05 WO PCT/CN2016/093418 patent/WO2017206316A1/en not_active Ceased
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030210230A1 (en) * | 2002-05-09 | 2003-11-13 | Waters Richard C. | Invisible beam pointer system |
| US20040102247A1 (en) * | 2002-11-05 | 2004-05-27 | Smoot Lanny Starkes | Video actuated interactive environment |
| CN201181561Y (en) * | 2008-04-24 | 2009-01-14 | 黄振武 | Interactive glass image system |
| CN101533316A (en) * | 2009-04-10 | 2009-09-16 | 梁雨时 | Interactive electric whiteboard system and method for using same |
| CN101907954A (en) * | 2010-07-02 | 2010-12-08 | 中国科学院深圳先进技术研究院 | Interactive projection system and interactive projection method |
| CN103201679A (en) * | 2010-11-12 | 2013-07-10 | 3M创新有限公司 | Interactive polarization-selective projection display |
| CN204129723U (en) * | 2014-09-25 | 2015-01-28 | 广州大学 | A kind of classroom multimedia teaching apparatus mutual based on Kinect somatosensory |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112912829A (en) * | 2018-11-01 | 2021-06-04 | 索尼公司 | Information processing apparatus, information processing method, and program |
| CN110942092A (en) * | 2019-11-21 | 2020-03-31 | 大庆思特传媒科技有限公司 | Graphic image recognition method and recognition system |
| CN110942092B (en) * | 2019-11-21 | 2023-08-08 | 大庆思特传媒科技有限公司 | Graphic image recognition method and recognition system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106095133A (en) | 2016-11-09 |
| CN106095133B (en) | 2019-11-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017206316A1 (en) | Interactive projection method and system | |
| CN110045816B (en) | Near-eye display and system | |
| KR101347232B1 (en) | Image Recognition Apparatus, Operation Determining Method, and Computer-Readable Medium | |
| JP6810125B2 (en) | How to navigate, systems, and equipment in a virtual reality environment | |
| JP6343718B2 (en) | Gesture interface | |
| RU2455676C2 (en) | Method of controlling device using gestures and 3d sensor for realising said method | |
| US9651782B2 (en) | Wearable tracking device | |
| US20110164032A1 (en) | Three-Dimensional User Interface | |
| US20120056989A1 (en) | Image recognition apparatus, operation determining method and program | |
| CN107004275A (en) | Method and system for determining spatial coordinates of a 3D reconstruction at an absolute spatial scale of at least a portion of an object | |
| WO2019128109A1 (en) | Face tracking based dynamic projection method, device and electronic equipment | |
| JP2021060627A (en) | Information processing apparatus, information processing method, and program | |
| JP7781214B2 (en) | head-mounted display | |
| WO2018086461A1 (en) | Visual tracking method based on monocular gesture recognition, and robot | |
| WO2013149475A1 (en) | User interface control method and device | |
| JP2009003576A (en) | Device control apparatus and control method | |
| JP2012238293A (en) | Input device | |
| KR101256046B1 (en) | Method and system for body tracking for spatial gesture recognition | |
| TWI521387B (en) | A re-anchorable virtual panel in 3d space | |
| KR101374316B1 (en) | Apparatus for recognizing gesture by using see-through display and Method thereof | |
| CN103761011A (en) | Method, system and computing device of virtual touch screen | |
| CN108700885A (en) | A flight control method, remote control device, and remote control system | |
| KR101984240B1 (en) | Automatic calibration method and system for motion recognition | |
| KR102024314B1 (en) | a method and apparatus for space touch | |
| JP7710386B2 (en) | Information processing device, device speed estimation method, and device position estimation method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16903698 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 09.04.2019) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 16903698 Country of ref document: EP Kind code of ref document: A1 |