KR20090116544A - Infrared camera space touch sensing device, method and screen device - Google Patents

Abstract

The present invention discloses a spatial touch sensing apparatus, method and screen apparatus of an infrared camera type. At least one infrared camera for infrared imaging the sensing space on the screen; A depth information extractor for extracting depth information of the user indicating means entering the sensing space from the infrared photographed image; And a spatial coordinate computing point for extracting a position coordinate of the screen corresponding to the position of the user indicating means entered into the sensing space when the extracted depth is greater than or equal to a threshold depth.

According to the present invention, it is possible to detect a user indicating means entering the sensing space as an infrared photographed image through an infrared camera, and by applying a visible light blocking filter to the infrared camera, there is an effect of preventing misrecognition by external lighting. have.

Description

Apparatus and Method for Space Touch Sensing and Screen Apparatus sensing Infrared Camera}

The present invention relates to an infrared camera type spatial touch sensing apparatus, a method and a screen device, and more particularly, to an infrared camera type spatial touch sensing apparatus and method using an infrared camera to detect a selection of a menu projected on a space. And a screen device.

Recently, when a person's hand or an object touches a character or a specific location displayed on the screen (screen) without using a keyboard, a touch screen that detects the location and processes a function corresponding to the location detected by the stored software is widely used. It is used.

The touch screen may display a variety of text or picture information corresponding to a function, thereby facilitating user's recognition of the function. Therefore, it is widely used in applications such as guide devices, store sales terminals and general business devices in places such as subways, department stores, banks, and the like.

The conventional touch screen detects the occurrence of user input by adding a touch panel to the screen of the monitor and recognizing that the characteristics of the corresponding area change when a fingertip or other object contacts a predetermined area.

That is, the conventional touch screen analyzes the contact position by dividing the entire screen into a two-dimensional grid.

In this case, the touch screen uses a principle that changes the characteristics of the touch panel to which the capacitance, ultrasonic waves, infrared rays, resistive film, sound wave recognition, etc. are applied by the contact of the object to detect the touch.

That is, the conventional touch screen is configured in a two-dimensional form in which the display screen and the touch panel are disposed on the same surface, and thus cannot provide a user interface for the menu icon projected on the space.

Disclosure of Invention An object of the present invention is to provide an infrared camera type spatial touch sensing apparatus, a method and a screen apparatus that project a menu onto a space to provide a three-dimensional user interface.

Another object of the present invention is to provide an infrared camera type spatial touch sensing apparatus, method, and screen apparatus that receive a menu selection in a sensing space using an infrared photographed image of an object.

In order to solve the above problems, an infrared camera type space touch sensing apparatus according to an aspect of the present invention comprises at least one infrared camera for infrared imaging the sensing space on the screen; A depth information extractor for extracting depth information of the user indicating means entering the sensing space from the infrared photographed image; And a spatial coordinate calculator for extracting the position coordinates of the screen corresponding to the position of the user indicating means entered into the sensing space when the extracted depth is greater than or equal to the threshold depth.

According to another aspect of the present invention, there is provided a method of detecting a spatial touch using an infrared camera, the method comprising: photographing an infrared sensing space on a screen; Extracting depth information of the user indicating means entering the sensing space from the infrared photographed image; And if the extracted depth is greater than or equal to a threshold depth, extracting position coordinates of the screen corresponding to the position of the user indicating means entered into the sensing space.

In accordance with another aspect of the present invention, a screen apparatus of an infrared camera type includes: a screen displaying at least one function execution menu; At least one infrared camera for infrared imaging the sensing space on the screen; A depth information extractor for extracting depth information of the user indicating means entering the sensing space from the infrared photographed image; A spatial coordinate calculator for extracting the position coordinates of the screen corresponding to the position entered by the user indicating means in the sensing space when the extracted depth is greater than or equal to a threshold depth; And an event generator for recognizing a function execution menu corresponding to the extracted position coordinates among the at least one function execution menu and generating a function execution event corresponding to the recognized function execution menu.

According to the present invention, it is possible to detect a user indicating means entering the sensing space as an infrared photographed image through an infrared camera, and by applying a visible light blocking filter to the infrared camera, there is an effect of preventing misrecognition by external lighting. have.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing a spatial touch sensing device of the infrared camera method according to an embodiment of the present invention, Figures 2 and 3 are an infrared camera 110 and an infrared light emitter ( 170 is an installation diagram.

As shown in FIG. 1, an infrared camera type spatial touch sensing apparatus according to the present invention includes at least one infrared camera 110, a depth information extractor 120, and a spatial coordinate calculator 130.

At least one infrared camera 110 is installed on the side of the sensing space 100 to take an infrared image of the sensing space 100 on the screen.

Here, the sensing space is a three-dimensional space on the screen, and may be an area where the infrared camera 110 can detect whether the user indicating means has entered. The sensing space may be determined by the size of the screen and / or the detectable range of the infrared camera 110 and the like.

At this time, the sensing space 100 is configured in a form corresponding to the screen is opened and installed on one side and the other side overlapping the screen, it is preferable to be configured in a rectangular parallelepiped shape corresponding to the shape of the rectangular screen.

As shown in FIG. 2, the infrared camera 110 is installed at the left and right sides of the sensing space 100 to cross the photographing area in the sensing space 100 so that the depth information extractor 120 may use two infrared cameras ( The depth information entered into the sensing space 100 of the user indicating means may be extracted using the parallax of the cross-photographed image.

Here, the infrared camera 110 is a camera photographing using an infrared dry plate, and can be used for distant photography, thermal photography by a special thermal element, measurement of radiance, and detection of minute temperature differences.

The infrared camera 110 includes a filter for blocking visible light of 880 nm or less to block the influence of external lighting, so that the detection reliability of the user indicating means is high.

The infrared camera 110 is installed on the upper, lower, left, and right sides of the sensing space 100 to cross the photographing area in the sensing space 100 to photograph the extent to which the user indicating means enters the sensing space 100 by parallax ( Depth).

In this case, a single wide-angle single-focal infrared camera may be used as the infrared camera 110 for extracting depth information, but the wide-angle single-focal infrared camera has a disadvantage of large distortion, complicated processing, and high price. It is preferable to extract depth information by using parallax of an image captured by a large general infrared camera.

The depth information extractor 120 extracts depth information of a user indicating means entering the sensing space 100 from the infrared photographed image.

In detail, the depth information extractor 120 converts the images captured by the plurality of infrared cameras 110 into the images taken frontally by correcting the perspective, and then the user indicating means collectively detects the sensing space 100. My entered depth information can be extracted. That is, in the synthesized image, since the user indicating means is located at the same position and the infrared value is the highest at the position of the user indicating means, the depth information extractor 120 may extract depth information from the infrared value.

If the extracted depth is greater than or equal to the threshold depth, the spatial coordinate calculator 130 extracts the position coordinates of the screen corresponding to the position of the user indicating means entered into the sensing space 100. Detailed components and specific roles of the spatial coordinate calculator 130 will be described later with reference to FIG. 4.

Here, the position coordinates may be two-dimensional coordinates which are interpreted as X-axis and Y-axis based on one corner of the screen.

In addition, the infrared camera-type spatial touch sensing apparatus further includes an event generator 150, a transmitter 140, and an infrared light emitter 170.

The event generator 150 may be included in the spatial touch sensing device or may be a separate device, and generates a function execution event corresponding to the extracted location coordinates.

The transmitter 140 transmits the extracted location coordinates or the generated function execution event to the function execution device corresponding to the extracted location coordinates or the generated function execution event.

At least one infrared light emitter 170 is provided to project infrared rays into the sensing space 100 to improve the photographing sensitivity of the infrared camera.

The infrared light emitter 170 may be an infrared light-emitting diode (LED) for uniformly projecting infrared light in the sensing space 100.

That is, as the infrared light emitter 170, a wide-angle low-power LED having a wide projection angle and a relatively uniform projection density may be applied.

The infrared light emitter 170 is preferably installed at a position capable of increasing the infrared projection rate for the photographing area of the infrared camera.

In this case, as shown in FIG. 3, when the infrared camera 110 is installed at the left and right sides of the sensing space 100, it is preferable to increase the infrared projection rate by installing the infrared light emitter 170 above and below the sensing space 100. .

At this time, of course, only one infrared emitter 170 may be installed above or below according to the installation environment.

4 is a detailed configuration diagram of the spatial coordinate calculator 130 according to an embodiment of the present invention.

As shown in FIG. 4, the spatial coordinate calculator 130 according to the present invention includes a depth information acquisition unit 131, a pixel detection unit 132, an indication means determination unit 133, and a coordinate detection unit 134. .

The depth information acquisition unit 131 acquires first raw data corresponding to the detected depth in units of pixels. That is, the depth information acquisition unit 131 extracts the entry depth of the detected object entering the sensing space 100 in a low data form.

Here, the raw data is raw data that has not been processed for a predetermined purpose, and is updated at predetermined intervals (for example, 1 second) to provide information for achieving the purpose.

Here, the first row data of the present invention includes information on the entry depth of the object entering the sensing space 100 and the position of the screen corresponding thereto.

In this case, since the position coordinates are extracted in units of pixels constituting the screen, the first row data is also extracted in units of pixels.

The pixel detector 132 detects the second row data of which the entry depth of the object into the sensing space 100 is greater than or equal to the threshold depth among the first row data.

In detail, the pixel detector 132 compares whether the pixel depth 132 is greater than or equal to the threshold depth, and displays the first row data as 1 when the threshold depth is greater than or equal to 1, and 0 when the threshold depth is less than the threshold depth. In addition, the pixel detector 132 detects the first row data indicated by 1 as the second row data and ignores the first row data indicated by 0. FIG.

The indicating means determiner 133 determines that the object entering the sensing space 100 is a user indicating means when the pixel area formed by the pixel having the second row data is greater than or equal to the threshold area.

In addition, if the pixel area formed by the pixel having the second row data is less than the threshold area, the indicating means determiner 133 may determine that an unnecessary object such as dust is detected and ignore it, thereby preventing unnecessary malfunction.

The coordinate detector 134 detects the center of the pixel area determined as the entry of the user indicating means, and converts the center of the pixel area into position coordinates.

For example, the coordinate detector 134 may determine the center of intersection of the longest length and the shortest length of the pixel area and convert the intersection into position coordinates.

Here, the coordinate detector 134 may detect the intersection of the predetermined (eg, second) second longest length and the predetermined second shortest length, and of course, various methods may be used.

5 is a block diagram showing a screen device of the infrared camera method according to an embodiment of the present invention.

As shown in FIG. 5, the screen apparatus of the infrared camera type according to the present invention includes a screen 160, an infrared camera 110, a depth information extractor 120, a spatial coordinate calculator 130, and an event generator 150. It includes.

The screen 160 displays at least one function execution menu including a plurality of pixels.

The infrared camera 110 is installed at least one side of the sensing space 100 on the screen to take an infrared image of the interior of the sensing space (100).

The depth information extractor 120 extracts depth information of a user indicating means entering the sensing space 100 from the infrared photographed image.

The spatial coordinate calculator 130 extracts the position coordinates of the screen corresponding to the position where the user indicating means enters the sensing space 100.

If the extracted depth is greater than or equal to the threshold depth, the spatial coordinate calculator 130 extracts the position coordinates of the screen corresponding to the position entered into the sensing space 100.

The event generator 150 recognizes a function execution menu corresponding to the extracted position coordinates among the at least one function execution menu, and generates a function execution event corresponding to the recognized function execution menu.

In addition, the infrared camera type screen device may further include at least one infrared light emitter 170, and may project infrared rays into the sensing space 100 to improve photographing sensitivity of the infrared camera.

6 is a flowchart illustrating a spatial touch sensing method of an infrared camera method according to an embodiment of the present invention. A description with reference to FIG. 6 is as follows.

First, the infrared camera type spatial touch sensing apparatus photographs infrared rays of the sensing space 100 on the screen (S610).

In this case, the infrared camera-type spatial touch sensing apparatus cross-photographs the sensing space 100 so that an area photographed from the upper, lower, left, and right sides of the sensing space intersects, and extracts depth information by using parallax of the cross-photographed image. .

In this case, it is preferable that the infrared camera type spatial touch sensing device projects infrared rays in the sensing space 100 to improve the image quality of the captured image.

Subsequently, the infrared camera type spatial touch sensing apparatus extracts depth information of the user indicating means entering the sensing space 100 from the infrared photographed image (S620).

In detail, the infrared camera-type spatial touch sensing apparatus corrects the cross-photographed image into perspective shot images, and combines the converted images into a single image, and the user indicating means enters the sensing space 100. Is to extract depth information.

When the extracted depth is greater than or equal to the threshold depth (S630), the infrared camera type spatial touch sensing apparatus extracts the position coordinates of the screen corresponding to the position of the user indicating means entered into the sensing space 100 (S640).

In this case, since the screen includes a plurality of pixels, the location coordinates are preferably extracted in units of pixels.

In detail, when the screen includes a large number of pixels, the infrared camera type spatial touch sensing apparatus acquires first raw data in pixel units corresponding to a depth at which the user indicating means enters into the sensing space. . If the pixel depth of the pixel having the second row data is greater than or equal to the threshold region, the second row data having the entered depth is greater than or equal to the threshold depth is detected. Detect the center and convert it to position coordinates.

In this case, it is preferable that the infrared camera type spatial touch sensing apparatus detects the intersection of the longest length and the shortest length of the pixel area and converts the detected intersection point into position coordinates.

On the other hand, if the depth of the user input means is less than the threshold depth (S630), the infrared camera type spatial touch sensing apparatus considers and deletes the first row data as noise (S650).

Thereafter, a function execution event corresponding to the converted position coordinate is generated, and a process of executing a function according to the function execution event may be performed.

In the above, the configuration of the present invention has been described in detail with reference to the accompanying drawings, which are merely examples, and those skilled in the art to which the present invention pertains various modifications and changes within the scope of the technical idea of the present invention. Of course this is possible. Therefore, the protection scope of the present invention should not be limited to the above-described embodiment, but should be defined by the following claims.

1 is a block diagram showing a spatial touch sensing device of the infrared camera method according to the present invention.

2 and 3 is an installation view of the infrared camera 110 and the infrared transmitter 170 according to the present invention.

4 is a detailed configuration diagram of the spatial coordinate calculator 130 according to the present invention.

Figure 5 is a block diagram showing a screen device of the infrared camera method according to the present invention.

6 is a flowchart illustrating a spatial touch sensing method of an infrared camera method according to the present invention.

Claims (20)

At least one infrared camera for infrared imaging the sensing space on the screen; A depth information extractor for extracting depth information of the user indicating means entering the sensing space from the infrared photographed image; And If the extracted depth is greater than or equal to the threshold depth, a spatial coordinate calculator for extracting the position coordinates of the screen corresponding to the position of the user indicating means entered into the sensing space Spatial touch sensing device of the infrared camera method comprising a. The method of claim 1, An event generator for generating a function execution event corresponding to the extracted position coordinates Infrared camera type space touch sensing device further comprising a. The method of claim 1, At least one infrared transmitter for projecting infrared rays in the sensing space Infrared camera type space touch sensing device further comprising a. The method of claim 3, wherein the at least one infrared light emitter, Infrared camera-type spatial touch sensing apparatus comprising an infrared LED for uniformly projecting the infrared rays in the sensing space. The method of claim 1, wherein the at least one infrared camera, Infrared camera type spatial touch sensing device, characterized in that it comprises a filter for blocking visible light below 880nm. The method of claim 1, wherein the at least one infrared camera, Infrared camera type space touch sensing device, characterized in that provided in the upper and lower or left and right sides of the sensing space to take a photographing area in the sensing space to cross. The method of claim 6, wherein the depth information extractor, And converting the cross-photographed image into a front-photographed image, and extracting depth information into which the user indicating means enters the sensing space. The spatial coordinate operator of claim 1, wherein when the screen includes a plurality of pixels, A depth information obtaining unit obtaining first raw data corresponding to the detected depth in units of pixels; A pixel detector configured to detect second row data of the first row data whose detected depth is greater than or equal to a threshold depth; An instruction means determination unit that determines that the user indication means has entered if the pixel area formed by the pixel having the second row data is equal to or larger than a threshold area; And Coordinate detection unit for detecting the center of the pixel area determined to enter the user indicating means and converting to the position coordinates Spatial touch sensing device of the infrared camera method comprising a. The method of claim 8, wherein the coordinate detection unit, And an intersection point of the longest length and the shortest length of the pixel area to the position coordinates. Infrared imaging the sensing space on the screen; Extracting depth information of the user indicating means entering the sensing space from the infrared photographed image; And If the extracted depth is greater than or equal to a threshold depth, extracting position coordinates of the screen corresponding to a position of a user indicating means entered into the sensing space; Space touch detection method of the infrared camera method comprising a. The method of claim 10, wherein the photographing step, Projecting infrared rays into the sensing space Space touch detection method of the infrared camera method comprising a. The method of claim 10, wherein the photographing step, Cross-photographing the regions photographed from the top, bottom, left and right sides of the sensing space to cross Space touch detection method of the infrared camera method comprising a. The method of claim 12, wherein extracting the depth information comprises: Converting the cross shot image into a front shot image; Synthesizing the converted images into one image; And Extracting depth information entered into the sensing space by the user indicating means from the synthesized image; Space touch detection method of the infrared camera method comprising a. The method of claim 10, wherein when the screen includes a plurality of pixels, extracting the position coordinates comprises: The method of claim 1, wherein the location coordinates are extracted in units of pixels. The method of claim 10, wherein the extracting of the position coordinates comprises: When the screen includes a plurality of pixels, acquiring first raw data in pixel units corresponding to a depth at which user indicating means enters into a sensing space on the screen; Detecting second row data of the first row data whose depth is greater than or equal to a threshold depth; If the pixel area formed by the pixel having the second row data is greater than or equal to a threshold area, determining that the user indicating means has entered; And Detecting the center of the pixel area determined as the entry and converting the center of the pixel area into position coordinates; Space touch detection method of the infrared camera method comprising a. The method of claim 15, wherein the detecting step, Ignoring second row data whose entered depth is less than a threshold depth Space touch detection method of the infrared camera method comprising a. The method of claim 15, wherein the converting step, Detecting an intersection of the longest length and the shortest length of the pixel area with the center of the pixel area; Space touch detection method of the infrared camera method comprising a. The method of claim 10, wherein after extracting the position coordinates, Generating a function execution event corresponding to the extracted position coordinates; And Executing a function according to the function execution event Space touch detection method of the infrared camera method further comprising a. A screen displaying at least one function execution menu; At least one infrared camera for infrared imaging the sensing space on the screen; A depth information extractor for extracting depth information of a user indicating means entering the sensing space from the infrared photographed image; A spatial coordinate calculator for extracting the position coordinates of the screen corresponding to the position entered by the user indicating means in the sensing space when the extracted depth is greater than or equal to a threshold depth; And An event generator for recognizing a function execution menu corresponding to the extracted position coordinates among the at least one function execution menu and generating a function execution event corresponding to the recognized function execution menu; Infrared camera type screen device comprising a. The method of claim 19, At least one infrared transmitter for projecting infrared rays in the sensing space Infrared camera type screen device further comprising.

Images