JP2012181264A - Projection device, projection method, and program - Google Patents

Abstract

Light projection onto a person in front of a screen is avoided without reducing the area of a projected image as much as possible.
A projection system (11 to 17) that projects an image according to an input image signal toward a projection target, and an infrared image in the image projection direction is photographed, and a human body is present in the infrared image obtained by photographing. The imaging system (27, 28B, 29 to 31) for detecting the shape of the area to be processed and the luminance of the corresponding area in the image projected by the projection system (11 to 17) corresponding to the detected shape of the human body area CPU34.
[Selection] Figure 1

Description

  The present invention relates to a projection apparatus, a projection method, and a program suitable for a projector apparatus using, for example, a laser diode as a light source.

  2. Description of the Related Art Conventionally, a technique related to a projection display device having an antiglare function that controls the brightness of image light in a region where a person in the display area is located to reduce the amount of image light incident on the eyes of the person located in the display region Was considered. (For example, Patent Document 1)

JP 2000-305481 A

  In the technique described in the above patent document, the entire vertical region is blanked according to the position of the person standing in front of the screen. Therefore, although the anti-glare function for a person standing in front of the screen can be surely implemented, there is a problem that the area of the image to be projected and the amount of information accompanying it are greatly reduced.

  The present invention has been made in view of the above circumstances, and its object is to reliably avoid projection of light onto a person standing in front of the screen without reducing the area of the projected image as much as possible. It is an object of the present invention to provide a projection apparatus, a projection method, and a program that can perform the above-described process.

  According to one aspect of the present invention, a projection unit that projects an image according to an input image signal toward a projection target, an infrared image in the image projection direction by the projection unit, and an infrared image obtained by shooting the infrared image A human body shape detecting means for detecting the shape of a region where a human body exists, and a projection corresponding to the shape of the human body region detected by the human body shape detecting means and reducing the luminance of the corresponding region in the image projected by the projecting means And a control means.

  According to the present invention, it is possible to reliably avoid the projection of light onto a person standing in front of the screen without reducing the area of the projected image as much as possible.

The block diagram which shows the function structure of the electronic circuit of the data projector apparatus which concerns on one Embodiment of this invention. 6 is a flowchart showing processing details of a projection operation in a presentation mode according to the embodiment. The figure for demonstrating the mask operation | movement with respect to the projection image which concerns on the same embodiment.

  Hereinafter, an embodiment in which the present invention is applied to a DLP (Digital Light Processing) (registered trademark) battery-driven data projector apparatus will be described with reference to the drawings.

  FIG. 1 is a diagram for mainly explaining a functional configuration of an electronic circuit of the data projector device 10 according to the present embodiment. In the figure, reference numeral 11 denotes an input unit. The input unit 11 includes, for example, a pin jack (RCA) type video input terminal, a D-sub 15 type RGB input terminal, an HDMI (High-Definition Multimedia Interface) standard image / audio input terminal, and a USB (Universal Serial Bus). An image signal and an audio signal are input from an external device having a connector and connected by wire through any of these terminals.

  The image signals of various standards input from the input unit 11 are input to the projection image conversion unit 12 also called a scaler via the system bus SB.

  The projection image conversion unit 12 unifies the input image signal into an image signal of a predetermined format suitable for projection, appropriately writes it in a built-in display buffer memory, and then reads and projects the written image signal. The image is sent to the image driver 13.

  The projection image drive unit 13 multiplies a frame rate according to a predetermined format, for example, 60 [frames / second], the number of color component divisions, and the number of display gradations, in accordance with the transmitted image signal. The micromirror element 14 is driven to display by high-speed time-division driving.

  The micromirror element 14 performs a display operation by individually turning on / off each inclination angle of a plurality of micromirrors arranged in an array, for example, WXGA (horizontal 1280 pixels × vertical 768 pixels) at high speed. Then, an optical image is formed by the reflected light.

  On the other hand, R, G, and B primary color lights are emitted cyclically from the light source unit 15 in a time-sharing manner. The primary color light from the light source unit 15 is totally reflected by the mirror 16 and applied to the micromirror element 14.

  Then, an optical image is formed by the reflected light from the micromirror element 14, and the formed optical image is projected and displayed on a screen (not shown) to be projected via the projection lens unit 17.

  The projection lens unit 17 includes a focus lens group for moving the focus position and a zoom lens group for changing the zoom (projection) angle of view in the internal lens optical system.

The light source unit 15 includes an LD (hereinafter referred to as “G-LD”) 19 that emits green (G) light,
It has a light emitting diode (hereinafter referred to as “R-LED”) 20 that emits red (R) light and an LD (hereinafter referred to as “B-LD”) 21 that emits blue (B) light.

  The green light emitted from the G-LD 19 is transmitted through the dichroic mirror 22, and then converted into a light beam having a uniform light intensity distribution by the integrator 23, and then sent to the mirror 16.

  The red light emitted from the R-LED 20 is reflected by the dichroic mirror 24 and then by the dichroic mirror 22, and the luminous intensity distribution is made uniform by the integrator 23 before being sent to the mirror 16.

The blue light emitted from the B-LD 21 is reflected by the mirror 25, then passes through the dichroic mirror 24, is then reflected by the dichroic mirror 22, and is converted into a light beam having a uniform light intensity distribution by the integrator 23. It is sent to the mirror 16.
The dichroic mirror 22 transmits green light while reflecting red light and blue light. The dichroic mirror 24 reflects red light while transmitting blue light.

  Accordingly, the projection light drive unit 26 controls the light emission timings of the G-LD 19, the R-LED 20, and the B-LD 21 of the light source unit 15, the waveform of the drive signal, and the like. The projection light drive unit 26 performs the light emission operation of the G-LD 19, R-LED 20, and B-LD 21 in accordance with a timing signal synchronized with the image signal supplied from the projection image drive unit 13 and control of the CPU 34 described later. Control.

  A light receiving lens 27 is disposed so as to be adjacent to the projection lens unit 17, and a CMOS image sensor 29, which is a solid-state imaging device, is disposed at a focus position of the light receiving lens 27.

  For example, the light receiving lens 27 has a photographing field angle slightly larger than the maximum zoom field angle of the projection lens unit 17 and includes a lens group including a focus lens that moves in the optical axis direction.

  In the optical axis between the light receiving lens 27 and the CMOS image sensor 29, a visible light transmission filter 28A and an infrared transmission filter 28B are selectively disposed. These filters 28A and 28B are disposed, for example, on the same rotation circumference of the filter revolver 28, and one of the filters 28A and 28B is inserted into the photographing optical axis by the rotation of the filter revolver 28.

  The light receiving lens 27, the filter revolver 28, and the CMOS image sensor 29 are provided so that photographing can be performed including the projection range of the projection lens unit 17. The image signal including the projection range obtained by the photographing operation by the CMOS image sensor 29 is digitized by the A / D converter 30 and then sent to the photographing control unit 31.

  The photographing control unit 31 executes a contrast AF (automatic focusing) operation by moving the focus lens of the light receiving lens 27 and a photographing operation by scanning the CMOS image sensor 29.

  Further, the imaging control unit 31 rotates the filter revolver 28 so as to drive the filter motor 32 with the visible light transmission filter 28A or the infrared transmission filter 28B interposed in the imaging optical axis between the light receiving lens 27 and the CMOS image sensor 29. Also do.

  The imaging control unit 31 performs image processing including projection image recognition and face detection processing on image data obtained by imaging with the CMOS image sensor 29 as necessary, and the recognition results and the like are displayed on the entire data projector apparatus 10. Is sent to the CPU 34 which controls the control operation.

  The CPU 34 controls all the operations of the above circuits. The CPU 34 is directly connected to the main memory 35 and the program memory 36. The main memory 35 is composed of, for example, an SRAM and functions as a work memory for the CPU 34. The program memory 36 is composed of an electrically rewritable nonvolatile memory such as a flash ROM, and stores an operation program executed by the CPU 34, various fixed data, and the like.

  The CPU 34 controls the data projector device 10 by reading out the operation program, fixed data, etc. stored in the program memory 36, developing and storing them in the main memory 35, and executing the program. Control.

The CPU 34 performs various projection operations in response to key operation signals from the operation unit 37.
The operation unit 37 includes a remote control light receiving unit that receives an infrared modulation signal from a remote controller (not shown) dedicated to the data projector device 10, and a key input unit provided on the upper surface of the housing of the data projector device 10, for example. The operation unit 37 outputs a key operation signal based on a key operated by a user with a remote controller dedicated to the data projector device 10 or a key input unit of the main body to the CPU 34.

The CPU 34 is further connected to an audio processing unit 38 via the system bus SB.
The sound processing unit 38 includes a sound source circuit such as a PCM sound source, converts the sound signal given during the projection operation into an analog signal, drives the speaker unit 39 to emit sound, or generates a beep sound or the like as necessary.

Next, the operation of the above embodiment will be described.
FIG. 2 is a flowchart showing the processing contents executed by the CPU 34 in an operation called a “presentation (presentation) mode” for setting a mode in which a person is positioned in front of the screen and giving a presentation.

  At this processing location, the CPU 34 determines whether it is time to detect the position of the person in front of the screen (step S101). This detection timing includes at the beginning of the operation, when a certain time (ex. 2 [seconds]) has elapsed, when the image signal input from the input unit 11 is switched, and when the projection environment is changed such as the focus position and zoom angle. Shall be.

  If it is determined in step S101 that the detection timing is reached, an image input at that time is projected from the projection lens unit 17, while the imaging control unit 31 moves the visible light transmission filter 28A of the filter revolver 28 to the light receiving lens. 27 and the CMOS image sensor 29 are set so as to be inserted into the imaging optical axis, and a projected image in the visible light region is captured by the CMOS image sensor 29 (step S102).

  At this time, the imaging control unit 31 performs the contrast AF operation as described above by moving the focus lens that constitutes a part of the light receiving lens 27 during imaging. The distance value to the screen to be projected is detected based on the driving position of the focus lens that provides the highest image contrast obtained by the AF operation.

FIG. 3A illustrates the contents of a visible light image captured by the CMOS image sensor 29 at this time. FIG. 4A shows a state in which the projected image area PA is located in the screen SC of the entire background and the person PS who is presenting is reflected so as to overlap a part of the projected image area PA. ing.
As described above, since the projection angle of view of the light receiving lens 27 is set to be slightly larger than the maximum zoom angle of view of the projection lens unit 17, the entire projection image can be reliably photographed.

  The imaging control unit 31 extracts a projected image area PA from the captured visible light image (step S103). Specifically, the coordinate positions of the four points A to D of the rectangular corner portion that defines the projection image area PA in the visible light image are detected.

  When extracting the projection image area PA executed by the imaging control unit 31, a rectangular projection image area PA may be cut out by contour extraction processing using only the captured visible light image, and at that time, the projection lens may be extracted. The image may be matched with the image projected from the unit 17.

  Next, the imaging control unit 31 sets the infrared transmission filter 28B of the filter revolver 28 to be inserted into the imaging optical axis between the light receiving lens 27 and the CMOS image sensor 29, and causes the CMOS image sensor 29 to capture an infrared image ( Step S104).

  FIG. 3B illustrates the contents of an infrared image captured by the CMOS image sensor 29 at this time. In FIG. 5B, the face portion FC of the person PS where the skin is particularly exposed and the portions HD and HD ahead of the wrist can be detected on the image as objects emitting infrared rays.

  The imaging control unit 31 performs face detection processing (face position detection processing) on the infrared image obtained in this manner based on an instruction from the CPU 34, and extracts only the face portion FC (step S105).

  This is executed by a face detection program (face position detection algorithm) stored in the program memory 36.

  The program memory 36 also stores, for example, a database that stores the relative size, positional relationship, and the like of each part (portion from the face and wrist) of a general person.

  Based on the face detection program, the CPU 34 compares the shape of the detected person PS with the database, determines and identifies which part the face part and the part beyond the wrist correspond to, and determines the face part FC. It is only necessary to extract (detect) only the portion.

  The CPU 34 converts the position of the area of the face portion FC extracted by the photographing control unit 31 into a coordinate range based on the projection image area PA extracted in step S103, whereby the face of the person PS is projected. It is possible to obtain the position corresponding to the position.

  Therefore, after setting the range for masking the face portion FC detected as described above (step S106), the process returns to the processing from step S101.

  Here, the setting of the mask means, for example, when the light image corresponding to each primary color light is formed by the micromirror element 14, each gradation value of the pixel group corresponding to the face portion FC in the image is greatly reduced, “Black” or projection with a very low luminance equivalent thereto is assumed.

  Thereafter, when it is determined in step S101 that it is not the detection timing, a light image with the face portion masked is formed by the micromirror element 14 as set in the previous step S106 based on the image signal input from the input unit 11. Then, after the projection lens unit 17 projects the image onto the screen SC (step S107), the process returns to step S101 again.

  FIG. 3C shows the contents of the image projected from the projection lens unit 17 at this time. As shown in the figure, the mask area M1 corresponding to the face portion FC in the projection image area PA is projected with “black” having a luminance of zero or with a very low luminance equivalent thereto. Thereby, it is possible to reliably avoid the dazzling light entering the face portion FC of the person PS who is presenting in front of the screen SC.

  In this way, the above-described processing of FIG. 2 is repeatedly executed, and the projection of an image in which a position portion considered to be a minimum is masked is continued while updating the mask position at an appropriate timing.

  As described above in detail, according to the present embodiment, it is possible to avoid the projection of light onto the person PS standing in front of the screen SC without reducing the area of the projected image more than necessary.

  In the above embodiment, a visible light image is captured separately from the infrared image capturing, and the position of the image projected on the screen is accurately grasped. Therefore, it is possible to reliably avoid the projection of light onto a person standing in front of the screen while minimizing the masking portion.

  In addition, in the above embodiment, since the face position of the person is detected by the face detection process on the infrared image, for example, even if a face is reflected in the image to be projected, it is not affected and is displayed in front of the screen. Projection of light onto the face of a standing person can be reliably avoided.

  Furthermore, in the above-described embodiment, a single imaging optical system combines the visible light image capturing for capturing the range of the projected image and the infrared image capturing for capturing the person standing in front of the screen. Since it was decided to deal with by selectively removing the optical filter inside, it is possible to simplify the overall configuration of the apparatus, and there is no parallax between the visible light image shooting and the infrared image shooting, The accuracy of alignment can be further improved.

  In addition, although not described in the above embodiment, a configuration in which the relationship between the position and range of the image captured through the light receiving lens 27 and the position and range of the image projected through the projection lens unit 17 can be specified in advance. For example, if the configuration is such that parallax (parallax) can be corrected from the distance to the screen, shooting of the visible light image for detecting the position and range of the projected image and subsequent detection processing can be omitted.

  Furthermore, in the above-described embodiment, the visible light transmission filter 28A is used to capture the projected image in the visible light region with the CMOS image sensor 29. However, if the projected image in the visible light region can be captured, the imaging device Depending on the characteristics, the visible light transmission filter may be a simple opening.

  In the above embodiment, the case where the present invention is applied to a DLP data projector apparatus has been described. However, the present invention does not limit the projector system or the like, and other types of projection apparatuses or various electronic devices having a projection function. It can be similarly applied to the above.

  In addition, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the functions executed in the above-described embodiments may be combined as appropriate as possible. The above-described embodiment includes various stages, and various inventions can be extracted by an appropriate combination of a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, if the effect is obtained, a configuration from which the constituent requirements are deleted can be extracted as an invention.

  The invention described in the claims of the present application of the present application will be appended below.

  According to the first aspect of the present invention, a projection unit that projects an image according to an input image signal toward a projection target, an infrared image in the image projection direction by the projection unit, and an infrared image obtained by shooting The human body shape detecting means for detecting the shape of the area where the human body is present and the shape of the human body area detected by the human body shape detecting means, and the luminance of the corresponding area in the image projected by the projecting means is reduced. And a projection control means.

  According to a second aspect of the present invention, in the first aspect of the present invention, a projection range detection is performed in which a visible light image in the image projection direction by the projection unit is photographed and a range of the projected image is detected from the photographed image. Means for projecting the projection means based on the shape of the human body region detected by the human body shape detection means for the range of the projection image detected by the projection range detection means in the image projected by the projection means. It is characterized in that the luminance of the corresponding area is reduced.

  The invention according to claim 3 is the invention according to claim 1 or 2, characterized in that the human body shape detecting means detects the shape of the face area of a person by face detection processing from an infrared image. Features.

  According to a fourth aspect of the present invention, in the invention according to any one of the first to third aspects, the human body shape detecting means selectively selects a filter that transmits infrared rays with respect to an imaging optical system that captures the projection direction. It is characterized in that it is inserted and an image is taken.

  According to a fifth aspect of the present invention, in the invention of the second or third aspect, the human body shape detecting means and the projection range detecting means are configured so that the human body shape detecting means is an infrared ray for one imaging optical system for photographing the projection direction. An image is photographed by selectively inserting a first filter that transmits light and a second filter that transmits visible light in the projection range detection means.

  The invention according to claim 6 is a projection method in an apparatus including a projection unit that projects an image according to an input image signal toward a projection target, and an infrared image in an image projection direction by the projection unit is obtained. Corresponding to the shape of the human body shape detected in the human body shape detection step, and the shape of the human body region detected in the human body shape detection step, and projected by the projection unit And a projection control step for reducing the luminance of the corresponding area in the image.

  The invention according to claim 7 is a program executed by a computer built in an apparatus including a projection unit that projects an image according to an input image signal toward a projection target, and the program is stored in the projection unit. Corresponding to the shape of the human body region detected by the human body shape detecting means, and the human body shape detecting means for detecting the shape of the region where the human body exists from the infrared image obtained by shooting the infrared image of the image projection direction by And it is made to function as a projection control means which reduces the brightness | luminance of the applicable area | region in the image projected by the said projection part.

  DESCRIPTION OF SYMBOLS 10 ... Data projector apparatus, 11 ... Input part, 12 ... Projection image conversion part, 13 ... Projection image drive part, 14 ... Micromirror element, 15 ... Light source part, 16 ... Mirror, 17 ... Projection lens part, 19 ... Green laser Diode (G-LD), 20 ... Red light emitting diode (R-LED), 21 ... Blue laser diode (B-LD), 22 ... Dichroic mirror, 23 ... Integrator, 24 ... Dichroic mirror, 25 ... Mirror, 26 ... Projection Light drive unit, 27 ... light receiving lens, 28 ... filter revolver, 28A ... visible light transmission filter, 28B ... infrared transmission filter, 29 ... CMOS image sensor, 30 ... A / D converter, 31 ... photographing control unit, 32 ... filter Motor (M), 34 ... CPU, 35 ... main memory, 36 ... program memory, 37 ... operation unit, 38 ... Voice processing unit, 39 ... speaker, SB ... system bus.

Claims (7)

Projection means for projecting an image according to an input image signal toward a projection target;
Human body shape detection means for capturing an infrared image in the direction of image projection by the projection means and detecting the shape of a region where a human body exists from the infrared image obtained by photographing,
A projection apparatus comprising: a projection control unit that reduces the luminance of a corresponding region in an image projected by the projection unit corresponding to the shape of the human body region detected by the human body shape detection unit. A visible range image is captured in the image projection direction by the projection unit, and further includes a projection range detection unit that detects a range of the projection image from the captured image.
The projection control unit reduces the luminance of the corresponding region in the image projected by the projection unit based on the shape of the human body region detected by the human body shape detection unit with respect to the range of the projection image detected by the projection range detection unit. The projection apparatus according to claim 1, wherein:   The projection apparatus according to claim 1, wherein the human body shape detecting means detects the shape of a human face region from an infrared image by face detection processing.   The said human body shape detection means image | photographs an image by selectively inserting the filter which permeate | transmits infrared rays with respect to the imaging optical system which image | photographs a projection direction, The imaging | photography is characterized by the above-mentioned. Projection device.   The human body shape detecting unit and the projection range detecting unit transmit a first filter that transmits infrared rays in the human body shape detecting unit and visible light in the projection range detecting unit with respect to one imaging optical system that captures the projection direction. The projection apparatus according to claim 2, wherein the second filter is selectively inserted to capture an image. A projection method in an apparatus including a projection unit that projects an image according to an input image signal toward a projection target,
A human body shape detection step of capturing an infrared image in the image projection direction by the projection unit, and detecting a shape of a region where a human body exists from the infrared image obtained by shooting,
A projection method comprising: a projection control step for reducing the luminance of a corresponding region in an image projected by the projection unit corresponding to the shape of the human body region detected in the human body shape detection step. A program executed by a computer built in an apparatus including a projection unit that projects an image according to an input image signal toward a projection target,
The above program
Taking an infrared image in the image projection direction by the projection unit, detecting a shape of a region where a human body exists from an infrared image obtained by the imaging, and a human body region detected by the human body shape detection unit A program that functions as a projection control unit that corresponds to a shape and reduces the luminance of a corresponding region in an image projected by the projection unit.

Images