JP2020072357A - Projection apparatus and projection method - Google Patents

Abstract

To provide a projection apparatus capable of displaying an OSD of the projection apparatus in an easy-to-see manner while maintaining the image quality improving effect, and displaying a projected image on an object to be observed in order to obtain the effect of improving the image quality of the object to be observed.SOLUTION: A projection apparatus includes OSD superimposing means that generates a second image by superimposing the OSD on a first image, projection means that projects the second image, reflectance acquisition means that acquires the reflectance of a projection surface on which the second image is projected, search means that searches a region where the spatial frequency of the reflectance of the projection surface is a predetermined value or less, and the reflectance on the projection surface is a predetermined value or more on the basis of the reflectance acquired from the reflectance acquisition means, and OSD superimposing region determining means that determines a region where the OSD is superimposed from the region searched by the search means. The OSD superimposing means superimposes the OSD on the region determined by the OSD superimposing region determining means.SELECTED DRAWING: Figure 6

Description

  The present invention relates to a projection device and a projection method.

  2. Description of the Related Art In recent years, there has been an increasing number of opportunities to handle a natural subject photographed with a digital camera or the like as a high dynamic range image (hereinafter referred to as an HDR image) having a high dynamic range. It is required to faithfully reproduce an HDR image with respect to human vision, and if it can be faithfully reproduced, the expressiveness of colors, gradations, textures, etc. will increase, so its use is expected. ..

On the other hand, although the display capability of various types of direct-view devices such as liquid crystal displays and organic EL is evolving, its reproduction range is generally about 1 to 1000 cd / m ² . Therefore, in order to reproduce an HDR image exceeding 1000 cd / m ² with these devices, it is necessary to perform gradation compression processing called tone mapping. In such a case, the dynamic range originally possessed by the HDR image cannot be fully expressed.

  Therefore, for the purpose of expanding the dynamic range of luminance, a technique has been proposed in which the contrast is improved by projecting on a printed matter with a projection device (Patent Document 1).

  In the related art, it is possible to expand the dynamic range of the luminance of the observed object by projecting the projected image of the projection device onto the observed object (for example, the printed matter on which the image is printed) so as to overlap.

  In order to superimpose the projected image of the projection device on a desired position of the object to be observed, the lens shift position adjustment function, the focus adjustment function, the trapezoidal correction function of the projected image, and the like of the projection device are generally used. In addition, the color and brightness of the projected image of the projection device are also adjusted so that the object to be observed has a desired appearance.

  In order to control various functions of such a projection device, a user of the projection device generally performs a work of projecting an OSD (On Screen Display) from the projection device and operating the OSD.

  On the other hand, there is a method of correcting the projected image so that even when the projection device projects onto a projection target with a pattern, it looks the same as when projected onto a projection target with uniform white (hereinafter, pattern color correction (Patent Document 2).

JP, 2008-83180, A WO05 / 057941 Publication

  However, according to the technique disclosed in the above-mentioned patent document, in the projection device that displays the projected images in order to obtain the image quality improving effect of the object to be observed, the OSD of the projection device is displayed in an easy-to-see manner while maintaining the image quality improving effect. Was difficult. This is because if the pattern color correction is performed using the conventional technique to make the OSD easier to see, the pattern color correction is performed on the entire area of the projected image, and the color or pattern of the observed object is canceled by the projected image. This is because it ends up.

  Therefore, an object of the present invention is to make it possible to easily display the OSD of the projection device while maintaining the image quality improving effect in a projection device that displays the projected image on the observed object in order to obtain the image quality improving effect of the observed object. It is to provide a projection device.

In order to achieve the above object, the projection device according to the present invention comprises:
The OSD superimposing means for generating a second image by superimposing the OSD on the first image, the projecting means for projecting the second image, and the reflectance of the projection surface on which the second image is projected are Based on the reflectance acquisition means to be acquired and the reflectance acquired from the reflectance acquisition means, the spatial frequency of the reflectance in the projection surface is a predetermined value or less, and the reflectance on the projection surface is a predetermined value. The above-described OSD superimposing means includes a searching means for searching the area and an OSD superimposing area determining means for determining an area where the OSD is to be superposed from the areas searched by the searching means. The OSD is superimposed on the determined area.

  ADVANTAGE OF THE INVENTION According to the projection device which concerns on this invention, in a projection device which superimposes a projection image on a to-be-observed object in order to obtain the image quality improvement effect of a to-be-observed object, OSD of a projection device is displayed in an easy-to-see manner, maintaining the image quality improvement effect. can do.

An example of an image display system using the projection device 100 in the present invention The figure which shows the whole structure of the projection apparatus 100 of a present Example. The figure which shows the internal structure of the image processing part 140. Flowchart when the projection device 100 according to the present invention projects an OSD The figure which shows the differential amount map and reflectance map of the image IMG_P in this invention. The figure which the projection apparatus 100 in this invention showed the projection position of OSD. Another flow diagram when the projection device 100 according to the present invention projects an OSD A flow chart when the projection apparatus 100 according to the present invention projects an OSD outside a print image area by lens shift. The figure which showed the OSD position when the projection apparatus 100 in this invention projects OSD outside a printing image area by lens shift. Flowchart when the projection device 100 according to the present invention projects the OSD outside the print image area by optical zoom The figure which shows the OSD position at the time of the projection apparatus 100 in this invention projecting OSD outside a printing image area by optical zoom.

  Hereinafter, examples of the present invention will be described in detail with reference to the drawings, but the present invention is not limited to the following embodiments. It should be noted that the following embodiments do not limit the invention according to the claims, and all combinations of the features described in the embodiments are not necessarily essential to the solution means of the invention.

  Note that each functional block described in this embodiment does not necessarily have to be individual hardware. That is, for example, the functions of some functional blocks may be executed by one piece of hardware. Further, the functions of one functional block or the functions of a plurality of functional blocks may be executed by the cooperative operation of some hardware. Further, the function of each functional block may be executed by a computer program loaded on the memory by the CPU.

  FIG. 1 is an example of an image display system using a projection device 100 according to the present invention.

  The projection device 100 performs a predetermined image processing on the image PD input to itself, and then projects the image PD on the display surface. Details of the internal operation of the projection device 100 will be described later.

  The printer 101 prints the image PD and outputs the print image 102. The print image 102 is arranged on the projection surface of the projection device 100.

  The projection image 103 projected by the projection device is projected so as to be superimposed on the print image 102 arranged on the display surface.

  As described above, by projecting the projection image 103 based on the print image 102, the dynamic range of the brightness of the print image 102 can be improved.

  Note that the projected image 103 does not have to be substantially the same image as the printed image, and may be, for example, a so-called grayscale image in which only the luminance component of the image PD is extracted. In addition, it may be an image that uniformly improves the reflectance of the printed image.

  In the present embodiment, the object to be observed is the print image 102, and a mode in which the projection image 103 is projected on the print image 102 will be described, but the object to be observed is not limited to this. If the projected image 103 improves the dynamic range of the reflectance of the object to be observed or uniformly improves the reflectance, the object to be observed may have any form, for example, a painting or a wall of a building. Good.

  FIG. 2 is a diagram showing the overall configuration of the projection apparatus 100 of this embodiment.

  The projection device 100 of this embodiment includes a CPU 110, a ROM 111, a RAM 112, an operation unit 113, an image input unit 130, and an image processing unit 140. The projection apparatus 100 further includes a liquid crystal controller 150, liquid crystal elements 151R, 151G, 151B, a light source controller 160, a light source 161, a color separator 162, a color synthesizer 163, an optical system controller 170, and a projection optical system 171. Have. In addition, the projection device 100 further includes a communication unit 193 and an imaging unit 194.

  The CPU 110 controls each operation block of the projection apparatus 100, the ROM 111 stores a control program describing the processing procedure of the CPU 110, and the RAM 112 temporarily stores the control program and data as a work memory. Is done. Further, the OSD is also recorded in the ROM 111. The CPU 110 can also temporarily store the still image data and the moving image data received from the communication unit 193, and use the program stored in the ROM 111 to play each image and video. Further, the image or video obtained by the image pickup unit 194 can be temporarily stored in the RAM 112.

  The operation unit 113 receives a user's instruction and transmits an instruction signal to the CPU 110, and includes, for example, a switch and a dial. In addition, the operation unit 113 may be, for example, a signal receiving unit (such as an infrared receiving unit) that receives a signal from a remote controller, and may transmit a predetermined instruction signal to the CPU 110 based on the received signal. Further, the CPU 110 receives a control signal input from the operation unit 113 or the communication unit 193, and controls each operation block of the projection device 100.

  The image input unit 130 receives an image transmitted from an external device. Here, the external device may be any device such as a personal computer, a camera, a mobile phone, a smart phone, a hard disk recorder, and a game machine as long as it can output an image signal.

  The image processing unit 140 changes the number of frames, the number of pixels, the pixel value, the image shape, and the like of the image signal received from the video input unit 130 and transmits the image signal to the liquid crystal control unit 150. It consists of a microprocessor. The image processing unit 140 does not have to be a dedicated microprocessor, and the CPU 110 may execute the same process as the image processing unit 140, for example, by a program stored in the ROM 111. The image processing unit 140 can perform functions such as frame thinning processing, frame interpolation processing, resolution conversion (scaling) processing, distortion correction processing (keystone correction processing), luminance correction processing, and color correction processing. The image processing unit 140 can also generate a desired test pattern image and send it to the liquid crystal control unit 150. In addition to the image signal received from the video input unit 130, the image processing unit 140 can also perform the above-described change processing on the image or video reproduced by the CPU 110. In addition, the image processing unit 140 can superimpose the OSD stored in the ROM 111 in advance on the image signal received from the video input unit 130 and output it.

  The liquid crystal control unit 150 controls the voltage applied to the liquid crystal of the pixels of the liquid crystal elements 151R, 151G, and 151B based on the image signal output from the image processing unit 140, and the transmittance of the liquid crystal elements 151R, 151G, and 151B. Adjust.

  The liquid crystal element 151R is a liquid crystal element corresponding to red, and of the light output from the light source 161, the light separated into red (R), green (G), and blue (B) by the color separation unit 162. Among them, it is for adjusting the transmittance of red light. The liquid crystal element 151G is a liquid crystal element corresponding to green, and of the light output from the light source 161, the light separated into red (R), green (G), and blue (B) by the color separation unit 162. Among them, it is for adjusting the transmittance of green light. The liquid crystal element 151B is a liquid crystal element corresponding to blue, and of the light output from the light source 161, the light separated into red (R), green (G), and blue (B) by the color separation unit 162. Among them, it is for adjusting the transmittance of blue light.

  The light source control unit 160 controls ON / OFF of the light source 161 and the amount of light, and includes a control microprocessor. Further, the light source control unit 160 does not need to be a dedicated microprocessor, and for example, the CPU 110 may execute the same processing as the light source control unit 160 by a program stored in the ROM 111. The light source 161 outputs light for projecting an image on a screen (not shown), and may be, for example, a halogen lamp, a xenon lamp, a high pressure mercury lamp, or the like. The color separation unit 162 separates the light output from the light source 161 into red (R), green (G), and blue (B), and includes, for example, a dichroic mirror or a prism. The color separation unit 162 is not necessary when an LED or the like corresponding to each color is used as the light source 161. The color synthesizing unit 163 synthesizes the red (R), green (G), and blue (B) light transmitted through the liquid crystal elements 151R, 151G, and 151B, and includes, for example, a dichroic mirror or a prism. .. The light obtained by combining the red (R), green (G), and blue (B) components by the color combining unit 163 is sent to the projection optical system 171. At this time, the liquid crystal elements 151R, 151G, and 151B are controlled by the liquid crystal control unit 150 so that the liquid crystal elements 151R, 151G, and 151B have the transmittance of light corresponding to the image input from the image processing unit 140. Therefore, when the light combined by the color combining unit 163 is projected onto the screen by the projection optical system 171, an image corresponding to the image input by the image processing unit 140 is displayed on the screen.

  The optical system controller 170 controls the projection optical system 171, and includes a control microprocessor. Further, the optical system controller 170 does not have to be a dedicated microprocessor, and the CPU 110 may execute the same processing as the optical system controller 170, for example, by a program stored in the ROM 111. The projection optical system 171 is for projecting the combined light output from the color combining unit 163 on the screen, and includes a plurality of lenses and a lens driving actuator. By driving the lenses by the actuator, It is possible to perform enlargement, reduction, focus adjustment, etc. of the projected image. Furthermore, by shifting the lens position, the projection position of the projected image can be moved, which is called lens shift. The shift direction and shift amount of the lens shift are based on an instruction from the optical system control unit 170.

  The communication unit 193 is for receiving control signals, still image data, moving image data, etc. from an external device, and may be, for example, a wireless LAN, a wired LAN, a USB, Bluetooth (registered trademark), or the like. The method is not particularly limited. If the terminal of the image input unit 130 is, for example, an HDMI (registered trademark) terminal, CEC communication may be performed via the terminal. Here, the external device may be any device such as a personal computer, a camera, a mobile phone, a smartphone, a hard disk recorder, a game console, and a remote controller, as long as it can communicate with the projection device 100. ..

  The image capturing unit 194 captures an image signal by capturing the periphery of the projection device 100 according to the present exemplary embodiment, and can capture an image projected through the projection optical system 171 (capturing in the screen direction). .. The image capturing unit 194 transmits the obtained image or video to the CPU 110, and the CPU 110 temporarily stores the image or video in the RAM 112 and converts the image or video into still image data or moving image data based on the program stored in the ROM 111. Convert. The imaging unit 194 is obtained by a lens that acquires an optical image of a subject, an actuator that drives the lens, a microprocessor that controls the actuator, an imaging device that converts the optical image acquired through the lens into an image signal, and an imaging device. It is composed of an AD conversion unit for converting an image signal into a digital signal.

  The image processing unit 140, the liquid crystal control unit 150, the light source control unit 160, and the optical system control unit 170 of this embodiment may be a single or a plurality of microprocessors capable of performing the same processing as those of these blocks. good. Alternatively, for example, the CPU 110 may execute the same processing as that of each block by a program stored in the ROM 111.

  Next, the internal configuration of the image processing unit 140 will be described with reference to FIG.

  The image processing unit 140 includes a pre-processing unit 141, an OSD superposition unit 142, a memory control unit 143, an image memory 144, a pattern generation unit 145, and a post-processing unit 146. Each unit that constitutes the image processing unit 140 is connected to the CPU 110 via a register bus 199.

  The preprocessing unit 141 converts the image input from the image input unit 130 into a color space and resolution suitable for the liquid crystal elements 151R, 151G, and 151B. Specifically, display layout conversion processing including color space conversion, enlargement / reduction processing, and image shift processing is performed. The image shift process is an image process in which an image in a projection region is moved vertically and horizontally, a portion protruding from the projection region is trimmed, and a black edge region is added to a region where there is no image.

  The OSD superimposing unit 142 can superimpose the OSD stored in the ROM 111 in advance on the image signal input to the OSD superimposing unit 142 and output the superposed OSD.

  The memory control unit 143 performs conversion processing on the time axis such as IP conversion and frame rate conversion, issue of a memory address of the image memory 144 used for shape correction of the projected image, and writing / reading control of the image. .. The frame rate conversion process of the memory control unit 143 also includes a frame rate doubling process realized by reading the same image twice from the image memory 144.

  The pattern generation unit 145 can generate a desired image pattern such as a white or black entire surface or a gradation image according to an instruction from the CPU 110, and output it to the post-processing unit 146.

  The post-processing unit 146 performs correction processing such as display unevenness (color unevenness, brightness unevenness) and disclination due to the liquid crystal elements 151R, G, and B and the projection optical system 171. Further, image processing such as gamma conversion matching the gradation of the liquid crystal element 151 is performed.

  Here, the operation of each unit when the projection apparatus 100 of the present invention displays the OSD will be described with reference to the flowchart of FIG.

  Upon receiving an instruction to display the OSD from the user of the projection apparatus 100 via the operation unit 113, each unit of the projection apparatus 100 executes the operation described in this flowchart.

  First, in step S101, the CPU 110 instructs the pattern generation unit 145 to generate a test pattern whose entire surface is black. The pattern generation unit 145 outputs the test pattern generated according to the instruction from the CPU 110 to the post-processing unit 146. After being output from the image processing unit 140, the test pattern is formed on the liquid crystal elements 151R, 151G, and 151B by the liquid crystal control unit 150 and projected via the projection optical system 171.

  Next, in S102, the CPU 110 instructs the imaging unit 194 to capture an image in the direction in which the image is projected from the projection device 100. The image capturing unit 194 captures a direction in which a video image is projected from the projection device 100, and records the captured image IMG_B in the RAM 111.

  In step S103, the CPU 110 instructs the pattern generation unit 145 to generate a test pattern whose entire surface is white. The pattern generation unit 145 outputs the test pattern generated according to the instruction from the CPU 110 to the post-processing unit 146. After being output from the image processing unit 140, the test pattern is formed on the liquid crystal elements 151R, 151G, and 151B by the liquid crystal control unit 150 and projected via the projection optical system 171.

  Next, in S104, the CPU 110 instructs the image capturing unit 194 to capture an image in the direction in which the image is projected from the projection device 100. The image capturing unit 194 captures a direction in which an image is projected from the projection device 100, and records the captured image IMG_W in the RAM 111.

  Next, in S105, the CPU 110 detects the projection area of the projection image of the projection device 100 in the captured images IMG_B and IMG_W. Specifically, the difference between IMG_B and IMG_W is calculated, and the area having a difference equal to or larger than a predetermined value is determined as the projection area of the projection image of the projection device 100.

  Next, in S106, the CPU 110 performs projective transformation on the captured image IMG_B to create an image IMG_P transformed so that the projection area of the projection device detected in S105 becomes a rectangle. In the image IMG_P created by the above procedure, the pattern of the print image 102 in the projection area of the projection device 100 is recorded.

  Next, in S107, the CPU 110 calculates the spatial frequency distribution of the print image 102 in the projection area of the projection device 100 based on the gradation value of the image IMG_P in the following procedure.

  First, the CPU 110 performs a differentiation process on the image IMG_P. The differential process is, for example, a process of obtaining a differential value (gradation change amount) between pixels from the difference between pixel values of adjacent pixels. Next, the CPU 110 divides the image IMG_P into a plurality of areas (A1 to A25) as shown in FIG. 5A, and uses the result of the differential processing for each area to show it in FIG. 5B. Create a differential amount map like this. The value shown for each area (A1 to A25) is the total differential amount (total differential value) obtained by adding the differential values of the pixels in the divided area. Note that the amount of division of this area is not limited to this example, and may be divided in any manner, and it is desirable that the area be in accordance with the size of the projected OSD.

  Next, in S108, the CPU 110 calculates the reflectance distribution of the print image 102 in the projection area of the projection device 100 based on the gradation value of the image IMG_P. Specifically, the CPU 110 creates a reflectance map recording the average reflectance in the area as shown in FIG. 6C for each of the areas (A1 to A25) described above.

  Next, in step S109, the CPU 110 determines the OSD overlapping area by the following procedure.

  First, the CPU 110 searches the differential amount map and the reflectance map for a region where the spatial frequency in the image IMG_P is equal to or lower than the threshold and the reflectance is equal to or higher than the threshold. For example, if the threshold value of the differential amount in this embodiment is 15 and the threshold value of the reflectance is 60, the areas A22, A24, and A25 are the areas searched by the CPU 110. Here, when a plurality of areas are searched by the CPU 110, the CPU 110 changes the threshold value of the differential amount or the threshold value thereof or both of them stepwise until the searched area is narrowed down to one. For example, assuming that the threshold value of the differential amount is 5, the CPU 110 has only the area A25 that satisfies the condition.

  Then, the CPU 110 determines the searched area (A25 in this embodiment) as the OSD superposition area and notifies the OSD superposition unit 142 of the area.

  On the other hand, if none of the areas A1 to A25 satisfies the above-described condition, the CPU 110 steps the threshold value of the differential amount or the threshold value of the reflectance or both of them until one area is searched. However, the area may be changed to the OSD overlapping area. Alternatively, the CPU 110 may determine the area in which the OSD was displayed last time as the overlapping area of the OSD.

  Next, in S110, the OSD superimposing unit 142 superimposes the OSD on its own input image so that the OSD is projected onto the area determined by the CPU 110 in S109.

  Next, in S111, the image signal on which the OSD is superposed by the OSD superposing unit 142 is output from the image processing unit 140 and then formed on the liquid crystal elements 151R, 151G, and 151B by the liquid crystal control unit 150, and the projection optical system. Projected via 171.

  Here, an example in which the OSD 200 is projected and displayed in the area A25 is shown in FIG. When the OSD 200 is projected on the area A1 having a low spatial frequency but a low reflectance (FIG. 6B), or when the OSD 200 is projected on an area A21 having a high reflectance but a high spatial frequency (FIG. 6C). It is possible to display the OSD more easily than in the case of.

  As described above, according to the present embodiment, in the projection apparatus 100 that displays the projection image on the observed object in order to obtain the effect of improving the image quality of the observed object, the projection apparatus maintains the image quality improving effect. The OSD of 100 can be displayed easily.

  It should be noted that, so far, it is assumed that when the respective units configuring the projection apparatus 100 receive an instruction to display the OSD from the user of the projection apparatus 100 via the operation unit 113, the operations described in the flowchart of FIG. 4 are performed. However, it is not limited to this. For example, the steps of S101 to S109 may be performed in advance after the user completes the installation of the projection device 100 and the alignment of the print image 102 and the projection image 103. In this way, when the projection device 100 receives an instruction to display the OSD from the user of the projection device 100 via the operation unit 113, only the operation of step S110 needs to be performed.

  Further, in the present embodiment, an example has been described in which the OSD display position is determined by searching for a region in the projection region of the projection device 100 having a low spatial frequency and high reflectance on the basis of the image IMG_P. The image to be searched is not limited to IGM_P. For example, the CPU 110 may search the display position of the OSD image based on the captured image IMG_B or IMG_P before the projective transformation. When an image related to the object to be observed (image PD or an image related to the image PD) is input to the projection device 100 as in the embodiment shown in FIG. 1, the CPU 110 is input to the projection device 100. The image to be searched may be the search target. This is because it can be determined that a region having a low spatial frequency and a high luminance of an image related to the observed object is equal to a region having a low spatial frequency and a high luminance of the observed object.

  Further, the CPU 110 may acquire the spatial frequency distribution and the reflectance distribution of the print image 102 in the projection area from the external device via the communication unit 193.

  Another operation example in which the projection apparatus 100 of the present invention determines the position where the OSD is displayed will be described. Note that the configuration of each unit configuring the projection device 100 is the same as that described in the first embodiment, and thus the description thereof will be omitted.

  Here, the operation of each unit when the projection apparatus 100 according to the present embodiment displays the OSD will be described with reference to the flowchart of FIG. 7.

  Upon receiving an instruction to display the OSD from the user of the projection apparatus 100 via the operation unit 113, each unit of the projection apparatus 100 executes the operation described in this flowchart.

  The operation of each unit of the projection device 100 in S201 to S208 is the same as S101 to S108 in FIG.

  In step S209, the CPU 110 determines the type of OSD that received the display instruction. The OSD type displays, for example, an OSD related to adjustment of the projection image 103 such as adjustment of brightness, saturation, or adjustment of image deformation, and information such as a timing format of an image input to the projection device 100. For example, OSD for doing so can be mentioned. Here, when the CPU 110 determines that the OSD to be displayed is the OSD related to the adjustment of the projection image 103, the process proceeds to S210. On the other hand, when the CPU determines that the OSD to be displayed is not the OSD related to the adjustment of the projected image 103, the process proceeds to S211.

  Next, in S210, the CPU 110 detects a region of the projection image 103 projected on the observed object 102, which is a main adjustment target of the image quality item adjusted via the OSD. For example, when the OSD to be displayed is the OSD for adjusting the brightness of the projected image 103, the CPU 110 detects a region in the projected image 103 where the brightness is equal to or higher than a predetermined value. As another example, when the OSD to be displayed is the OSD for adjusting a specific color of the projected image, the CPU 110 causes the CPU 110 to have a predetermined number of pixels displaying the color to be adjusted in the image projected image 103. The area included above is detected. As another example, when the OSD to be displayed is an OSD for deforming a part of the shape of the projected image, the CPU 110 detects the area to be deformed in the projected image 103.

  In this example, it is assumed that the OSD to be displayed adjusts the blue hue of the projection image 103, and the CPU 110 causes the blue pixels to be projected on the areas A24 and A25 of the projection surface of the projection image 103. The description will be continued assuming that it is detected that a predetermined number or more is included.

  Next, in step S211, the CPU 110 determines the OSD overlapping area by the following procedure.

  First, the CPU 110 searches the differential amount map and the reflectance map for a region where the spatial frequency in the image IMG_P is equal to or lower than a predetermined value and the luminance is equal to or higher than the predetermined value. For example, when the threshold value of the differential amount in this embodiment is 15 and the threshold value of the luminance is 60, the areas A22, A24 and A25 are searched by the CPU 110. The CPU 110 notifies the OSD superimposing unit 142 of the searched area.

  When a plurality of areas (A22, A24, A25) are searched as in this example, the CPU 110 is a main adjustment target of the image quality item adjusted via the OSD from the searched area detected in S210. If the OSD is an OSD that adjusts the blue hue of the projected image 103 as in this example that excludes regions, the pixels that display the color to be adjusted in the image projected image 103 detected by the CPU 110 in S210. Areas including a predetermined number or more are excluded from the OSD overlapping area candidates. In this example, the CPU 110 excludes the areas A24 and A25, determines the remaining area A22 as the overlapping area of the OSD overlapping area candidate OSD, and notifies the OSD overlapping unit 142 of the overlapping area.

  The main operation of the CPU 110 is the same when the OSD is an OSD for adjusting the brightness of the projection image 103 or an OSD for deforming a part of the shape of the projection image.

  The operation of each unit of the projection apparatus 100 in S212 to S213 is the same as S110 to S111 in FIG.

  As described above, by operating the respective units of the projection apparatus 100, the OSD of the projection apparatus 100 can be easily seen while maintaining the image quality improving effect, and the OSD can control the area where the user adjusts the projection image 103 via the OSD. It can be projected without hiding.

  Further, in S211, when the CPU 110 still has a plurality of regions that are display candidates for the OSDs, the CPU 110 preferably determines the region as close as possible to the region in which the OSD is displayed last time as the OSD overlapping region.

  In the first and second embodiments, the projection device 100 displays the OSD at the optimum position on the observed object. However, depending on the state of the object to be observed, the OSD may not be easy to see at any position. In the present embodiment, a method will be described in which the OSD is superimposed on the outside of the print image area by lens shift and the OSD is displayed in an easy-to-see manner while maintaining the image quality improving effect as much as possible.

  Note that the configuration of each unit that configures the projection device 100 is the same as that described in the first embodiment, and thus the description thereof is omitted.

  The operation of each unit when the projection apparatus 100 according to the present embodiment displays the OSD will be described with reference to the flowchart of FIG.

  Upon receiving an instruction to display the OSD from the user of the projection apparatus 100 via the operation unit 113, each unit of the projection apparatus 100 executes the operation described in this flowchart.

  The operation of each unit of the projection device 100 in S101 to S106 and S109 is the same as that in the first embodiment, and thus the description thereof is omitted.

  In step S801, it is determined from the positions of the projection area and the print image detected in step S105 whether or not the OSD can be superimposed outside the print image area. For example, when the print image area in the projection area is less than a certain ratio, it is determined that OSD superimposition is possible. If OSD superimposition is possible, the process proceeds to step S804 to superimpose the OSD without lens shift control, and if OSD superimposition is not possible, the process proceeds to step S802 to perform lens shift control to superimpose the OSD.

  In step S802, the CPU 110 determines the lens shift direction (vertical and horizontal) and the lens shift amount.

  As the lens shift direction, a direction suitable for OSD superposition is determined from the captured image (including the peripheral area of the print image) captured in S102. Specifically, an analysis using the differential amount map and the reflectance map in IMG_P described in the first embodiment is performed to determine the position where the OSD is easy to see. However, in this embodiment, not the area of the print image 102 but the peripheral area thereof is analyzed. Then, the lens is shifted in the direction determined as the area suitable for the OSD superposition. Although the method of determining the lens shift direction has been described here, the lens shift may be performed in a direction preset by the user.

  FIG. 9A shows a state in which the print image and the projection area match each other, and FIG. 9B shows a state in which the lens is shifted rightward. For the lens shift amount 901 in FIG. 9B, a value set by user adjustment may be used, or it may be calculated from the ratio of the sizes of the projected image and the OSD image.

  For example, as shown in FIG. 9B, assume that the size of the projected image is horizontal 1920 pixels × vertical 1200 pixels, and the size of the OSD image is horizontal 384 pixels × vertical 240. At this time, the ratio of the size of the OSD image to the projected image in the horizontal direction is 1/5, and the CPU 110 determines the lens shift amount 901 to be 20%. Based on the determined value, the optical system controller 170 controls the projection optical system 171 to shift the lens by 20% to the right.

  Next, in S803, image shift processing of the projected image is performed. The image shift processing of the projected image is performed by the preprocessing unit 141. For example, when the lens is shifted rightward, the display content of the projection image is also shifted to the right with respect to the print image, and the image quality improving effect is lost. In order to prevent this, the display content of the projected image is shifted to the left. The image shift amount is the lens shift amount determined in S802 converted into the number of pixels, and is 384 pixels equal to the OSD image size in the above example. At this time, since the left 384 pixels of the projected image cannot be projected, the area is trimmed, and the right 384 pixels are projected by adding the black edge area 902 as shown in FIG. 9B.

  In step S804, the OSD is superimposed outside the print image area. As for the case where the lens is shifted, the OSD superimposing unit 142 superimposes the OSD 200 on the black edge region 902 as shown in FIG. 9B added in S803.

  In this way, by shifting the lens, the projection image is appropriately projected on the right fifth region of the print image, so that the OSD of the projection device can be displayed in an easy-to-see manner while maintaining the image quality improving effect as much as possible. .. In the present embodiment, the image shift processing is performed in order to maintain the image quality improvement effect. However, if only the purpose of displaying the OSD in an easy-to-see manner is achieved, the image shift processing in S803 may not necessarily be performed.

  The third embodiment has described the example in which the projection area outside the print image area is provided by the lens shift and the OSD is superimposed on the projection area. In the present embodiment, an example will be described in which a projection area outside the print image area is provided by optical zooming by a lens, and the OSD is superimposed on the projection area.

  The operation of each unit when the projection device 100 according to the present embodiment displays the OSD will be described with reference to the flowchart of FIG.

  Upon receiving an instruction to display the OSD from the user of the projection apparatus 100 via the operation unit 113, each unit of the projection apparatus 100 executes the operation described in this flowchart. Since the flow from S101 to S801 is the same as that of the third embodiment, the description is omitted.

  In step S801, it is determined whether the OSD superimposition can be performed outside the print image area. If not, the process proceeds to step S1001.

  In S1001, the optical zoom magnification and the OSD image size are determined. The optical zoom magnification and the OSD image size are determined so that the OSD can be superimposed on the projection image area outside the print image area obtained by the optical zoom. These may be determined by the trade-off between the zoom limit and the OSD size, but here, as an example, a method of determining the optical zoom magnification from the OSD size will be described.

  For example, FIG. 11A shows a state in which the size of the projected image projected at an optical zoom of 1.0 times is horizontal 1920 pixels × vertical 1200 pixels, and the size and position of the printed image and the projected image match. ing.

  Here, a case where OSDs of horizontal 320 pixels × vertical 200 pixels are superimposed will be described with reference to FIG. In FIG. 11B, the optical zoom is changed to 1.5 times, and the projected image is reduced to 1 / 1.5 times, which is the reciprocal thereof, to provide the black edge area 1101 so that the OSD size can be superimposed. The optical zoom magnification is determined so that the OSD can be superimposed on the black edge area 1101.

  In S1002, the pre-processing unit 141 reduces the projected image by a factor of 1 / 1.5 based on the determination in S1001, and performs image processing with a black edge region 1101 added to the periphery thereof.

  In step S804, the OSD is superimposed outside the print image area. In the case of optical zooming, the OSD superimposing unit 142 superimposes the OSD 200 having the size determined in S1001 on the black edge region 1101 added in S1002.

  In this way, the reduced projection image is appropriately projected on the print image, so that the OSD of the projection device can be displayed in an easy-to-see manner while maintaining the image quality improving effect as much as possible. In the present embodiment, the image reduction processing is performed in order to maintain the image quality improvement effect, but the image reduction processing in S1002 does not necessarily have to be performed if only the purpose of displaying the OSD easily is achieved.

100 projection device, 101 printer, 102 print image, 103 projection image,
110 CPU, 111 ROM, 112 RAM, 130 image input unit,
140 image processing unit, 141 pre-processing unit, 142 OSD superimposing unit,
143 memory control unit, 144 image memory, 145 pattern generation unit,
146 post-processing unit, 150 liquid crystal control unit, 194 image pickup unit

Claims (19)

OSD top means for generating a second image in which the OSD is superimposed on the first image,
Projection means for projecting the second image,
Reflectance acquisition means for acquiring the reflectance of the projection surface on which the second image is projected,
Search for searching a region in which the spatial frequency of the reflectance on the projection surface is a predetermined value or less and the reflectance on the projection surface is a predetermined value or more based on the reflectance acquired from the reflectance acquisition unit. Means and
An OSD overlapping area determining unit that determines an area in which the OSD is to be superimposed from the areas searched by the searching unit;
The projection apparatus, wherein the OSD superimposing means superimposes the OSD on the area determined by the OSD overlapping area determining means.   The said 1st image is an image which improves the dynamic range of the intensity | strength of the reflected light of the said projection surface, The projection apparatus of Claim 1 characterized by the above-mentioned.   The projection device according to claim 1, wherein the first image is an image that uniformly improves the intensity of reflected light on the projection surface in the projection surface.   The projection apparatus according to claim 1, wherein the reflectance acquisition unit acquires the reflectance of the projection surface from a captured image of the projection surface.   The projection apparatus according to claim 1, wherein the reflectance acquisition unit acquires the reflectance of the projection surface calculated from the first image.   The projection apparatus according to claim 1, wherein the reflectance acquisition unit acquires the reflectance characteristic of the projection surface from outside the projection apparatus.   The projection device according to claim 1, wherein the searching unit obtains the spatial frequency of the projection surface by differentiating the reflectance of the projection surface acquired by the reflectance acquisition unit.   When a plurality of areas are searched by the searching means, the OSD overlap area determining means determines one area among the plurality of areas searched by the searching means according to the contents of the OSD, and the OSD overlap area. The projection apparatus according to claim 1, wherein:   When the OSD is an OSD for adjusting the brightness of the projected image, the OSD overlapping area determination means may avoid the area having the highest reflectance among the plurality of areas searched by the searching means. 9. The projection device according to claim 8, wherein a superimposing area is determined.   When the OSD is an OSD for adjusting a specific color of the projected image, the OSD overlapping area determining unit avoids an area including the color to be adjusted among the plurality of areas searched by the searching unit. 9. The projection apparatus according to claim 8, wherein the OSD overlapping position is determined as described above.   The said OSD superposition area | region determination means determines the area | region near the position previously determined as an OSD superposition position among the some area | regions which the said search means searched as an OSD superposition position. Projection device. Generating a second image in which the OSD is superimposed on the first image;
Projecting the second image,
Acquiring the reflectance of the projection surface on which the second image is projected;
Based on the reflectance of the projection surface, the spatial frequency of the reflectance on the projection surface is a predetermined value or less, and the step of searching for a search region having a reflectance of a predetermined value or more,
Determining an area in which the OSD is superimposed on the first image from the searched area;
Image projection method consisting of. OSD superimposing means for generating a second image by superimposing the OSD on the first image,
Projection means for projecting the second image,
A reflectance acquisition means for acquiring the reflectance including the projection surface on which the second image is projected and the peripheral area thereof;
Based on the reflectance acquired from the reflectance acquisition means, a search for a region in which the spatial frequency of the reflectance including the projection surface and its surrounding area is a predetermined value or less and the reflectance is a predetermined value or more. Means and
OSD overlapping area determining means for determining an area in which the OSD is to be superimposed in the area searched by the searching means;
The projection plane control means for changing the position of the projection plane by optical control is provided,
When the area determined by the OSD overlapping area determining means is a peripheral area of the projection surface, the projection surface controlling means changes the position of the projection surface to an area including the peripheral area, and the OSD overlapping area determining means determines the area. A projection device, characterized in that the OSD is superimposed on a defined area.   14. The projection device according to claim 13, wherein the projection plane control means is lens shift control.   15. The projection device according to claim 14, wherein the projection plane control unit determines the lens shift amount from the OSD size determined by the OSD overlapping region determination unit. An image shift processing means for shifting the image is provided,
According to the lens shift direction and the lens shift amount determined by the projection plane control means, the image shift processing is performed in the opposite direction to the lens shift, and the amount equal to the lens shift amount,
The projection apparatus according to claim 15, wherein the third image processed by the shift processing unit is generated and projected.   14. The projection apparatus according to claim 13, wherein the projection plane control means is an optical zoom control.   18. The projection apparatus according to claim 17, wherein the projection plane control unit determines the optical zoom magnification from the size of the OSD determined by the OSD overlapping region determination unit. An image reduction processing means for reducing the image is provided,
19. The image reduction processing is performed at a magnification that is the reciprocal of the optical zoom determined by the projection surface control means, and a third image processed by the image reduction processing means is generated and projected. The projection device according to.