JP5298738B2 - Image display system and image adjustment method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display system and an image adjustment method which can adjust display images inexpensively in a short period of time. <P>SOLUTION: The image display system for displaying one composite image composed of first and second display images includes: first and second image display devices for displaying a first display image and a second display image, respectively, which include a first reference pattern and a second reference pattern, respectively; an image capturing apparatus for simultaneously capturing the composite image in an imaging range including all measurement points in the composite image and acquiring the image information of the composite image; and an image adjustment device for performing control for adjusting at least one of the first and second display images. The image adjustment device calculates the positions of respective measurement points in respective display images based on respective reference patterns in the imaging range and performs control for adjusting at least one of the first and second display images based on the image information of positions in the imaging range which correspond to the positions of measurement points in respective display images. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to an image display system and an image adjustment method.

A multi-projection system (image display system) using a plurality of projectors as a projection-type image display device (image projection device) displays a large screen by, for example, arranging projection images (display images) of each projector in two dimensions. Used for Also in this multi-projection system, as with a single projector, there is a high demand for high image quality of projected images, and high image quality is achieved by adjusting individual performance variations of a plurality of projectors.

For example, Patent Document 1 discloses an automatic adjustment system for a multi-display device. In Patent Document 1, a camera is arranged in front of a plurality of projection displays, the brightness of the center point of each projection display image or a block obtained by dividing the image is measured, and the amplification factor is based on the measurement result. Has been disclosed that controls the brightness of the projection image of each projection type display so as to be uniform.

JP-A-7-64522

However, the projection surface becomes wide due to the large screen of the multi-projection system, and even if the technology disclosed in Patent Document 1 is applied, a wide-angle lens is required for shooting of the camera that acquires the luminance in the projected image, It is necessary to shoot at a certain distance. for that reason,
There are problems such as incurring high costs of the multi-projection system and taking time for photographing.

In addition, in order to associate the projection image projected on the projection surface of the multi-projection system with the camera image, the position detection pointer is sequentially displayed on each image and photographed each time, so the brightness in the projection image is acquired. It takes a long time to adjust the multi-projection system.

The present invention has been made in view of the technical problems as described above, and one of its purposes is as follows.
An object of the present invention is to provide an image display system and an image adjustment method capable of adjusting a display image in a short time at a low cost.

In order to solve the above-described problems, the present invention is an image display system that displays a single composite image configured using a first display image and a second display image in which measurement points are provided in each display image. A first image display device that displays the first display image including the first reference pattern, a second image display device that displays the second display image including the second reference pattern, and An imaging device that captures the composite image at a time within an imaging range including all measurement points in the composite image and obtains image information of the composite image, and based on the image information, the first display image and An image adjustment device that performs control to adjust at least one of the second display images, wherein the image adjustment device is based on the first reference pattern and the second reference pattern within the imaging range. Within each display image A position of a fixed point is calculated, and at least one of the first display image and the second display image is calculated based on image information at a position in the imaging range corresponding to the position of the measurement point in each display image. The present invention relates to an image display system that performs control for adjustment.

According to the present invention, since the reference pattern is arranged in each display image and the position of the measurement point in each display image is calculated based on the reference pattern, the image information of all the display images of the image display system No need to get. Therefore, it is only necessary to capture images at once within the imaging range including the measurement points in the entire display image, so even if the display screen becomes a large screen, it is possible to adjust each display image in a short time at a low cost. Become.

In the image display system according to the present invention, the first reference pattern and the second reference pattern may be patterns having a predetermined shape having a luminance different from that of a background image.

According to the present invention, since the reference pattern can be specified by the change in luminance based on the image information acquired by the imaging device, the image display system can be adjusted at low cost.

In the image display system according to the present invention, each of the reference patterns may be a rectangular pattern having a luminance different from that of the background image.

According to the present invention, the images displayed by the respective image display devices constituting the image display system are all the same image, so that it is not necessary to prepare different images for each image display device, and adjustment work can be saved. It becomes like this.

In the image display system according to the present invention, a reference pattern shape calculation unit that calculates at least one shape of the first reference pattern and the second reference pattern based on the image information, and the reference pattern shape calculation A display image size calculation unit that calculates the size of the display image including the reference pattern based on the shape calculated by the unit, and the display image based on the size of the display image calculated by the display image size calculation unit A measurement point position calculation unit that calculates the position of the measurement point in the imaging range corresponding to the position of the measurement point in the image, and the image adjustment device uses the image information of the position calculated by the measurement point position calculation unit On the basis of the,
Control for adjusting at least one of the first display image and the second display image can be performed.

According to the present invention, after calculating the shape of the reference pattern and calculating the size of the display image based on the shape, the position of the measurement point in the imaging range corresponding to the position of the measurement point in the display image is calculated. Since it did in this way, it becomes unnecessary to make a display image size and an imaging range correspond. Therefore, it is possible to acquire image information necessary for adjustment in a short time by imaging at a smaller imaging range at a time.

In the image display system according to the present invention, the luminance histogram calculation unit that calculates the vertical luminance histogram and the horizontal luminance histogram in the imaging range, and the luminance histogram calculated by the luminance histogram calculation unit, An image dividing unit that divides an image within the imaging range; and a reference pattern searching unit that searches for a side of a reference pattern in the image divided by the image dividing unit, wherein the reference pattern shape calculating unit includes the reference pattern Based on the sides searched by the search unit, the shape of the reference pattern can be calculated.

According to the present invention, a luminance histogram is calculated in the vertical and horizontal directions for an image captured by an imaging device, and each display image constituting a plurality of display images displayed by the image display system based on the result is calculated. Since the edge for specifying the shape of the reference pattern is searched after the image is divided, the processing load can be reduced, and the shape of the reference pattern in each display image constituting the plurality of display images of the image display system Can be easily identified.

In the image display system according to the present invention, each reference pattern may be a pattern having a predetermined shape and having a luminance different from the luminance of the background image, which is arranged at the position of the measurement point in each display image.

According to the present invention, since the reference pattern is arranged at the position of the measurement point in each display image, the imaging including the measurement point in the entire display image is performed without specifying the shape of the reference pattern. In the range, it is possible to adjust each display image at low cost and in a short time based on image information captured at a time.

Further, in the image display system according to the present invention, the image adjustment device is configured to display at least one luminance and color of the first display image and the second display image based on image information at a measurement point of each display image. Control to adjust the degree can be performed.

According to the present invention, based on the image information of the measurement points of each display image, the first display image and the second display image
Since at least one luminance and chromaticity of the display image of the image is corrected to match,
With a simple configuration and processing, for example, the boundary between two display images becomes inconspicuous, and it becomes possible to prevent deterioration in the image quality of the composite image.

In the image display system according to the present invention, the image adjustment device adjusts at least one position of the first display image and the second display image based on image information at a measurement point of each display image. Can be controlled.

According to the present invention, based on the image information of the measurement points of each display image, the first display image and the second display image
Since at least one position of the display image is corrected, with a simple configuration and processing,
For example, the boundary between two display images becomes inconspicuous, and deterioration of the image quality of the composite image can be prevented.

The present invention is also an image adjustment method for one composite image configured by using a first display image and a second display image in which measurement points are provided in each display image, wherein the first reference pattern is represented by An image display step for displaying the first display image including the second display image including the second reference pattern, and the composite image at a time within an imaging range including all measurement points in the composite image. An image information acquisition step of capturing and acquiring image information of the composite image, and a position of a measurement point in each display image based on the first reference pattern and the second reference pattern within the imaging range And at least one of the first display image and the second display image based on image information at a position in the imaging range corresponding to the position of the measurement point in each display image.
The present invention relates to an image adjustment method including an image adjustment step for performing control to adjust the image.

According to the present invention, since the reference pattern is arranged in each display image and the position of the measurement point in each display image is calculated based on the reference pattern, the image information of all the display images of the image display system No need to get. Therefore, it is only necessary to capture images at once within the imaging range including the measurement points in the entire display image, so even if the display screen becomes a large screen, it is possible to adjust each display image in a short time at a low cost. Become.

In the image adjustment method according to the present invention, the first reference pattern and the second reference pattern may be patterns having a predetermined shape having a luminance different from that of a background image.

According to the present invention, since the reference pattern can be specified by the change in luminance based on the image information acquired by the imaging device, the image display system can be adjusted at low cost.

In the image adjustment method according to the present invention, each of the reference patterns may be a rectangular pattern having a luminance different from the luminance of the background image.

According to the present invention, the images displayed by the respective image display devices constituting the image display system are all the same image, so that it is not necessary to prepare different images for each image display device, and adjustment work can be saved. It becomes like this.

In the image adjustment method according to the present invention, a reference pattern shape calculating step for calculating at least one shape of the first reference pattern and the second reference pattern based on the image information; and the reference pattern shape calculation A display image size calculating step for calculating a size of the display image including the reference pattern based on the shape calculated in the step, and the display image based on the size of the display image calculated in the display image size calculating step. Measuring point position calculating step for calculating the position of the measuring point in the imaging range corresponding to the position of the measuring point in the image, and the image adjusting step includes image information of the position calculated in the measuring point position calculating step And adjusting at least one of the first display image and the second display image based on It is possible to perform the control.

According to the present invention, after calculating the shape of the reference pattern and calculating the size of the display image based on the shape, the position of the measurement point in the imaging range corresponding to the position of the measurement point in the display image is calculated. Since it did in this way, it becomes unnecessary to make a display image size and an imaging range correspond. Therefore, it is possible to acquire image information necessary for adjustment in a short time by imaging at a smaller imaging range at a time.

In the image adjustment method according to the present invention, the luminance histogram calculation step for calculating a vertical luminance histogram and a horizontal luminance histogram in the imaging range, and the luminance histogram calculated in the luminance histogram calculation step, An image dividing step for dividing the image within the imaging range; and a reference pattern searching step for searching for a side of the reference pattern in the image divided in the image dividing step, wherein the reference pattern shape calculating step includes the reference pattern Based on the sides searched in the search step, the shape of the reference pattern can be calculated.

According to the present invention, a luminance histogram is calculated in the vertical and horizontal directions for an image captured by an imaging device, and each display image constituting a plurality of display images displayed by the image display system based on the result is calculated. Since the edge for specifying the shape of the reference pattern is searched after the image is divided, the processing load can be reduced, and the shape of the reference pattern in each display image constituting the plurality of display images of the image display system Can be easily identified.

In the image adjustment method according to the present invention, each reference pattern may be a pattern having a predetermined shape and having a luminance different from the luminance of the background image, which is arranged at the position of the measurement point in each display image.

According to the present invention, since the reference pattern is arranged at the position of the measurement point in each display image, the imaging including the measurement point in the entire display image is performed without specifying the shape of the reference pattern. In the range, it is possible to adjust each display image at low cost and in a short time based on image information captured at a time.

In the image adjustment method according to the present invention, the image adjustment step is based on image information at a measurement point of each display image, and at least one luminance and color of the first display image and the second display image. Control to adjust the degree can be performed.

According to the present invention, based on the image information of the measurement points of each display image, the first display image and the second display image
Since at least one luminance and chromaticity of the display image of the image is corrected to match,
With a simple configuration and processing, for example, the boundary between two display images becomes inconspicuous, and it becomes possible to prevent deterioration in the image quality of the composite image.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The embodiments described below do not unduly limit the contents of the present invention described in the claims. Also, not all of the configurations described below are essential constituent requirements of the present invention.

Hereinafter, a multi-projection system will be described as an example of the image display system according to the present invention, but the image display system according to the present invention is not limited to the multi-projection system. Similarly, a projector is described as an example of the image display device (image projection device) according to the present invention, but the image display device according to the present invention is not limited to the projector.

Embodiment 1
FIG. 1 shows a configuration example of a multi-projection system as an image display system in Embodiment 1 according to the present invention. In FIG. 1, the multi-projection system is configured by four projectors. However, the first embodiment is not limited to the number of projectors, and may be configured by N (N is a natural number of 2 or more) projectors. That's fine.

The multi-projection system 10 according to the first embodiment includes first to fourth projectors PJ1 to PJ4 as image display devices (image projection devices), an image adjustment device 200, and an imaging device 300 as an image measurement unit. The first to fourth projectors PJ1 to PJ4 project images onto a screen SCR as a projection surface. The first projector PJ1 displays a first projection image (display image in a broad sense) IMG1 on the screen SCR. The second projector PJ2 displays the second projection image IMG2 on the screen SCR. The third projector PJ3 displays the third projection image IMG3 on the screen SCR. 4th
Projector PJ4 displays the fourth projected image IMG4 on the screen SCR. The multi-projection system 10 includes first to fourth projection images IMG1 to IMG.
The so-called tiling images (synthesized images in a broad sense) are displayed by two-dimensionally arranging the projection images constituting the image 4.

The projection images constituting the first to fourth projection images IMG1 to IMG4 may be displayed so that the projection images adjacent to each other and the boundary portion thereof are in contact with each other, or at a given interval from the adjacent projection images. May be displayed. Alternatively, each projection image may be displayed by providing an area overlapping with the projection images adjacent to each other. In FIG. 1, the first to fourth projection images IMG1 to IM
G4 shows an example in which two images are displayed side by side in the horizontal direction (horizontal direction, left and right direction) and two images are displayed in the vertical direction (vertical direction, vertical direction). The present embodiment is not limited.

The first to fourth projectors PJ1 to PJ4 may have the same configuration,
Different configurations may be used. However, each projector constituting the first to fourth projectors PJ1 to PJ4 has a function of adjusting the luminance and chromaticity of the entire screen.

The image adjustment apparatus 200 determines the luminance and chromaticity (or at least one of the luminance and chromaticity) of the images of the first to fourth projection images IMG1 to IMG4 projected by the first to fourth projectors PJ1 to PJ4. Control to adjust. Therefore, the image adjustment apparatus 200 calculates adjustment parameters for adjusting the luminance and chromaticity of the image, and the first to fourth projectors PJ1 to PJ4.
The adjustment parameter can be transmitted to at least one of the following parameters. The projector that has received the adjustment parameter adjusts the brightness and chromaticity of the entire screen based on the adjustment parameter. Such an image adjustment apparatus 200 calculates an adjustment parameter using a measurement result of a projection image obtained by the imaging apparatus 300. The function of the image adjustment apparatus 200 is realized by, for example, software processing using a personal computer or hardware processing using dedicated hardware.

The imaging apparatus 300 can capture an image projected on the screen SCR by the projector and output the imaging result to the image adjustment apparatus 200 as image information. Only one imaging device 300 may be provided in the multi-projection system 10, or may be provided for each projector. The function of the imaging apparatus 300 is realized by, for example, a multiband camera, a colorimeter, a colorimeter, or the like. The imaging apparatus 300 only needs to be able to acquire image information such as luminance for one pixel constituting the projection image.

FIG. 2 shows a block diagram of a configuration example of the multi-projection system 10 of FIG. 2, the same parts as those in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted as appropriate. FIG.
In the following description, it is assumed that the configurations of the first to fourth projectors PJ1 to PJ4 are the same, and the image adjustment apparatus 200 supplies image data to each projector.

The first projector PJ1 includes an image display unit 100, an image processing unit 180, and an image data input unit 190. The image data input unit 190 performs reception interface processing of image data from the image adjustment apparatus 200 and outputs the received image data to the image processing unit 180 as an image signal. This reception interface processing includes physical layer signal level conversion processing and progressive conversion processing. The image processing unit 180 corrects the image signal from the image data input unit 190 based on the adjustment parameter from the image adjustment device 200, and outputs the corrected image signal to the image display unit 100. The image display unit 100 changes the modulation rate of light from a light source (not shown) based on the image signal adjusted (corrected) by the image processing unit 180, and transmits the modulated light to the screen SCR.
Project to.

The second to fourth projectors PJ2 to PJ4 also have the same configuration as that of the first projector PJ1, and an image signal corresponding to the image data from the image adjustment device 200 is used as an adjustment parameter from the image adjustment device 200. And projecting an image on the screen SCR based on the adjusted image signal.

The image adjustment apparatus 200 includes an image data generation unit 210, an image information analysis unit 220, and an image adjustment control unit 230 as a parameter calculation unit.

The image data generation unit 210 generates image data corresponding to the content image and outputs the image data to each of the first to fourth projectors PJ1 to PJ4. The image data generation unit 210 may output the same image data to the first to fourth projectors PJ1 to PJ4, or displays the projection images adjacent to each other as a part of the tiling image. Such image data may be output to each projector. Further, the image data generation unit 210 may output different image data to the first to fourth projectors PJ1 to PJ4. Such a function of the image data generation unit 210 may be provided outside the image adjustment apparatus 200 or may be provided for each projector.

The image information analysis unit 220 analyzes the image information of the projection image acquired by the imaging device 300, and a correction (adjustment) reference value that can be expressed quantitatively without depending on the difference in spectral characteristics between the imaging device 300 and the projector. A measurement value (image information) is generated. Here, the imaging device 3
00 acquires image information corresponding to the chromaticity component at a given measurement point in the projection image. For this reason, the image information analysis unit 220 generates a measurement value obtained by converting the image information acquired by the imaging device 300 into color coordinates of a given color space. More specifically, the image information analysis unit 220 performs CIE (Commission Internati) corresponding to the image information acquired by the imaging apparatus 300.
onale de l'Eclairage) Outputs the value of the color system. As a value of such a CIE color system,
Value of XYZ color system (CIE 1931 color system), X ₁₀ Y ₁₀ Z ₁₀ color system (CIE 1)
964 color system), chromaticity coordinates (x, y) in the XYZ color system, chromaticity coordinates (x ₁₀ , y ₁₀ ) in the X ₁₀ Y ₁₀ Z ₁₀ color system, CIELAB color space (CIE) 1976 L ^* a ^* b
^* Color space) brightness and color coordinates, CIE LV color space (CIE 1976 L ^* u ^* v ^* color space) brightness and color coordinates, and the like. In the following, it is assumed that the image information analysis unit 220 outputs XYZ color system values corresponding to image information acquired by the imaging apparatus 300 as converted image information.

The image adjustment control unit 230 acquires, from the image information analysis unit 220, image information at a given measurement point in each projection image constituting the first to fourth projection images IMG1 to IMG4.
The measurement point in each projection image can be a pixel position in the boundary region between two adjacent projection images, for example. Then, the image adjustment control unit 230, based on the image information from the image information analysis unit 220, the luminance and chromaticity at the measurement points of the two adjacent projection images among the first to fourth projection images IMG1 to IMG4. Are controlled so as to adjust the brightness and chromaticity of the entire projection image by at least one projector. By doing so, the boundary between two projection images in the multi-projection system can be made inconspicuous with a simple configuration and without performing complicated processing. That is, it becomes possible to make the boundary between projection images inconspicuous when a plurality of projection images are displayed next to each other without necessarily performing luminance unevenness / color unevenness correction processing in one projection screen.

Note that the measurement point in each projection image is preferably close to the boundary portion in each projection image close to another adjacent projection image, and the present invention is not limited to the position of the measurement point in the projection image. Absent.
What is necessary is just the position of the measurement point in the boundary area | region provided in a projection image.

FIG. 3 is a diagram for explaining the operation of the image adjustment control unit 230 shown in FIG. Figure 3 represents an example of a state in which the measured values of the XYZ color system value X _R with respect to the input value of the R component of the image signal changes. In FIG. 3, the first and second projectors PJ1 and PJ2 will be described as an example, but the same applies to other projectors. The change in the measured value of the XYZ color system value Y _G with respect to the input value of the G component of the image signal and the change in the measured value of the value XYZ color system value Z _B with respect to the input value of the B component of the image signal are also shown in FIG. It is the same.
FIG. 4 is an explanatory diagram of specific processing contents in the image adjustment control unit 230.

Each projector constituting the multi-projection system may have different brightness and chromaticity of the image projected on the screen SCR even when image signals corresponding to the same gradation are input. Therefore, for example, as shown in FIG. 3, the first and second projectors P
The measurement values acquired at the measurement points J1 and PJ2 may differ depending on the projector. Accordingly, the image adjustment control unit 230 calculates the input value Rin ′ of the R component of the first projector PJ1 in which the input value Rin of the R component of the image signal matches the measured value Xout at the measurement point of the second projector PJ2. .

Then, the image adjustment control unit 230 receives the input value Ri in the first projector PJ1.
An adjustment parameter for correction so as to output the input value Rin ′ at n is obtained, and the adjustment parameter is output to the first projector PJ1. Similarly, for the G component and the B component, adjustment parameters are obtained and output to the first projector PJ1.

For example, the adjustment parameter is obtained by modifying the conversion equation shown in FIG.
The first projector P corresponding to the input value Gin of the in and G components and the input value Bin of the B component
The brightness and color coordinates (L, U, V) of the CIELV color space of the first projected image IMG1 by J1
). Therefore, the adjustment parameters for realizing the lightness and the color coordinates may be output to the first projector PJ1.

In the above description, the adjustment parameter is transmitted only to the first projector PJ1, but the second projector PJ is used to match the luminance and chromaticity of both measurement points.
2 and send the adjustment parameters only to the first and second projectors PJ1, PJ
The adjustment parameters may be transmitted to both of them.

The image adjustment control unit 230 performs calculation and transmission of such adjustment parameters in order to adjust projection images adjacent to each other among the first to fourth projection images IMG1 to IMG4. As described above, the image adjustment control unit 230 converts the image information at the measurement points in the boundary regions adjacent to each other into the color coordinates of the given color space, and then adjusts the parameters for adjusting the luminance and chromaticity of the entire projection image. calculate.

Each projector constituting the multi-projection system 10 includes an image adjustment device 20.
Based on the adjustment parameter from 0, the brightness and chromaticity of the entire projected image are adjusted. This adjustment processing is performed by the image processing unit 180 mounted on each projector.

FIG. 5 shows a block diagram of a configuration example of the image processing unit 180 installed in each projector.
5, the same parts as those in FIG. 2 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

The image processing unit 180 includes an adjustment parameter storage unit 182 and a signal conversion unit 184. The adjustment parameter storage unit 182 stores the adjustment parameters from the image adjustment apparatus 200. The signal conversion unit 184 corrects the image signal from the image data input unit 190 based on the adjustment parameter stored in the adjustment parameter storage unit 182, and outputs the corrected image signal to the image display unit 100.

For example, adjustment parameters for all gradations that can be expressed by image data are stored in the adjustment parameter storage unit 182, and the signal conversion unit 184 is based on the adjustment parameters corresponding to the gradations specified by the image signal. The image signal before correction can be corrected. Or
For example, some adjustment parameters are discretely stored in the adjustment parameter storage unit 182 among all the gradations that can be expressed by the image data, and the signal conversion unit 184 corresponds to the gradation specified by the image signal. The image signal before correction can be corrected based on the adjustment parameter obtained by interpolating the adjustment parameter or the adjustment parameter stored in the adjustment parameter storage unit 182.

FIG. 6 shows a configuration example of the image display unit 100 of FIG. In FIG. 6, the first projector PJ
Although one image display unit 100 shows a so-called three-plate type configuration example, the image display unit according to the present invention is not limited to a so-called three-plate type. The second to fourth projectors PJ2 to PJ4 in FIG. 2 can also have an image display unit having the same configuration as that in FIG.

The image display unit 100 includes a light source 110, integrator lenses 112 and 114, a polarization conversion element 116, a superimposing lens 118, an R component dichroic mirror 120R, a G component dichroic mirror 120G, a reflection mirror 122, and an R component field lens 124R and G. Component field lens 124G, R component liquid crystal panel 130R (first light modulation element), G
A component liquid crystal panel 130G (second light modulation element), a B component liquid crystal panel 130B (third light modulation element), a relay optical system 140, a cross dichroic prism 160, and a projection lens 170 are included. The liquid crystal panels used as the R component liquid crystal panel 130R, the G component liquid crystal panel 130G, and the B component liquid crystal panel 130B are transmissive liquid crystal display devices. The relay optical system 140 includes relay lenses 142, 144, and 146 and reflection mirrors 148 and 150.

The light source 110 is composed of, for example, an ultra-high pressure mercury lamp, and emits light including at least R component light, G component light, and B component light. The integrator lens 112 has a plurality of small lenses for dividing the light from the light source 110 into a plurality of partial lights. The integrator lens 114 has a plurality of small lenses corresponding to the plurality of small lenses of the integrator lens 112. The superimposing lens 118 superimposes the partial light emitted from the plurality of small lenses of the integrator lens 112 on the liquid crystal panel.

The polarization conversion element 116 includes a polarization beam splitter array and a λ / 2 plate.
The light from 10 is converted into substantially one type of polarized light. The polarization beam splitter array includes a polarization separation film that separates the partial light divided by the integrator lens 112 into p-polarized light and s-polarized light,
It has a structure in which reflection films that change the direction of light from the polarization separation film are alternately arranged. The polarization direction of the two types of polarized light separated by the polarization separation film is aligned by the λ / 2 plate. Light that has been converted into substantially one type of polarized light by the polarization conversion element 116 is applied to the superimposing lens 118.

The light from the superimposing lens 118 enters the R component dichroic mirror 120R.
The R component dichroic mirror 120R has a function of reflecting R component light and transmitting G component light and B component light. The light transmitted through the R component dichroic mirror 120R is
G component dichroic mirror 120G is irradiated to R component dichroic mirror 12
The light reflected by 0R is reflected by the reflecting mirror 122 and is used as the R component field lens 1.
It is led to 24R.

The G component dichroic mirror 120G has a function of reflecting G component light and transmitting B component light. The light transmitted through the G component dichroic mirror 120G is incident on the relay optical system 140, and the light reflected by the G component dichroic mirror 120G is guided to the G component field lens 124G.

In the relay optical system 140, in order to minimize the difference between the optical path length of the B component light transmitted through the G component dichroic mirror 120G and the optical path length of the other R component and G component light, the relay lenses 142 and 144 are provided. 146 is used to correct the difference in optical path length. The light transmitted through the relay lens 142 is guided to the relay lens 144 by the reflection mirror 148. The light transmitted through the relay lens 144 is guided to the relay lens 146 by the reflection mirror 150.
The light transmitted through the relay lens 146 is applied to the B component liquid crystal panel 130B.

The light applied to the R component field lens 124R is converted into parallel light and is incident on the R component liquid crystal panel 130R. The R component liquid crystal panel 130R functions as a light modulation element (light modulation unit), and the transmittance (passage rate, modulation factor) changes based on the R component image signal. Therefore, the light (first color component light) incident on the R component liquid crystal panel 130R is modulated based on the R component image signal corrected by the image processing unit 180, and the modulated light is crossed. The light enters the dichroic prism 160.

The light applied to the G component field lens 124G is converted into parallel light and is incident on the G component liquid crystal panel 130G. The G component liquid crystal panel 130G functions as a light modulation element (light modulation unit), and the transmittance (passage rate, modulation rate) changes based on the G component image signal. Therefore, the light (second color component light) incident on the G component liquid crystal panel 130G is modulated based on the G component image signal corrected by the image processing unit 180, and the modulated light is crossed. The light enters the dichroic prism 160.

The B component liquid crystal panel 130B irradiated with the light converted into parallel light by the relay lenses 142, 144, and 146 functions as a light modulation element (light modulation unit), and has a transmittance (based on the B component image signal). (Passing rate, modulation rate) are changed. Therefore, the light (third color component light) incident on the B component liquid crystal panel 130B is modulated based on the B component image signal corrected by the image processing unit 180, and the modulated light is crossed. Dichroic prism 1
60 is incident.

R component liquid crystal panel 130R, G component liquid crystal panel 130G, and B component liquid crystal panel 1
Each of 30B has the same configuration. Each liquid crystal panel is a liquid crystal, which is an electro-optical material, sealed in a pair of transparent glass substrates. For example, a polysilicon thin film transistor is used as a switching element, and the transmittance of each color light corresponding to the image signal of each sub-pixel. Modulate.

The cross dichroic prism 160 has a function of outputting combined light obtained by combining incident light from the R component liquid crystal panel 130R, the G component liquid crystal panel 130G, and the B component liquid crystal panel 130B as outgoing light. The projection lens 170 is a lens that enlarges and forms an output image on the screen SCR, and has a function of enlarging or reducing the image in accordance with the zoom magnification.

In the multi-projection system 10 having such a configuration, the screen SCR
Even if the large screen becomes a large screen, the first to fourth projection images IMG1 to IMG1 to IMG1 to II can be realized at low cost and in a short time.
Allows adjustment of MG4. Therefore, the imaging apparatus 300 captures the first to fourth projection images IMG1 to IMG4 at a time with a smaller imaging range, acquires image information at the measurement points in each projection image, and the image adjustment apparatus 200 The projected image can be adjusted based on this image information.

On the other hand, when the imaging range of the imaging device 300 matches one projection image, the imaging device 30
Since the position of a predetermined measurement point in the projected image is known in the image captured at 0, the image information at the measurement point in the projected image can be easily acquired from the image captured by the imaging device 300. However, in the first embodiment, since the imaging range of the imaging device 300 does not match the projected image, it is necessary to specify the position of the measurement point in the projected image in the image captured by the imaging device 300. Therefore, in the first embodiment, an image including a given reference pattern is employed in the projection image of the screen SCR captured by the imaging device 300, and the imaging range of the projection image is calculated based on the reference pattern, thereby capturing the image. Image information at the position of the measurement point within the range is acquired.

By doing so, it is not necessary to provide an expensive wide-angle lens in the imaging device 300 that captures a large-screen screen SCR, and it is not necessary to provide an image with a distance between the screen SCR and the imaging device 300. Furthermore, since image information at measurement points in a plurality of projection images can be acquired at once, the multi-projection system can be adjusted in a short time.

FIG. 7 shows an example of a processing flow of image adjustment processing of the multi-projection system 10 in the first embodiment.
FIG. 8 is a schematic diagram illustrating an operation example of the multi-projection system 10 according to the first embodiment.

In the first embodiment, two sets of test images are prepared roughly. A set of test images
It is a test image for detecting the position of the measurement point within the imaging range of the imaging device 300, and the other set of test images is a test image for color adjustment of each projection image. Therefore, the image data generation unit 210 uses the first to fourth projectors PJ1 to PJ1 as test images for detecting the positions of the measurement points.
For each PJ4, image data corresponding to a so-called all-black image and image data corresponding to a patch image in which a white rectangular reference pattern is arranged on a black background image are generated. Further, the image data generation unit 210 generates image data corresponding to each of a plurality of gradation images for specifying the characteristics as shown in FIG. 3 for each color component as a test image for color adjustment.

First, the image adjustment apparatus 200 outputs image data corresponding to the two sets of test images generated by the image data generation unit 210 to each of the first to fourth projectors PJ1 to PJ4. First to fourth projectors PJ1 corresponding to test images from the image adjustment apparatus 200
To PJ4 display test images one by one as an image display step (T1 in FIG. 8) (
Step S10).

Then, the imaging apparatus 300 has a narrower range than the entire range of the tiling images composed of the first to fourth projection images IMG1 to IMG4 displayed in step S10 as the image information acquisition step, In the imaging range including all the measurement points of the fourth projection images IMG1 to IMG4 and all the reference patterns in each projection image, images are captured at a time to obtain image information at all the measurement points in the tiling image (FIG. 8 T2) (step S12). In the case of the color adjustment test image, the first to fourth projection images IMG1 to IMG displayed in step S10.
4 is a range narrower than the entire range of the tiling image composed of 4 and includes all the measurement points of the first to fourth projection images IMG1 to IMG4. Image information at all measurement points is acquired.

Steps S10 and S12 are performed on each test image constituting the above two sets of test images (step S14: N), and display and imaging of all the test images are completed (
Step S14: Y), based on the image information of the test image for detecting the position of the measurement point acquired in Step S10 and Step S12, the image adjustment apparatus 200 measures the measurement point of each projection image in the image within the imaging range. Is calculated (step S16).

Subsequently, the image adjustment apparatus 200 extracts the image information at the measurement point calculated in step S16 from the image information of the color adjustment test image acquired in step S10 and step S12, and acquires it as measurement data. (Step S18).

Then, as described in FIG. 3 and FIG. 4, the image adjustment apparatus 200 calculates the adjustment parameter of each projector using the measurement data acquired in step S <b> 18 as the image adjustment step, and uses the adjustment parameter for each projector. (T3 in FIG. 8) (step S2
0).

As described above, each of the first to fourth projectors PJ1 to PJ4 corrects the image signal based on the adjustment parameter from the image adjustment apparatus 200 and adjusts the brightness and chromaticity of the entire screen (step). S22), a series of processing ends (end).

As described above, when focusing on the first and second projection images IMG1 and IMG2 and adjusting the tiling image as a composite image configured using the first and second projection images IMG1 and IMG2. In the image display step, the first projection image I including the first reference pattern
After image display of MG1 and the second projection image IMG2 including the second reference pattern, as the image information acquisition step, given the tiling image at once in the imaging range including all measurement points in the tiling image The region (part or all of the tiling image) is imaged, and image information of the tiling image is acquired. Thereafter, as an image adjustment step, the position of the measurement point in each projection image is calculated with reference to each reference pattern constituting the first and second reference patterns in the imaging range, and the measurement point in each projection image is calculated. Control is performed to adjust at least one of the first and second projection images based on image information at a position within the imaging range corresponding to the position.

Below, an example of the detection process of the position of the measurement point in Embodiment 1 is demonstrated in detail.

FIG. 9 shows an example of a test image for detecting the position of the measurement point in the first embodiment. In FIG. 9, measurement points P12, P13, P21, P24, P31, P34, P42, P43
These measurement points P12 and the like are shown in the first to fourth reference patterns BP1 to BP4.
Unlike the actual image that is displayed.

In the first embodiment, a patch image in which a white rectangular reference pattern is arranged on a black background image is employed as a test image for detecting the position of a measurement point. Here, the reference pattern may be a pattern having a predetermined shape having a luminance different from that of the background image. This is because when the background image is black and the rectangular shape is white, the shape of the reference pattern can be specified with the maximum detectable brightness, and the detection error due to noise or the like can be minimized.

In FIG. 9, the first projector PJ1 projects a first projection image IMG1 that is a patch image having a white rectangular first reference pattern BP1 arranged on a black background image onto the screen SCR. In the background image, a measurement point P12 provided in a boundary region adjacent to the second projection image IMG2 and a measurement point P13 provided in a boundary region adjacent to the third projection image IMG3 are arranged.

Similarly, the second projector PJ2 projects a second projection image IMG2 that is a patch image having a white rectangular second reference pattern BP2 arranged on a black background image onto the screen SCR. In the background image, a measurement point P21 provided in a boundary region adjacent to the first projection image IMG1 and a measurement point P24 provided in a boundary region adjacent to the fourth projection image IMG4 are arranged.

The third projector PJ3 projects a third projection image IMG3, which is a patch image having a white rectangular third reference pattern BP3 arranged on the black background image, onto the screen SCR. In the background image, the measurement point P31 provided in the boundary region adjacent to the first projection image IMG1 and the measurement point P provided in the boundary region adjacent to the fourth projection image IMG4.
34 are arranged.

Further, the fourth projector PJ4 projects a fourth projection image IMG4, which is a patch image having a fourth rectangular reference pattern BP4 arranged in a black background image onto the screen SCR. In the background image, the measurement point P42 provided in the boundary region adjacent to the second projection image IMG2 and the measurement point P provided in the boundary region adjacent to the third projection image IMG3.
43 are arranged.

In the first embodiment, each of the projections constituting the first to fourth projection images IMG1 to IMG4 by the imaging apparatus 300 in a state where the test images shown in FIG. 9 are displayed by the first to fourth projectors PJ1 to PJ4. All measurement points provided in the image (measurement points P12, P13, P21, P
24, P31, P34, P42, and P43), an image of a part of the tiling image is captured at a time, and image information of this image is acquired. The imaging range PR is
It is desirable to include all of the reference patterns (reference patterns BP1 to BP4) provided in each of the projection images constituting the first to fourth projection images IMG1 to IMG4. Can be detected, the imaging range PR may be a range including only a part of the reference pattern.

That is, when the first and second projection images IMG1 and IMG2 are focused on and the tiling image is adjusted as a composite image configured using the first and second projection images IMG1 and IMG2, the imaging apparatus Reference numeral 300 captures a tiling image at a time within an imaging range including all measurement points of the first and second projection images in which measurement points are provided in each projection image, and acquires image information of the tiling image. .

Based on the image information in the imaging range PR, the image adjustment device 200 identifies the position of the measurement point in the imaging range PR corresponding to the position of the measurement point defined in the projection image, and the imaging device 300 The image information at the position of the measurement point within the imaging range PR is extracted from the image information acquired by the above. The image adjustment device 200 adjusts each projection image based on the image information at the position of the measurement point within the imaging range PR. Therefore, the image adjustment apparatus 200 needs to specify the position of the measurement point in the coordinate system of the imaging apparatus 300 corresponding to the position of the measurement point defined in the coordinate system of the projection image.

FIG. 10 schematically shows the coordinate system of each projection image and the coordinate system of the imaging apparatus 300 in the first embodiment.

In each projection image on the screen SCR, for example, the position of the measurement point in each projection image is specified in a coordinate system defined by the x-axis in the horizontal direction and the y-axis in the vertical direction with reference to the pixel in the upper left corner. On the other hand, as shown in FIG. 10, it is unclear where the imaging range PR of the imaging device 300 is located in the coordinate system of each projection image.

Therefore, based on the image information acquired by the imaging device 300, the image adjustment device 200 first specifies the position of the imaging range PR of the imaging device 300 in the coordinate system of the projection image.
At this time, the image adjustment device 200 specifies the position of the imaging range PR in the coordinate system of the projection image based on the reference pattern arranged in each projection image.

And if the position of the imaging range PR in the coordinate system of a projection image is specified, the position of the measurement point in the imaging range PR corresponding to the position of the measurement point in a projection image will be specified.

Even within the imaging range PR, with the upper left corner as a reference, the xc axis in the horizontal direction and yc in the vertical direction
An axis defines a coordinate system. Therefore, the image adjustment apparatus 200 extracts image information at the position of the measurement point in the imaging range PR from the image information acquired by the imaging apparatus 300, and based on the image information, the projection image of each projection image as described above. Control to adjust brightness and chromaticity.

FIG. 11 is a diagram illustrating the principle of measurement point position detection processing in the first embodiment. 11, the same parts as those in FIG. 9 are denoted by the same reference numerals, and the description thereof is omitted as appropriate.

With the first to fourth projectors PJ1 to PJ4 projecting the test images shown in FIG. 9 onto the screen SCR, the imaging apparatus 300 can measure points P12, P13, P, for example.
Image information is acquired at a time in the imaging range PR including all of 21, 21, P24, P31, P34, P42, P43 and the reference patterns BP1 to BP4.

Next, the image adjustment device 200 uses the reference patterns BP1 to BP4 as a reference, based on the image information in the imaging range PR acquired by the imaging device 300, to the first to fourth projection images IMG.
1 to 4 images corresponding to IMG4.

Then, the image adjustment apparatus 200 calculates the shape of the reference pattern in the divided image, and specifies the size of the projection image based on the calculated shape of the reference pattern. Since the position of the measurement point in the projection image is known in advance, the position of the measurement point in the divided image is obtained, and the projection image is adjusted using the image information at this position.

  Next, a configuration and an operation example of such an image adjustment apparatus 200 will be described.

FIG. 12 is a block diagram illustrating a configuration example of the image information analysis unit 220 of the image adjustment apparatus 200 according to the first embodiment.

The image information analysis unit 220 receives the first to fourth projection images IMG1 to IMG1 from the imaging device 300.
Image information obtained by capturing a part of the tiling image configured by MG4 as an imaging range is input. The image information analysis unit 220 calculates the position of the measurement point defined in the projection image based on the image information, and acquires the image information at the position.
Based on the image information acquired by the imaging apparatus 300, a process for generating a measurement value serving as a correction (adjustment) reference value that can be quantitatively expressed without depending on a difference in spectral characteristics of a projector or the like is performed.

Such an image information analysis unit 220 includes a reference pattern shape calculation unit 222, a projection image size calculation unit (display image size calculation unit in a broad sense) 224, a measurement point position calculation unit 226, and a measurement data processing unit 228.

The reference pattern shape calculation unit 222 calculates at least one shape of the reference patterns in the first to fourth projection images IMG1 to IMG4 based on the image information acquired by the imaging device 300. The projection image size calculation unit 224 calculates the size of the projection image including the reference pattern based on the shape calculated by the reference pattern shape calculation unit 222. The measurement point position calculation unit 226 calculates the position of the measurement point in the imaging range of the imaging apparatus 300 corresponding to the position of the measurement point in the projection image based on the size of the projection image calculated by the projection image size calculation unit 224. calculate.

The measurement data processing unit 228 performs different processing depending on the processing content of the image adjustment apparatus 200. That is, when calculating the position of the measurement point, the measurement data processing unit 228 acquires image information at the position of the measurement point calculated by the measurement point position calculation unit 226 from the image information from the imaging device 300. I do. When performing control to adjust the luminance and chromaticity of the projected image, the measurement data processing unit 228 quantitatively expresses the image information from the imaging device 300 as described with reference to FIGS. A process of generating a measurement value that can be a correction reference value is performed.

  FIG. 13 shows a block diagram of a configuration example of the reference pattern shape calculation unit 222 of FIG.

The reference pattern shape calculation unit 222 includes a luminance histogram calculation unit 250 and an image division unit 252.
The reference pattern side search unit 254 is included.

The luminance histogram calculation unit 250 calculates a vertical luminance histogram and a horizontal luminance histogram within the imaging range of the imaging apparatus 300. The image dividing unit 252 divides an image within the imaging range of the imaging device 300 based on the luminance histogram calculated by the luminance histogram calculating unit 250. The reference pattern edge searching unit 254 searches for the edge of the reference pattern in the image divided by the image dividing unit 252. Then, the reference pattern shape calculation unit 222
Based on the sides searched by the reference pattern side search unit 254, the shape of the reference pattern is calculated.

As a result, it is possible to easily specify the shape of the reference pattern in each projection image constituting the plurality of projection images of the multi-projection system 10 with a smaller processing load.

In FIG. 13, the reference pattern shape calculation unit 222 includes a luminance histogram calculation unit 250.
The image dividing unit 252 and the reference pattern side searching unit 254 have been described as being included, but the first embodiment is not limited to this. The reference pattern shape calculation unit 222 only needs to include the reference pattern side search unit 254.

The function of the image information analysis unit 220 of the image adjustment apparatus 200 having the above configuration may be realized by hardware processing or software processing. In the first embodiment, the image adjustment apparatus 200 is a central processing unit (Central Processi) (not shown).
(ng Unit: CPU) and a memory, and a CPU that reads and executes a program stored in the memory realizes the functions of each unit of the image information analysis unit 220 of the image adjustment apparatus 200 by software processing.

FIG. 14 shows a flowchart of a calculation processing example of the position of the measurement point within the imaging range of the image information analysis unit 220 in the first embodiment. That is, in the image information analysis unit 220, a program for realizing the processing method shown in FIG. 14 is stored in a memory (not shown), and the CPU reads the program stored in the memory and performs processing corresponding to the program. By executing, the processing shown in FIG. 14 can be realized by software processing.
FIG. 15 is an explanatory diagram of step S32 of FIG. In FIG. 15, the same parts as those in FIG.
FIGS. 16A and 16B are explanatory diagrams of step S38 in FIG.

First, on each projector, an all black image having the same brightness as the background of the patch image and a test image having a white rectangular reference pattern on the background image are sequentially displayed so that the image capturing device 300 can capture the image. Thus, the image information of the all black image and the image information of the test image are obtained at a time. Then, the image information analysis unit 220 calculates a difference in luminance of each pixel between the all black image and the test image as a difference calculation step (step S30). This
Image information as shown in FIG. 9 is obtained within the imaging range of the imaging apparatus 300.

Next, the image information analysis unit 220 performs step S3 as a luminance histogram calculation step.
A luminance histogram in the vertical direction of the difference image having the luminance calculated at 0 and a luminance histogram in the horizontal direction of the difference image are calculated (step S32). As a result, as shown in FIG. 15, the magnitude of the luminance histogram can be determined based on the position of the rectangular reference pattern, and a rough division line of an image including the reference pattern can be specified.

Subsequently, the image information analysis unit 220 divides the difference image of the luminance calculated in step S30 based on the luminance histogram calculated in step S32 as an image division step (step S34). More specifically, as shown in FIG. 15, the image information analysis unit 220 determines a position where the value of the luminance histogram in each direction is low as an image division line, and divides the image into four images of divided images BI1 to BI4. To do. The divided image BI1 is an image corresponding to the first projection image IMG1 in FIG. 9, the divided image BI2 is an image corresponding to the second projection image IMG2 in FIG. 9, and the divided image BI3 is the image in FIG. The divided image BI4 is an image corresponding to the third projection image IMG3 in FIG. 9.

Then, the image information analysis unit 220 performs step S as the reference pattern shape calculation step.
The shape of a reference pattern (for example, reference pattern BP1) in one image (for example, divided image BI1) divided at 34 is calculated (step S36). In step S36, step S
The shape of the reference pattern is calculated for one image divided in 34, but in step S34.
The shape of the reference pattern may be calculated for each of all the images divided by.

When the shape of the reference pattern in each image is calculated, the image information analysis unit 220 displays the size of the projection image including the reference pattern based on the shape of the reference image calculated in step S36 as the display image size calculation step. Is calculated (step S38). As shown in FIG. 16A, for example, the reference pattern BP1 is arranged at a predetermined position in the first projection image IMG1, the horizontal width of the first projection image IMG1 is W, and the horizontal direction of the reference pattern BP1. Width is W
/ 3. At this time, when the width of the reference pattern is calculated in the divided image BI1 obtained by dividing the image within the imaging range in step S36, the horizontal size of the projection image is specified in the horizontal direction based on the width. Is possible. Accordingly, the vertical size of the projected image can be specified in the same manner in the vertical direction of the image.

Thus, when the vertical and horizontal sizes of the projected image are calculated in step S38 based on the shape of the reference pattern calculated in step S36, the image information analysis unit 22 is calculated.
As a measurement point position calculation step, 0 is a position of a measurement point (for example, measurement points P12 and P13) in the projection image (for example, the first projection image IMG1) based on the size of the projection image calculated in step S36. The position of the measurement point in the corresponding imaging range is calculated (step S40), and the series of processing ends (end).

Image information at a position within the imaging range calculated by the processing shown in FIG.
By extracting from the image information acquired by 00, it is possible to adjust the luminance and chromaticity of each projected image in FIG. 1 by only one imaging in a smaller imaging range.

FIG. 17 shows a flowchart of a processing example of the reference pattern shape calculation processing of FIG.
FIG. 18A, FIG. 18B, FIG. 18C, and FIG. 18D are explanatory diagrams of each process of FIG. 18A to 18D, the divided image BI1 will be described as an example, but the same applies to other divided images.

The reference pattern shape calculation process in step S36 of FIG. 14 is mainly realized by a process of searching for a side (boundary) of the reference pattern. Therefore, the image information analysis unit 220 calculates a position near the center in the reference pattern in the divided image divided in step S34 as the center vicinity position calculating step (step S60). For example, as shown in FIG. 18A, the centroid of the pixel value of each pixel in the divided image BI1 may be calculated, and the centroid position may be obtained as the position GP1 near the center in the reference pattern BP1.

Next, as the boundary search step, the image information analysis unit 220 scans in the vertical and horizontal directions of the divided image using the position near the center in the reference pattern calculated in step S60 as the starting point, and A boundary is obtained (step S62). For example, as shown in FIG. 18B, the boundary of the reference pattern BP1 may be obtained by scanning in units of a plurality of pixels in the horizontal direction or the vertical direction and analyzing the luminance of the sampled pixels. .

When the boundary of the reference pattern is obtained in step S62, the image information analysis unit 220 searches the vicinity of the boundary of the reference pattern pixel by pixel as a reference pattern side detailed search step,
The sides of the reference pattern in the vertical and horizontal directions are obtained (step S64). For example, FIG.
As shown in FIG. 5B, the edge of the reference pattern is obtained by detecting a change in luminance leftward by one pixel from the vicinity of the boundary of the reference pattern.

Thereafter, the image information analysis unit 220 performs step S as a reference pattern vertex calculation step.
The vertex position of the reference pattern is obtained from the intersection of the two sides of the reference pattern obtained in 64, the positions of all the vertices that specify the shape of the reference pattern are calculated (step S66), and the series of processing ends (end). . For example, in step S66, as shown in FIG.
By obtaining the intersection point EP1 of the two sides ED1 and ED2 obtained in step 4, a total of four vertices are obtained.

When the positions of the four vertices that specify the shape of the reference pattern are obtained in this way, the size of the reference pattern can be specified. As described in step S38 of FIG. 14, the size of the projection image including the reference pattern is also determined. It becomes possible to identify.

As described above, according to the first embodiment, the reference pattern is arranged in each projection image, and the position of the measurement point in each projection image is calculated based on the reference pattern. It is not necessary to acquire image information of all the projection images. Therefore, since it is only necessary to capture images at once within the imaging range including the measurement points in all the projected images, even if the screen SCR becomes a large screen, it is possible to adjust each projected image at a low cost in a short time. Become. In the first embodiment, since the test images projected by the projectors constituting the multi-projection system are all the same image, it is not necessary to prepare a different test image for each projector, and the time for adjustment can be saved. It becomes like this.

[Embodiment 2]
In the first embodiment, the reference pattern is described as being arranged at a position different from the measurement point of the projection image, but the present invention is not limited to this. In Embodiment 2 according to the present invention,
A reference pattern is arranged at the position of the measurement point of each projection image.

  FIG. 19 shows an example of a test image for detecting the position of a measurement point in the second embodiment.

In the second embodiment, as a black background image, an image in which a white reference pattern (for example, a rectangular pattern of one pixel or a plurality of pixels) is arranged at the position of the measurement point is used as a test image for detecting the position of the measurement point. Adopted. Here, the reference pattern may be a pattern having a predetermined shape having a luminance different from that of the background image.

In FIG. 19, the first projector PJ1 projects the first projection image IMG1 having the first white reference patterns BP12 and BP13 at the positions of the measurement points P12 and P13 of the black background image onto the screen SCR. In the background image, a measurement point P12 provided in a boundary region adjacent to the second projection image IMG2 and a measurement point P13 provided in a boundary region adjacent to the third projection image IMG3 are arranged.

Similarly, the second projector PJ2 projects the second projection image IMG2 having the white second reference patterns BP21 and BP24 at the positions of the measurement points P21 and P24 of the black background image on the screen SCR. In the background image, a measurement point P21 provided in a boundary region adjacent to the first projection image IMG1 and a measurement point P24 provided in a boundary region adjacent to the fourth projection image IMG4 are arranged.

Further, the third projector PJ3 projects the third projected image IMG3 having the white third reference patterns BP31 and BP34 at the positions of the measurement points P31 and P34 of the black background image on the screen SCR. In the background image, a measurement point P31 provided in a boundary region adjacent to the first projection image IMG1 and a measurement point P34 provided in a boundary region adjacent to the fourth projection image IMG4 are arranged.

Further, the fourth projector PJ4 projects the fourth projected image IMG4 having the white fourth reference patterns BP42 and BP43 at the positions of the measurement points P42 and P43 of the black background image on the screen SCR. In the background image, a measurement point P42 provided in a boundary region adjacent to the second projection image IMG2 and a measurement point P43 provided in a boundary region adjacent to the third projection image IMG3 are arranged.

In the second embodiment, the imaging device 300 displays the first to fourth projection images IMG1 to IMG4 in a state where the test images shown in FIG. 19 are displayed by the first to fourth projectors PJ1 to PJ4.
All the measurement points provided in each projection image that constitutes (measurement points P12, P13, P21,
In the imaging range PR2 including P24, P31, P34, P42, and P43), the tiling image is captured at a time, and the image information of this image is acquired. Note that the imaging range PR2 is the first to the first.
All reference patterns (reference patterns BP12, BP13, BP21, BP24, BP31, BP34, provided in each projection image constituting the fourth projection images IMG1 to IMG4,
The range includes all of BP42 and BP43).

In the second embodiment, as in the first embodiment, based on the image information in the imaging range PR2, the image adjustment device 200 is in the imaging range PR2 corresponding to the position of the measurement point defined in the projection image. From the image information acquired by the imaging device 300,
Image information at the position of the measurement point within the imaging range PR2 is extracted. The image adjustment apparatus 200
Each projection image is adjusted based on the image information at the position of the measurement point in the imaging range PR2.

FIG. 20 is a diagram for explaining the principle of the measurement point position detection process in the second embodiment. 20, the same parts as those in FIG. 19 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

With the first to fourth projectors PJ1 to PJ4 projecting the test images shown in FIG. 19 on the screen SCR, the imaging apparatus 300 measures the measurement points P12, P13, and P21.
, P24, P31, P34, P42, P43 and reference patterns BP12, BP13, BP
21, imaging range PR including all of BP24, BP31, BP34, BP42, and BP43
2 to obtain image information at a time.

Next, the image adjustment apparatus 200 includes the reference pattern arrangement relationship at the measurement points in the imaging range PR2 acquired by the imaging apparatus 300 and the predetermined first to fourth projection images IMG.
1 to IMG4 are used to perform matching processing with position information REF indicating the position distribution of measurement points in the tiling image. In this matching process, the position of the reference pattern in the imaging range PR2 is specified at a predetermined measurement point in the tiling image by scaling or rotating the direction of the image. For example, for each position of the reference pattern in the imaging range PR2 subjected to the scaling process, the positional relationship (for example, distance) with the position of another reference pattern is digitized and compared with the numerical information of the positional relationship in the position information REF. Then, the closest combination is set as a matching result.

Then, as a result of the matching process, the image adjustment device 200 specifies the size of the projection image based on the positional relationship between the measurement points in the imaging range PR2. Since the position of the measurement point in the projection image is known in advance, the position of the measurement point in the divided image is obtained, and the projection image is adjusted using the image information at this position.

The configuration and processing contents of the multi-projection system in the second embodiment are the same as those described with reference to FIGS. The second embodiment differs from the first embodiment in the configuration and processing contents of the image information analysis unit.

The function of the image information analysis unit in the second embodiment may be realized by hardware processing as in the first embodiment, or may be realized by software processing. Also in the second embodiment, the CPU that has read and executed the program stored in the memory can execute the second embodiment.
The function of each unit of the image information analysis unit of the image adjustment apparatus 200 is realized by software processing.

FIG. 21 is a flowchart of a calculation processing example of the position of the measurement point within the imaging range of the image information analysis unit according to the second embodiment. That is, in the image information analysis unit, a program for realizing the processing method shown in FIG. 21 is stored in a memory (not shown), and the CPU reads the program stored in the memory and executes processing corresponding to the program. Thus, the processing shown in FIG. 21 can be realized by software processing.

First, each projector sequentially displays an all black image having the same brightness as the background of the patch image and a test image having the reference pattern arranged at the position of the measurement point in the background image described above. The image information of the all-black image and the image information of the test image are acquired at a time within the imaging range according to. Then, the image information analysis unit, as the difference calculation step,
A difference in luminance of each pixel between the all black image and the test image is calculated (step S70). Thereby, image information as shown in FIG. 19 is obtained within the imaging range of the imaging apparatus 300.

Next, as a reference pattern position calculation step, the image information analysis unit calculates the position of the reference pattern based on the luminance difference image calculated in step S70 (step S72).
. In step S72, a pixel having a large change in luminance can be calculated as the position of the reference pattern.

Subsequently, the image information analysis unit performs a matching process between the position of the reference pattern calculated in step S72 and the position information REF of the measurement point set in advance as a matching process step (step S74).

Then, as the measurement point calculation step, the image information analysis unit specifies the size of the projection image using the result after the matching process in step S74, and calculates the position of the measurement point in the imaging range PR2 (step S76). Then, the series of processing ends (end).

Image information at a position within the imaging range calculated by the processing shown in FIG.
By extracting from the image information acquired by 00, it is possible to adjust the luminance and chromaticity of each projected image in FIG. 1 by only one imaging in a smaller imaging range.

As described above, according to the second embodiment, as in the first embodiment, the reference pattern is arranged in each projection image, and the position of the measurement point in each projection image is calculated based on the reference pattern. Therefore, it is not necessary to acquire image information of all the projection images of the multi-projection system. Therefore, since it is only necessary to capture images at once within the imaging range including the measurement points in all the projected images, even if the screen SCR becomes a large screen, it is possible to adjust each projected image at a low cost in a short time. Become.

Further, according to the second embodiment, the process of specifying the shape of the reference pattern as in the first embodiment can be omitted.

[Embodiment 3]
In the multi-projection system according to the first or second embodiment, the brightness and chromaticity of the projection image are adjusted based on the image information at the measurement point. However, the present invention is not limited to this. In the multi-projection system in the third embodiment, at least one position of the projection image projected on the screen SCR is adjusted.

FIG. 22 is a diagram for explaining the operation of the image adjustment apparatus according to the third embodiment. FIG. 22 shows an example in which the first and second projection images IMG1 and IMG2 are adjusted, but the projection images of the first to fourth projection images IMG1 to IMG4 shown in FIG. Can do.

In the third embodiment, as shown in FIG. 22, for example, the first and second projection images IMG1, IMG
When the shape of 2 is a trapezoidal shape, the first and second projectors PJ1 are based on the image information acquired by imaging the test image or the like described in the first or second embodiment with the imaging device 300. , PJ2 is subjected to a known keystone correction to adjust the tiling image. Therefore, after the adjustment, the first and second projection images IMG1 in FIG.
Thus, it becomes possible to provide an image display system capable of adjusting the projected image in a short time at a low cost.

In such a multi-projection system according to the third embodiment, the operations of the image adjustment control unit of the image adjustment apparatus and the image processing unit of each projector are different from those of the first or second embodiment.

For example, the image adjustment control unit in the third embodiment calculates the adjustment parameter so as to correct the inclination of the side of the reference pattern based on the image information of the test image in the first embodiment, and the image processing unit in the third embodiment A known keystone correction is performed based on this adjustment parameter.

Further, when using the image information of the test image in the second embodiment, the number of measurement points in each projection image is increased, and the image adjustment control unit in the third embodiment determines the inclination of the position of the obtained measurement point group. The adjustment parameter is calculated according to the above, and the image processing unit in the third embodiment may perform known keystone correction based on the adjustment parameter.

As described above, according to the third embodiment, as in the first or second embodiment, the reference pattern is arranged in each projection image, and the position of the measurement point in each projection image is determined based on the reference pattern. Since the calculation is performed, it is not necessary to acquire image information of all the projection images of the multi-projection system. Therefore, since it is only necessary to capture images at once within the imaging range including the measurement points in all the projected images, even if the screen SCR becomes a large screen, it is possible to adjust each projected image at a low cost in a short time. Become.

Further, according to the third embodiment, since the position of at least one image constituting the tiling image (composite image) is corrected based on the image information of the measurement point of each projection image, a simple configuration and In the processing, for example, a boundary portion between two projection images becomes inconspicuous, and deterioration of the image quality of the composite image can be prevented.

The image display system and the image adjustment method according to the present invention have been described based on the above embodiments. However, the present invention is not limited to the above embodiments, and various modifications can be made without departing from the scope of the invention. For example, the following modifications are possible.

(1) In each of the above-described embodiments, an example in which a tiling image as a composite image in which a plurality of projection images are arranged two-dimensionally has been described. However, the present invention is not limited to this. For example, the composite image may be an image displayed by superimposing a plurality of projection images.

(2) In each of the embodiments described above, the image adjustment device according to the present invention is provided outside the projector. However, the image adjustment device according to the present invention is provided in any of a plurality of projectors constituting the multi-projection system. A function may be built in.

(3) In each of the above embodiments, the projection image by the projector has been described as an example, but the present invention is not limited to this. For example, a liquid crystal display device, a plasma display device,
The present invention can also be applied to an image display system that displays a plurality of images as a tiling image, such as an organic EL display device.

(4) In each of the above embodiments, an example in which the number of projectors constituting the multi-projection system is “4” has been mainly described, but the present invention is not limited to this. In the present invention, the number of projectors constituting the multi-projection system is “2”.
It can be applied to the above.

(5) In each of the above embodiments, the light valve is used as the light modulation element (light modulation unit). However, the present invention is not limited to this. Light modulator (light modulator)
For example, DLP (Digital Light Processing) (registered trademark), LCOS (Liquid Cr
ystal On Silicon) may be employed.

(6) In each of the above embodiments, the present invention has been described as an image display system and an image adjustment method, but the present invention is not limited to this. For example, the present invention may be an image adjustment apparatus for realizing the present invention, a program in which processing procedures of an image adjustment method are described, or a recording medium on which the program is recorded.

1 is a diagram illustrating a configuration example of a multi-projection system in Embodiment 1. FIG. The block diagram of the structural example of the multi-projection system of FIG. FIG. 3 is an operation explanatory diagram of the image adjustment control unit in FIG. 2. Explanatory drawing of the specific processing content in an image adjustment control part. The block diagram of the structural example of the image process part mounted in each projector. The figure which shows the structural example of the image display part of FIG. FIG. 3 is a diagram illustrating an example of a processing flow of image adjustment processing of the multi-projection system according to the first embodiment. FIG. 3 is a schematic diagram illustrating an operation example of the multi-projection system according to the first embodiment. FIG. 3 is a diagram illustrating an example of a test image for detecting a position of a measurement point according to the first embodiment. FIG. 3 is a diagram schematically illustrating a coordinate system of each projection image and a coordinate system of the imaging apparatus in the first embodiment. FIG. 3 is a diagram illustrating the principle of measurement point position detection processing according to the first embodiment. FIG. 3 is a block diagram of a configuration example of an image information analysis unit of the image adjustment apparatus according to the first embodiment. FIG. 13 is a block diagram of a configuration example of a reference pattern shape calculation unit in FIG. 12. FIG. 3 is a flowchart of a calculation processing example of a position of a measurement point within an imaging range of an image information analysis unit according to the first embodiment. Explanatory drawing of step S32 of FIG. 16A and 16B are explanatory diagrams of step S38 in FIG. FIG. 15 is a flowchart of a processing example of a reference pattern shape calculation process of FIG. 14; 18A, 18B, 18C, and 18D are explanatory diagrams of each process of FIG. FIG. 6 is a diagram illustrating an example of a test image for detecting a position of a measurement point in the second embodiment. FIG. 9 is a diagram illustrating the principle of measurement point position detection processing according to the second embodiment. FIG. 9 is a flowchart of a calculation processing example of the position of a measurement point within an imaging range of an image information analysis unit in the second embodiment. FIG. 10 is an operation explanatory diagram of the image adjustment apparatus according to the third embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Multi projection system 100 ... Image display part 110 ... Light source,
112, 114 ... integrator lens, 116 ... polarization conversion element,
118: Superimposing lens, 120R: R component dichroic mirror,
120G ... Dichroic mirror for G component, 122, 148, 150 ... Reflection mirror,
124R: Field lens for R component, 124G: Field lens for G component,
130R ... Liquid crystal panel for R component, 130G ... Liquid crystal panel for G component,
130B ... B component liquid crystal panel, 140 ... Relay optical system,
142, 144, 146 ... relay lens, 160 ... cross dichroic prism,
170 ... projection lens, 180 ... image processing unit, 182 ... adjustment parameter storage unit,
184 ... Signal conversion unit, 190 ... Image data input unit, 200 ... Image adjustment device,
210 ... an image data generation unit, 220 ... an image information analysis unit,
222 ... reference pattern shape calculation unit, 224 ... projected image size calculation unit,
226 ... Measurement point position calculation unit, 228 ... Measurement data processing unit, 230 ... Image adjustment control unit,
250 ... luminance histogram calculation unit, 252 ... image division unit,
254... Reference pattern edge search unit, 300... Imaging device, BI1 to BI4.
BP1 to BP4 ... first to fourth reference patterns,
BP12, BP13, BP21, BP24, BP31, BP34, BP42, BP43 ...
Reference pattern,
IMG1 to IMG4 ... first to fourth projection images,
P12, P13, P21, P24, P31, P34, P42, P43 ... measurement points,
PJ1 to PJ4: first to fourth projectors, PR, PR2: imaging range,
SCR ... Screen

Claims (15)

An image display system that displays one composite image configured using a first display image and a second display image in which measurement points are provided in each display image,
A first image display device for displaying the first display image including a first reference pattern;
A second image display device for displaying the second display image including a second reference pattern;
An imaging device that captures the composite image at a time in an imaging range including all measurement points in the composite image, and acquires image information of the composite image;
An image adjustment device that performs control to adjust at least one of the first display image and the second display image based on the image information,
The image adjusting device is
The position of the measurement point in each display image is calculated based on the first reference pattern and the second reference pattern in the imaging range, and the imaging corresponding to the position of the measurement point in the display image An image display system that performs control to adjust at least one of the first display image and the second display image based on image information at a position within a range. In claim 1,
The first reference pattern and the second reference pattern are:
An image display system characterized by being a pattern of a predetermined shape having a luminance different from that of a background image. In claim 2,
Each of the reference patterns is
An image display system comprising a rectangular pattern having a luminance different from that of a background image. In any one of Claims 1 thru | or 3,
A reference pattern shape calculation unit that calculates at least one shape of the first reference pattern and the second reference pattern based on the image information;
A display image size calculation unit that calculates a size of a display image including the reference pattern based on the shape calculated by the reference pattern shape calculation unit;
A measurement point position calculation unit that calculates the position of the measurement point in the imaging range corresponding to the position of the measurement point in the display image based on the size of the display image calculated by the display image size calculation unit; Including
The image adjusting device is
An image display system that performs control to adjust at least one of the first display image and the second display image based on image information of a position calculated by the measurement point position calculation unit. In claim 4,
A luminance histogram calculator for calculating a luminance histogram in the vertical direction and a luminance histogram in the horizontal direction within the imaging range;
An image dividing unit that divides an image in the imaging range based on the luminance histogram calculated by the luminance histogram calculating unit;
A reference pattern search unit for searching for a side of the reference pattern in the image divided by the image dividing unit,
The reference pattern shape calculation unit
An image display system, wherein the shape of the reference pattern is calculated based on the side searched by the reference pattern search unit. In claim 1,
Each of the reference patterns is
An image display system, which is a pattern having a predetermined shape and having a luminance different from that of a background image, which is arranged at a position of a measurement point in each display image. In any one of Claims 1 thru | or 6.
The image adjusting device is
An image display system that performs control to adjust at least one luminance and chromaticity of the first display image and the second display image based on image information at a measurement point of each display image. In any one of Claims 1 thru | or 6.
The image adjusting device is
An image display system that performs control to adjust at least one position of the first display image and the second display image based on image information at a measurement point of each display image. Measurement point in each of the display images are provided, one configured by using the second display image displayed by the first display image and the second image display device to be displayed by the first image display device An image adjustment method for a composite image,
An image display step for displaying the first display image including a first reference pattern and the second display image including a second reference pattern;
An image information acquisition step of capturing the composite image at a time in an imaging range including all measurement points in the composite image and acquiring image information of the composite image;
The position of the measurement point in each display image is calculated based on the first reference pattern and the second reference pattern in the imaging range, and the imaging corresponding to the position of the measurement point in the display image An image adjustment method comprising: an image adjustment step of performing control to adjust at least one of the first display image and the second display image based on image information at a position within the range. In claim 9,
The first reference pattern and the second reference pattern are:
An image adjustment method comprising a pattern having a predetermined shape having a luminance different from that of a background image. In claim 10,
Each of the reference patterns is
An image adjustment method comprising a rectangular pattern having a luminance different from that of a background image. In any of claims 9 to 11,
A reference pattern shape calculating step for calculating at least one shape of the first reference pattern and the second reference pattern based on the image information;
A display image size calculating step for calculating a size of a display image including the reference pattern based on the shape calculated in the reference pattern shape calculating step;
A measurement point position calculating step for calculating the position of the measurement point in the imaging range corresponding to the position of the measurement point in the display image based on the size of the display image calculated in the display image size calculation step; Including
The image adjustment step includes:
An image adjustment method, wherein control is performed to adjust at least one of the first display image and the second display image based on image information of the position calculated in the measurement point position calculation step. In claim 12,
A luminance histogram calculating step for calculating a vertical luminance histogram and a horizontal luminance histogram within the imaging range;
An image dividing step of dividing an image within the imaging range based on the luminance histogram calculated in the luminance histogram calculating step;
A reference pattern searching step of searching for a side of the reference pattern in the image divided in the image dividing step,
The reference pattern shape calculating step includes:
An image adjustment method, comprising: calculating a shape of the reference pattern based on the side searched in the reference pattern search step. In claim 9,
Each of the reference patterns is
An image adjustment method comprising: a pattern having a predetermined shape and having a luminance different from that of a background image, which is arranged at a position of a measurement point in each display image. In any of claims 9 to 14,
The image adjustment step includes:
An image adjustment method comprising performing control to adjust at least one luminance and chromaticity of the first display image and the second display image based on image information at a measurement point of each display image.

Images