JP2013037082A - Image processing device and image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To eliminate the convenience that either lens shift for moving a projection lens or image shift for moving an image position on a liquid crystal panel is permitted when a user adjusts the position of a projection image on a screen.SOLUTION: The lens shift and image shift are interlocked according to an instruction from a user to move a projection position. First, an image projection area 204 of an image on a screen 201 is moved for each maximum projection area 203 by means of lens shift. If the maximum projection area 203 exceeds a moving range 202 of the projection lens, image shift is performed to move the image projection area 204 in the maximum projection area 203. The image projection area 204 on the screen 201 can be maximally shifted.

Description

  The present invention relates to an image processing apparatus and an image processing method for enlarging and projecting an image displayed on an image forming panel onto a projection surface such as a screen.

  Conventionally, a projection display device has been used as a television receiver or a large-screen display device for presentation. The projection display device enlarges and projects an image on a projection surface such as a screen as follows. That is, using an irradiation light from a light source, an image forming panel constituted by a plurality of image forming elements represented by a liquid crystal panel is illuminated via an optical system such as a mirror or a polarizing plate, and the image forming panel is illuminated. The formed image is enlarged and projected onto a screen through a projection lens.

  In this type of projection display device, a lens shift function for moving the position of a projection lens is known as a function for adjusting an image position (projection position) projected on a screen. Lens shift is a function that adjusts the projection position on the screen by changing the projection direction by moving (shifting) the projection lens within a fixed range in at least one of the two axes orthogonal to the optical axis. Yes (see, for example, Patent Document 1). By performing lens shift, it is possible to easily adjust the projection position via a UI (user interface) or the like while viewing the image projected by the user.

Japanese Patent No. 0328886

  In recent projection display devices, with the increase in the number of pixels in an image forming panel represented by a liquid crystal panel, the number of pixels in the image area (image forming area) formed on the panel rather than the number of pixels in the image forming panel. May be small. In this case, a mask area is generally formed on the image forming panel by adding a black or single color image to the peripheral area of the image forming area.

  In addition to the lens shift function that adjusts the projection position by shifting the projection lens as described above, the projection display device has an image shift function that moves (shifts) the image forming area of the image within the image forming panel. ing. That is, the image shift is a function of adjusting the projection position with respect to the screen by shifting the position of the image forming area within the image forming panel.

  However, in the conventional projection display device, even if both the lens shift function and the image shift function are provided, the functions are independent of each other. Therefore, when the user adjusts the projection position, it is necessary to select either lens shift or image shift, which is not convenient. For example, when the user adjusts the projection position of the image forming area using the lens shift function, the adjustment range is the range of the projection lens even though a wider range of adjustment is possible by using the image shift function. It was limited to the limit of movement.

  SUMMARY An advantage of some aspects of the invention is to provide an image processing apparatus and an image processing method having the following functions. That is, when adjusting the projection position of the image on the projection surface, a lens shift function for moving the projection lens and an image shift function for moving the image forming area in the image forming panel are continuously controlled to perform a wider range of adjustment. .

  As a means for achieving the above object, an image processing apparatus of the present invention comprises the following arrangement.

  That is, the light source, the image forming panel, and a projection unit that projects an image onto a projection surface using a projection lens, a lens shift unit that moves the projection lens, and the image forming surface of the image forming panel form the image. An image shift means for moving the image forming area, an instruction input means for inputting movement instruction information for instructing movement of an image projected on the projection surface, and the lens shift means according to the movement instruction information. A control unit that outputs a lens shift command indicating a movement direction and a movement amount of the projection lens, and an image shift command indicating a movement direction and a movement amount of the image forming area with respect to the image shift unit. Either one of the lens shift means and the image shift means operates in accordance with the movement instruction information, and after the operation ends To work better, and outputs the lens shift command and the image shift instructions.

  According to the present invention, when adjusting the projection position of the image on the projection surface, the lens shift function for moving the projection lens and the image shift function for moving the image forming area in the image forming panel are continuously controlled, so that a wider range. Adjustments can be made.

The block diagram which shows schematic structure of the projection display apparatus in 1st Embodiment, The figure explaining the projection image in 1st Embodiment, The flowchart which shows the shift adjustment process in 1st Embodiment, The flowchart which shows the shift adjustment process in 2nd Embodiment, It is a block diagram which shows schematic structure of the projection display apparatus in 3rd Embodiment.

  Hereinafter, embodiments according to the present invention will be described with reference to the drawings. The following embodiments do not limit the present invention related to the scope of claims, and all combinations of features described in the present embodiments are essential to the solution means of the present invention. Not necessarily.

<First Embodiment>
In this embodiment, image processing is performed by illuminating an image forming panel such as a liquid crystal panel using irradiation light from a light source, and enlarging and projecting an image formed on the image forming panel onto a projection surface such as a screen via a projection lens. A projection display device, which is a device, will be described.

Device Configuration FIG. 1 is a block diagram showing a schematic configuration of a projection display device according to this embodiment. In the figure, an image shift unit 101 controls an image shift function for moving the position of an image formed on the image forming panel 102 when the number of pixels of the input image is smaller than the number of pixels of the image forming panel 102. Specifically, the input image writing timing for each pixel of the image forming panel 102 is determined based on the information indicating the moving amount and moving direction indicated by the image shift command output from the control unit 105. For an area where an input image is not written on the image forming panel 102, an output signal is generated on the assumption that a black or monochrome image is written. Hereinafter, the area of the input image formed on the image forming panel 102 is referred to as an image forming area.

  The image forming panel 102 includes a plurality of image forming elements, and forms an input image on the surface thereof. The image forming panel 102 is a reflective liquid crystal panel such as LCOS (Liquid Crystal On Silicon), and has various conversion circuits and panel drivers (not shown). The output signal from the image shift unit 101 is first converted into a drive voltage according to the signal level, and further converted into an AC signal by polarity inversion processing. The converted AC signal is converted into an analog signal by DA conversion processing, and then applied to the liquid crystal panel via a panel driver, thereby forming an image. Needless to say, when the liquid crystal panel is a digital input, the DA conversion process is unnecessary. Further, as the image forming panel 102, a DMD (Digital Micromirror Device) may be used, or a transmissive liquid crystal panel may be used.

  The light source 106 is a white light source such as a high-pressure mercury lamp, for example, and is split into three primary colors of RGB by a dichroic mirror (not shown). Each split light is incident on the image forming panel 102 via a polarizing plate (not shown), and becomes irradiation light to each of the RGB liquid crystal panels. As the light source 106, a light emitting diode (LED), a laser, or the like may be used. In the image forming panel 102, RGB transmitted light or reflected light corresponding to the voltage applied to the liquid crystal panel is combined by a cross dichroic prism (not shown), and the combined light is output to the projection lens unit 103. The projection lens unit 103 includes a projection lens, and the input combined light is enlarged and projected onto a screen 107 serving as a projection surface installed in front through the projection lens.

  The lens shift unit 104 controls a lens shift function that moves (shifts) the position of the projection lens within a predetermined range on at least one orthogonal axis with respect to the optical axis of the combined light that is incident light on the projection lens unit 103. . The projection position of the image on the screen can be adjusted by changing the projection direction of the synthesized light by lens shift. Note that the shift amount of the projection lens is determined based on information indicating the movement amount and the movement direction indicated by the lens shift command output from the control unit 105.

  The control unit 105 continuously controls the shift operations in the image shift unit 101 and the lens shift unit 104. That is, based on the image area information of the input image and the projection position movement instruction information according to the user instruction, information indicating the movement amount and the movement direction for each of the image shift and the lens shift is determined and output as each shift command To do. At that time, control is performed so that either one of the lens shift and the image shift operates according to the projection position movement instruction information, and the other operates after the operation ends. Here, the image area information is information indicating the size of the input image. The projection position movement instruction information is information obtained by inputting an instruction via the UI when the user adjusts the projection position, and indicates the movement direction (horizontal or / and vertical) of the projection image with respect to the screen. . The projection position movement instruction information is not limited to information from the UI, and may be information indicating the positional relationship between the screen and the image acquired by a sensor such as a camera attached to the projection display device, for example.

Shift Adjustment Process A shift adjustment process in which the control unit 105 controls image shift and lens shift in conjunction with each other will be described below with reference to FIGS.

  FIG. 2 is a diagram illustrating a projected image in the present embodiment. In the figure, reference numeral 201 denotes a screen as a projection surface, which corresponds to the screen 107 in FIG. Reference numeral 203 denotes a maximum projection area on the screen 201, that is, an area that can be projected onto the screen 201 when projection using all the pixels of the image forming panel 102 is performed. Reference numeral 204 denotes an image projection area on which an input image is projected, which is an area smaller than the maximum projection area 203. For example, the size of the image forming panel 102 is horizontal 2048 pixels × vertical 1080 pixels, the size of the input image is horizontal 1280 pixels × vertical 1024 pixels, and dot-by-dot display is performed in which the input pixels and the projection pixels correspond one-to-one. In some cases, an image projection area 204 is generated. The image projection area 204 depends on the size of the input image, that is, the image forming area on the image forming panel 102. It is assumed that a region within the maximum projection region 203 and outside the image projection region 204 (a region indicated by diagonal lines in FIG. 2) is masked by an image indicating a black level. Reference numeral 202 denotes a range (lens movable range) in which the maximum projection region 203 can be moved when the projection lens is shifted to the limit of the movable range (movable limit) by lens shift.

  FIG. 3 is a flowchart showing an example of the shift control process in the present embodiment. First, the control unit 105 refers to the projection position movement instruction information and determines whether or not there is a projection position movement instruction (S101). As described above, the projection position movement instruction information is information obtained via the UI, for example. Here, the UI is realized as, for example, a remote controller (remote controller) having four buttons, upper, lower, left, and right, and a user can see a projected image on the screen 107 and a button in a direction in which the user wants to shift the image with respect to the screen 107. Press. Note that the user's instruction to move the projection position is given to the image projection area 204 projected on the screen 201 in FIG.

  If there is an instruction to move the projection position in S101, a lens shift is executed in S102. That is, in S102, first, the control unit 105 determines the movement direction of the projection lens so that the projected image is shifted in the direction according to the user's instruction. Then, the lens shift unit 104 executes the lens shift according to the movement direction of the projection lens determined by the control unit 105. The shift amount at this time is assumed to be based on a movement amount set in advance by the control unit 105. This movement amount may be a fixed value or may be calculated each time according to the projection size of the input image indicated by the image area information (the size of the image projection area shown below). Due to this lens shift, the image projection area 204 shown in FIG.

  After the lens shift in S102, the control unit 105 determines whether or not the projection lens has reached the movable limit (S103). Whether or not the movable limit has been reached is determined by storing a cumulative value of the moving direction and the moving amount in the control unit 105, and moving the cumulative value relative to the initial position of the maximum projection area 203. In addition, it may be determined whether or not the maximum projection area 203 exceeds the lens movable range 202. Further, the lens shift unit 104 may be provided with a mechanism for determining the movable limit. If the projection lens has not reached the movable limit in S103, it is determined whether or not the projection position movement instruction has been completed (S104) .If the projection position movement instruction has been completed, the lens shift is terminated ( S105), a series of shift adjustment processing is completed. On the other hand, if the projection position movement instruction has not ended in S104, the process returns to S102 and the lens shift is continued.

  Next, processing when the projection lens has reached the movable limit in S103 will be described. Here, FIG. 2 (b) schematically shows an example of the case where the user reaches the lens movable limit while pressing the right button of the remote control with respect to the projection image shown in FIG. 2 (a). A state in which the projection area 203 has reached a limit position where the lens can be shifted is shown. In this case, the control unit 105 first controls to end the lens shift (S106), and then executes the image shift (S107). In S107, the control unit 105 first determines the moving direction of the image shift so that the projected image is shifted in the direction according to the user's instruction. Then, the image shift unit 101 performs image shift according to the determined image shift movement direction. Note that the image shift is performed based on the movement amount set in advance by the control unit 105, similarly to the lens shift. Due to this image shift, the image projection area 204 shown in FIG. 2B moves within the maximum projection area 203.

  After the image shift in S107, the control unit 105 refers to the image area information and determines whether or not the image projection area 204 on which the input image is projected deviates from the maximum projection area 203 (S108). This deviation determination is performed based on, for example, the current image formation position on the image forming panel 102, that is, the image forming area. Specifically, the control unit 105 stores the cumulative value of the moving direction and the moving amount of the image forming area on the image forming surface of the image forming panel 102, and moves the cumulative value to the initial position of the image forming area. What is necessary is just to determine whether it deviates from an image formation surface when performing. When the image forming area deviates from the image forming surface in the image forming panel 102, it is determined that the image projection area 204 deviates from the maximum projection area 203 on the screen 201. When deviating, the image shift is terminated (S110), and a series of shift adjustment processing is completed. Here, FIG. 2 (c) shows that the image projection area 204 is obtained by performing image shift on the projected image at the lens movable limit shown in FIG. 2 (b) under the condition that the right button of the remote control is kept pressed. A state in which a limit that does not deviate from the maximum projection area 203 is reached is shown. That is, the image projection area 204 is shifted to the maximum on the screen 201.

  If the image projection area 204 does not deviate from the maximum projection area 203 in S108, it is determined whether or not the projection position movement instruction has ended (S109), and if the projection position movement instruction has ended, the image shift is performed. The process ends (S110). On the other hand, if the instruction to move the projection position has not ended, the process returns to S107, and the image shift is continued.

  As described above, according to the present embodiment, when the user adjusts the position of the image projected on the screen, the projection position of the projection position can be adjusted while interlocking the lens shift and the image shift by determining the movable limit of the projection lens. Make adjustments. Thereby, especially when the image projection area 204 is smaller than the maximum projection area 203, the projection position of the image projection area 204 can be adjusted to the maximum with a single UI beyond the lens shift limit. That is, when the user adjusts the projection position of the image on the screen, it is possible to perform adjustment with a single UI without being aware of lens shift or image shift, and convenience is improved.

  Note that the shift adjustment processing in the present invention is not limited to the example described with reference to FIGS. For example, a configuration may be adopted in which a predetermined waiting time is set during the transition from the lens shift to the image shift in S106 and S107 in FIG. 3 to notify the user of the transition. Here, the waiting time is a time for which the movement amount is zero for both the lens shift and the image shift.

  Further, after the image projection area 204 deviates from the maximum projection area 203 in S108, the image formation may be continued in the deviated state without ending the image shift. For example, if a predetermined waiting time is set before the end of the image shift in S110 and the projection position movement instruction is not finished within the waiting time, the image projection area 204 is left as it deviates from the maximum projection area 203. Image shift may be performed.

  Further, the processing order of the lens shift and the image shift may be switched. In this case, after the image shift is performed first, the lens shift may be performed when the image projection area 204 deviates from the maximum projection area 203.

Second Embodiment
Hereinafter, a second embodiment according to the present invention will be described. In the first embodiment described above, when the size of the input image is changed after the image shift is executed, the image projection area 204 may deviate from the maximum projection area 203. The second embodiment is characterized in that further shift adjustment (image shift) is performed when there is a change in image area information indicating the size of the input image after the shift adjustment in the first embodiment. In addition, since the structure of the projection display apparatus in 2nd Embodiment is the same as the structure shown in FIG. 1 in 1st Embodiment mentioned above, description is abbreviate | omitted.

  Hereinafter, the shift adjustment process in the second embodiment will be described with reference to the flowchart of FIG. As described above, the process shown in the flowchart of FIG. 4 is executed after the process shown in the flowchart of FIG. 3 in the first embodiment described above.

  First, the control unit 105 refers to the image area information of the input image and determines whether or not there is a change in the image size between the currently projected image and the next image to be projected (S201). For example, if there is a change in the size of successive frames during projection of a moving image, it is determined in S201 that the image area information has changed. If there is a change, it is determined whether or not the image projection area 204 corresponding to the changed image area information deviates from the maximum projection area 203 (S202). If it does not deviate, the shift adjustment process is terminated as it is, but if it deviates, image shift is executed until the image projection area 204 reaches a limit position that does not deviate from the maximum projection area 203 (S203). As the details of the image shift processing in S203, the control unit 105 determines the image shift movement direction so that the image projection area 204 moves to the minimum position within the maximum projection area 203, and sets the movement amount to a predetermined amount. The image shift based on it is repeated.

  As described above, according to the second embodiment, in addition to the effects obtained in the first embodiment described above, it is possible to prevent the image projection area from deviating from the maximum projection area by changing the input image size. This improves convenience.

<Third Embodiment>
The third embodiment according to the present invention will be described below. In the first and second embodiments described above, the example in which the size information of the input image is used as the image area information has been shown. However, the input image itself is an image in which a black level image (black mask) is embedded in the peripheral portion (image peripheral portion), that is, a black mask image is projected such that the black mask is included in the image forming area. There is also a technique. For example, when a 4: 3 image is projected on an input image having a horizontal / vertical size ratio of 16: 9, a black mask may be embedded on the left and right sides of the image itself. In the processing on the projection display device side, a black mask may be embedded in the peripheral portion of the image by, for example, keystone (trapezoidal distortion correction) processing or reduction processing. The third embodiment is characterized in that the black mask region embedded in the peripheral portion of the image is regarded as outside the image forming region, and the range in which the image can be shifted is widened.

  FIG. 5 is a block diagram illustrating a schematic configuration of the projection display device according to the third embodiment. The configuration shown in the figure is characterized in that a black mask region determination unit 501 is provided in addition to the configuration shown in FIG. 1 in the first embodiment. Since other configurations are the same as those in FIG. 1, the same reference numerals are given, and descriptions thereof are omitted.

  The black mask area determination unit 501 determines an area having a signal level of black in the periphery of the image, that is, an area that is equal to or lower than a predetermined level corresponding to the black level, as a black mask area. Here, the peripheral portion of the image is set in advance as a region within the predetermined range in the image from the edge of the image in which a black mask may be embedded in the input image. . Then, an area excluding the black mask area from the input image is set as a new image forming area. Then, information indicating the image size of the set new image forming area is output to the control unit 105 as image area information. The shift adjustment process by the control unit 105 and other configurations is executed in the same manner as in the first or second embodiment described above.

  As described above, according to the third embodiment, the black mask region embedded in the peripheral portion of the image is determined, and the black mask region is regarded as outside the image forming region, and image shift is performed. Thereby, as the image projection area in the maximum projection area becomes smaller, the movable range becomes wider, that is, the range in which image shift is possible can be expanded.

<Other embodiments>
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and the computer of the system or apparatus (or CPU, MPU, etc.) reads the program. It is a process to be executed.

Claims (9)

Projection means for projecting an image onto a projection surface using a light source, an image forming panel, and a projection lens;
Lens shift means for moving the projection lens;
An image shift means for moving an image forming area in which the image is formed on an image forming surface of the image forming panel;
Instruction input means for inputting movement instruction information for instructing movement of an image projected on the projection surface;
According to the movement instruction information, a lens shift command indicating a movement direction and a movement amount of the projection lens with respect to the lens shift unit, and an image shift command indicating a movement direction and a movement amount of the image forming region with respect to the image shift unit. Control means for outputting,
The control unit is configured to operate the lens shift command and the image shift command so that one of the lens shift unit and the image shift unit operates according to the movement instruction information, and the other operates after the operation ends. Is output.   The control means first outputs the lens shift command according to the movement instruction information, and the image shift command when the position of the projection lens moved according to the lens shift command deviates from a predetermined movable range. The image processing apparatus according to claim 1, wherein:   The control means first outputs the image shift command in accordance with the movement instruction information, and outputs the lens shift command when the image forming area moved in response to the image shift command deviates from the image forming surface. The image processing apparatus according to claim 1, wherein the image processing apparatus outputs the image. Furthermore, it has an input means for inputting the size information of the image,
The image processing apparatus according to claim 2, wherein the control unit outputs the image shift command based on the size information so that the image forming area does not deviate from the image forming surface. Further, in the peripheral portion of the image within the predetermined range from the edge of the image, an area where the signal level is equal to or lower than the predetermined level is a black mask area, and new size information is obtained by omitting the black mask area from the image. Black mask area determination means for setting
The image processing apparatus according to claim 4, wherein the control unit outputs the image shift command based on new size information set by the black mask region determination unit.   The said lens shift means moves the said projection lens within the predetermined range on the orthogonal axis with respect to the optical axis of incident light based on the said lens shift command, The any one of Claim 1 thru | or 5 characterized by the above-mentioned. The image processing apparatus described.   The image shift means moves the image forming area on the image forming surface by controlling the writing timing of the image for each pixel on the image forming surface based on the image shift command. The image processing apparatus according to any one of claims 1 to 6. Projection means for projecting an image onto a projection surface using a light source, an image formation panel, and a projection lens, lens shift means for moving the projection lens, and image formation in which the image is formed on the image formation surface of the image formation panel An image processing method in an image processing apparatus having an image shift means for moving an area, an instruction input means, and a control means,
The instruction input means inputs movement instruction information for instructing movement of an image projected on the projection surface,
The control means determines, according to the movement instruction information, a lens shift command indicating a movement direction and movement amount of the projection lens with respect to the lens shift means, and a movement direction and movement amount of the image forming area with respect to the image shift means. An image processing method comprising: outputting one of the lens shift means and the image shift means to operate so that the other operates after the operation ends.   A program for causing a computer device to function as each unit of the image processing device according to any one of claims 1 to 7 when executed on the computer device.

Images