JP2006174053A - Projection apparatus, projection control method, and program - Google Patents

Abstract

In consideration of the influence of the color of a screen that is a projection target of an image, a projected image having a hue with no unnaturalness and handwritten writing information are always photographed and reproduced later.
A projection system including an SOM 27 for performing projection according to an input image signal, a projection lens 12, a photographing lens 13 for photographing a projection range, a photographing system including a CCD 39, and a white image on the entire surface by the projection system. A projection range is photographed by the photographing system in the projected state, a first color correction value with the image signal is calculated from the obtained image information, color correction of the image to be projected is performed according to the first color correction value, and a key When recording of the projection image is instructed by the switch unit 15, the projection range is photographed by the photographing system in a state where the entire white image is projected by the projection system, and information on the first color correction value is added to the obtained image information. And a control unit 35 that is added and recorded in the image recording unit 37 in association with the initially projected image.
[Selection] Figure 2

Description

  The present invention relates to a projection apparatus having a photographing function capable of photographing projection content, a projection control method, and a program.

Conventionally, a projector is provided with a digital camera, and during projection of a document, a screen in a document projection state is photographed in accordance with a user's photographing operation to capture a document image, and then a single state screen in which projection of the document is stopped is provided. Take a handwritten information image showing only the handwritten information directly written on the screen, record both images in a predetermined manner and record them on a medium such as a memory card The handwritten information image can be used on a personal computer by attaching it to the PC. At that time, by confirming the corresponding document image, which document (or document page) contains the handwritten information reflected in the handwritten information image. There was a technology that made it possible to know if it corresponds to. (For example, Patent Document 1)
JP 2004-199299 A

  However, in the technique described in Patent Document 1, the background color specified in the document to be projected differs from the color of a screen such as a whiteboard that actually projects the image, so that projection display is performed. There is no denying the possibility that the resulting image will have an unnatural hue.

  Therefore, even if handwritten information is appropriately added to an image projected with such an unnatural color and the image is taken, the image obtained at the time of reproduction later can be a computer image or a projected image. While maintaining the original unnatural hue.

  The present invention has been made in view of the above circumstances, and its object is to consider the influence of the color of the screen that is the projection target of the image, and always to provide a projected image with unnaturalness and handwriting. It is an object of the present invention to provide a projection apparatus, a projection control method, and a program capable of photographing the writing information according to, and reproducing them later.

  According to the first aspect of the present invention, there is provided a projection unit that performs projection according to an input image signal, an imaging unit that captures a projection range of the projection unit, and a state in which a predetermined image is projected by the projection unit. The image capturing area is imaged by the image capturing means, and a calculation means for calculating a first color correction value for the image signal from the obtained image information, and the projection means projects according to the first color correction value obtained by the calculation means. A first projection control unit that performs color correction of an image to be performed, an instruction unit that instructs recording when projecting an image that has undergone color correction by the first projection control unit, and the projection unit according to the instruction unit A projection range is photographed by the photographing unit in a state where a predetermined image is projected, the information of the first color correction value is added to the obtained image information, and the information is recorded in association with the image projected by the projecting unit. Recording means and input It is determined that there is a determination unit that determines the presence or absence of an image recorded in association with the recording unit during the reproduction projection operation by the projection unit according to the image signal, and an image that is recorded in association with the determination unit. In this case, the second color image is subjected to color correction based on the information of the first color correction value added to the image recorded in association with the image and is projected onto the image projected by the projection unit. And a projection control means.

  According to a second aspect of the present invention, in the first aspect of the present invention, the predetermined image is an entire white image.

  According to a third aspect of the present invention, in the first aspect of the present invention, the calculation means causes the photographing means to photograph a projection range in a state where a predetermined image is projected by the projection means during the reproduction projection operation. A second color correction value for the image signal is calculated from the obtained image information, and the second projection control means projects the image superimposed with the second color correction value calculated by the calculation means. The color correction is performed.

  According to a fourth aspect of the invention, in the first aspect of the invention, the calculating means calculates a white color correction value as a background color based on the projection range photographed by the photographing means and the image signal. Features.

  According to a fifth aspect of the invention, in the first aspect of the invention, the calculating means converts the projection range photographed by the photographing means into at least one of a plurality of colors prepared in advance based on the image signal. The conversion value is calculated as a color correction value.

  According to a sixth aspect of the present invention, in the first aspect of the present invention, at least one of the first and second projection control means determines the color of the image to be projected according to the content of the color correction value calculated by the calculation means. It is characterized by canceling the execution of the correction.

  The invention according to claim 7 is a projection control method in a projection apparatus comprising: a projection unit that performs projection according to an input image signal; and an imaging unit that captures a projection range of the projection unit, A calculation step of photographing a projection range by the photographing unit in a state where a predetermined image is projected by the projection unit, and calculating a first color correction value for the image signal from the obtained image information, and a calculation step obtained by the calculation step A first projection control step of performing color correction of an image projected by the projection unit according to the first color correction value, and an instruction for instructing recording when projecting an image subjected to color correction in the first projection control step And a projection range is imaged by the imaging unit in a state where a predetermined image is projected by the projection unit in accordance with an instruction in the instruction step, and the information of the first color correction value is added to the obtained image information. Add and associate with the image projected by the projection unit A recording step for recording, a determination step for determining the presence or absence of an image recorded in association with the recording step during a reproduction projection operation by the projection unit according to an input image signal, and recording in association with the determination step When it is determined that there is an image that has been corrected, the image that has been subjected to color correction by the information of the first color correction value added to the image recorded in association with the image and projected by the projection unit And a second projection control step for projecting the images in a superimposed manner.

  The invention according to claim 8 is a program executed by a computer built in a projection apparatus including a projection unit that performs projection according to an input image signal and an imaging unit that captures a projection range of the projection unit. A calculation step of causing the imaging unit to image a projection range in a state where a predetermined image is projected by the projection unit, and calculating a first color correction value for the image signal from the obtained image information; A first projection control step for correcting the color of the image projected by the projection unit according to the first color correction value obtained in the step, and recording at the time of projecting the image subjected to the color correction in the first projection control step. An instruction step for instructing, and in accordance with an instruction in this instruction step, a projection range is imaged by the imaging unit in a state where a predetermined image is projected by the projection unit, and the first color correction value is obtained in the obtained image information A recording step in which information is added and recorded in association with the image projected by the projection unit, and an image recorded in association with the recording step during the reproduction projection operation by the projection unit according to the input image signal When it is determined that there is a determination step for determining the presence or absence and an image recorded in association with the determination step, the first color correction value added to the image recorded in association with the association A color correction is performed based on the information, and the computer executes a second projection control step of projecting the image by superimposing it on the image projected by the projection unit.

  According to the first aspect of the present invention, it is possible to project an image having a hue with no unnaturalness in consideration of the influence of the color of the screen that is the projection target of the image.

  According to the second aspect of the invention, in addition to the effect of the first aspect of the invention, it is easier to adjust the white balance and the like by projecting a full white image in which each primary color component has a full gradation. Can be.

  According to the third aspect of the invention, in addition to the effect of the first aspect of the invention, in addition to the projected image, handwritten writing information is photographed, and then they are similarly unnatural. It is possible to reproduce in shades.

  According to the invention described in claim 4, in addition to the effect of the invention described in claim 1, all digital cameras, etc., when the background color of the image and the screen to be projected are both generally white. By using the white balance adjustment function that is installed as a standard, it is possible to obtain a projected image with a more natural hue without complicating the circuit configuration.

  According to the invention described in claim 5, in addition to the effect of the invention described in claim 1 above, when there is a limit to the number of colors that can be colored simultaneously in the projection system, such as a color palette, it is more suitable within that range. By selecting the selected color, color correction can be executed, and the processing can be simplified.

  According to the sixth aspect of the invention, in addition to the effect of the first aspect of the invention, when color correction results in an unnatural hue, this is judged and color correction is performed. By avoiding this, it is possible to prevent the projected image from being unsightly.

  According to the seventh aspect of the present invention, it is possible to project an image having a hue with no unnaturalness in consideration of the influence of the color of the screen that is the projection target of the image.

  According to the eighth aspect of the present invention, it is possible to project an image having a hue with no unnaturalness in consideration of the influence of the color of the screen to be an image projection target.

(First embodiment)
A first embodiment when the present invention is applied to a projector apparatus will be described below with reference to the drawings.

  FIG. 1 shows the external configuration of the projector apparatus 10 according to the embodiment, and mainly shows the configuration of the front and top surfaces of the housing. As shown in the figure, a projection lens 12 and a photographic lens 13 are embedded in close proximity to a part of the front surface of a rectangular parallelepiped main body casing 11 toward the right side. An Ir receiver 14 is disposed on the front and left end sides of the main casing 11.

  The projection lens 12 is for projecting a light image formed by a spatial light modulation element such as a micromirror element, which will be described later, onto an object such as a screen, and here, a focus position and a zoom position (projection angle of view). Is arbitrarily variable.

  The photographing lens 13 is for photographing an image projected and displayed by the projection lens 12. The photographing lens 13 can also change the focus position and the zoom position, and in particular, the zoom position is the zoom of the projection lens 12. It is controlled in conjunction with the position, and is controlled so as to always have an imaging range corresponding to the size of the image projected from the projection lens 12.

  The Ir receiver 14 receives an infrared light (Ir) signal on which a key operation signal from a remote controller of the projector device 10 (not shown) is superimposed.

A key switch unit 15 and a speaker 16 are disposed on the upper surface of the main body casing 11.
The key switch unit 15 includes various key switches for instructing on / off of the apparatus, input switching, automatic focusing, automatic keystone correction, mode selection, projection image recording, and the like.

  The speaker 16 emits a sound of the input audio signal and a beep sound during operation.

Although not shown, an input / output connector section, an Ir receiving section similar to the Ir receiving section 14 and an AC adapter connecting section are disposed on the back surface of the main casing 11.
The input / output connector section includes, for example, a USB terminal for connection with an external device such as a personal computer, an RGB mini D-SUB terminal for video input, an S terminal, an RCA terminal, and a stereo mini terminal for audio input. Become.

  The AC adapter connection unit connects a cable from an AC adapter (not shown) serving as a power source.

Next, the functional configuration of the electronic circuit of the projector apparatus 10 will be described with reference to FIG.
In the figure, image signals of various standards input from the input / output connector unit 21 are unified into image signals of a predetermined format by the image conversion unit 23 via the input / output interface (I / F) 22 and the system bus SB. Later, it is sent to the projection encoder 24.

  The projection encoder 24 develops and stores the transmitted image signal in the video RAM 25, generates a video signal from the stored contents of the video RAM 25, and outputs the video signal to the projection drive unit 26.

  The projection driving unit 26 appropriately speeds up the time division by multiplying the frame rate, for example, 120 [frames / second], the number of color component divisions, and the number of display gradations as appropriate according to the transmitted image signal. For example, the micro-mirror element 27 which is a spatial light modulation element (SOM) is driven to display.

A light source lamp 29 disposed in the reflector 28 with respect to the micromirror element 27.
The high-intensity white light emitted from the light source is appropriately colored to the primary color via the color wheel 30 and irradiated through the integrator 31 and the mirror 32 to form an optical image with the reflected light. Thus, it is projected and displayed on a screen (not shown).

  However, both the lighting drive of the light source lamp 29 and the motor (M) 33 that rotationally drives the color wheel 30 operate based on the supply voltage value from the projection light processing unit 34.

  The control unit 35 controls all the operations of the above circuits. The control unit 35 includes a CPU, a non-volatile memory storing an operation program executed by the CPU including a projection operation and a photographing operation described later, a work memory, and the like.

  The control unit 35 is also connected with a process circuit 36, an image recording unit 37, and an audio processing unit 38 via a system bus SB.

  The process circuit 36 receives an output of a CCD 39 as an image pickup device that photoelectrically converts a light image that is behind the photographing optical axis of the photographing lens 13 and is formed by the photographing lens 13, and receives an analog value image from the CCD 39. The signal is digitized, and color process processing including pixel interpolation processing and γ correction processing is performed, and then a digital luminance signal Y and color difference signals Cb and Cr are generated and sent to the image conversion unit 23 via the system bus SB. Output.

  The image conversion unit 23 compresses the luminance and color difference signals by a process such as ADCT or Huffman coding, and writes the obtained image data into an image recording unit 37 that is mounted as a recording medium of the projector device 10. The image recording unit 37 is composed of, for example, a flash memory, and stores image data obtained by photographing.

  The sound processing unit 38 includes a sound source circuit such as a PCM sound source, converts the sound data given during the projection operation into an analog signal, drives the speaker 16 to emit a loud sound, or generates a beep sound if necessary.

  Each key operation signal in the key switch unit 15 is directly input to the control unit 35, and a signal from the Ir receiving unit 40 is also directly input. The Ir receiving unit 40 includes the Ir receiving unit 14 and an Ir receiving unit provided on the back side of the main body casing 11, converts the infrared light reception signal into a code signal, and sends the code signal to the control unit 35.

Next, the operation of the above embodiment will be described.
FIG. 3 shows a process of projecting individual images (hereinafter referred to as “slide images”) constituting a document file by a presentation (hereinafter referred to as “presentation” in the drawings) by a personal computer or the like connected to the projector apparatus 10. For example, the operation content in the “presentation recording mode” in which a whiteboard is used as a projection target screen and the projection image is appropriately written with a marker pen or the like and recorded, is controlled mainly by the control unit. 35 is performed based on the operation program of the corresponding mode.

  At the beginning of the operation, first, before the document file is projected, an image that is white on the entire surface is projected by setting the RGB color components to full gradation values for all the pixels constituting the image by the micromirror element 27 (step A01). In this state, the image range projected by the photographing lens 13, the CCD 39, and the process circuit 36 is imaged (step A02).

  In the image data obtained by this imaging, since the projected image is an entirely white image, the white level of the whiteboard that is the projection target screen is reflected as it is. Is executed, the image conversion unit 23 calculates the first white balance (WB) correction value (step A03).

  Next, depending on whether or not the calculated first white balance correction value is within a preset range, the white level of the screen projection surface can be corrected by white balance correction in the projector device 10. (Step A04).

  If it is determined that the calculated first white balance correction value is within a preset range, the projected content is corrected by white balance so that the color originally assumed in the document file of the presentation is corrected. Therefore, the image conversion unit 23 performs the white balance correction using the correction value on the projected image, and the corrected projected image is projected onto the projection encoder 24. The presentation is executed (step A05).

  While performing the presentation operation process, whether or not the projection image recording is instructed by the key operation of the key switch unit 15 or the remote controller at the same time (step A06), the projection operation of the slide image constituting the presentation document file By repeatedly determining whether or not all the processes have been completed (step A10), the system waits for these states.

  Accordingly, when the recording of the projection image is instructed by the key operation on the key switch unit 15 or the remote controller, this is determined in step A06. In this case, when it is determined that the recording of the projection image has been instructed as described above, it is considered that the user of the projector device 10 or the like performed some writing on the projection image with respect to the slide image of the presentation. .

  FIG. 4A illustrates the projection state of the whiteboard that becomes the screen SC in which handwritten information is written and superimposed on the projected slide image, and the user of the projector device 10 needs to do. When it is determined that the item has been written into the projected image, recording is instructed by key operation of the key switch unit 15 or the remote controller.

  Therefore, if it is determined in step A06 that there is an instruction for recording by a key operation, the projection operation of the slide image of the presentation is temporarily stopped at that time, and the first white balance correction value is used instead for the image that becomes entirely white. Then, the corrected image is displayed on the micromirror element 27 and the optical image is projected (step A07).

  FIG. 4B illustrates the projection state of the screen SC at this time. The projection content is completely deleted from the state shown in FIG. 4A, and only handwritten information by the user of the projector device 10 or the like is obtained. Thus, the screen remains on the screen SC that has been corrected to white by white balance correction.

  In this state, the photographing range is imaged by the photographing lens 13, the CCD 39, and the process circuit 36, and is recorded in the image recording unit 37, for example, in association with the identification information of the slide image projected at this time and the first white balance correction value. (Step A08).

  Thereafter, the display returns to the projection display state of the slide image of the presentation (step A09), and the process returns to step A10.

  In this way, every time a recording instruction key operation is performed during the presentation, an image of handwritten information written on the screen SC at that time is photographed and sequentially recorded in the image recording unit 37.

  When all the slide images constituting the document file of this presentation have been projected and displayed, this is determined in the above step A10, and as a post-processing, all the images captured and recorded in relation to each slide image of this presentation The image data is read from the image recording unit 37 together with the accompanying data, that is, the identification information of the slide image and the first white balance correction value, and is collectively collected via a USB cable to a personal computer or the like that provides the presentation document file. After the transmission and output (step A11), the processing of FIG.

  If it is determined in step A04 that the calculated first white balance correction value exceeds the preset range, even if the white balance correction is performed on the projection content, Since the slide image data of the assumed color cannot be reproduced and the color tone becomes unnatural, the presentation is executed without white balance correction using the correction value. Step A12).

  While performing the presentation operation process, whether or not the projection of the projection image is instructed simultaneously by the key operation of the key switch unit 15 or the remote controller (step A13), the projection operation of the slide image constituting the presentation document file By repeatedly determining whether or not all the processes have been completed (step A17), the system waits for these states.

  If the recording of the projection image is instructed by the key operation of the key switch unit 15 or the remote controller, this is determined in step A13, and the projection operation of the document file of the presentation is paused at that time, and instead, As in step A01, the RGB color components are set to full gradation values for all the pixels constituting the image by the micromirror element 27, and an image that is entirely white is projected to project the light image (step A14). .

  At this time, the screen SC is in a state where only handwritten information by the user of the projector device 10 or the like is left, so the projection range is imaged by the photographing lens 13, the CCD 39 and the process circuit 36, and is projected at this time. In association with the identification information of the slide image, for example, it is recorded in the image recording unit 37 (step A15).

  Thereafter, the display returns to the projection display state of the slide image of the presentation (step A16), and the process returns to step A17.

  In this way, every time a recording instruction key operation is performed during the presentation, an image of handwritten information written on the screen SC at that time is photographed and sequentially recorded in the image recording unit 37.

  When all the slide images constituting the document file of this presentation have been projected and displayed, this is determined in the above step A17, and as a post-processing, all images captured and recorded in relation to the document file of this presentation are recorded. Is read from the image recording unit 37 together with the identification information of the slide image that is the accompanying data, transmitted to a personal computer or the like providing the presentation document file via a USB cable (step A18), and so on. The process of FIG. 3 is terminated.

  Next, the operation in the “presentation playback mode” in which the slide image of the presentation recorded in association with the handwritten information image as described above is described.

  FIG. 5 exemplifies the content, and the control is mainly performed by the control unit 35. The document file of the presentation is selected, and the document file is associated with the document file by the processing in FIG. 3 according to the selection. Then, the operation is started in a state where the image data captured and recorded is transferred and recorded from the PC or the like to the image recording unit 37.

  At the beginning of the operation, prior to the reproduction and projection of the document file, first, an image that is all white is projected by setting the RGB color components to full gradation values for all the pixels constituting the image by the micromirror element 27 (step B01). In this state, the image range projected by the photographing lens 13, the CCD 39, and the process circuit 36 is imaged (step B02).

  In the image data obtained by this imaging, since the projected image is a white image, the white level of the whiteboard that is the projection target screen is reflected as it is. By executing the white balance correction process, the second white balance (WB) correction value is calculated (step B03).

  Next, depending on whether or not the calculated second white balance correction value is within a preset range, the white level of the screen projection surface can be corrected by white balance correction in the projector device 10. Is determined (step B04).

  If it is determined that the calculated second white balance correction value is within a preset range, the projected content is corrected by white balance, so that the color originally assumed in the document file of the presentation is corrected. Since the image can be reproduced on the screen as it is, the image conversion unit 23 subsequently performs white balance correction using the correction value on the projection image, and sends the corrected projection image to the projection encoder 24. A presentation to be projected is executed (step B05).

  While performing such an operation process of the presentation, at the same time, whether or not there is image data associated with the slide image to be projected at that time in the image recording unit 37 (step B06). Whether or not (step B10) is repeatedly determined to wait for these states.

  If the image data associated with the slide image is recorded in the image recording unit 37, this is determined in step B06, and then the first white balance correction value is added to the image data. It is determined whether or not there is (step B07).

  Only when it is determined that the first white balance correction value is additionally set, the image conversion unit 23 calculates the first white balance correction value and the second white balance correction value for the image data. Each gradation value of RGB is converted using the multiplied correction value (step B08).

  After that, the image conversion unit 23 synthesizes the image data with the white balance corrected as necessary on the slide image data projected at that time, and then sends it to the projection encoder 24 for projection (step B09). ), The process returns to step B10.

  Thus, if there is an image recorded during the presentation, the image is also projected and displayed together with the original slide image.

  When all the slide images constituting the document file of this presentation have been projected and displayed, this is determined in step B10, and the processing in FIG. 5 is completed.

  If it is determined in step B04 that the calculated second white balance correction value exceeds the preset range, even if the white balance correction is performed on the projection content, Since the assumed color image cannot be reproduced and the color becomes unnatural, the presentation is executed without white balance correction using the correction value (step B11). .

  While performing the operation process of the presentation, whether or not the image recording unit 37 has image data associated with the slide image to be projected at that time (step B12), and all the projection operations of the document file of the presentation are completed. Whether or not (step B16) is repeatedly determined to wait for these states.

  If the image data associated with the slide image is recorded in the image recording unit 37, this is determined in step B12, and then the first white balance correction value is added to the image data. It is determined whether or not there is (step B13).

  Only when it is determined that the first white balance correction value is additionally set, the image conversion unit 23 converts each gradation value of RGB using the first white balance correction value for the image data. (Step B14).

  By executing the conversion using the first white balance correction value in this way, the white balance correction that is effective in the recording environment of the image, although the current image reproduction environment is not in the state of performing the white balance correction. To avoid projecting images with somewhat unnatural hues.

  After that, if necessary, the image data subjected to white balance correction is synthesized and projected so as to be superimposed on the slide image data projected at that time (step B15), and the process returns to step B16.

  Thus, if there is an image recorded during the presentation, the image is also projected and displayed together with the original slide image.

  When all the slide images constituting the document file of this presentation have been projected and displayed, this is determined in step B16, and the processing in FIG. 5 is completed.

  As described above with the operations shown in FIG. 3 and FIG. 5, it is possible to always project an image having a hue with no unnaturalness by performing correction in consideration of the influence of the color of the screen to be projected. In addition to the projected image, it is possible to capture handwritten information written by the user or the like and later reproduce them in a similar unnatural hue.

  In addition, as a correction that takes into account the influence of the color of the screen, digital imaging means such as all digital cameras can be used, particularly when the background color of the image and the screen to be projected are both generally white. By using the white balance function installed as a standard, it is possible to obtain a projected image with a more natural color without complicating the circuit configuration.

  Depending on whether or not the white balance correction value is within a predetermined range, when the white balance correction results in an unnatural hue, it is determined that it has exceeded the range. If it is determined that the color correction is not performed, it is possible to prevent the projected image from becoming unsightly.

  In the above embodiment, it is assumed that the background color of each slide image in the document file of the presentation to be projected is white, and white balance correction corresponding to the color of the whiteboard of the screen SC to be projected is based on this. However, the entire screen including the background color of the projected slide image may be corrected using the screen SC to be projected as a reference, and the intermediate value thereof may be used as the reference value. The user of hot water 0 may set the white level as a reference manually.

(Second Embodiment)
A second embodiment in which the present invention is applied to a projector apparatus will be described below with reference to the drawings.

  The external configuration of the projector device is basically the same as that of FIG. 1 above, and the functional configuration of the electronic circuit of the projector device is basically the same as that of FIG. 2, and the same parts are denoted by the same reference numerals. And the description will be omitted.

  Further, in the projector device 10, as a color image to be projected, for example, the number of RGB color gradation bits is 8 bits (= 256 gradations), and the number of colors that can be displayed by one pixel is about 16,777,216 colors (= 256 to the third power) It is assumed that one projection image screen can be generated using a maximum of 256 colors by the color palette prepared by the image conversion unit 23.

Next, the operation of the above embodiment will be described.
FIG. 6 shows a process of projecting individual slide images constituting a document file of a presentation by a personal computer or the like connected to the projector apparatus 10, for example, using a whiteboard as a projection target screen, a marker pen or the like on the projection image Exemplifies the contents of operation in the “presentation recording mode” in which writing is appropriately performed and recorded, and the control is mainly performed by the control unit 35 based on the operation program of the corresponding mode.

  At the beginning of the operation, prior to the projection of the document file, first, an image that is entirely white is projected by setting the RGB color components to full gradation values for all the pixels constituting the image by the micromirror element 27 (step C01). In this state, the image range projected by the photographing lens 13, the CCD 39, and the process circuit 36 is imaged (step C02).

  In the image data obtained by this imaging, since the projected image is an entirely white image, the white level of the whiteboard that is the projection target screen is reflected as it is. Is executed to calculate the first white balance (WB) correction value (step C03).

  Next, depending on whether or not the calculated first white balance correction value is within a preset range, the white level of the screen projection surface can be corrected by white balance correction in the projector device 10. (Step C04).

  If it is determined that the calculated first white balance correction value is within a preset range, the projected content is corrected by white balance so that the color originally assumed in the document file of the presentation is corrected. Therefore, the color information closest to the color information obtained when the image conversion unit 23 performs the white balance correction using the correction value is reproduced. Is selected from the color palette (step C05), and after replacing the background color of the projection image with the first background color prepared in the color palette, the projection image with the color information replaced is sent to the projection encoder 24. The presentation projection operation is then executed (step C06).

  While performing such presentation operation processing, whether or not the recording of the projection image is instructed simultaneously by the key operation of the key switch unit 15 or the remote controller (step C07), the projection operation of the slide image constituting the presentation document file By repeatedly determining whether or not all the processes have been completed (step C11), the system waits for these states.

  Accordingly, when the recording of the projection image is instructed by the key operation on the key switch unit 15 or the remote controller, this is determined in Step C07. In this case, when it is determined that the recording of the projection image has been instructed as described above, it is considered that the user of the projector device 10 or the like performed some writing on the projection image with respect to the slide image of the presentation. .

  FIG. 4A illustrates the projection state of the whiteboard that becomes the screen SC in which handwritten information is written and superimposed on the projected slide image, and the user of the projector device 10 needs to do. When it is determined that the item has been written in the projected image, recording is instructed by key operation of the key switch unit 15 or the remote controller.

  If it is determined in step C06 that there is an instruction for recording by key operation, the projection operation of the slide image of the presentation is temporarily stopped at that time. Instead, the first image selected from the color palette by the image conversion unit 23 in step C05 is used. An image in which the background color is developed on the entire surface is displayed on the micromirror element 27 and the optical image is projected (step C08).

  FIG. 4B illustrates the projection state of the screen SC at this time. The projection content is completely deleted from the state shown in FIG. 4A, and only handwritten information by the user of the projector device 10 or the like is obtained. Then, the screen is left on the screen SC corrected to the selected first background color.

  In this state, the photographing range is imaged by the photographing lens 13, the CCD 39, and the process circuit 36, and is recorded in, for example, the image recording unit 37 in association with the slide image identification information and the first background color information projected at this time. (Step C09).

  Thereafter, the projection display state of the slide image of the presentation is restored (step C10), and the process returns to step C11.

  In this way, every time a recording instruction key operation is performed during a presentation, an image of handwritten information written on the screen SC at that time is photographed and sequentially recorded in the image recording unit 37.

  When all the slide images constituting the document file of this presentation have been projected and displayed, this is determined in step C11, and as a post-processing, all the images captured and recorded in relation to each slide image of this presentation are recorded. The image data is read from the image recording unit 37 together with the accompanying data, that is, the identification information of the slide image and the information of the first background color, and is collectively collected via a USB cable to a personal computer or the like that provides the presentation document file. After the transmission and output (step C12), the processing in FIG.

  If it is determined in step C04 that the calculated first white balance correction value exceeds the preset range, even if the white balance correction is applied to the projection content, Since the slide image data of the assumed color cannot be reproduced, it will result in an unnatural color, so the color selected as the background color from the color palette as the white balance correction by the correction value The presentation is executed without converting to (step C13).

  While executing the operation process of the presentation, whether or not the recording of the projection image is instructed simultaneously by the key operation of the key switch unit 15 or the remote controller (step C14), the projection operation of the slide image constituting the presentation document file By repeatedly determining whether or not all the processes have been completed (step C18), the system waits for these states.

  If the recording of the projection image is instructed by the key operation of the key switch unit 15 or the remote controller, this is determined in step C14, and the projection operation of the document file of the presentation is paused at that time, and instead, As in step C01 above, all the pixels constituting the image by the micromirror element 27 set the RGB color components to full gradation values, project an image that is entirely white, and project the light image (step C15). .

  At this time, the screen SC is in a state where only handwritten information by the user of the projector device 10 or the like is left, so the projection range is imaged by the photographing lens 13, the CCD 39 and the process circuit 36, and is projected at this time. In association with the identification information of the slide image, for example, it is recorded in the image recording unit 37 (step C16).

  Thereafter, the projection display state of the slide image of the presentation is restored (step C17), and the process returns to step C18.

  In this way, every time a recording instruction key operation is performed during the presentation, an image of handwritten information written on the screen SC at that time is photographed and sequentially recorded in the image recording unit 37.

  When all the slide images constituting the document file of this presentation have been projected and displayed, this is determined in step C18, and as a post-processing, all the images captured and recorded in relation to the document file of this presentation are recorded. Is read from the image recording unit 37 together with the identification information of the slide image that is the accompanying data, transmitted to a personal computer or the like providing the presentation document file via a USB cable (step C19), and so on. The process of FIG. 6 is terminated.

  Next, the operation in the “presentation playback mode” in which the slide image of the presentation recorded in association with the handwritten information image as described above is described.

  The control of the processing contents shown in FIG. 7 is mainly performed by the control unit 35, and the document file of the presentation is selected, and is picked up and recorded in association with the document file by the processing in FIG. 6 according to the selection. The operation starts with the image data being transferred and recorded from the PC or the like to the image recording unit 37.

  At the beginning of the operation, first, before reproducing and projecting the document file, all the pixels constituting the image by the micromirror element 27 are set to full gradation values for each of the RGB color components so as to project an image that is entirely white (step D01). In this state, the image range projected by the photographing lens 13, the CCD 39 and the process circuit 36 is imaged (step D02).

  In the image data obtained by this imaging, since the projected image is a white image, the white level of the whiteboard that is the projection target screen is reflected as it is. By executing the white balance correction process, the second white balance (WB) correction value is calculated (step D03).

  Next, depending on whether or not the calculated second white balance correction value is within a preset range, the white level of the screen projection surface can be corrected by white balance correction in the projector device 10. Is determined (step D04).

  If it is determined that the calculated second white balance correction value is within a preset range, the projected content is corrected by white balance, so that the color originally assumed in the document file of the presentation is corrected. Since the image can be reproduced on the screen as it is, the color information closest to the color information obtained when the white balance correction using the correction value is performed is selected from the color palette by the image conversion unit 23. Then, after replacing the background color of the projection image with the second background color prepared in the color palette, the projection image with the color information replaced is sent to the projection encoder 24 to project the presentation. The operation is executed (step D06).

  While performing such an operation process of the presentation, whether or not there is image data associated with the slide image to be projected at that time in the image recording unit 37 (step D07), and all the projection operations of the document file of the presentation are completed. Whether or not (step D11) is repeatedly determined to wait for these states.

  If the image data associated with the slide image is recorded in the image recording unit 37, this is determined in step D07, and then the first background color information is added and set to the image data. It is determined whether or not (step D08).

  Only when it is determined that the first background color information is additionally set, the image conversion unit 23 multiplies the image data with the first background color and the second background color. Select the background color that is closest to the color palette, and convert each gradation value of RGB of the background color of the recorded image as white balance correction according to the content of the selected background color (specifically, replace with the color closest to the color palette) (Step D09).

  Thereafter, if necessary, the image conversion unit 23 combines the image data with the white balance corrected with the slide image data projected at that time, and then sends the image data to the projection encoder 24 for projection (step D10). ), The process returns to step D11.

  In this way, if there is an image recorded during the presentation, the image is also superimposed and projected on the original slide image.

  When all the slide images constituting the document file of this presentation have been projected and displayed, this is determined in step D11, and the processing in FIG.

  If it is determined in step D04 that the calculated second white balance correction value exceeds the preset range, even if the white balance correction is performed on the projection content, Since the assumed color image cannot be reproduced, it will result in an unnatural hue, so the presentation should be performed without intentionally replacing the background color as white balance correction using the correction value. Execute (Step D12).

  While performing the operation process of the presentation, whether or not the image recording unit 37 has image data associated with the slide image to be projected at the same time (step D13), and all the projection operations of the presentation document file have been completed. Whether or not (step D17) is repeatedly determined to wait for these states.

  If the image data associated with the slide image is recorded in the image recording unit 37, this is determined in step D13, and then the first background color information is added to the image data. It is determined whether or not there is (step D14).

  Only when it is determined that the information of the first background color is additionally set, the image conversion unit 23 applies RGB to the background color of the recorded image as white balance correction by the first background color for this image data. Are converted (specifically, replaced with colors closest to the color palette) (step D15).

  By executing the replacement with the first background color in this way, the white balance correction that is effective in the recording environment of the image is executed although the current image reproduction environment is not in the state of performing the white balance correction. Avoid projecting images with somewhat unnatural hues.

  Thereafter, if necessary, the image data subjected to white balance correction is synthesized and projected so as to be superimposed on the slide image data projected at that time (step D16), and the process returns to step D17.

  In this way, if there is an image recorded during the presentation, the image is also superimposed and projected on the original slide image.

  When all the slide images constituting the document file of this presentation have been projected and displayed, this is determined in step D17, and the processing in FIG.

  6 and 7, when there is a limit to the number of colors that can be simultaneously developed in the projection system, color correction is performed by selecting a more suitable color within that range. Thus, it is possible to effectively use those colors and simplify the processing.

  In the second embodiment described above, only the background color in the image is selected and replaced from the color palette based on the white balance correction value. However, the present invention is not limited to this, and the slide image is not limited thereto. May be selected and replaced from the color palette for each color component constituting the recorded image by handwritten information.

  Further, in the first and second embodiments, the RGB color components are first set to full gradation values for every pixel constituting the image by the micromirror transmission 27, and an image that is entirely white is projected. However, the image may be projected on the basis of an image of a specific color on the entire surface without being limited to the entire surface white.

  Furthermore, both the first and second embodiments described above are handwritten on the projector device 10 side during the projection operation of the slide image constituting the document file of the presentation provided from the personal computer or the like connected to the projector device 10. The image is recorded and reproduced. However, all of these operations may be executed as a closed system only on the projector device 10 side. Further, the projector device 10 is simply sent from a personal computer or the like. It is also possible to perform all operation control by a presentation program installed on a personal computer or the like, by projecting a coming image and only photographing an image in the projection range according to an instruction.

  In addition, the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the invention.

  Further, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent elements are deleted from all the constituent elements shown in the embodiment, at least one of the problems described in the column of the problem to be solved by the invention can be solved, and described in the column of the effect of the invention. In a case where at least one of the obtained effects can be obtained, a configuration in which this configuration requirement is deleted can be extracted as an invention.

1 is a perspective view showing an external configuration of a projector apparatus according to a first embodiment of the present invention. The block diagram which shows the functional circuit structure of the projector apparatus which concerns on the same embodiment. The flowchart which shows the processing content in the presentation recording mode which concerns on the embodiment. The figure which illustrates the projection image which concerns on the same embodiment, and the writing information with respect to it. The flowchart which shows the processing content in the presentation reproduction | regeneration mode which concerns on the embodiment. 10 is a flowchart showing processing contents in a presentation recording mode according to a second embodiment of the present invention. The flowchart which shows the processing content in the presentation reproduction | regeneration mode which concerns on the embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Projector apparatus, 11 ... Main body casing, 12 ... Projection lens, 13 ... Shooting lens, 14 ... Ir receiving part, 15 ... Switch part, 16 ... Speaker, 21 ... Input / output connector part, 22 ... Input / output interface (I / F), 23 ... Image conversion unit, 24 ... Projection encoder, 25 ... Video RAM, 26 ... Projection drive unit, 27 ... Micromirror element (SOM), 28 ... Reflector, 29 ... Light source lamp, 30 ... Color wheel, 31 ... Integrator, 32 ... Mirror, 33 ... Motor (M), 34 ... Projection light processing unit, 35 ... Control unit, 36 ... Process circuit, 37 ... Image recording unit, 38 ... Audio processing unit, 39 ... CCD, 40 ... Ir reception Part, SB ... system bus, SC ... screen.

Claims (8)

Projection means for performing projection according to an input image signal;
Photographing means for photographing the projection range of the projecting means;
A calculation unit for shooting a projection range by the shooting unit in a state where a predetermined image is projected by the projection unit, and calculating a first color correction value for the image signal from the obtained image information;
First projection control means for performing color correction of an image projected by the projection means according to a first color correction value obtained by the calculation means;
Instruction means for instructing recording at the time of projecting an image subjected to color correction by the first projection control means;
In response to the instruction unit, the projection unit projects a predetermined range with the projection unit, and the projection unit captures a projection range, and the information of the first color correction value is added to the obtained image information. Recording means for recording in association with the image projected in
Determining means for determining the presence / absence of an image recorded in association with the recording means during a reproduction projection operation by the projecting means in accordance with an input image signal;
When it is determined that there is an image recorded in association with the determination means, color correction is performed based on the information of the first color correction value added to the image recorded in association with the image. A projection apparatus comprising: a second projection control unit configured to superimpose and project an image projected by the projection unit.   The projection apparatus according to claim 1, wherein the predetermined image is an entire white image. The calculation means causes the projection means to photograph a projection range in a state where a predetermined image is projected by the projection means during the reproduction projection operation, and obtains a second color correction value for the image signal from the obtained image information. Calculate
The projection apparatus according to claim 1, wherein the second projection control unit performs color correction of the image projected in superposition with the second color correction value calculated by the calculation unit.   The projection apparatus according to claim 1, wherein the calculation unit calculates a white color correction value, which is a background color, based on the projection range captured by the imaging unit and the image signal, using white balance processing.   2. The calculation unit according to claim 1, wherein the conversion unit calculates a conversion value converted into at least one of a plurality of colors prepared in advance based on the projection range captured by the imaging unit and the image signal as a color correction value. The projection device described.   2. The projection according to claim 1, wherein at least one of the first and second projection control means cancels the color correction on the projected image according to the content of the color correction value calculated by the calculation means. apparatus. A projection control method in a projection apparatus including a projection unit that performs projection according to an input image signal and an imaging unit that captures a projection range of the projection unit,
A calculation step of photographing a projection range by the photographing unit in a state where a predetermined image is projected by the projecting unit, and calculating a first color correction value with the image signal from the obtained image information;
A first projection control step of performing color correction of an image projected by the projection unit according to the first color correction value obtained in the calculation step;
An instruction step for instructing recording when projecting an image subjected to color correction in the first projection control step;
In accordance with an instruction in this instruction step, the projection unit captures a projection range in a state where a predetermined image is projected by the projection unit, and the information of the first color correction value is added to the obtained image information, A recording step of recording in association with the image projected by the projection unit;
A determination step of determining the presence or absence of an image recorded in association with the recording step during a reproduction projection operation by the projection unit according to an input image signal;
When it is determined that there is an image recorded in association with the determination step, color correction is performed based on the information of the first color correction value added to the image recorded in association with the image, A projection control method comprising: a second projection control step of superimposing and projecting on an image projected by a projection unit. A program executed by a computer built in a projection apparatus that includes a projection unit that performs projection according to an input image signal and an imaging unit that captures a projection range of the projection unit,
A calculation step of photographing a projection range by the photographing unit in a state where a predetermined image is projected by the projecting unit, and calculating a first color correction value with the image signal from the obtained image information;
A first projection control step for performing color correction of an image projected by the projection unit in accordance with the first color correction value obtained in the calculation step;
An instruction step for instructing recording when projecting the image subjected to color correction in the first projection control step;
In accordance with an instruction in this instruction step, the projection unit captures a projection range in a state in which a predetermined image is projected by the projection unit, and the information of the first color correction value is added to the obtained image information. A recording step of recording in association with the image projected by the projection unit;
A determination step of determining the presence or absence of an image recorded in association with the recording step during a reproduction projection operation by the projection unit according to an input image signal;
If it is determined in this determination step that there is an image recorded in association with each other, color correction is performed based on the information of the first color correction value added to the image recorded in association with the image, A program that causes a computer to execute a second projection control step of projecting an image projected on a projection unit in an overlapping manner.

Images