JP4005322B2 - Image processing apparatus, image processing method, program, and automatic photography apparatus - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image processing apparatus, an image processing method, a program, an automatic photography apparatus, and an automatic photography method, and more particularly to a technique for synthesizing another background image with a background area included in a photographic image, that is, a chroma key composition technique.
[0002]
[Prior art]
As a kind of automatic photo shooting device, there are photo sticker making machines where a user's face photo etc. is printed on a sticker and output when a user enters a shooting booth and takes a picture of himself as a subject. It is installed in the play facilities of and has gained popularity.
[0003]
In many such photo sticker making machines, the background area of a user's photo image is replaced with another background image, and a photo with a background is printed on the sticker. Specifically, a known chroma key composition technique is applied to recognize the same color area as the background panel or background curtain of the photographic booth in the photographic image and replace that area with a separately prepared background image. . In this way, various images can be arranged on the background of the user's face photograph and the like, and the attractiveness of the photo sticker making machine can be further enhanced.
[0004]
[Problems to be solved by the invention]
However, even if another background image is synthesized with a part of the photographic image by applying the chroma key composition technique, the recognition accuracy of the background area is limited, and the background image is synthesized with the photographic image up to the part that is not the background area. It may end up. For example, when the user wears clothes of the same color as the background panel or the background curtain, the background image may be synthesized up to the clothes part.
[0005]
The present invention has been made in view of the above problems, and an object of the present invention is to provide an image processing apparatus, an image processing method, a program, an automatic photography apparatus, and an automatic image processing apparatus that can prevent a background image from being synthesized other than a background area of a photographic image. It is to provide a photography method.
[0006]
[Means for Solving the Problems]
In order to solve the above-mentioned problems, an image processing apparatus according to the present invention recognizes the means for acquiring a photographic image, means for acquiring a background image, means for recognizing a background composite region of the photographic image, and the recognized Means for synthesizing the background image in the background synthesis region of the photographic image to generate a photographic image with background, means for displaying the photographic image with background, and means for indicating a part of the photographic image with background by a user And when the part of the designated background-attached photographic image is a part included in the background composite area, at least the part is replaced with a corresponding part of the photographic image, and the background-added photographic image is updated. It is characterized by including these.
[0007]
The image processing method according to the present invention includes a step of acquiring a photographic image, a step of acquiring a background image, a step of recognizing a background composite region of the photographic image, and the background composition of the recognized photographic image. Generating a background-attached photo image by synthesizing the background image in a region; displaying the background-added photo image; and indicating a part of the background-added photo image by a user; When a part of the photographic image with background is a part included in the background synthesis region, the method includes a step of replacing at least the part with a corresponding part of the photographic image and updating the photographic image with background. Features.
[0008]
The program according to the present invention includes a step of acquiring a photographic image, a step of acquiring a background image, a step of recognizing a background composite region of the photographic image, and the background composite region of the recognized photographic image. Generating a background-attached photographic image by combining the background image; displaying the background-backed photographic image; step of indicating a part of the background-backed photographic image by a user; When a part of a photographic image is a part included in the background composite region, at least the part is replaced with a corresponding part of the photographic image, and the step of updating the photographic image with background is executed by a computer. belongs to.
[0009]
According to the present invention, when a background image of a photographic image is recognized, the background image is synthesized there and a photographic image with a background is generated. This background photographic image is displayed. When the user designates a part of the photographic image with the background while viewing it, it is determined whether or not the part is included in the background area. If it is included in the background image, the portion is replaced with the original photographic image, and the photographic image with background is updated. In this way, it is possible to prevent the background image from being synthesized outside the background area of the photographic image.
[0010]
The automatic photography apparatus according to the present invention includes means for acquiring a user's photographic image, means for acquiring a background image in accordance with a user's selection, means for recognizing a background composite area of the photographic image, A means for synthesizing the background image in the background synthesis area of the photographic image to generate a photographic image with background, a means for displaying the photographic image with background, and a part of the photographic image with background If the part of the photographic image with background to be instructed is a part included in the background composite region, at least the part is replaced with a corresponding part of the photographic image, and the photographic image with background is Means for updating, and means for outputting the updated photographic image with background.
[0011]
In addition, the automatic photography method according to the present invention includes a step of acquiring a user's photographic image, a step of acquiring a background image according to the user's selection, a step of recognizing a background composite region of the photographic image, A step of synthesizing the background image with the background synthesis area of the photographic image to generate a photographic image with background, a step of displaying the photographic image with background, and a part of the photographic image with background And when the part of the designated background-attached photographic image is a part included in the background synthesis region, at least the part is replaced with a corresponding part of the photographic image, and the background-attached photographic image is And a step of outputting the background-added photographic image after the update.
[0012]
According to the present invention, when a background image of a photographic image is recognized, the background image is synthesized there and a photographic image with a background is generated. The background image is acquired according to the user's selection. This background-added photographic image is displayed. When the user designates a part of the photographic image with the background while viewing it, it is determined whether or not the part is included in the background area. If it is included in the background image, the portion is replaced with the original photographic image, and the photographic image with the background is updated. In this way, it is possible to prevent the background image from being synthesized outside the background area of the photographic image.
[0013]
DETAILED DESCRIPTION OF THE INVENTION
DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of the invention will be described in detail with reference to the drawings.
[0014]
FIG. 1 is a diagram showing a configuration of a photographic sticker producing machine according to an embodiment of the present invention. This photo sticker making machine 10 is an embodiment of an image processing apparatus, a program, and an automatic photo photographic apparatus according to the present invention, and its operation is an embodiment of an image processing method according to the present invention.
[0015]
As shown in the figure, this photographic sticker making machine 10 is mainly composed of a personal computer (PC) 12, which includes a personal computer 12, a monitor 14, a touch panel 16, and a sticker. A printer 18 and a digital camera 20 are connected. These components are arranged in a box attached to the shooting booth.
[0016]
The personal computer 12 is a known computer system in which various storage devices and the like are connected to a CPU (Central Processing Unit) via a bus, and is stored in an information storage medium such as a CD-ROM (trademark) or a DVD (trademark). Each part of the photo sticker making machine 10 is controlled in accordance with the program that is being used. Note that the program may be supplied to the personal computer 12 via a communication network.
[0017]
The seal printer 18 includes a sublimation printer, prints a photographic image with background composition on a sticker (roll paper), and discharges it from a sticker discharge port provided outside the photographing booth. The monitor 14 includes a CRT (CRT) or an LCD (Liquid Crystal Display), and displays a photographic image taken by the digital camera 20 and an image obtained by performing various edits on the photographic image. A touch panel 16 is attached to the display surface of the monitor 14. The touch panel 16 has a known configuration. When the user touches with a finger or a stylus pen, data representing the touched position is input to the personal computer 12. The digital camera 20 is a well-known electronic image pickup unit that takes a picture of a user who has entered a shooting booth, and inputs a user's photographic image to the personal computer 12.
[0018]
Hereinafter, a technique for synthesizing a background image on a background area of a user's photographic image by the photographic sticker producing machine 10 having such a configuration will be described.
[0019]
FIG. 2 is a diagram illustrating an example of a photographic image of a user photographed by the digital camera 20. As shown in the figure, a person area 26 is formed at the center of the photographic image 22, and a background area 24 is formed around it.
[0020]
FIG. 3 is a diagram showing a user's selection instruction among a plurality of background images stored in a storage device (for example, a hard disk storage device) provided in the personal computer 12. That is, the personal computer 12 displays a plurality of background images on the monitor 14 and guides the user to select which one to use as the background of his / her own photographic image. The figure shows a background image 28 selected by the user using the touch panel 16 in response to this guidance. Note that each of the plurality of background images stored in advance in the personal computer 12 has the same size as the photographic image output from the digital camera 20.
[0021]
FIG. 4 is a diagram showing a photographic image with a temporarily generated background by the photographic sticker producing machine 10. The tentatively generated photographic image 30 with background shown in the figure is obtained by temporarily synthesizing the photographic image 22 shown in FIG. 2 and the background image 28 shown in FIG. 3 by the photographic sticker producing machine 10 (personal computer 12). The tentatively generated photographic image 30 with background is obtained by the personal computer 12 recognizing the background region 24 of the photographic image 22 and embedding an image located at the same place in the background image in the recognized region. Is displayed. At this time, for example, when the user is wearing clothes of the same color as the background and the person area 26 includes pixels of the same color as the background, the personal computer 12 may not recognize the background area 24 of the photographic image 22 correctly. In this case, as shown in the figure, the background synthesis area (recognized background area) 32 enters the person area 26.
[0022]
Therefore, in the photo sticker making machine 10, when the user touches the temporarily generated photo image 30 with the background displayed on the monitor 14 provided with the touch panel 16 with a fingertip or a stylus pen, the touched position is the inside of the background composition area 32. If so, that portion is returned to the image located at the same place in the original photographic image 22. FIG. 5 is a diagram showing a photographic image with a background being corrected. In the photographic image 34 with the background being corrected shown in the figure, when the user touches the background composition area 32 that has entered the person area 26, the touched portion is immediately replaced with the original photographic image 22. Has been.
[0023]
FIG. 6 shows a photographic image with a background in a state where the user has completely touched and corrected the portion of the background composition area 32 that has entered the person area 26. The person area 26 included in the corrected background photograph image 38 is the same image as the person area 26 included in the photograph image 22.
[0024]
7 and 8 are flowcharts for explaining the image processing (background synthesis processing) of the photographic sticker making machine 10. The image processing shown in the figure is realized by installing an image processing program in the personal computer 12 and executing the image processing program by the personal computer 12.
[0025]
In this image processing, first, the target pixel coordinates are set at the upper left corner of the photographic image 22 (S101). Then, the data Cp assigned to the pixel of the target pixel coordinate (target pixel) is acquired from the photographic image 22 (S102). Then, it is determined whether the absolute distance L = | Cd−Cp | between the background color data Cd and the color data Cp is within the minute color difference ΔC1 (S103).
[0026]
If YES in S103, the absolute distance L and the pixel coordinates of interest (set in S101 or S106) are added to the background area pixel list (S104). On the other hand, if NO in S103, S104 is skipped. Then, until the target pixel coordinates reach the lower right corner of the photographic image 22 (S105), the processing of S102 to S104 is repeated while moving the target pixel coordinates to the right side or to the left end of the next row (S106).
[0027]
When the background area pixel list is generated in this way, the coordinates recorded at the head of the background area pixel list are set as the target pixel coordinates (S107). Then, the color data Cp assigned to the target pixel is acquired from the photographic image 22 (S108). Next, color data Cp ′ assigned to 8 pixels (peripheral pixels) around the pixel of interest in the photographic image 22 is acquired, and an absolute distance | Cp′−Cp | between the color data Cp and the color data Cp ′ is obtained. It is determined whether or not there is one that satisfies the condition that it is within the minute color difference ΔC2 (S109). If there is a peripheral pixel that satisfies such a condition, the absolute distance L = | Cd−Cp ′ | between the color data CP ′ of the peripheral pixel and the background color data Cd is calculated (S110). Further, the absolute distance L and the pixel coordinates of the surrounding pixels are added to the background area pixel list (S111). On the other hand, if NO in S109, S110 and S111 are skipped.
[0028]
Then, until the target pixel coordinates reach the coordinates recorded at the end of the background area pixel list (S112), the target pixel coordinates are moved to the coordinates recorded in the next line of the background area pixel list (S113), The processes from S108 to S111 are repeated.
[0029]
When the background area pixel list is expanded in this way, the photographic image 22 is then copied onto the memory for a photographic image with a background (S114). Then, the coordinates recorded at the head of the background area pixel list are set as the pixel of interest coordinates (S115), and the parameter α is calculated for the pixel of interest (S116). The parameter α is obtained by reading the absolute distance L of the target pixel from the background area pixel list and assigning it to the predetermined function f. The predetermined function f is an increasing function of the absolute distance L in which the value of the function f is 0 when the absolute distance L is zero and the value of the function f is 1 when the absolute distance L is the maximum color difference. Then, by substituting this parameter α into the following equation (1), the color data Cp ″ at the target pixel coordinates of the background-added photographic image is calculated (S117).
[0030]
[Expression 1]
Cp ″ = α × Cp + (1−α) × Cb (1)
[0031]
Here, Cp is color data at the target pixel coordinates of the photographic image 22 (or a copy thereof), and Cb is color data at the target pixel coordinates of the background image 28. According to the equation (1), the larger the absolute distance L is, the more color data components of the photographic image 22 are included in the color data of the photographic image with background, and the smaller the absolute distance L is, the more the background Many color data components of the background image 28 are included in the color data of the attached photograph image.
[0032]
When the color data Cp ″ is thus calculated, the value is stored in association with the pixel coordinates of interest in the copy of the photographic image prepared in S114, and the color data Cp is updated to Cp ″ (S118).
[0033]
Then, until the target pixel coordinates reach the coordinates recorded at the tail of the background area pixel list (S119), the target pixel coordinates are moved to the coordinates recorded in the next line of the background area pixel list (S120), The processes from S116 to S118 are repeated.
[0034]
Thereafter, a copy of the photographic image 22 with the color data updated in this way is displayed on the monitor 14 provided with the touch panel 16. Then, it is monitored whether or not the user touches the touch panel 16 with a fingertip or with a stylus pen (S112). When the user touches the touch panel 16, the pixel coordinates (instructed coordinates) of the background-attached photo image at the touched position are acquired (S123), and it is determined whether the pixel coordinates are included in the background area pixel list. (S124). If the coordinates are included in the background area pixel list, the color data Cp at the designated coordinates of the photographic image 22 is acquired (S125), and the color data Cp '' at the designated coordinates for copying the photographic image is obtained as the color data Cp. Return (S126). Thus, the original photographic image 22 can be restored to the image position designated by the user. On the other hand, if the coordinates are not included in the background area pixel list, S125 and S126 are skipped. Then, the processing of S122 to S126 is repeated until it is determined that the editing can be completed (S127), for example, when an editing (correction) completion button is pressed.
[0035]
A copy of the photographic image 22 in which the background image 28 is combined with the background area and further necessary corrections are performed in accordance with the user's instruction is output as a corrected background-added photographic image 38. This modified background-backed photographic image 38 is output from the personal computer 12 to the sticker printer 18 where it is printed on the sticker.
[0036]
According to the photo sticker making machine 10 described above, the background composite region 32 of the photographic image 22 is recognized and the background image 28 is combined there to generate the tentatively generated photographic image 30 with background, which is displayed on the monitor 14. Can be displayed. Then, when the user designates a part of the photographic image 30 with the temporarily generated background, if the part is included in the background composition area 32, the photographic image with the modified background is replaced with the original photographic image 22. An image 38 is output. As a result, the background image 28 can be prevented from being synthesized other than the background region 24 of the photographic image 22 relatively easily.
[0037]
The present invention is not limited to the above embodiment.
[0038]
For example, in the above description, the example in which the present invention is applied to the photo sticker making machine 10 has been taken up, but of course, the present invention may be applied to other apparatuses. Moreover, the process which produces | generates the temporary production | generation background image 30 is not limited to the process shown by FIG.7 and FIG.8, You may make it employ | adopt another process. In the above description, the photographic image 22 and the background image 28 have the same size, but may have different sizes.
[0039]
【The invention's effect】
As described above, according to the present invention, the background composite region of a photographic image is recognized, and the background image is combined therewith to generate and display a background photographic image, while viewing the background photographic image. When the user designates a part of the image, if the part is included in the background composite area, the background image is updated by replacing the original photo image with the background image. Can be prevented from being synthesized.
[Brief description of the drawings]
FIG. 1 is a diagram showing a configuration of an automatic photography apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram schematically illustrating an example of a photographic image.
FIG. 3 is a diagram schematically illustrating an example of a background image.
FIG. 4 is a diagram schematically illustrating an example of a temporarily generated photographic image with a background.
FIG. 5 is a diagram schematically illustrating an example of a photographic image with a background in the middle of correction.
FIG. 6 is a diagram schematically illustrating an example of a corrected background-added photographic image.
FIG. 7 is a flowchart for explaining background composition processing of the automatic photographing apparatus according to the embodiment of the present invention.
FIG. 8 is a flowchart for explaining background composition processing of the automatic photographing apparatus according to the embodiment of the present invention.
[Explanation of symbols]
10 Photo Sticker Making Machine, 12 Personal Computer (PC), 14 Monitor, 16 Touch Panel, 18 Seal Printer, 20 Digital Camera, 22 Photo Image, 24 Background Area, 26 Person Area, 28 Background Image, 30 Temporarily Generated Photo Image with Background , 32 Background composite region, 34 Photo image with background being corrected, 38 Photo image with corrected background.

Claims (5)

Means for obtaining a photographic image;
Means for obtaining a background image;
Means for recognizing a background composite area of the photographic image and storing the coordinates of pixels related to the background composite area in a list ;
Means for synthesizing the background image in the background synthesis region of the recognized photographic image to generate a photographic image with a background;
Means for displaying the photographic image with background;
Means for a user to indicate pixels of the background photographic image;
It is determined whether or not the coordinates of the pixel of the designated background-attached photo image are included in the list, and if included, the color data of the pixel is replaced with the color data of the corresponding pixel of the photo image, and the background-added photo Means for updating the image;
An image processing apparatus comprising: Obtaining a photographic image;
Obtaining a background image;
Recognizing a background composite area of the photographic image and storing the coordinates of pixels related to the background composite area in a list ;
Synthesizing the background image in the background synthesis region of the recognized photographic image to generate a photographic image with a background;
Displaying the photographic image with background;
A user indicating the pixels of the background photographic image;
It is determined whether or not the coordinates of the pixel of the designated background-attached photo image are included in the list, and if included, the color data of the pixel is replaced with the color data of the corresponding pixel of the photo image, and the background-added photo Updating the image;
An image processing method comprising: Obtaining a photographic image;
Obtaining a background image;
Recognizing a background composite area of the photographic image and storing the coordinates of pixels related to the background composite area in a list ;
Synthesizing the background image in the background synthesis region of the recognized photographic image to generate a photographic image with a background;
Displaying the photographic image with background;
A user indicating the pixels of the background photographic image;
It is determined whether or not the coordinates of the pixel of the designated background-attached photo image are included in the list, and if included, the color data of the pixel is replaced with the color data of the corresponding pixel of the photo image, and the background-added photo Updating the image;
A program that causes a computer to execute. Means for obtaining a user's photographic image;
Means for acquiring a background image according to a user's selection;
Means for recognizing a background composite area of the photographic image and storing the coordinates of pixels related to the background composite area in a list ;
Means for synthesizing the background image in the background synthesis region of the recognized photographic image to generate a photographic image with a background;
Means for displaying the photographic image with background;
Means for a user to indicate pixels of the background photographic image;
It is determined whether or not the coordinates of the pixel of the designated background-attached photo image are included in the list, and if included, the color data of the pixel is replaced with the color data of the corresponding pixel of the photo image, and the background-added photo Means for updating the image;
Means for outputting the updated photographic image with background;
An automatic photography apparatus characterized by comprising: Obtaining a photographic image of the user;
Obtaining a background image in response to a user selection;
Recognizing a background composite area of the photographic image and storing the coordinates of pixels related to the background composite area in a list ;
Synthesizing the background image in the background synthesis region of the recognized photographic image to generate a photographic image with a background;
Displaying the photographic image with background;
A user indicating the pixels of the background photographic image;
It is determined whether or not the coordinates of the pixel of the designated background-attached photo image are included in the list, and if included, the color data of the pixel is replaced with the color data of the corresponding pixel of the photo image, and the background-added photo Updating the image;
Outputting the updated photographic image with background, and
An automatic photography method characterized by comprising:

Images