JP2003044837A - Device for simulating makeup, method for controlling makeup simulation and computer-readable recording medium having makeup simulation program recorded thereon - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a makeup simulation technology capable of making a user more accurately confirm a makeup effect by simulating makeup in a more realistic manner. SOLUTION: In this makeup simulation system, skin colors are changed in accordance with the application of cosmetics (foundation, a face color, finish power, etc.), of highlight colors to a T zone 61, parts above cheeks 62 and 63 in a facial part image 50 constituting a frame of a moving image and the application of cosmetics of cheek colors to lower parts 64 and 65 of the middle of the cheeks, and the result is sequentially displayed as a facial part image 60.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a makeup simulation technique for simulating makeup on a face.

[0002]

2. Description of the Related Art Conventionally, when selling cosmetics or learning about makeup techniques, in order to easily confirm the effects of various makeups without actually applying makeup, a face image captured on a computer A technique of performing image processing on an image to simulate makeup is known.

A facial make-up support device described in JP-A-6-319613, a lip color advice system described in JP-A-8-202754, a make-up simulation method described in JP-A-10-21290, and , JP-A-20
The makeup advice systems described in 00-194835 all realize the simulation of makeup, and the users of these systems can easily confirm the effect of makeup by the simulation results.

[0004]

However, in the conventional makeup simulation system as described above, since the simulation result is displayed as a still image, the user does not have to change the facial expression when he / she speaks or laughs. The effect of makeup may not be sufficiently judged, and the effect of makeup may be erroneously recognized.

The present invention has been made in view of these, and an object thereof is to provide a makeup simulation technique capable of more realistically simulating makeup and confirming the effect of makeup more accurately. Is.

[0006]

Means for Solving the Problems The first and second makeup simulation apparatuses according to the present invention for achieving the above-mentioned object apply a facial color to a face based on an input received from a user for designating a makeup color. It is a makeup simulation device that simulates makeup.

In the first makeup simulation apparatus, in the frame image corresponding to each frame of the moving image in which the change in facial expression is captured, the pixel area corresponding to the specific portion of the face is sequentially specified, and the specified pixel area is specified. The frame image is displayed while a part or all of the color is changed corresponding to the designated makeup color.

In the first makeup simulation apparatus, the partial area in the frame image corresponding to the predetermined template image is specified, and the pixels corresponding to the color in the predetermined range are specified in the specified partial area. , The pixel area can be specified, and the pixel is specified using an identification function in a color space, and the color of the pixel area is changed by an affine transformation in the color space. Can be one.

In the second makeup simulation apparatus, in the frame image corresponding to each frame of the moving image in which the change in the facial expression is captured, the pixel regions corresponding to at least three specific portions of the face are specified by a plurality of frames. The makeup area to which virtual makeup is applied is calculated from the specified pixel area in each frame image, and part or all of the colors of the calculated makeup area become the specified makeup color. The frame image is displayed while being changed correspondingly.

In this second makeup simulation apparatus, in particular, the makeup area is composed of an elliptical area, and the calculation of the makeup area is performed based on the three specified pixel areas and the center of the elliptical area and the long area. This can be done by calculating the axis and the minor axis, and further, so that the calculated center of the elliptical area corresponds to the makeup color, and as it goes outward from the center of the elliptical area. The makeup color can be changed so that the makeup color gradually decreases.

In these first and second makeup simulation apparatuses, while capturing the moving image, the captured moving image can be displayed in real time adjacent to the display of the frame image. .

[0012]

BEST MODE FOR CARRYING OUT THE INVENTION A makeup simulation system, which is one of the embodiments of the present invention, will be described below with reference to the drawings.

FIG. 1 is a block diagram showing a hardware configuration of a make-up simulation system which is one of the embodiments of the present invention, and FIGS. 2 and 3 are points for a lip in the make-up simulation system. It is a figure which shows a make simulation and a face make simulation.

As shown in FIG. 1, the present makeup simulation system includes a make simulator 10 in which a make simulation processing program on a predetermined OS is installed in a program storage computer, and an IE.
It includes a moving image pickup device 20 such as a video camera or a digital video camera, which is connected to the make simulator 10 via EE1394 or another predetermined interface.

The moving image capturing apparatus 20 captures a moving image including the face of the user, and the corresponding moving image data (video signal).
Is transmitted to make simulator 10. The makeup simulator 10 performs moving image processing on the transmitted moving image data to simulate makeup.

More specifically, the make simulator 10 is
An input unit 14 including a keyboard and a mouse, a display unit 11 that is a display such as a CRT, an HDD 15 that stores a program file and a data file, and a RAM that temporarily stores a program and data used.
The RA, the input unit 14, the display unit 11, the HDD 15, and the moving image capturing apparatus 20 while controlling the transmission of moving image data.
Control unit (C that executes the program loaded on M12
PU) 13 and. (The make simulation processing program to be executed is distributed by a recording medium such as a CD-ROM and installed from a CD-ROM drive (not shown), or downloaded and installed via a communication line.) In particular, the input unit In 14,
Designation of color of cosmetics such as lipstick and foundation shall be accepted from the user, and in addition to the above, a pen tablet and touch panel shall be used, and voice input, gesture input using image recognition, etc. shall be performed. You can The display unit 11 displays the result of the makeup simulation. In addition to the above, an LCD, a projector,
A plasma display or the like may be used.

As a general makeup technique, (1) a base make-up for making the skin look beautiful, (2) a face make-up for correcting the three-dimensional effect of the face, (3) a face part such as a lip, an eye or an eyebrow. There are point-makes for correcting colors and shapes, which are usually combined. In the present make simulation system, mainly point make and face make for the lip are simulated individually and in combination, and these simulation results are displayed.

Actually, according to the lip make simulation, as shown in FIGS. 2 (a) to 2 (d), for example, the lip color of the red lip 31 in the input face image 30 is changed and the lip color of the orange is changed. The face image 40 is displayed on the lip 41, and according to the face make simulation, as shown in FIGS. 3A to 3D, in the face image 50, the T zone 61 and the upper cheek are shown. Applying highlight color cosmetics (foundation, face color, finish powder, etc.) to 62 and 63 and lower cheeks
The skin color is changed corresponding to the application of the cheek color cosmetic to 64 and 65, and is displayed as the face image 60.

In particular, these makeup simulations in the makeup simulation system are performed in real time on a moving image, so that the user can confirm the effect of makeup realistically while changing the facial expression in various ways. In addition, the captured moving images (face images 30, 50) and the simulated moving images (face images 40, 60) are displayed side by side in one screen on the display unit 11 (Fig. 1). By doing so, the effect of makeup can be known more easily and accurately.

The make simulator 10 of the makeup simulation system having the above outline will be described in detail. FIG. 4 is a block diagram showing a main part of the make simulation processing unit (make simulation processing program) 100 of the make simulator 10, and FIG. 5 is a flowchart showing an outline of a processing procedure in the make simulation processing.

The make simulation processing unit 100 is shown in FIG.
As shown in, including a frame extraction unit 101 for extracting one frame of image data from the moving image data 110, mainly with regard to lip make simulation processing, in the vicinity of the mouth on the frame image corresponding to the extracted image data. A mouth area tracking unit 102 that tracks an image area, a lip pixel selection unit 103 that selects only pixels corresponding to a lip in an image area near the tracked mouth, and a color of a pixel corresponding to the selected lip is changed. And a lip color changing unit 104 for changing the color.

Further, mainly in the face make-up simulation process, from the eye area tracking unit 105 for tracking the image area near the eyes in the frame image, and the positions of the tracked mouth area and eye area, the (highlight color makeup Highlight area (corresponding to application of a cosmetic material) and highlight cheek area designating section 106 for calculating and designating a cheek area (corresponding to application of a cheek color cosmetic material), and a designated highlight area and cheek area color And a highlight cheek area color changing section 107 for changing the color of the lip and highlight areas, and the cheek area and the original extracted frame image are combined and displayed on the display section 11. The image synthesizing unit 108 is included.

In the make simulation process, as shown in FIG. 5, the user first inputs the makeup technique, and the lip color, highlight color, cheek color, etc. are designated (ST1). Video imaging device 20
A frame image is extracted from the moving image data 110 corresponding to the face image picked up from (FIG. 1) and transmitted in real time (ST2), and the mouth area tracking unit 102 and the pixel selection unit 103 are applied to this frame image. And lip color change section
Mouth region image processing is performed in 104 (ST3, which will be described later with reference to FIG. 6 and the like), and an eye region tracking unit 105, a highlight cheek region specifying unit 106, and a highlight cheek region color changing unit 107.
Highlight cheek area image processing in (ST
4, detailed description with reference to FIG. 12, etc.).

The image area in which the pixel color is changed in ST3 and ST4 is combined with the original frame image by the image combining section 108 (ST5), and the combined frame image is displayed (ST6). .

The processing of ST2 to ST6 is repeated (ST7
NO at), when the final frame is reached (YE at ST7)
S), this make simulation process ends.

FIG. 6 is a flow chart showing the procedure of the mouth area image processing in ST3 of FIG. Figure 7 shows a frame image 200
FIG. 8 is a diagram showing the upper mouth region 110, and FIG. 8 shows tracking of the mouth region (see FIG.
6 is a diagram for explaining ST31) and FIG. 9 is a diagram for explaining template matching performed for tracking the mouth region. FIG. 10 is a diagram showing the rotation of the point cloud (cluster) on the UV plane for changing the lip color in the mouth area (ST33 in FIG. 6), and FIG. 11 is the lip color in the mouth area. It is a figure which shows the change of.

As shown in FIG. 6, in the mouth area image processing,
First, the mouth area 110 (FIG. 7) is tracked by the mouth area tracking unit 102 (ST31). When the frame image 201 shown in FIG. 8A is changed to a frame image 202 due to the movement of the person who is being imaged, the mouth area 111 is tracked as shown in FIG. 8B due to this change. It

Such tracking of the mouth area can be performed by template matching. As shown in FIG. 9, the template image 112 composed of pixels arranged in M × N corresponding to the mouth area in the first frame image 203 forming the moving image.
Then, the template image 112 is moved vertically and horizontally in the subsequent frame image, and then the degree of matching is calculated using the error function E (u, v) shown in [Equation 1]. The region most similar to is identified as the mouth region to be tracked.

[0029]

[Equation 1]

Here, t (i, j) is the brightness of the template image, p (i, j) is the brightness of the input frame image, and u _m and v _m are predetermined constants, and u = u ₀ ,
_{u 0 ± 1, u 0 ±} 2, ..., u 0 ± u m, v = v 0, v 0 ± 1, v 0
± 2, ..., V ₀ ± v _m .

In the mouth area image processing (FIG. 6), the pixel corresponding to the lip in the tracked mouth area is the lip pixel selection unit 10.
When selected by 3 (ST32), the color of these lip pixels is changed so as to correspond to the lip color designated by the user (ST33), and the process is returned.

The pixels of each frame in the moving image data are YU
Assuming that the pixel is represented by the V (YCbCr) color system, when actually projecting each pixel of the mouth region 113 (FIG. 11A) onto the UV plane (hue / saturation plane), FIG. The distribution as shown in a) is obtained. The pixels on these UV planes are determined by a predetermined discriminant function (here, a linear discriminant function V = −3U−12) and a skin region cluster 71 corresponding to the skin color and a lip region corresponding to the lip color. Cluster 72
Can be separated into

The pixels of the separated (selected) lip region cluster 72 are rotated on the UV plane and color converted into the lip region cluster 73 as shown in FIG. You can change the hue while doing it. (The rotation amount is set so that the average of the colors after rotation is the lip color designated by the user.) The mouth area 114 in FIG. 11B corresponds to the lip area cluster 73 after color conversion. 2 (a) to ((lip color) is included, and the lip color is continuously changed (linearly converted into the RGB color system) and displayed for each frame image. A lip make simulation as shown in d) is possible.

FIG. 12 is a flowchart showing the procedure of highlight cheek area image processing in ST4 of FIG. FIG. 13 is a diagram showing changes in the skin color of the highlight regions 121 to 123 and the cheek regions 124 and 125 on the frame image 204, and FIG. 14 is a diagram showing the eye regions 116 and 117 on the frame image 205. is there.
FIG. 15 is a diagram for explaining the calculation of the highlight area (ST42 in FIG. 12) and the calculation of the cheek area (ST43).
FIG. 6 is a diagram showing an elliptical area that constitutes a highlight area and a cheek area. FIG. 17 is a diagram showing an example of the distribution function α (x) for displaying the makeup color smoothly.

The application of the highlight color cosmetics to the T zone from the upper nose to the lower forehead and the upper cheeks, and the application of the cheek color cosmetics to the lower middle cheeks are considered to be one of the basic face-making techniques. , Which emphasizes the stereoscopic effect of the face. In this highlight cheek area image processing, as shown in FIG. 13, in the face image of the input frame image 204, highlight areas (T zones) 121, highlight areas (upper cheeks) 122 and 123, and cheek areas. (Lower middle cheek) 124 and 125 are designated, the colors of these regions are changed to the highlight color and cheek color designated by the user, and the face image 115 is generated.

In the highlight cheek area image processing, FIG.
First, as shown in FIG.
At 105, tracking is performed by template matching or the like like the mouth area 110 (FIG. 7) (ST41), and at the highlight cheek area designating unit 106, the mouth area 110, the two eye areas 116 and 117 to the highlight areas 121 to 123. Is calculated (ST42), and the cheek areas 124 and 125 are calculated (ST43).

Actually, the center of the mouth area 110 shown in FIG.
q_m, The center q of the two eye regions 116, 117_l, Q_rFrom Hyla
Of the elliptical T-zone lateral area 131 forming the right area 121
Heart q_c ^fH, The vector v corresponding to the long axis₀₁(Second subscript
1 is q_c ^fHCorresponding to the short axis
Vector v₁₁Is calculated by [Equation 2] and [Equation 3]
It

[0038]

[Equation 2]

[0039]

[Equation 3]

Here, a ₁ is a value of about 1.3 to 1.5,
b ₁ is the value of the order of 0.3 to 0.5. Also, as shown in Figure 16,
The basis vector s _{01 in} the major axis direction and the basis vector s _{11 in} the minor axis direction are calculated, and from these, α (x) (here, α (x, y ) = E
^{xp [- (3x 2 -2xy +} 3y 2) / 4], and thus obtained by later with [Expression 10]) is [Equation 4].

[0041]

[Equation 4]

Further, like the T-zone lateral area 131, it is an elliptical area, that is, the T-zone vertical area 132, the left cheek upper area 133, the left cheek middle lower area 134, the right cheek upper area 135, and the right cheek upper area 135 in FIG. 15B. [Equation 5] to [Equation 5] for each of the lower cheek regions 136
9], the center, the long axis, and the short axis are calculated, and the basis vector in the long axis direction and the short axis direction and α (x) are obtained.

[0043]

[Equation 5]

Here, a ₂ is a value of about 1.0 to 1.2,
b ₂ has a value of about 0.25, and c ₂ has a value of about 0.5.

[0045]

[Equation 6]

Here, a ₃ is a value of about 0.3, and b ₃ is
The value is about 0.1, and c ₃ is about 0.2.

[0047]

[Equation 7]

Here, a ₄ is a value of about 0.3, and b ₄ is
The value is about 0.1, and c ₄ is about 0.2.

[0049]

[Equation 8]

Here, a ₅ is a value of about 0.1, and b ₅ is
The value is about 0.2, and c ₅ is about 0.3.

[0051]

[Equation 9]

Here, a ₆ is a value of about 0.1, and b ₆ is
The value is about 0.2 and c ₆ is about 0.3. In this way, highlight cheek area image processing (Fig. 12)
In ST42 and ST43 of, α is set for each of the regions 131 to 136.
When (x) is obtained, subsequently, the highlight cheek area color changing unit 107 changes the highlight area to the designated highlight color and the cheek area to the designated cheek color (ST44, ST45), The process is returned.

Actually, by using the above α (x) in [Equation 10], the input image p (i, j) and (highlight area changed to highlight color and cheek color are changed). Highlight cheek region q (i, j) is synthesized.

[0054]

[Equation 10]

As shown in FIG. 17, the value of α (x) is concentrically decreased with respect to the inner position of each of the elliptic regions 131 to 136 from the center to the end. The color is set so that the color does not become discontinuous even at the boundary between the highlight area and the cheek area.

By continuously changing and displaying these highlight colors and cheek colors for each frame image, the face make simulation as shown in FIGS. 3A to 3D becomes possible.

As described above, in the lip make-up simulation in this makeup simulation system, the pixel region corresponding to the mouth is specified in each frame image in the moving image in which the change in the facial expression of the person is specified, and the specified pixel is specified. The color of the area is changed according to the specified lip color, and the frame image is displayed.

According to such lip makeup simulation, makeup is more realistically simulated on the moving image, and the effect of makeup is more accurately confirmed by the user. In other words, a moving image that captures changes in the direction of the face with respect to the light source and facial expressions makes it possible to perceive irregularities and heights that are difficult to discern in a still image. The changes in facial expressions are displayed realistically.

In particular, the above-mentioned pixel area is specified by using template matching, and the pixel to be changed is specified by using a discrimination function in a predetermined color space (for example, UV plane) to determine the color of the specified pixel. By performing affine transformation and color transformation, the above effect can be achieved while suppressing the amount of calculation by a simple method.

In the face make-up simulation in this makeup simulation system, the pixel regions corresponding to the mouth and both eyes are specified in each frame image in the moving image capturing the facial expression change of the person, and are specified in each frame image. The makeup area to which face makeup is virtually applied is calculated from these three pixel areas, and the frame image is displayed while the color in the calculated makeup area is changed according to the specified highlight color, cheek color, etc. To be done.

According to such a face-make simulation, the makeup is more realistically simulated on the moving image, and the effect of the makeup is more accurately confirmed by the user.

In particular, the above makeup area is specified as an elliptical area as in [Equation 2] to [Equation 9], and α
By using (x) to gradually reduce the highlight color and cheek color from the center to the edge of the elliptical area, the position and shape of the makeup area can be changed appropriately and a realistic face make-up is simple. Will be simulated.

In addition, when these lip makeups and face makeups are combined or individually simulated, the simulation result is displayed adjacent to the image of the person so that the user can see the effect of makeup. You can learn more easily and accurately.

In the make-up simulation system of the above-described embodiment, it is assumed that the captured moving image is processed in real time, but it is assumed that the processing is performed based on the stored moving image data. can do.

Further, in the make-up simulation system of the above-described embodiment, conversion is performed on the colors represented by the YUV color system, but CIE XYZ, CIE are performed (conversion is performed as necessary). It is possible to perform conversion on colors represented by other color systems such as LAB, Munsell color coordinate system, RGB color system, and the like.

In the make-up simulation system of the above-described embodiment, in particular, a digital video camera or a video camera is directly connected to the make simulator, and image data or A
It is assumed that the video signal of the D / D-converted video camera is subjected to the moving image processing. However, the make simulator has a communication control unit for controlling the communication, and the digital video camera is connected via the network. Alternatively, the moving image data to be processed (or the video signal after A / D conversion) is transmitted from a remote personal computer to which a video camera or the like is connected, and further, the processed moving image data is transmitted to the remote. It can be anything.

In the make-up simulation system of the above-described embodiment, the color conversion on the hue / saturation plane is performed by rotation, but the operator indicates the average color of the converted lip region clusters. The color conversion may be performed by an affine transformation so as to obtain a color.
It is possible to change the texture such as glossiness by performing color conversion by non-linear conversion of the saturation component,
Further, although the color discrimination is performed by the linear function, it can be performed by the non-linear function.

In the makeup simulation system of the above-described embodiment, it is possible to convert the skin color to white by further increasing the lightness of the pixel corresponding to the skin area and decreasing the saturation. Therefore, by reducing the lightness and emphasizing the red component, it is possible to convert to a skin color corresponding to sunburn.

In addition, in the makeup simulation system of the above embodiment, in addition,
Tracking the feature points that characterize the eyes, pupils, eyelashes, eyebrows, teeth, etc. on the image, and virtually make up mascara, eyeline, eye color, etc.,
Further, the shape of the eyebrows and the color of the teeth can be changed. The hair area can be tracked to simulate a hair dye, and other methods besides template matching, such as spatio-temporal gradient method, may be used to track the face parts (mouth area and other areas). it can.

In the makeup simulation system of the above-described embodiment, the nose region can be traced during face make simulation to more accurately specify the highlight region and the cheek region. In addition, more elliptical areas to which the foundation is applied can be combined to specify more complicated areas, and in addition to elliptical areas, areas of other shapes such as circles, ovals, and rectangles can be specified. Can be combined.

[0071]

[Effects of the Invention] According to the inventions of claim 1, claim 8 and claim 10, since makeup (particularly point makeup) is smoothly simulated on the moving image, the user can change the facial expression while applying makeup. The effect of can be confirmed more accurately.

According to the inventions of claims 2 and 3, the point-make simulation can be achieved by a simple method while suppressing the amount of calculation.

According to the inventions of claim 4, claim 9 and claim 11, since makeup (particularly face makeup) is smoothly simulated on the moving image, the user can change the facial expression and the effect of makeup. Can be confirmed more accurately.

According to the invention described in claim 5, since the position and shape of the makeup area are appropriately changed, a realistic face-make simulation can be achieved while the amount of calculation is suppressed by a simple method.

According to the invention of claim 6, a more realistic face make simulation is performed.

According to the invention described in claim 7, since the moving image which is the simulation result and the captured moving image are displayed adjacent to each other in real time, the user can easily and accurately understand the effect of makeup. You can know

[Brief description of drawings]

FIG. 1 is a block diagram showing a hardware configuration of a makeup simulation system which is one of the embodiments of the present invention.

FIG. 2 is a diagram showing a point-make simulation for a lip in the make-up simulation system.

FIG. 3 is a diagram showing a face-make simulation in the make-up simulation system.

[FIG. 4] Make simulation processing unit (make simulation processing program) 10 of make simulator 10
It is a block diagram which shows the principal part of 0.

FIG. 5 is a flowchart showing an outline of a processing procedure in a make simulation processing.

FIG. 6 is a flowchart showing a procedure of mouth area image processing in ST3 of FIG.

7 is a diagram showing a mouth area 110 on a frame image 200. FIG.

FIG. 8 is a diagram for explaining tracking of a mouth region (ST31 in FIG. 6).

FIG. 9 is a diagram for explaining template matching performed for tracking a mouth region.

FIG. 10: Change of lip color in mouth area (ST3 of FIG. 6
It is a figure showing rotation of a point cloud (cluster) on a UV plane for performing 3).

FIG. 11 is a diagram showing a change in lip color in the mouth region.

FIG. 12 is a flowchart showing a procedure of highlight cheek region image processing in ST4 of FIG.

FIG. 13 is a highlight area 121 to on the frame image 204.
FIG. 12 is a diagram showing changes in skin color of 123 and cheek areas 124 and 125.

14 is a diagram showing eye regions 116 and 117 on the frame image 205. FIG.

FIG. 15 is a diagram for explaining calculation of a highlight area (ST42 in FIG. 12) and calculation of a cheek area (ST43).

FIG. 16 is a diagram showing an elliptical area forming a highlight area and a cheek area.

FIG. 17 is a diagram showing an example of a distribution function α (x) for displaying a makeup color smoothly.

[Explanation of symbols]

10 Make simulator 11 Display unit 12 RAM 13 Control unit (CPU) 14 Input unit 15 HDD 20 Digital video camera 30, 50 Face image input 31 Lip before changing lip color 40 Face image with changed lip color 41 Lip 60 after changing lip color, 115 Face image with changed highlight area color and cheek area color 61, 121 Highlight area (T zone) 62, 63, 122, 123 Highlight area (upper cheek) 64, 65, 124, 125 Cheek area (lower cheek area) 71 Skin area cluster 72, 73 Lip area cluster 100 Make simulation processing section 101 Frame extraction section 102 Mouth area tracking section 103 Lip pixel selection section 104 Lip color changing section 105 Eye area tracking Section 106 highlight cheek area designation section 107 highlight cheek area color changing section 108 image synthesizing section 110 moving image data 110-112 mouth area 113 mouth area 114 in the input face image -Mouth area 116, 117 eye area 120 in the changed face image 120 Template image 131 T zone horizontal area 132 T zone vertical area 133 Left upper cheek area 134 Left lower cheek area 135 Right cheek upper area 136 Right lower cheek middle area Area 200-205 frame image

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 1/46 G09B 9/00 Z // G09B 9/00 H04N 1/46 Z F term (reference) 5B046 AA10 GA04 JA04 5B057 AA20 CA01 CA08 CA12 CA16 CB01 CB08 CB12 CB16 CE08 CE16 DA08 DB02 DB06 DB09 DC03 DC09 5C076 AA01 AA26 BA06 CA10 5C079 LA02 LA10 LB12 MA01 MA11 5L096 AA02 AA06 BA08 CA04 FA63 HA02 HA05 JA09

Claims (11)

[Claims] 1. A makeup simulation apparatus for simulating makeup on a face based on an input for designating a makeup color received from a user, the frame corresponding to each frame of a moving image in which a change in facial expression is captured. In the image, the pixel area corresponding to the specific part of the face is sequentially specified, and the frame image is displayed while changing the color of a part or all of the specified pixel area according to the specified makeup color. A makeup simulation device characterized by: 2. The pixel area is specified by specifying a partial area in a frame image corresponding to a predetermined template image, and specifying a pixel corresponding to a color in a predetermined range in the specified partial area. The method according to claim 1
Makeup simulation device according to. 3. The pixel according to claim 2, wherein the pixel is identified by using an identification function in a color space, and the color of the pixel area is changed by an affine transformation in the color space. Makeup simulation device. 4. A makeup simulation apparatus for simulating makeup on a face based on an input for designating a makeup color received from a user, the frame corresponding to each frame of a moving image capturing a change in facial expression. Pixel regions corresponding to at least three specific parts of the face in the image are specified sequentially over a plurality of frames, and in each frame image, a makeup region to which virtual makeup is applied is specified from the specified pixel regions. A makeup simulation apparatus which displays a frame image while calculating and changing a part or all of the calculated makeup area colors in accordance with a specified makeup color. 5. The makeup area is composed of an elliptical area, and the calculation of the makeup area is based on the three identified pixel areas, and the center of the elliptical area and the major axis and the minor axis are calculated. The makeup simulation apparatus according to claim 4, which is performed by calculating. 6. The makeup color is changed such that the calculated center of the elliptical area corresponds to the makeup color, and the makeup color gradually decreases from the center of the elliptical area toward the outside. The makeup simulation device according to claim 5, wherein 7. The moving image is captured, and adjacent to the display of the frame image, in real time,
The imaged moving image is displayed to claim 1.
7. The makeup simulation apparatus according to claim 6. 8. A makeup simulation control method for simulating makeup on a face based on an input for designating a makeup color received from a user, which corresponds to each frame of a moving image in which a change in facial expression is captured. In the frame image, the pixel area corresponding to the specific part of the face is sequentially specified, and part or all of the color of the specified pixel area is changed according to the specified makeup color, while the frame image is changed. A makeup simulation control method characterized by displaying. 9. A makeup simulation control method for simulating makeup on a face based on an input for designating a makeup color received from a user, which corresponds to each frame of a moving image in which a change in facial expression is captured. In the frame image, the pixel area corresponding to at least three specific parts of the face is specified sequentially over a plurality of frames, and in each frame image, a makeup area for applying virtual makeup from the specified pixel area. And a frame image is displayed while changing the color of a part or all of the calculated makeup area according to the specified makeup color, and displaying the frame image. 10. A computer-readable recording medium recording a makeup simulation program for simulating makeup on a face based on an input for designating a makeup color received from a user, wherein changes in facial expressions are captured. In the frame image corresponding to each frame of the moving image, the pixel areas corresponding to specific parts of the face are sequentially specified, and part or all of the colors of the specified pixel areas are made to correspond to the specified makeup color. A computer-readable recording medium having a makeup simulation program recorded thereon, which displays a frame image while changing. 11. A computer-readable recording medium in which a makeup simulation program for simulating makeup on a face is recorded based on an input for designating a makeup color received from a user, and changes in facial expressions are captured. In the frame image corresponding to each frame of the moving image, the pixel regions corresponding to at least three specific portions of the face part are sequentially specified over a plurality of frames, and in each frame image, from the specified pixel region A makeup that displays a frame image while calculating the makeup area to which virtual makeup is applied and changing part or all of the calculated makeup area color in accordance with the specified makeup color. A computer-readable recording medium recording a simulation program.