JP4128680B2 - Makeup advice system - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention is used for advice on makeup methods and advice for selecting cosmetics. The present invention is used in a device that assists a salesperson by placing it at a store of a cosmetics store.
[0002]
[Prior art]
Demonstration sales have been widely carried out for sales of cosmetics at stores. In general, the salesperson listens to the request of the subject who is a customer, selects a makeup method and cosmetics, and actually applies makeup to the face of the subject. Demonstration sales make up using the subject's face, so it is an effective means to let the subject know the effect, but if the finish does not meet the subject's request, remove the makeup and try again. Is required.
[0003]
[Problems to be solved by the invention]
As described above, in the conventional demonstration sales, it takes a lot of time to apply makeup to the subject and redo the makeup, and it is difficult to perform efficient sales.
[0004]
Japanese Patent Laid-Open No. 10-21290 discloses a method for displaying a face image of a subject on a display device and making a simulation of makeup using an image processing technique using a computer. In this case, an image of the face of the subject is displayed on the display device, and the same state as when artificial makeup is applied is created by changing the skin color.
[0005]
However, this method also applies makeup to the face image displayed on the display device while meeting with the subject, so the number of hands is almost the same as when actually applying makeup to the subject's face. Absent. In addition, when applying makeup to the face image on the screen, it is undeniable that a sense of incongruity will arise because the tools and procedures used are different compared to when applying makeup.
[0006]
In addition, in these methods, the salesperson listens to the subject's request and applies makeup. Therefore, if the salesperson and the subject have different sensations, the salesperson applies makeup different from that desired by the subject. May occur.
[0007]
The present invention has been made in such a background, and an object thereof is to provide a makeup advice system capable of accurately grasping the finish of makeup. An object of this invention is to provide the makeup | decoration advice system which can sell cosmetics efficiently.
[0008]
[Means for Solving the Problems]
A first aspect of the present invention is a makeup advice system, a camera device that captures a face of a subject, a display device that captures an image of the face of the subject photographed by the camera device, and the image that is projected on the display device. A makeup advice system including means for virtually applying makeup to a face image of a subject.
[0009]
Here, a feature of the present invention is that it includes a memory in which a plurality of makeup data images representing changes in face due to makeup are stored, and the means for virtually applying makeup includes a makeup data image stored in the memory. There is provided a means for selecting any one and deforming it so as to be adapted to the face image of the subject and synthesizing it with the face image of the subject.
[0010]
That is, in the present invention, first, the subject selects a desired makeup method and cosmetics based on a photograph in which makeup is applied to the model. Next, by synthesizing the makeup data of the model selected by the subject with the image of the face of the subject, it is possible to simulate the state when the subject applies makeup.
[0011]
At this time, since it is difficult to combine the makeup data as it is with the face image of the subject, the makeup data is transformed by a computer so as to match the face image of the subject.
[0012]
As a result, the subject can check the condition of the makeup on the face after confirming the finish of the makeup in advance with a photograph of the model with the makeup, etc. As described above, it is possible to avoid the salesperson from applying makeup different from that desired by the subject due to the difference in sense between the salesperson and the subject. Accordingly, it is possible to accurately grasp the makeup finish and to sell cosmetics efficiently.
[0013]
For information on facial image processing techniques, refer to the references (supervised by Shin Ichimatsu and Yoichi Muraoka, edited by the Japan Interdisciplinary Conference “Kansei and Information Processing”, IEICE Transactions, AUG, 1997. Vol. J80-A NO.8, pp.1231-1249).
[0014]
In the present invention, it is desirable to include means for classifying makeup data according to face types having different characteristics and storing them in the memory. That is, makeup data is classified in advance according to the face, the contour of the face, and other elements and stored in the memory, so that makeup data suitable for the face of the subject can be quickly selected from a large number of makeup data. it can.
[0015]
A second aspect of the present invention is a method for creating makeup data according to the first aspect, wherein a face image of a model with makeup is photographed, and a face part before makeup of the model is taken from the face image. An image from which the image is removed is extracted as makeup data. That is, the makeup data is data representing changes in the face caused by makeup. The face of a model with makeup is photographed, and the remaining image obtained by subtracting the image of the face before makeup from the image is referred to as makeup data. To do.
[0016]
DETAILED DESCRIPTION OF THE INVENTION
An embodiment of the invention will be described with reference to FIG.
[0017]
The present invention is a makeup advice system, which includes a camera device 1 that captures a face of a subject, a display device 2 that captures an image of the face of the subject photographed by the camera device 1, and a subject that is projected on the display device 2 This is a makeup advice system including a control unit 3 that is a means for virtually applying makeup to the face image of the person.
[0018]
Here, a feature of the present invention is that it includes a memory 4 in which a plurality of makeup data images representing face changes due to makeup are stored, and the control unit 3 stores any one of the makeup data images stored in the memory 4. The selected image is deformed so as to be adapted to the face image of the subject and is combined with the face image of the subject.
[0019]
Next, a procedure for synthesizing the makeup data image and the face image of the subject will be described with reference to FIG. The face of the subject is photographed, skin color data in the face image (A-1) before makeup is extracted, and a wire frame (A-2) is created. The wire frame is a known technique and will not be described in detail, but is an image obtained by connecting a plurality of feature points arranged on the face image before makeup with lines, and the facial features are defined as lines. Can be represented by a point.
[0020]
Next, the test subject selects a desired one from the plurality of makeup data images stored in the memory 4. At this time, the makeup data image can be easily selected by classifying the makeup data images according to the types of faces having different characteristics and storing them in the memory 4. For example, “adult face sharp”, “adult face soft”, “kid face sharp”, and “kid face soft”.
[0021]
The wire frame (B-2) of the selected makeup data image (B-1) is adapted to the face image before makeup of the subject with reference to the wire frame (A-2) of the face before makeup of the subject. (C-2). The makeup data image is transformed according to the wire frame of the transformed makeup data image (C-1).
[0022]
The makeup data image (C-1) thus created and the face image of the subject before makeup are combined (+) to obtain the makeup face image of the subject (D).
[0023]
That is, makeup data image Ms (x, y), face image of the subject before makeup is I (x, y), makeup face of the subject after synthesis is O (x, y), transmittance matrix is A, unit matrix Is E and each (x, y) is a coordinate position in the image,
O (x, y) = A.I (x, y) + (EA) .Ms (x, y)
Can be expressed as
[0024]
FIG. 3 shows a state of deformation synthesis using a wire frame. The left-side wire frame is a wire frame of the makeup data image, and the right-side modified makeup data image is obtained by matching this with the wire frame of the face image of the subject before makeup.
[0025]
FIG. 4 is a diagram illustrating extraction of a makeup data image. A face image of the model before applying makeup is photographed, and skin color data in the face image is extracted (E-1). Further, a makeup face image of the model is photographed, and skin color data in the makeup face image is extracted (F-1). The skin color data of the face image before makeup is subtracted from the skin color data of the makeup face image (−), thereby obtaining skin color data in the makeup data image (G).
[0026]
That is, the makeup data image is Ms (x, y), the model makeup face image is O ₀ (x, y), the model face image before makeup is I ₀ (x, y), the transmittance matrix is A ₀ , When the unit matrix is E and each (x, y) is a coordinate position in the image,
Ms (x, y) = (E−A ₀ ) ⁻¹ [O ₀ (x, y) −A ₀ · I ₀ (x, y)]
Can be expressed as The makeup data image Ms (x, y) describes a two-dimensional coloring parameter.
[0027]
At this time, the wire frame (E-2, F-2) created based on the face image before makeup or the makeup face image of the model is used when the makeup face shown in FIG. 2 is synthesized.
[0028]
(Example 1)
Using a makeup application image extracted from the foundation-applied face image of the female model (20's) and the face image before makeup, a synthetic makeup face based on the face images before makeup of two test females was created. At that time, the measured value of the transmittance matrix of the makeup data image of the foundation was used (A = 0.7 · E).
[0029]
(Comparative Example 1)
Uniform skin color created by image processing and translucency, the same translucent image filter as in Example 1 is processed into face images before makeup of the same two female subjects as in Example 1, and the makeup composite face is processed. Created. When the actual makeup face image applied to the subjects 1 and 2 and the synthetic makeup face were visually evaluated, both the subjects 1 and 2 matched well in Example 1, but the subject 1 in Comparative Example 1 It looked flat, and subject 2 was flat and different in color.
[0030]
(Example 2)
One female model (20's) applies two types of foundations A and B with different glosses, extracts two types of makeup data images extracted from each applied face image and face image before makeup. Using this, a synthetic makeup face based on the face image before makeup of one female subject was created. At that time, the measured value of the transmittance matrix of the makeup data image of the foundation was used (A = 0.7 · E).
[0031]
(Comparative Example 2)
Two kinds of uniform skin colors with different glossiness made by image processing, and the translucency image filter whose transmittance is the same as in Example 2 is processed into a face image before makeup of the same female subject as in Example 2. Then, a makeup synthetic face was created. Visual evaluation of whether the difference in glossiness can be recognized with respect to foundations A and B reveals that the difference in Example 2 is well understood, whereas in Comparative Example 2, the difference in gloss is not seen and it looks planar. .
[0032]
(Example 3)
A makeup data image is extracted from the foundation, eyeshadow, and teak applied face of a female model (20's) and the face before makeup, and a synthetic makeup face is created based on the face images before makeup of the two female subjects. did. A value obtained by actually measuring the transmittance matrix of the makeup data image was used (A = 0.7 · E).
[0033]
(Comparative Example 3)
The part corresponding to the eye shadow and teak with a uniform skin color made by image processing was colored. The translucent image filter having the same transmittance as that of Example 3 was applied to two female subjects who were the same as Example 3. A face image before makeup was processed to create a synthetic makeup face. When the actual makeup face images and these synthetic makeup faces were visually evaluated for subjects 1 and 2, both subjects 1 and 2 matched well in Example 3, but subject 1 was flat in Comparative Example 3. Moreover, the glossiness was different, and subject 2 was flat and different in color.
[0034]
Example 4
A makeup data image is extracted from the makeup makeup doll for makeup practice (manufactured by Beaulux), lipstick, eyeshadow, teak applied face and pre-makeup face, and two pre-makeup face images of two female subjects are used. A synthetic makeup face was created. A value obtained by actually measuring the transmittance matrix of the makeup data image was used (A = 0.7 · E).
[0035]
(Comparative Example 4)
A part of the skin corresponding to lipstick, eye shadow, and teak with a uniform skin color made by image processing is colored, and a translucent image filter having the same transmittance as in Example 4 is used. The face image before makeup was processed to create a composite makeup face. When the actual makeup face image and the warped synthetic makeup face were visually evaluated for subjects 1 and 2, both of subjects 1 and 2 matched well in Example 4, but in Comparative Example 4, subject 1 In addition to being flat, the feeling of gloss was different, and subject 2 was flat and different in color.
[0036]
【The invention's effect】
As described above, according to the present invention, the finish of makeup can be accurately grasped. Further, by using the makeup advice system of the present invention, cosmetics can be sold efficiently at the store.
[Brief description of the drawings]
FIG. 1 is a block diagram of a main part of a makeup advice system according to an embodiment of the present invention.
FIG. 2 is a diagram showing a procedure for synthesizing a makeup data image and a face image of a subject.
FIG. 3 is a diagram showing a state of deformation synthesis by a wire frame.
FIG. 4 is a diagram showing extraction of a makeup data image.
[Explanation of symbols]
1 Camera device 2 Display device 3 Control unit 4 Memory

Claims (3)

A camera device for photographing the face of the subject, a display device for photographing an image of the face of the subject photographed by the camera device, and means for virtually applying makeup to the image of the face of the subject projected on the display device We met cosmetic advice system that includes,
A memory in which a plurality of makeup data images representing facial changes due to makeup are stored;
The means for virtually applying makeup comprises means for selecting any one of the makeup data images stored in the memory and transforming the makeup data image so as to match the face image of the subject and synthesizing it with the face image of the subject. Prepared ,
The makeup data is a makeup advice system in which the makeup data is image data extracted by photographing a face image of a model to which makeup is applied, and removing an image of a face portion before makeup of the model from the face image . The makeup advice system according to claim 1 , wherein the makeup data is used when the makeup data is combined with the makeup data and a subject image . The makeup advice system according to claim 1 or 2, further comprising means for classifying makeup data for each type of face having different characteristics and storing the makeup data in the memory .

Images