JP3390558B2 - Lip color advice system and method - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a lip color advice system and method for advising a lip color suitable for a makeup image desired by a person.

[0002]

2. Description of the Related Art Makeup cosmetics such as lip colors play an important role in adding an accent to a face and forming an image of the person. For this reason, makeup cosmetics have a wide variety of colors. Furthermore, the users' tastes of color vary widely, and it is desirable that the makeup cosmetics should be able to sufficiently express the intention of the person who wears makeup and the makeup image of that person.

However, there are cases where cosmetics different from the make-up image that a person initially had as a desire were recommended at the sales site for subjective advice from beauty staff. That is, inconsistency may occur between a person's request and the subjective image of the beauty staff.

Further, actually applying a large number of colors to the skin imposes a great burden on the skin. Furthermore, it has been difficult for the user to compare the make-up images with a plurality of colors applied to the skin.

[0005]

Regarding the make-up of the cosmetics, the make-up simulation system of JP-A-63-80692 and JP-A-64-4189, and the make-up simulator of JP-A-62-144280 have already been proposed. Are known.

The make-up simulation system displays a make-up part such as a face obtained by an image pickup device on a display device, and specifies a makeup color and a range of the make-up part to simulate the make-up on the screen. Is. The make-up simulator is a make-up simulator that outputs a processed image by subjecting a face image of a subject to image processing with a function and processing suitable for actual makeup by a high-speed and large-capacity arithmetic processing circuit.

However, in the conventional system, the color is selected by the operator's personal feeling. For this reason, there is often a discrepancy between a person's request and an operator's personal feeling.

Further, actually applying a large number of colors to the skin imposes a great burden on the skin. Furthermore, it has been difficult for the user to compare the make-up images with a plurality of colors applied to the skin.

An object of the present invention is to provide a lip color advice system and method which can accurately advise a lip color suitable for a person's will and a desired make image.

[0010]

The lip color advice system of the present invention adopts the following means in order to solve the above problems.

<Summary of Lip Color Advice System of the Present Invention> As shown in FIG. 1, the lip color advice system of the present invention uses the skin color information of the face of the makeup cosmetic user and the preference for human color in advance. An input unit 10 for inputting group information divided into groups according to a permissible range , and each of the make image information desired by the user.
And each of the skin color information, the group information, and the make image information, and a skin color corresponding to these various kinds of information.
Munsell value of each phase and Munsell value of skin color brightness
Cell values are classified into multiple categories and Munsell values and
Skin color category table that correlates with Gory,
Hue difference, lightness difference and saturation difference with lip color
Are classified into multiple categories and the color difference and category are paired.
Corresponding color difference category table and each category table
Color, skin tone, and skin tone corresponding to each category
Hue difference, lightness difference, and saturation difference data are group information and
Category score table classified by make image
221, hue, brightness, and color for selecting a lip color
A storage unit 20 for storing the lip color data that associates each colorimetric value of time, the skin color information inputted by the input unit 10, the group information, lapis lazuli Ppukara to respond to each information of the make-image information Search unit 30 for searching the lip color data stored in the storage unit
If, Ru and a display unit 50 for displaying the retrieved re Ppukara by the search unit 30.

The point is to display a lip color that matches the make-up image and give an appropriate advice based on the skin colorimetric value and the objective data based on experiments. The configuration will be described below. (Input Unit) The input unit 10 includes the skin color information of the face of the makeup cosmetic user, group information in which the preference of a person for a color is grouped in advance according to the permissible width for the color, and the makeup image information desired by the user. Each of the information is input, for example, a color video camera, a mouse, a keyboard, or the like. (Storage Unit) The storage unit 20 stores each of the skin color information, the group information, and the make-up image information, and a lip color suitable for the make-up image corresponding to the information, and is, for example, a hard disk or an optical disc. For example, a magnetic disk. (Search section) retrieval unit 30 the skin color information inputted by the input unit 10, the group information, in a lip color that the lapis lazuli Ppukara to respond to the information of the make-image information stored in the storage unit 20 The function is realized by executing the program stored in the memory by the central processing unit, for example.
(Display unit) The display unit 50 displays a lip color corresponding to the make image searched by the search unit 30, and is a monitor, a color printer, or the like.

The present invention can be realized by adding the following additional components. The other additional components, wherein the input unit, an imaging unit, a color position designator skin, skin color calculation unit, the color grouping unit is to comprise a make image selection unit.

The image pickup unit is, for example, a video camera, and photographs the face of the user and a color chart to be a color reference. Color position designator skin extracts data of the color location of the skin that is specified by specifying an arbitrary position skin from the obtained face image by the image pickup unit. The skin color calculation unit corrects the difference between the reference color of the reference color patch measured in advance by the reference colorimeter and the photographed reference color patch with respect to the skin color position data extracted by the skin color position designation unit. To calculate the skin color. The color grouping unit sets an allowable width for each group information and determines which group the user belongs to. The make image selection unit selects a desired make image from a plurality of make images using a mouse, for example.

[0015] The other additional components, Ru der that the input unit comprises a lip contour designation unit for designating the contour of the lips from the obtained face image by the image pickup unit.

The skin color category table classifies the Munsell values of the skin color hue and the Munsell value of the skin color lightness into a plurality of categories, and associates the Munsell values with the categories. In the color difference category table, each color difference of hue difference, lightness difference, and saturation difference between skin color and lip color is classified into a plurality of categories, and the color difference is associated with the category. The category score table is a skin color hue, skin color lightness, hue difference, lightness difference for the matching lip color corresponding to each category of each category table,
Each data of the saturation difference is classified according to the group information and the make image.

With respect to other additional components, the search unit calculates the skin color category and the color difference category from the skin color colorimetric value and the lip colorimetric value using the skin color category table and the color difference category table, Sum of each data of skin color hue, skin color lightness, hue difference, lightness difference, saturation difference corresponding to the category calculated using the category score table based on the determined group information and the selected make image information. Calculate the value and add it to the total
Ru Der possible to extract the association was lip color.

[0018] The other additional component is the search unit.
Classifies the lip color data based on the total value ,
Ru der outputs it to the display unit the top few lip color data of the classification result as the candidate color.

The other additional component is that the display unit applies a plurality of face images to the lips designated by the lip contour designating unit on the screen by applying the some candidate colors matching the makeup image. displayed, selects one from among these, Ru der displaying the selected face image and the candidate color coated front of the face image on the same screen.

[0020] In addition, the present invention can also be a lip color advice method. As this method, for example, FIG.
As shown in, the skin color information of the makeup cosmetics user's face, group information in which the preference for the color of a person is grouped in advance according to the permissible width for the color, and each information of the make image information desired by the user. And an input step S1 for inputting, and a storage step S2 for storing each of the skin color information, the group information, and the make image information and a matching lip color matching the make image corresponding to the information. The skin color information,
The group information display step the search step S3 to search from the lip color, which is the storage to Brighter Ppukara corresponding to each information, for displaying suits re Ppukara to make images that are the search of the make-image information A method including S4 can be mentioned.

The input step is designated by an image pickup step for photographing the face of the user and a color chart to be used as a color reference, and an arbitrary position of skin color is designated from the obtained face image. Skin color position specifying step of extracting the data of the skin color position, and the difference between the reference color of the reference color chip measured in advance by the reference colorimeter and the taken reference color patch to the extracted skin color position data. A skin color calculation step of calculating a skin color by correcting it, a color grouping step of determining which group the user belongs to by setting an allowable width for each group information, and a plurality of make-up images. A make image selecting step of selecting a desired make image from among them may be included.

Further, the input step may include a lip contour designating step of designating a lip contour from the obtained face image . Further, the storing step stores a skin color category table in which the Munsell value of the skin color hue and the Munsell value of the skin color lightness are classified into a plurality of categories and the Munsell value and the category are associated with each other, and the skin color is A color difference category table in which the color difference with the lip color, the lightness difference, and the saturation difference are classified into a plurality of categories and the color difference and the category are associated with each other is stored, and each color difference table corresponds to each category of each category table. It may include contents of storing a category score table in which each data of skin color hue, skin color lightness, hue difference, lightness difference, and saturation difference for the matching lip color is classified for each group information and make image .

In the searching step, the skin color category and the color difference category are calculated from the skin color measurement value and the lip color measurement value using the skin color category table and the color difference category table, and the determined group information and the selection are performed. Based on the makeup image information and the category score table based on the calculated category skin color, skin color lightness, hue difference, lightness difference, each data of saturation difference is calculated, based on each of the data Includes content to calculate the degree of matching for lip color in a group
But good.

[0024] The search step is to output to the display unit classifies the lip color data to be the order of the result of the degree of match for lip color that is the calculated, the upper few lip color data of the classification result as candidate color
You may

In the displaying step, a plurality of face images in which the above-mentioned designated candidate lips that match the make-up image are respectively applied to the specified lips are displayed on the screen, and one of them is selected. , The selected face image and the face image before applying the candidate color may be displayed on the same screen .
Yes.

[0026]

According to the present invention, when the skin color information, the group information, and the make image information desired by the user are input through the input unit 10, the search unit 30 causes the input skin color information, the group information, and the makeup. searching among the lip color stored re Ppukara in the storage unit 20 that matches the make-image to be desired for each information of the image information, the display unit 50 to display the retrieved re Ppukara.

That is, based on the physical data such as the colorimetric value of the skin color and the objective data stored by the experiment, the lip color suitable for the intention of the person or the desired make image is accurately advised. be able to.

Further, when the skin color position designation section extracts the data of the designated skin color position from the face image obtained by the image pickup section,
The skin color calculation unit corrects the difference between the reference color of the reference color patch and the photographed reference color patch to the extracted data of the skin color position, so that the skin color information is obtained. The color grouping unit obtains the group information of the user, and the make image selecting unit selects the desired make image information.

Further, since the lip contour designating unit designates the lip contour from the face image obtained by the image pickup unit, it is possible to apply the lip color to the designated portion later. Further, by using the skin color category table, the color difference category table, and the category score table,
Skin color hue for ruri Ppukara to correspond to each category, skin color lightness, hue difference, lightness difference can be obtained each data of chroma difference for each group information and make an image.

Further, the search unit calculates the skin color category and the color difference category from the skin color measurement value and the lip color measurement value using the skin color category table and the color difference category table, and selects the determined group information. skin color hue corresponding to the calculated category by using the category score table based on the make-image information, the skin color lightness, hue difference, brightness difference, it calculates the data of chroma difference, corresponding to the total value of the respective data it can be extracted Rippukara over that.

The retrieval unit sums up the calculated respective data.
It is possible to classify the lip color data based on the values, and output the top several lip color data of the classification result as candidate colors to the display unit.

The display unit displays on the screen a plurality of face images in which the above-mentioned designated lips are respectively coated with the above-mentioned several candidate colors that match the make-up image, and one of them is selected, Since the selected face image and the face image before applying the candidate color are displayed on the same screen, a plurality of colors can be compared and viewed at the same time, so that a color that is more satisfying for a person can be selected.

[0033]

Embodiments of the lip color advice system and method of the present invention will be described below with reference to the drawings. The lip color advice system uses a video camera to input a person's face, and a mouse to input a person's taste and a make image to be realized.

The system measures the skin color from the face image input from the video camera, and considers the optimum lip color based on the colorimetric value, the preference of the person and the condition of "matching and matching the makeup image". Select the color of from the objective experimental results, and display and give advice.

The inventors conducted a study on "a matching lip color" as a visual aesthetic study. As a result, we obtained "the matching lip color theory" that determines the "matching" lip color that matches the skin color and facial shape.

The lip color advice system was developed in order to tangibly embody the matching lip theory. Hereinafter, the lip color advice system will be described. The lip color advice system consists of hardware and software. (1) Hardware Configuration of System FIG. 3 is a hardware configuration diagram of the lip color advice system of the embodiment of the present invention. In FIG. 3, the lip color advice system includes a video camera 11, a keyboard 12, a mouse 13, a disk 22, a full color board 21 connected to the video camera 11, a color printer 51, a reference colorimeter 44, and a full color board 21.
And a monitor 52 connected to the.

The computer 31 is, for example, a personal computer and has a central processing unit (CPU). The computer 12, the keyboard 12, the mouse 13, the disk 22, the full-color board 21, the color printer 51, and the reference colorimeter 44 are connected.

The video camera 11 picks up the face 70 of the person and the reference color chart 60 shown in FIG. 6 to obtain a face image and a color chart image, and outputs those images to the full color board 21. The full-color board 21 is an image memory, and stores image data of a face image and a color chart image output from the video camera 11.

The keyboard 12 and the mouse 13 are used to input conditions such as a person's taste and a make image to be realized,
The condition data is output to the computer 31. The reference colorimeter 44 is, for example, a spectrophotometer, and measures only the reference color chart 60 shown in FIG. 6 to obtain reference colors (white 61, gray 62, black 6).
3, blue 64, green 65, red 66) RGB data,
The RGB data of the reference color is output to the computer 31.

The color (RGB data) of the reference color chart taken by the video camera 11 is different from the reference color measured by the reference colorimeter. Therefore, the colorimetric value of the color chart photographed by the video camera 11 is corrected using the reference color measured by the reference colorimeter.

The disk 22 is, for example, a hard disk, a magneto-optical disk, or the like, and stores a plurality of lip color that suits the makeup image, and the lip color data is desired to be realized by the computer 31. It is read according to the make image.

The disk 22 is provided with a lip color advice program 220, and the lip colors that match the makeup image are stored in a plurality of tables. These tables are the category score table 221, the skin color hue category table 22.
2. Skin color lightness category table 223, hue difference category table 224, lightness difference category table 22
5 and a saturation difference category table 226.

The category score table 221 is shown in FIG.
As shown in 5, each data of skin color hue, skin color lightness, ΔH (hue difference), ΔV (lightness difference), ΔC (saturation difference), and standardized category score is classified into groups and image words. , Skin color hue, skin color brightness, ΔH, ΔV, and ΔC data have several levels (some categories described later).
It is divided into The group is divided into, for example, three groups, as will be described later, and the image word represents a make image of a person's will or desire, and includes items of "look good" and "youthful".

As shown in FIG. 17, the skin hue hue category table 222 classifies Munsell values of skin hues of 0.1R to 10Y into three categories, and associates each Munsell value with each category. The number of categories corresponds to the number of categories of skin color hue in the category score table 221.

As shown in FIG. 18, the skin color lightness category table 223 sets the Munsell value of skin color lightness of 0 to 3 to 3
They are classified into one category, and each Munsell value is associated with each category. The number of categories corresponds to the number of categories of skin color brightness in the category score table 221.

The hue difference category table 224 is shown in FIG.
As shown in 0, the color difference of ΔH (hue difference between skin color hue and lip color hue) of −5 to 30 is classified into seven categories, and each color difference is associated with each category. The number of categories corresponds to the number of ΔH categories in the category score table 221.

The brightness difference category table 225 is shown in FIG.
As shown in 1, color differences of ΔV (brightness difference between skin color brightness and lip color brightness) of −2 to 4 are classified into six categories, and each color difference is associated with each category. The number of this category is Δ in the category score table 221.
Matches the number of categories in V.

The saturation difference category table 226 is shown in FIG.
As shown in 2, color differences of ΔC (saturation difference between skin color saturation and lip color saturation) of −3 to 11 are classified into three categories, and each color difference is associated with each category. The number of categories corresponds to the number of ΔC categories in the category score table 221.

The data of each lip color in these tables is created by the past objective experimental results. The computer 31 performs arithmetic processing on various conditions from the keyboard 12 and the mouse 13, various data from the disk 22, and image data stored in the full-color board 21, and outputs the result to the color printer 51.
Alternatively, it outputs to the monitor 52 via the full color board 21.

That is, the computer 31 measures the flesh color from the face image input from the video camera, and considers that it is optimal based on the colorimetric value, the taste of the person, and the condition of "matching and matching the makeup image". Select the color of the lip color from the objective experimental results in the table,
Display and give advice. The monitor 52 displays the image data stored in the full color board 21 on the screen. (2) System Software Configuration Next, the system software configuration will be described. FIG. 4 is a diagram showing a software configuration of the lip color advice system. The software is a function realized by the central processing unit (CPU) in the computer 31 executing the lip color advice program 220 stored in the disk 22. According to the matching lip color theory, the software obtains a “matching” lip color that matches the makeup image one wants to realize.

A lip color that "matches" a person's desired makeup image is obtained by a function of f ₁ (skin color, grouping of evaluators) and f ₂ (make image desired to be realized).

The elements of the flesh color, the grouping of evaluators, and the make image are the flesh color position designation section 306 shown in FIG.
It is measured by the skin color calculation unit 308, the lip contour designation unit 310, the color grouping unit 311, and the make image selection unit 312.

The skin color position designating unit 306 designates the skin color position in the human face by the mouse 13, reads out the face image and the reference color patch simultaneously photographed by the video camera 11 from the full color board 21, Data of the designated skin color position is extracted from the face image. The skin color calculation unit 30 is included in the skin color position designation unit 306.
8 are connected.

The skin color calculation unit 308 extracts the difference between the reference color of the reference color patch measured by the reference colorimeter 44 and the reference color patch captured by the video camera 11 by the skin color position designation unit 306. A more accurate skin color is calculated by correcting the data of the skin color position thus obtained. That is, the skin color calculation unit 308 measures the skin color.

The flesh color calculator 308 converts the corrected flesh color RGB data into XYZ color coordinate system XYZ data,
This XYZ data is converted into Munsell HVC data. The color printer 51 prints RGB data.

The lip contour designating section 310 is a skin color calculating section 30.
8, and specifies the contour of the lips from the face images simultaneously captured by the video camera 11. A color grouping unit 311 is connected to the lip contour designating unit 310.

The color grouping unit 311 groups the evaluator's colors into groups according to the person's preference, and presents a sample photograph showing a difference in the color evaluation among the evaluator groups, and the person who wants to show it (usually Determine which group you (yourself) belong to. A make image selection unit 312 is connected to the color grouping unit 311.

The make image selection unit 312 selects a make image that the person wants to realize from the image words displayed on the screen by the mouse 13 or the like and used according to the experimental result.

Further, in FIG. 4, an arithmetic processing unit 313 connected to the make image selection unit 312 and a display control unit 314 connected to the arithmetic processing unit 313 are provided.
The arithmetic processing unit 313 applies a matching lip color that matches the desired make image selected by the make image selection unit 312 to each table 2 on the disk 22.
A search is performed using the data stored in 21 to 226.

The display control unit 314 displays on the screen of the monitor 52 a plurality of face images in which the lips designated by the lip contour designating unit 310 are respectively coated with the above-mentioned candidate colors that match the makeup image. Any one from
One of them is selected, and the selected face image and the face image before applying the candidate color are displayed on the same screen.

Next, a lip color advice method realized by the lip color advice system configured as described above will be described with reference to the flowchart shown in FIG.

First, as shown in FIG. 6, a person's face 70 and a color chart 60 to be a reference are simultaneously photographed by the video camera 11 (step 101), and the face image and the color chart image are taken into the full-color board 21. Be done.

Next, the skin color position designation unit 306 designates the reference color chart 60 (the position of the red color chart 66 in the example shown in FIG. 6), and further, the skin color position 71 as shown in FIG. Designate (step 102).

Further, the skin color position designating unit 306 reads out the face image and the reference color chip simultaneously photographed by the video camera 11 from the full color board 21, and the data of the designated skin color position from the face image. To extract.

On the other hand, the reference colorimeter 44 measures only the reference color chart 60 shown in FIG. 6 to obtain reference colors (white 61, gray 62, black 6).
3, blue 64, green 65, red 66) RGB data,
The RGB data of the reference color is output to the skin color calculation unit 308.

The skin color calculator 308 calculates the difference between the reference color of the reference color chart 60 measured by the reference colorimeter 44 and the reference color chart 60 taken by the video camera 11 as the skin color position designation section 306. A more accurate calculation of the skin color is performed by correcting the data of the skin color position 71 extracted in (step 103). That is, the RG of the skin
Since the B data is corrected by the difference, the error in the RGB data of the video camera 11 is eliminated, and thus the color measurement accuracy can be improved.

Further, the flesh color calculator 308 converts the corrected flesh color RGB data into XYZ color system XYZ data, converts this XYZ data into Munsell system HVC data, and displays it on the screen of the monitor 52. A skin color map 72, HVC data 73, and an area 74 of the skin color HVC data 73 on the skin color map 72 are displayed.

FIG. 8 shows a skin color map 72. Figure 8 (c)
V shown in is a brightness, and is divided into low brightness (color black), medium brightness, and high brightness (white). The circumferential direction H shown in FIG. 8B is a hue. C shown in FIG. 8B is the saturation. Figure 8
In the skin color HVC data 73 shown in (a), the hue H
Is 5.3YR (yellow red), the brightness V is 6.2, and the saturation C is 3.
It is 2.

Next, the lip contour designating section 310 designates the lip contour 76 with the mouse 13 as shown in FIG. 9 (step 104). Here, the lip contour designating unit 310 is shown in FIG.
The lip contour 76 is designated according to the flowchart shown in FIG.

That is, the lip contour designating section 310 designates the peripheral region 75 of the lip from the face image 70 obtained by the video camera 11 with the mouse 13 as shown in FIG. 9 (step 141).

Next, the lip contour designating section 310 enlarges and displays the designated peripheral region 75 of the lip on the upper right screen of the monitor 52 (step 142). Further, the lip contour designating section 310 displays a model 77 for designating the lip contour on the screen of the monitor (step 143). Further, the lip contour designating section 310 determines whether or not to modify the lip contour template 77 (step 144).

Here, when the template 77 for the lip contour is not modified, the lip contour designating section 310 pushes the modification end button 78 (step 145) and designates the center position of the lip (step 146).

On the other hand, when modifying the lip contour template 77, the lip contour designating section 310 uses the template 77.
A moving point (any one of + marks P1 to P7 in the figure) for transforming is selected (step 147).

Then, the lip contour designating section 310 corrects the lip shape by moving the + marks P1 to P7 to a desired position using the mouse 13 (step 148). Then, the process proceeds to step 145. Through the above processing, the lip contour 76 is designated.

Next, returning to FIG. 5, the color grouping unit 31
In step 1, the grouping is carried out according to the evaluator's allowable width for the color according to the taste of the person (step 105). The color grouping unit 311 performs grouping according to the allowable width for colors according to the flowchart shown in FIG.

That is, in FIG. 11, the color grouping unit 311 uses a group classification image (a photograph taken in advance).
Is displayed (step 151). For example, the color grouping unit 311 displays images G1 (lip color 79) having different lip colors on the left and right sides of the screen as shown in FIG.
And an image G2 (lip color 80) is displayed.

Then, the evaluator makes a response (YES, NO) as to whether or not the individual images G1, G2 of the group classification image look good, by pressing YES buttons 81a, 82a, NO.
Input with buttons 81b and 82b (step 15)
2).

Next, the color grouping unit 311 determines whether or not the evaluator thinks that the left side image G1 looks good according to the input answer (step 153). Here, when the evaluator presses the YES button 81a because he thinks that the left group classification image G1 is suitable, the color grouping unit 311 selects the group II (step 154).

On the other hand, if the evaluator presses the NO button 81b because he / she does not think that the left group classification image G1 looks good, the color grouping unit 311 causes the evaluator to sort the right group classification image according to the input. It is determined whether or not the image G2 looks good (step 155).

Here, if the evaluator presses the YES button 82a on the assumption that the evaluator looks like the right group classification image G2, the color grouping unit 311 selects the group III (step 156).

On the other hand, when the evaluator presses the NO button 82b because he / she does not think that the right side group classification image G2 looks good, the group I is selected (step 15).
7). By the above processing, the group according to the allowable width for the evaluator's color is determined. The results of the above grouping correspond to the groups in the category score table 221 of the disc 22.

Next, returning to FIG. 5, the computer 31 reads a plurality of make images stored in the disk 22 and displays them on the screen of the monitor as shown in FIG. Figure 1
3 has multiple make-up images, "calm", "cute", "youthful", "elegant",
"Passionate", "Gorgeous", "Skin tones", "Soft", "Attractive" are displayed.

Then, the button 84 of the desired make image from the plurality of make images displayed by the person on the screen is displayed.
By pressing, the make image selection unit 312 selects the desired make image (step 106).

By the above processing, skin colorimetric values for obtaining a lip color suitable for the make-up image, grouping according to the permissible width for the color, and each element of the make-up image to be realized were measured. Next, the arithmetic processing unit 313 searches each of the tables 221 to 226 in the disk 22 for a lip color that matches the make image selected by the make image selecting unit 312 (step 107). The arithmetic processing unit 313 is shown in FIG.
Search for a matching lip color that matches the makeup image according to the flowchart shown in.

In FIG. 14, first, in order to estimate an image word that matches, the arithmetic processing unit 313 corresponds to the corresponding category in the category table 221 shown in FIG. 15 based on the group classification result classified by the group classification unit 312. The category score calculated in the group quantification type I is read (step 171).

Next, the arithmetic processing section 313 calculates category data from the skin color value (Munsell value) (step 17).
2). The category data is calculated from the skin color according to the flowchart shown in FIG.

In the figure, the arithmetic processing unit 313 calculates the skin color hue obtained in step 103 (step 17).
21) Furthermore, the arithmetic processing unit 313 determines one of categories 1 to 3 corresponding to the skin color hue value (Munsell value) according to the skin color hue category table 222 shown in FIG. 17 (step 1722).

Next, the arithmetic processing unit 313 executes the above step 1
The skin color brightness obtained in step 03 is calculated (step 172
3) Further, according to the skin color hue category table 223 shown in FIG. 18, one of the categories “1” to “3” corresponding to the skin color lightness value (Munsell value) is determined (step 1724). Through the above processing, the skin color category data for referring to the category score table 221 was calculated.

Next, returning to FIG. 5, the arithmetic processing section 313 calculates category data based on the color difference between the skin color and the lip color (step 173). The calculation of the category data based on the color difference between the skin color and the lip color is performed according to the flowchart shown in FIG.

In FIG. 19, the arithmetic processing section 313 first calculates the hue difference category (step 173).
1). That is, the arithmetic processing unit 313 numerically converts the hue values of the skin color and the lip color (step 1732).
In this case, 10B (blue) is set to "0" and the numerical value conversion is performed clockwise.

Further, the arithmetic processing unit 313 calculates the color difference on the hue axis by subtracting the lip color conversion value from the obtained skin color conversion value (step 1733).
Then, the arithmetic processing unit 313 determines the hue difference category corresponding to the calculated color difference on the hue axis according to the hue difference category table 224 (step 173).
4).

Next, the arithmetic processing section 313 calculates the brightness difference category (step 1735). That is, the arithmetic processing unit 313 calculates the brightness difference on the brightness axis by subtracting the lip color brightness from the skin color brightness (step 1736). The arithmetic processing unit 313 determines a category corresponding to the calculated brightness difference on the brightness axis based on the brightness difference category table 225 (step 173).
7).

Further, the arithmetic processing section 313 calculates the saturation difference category (step 1738). That is, the arithmetic processing unit 313 calculates the saturation difference on the saturation axis by subtracting the lip color saturation from the skin color saturation (step 1739), and the saturation difference calculated by the saturation difference category table 226. The category corresponding to the saturation difference in is determined (step 1740).

By the above processing, the category data was calculated by the color difference between the skin color and the lip color. Next, returning to FIG. 5, the arithmetic processing unit 313 calculates the degree of matching for each lip color by the quantification type I (step 174). FIG. 23 shows a calculation example of the degree of matching with respect to the lip color.

Here, as shown in FIG. 23A, for example, as the calorimetric values, the skin color hue is 5.0YR, the skin color lightness is 6.2, the skin color saturation is 3.2, and the lip hue is 8. 75R
P (magenta), lip brightness of 6.1, lip saturation of 10.
It was set to 0.

In this case, the skin color hue category is 2 according to the skin color hue category table 222. The skin color lightness category is 3 according to the skin color lightness category table 223.

The category of the lip hue difference (ΔH) becomes "5" by rotating clockwise with 10B as 0 according to the hue difference category table 224. Since the lip brightness difference (ΔV) category has a brightness difference of “0.1”, it is “3” according to the brightness difference category table 225.
Becomes Since the saturation difference of the lip saturation difference (ΔC) category is “6.8”, the saturation difference category table 22
According to 6, it becomes “2”.

Next, regarding the group 1 in the category score table 221 and the image words look good,
Data (shown in FIG. 15) corresponding to each of the determined category data is obtained.

Then, as shown in FIG. 23B, the skin color hue is 0.031, the skin color lightness is 0.2396, ΔH is 0.4575, ΔV is −0.5154, and ΔC is 0.08.
43, the standardized category score is 3.1726, and the matching evaluation result of group 1 is obtained as 3.4696.

Next, the arithmetic processing section 313 calculates the degree of fitting to the "image word" for each lip color according to the quantification type I (step 175), and sorts in the descending order of the results of the calculated "matching degree" (step 175). Step 17
6).

The arithmetic processing unit 313 extracts the upper three lip color RGB data of the classification result (step 17).
7) Then, the images are classified in descending order of the degree of fit to the calculated "image word" (step 178).

Further, the arithmetic processing unit 313 extracts the lip color RGB data of "3" (neither match or neither match) of the result of the degree of "matching" from the higher order of the classification result (step 179). Here, "5" means that it looks good, and "4" means that it looks good.

With the above processing, the processing of step 107 is completed. Next, returning to FIG. 5, the display control unit 34 images candidate colors that match the make image desired by the person (lip color RGB data of '3' or higher as a result of the degree of "matching" from the top of the classification result). By pressing the candidate color button 86, the color is read from the arithmetic processing unit 313, and
As shown in FIG. 4, three face images 70a are displayed on the screen of the monitor 52.
.About.70c and three lip images 85a to 85c coated with candidate colors suitable for the make image are displayed (step 108).

Further, the display control section 34 selects any one of the three candidate colors as shown in FIG. In the example shown in FIG. 25, the color applied to the lip 85c is selected.

Next, the display controller 34 displays the face 70c after application of the selected color and the face 70 before application as shown in FIG. 26 for comparison (step 109). Finally, the display controller 34 displays the face 70c after the application of the selected color and the advice to the person regarding the lip color (step 110).

That is, a display of a color suitable for a make image desired by a person is displayed on the screen of the monitor. In this way, the skin color information, the group information, and the make image information desired by the user are measured, and the arithmetic processing unit 313
The lip color stored in each table is searched for a matching lip color that matches the desired make image corresponding to each of the input skin color information, the group information, and the make image information, and the display control unit 34
Displays a matching lip color that matches the retrieved make image.

That is, based on the physical data such as the colorimetric value of the skin color and the objective data stored by the experiment, the lip color suitable for the will of the person or the desired make image is accurately advised. be able to.

In this case, the software of the system is largely different from that of the existing system, for example, the publicized make-up simulator. In the conventional system, the color is selected according to the operator's personal feeling, but in the system of the present embodiment, the color is selected based on the theory supported by the objective experimental data.

Further, the display control section 34 displays a plurality of face images in which the lips designated by the lip contour designating section 310 are respectively coated with the above-mentioned candidate colors that match the make-up image on the screen. Since any one of them is selected and the selected face image and the face image before applying the candidate color are displayed on the same screen, it is possible to compare and view a plurality of colors at the same time. You can choose a color that satisfies people.

Further, in terms of hardware, an expensive workstation was used in the conventional system, but a personal computer can be used in the system of this embodiment, so an inexpensive system can be constructed.

[0111]

According to the present invention, when the skin color information, the group information, and the make image information desired by the user are input through the input unit, the search unit inputs the skin color information, the group information, and the makeup. The lip color stored in the storage unit is searched for the matching lip color matching the desired make image corresponding to each piece of image information, and the display unit displays the matching lip color matching the searched make image. indicate.

That is, based on the physical data such as the colorimetric value of the skin color and the objective data stored by the experiment, the lip color suitable for the will of the person or the desired make image is properly advised. be able to.

Further, the skin color information is obtained by the processing of the image pickup section, the skin color position designation section, and the skin color calculation section. The color grouping unit obtains the group information of the user, and the make image selecting unit selects the desired make image information.

Further, since the lip contour designating section designates the lip contour from the face image obtained by the imaging section, it is possible to apply the lip color to the designated section later. In addition, by using the skin color category table, the color difference category table, and the category score table, each data of skin color hue, skin color lightness, hue difference, lightness difference, and saturation difference for a matching lip color corresponding to each category is grouped. It can be obtained for each information and make image.

Further, the search section calculates the category using the skin color category table and the color difference category table, and the category score table based on the determined group information and the selected make image information. It is possible to calculate each of the data corresponding to the category, and calculate the degree of matching of the group to the lip color based on each of the calculated data.

The retrieval section can output some of the upper lip color data of the classification result as candidate colors to the display section. The display unit displays on the screen a plurality of face images in which the aforementioned several candidate colors that match the make image are applied to the lips designated by the lip contour designating unit, and one of them is selected. Since the selected face image and the face image before applying the candidate color are displayed on the same screen, it is possible to compare and see a plurality of colors at the same time. .

[Brief description of drawings]

FIG. 1 is a principle view showing a lip color advice system of the present invention.

FIG. 2 is a flowchart showing a lip color advice method of the present invention.

FIG. 3 is a hardware configuration diagram of the lip color advice system according to the embodiment of this invention.

FIG. 4 is a software configuration diagram of a lip color advice system according to an embodiment of the present invention.

FIG. 5 is a flowchart showing a process of the lip color advice system.

FIG. 6 is a diagram showing shooting of a face image and a color chart.

FIG. 7 is a diagram showing designation of a skin color position.

FIG. 8 is a diagram showing a skin color map.

FIG. 9 is a diagram showing designation of a lip contour.

FIG. 10 is a flowchart showing designation of a lip contour.

FIG. 11 is a flowchart showing grouping according to an allowable width for a color.

FIG. 12 is a diagram showing a question for group selection on the screen.

FIG. 13 is a diagram showing selection of a desired make image.

FIG. 14 is a flowchart showing a search for a suitable lip color that matches a make image.

FIG. 15 is a diagram showing a category score table.

FIG. 16 is a flowchart showing category data calculation from skin color.

FIG. 17 is a diagram showing a skin color hue category table.

FIG. 18 is a diagram showing a skin color brightness category table.

FIG. 19 is a flowchart showing category calculation based on a color difference between a skin color and a lip color.

FIG. 20 is a diagram showing a hue difference category table.

FIG. 21 is a diagram showing a brightness difference category table.

FIG. 22 is a diagram showing a saturation difference category table.

FIG. 23 is a diagram illustrating an example of a matching evaluation result.

FIG. 24 is a diagram showing display of candidate colors suitable for a make image.

FIG. 25 is a diagram showing selection of a desired color.

FIG. 26 is a diagram showing a comparison between the face after applying the selected color and the face before applying.

[Explanation of symbols]

11 ... Video camera 12 ... Keyboard 13 ... Mouse 21 ... Full color board 22 ... Disk 31 ... Computer 44 .. Standard colorimeter 51 .. Color printer 52 ... Monitor 60 ... Color chart 70 ... Face image 220 ... Lip color advice program 221 ... Category score table 222 ... Skin color hue category table 223 ... Skin color brightness category table 224..Hue difference category table 225 ... Brightness difference category table 226 ... Saturation difference category table 306..Skin color position designation section 308 ... Skin color calculator 310 .. Lip contour designating section 311 ... Color grouping unit 312 ... Make image selection section 313 .. Arithmetic processing unit 314..Display control unit

─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Tomofumi Kimura 27 Takashimadai, Kanagawa-ku, Kanagawa-ku, Kanagawa 1 Pola Chemical Industry Co., Ltd. Yokohama Research Laboratory (72) Inoue Sakura 27 Takashimadai, Kanagawa-ku, Yokohama, Kanagawa 1 Pola Chemical Industry Co., Ltd. Yokohama Research Laboratory (56) Reference JP-A-2-168356 (JP, A) JP-A-1-273167 (JP, A) JP-A-1-276364 (JP, A) JP-A 5-253191 (JP, A) Actual development 57-145310 (JP, U) Actual development 63-183908 (JP, U) Actual development Flat 6-68075 (JP, U) (58) Fields investigated (Int. Cl. ⁷ , DB name) G06F 17/50 A45D 44/00

Claims (6)

(57) [Claims] 1. A makeup cosmetic user's facial skin color information, group information in which a person's preference for a color is grouped in advance according to an allowable range for the color, and a makeup image desired by the user. An input unit for inputting each piece of information, each piece of information of the flesh color information, the group information, the make image information, and a flesh color hue corresponding to these pieces of information.
The Munsell value of the cell value and the Munsell value of the skin tone are
Munsell value and category by classifying into multiple categories
Corresponding skin color category table, skin color and lip color
Multiple hue differences, lightness differences, and saturation differences with
The color difference was classified into categories and the categories were associated with each other.
Color difference category table and each category table
The skin tone and the skin tone corresponding to each category of
Degree, the hue difference, the lightness difference, and the saturation difference data
Categories classified by the group information and make-up image
Gory score table, for choosing lip color
Lip color that associates each colorimetric value of hue, lightness, and saturation
A storage unit for storing data, the skin color information input by the input unit, the group information, lip color, which is stored Ruri <br/> Ppukara to correspond to the storage unit in the information of the make-image information Day
Lip color advice system, comprising a search unit which searches the data, and a display unit for displaying the retrieved re Ppukara by the search unit. 2. The input unit specifies an image capturing unit for capturing a face of the user and a color chart to be used as a color reference, and an arbitrary skin color position from a face image obtained by the image capturing unit. a color position designator skin for extracting data from the specified skin color position Te, the difference of the skin of the reference color of the reference color chart measured in advance reference colorimeter and the photographed reference color chip color a skin color calculation unit for calculating the color of the skin by correcting for the data of the color location of the skin that have been extracted by the position specifying unit, belong the the user which groups sets the acceptable range for each group information lip color advice system according to claim 1, characterized in that it comprises a determining color grouping unit whether there, and make the image selecting unit that makes selecting a make images desired from a plurality of makeup image, the. 3. The lip color advice system according to claim 2, wherein the input unit includes a lip contour designating unit that designates a lip contour from the face image obtained by the imaging unit. 4. The skin color category table
And the color difference category table and the lip color
From the skin color measurement value and the lip color measurement value using
Select a skin color category and a color difference category, and further
The selected skin is selected using the category score table.
Color category and skin color corresponding to the color difference category
Phase, skin color lightness, hue difference, lightness difference, saturation difference, and the judgment
Group information and the selected make-up image information
Score data of standardized category scores corresponding to information
And the total value of each of these selected score data
And calculate the lip color associated with that total value.
Extraction be Lip Color advice system according to claim 1, wherein the Rukoto. 5. The search unit is arranged in the order of magnitude of the total value.
The lip color data is classified into
The lip color data is displayed as a candidate color on the display.
Lip Color advice system according to claim 1, characterized in that the force. 6. The display unit includes a lip contour designation unit on a screen.
The number of the above that matches the make image to the more specified lips
Display multiple face images with each of these candidate colors applied,
Select one of these and select the selected face
Image and face image before applying candidate lip color on the same screen
6. The lip color advice system according to claim 1, wherein the lip color advice system is displayed .