KR101507410B1 - Live make-up photograpy method and apparatus of mobile terminal - Google Patents

Abstract

A method for photographing live makeup of a mobile terminal equipped with a camera, the method comprising: receiving a user image in real time; detecting a character area to which a beauty effect is to be applied from the user image; Determining a beauty effect to be applied to each of the parts based on the person information, determining a beauty effect to be applied to each part on the basis of the outline, Applying the beauty effect, and displaying the user image to which the beauty effect is applied through the mobile terminal.

Description

TECHNICAL FIELD [0001] The present invention relates to a live make-up photographing method and apparatus for a mobile terminal,

The present invention relates to a method and apparatus for photographing live make-up of a mobile terminal.

Recently, users want to use their beauty shoots to make their faces more beautiful when shooting images and images. The beauty shot here is one of the correction functions for portrait photographs that brighten the color of the skin in the photograph and remove the dirt and the like and make the face look clean.

However, the conventional beauty shot shooting technique does not provide appropriate images or images for users with various skin types and skin colors according to sex, age, and race. That is, the appropriate beauty shot is not applied according to the user's sex, age, and race. For example, an image or an image to which a color cosmetic effect, which is favored by Asian young women who are not suitable for a grandfather or a man, may be output.

In order to solve this problem, conventional beauty shot techniques do not apply and unify a particular layer, for example, the deep-toned cosmetic effect preferred by Asian young women. For example, a beauty shot that can be applied only to Asian young women can be applied to a grandfather or a man when a specific layer, for example, a dark color cosmetic effect preferred by Asian young women, is applied and unified. In addition, the conventional beauty shot shooting technique has a problem that it can be applied to a position other than each part of the face. For example, there is a problem that a blue color cosmetic effect is applied to a white eye and a red lip tip effect is applied to a white color.

Accordingly, not only an image with appropriate beauty shot shooting according to sex, age, and race is outputted, but also a specific layer such as a dark color cosmetic effect preferred by Asian young women is applied and unified, and a cosmetic effect You need an applicable beauty shot technique.

The present invention detects a person area from a user image and detects an outline for each part of the face from a person area, thereby accurately recognizing an outline for each part, and applying a beauty effect to a more accurate position of each part And to provide a live makeup shooting method and apparatus of a mobile terminal that can be applied.

The present invention also provides a method and apparatus for photographing live make-up of a mobile terminal capable of generating appropriate images and images desired by various users because various beauty effects can be applied according to sex, age, and race of users The purpose.

The present invention also provides a method and apparatus for photographing live makeup of a mobile terminal capable of quickly determining various beauty effects from a database with respect to a user image, .

The objects of the present invention are not limited to the above-mentioned objects, and other objects and advantages of the present invention which are not mentioned can be understood by the following description and more clearly understood by the embodiments of the present invention. It will also be readily apparent that the objects and advantages of the invention may be realized and attained by means of the instrumentalities and combinations particularly pointed out in the appended claims.

According to an aspect of the present invention, there is provided a method for photographing live makeup of a mobile terminal equipped with a camera, the method comprising the steps of: receiving a user image in real time; detecting a person area to which a beauty effect is to be applied, Determining an outline for each part of the face from the person area, determining a beauty effect to be applied to each part based on the person information, Applying the beauty effect to each part according to the beauty effect, and displaying the user image to which the beauty effect is applied through the mobile terminal.

In addition, the present invention provides an apparatus for photographing live makeup of a mobile terminal equipped with a camera, comprising: an input unit for inputting a user image in real time; a character area detecting unit for detecting a character area to which a beauty effect is to be applied, A determination unit for determining the personality information of a person corresponding to the person area and determining a beauty effect to be applied to each of the parts based on the person information, And a beauty effect processor for applying the beauty effect to the user and displaying the user image to which the beauty effect is applied through the mobile terminal.

According to the present invention as described above, the outline for each part can be accurately recognized by detecting the character area from the user image and detecting the outline for each part of the face from the character area, Beauty effect can be applied to exact position.

In addition, according to the present invention, a variety of beauty effects can be applied according to the sex, age, and race of users, so that it is possible to generate appropriate images and images desired by various users.

In addition, according to the present invention, since various beauty effects can be quickly determined from a database with respect to a user image, there is an effect that a single image can be displayed and applied to a user image in real time.

1 is a configuration diagram of a live makeup photographing system according to an embodiment of the present invention.
2 is a diagram for explaining the operation of the live-makeup photographing apparatus 100. Fig.
3 is an example of a beauty effect stored in the database unit.
4 is an operational flowchart of a live makeup photographing apparatus according to an embodiment of the present invention.

The above and other objects, features, and advantages of the present invention will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings, which are not intended to limit the scope of the present invention. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are used to denote the same or similar elements.

1 is a configuration diagram of a live makeup photographing system according to an embodiment of the present invention.

Referring to FIG. 1, a live makeup shooting system 500 includes a camera 10, a live makeup shooting device 100, and a display unit 200. The live make-up photographing system 500 may be a mobile terminal 500 having a camera 10 and a display unit 200 to perform a video call. For example, the mobile terminal 500 may be a notebook, a mobile communication terminal, a smart phone, a portable media player (PMP), a personal digital assistant (PDA), a tablet PC, a set- , Smart TV, and the like.

The live makeup photographing system 500 according to the embodiment of the present invention can apply a beauty effect to a user image photographed through the camera 10 and display a user image to which a beauty effect is applied in real time through the display unit 200 have.

Here, the beauty effects are based on eyeliner, eyelid color, eyelash, eye shadow, brightness of the eyes, dark circles removal, removal of points, foundation, ball lifting (raising the ball), nose strengthening (nose raising), lipstick and tooth whitening May be a setting value. For example, the set value of the brightness of the eye can be expressed by a step of 1 to 10. That is, the brightness 1 of the eyes is a predetermined value for adjusting the brightness of the eyes to the minimum brightness, and the brightness 10 of the eyes may be a predetermined value for adjusting the brightness of the eyes to the maximum brightness.

At this time, the camera 10 is an apparatus that can capture a user's image and image, and can transmit the photographed image and image to the live makeup photographing apparatus 100. For example, the camera 10 may be a front camera or a rear camera of the mobile terminal 500.

The live makeup photographing apparatus 100 may display a user image or an image to which the beauty effect is applied through the display unit 200 by receiving a user image or an image photographed from the camera 10. [

Hereinafter, the live-makeup photographing apparatus 100 will be described in detail with reference to Fig.

2 is a diagram for explaining the operation of the live-makeup photographing apparatus 100. Fig.

1 and 2, the live makeup photographing apparatus 100 includes an input unit 30, a detection unit 40, a determination unit 50, and a beauty effect processing unit 60. According to the embodiment, the live makeup photographing apparatus 100 may further include a database unit 70.

The input unit 30 can receive the user image 31 photographed from the camera 10 in real time and transmit it to the detection unit 40. Here, the user image 31 may be a plurality of images arranged in chronological order. That is, the input unit 30 can transmit to the detection unit 40 a plurality of images in which the user images 31 photographed from the camera 10 are arranged in chronological order, in the order of time in which the images are received. Accordingly, the input unit 30 can transmit not only the user image 31 photographed by the camera 10 but also a user image to the detection unit 40.

The detection unit 40 can detect the person area 41 to which the beauty effect is to be applied from the user image 31 transmitted from the input unit 30. [ At this time, the user image 31 may include a background area (not shown) as well as a character area. That is, the detection unit 40 can detect the face and the body of the person from the user image 31, and detect the person area 41 corresponding to the detected face and the size of the body. For example, the detection unit 40 can detect the character area 41 using Haar-like feature algorithm, which is a character detection algorithm.

Further, the detection unit 40 can detect the outline 42 for each part of the face from the person area 41. [ Here, the outline may mean the contours of the eyebrows, eyes, nose, lips, and balls of the face. More specifically, the detecting unit 40 detects the points located at a certain distance from the eyebrows of the person area 41, the points of the eyes of the person area 41, the eyes of the person area 41, Points located at a certain distance from the nose of the person area 41, points located at a certain distance from the lips of the person area 41, and points located at a certain distance from the nose of the person area 41, It is possible to detect points located at a certain distance. According to the embodiment of the present invention, the detecting unit 40 can detect three points on the eyebrow, four points on the eye, two points on the nose, four points on the lips, and two points on the ball. According to another embodiment, the detector 40 can adjust the number of points on the eyebrows 3, 4 on the eye, 2 on the nose, 4 on the lips and 2 on the ball. Therefore, the detection unit 40 detects the person area 41 from the user image 31 and detects the outline for each part of the face from the person area 41, thereby accurately recognizing the outline for each part And the beauty effect can be applied to a more accurate position of each part.

Next, the determination unit 50 can determine the person information 51 of the person corresponding to the person area 41 detected by the detection unit 40. [ At this time, the person information 51 may be information on sex, age, and race. For example, the person information 51 may mean a 28-year-old Asian male. More specifically, the determination unit 50 determines and determines the race on the basis of the skin color of the character area 41 detected by the detection unit 40, and determines the shape of the character area 41 detected by the detection unit 40 It is possible to determine and determine the age based on the amount of wrinkles, and to determine and determine the sex based on the hair style detected from the detection unit 40. [ According to another embodiment, the determination unit 50 can directly receive the user's personal information corresponding to the person area 51 from the user.

The determination unit 50 also searches the database unit 70 to determine the beauty effect 52 to be applied to each part of the face based on the determined and determined person information 51 or directly inputted person information 51 can do. According to another embodiment, the determining unit 50 may search the memory of the mobile terminal 500 in which a plurality of beauty effects are stored in advance according to the person information 51 of the race, sex and age, or a server that can access through the wired / wireless network . That is, the determination unit 50 is applied to each part of the corresponding face of the data information 71 to 7N of the database unit 70 based on the determined and determined person information 51 or directly inputted person information 51 The beauty effect 52 can be searched.

Hereinafter, the database unit 70 will be described with reference to FIG.

3 is an embodiment of a plurality of beauty effects stored in the database unit.

Referring to FIG. 3, the database unit 70 may store data information 71 to 7N in advance. Here, the data information 71 to 7N includes respective beauty effects according to the person information. For example, the data information 71 to 7N includes a set value 1 for the eyeliner and a set value 3 for the nose reinforcement depending on the male in the Asian teenager, And a set value 9 for the removal of the circle. More specifically, the database unit 70 stores the eyeliner, the eyelash color, the eyelash, the eye shadow, the brightness of the eyes, the dark circle removal, the dot removal, the foundation, the ball lifting ), Nose strengthening (nose elevation), lipstick, and tooth whitening can be stored in advance. According to another embodiment, the user can change the beauty effect by directly storing each beauty effect in the data information 71 to 7N according to the person information.

Therefore, the determination unit 50 of FIG. 2 determines whether or not the character information 51 (FIG. 2) among the data information 71 to 7N of the database unit 70, based on the determined and determined person information 51 or directly inputted person information 51 Sexiness, age, and the like, and determine the beauty effect 52 to be applied to each part of the searched face. For example, when the determined and determined person information 51 or the person information 51 directly inputted is the Asian teenager, the determination unit 50 determines the setting value 7 for the eyeliner to be applied to each part from the database unit 70 , And a beauty effect 52 with a set value of 5 for lipstick.

Thereafter, the beauty effect processor 60 outputs the beauty effect 52 to each part determined by the determination unit 50 along the outline 42 for each part of the face detected from the detection unit 40, from the input unit 30 And can be applied to the input user image 31. At this time, the beauty effect processor 60 can adjust at least one of the saturation value, the brightness value, the hue value, and the sharpness value of each region based on the beauty effect 52 determined by the determination unit 50. [ For example, when the beauty effect 52 for each part determined by the determination unit 50 is the set value 5 for the lipstick, the beauty effect processing unit 60 adjusts the saturation, brightness, The effect 51 can be applied to the user image 31. [

That is, the beauty effect processor 60 adjusts at least one of the saturation value, the brightness value, the hue value, and the sharpness value of each part based on the beauty effect 52 to output the output image 61 to which the beauty effect 52 is applied Can be generated. In this way, the beauty effect processor 60 can provide the user with an output image 61 to which the beauty effect 52 is applied.

At this time, the display unit 200 can display the output image 61 generated from the beauty effect processor 60.

According to the embodiment of the present invention, since the determination unit 50 can determine various beauty effects based on the person information 51 from the database unit 70 with respect to the user image 31, the beauty effect processing unit 60 It is possible to generate an appropriate image and an image desired by the users, and display the combined and applied image on the user image 31 through the display unit 200 in real time.

4 is an operational flowchart of a live makeup photographing apparatus according to an embodiment of the present invention.

Referring to FIGS. 1 to 4, the input unit 30 receives a first image captured by a user via the camera 10 (S100). The detection unit 40 detects a person area to which the beauty effect is applied from the first image received from the input unit 30 (S110). Then, the determination unit 50 determines the person information of the person corresponding to the person area detected from the detection unit 40 (S120). At this time, the detection unit 40 detects an outline for each part of the face from the detected person area (S130). Then, the determination unit 50 determines a beauty effect to be applied to each region based on the person information (S140). Accordingly, the beauty effect processing unit 60 applies the determined beauty effect from the determination unit 50 to each part along the outline detected from the detection unit 40 (S150), and outputs the first image, to which the beauty effect is applied, Through the display unit 200 (S160).

According to an embodiment of the present invention, the live-makeup photographing apparatus 100 may include an input unit 30, a detection unit 40 The detection unit 40, the determination unit 50, and the beauty effect processing unit 60 (hereinafter, referred to as " the image processing unit 60 ") for the next image after performing the operations S100 to S160 of the determination unit 50, ) From step S100 to step S160. That is, the live-makeup photographing apparatus 100 is configured to perform a real-time beauty effect application to the user through the repetitive operations S100 to S160 of the input unit 30, the detection unit 40, the determination unit 50 and the beauty effect processing unit 60 The user image can be displayed.

10: Camera
30: Input unit
31: User picture
40:
41: Character area
50:
51: People information
52: Beauty effect
60: Beauty effect processor
61: Output video
70:
71 ~ 7N: Data information
100: Live makeup device
200:
500: Live make-up system or mobile terminal

Claims (10)

A method for photographing live makeup of a mobile terminal equipped with a camera,
Receiving a user image in real time;
Detecting a person area to which a beauty effect is to be applied from the user image;
Receiving person information of a person corresponding to the person area from a user and determining person information of the person;
Detecting an outline for each part of the face from the person area;
Searching for a beauty effect to be applied to each corresponding part of the data information stored in advance based on the person information, and determining the searched beauty effect;
Applying the beauty effect to each of the parts along the outline; And
Displaying the user image to which the beauty effect is applied through a display unit
A method of shooting a live makeup of a mobile terminal, comprising:
delete The method according to claim 1,
The person information includes information on sex, age, and race
A method for photographing live makeup of a mobile terminal.
The method of claim 1, wherein applying the beauty effect comprises:
Adjusting at least one of a saturation value, a brightness value, a hue value, and a sharpness value of each of the parts
Further comprising the steps of:
The method of claim 1, wherein the beauty effect comprises:
Set values for eye liner, eye color, eyelashes, eye shadow, brightness of eyes, removal of dark circles, removal of points, foundation, ball lifting, strengthening of nose, lipstick and tooth whitening
A method for photographing live makeup of a mobile terminal.
A live makeup photographing apparatus of a mobile terminal equipped with a camera,
An input unit for inputting a user image in real time;
A detecting unit detecting a person area to which a beauty effect is to be applied from the user image and detecting an outline for each part of the face from the person area;
The information processing apparatus according to any one of claims 1 to 3, further comprising: a display unit configured to receive character information of the character corresponding to the character area from a user, determine character information of the character, A determining unit for determining the beauty effect; And
A beauty effect processor for applying the beauty effect to the respective parts along the outline and displaying the user image to which the beauty effect is applied through a display unit
Wherein the mobile terminal comprises:
delete The method according to claim 6,
The person information includes information on sex, age, and race
A live makeup shooting device of a mobile terminal.
The method according to claim 6,
Wherein the beauty effect processing unit adjusts at least one of a saturation value, a brightness value, a hue value, and a sharpness value of each part
A live makeup shooting device of a mobile terminal.
7. The method of claim 6,
Set values for eye liner, eye color, eyelashes, eye shadow, brightness of eyes, removal of dark circles, removal of points, foundation, ball lifting, strengthening of nose, lipstick and tooth whitening
A live makeup shooting device of a mobile terminal.

Images