WO2019124595A1 - Method for proposing patch on basis of skin analysis result - Google Patents

Abstract

An embodiment discloses a method for proposing a patch on the basis of a skin analysis result, comprising the steps of: obtaining a primary skin image by means of a skin analyzer; analyzing the primary skin image; and transmitting the analysis result of the primary skin image to a user terminal, wherein the step of transmitting the analysis result includes transmitting information on a micro needle patch that is determined to be suitable for improving the skin, along with the analysis result of the skin image.

Description

Patch proposal method based on skin analysis result

The embodiment relates to a patch proposal method based on skin analysis results.

The skin is the largest organ of the envelope system, including skin parts such as hair, nails, hair and glands. The skin includes multiple layers of epithelial tissue that protect the lower muscles and organs. Because skin is constantly attacked by many external and internal factors, skin can become infected with many diseases. Thus, measuring skin conditions is important from a health point of view and from a cosmetic point of view.

There are many ways to measure the condition of the skin, but most methods require access to dedicated devices that are available to dermatologists or dermatologists. However, access to such physician or dedicated devices is accompanied by difficulties, inconveniences and excessive expenditure.

Therefore, there is a need for a simpler solution that allows the general user to easily grasp the condition of the skin without a dermatologist or a dedicated device provided to the dermatologist.

The embodiment provides a patch proposed method based on skin analysis results.

The problems to be solved in the embodiments are not limited to these, and the objects and effects that can be grasped from the solution means and the embodiments of the problems described below are also included.

According to an embodiment of the present invention, there is provided a patch proposal method based on a skin analysis result, comprising: acquiring a primary skin image using a skin meter; Analyzing the primary skin image; And transmitting an analysis result of the primary skin image to a user terminal, wherein the transmitting to the user terminal comprises: selecting a patch matched with the analysis result of the skin image; Together with information about the patch.

The patch may be a micro needle patch.

And detecting whether the patch is used after the step of transmitting to the user terminal.

The step of detecting whether or not the patch is used may recognize that the user uses the patch when receiving the tagging information of the patch from the user terminal.

The step of detecting whether or not the patch is used comprises the steps of: acquiring attribute information of a patch matched with the tagging information; generating a use termination timer of the patch based on the attribute information; To terminate the use of the patch.

Obtaining a secondary skin image after detecting whether the patch is used, reanalyzing the secondary skin image; And transmitting an analysis result of the secondary skin image to the user terminal, wherein the step of transmitting the analysis result of the secondary skin image to the user terminal comprises: determining skin improvement degree and reusing the currently used patch Can be determined.

If the degree of skin improvement is less than or equal to a preset reference value, use of a different kind of patch may be proposed.

The step of analyzing the primary skin image may include acquiring a plurality of skin images taken from different directions from the skin measuring device to generate a three-dimensional image, and analyzing the state of the skin using the three-dimensional image.

According to one embodiment of the present invention, an optimal micro needle patch capable of improving the skin according to the result of skin analysis is proposed, whereby a quick skin improvement effect can be obtained.

The various and advantageous advantages and effects of the present invention are not limited to the above description, and can be more easily understood in the course of describing a specific embodiment of the present invention.

1 is a conceptual view of a micro needle patch according to an embodiment of the present invention,

Fig. 2 is a view showing the microstructure of Fig. 1,

Fig. 3 is a first modification of the microstructure of Fig. 1,

FIG. 4 is a view showing a path through which the drug is injected into the skin by the microstructure of FIG. 3,

Fig. 5 is a second modification of the microstructure of Fig. 1,

6 is a perspective view of a micro needle patch according to an embodiment of the present invention,

FIG. 7 is a view showing the micro needle patch of FIG. 6 attached to the skin,

8A to 8E are views showing a method of manufacturing a micro needle patch according to an embodiment of the present invention,

FIG. 9 is a conceptual diagram of a skin measurement apparatus according to the first embodiment of the present invention,

10 is a block diagram of a skin measurement apparatus according to the first embodiment of the present invention,

11 is a front view of the skin measurement apparatus according to the first embodiment of the present invention,

12 is a side view of the skin measurement apparatus according to the first embodiment of the present invention,

FIG. 13 is a conceptual diagram of a skin measurement apparatus according to a second embodiment of the present invention,

FIG. 14 is a block diagram of a skin measurement apparatus according to a second embodiment of the present invention,

15 is a view showing a process of acquiring a distant image using a skin measurement device,

16 is a view showing a process of acquiring a close-up image using a skin measurement device,

17 is a view showing a process of generating a stereoscopic image by synthesizing a front image and a side image obtained using a skin measurement device,

18 is a conceptual diagram of a skin measurement apparatus according to a third embodiment of the present invention,

19 is a view showing a process of acquiring a stereoscopic image using a skin measurement device,

20 is a conceptual diagram of a skin measurement apparatus according to a fourth embodiment of the present invention,

21 is a view showing a skin analysis and patch proposal system according to an embodiment of the present invention,

22 is a flowchart showing a patch proposal method based on a skin analysis result according to an embodiment of the present invention,

FIG. 23 is an example of a screen displayed on a user terminal according to an embodiment of the present invention,

Fig. 24 is a modification of Fig. 22,

25 is a configuration diagram of a skin condition evaluating apparatus according to an embodiment of the present invention,

26 is a view for explaining a method of generating a skin recognizer according to an embodiment of the present invention,

FIG. 27 is a view for explaining a method of determining a skin class using a skin recognizer according to an embodiment of the present invention, and FIG.

28 is a diagram for explaining a method of generating a first vector,

29 is a flowchart illustrating a skin condition evaluation method performed by the skin condition evaluating apparatus according to an embodiment of the present invention.

The present invention is capable of various modifications and various embodiments, and specific embodiments are illustrated and described in the drawings. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

The terms including ordinal, such as second, first, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the second component may be referred to as a first component, and similarly, the first component may also be referred to as a second component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings, wherein like or corresponding elements are denoted by the same reference numerals, and redundant description thereof will be omitted.

<Micro Needle Patch>

FIG. 1 is a conceptual view of a micro needle patch according to an embodiment of the present invention, and FIG. 2 is a view showing the micro structure of FIG. 1.

Referring to FIGS. 1 and 2, a micro needle patch 100 according to an embodiment may include a base layer 110, and a needle array 120 disposed on the base layer 110.

The base layer 110 may provide mechanical strength to the needle array 120 and may have flexibility. The material of the base layer 110 is not particularly limited.

Illustratively, the base layer 110 may be formed of a material selected from the group consisting of hydrocolloid, urethane, polyethylene, polypropylene, polyvinyl chloride resin, polyethylene terephthalate (PET), nylon, epoxy, polyimide, polyester, urethane, acrylic, polycarbonate, (PVDF-co-HFP), polyvinylidenefluoride (PVDF), polyacrylonitrile, polyvinylidene fluoride, polyvinylidene fluoride, polyvinylidene fluoride, melanin, chlorinated rubber, polyvinyl alcohol, polyvinyl ester, vinylidene fluoride-hexafluoropropylene copolymer Based materials such as polymethylmethacrylate, polytetrafluoroethylene (PTFE), styrene-butadiene rubber (SBR), or ethylene-propylene-diene copolymer (EPDM) Lt; / RTI &gt;

The needle array 120 may include a matrix 122 and a plurality of microstructures 121 disposed on the matrix 122. The matrix 122 and the plurality of microstructures 121 may be integrally formed. The plurality of microstructures 121 may be finely formed to penetrate the stratum corneum and enter the skin layer. Thus, it can pass through the stratum corneum without stimulating the pain receptor.

The plurality of microstructures 121 may have various needle shapes. Illustratively, the plurality of microstructures 121 may have at least one of a cone shape, a triangular shape, a quadrangular shape, and a polygonal shape.

Illustratively, the plurality of microstructures 121 may have a triangular pyramid shape. The triangular pyramid may have a triangular bottom surface 121d and three triangular side surfaces 121a, 121b and 121c. At this time, the ratio (aspect ratio) of one side W1 to the height W2 of the bottom surface of the triangular pyramid may be 1: 0.8 to 1: 1.2. Illustratively, one side W1 of the base of the plurality of microstructures 121 may have a width of 200 mu m and a height W2 of 200 mu m. Thus, the aspect ratio can be 1: 1. According to this structure, the dicing blade can be used to densely form irregularities on the master. Therefore, the density of the plurality of microstructures 121 can be increased. The density of the plurality of microstructures 121 according to the embodiment may be 400 or more per 1 cm ^2, but is not limited thereto.

FIG. 3 is a first modification of the microstructure of FIG. 1, FIG. 4 is a view showing a path of injecting a drug into the skin by the microstructure of FIG. 3, and FIG. 5 is a cross- to be.

Referring to FIG. 3, the plurality of microstructures 121 may include a plurality of first microstructures 121-1 and a plurality of second microstructures 121-2. At this time, the height h1 of the first microstructure 121-1 may be higher than the height h2 of the second microstructure 121-2. The first microstructure 121-1 and the second microstructure 121-2 may be arranged randomly or regularly.

The height h2 of the second microstructure 121-2 may be 30% to 70% of the height h1 of the first microstructure 121-1. Illustratively, if the height of the first microstructure 121-1 is 200 占 퐉, the height of the second microstructure 121-2 may be 60 占 퐉 to 140 占 퐉.

Referring to FIG. 4, the first microstructure 121-1 is inserted deep into the skin to inject the drug, whereas the second microstructure 121-2 is inserted only near the epidermis, can do. Therefore, the first microstructure 121-1 and the second microstructure 121-2 may have different skin layers for injecting drugs. Therefore, the drug can be injected evenly into various skin layers, and the efficacy can be improved.

Illustratively, the first microstructure 121-1 is inserted into the dermal layer S2 to inject the drug, and the second microstructure 121-2 is inserted into the skin layer S1 to inject the drug. However, Is not particularly limited. Illustratively, the first microstructure 121-1 and the second microstructure 121-2 can be inserted into the skin layer S1 to inject drugs. Further, the third microstructures 121 having different heights may be additionally disposed.

Referring to FIG. 5, the second microstructure 121-2 may be disposed between two neighboring first microstructures 121-1. A first spacing 123a is formed between the second microstructure 121-2 and the first microstructure 121-1a disposed on the left side and a first spacing 123b is formed between the first microstructures 121-1b disposed on the right side. The second spacing portion 123b may be formed.

At this time, the thickness of the first spacing part 123a may be thicker than the thickness of the second spacing part 123b. That is, the thickness of the matrix 122 may be uneven in the micro needle patch 100 according to the embodiment.

The microstructure 121 according to the embodiment can be manufactured by forming a mold using a master having concave and convex portions as described later and applying the active solution to the mold. The height of the concave and convex can be adjusted by adjusting the height of the dicing blade in the process of forming the concave and convex on the master. In this process, since the dicing blade relatively cuts the master in order to form the irregularities at a low level, the thickness may become uneven.

Referring again to FIG. 1, an adhesive layer 170 and a protective film 160 may be disposed on the base layer 110. Accordingly, the user can remove the protective film 160 and use the adhesive layer 170 when the pad is used.

The adhesive layer 170 may include a variety of pressure-sensitive adhesives, such as hydrophobic adhesives, silicone adhesives, acrylic adhesives, and hydrophilic adhesives, which can adhere without damaging the skin.

The printed layer 130 and the temperature responsive layer 140 may be disposed under the base layer 110. Also, a release film 150 may be disposed on the lower surface of the temperature responsive layer 140.

The print layer 130 may be a layer on which various shapes, patterns, logos, and text are printed. The print layer 130 may be formed by screen printing on the back surface of the base layer 110.

The temperature responsive layer 140 may be a layer having a predetermined color at normal times, or may be transparent when the temperature is higher than a predetermined temperature. Illustratively, the temperature responsive layer 140 may include, but is not necessarily limited to, Zion ink.

6, when the patch is attached to the skin as shown in FIG. 7, the temperature responsive layer 140 is transparently changed due to body temperature, so that the printed layer 130 is not formed before the patch is used. Logo 141 may appear. Thus, the user can confirm that the patch is stuck to the skin.

In addition, the print layer 130 may display an attachment time guide text of the patch. By way of example, the phrase "15 minutes" may be printed on the print layer 130. In the case of a high-capacity patch, the phrase "30 minutes" may also be printed. That is, there is an effect that the user can easily recognize the attachment time of the patch by printing and displaying the attachment time according to the capacity of the patch.

8A to 8E are views showing a method of manufacturing a micro needle patch according to an embodiment of the present invention.

8A to 8E, a method of manufacturing a micro needle patch 100 according to an embodiment includes the steps of: fabricating a master 10; Fabricating the mold (20) using the master (10); Applying an active solution to the mold (20); Drying the active solution to fabricate the needle array 120; And fabricating the patch using the fabricated needle array 120.

Referring to FIG. 8A, the step of fabricating the master 10 can form the fine irregularities 11 on the mold plate 12 by using the dicing blade 5 rotating at a high speed. The dicing blade 5 may be in the form of a circular disk, but is not necessarily limited thereto. Concretely, fine irregularities can be formed by the inclined surface 5a of the dicing blade.

Referring to FIG. 8B, in the step of fabricating the mold 20 using the master 10, the mold 20 may be manufactured by filling the mold 20 on the master 10 and then hardening the mold 20. Referring to FIG. 8C, grooves 21 corresponding to the unevenness of the master may be formed in the mold 20. The material of the mold 20 is not particularly limited.

Referring to FIG. 8D, the active solution may be applied to the mold 20. The active solution may be prepared by mixing a biodegradable polymer, a surfactant mixture, and an active ingredient mixture in a solvent. The solvent may be distilled water.

The biodegradable polymer is composed of poly (lactic acid) (HA), poly (lactic acid) (PLA), polyhydroxyalkanoate (PHA), polyetheramide (PEA) but are not limited to, lactic-co-glycolic acid (PLGA), polyglycolic acid (PGA), polyvinyl alcohol (PVA), and mixtures thereof.

The surfactant mixture may include sugars such as trihalose.

In addition, the active ingredient mixture may contain various active substances. The active substances may include various herbal extracts such as chitosan, collagen, gelatin, salicylic acid, vitamin C, peptides, proteins, caffeine, stem cells, drug or cosmetic ingredients,

Among them, Lonicera japonica Thunberg belongs to the genus Caprifoliaceae. It is used as a medicine to remove the toxins from the blood and cool the heat in Oriental medicine. It is used as a detoxifying and anti-inflammatory drug. It has strong anti- It is applied to fever due to illness and cold, and to swelling of the surgeon. Thus, the microneedle patch containing gingival component can exert a very good effect on the skin.

Thereafter, the needle array 120 can be manufactured by drying the active solution. The needle array 120 may comprise 85 to 99 parts by weight of hyaluronic acid, 0.5 to 1.5 parts by weight of a surfactant, 0.5 to 2.5 parts by weight of collagen, and 0.1 to 15 parts by weight of an active ingredient composite, have. The active ingredient complex may include gold silver.

At this time, hyaluronic acid may include polymer hyaluronic acid and low molecular hyaluronic acid. At this time, the polymer hyaluronic acid has a molecular weight of more than 10,000 Da and less than 25,000 Da, and a low molecular weight hyaluronic acid may have a molecular weight of more than 100 Da and less than 10,000 Da.

According to the embodiment, since the polymer hyaluronic acid and the low molecular weight hyaluronic acid are mixed, when inserting into the skin, the low molecular weight hyaluronic acid is dissolved first, the active substance is rapidly injected, and the polymer hyaluronic acid is relatively slowly dissolved so that the drug efficacy can be maintained .

Referring to FIG. 8E, a patch can be manufactured using the manufactured needle array 120. In the embodiment, the patch array using the needle array 120 is illustrated, but the application of the needle array 120 is not limited thereto. Illustratively, the needle array 120 can be applied to a variety of cosmetic products, such as mask sheets. It can also be applied to medicinal products depending on the contained components.

<Skin measuring device>

FIG. 9 is a conceptual diagram of a skin measurement apparatus according to a first embodiment of the present invention, and FIG. 10 is a block diagram of a skin measurement apparatus according to the first embodiment of the present invention.

In the present invention, 'skin' is a tissue of a human body constituting the surface of a human body, and may be an object to be determined for an attribute value or a grade. The skin may be the skin of the face or the skin of various parts of the human body. Hereinafter, for convenience of explanation, it is assumed that the skin is the skin of the face.

Referring to FIGS. 9 and 10, a skin measurement apparatus according to an embodiment of the present invention includes a body 210, an image sensor 221 disposed on the body 210 for photographing a user's skin, A temperature sensor 222 for measuring the temperature, a distance adjusting device 223 disposed on the body 210 and capable of adjusting an appropriate distance to the image sensor 221; And a control unit 230 communicating with the image sensor 221 and the temperature sensor 222. [

The body 210 may be made of a plastic material and / or a metal material. The body 210 may be formed in the form of a water droplet or an egg so as to improve the grip feeling of the user. However, the shape of the body 210 is not limited thereto, and various shapes can be applied.

The image sensor 221 can acquire the skin image of the user. The image sensor 221 may be a concept that includes a camera module, but is not necessarily limited thereto.

The temperature sensor 222 can measure the skin temperature of the user. For example, the temperature sensor 222 may be an infrared sensor, but not limited thereto, and various sensors capable of sensing temperature may be selected.

The control unit 230 may operate the alarm unit 224 to alert the user if the temperature of the user sensed by the temperature sensor 222 exceeds a predetermined threshold value. Illustratively, when the temperature of the measurement object is higher than 38 degrees, red light can be output. Therefore, the user can easily recognize that the row of the measurement object is high.

The alarm unit 224 may be an LED disposed inside the body 210. The memory 226 may store preset threshold information. Also, the usage history of the user may be stored.

The control unit 230 may include any kind of device capable of processing data, such as a processor. Herein, the term &quot; processor &quot; may refer to a data processing apparatus embedded in hardware, for example, having a circuit physically structured to perform a function represented by a code or an instruction contained in the program.

As an example of the data processing apparatus built in hardware, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, an ASIC (Application-Specific Integrated Circuit, and an FPGA (Field Programmable Gate Array), but the scope of the present invention is not limited thereto.

The user can adjust the appropriate distance to the skin measuring device by using the distance adjusting device 223. Illustratively, the distance adjustment device 223 may be a distance sensor or a mirror. The user can stretch his arms and separate the skin measuring device to the mirror where he can see all his faces. Therefore, the distance between the user and the skin measuring device can be adjusted according to the size of the mirror.

The control unit 230 operates the wake-up mode to check each sensor when the power switch 215 is turned on and drives the image sensor 221 when the skin image measurement signal is received from the client through the communication unit 225 To obtain a skin image. The acquired image can be transmitted to the client through the communication unit 225. The client may be a user terminal, but is not limited thereto and may include various devices capable of communicating with the skin measurement device.

FIG. 11 is a front view of a skin measurement apparatus according to a first embodiment of the present invention, and FIG. 12 is a side view of a skin measurement apparatus according to the first embodiment of the present invention.

11 and 12, the body 210 may have a convex shape in a direction (width direction) perpendicular to the longitudinal direction. That is, the body 210 may include a first region 211 having a larger cross-sectional area in the longitudinal direction and a second region 212 having a smaller cross-sectional area in the longitudinal direction. The first region 211 may be disposed at an upper portion of the second region 212. The height of the first region 211 may be greater than the height of the second region 212. In addition, the width of the front surface of Fig. 11 may be smaller than the side width of Fig. This shape can improve the grip of the user.

The first area 211 may have a concave surface 213 formed by cutting-out a part of the area. The concave surface 213 may have a curvature. The image sensor 221, the temperature sensor 222, and the distance adjuster 223 may be disposed on the concave surface 213.

The concave surface 213 may include a third region 213a having a larger width in the longitudinal direction and a fourth region 213b having a smaller width in the longitudinal direction. The distance adjusting device 223 may be disposed at the uppermost position of the concave surface 213. At this time, the area of the concave surface 213 and the area of the distance adjusting device 223 can satisfy 1: 0.2 to 1: 0.6. If the area is smaller than 1: 0.2, the area of the distance adjusting device 223 becomes small, and the entire face of the user may not be seen. Also, when the area is larger than 1: 0.6, the area occupied by the distance adjusting device 223 becomes large, so that the mounting space of other sensors can be narrowed.

FIG. 13 is a conceptual diagram of a skin measurement apparatus according to a second embodiment of the present invention, FIG. 14 is a block diagram of a skin measurement apparatus according to a second embodiment of the present invention, FIG. FIG. 16 is a view showing a process of acquiring a side image using the skin measurement device, FIG. 17 is a view illustrating a process of synthesizing a front image and a side image acquired using the skin measurement device, FIG.

13 and 14, the skin measurement apparatus according to the embodiment includes a control unit 230, an image sensor 221, a temperature sensor 222, a first light source 241, a second light source 247, A brightness sensor 246, a communication unit 225, a distance control unit 244 (hereinafter, referred to as a distance sensor), and a power source unit 227. [

The image sensor 221 can acquire the skin image of the user. The image sensor 221 may be a camera module, but is not limited thereto.

The temperature sensor 222 can measure the skin temperature of the user. For example, the temperature sensor 222 may be an infrared sensor, but not limited thereto, and various sensors capable of sensing temperature may be selected.

The illuminance sensor 246 can measure the external illuminance. Therefore, the controller 230 may calculate the necessary illuminance using the external illuminance information, and then control the first light source 241 and the second light source 247 to provide only necessary illuminance.

The first light source 241 may illuminate the light toward the front of the user so that the image sensor 221 may obtain a frontal image of the user. Thus, the first light source 241 may be disposed closer to the image sensor 221 than the second light source 247. Referring to FIG. 15, the user can acquire a frontal image using the image sensor 221 while illuminating the first light source 241. FIG. At this time, the front image may be a distant image photographed at a predetermined distance.

When the user selects the long distance shooting mode, the control unit 230 detects the distance to the user using the distance sensor 244, and can alarm through the alarm unit 224 when the distance exceeds a predetermined distance. For example, you can alarm red light when the distance is out, and green light when you are within range.

The controller 230 drives the first light source 241 and the image sensor 221 to determine the distance to the user from the distance information of the distance adjusting device 223 Can be obtained.

Referring to FIG. 16, the second light source 247 may be used when the user obtains a proximity image (or a tilted image). At this time, the optical axis of the second light source 247 may be arranged to intersect the optical axis of the first light source 241 at a predetermined angle? 1. When the light emitted from the first light source 241 is defined as parallel light, the light emitted from the second light source 247 may be oblique light. Therefore, the user can acquire a close-up image by arranging the skin measurement device near the face and then photographing it.

When the user selects the short-distance shooting mode, the control unit 230 detects the distance to the user by using the distance sensor 244, and can alarm through the alarm unit 224 when the distance exceeds a predetermined distance.

Thereafter, if it is determined that the user adjusts the distance and is located within an appropriate distance, the controller 230 may drive the second light source 247 and the image sensor 221 to acquire a proximity image.

At this time, the controller 230 may generate a stereoscopic image as shown in FIG. 17C by synthesizing a front image as shown in FIG. 17A and a gradient image as shown in FIG. 17B. Such stereoscopic images of the skin can be used as data for determining the roughness of the skin and the like.

When the user selects the stereoscopic image shooting mode, the controller 230 detects the distance to the user by using the distance sensor 244, and when the distance exceeds the predetermined first distance, the controller 230 alerts the user through the alarm unit 224 .

Thereafter, when the user adjusts the distance and enters the first distance, the controller 230 may drive the first light source 241 and the image sensor 221 to obtain a front skin image.

Thereafter, the control unit 230 detects the distance to the user again by using the distance sensor 244, and can alarm through the alarm unit 224 when the distance exceeds the predetermined second distance.

Thereafter, when the user determines that the second distance is maintained by adjusting the distance, the controller 230 may drive the second light source 247 and the image sensor 221 to acquire the skin image at an inclined angle. At this time, the control unit 230 may output a control signal to the alarm unit 224 to alert the user if the first distance and the second distance are determined to be maintained.

Then, the control unit 230 can transmit the two skin images taken at different angles to the server. However, the present invention is not limited thereto, and the controller 230 of the skin measurement apparatus may synthesize two skin images to generate a stereoscopic image.

FIG. 18 is a conceptual diagram of a skin measurement apparatus according to a third embodiment of the present invention, and FIG. 19 is a view showing a process of acquiring a stereoscopic image using a skin measurement apparatus.

18, the skin measurement apparatus according to the embodiment includes a first image sensor 251, a temperature sensor 222, a light source 253, an illuminance sensor 246, and a second image sensor 252, (248). &Lt; / RTI &gt; The first image sensor 251 and the second image sensor 252 can serve as a dual camera. At this time, the first image sensor 251 and the second image sensor 252 need to be spaced apart at appropriate intervals.

The first image sensor 251 may acquire a first skin image and the second image sensor 252 may acquire a second skin image. Therefore, two skin images can be synthesized to form a three-dimensional image.

20 is a conceptual diagram of a skin measurement apparatus according to a fourth embodiment of the present invention.

20, the skin measurement apparatus according to the embodiment includes an image sensor 221, a plurality of filters 263, 264, 265, and 266 disposed in the image sensor 221, and a rotation unit 261 ).

The plurality of filters may include a first filter 263 in which a general lens is disposed, a second filter 264 in which a convex lens is disposed, an infrared filter 265, and a wood lamp filter 266.

The first filter 263 can function as a long distance lens by disposing a general lens. Accordingly, the user can place the first filter at the top of the image sensor 221 when he / she wants to photograph a long-distance image.

The second filter 264 is provided with a convex lens and can function as a near-field lens. Therefore, the user can place the second filter at the top of the image sensor 221 when he wants to shoot a close-up image.

The third filter 265 may be provided with an infrared filter to serve as the temperature sensor 222. Therefore, the user can place the third filter at the top of the image sensor 221 when the temperature is to be measured.

The fourth filter (266) is provided with a filter for the wood lamp, so that moisture of the skin can be measured. Wood lamps are lamps that can irradiate the skin with ultraviolet rays of 365 nm or more and measure skin condition with reflected light. The wood lamp filter may be a band-pass filter transmitting ultraviolet rays of 365 nm or more. If necessary UV-A ultraviolet LEDs may be further arranged.

The rotation unit 261 may be connected to the first to fourth filters 263, 264, 265, and 266. Therefore, the desired filter can be disposed on the image sensor 221 by rotating the rotating portion 261. [ The rotation unit 261 illustrated in the manual mode for directly rotating the user may be implemented in a fully automatic mode for selecting a desired filter.

<Skin analysis and patch proposal system>

21 is a view showing a skin analysis and patch proposal system according to an embodiment of the present invention.

In the present invention, the term 'patch' may be a term encompassing various kinds of beauty products that can be attached to the user's skin. Illustratively, the patch may be a concept that includes both a mask pack, various pads attached to the skin, cosmetic articles, massage packs, micro needle patches, and the like. It may also be a concept that includes both beauty and medical supplies. Hereinafter, a micro needle patch will be described as an example for convenience of explanation.

In the present invention, the term 'skin property' may mean various factors that are essential for evaluating the skin. For example, the properties of the skin may mean any one of the degree of flushing of the skin, the degree of wrinkling of the skin, and the flatness of the skin.

At this time, the degree of redness of the skin means that the skin is reddish, and the more reddish the skin, the higher the degree of redness. The degree of redness of the skin can have meaning as an element to judge the color of the skin.

The degree of wrinkling of the skin may mean the degree to which the skin folds finely due to a decrease in elasticity of the skin. At this time, the degree of the wrinkles of the skin is high, which may mean that the area of the skin folded finely is large or the degree of folded finely is large.

On the other hand, the flatness of the skin may mean the roughness of the skin due to factors other than the bending due to the wrinkles of the skin. For example, the flatness of the skin may mean the roughness of the skin due to the pores, or the degree of ruggedness of the skin due to scratches, dots, scars, etc. in a specific area.

However, the above-mentioned attributes of the skin are merely illustrative, and the spirit of the present invention is not limited thereto. It is obvious that the skin can be used as an attribute of the skin of the present invention if it can represent the state of the skin.

In the present invention, the 'grade of skin' may be a value determined according to the necessity of management of the skin based on the above-mentioned property of the skin. Grades are, for example, four grades, which may include a zero grade that requires no special care, a first grade that requires general care, a second grade that requires professional care, and a third grade that is urgently needed. However, such classification of grades is exemplary and skin can be classified into more or less grades. At this time, the grade of the skin can be calculated by taking into consideration the above-mentioned properties of the skin in various ways.

In the present invention, the user terminal 400 may refer to various devices capable of receiving attribute values or skin ratings of the skin from the server 300. The user terminal 400 may be a portable terminal or a personal computer.

The user terminal 400 may include display means for displaying contents or the like, and input means for obtaining a user's input on the contents. At this time, the input means and the display means can be configured in various ways. For example, the input means may include, but is not limited to, a keyboard, a mouse, a trackball, a microphone, a button, a touch panel,

The user terminal 400 may transmit the tagging information of the micro needle patch 100 (hereinafter referred to as a patch) to the server 300. The patch 100 is equipped with a wireless communication chip 101 such as an NFC and can perform short-range communication with the user terminal 400. [

The server 300 receives the image of the skin to know the property value or the rating from the skin measurement device 200, and can determine an attribute value or a rating of the skin.

The skin measurement device 200 may acquire a user's skin image and transmit the skin image to the server 300. The skin measurement device 200 may transmit the skin image acquired by the skin measurement device 200 to the user terminal 40 and / or the server 300 in real time in cooperation with the user terminal 400.

FIG. 22 is a flowchart showing a patch suggestion method based on a skin analysis result according to an embodiment of the present invention.

Referring to FIG. 22, a patch proposal method based on a skin analysis result according to an embodiment includes a step of obtaining and transmitting a primary skin image using the skin measurement device 200 (S101), analyzing a primary skin image Step S102, and transmitting the analysis result of the primary skin image to the user terminal 400 (S103).

The step of acquiring and transmitting the primary skin image using the skin measurement device (S101) may be applied to the method of acquiring the skin image using the skin measurement device 200 described with reference to FIGS. The skin image may be at least one of a distant image, a frontal image, a close-up image, a tilted image, or a stereoscopic image.

In the step of analyzing the primary skin image (S102), the server 300 may analyze the skin condition using the skin image received from the skin measurement device 200. [ Specific methods for analyzing the skin condition will be described later.

The step S103 of transmitting the information to the user terminal 400 can transmit the information about the patch 100 determined to be suitable for skin improvement together with the result of analysis by the server 300. [

The server 300 can select the patch 100 that is determined to be most suitable for skin improvement as a result of analyzing the condition of the skin. Specifically, the server 300 can tabulate and store a list of usable patches 100 according to the extent of skin damage. Accordingly, when the skin level and the attribute are determined, the patch 100 most matching with the skin level and attribute can be selected.

Referring to FIG. 23, the server 300 may suggest information (740) of a usable patch together with a skin analysis result of the user. The user can be informed of his / her skin condition and available patch information by using the information output to the user terminal 400.

In addition to the patch 100 information, additional information 750 may also be provided. For example, cosmetic information or a dermatology hospital may be recommended.

Referring again to FIG. 22, after using the guided patch 100, the user can again measure the skin condition. The skin measurement device 200 can be used to acquire at least one of a long distance image, a frontal image, a close-up image, a tilted image, or a stereoscopic image in the same manner as the previously measured method. The skin measurement apparatus 200 may transmit the obtained secondary skin image to the server 300 (S104).

The server 300 may analyze the secondary skin image (S105). The server 300 can evaluate the degree of improvement of the secondary skin image. That is, if it is determined that the analysis result of the secondary skin image is improved based on the analysis result of the primary skin image, it can be determined that the patch 100 currently in use is effective. Therefore, it may be suggested to use the patch regularly at the same time as outputting the improved skin analysis result.

However, if the skin analysis results are not improved or deteriorated even after using the patch 100, the server 300 may suggest the next succeeding patch 100 in the list. Or if there is a user of the same pattern as the result of learning, the user may suggest a skin improved patch.

Fig. 24 is a modification of Fig. 22. Fig.

Referring to FIG. 24, the process of the server 300 analyzing the primary skin image and recommending the patch 100 to the user terminal 400 may be the same as described above.

When the user uses the recommended patch 100, the user terminal 400 may transmit the tagging information to the server 300 when the patch 100 is tagged on the user terminal 400 (S204). As described above, the patch 100 can communicate with the user terminal 400 by attaching the NFC.

The server 300 may extract information such as the manufacture date, the used capacity, and the usage time of the currently used patch 100 in the database using the tagging information and generate a timer (S205). The timer can be set as long as the use time of the patch 100 is used.

If the server 300 determines that the timer has expired, the server 300 may output an end-of-use alarm to remove the patch 100 from the user terminal 400 (S207). Thus, the user can attach the patch 100 for an accurate time.

Thereafter, the user can measure the skin condition using the skin measuring device again after a predetermined time has elapsed. The server 300 can evaluate the degree of improvement of the secondary skin image (S209). That is, if it is determined that the analysis result of the secondary skin image is improved based on the analysis result of the primary skin image, it can be determined that the patch 100 currently in use is effective. Accordingly, it is possible to propose using the patch periodically at the same time as outputting the improved skin analysis result (S210).

FIG. 25 is a configuration diagram of a skin condition evaluating apparatus according to an embodiment of the present invention, and FIG. 26 is a diagram for explaining a method of generating a skin recognizer according to an embodiment of the present invention.

Referring to FIG. 25, the server 300 may include a skin condition evaluation device 301. FIG. However, the present invention is not limited thereto, and the skin condition evaluating apparatus 301 may be provided in the skin measuring apparatus 200 or may be provided in the user terminal 400. [ Hereinafter, the skin condition evaluating device of the server analyzes the skin image to determine the skin condition.

The skin condition evaluating apparatus 301 may include a communication unit 303, a control unit 304, and a memory 302. [ Also, although not shown in the drawing, the skin condition evaluating apparatus 301 according to an embodiment of the present invention may further include an input / output unit, a program storage unit, and the like.

26, the controller 304 of the skin condition evaluating apparatus 301 according to an exemplary embodiment of the present invention includes one or more training skin members 331 and 332 for generating the first skin recognizer 331 and the second skin recognizer 332, An image 310 may be obtained from the user terminal 400 and / or the skin measurement device 200.

At this time, the training skin image 310 may have an attribute value for at least one attribute and a rating of the skin. In other words, the training skin image 310 is an image for the skin that already has its attribute value and rating, and may be the information used for the generation and / or training of the skin recognizer.

For example, in the case of the first training skin image 311, the attribute value 312 including the flushing degree, wrinkle degree and flatness of the skin image 311 and the skin grade 313 may be marked. In this case, the degree of flushing, the degree of wrinkling and the degree of flatness, respectively, may be numerical values indicating the strength of each property such as 0.1 and 0.8. Also, the skin may have a grade of 'first class' or 'third class' and one of the above four classes.

In addition to the attribute values for the three attributes described above, the attribute value 312 may include attribute values for skin age (for example, skin age 30 years), sex (male), race (for example, Asian), disease As shown in FIG. However, the present invention is not limited thereto.

The control unit 304 according to an embodiment of the present invention may acquire the training skin image 310 from the skin measurement device 200 or may acquire the training skin image 310 from the memory 302 of the skin condition evaluation device 301 have. For example, the control unit 304 may acquire a training skin image 310 from a medical history stored in a server of a specific dermatologist. At this time, the medical history stored in the dermatology server may be written by an expert (for example, a dermatologist). In other words, the training skin image 310 may be based on data that an expert has evaluated the skin. In addition, the control unit 304 may acquire the training skin image 310 from a history in which an attribute value or a rating of another skin image has been determined in the past.

The controller 304 according to an embodiment of the present invention may generate a first feature vector from each of the training skin images 310 obtained by the above-described process. For example, the control unit 304 may generate the first feature vector 321 from the first training skin image 311. At this time, the control unit 304 may generate the first feature vector 321 based on the image analysis on the skin image 311. [

For example, the control unit 304 can recognize the face region in the skin image 311 for more accurate evaluation of the skin condition, and will be described with reference to FIG. The control unit 304 can determine the face area in the image 510 by using the recognition method of contour ratio and the recognition method of contour.

The control unit 304 can generate the first feature vector 520 based on the image 511 corresponding to the recognized face area. In other words, the control unit 304 can generate the first feature vector 520 only from the image 511, which is the object of the state evaluation, except for the region not subject to the state evaluation in the skin image 510. [ Thus, the present invention can exclude the elements of inaccuracy of skin condition evaluation according to the acquisition state or method of image.

On the other hand, the controller 304 may generate the first feature vector by considering the physical quantity of at least one physical quantity of the skin or the environment in which the skin is exposed in the generation of the first feature vector.

Images only contain visual information. Thus, from the image, it may be difficult to obtain the rest of the information other than the visual information about the skin (for example, the elasticity of the skin, the moisture content of the skin, the thickness of the skin, the thickness of the makeup painted on the skin, etc.). The controller 304 according to an embodiment of the present invention may generate the first feature vector by considering at least one physical quantity of the skin in generating the first feature vector. The moisture information of the skin can be obtained illustratively from the skin measuring device according to the embodiment.

Also, the result may be different depending on the acquisition environment. For example, when an image is acquired under a lighting condition of a specific color, the color of the skin on the image may be different from the color of the original skin. The controller 304 may generate the first feature vector by considering the physical quantity of the environment in which the skin is exposed in the generation of the first feature vector.

Meanwhile, one or more physical quantities for the skin or physical quantities for the environment in which the skin is exposed may be acquired and transmitted by the skin measurement device 200 and / or the user terminal 400 described above.

Thus, the present invention can evaluate the condition of the skin more accurately in consideration of various environmental factors.

Referring again to FIG. 26, the controller 304 according to an embodiment of the present invention calculates the attribute value (s) of at least one attribute of the first feature vector 321 and the training skin image 311 generated by the above- It is possible to update the first skin recognizer 331 based on the first skin recognizer 331. The attribute value 312 for at least one attribute of the skin may be in the form of a second feature vector 322. In other words, the training skin image 311 may be marked with a second feature vector 322 corresponding to an attribute value 312 for at least one attribute of the skin. Such a second feature vector 322 may be generated through a separate transformation process on the attribute value 312 for at least one attribute of the skin.

As described above, the first skin recognizer 331 includes a first feature vector corresponding to each of a plurality of images of the skin, generated by a machine learning technique, and a second feature vector corresponding to one or more attribute values of each of the plurality of skin The correlation between the second feature vectors, i.e., the mapping information of both of them.

The control unit 304 according to an embodiment of the present invention includes the first feature vector 321 generated by the above process and the attribute value 312 (i.e., the second feature vector 322) for at least one attribute of the skin, The first skin recognizer 331 can be updated in such a manner that the data set of the first skin recognizer 331 is updated so that the first skin recognizer 331 can correspond to each other. When the data set of the first skin recognizer 331 is composed of a plurality of coefficients as shown in FIG. 26, the control unit 304 controls the first feature vector 321 and the second feature vector 322, The first skin recognizer 331 can adjust the coefficients constituting the first skin recognizer 331 based on

The control unit 304 repeatedly generates a first feature vector from a plurality of training skin images, repeatedly obtains an attribute value (i.e., a second feature vector) for at least one attribute of the skin, It is possible to acquire the first skin recognizer 331 that provides more accurate skin attribute values.

The controller 304 according to an embodiment of the present invention then updates the second skin recognizer 332 based on the second feature vector 322 and the skin grade 313 included in the training skin image information, can do. The skin grade 313 may then be in the form of a third feature vector 323. In other words, the training skin image 311 may be marked with a third feature vector 323 corresponding to the skin level. The third feature vector 323 may also be generated through a separate conversion process for the skin class 313.

As described above, the second skin recognizer 332 also includes a second feature vector corresponding to one or more attribute values of each of the plurality of skin generated by the machine learning technique, and a second feature vector corresponding to the class of each of the plurality of skin The correlation between the three feature vectors, that is, the mapping information of the two.

The control unit 304 according to an embodiment of the present invention may be configured such that the second feature vector 322 and the skin class 313 (i.e., the third feature vector 323) The second skin recognizer 332 can be updated in such a manner that the data set of the recognizer 332 is updated. When the data set of the second skin recognizer 332 is composed of a plurality of coefficients as shown in Fig. 26, the control unit 304 controls the second feature vector 322 and the third feature vector 323, And adjusts the coefficients constituting the second skin recognizer 332 based on the second skin recognizer 332. [

The control unit 304 can acquire the second skin recognizer 332 that repeatedly obtains the second feature vector and the third feature vector and repeatedly updates the coefficients based thereon to provide a more accurate skin rating .

Thus, the present invention can obtain a first skin recognizer 331 that provides attribute values with high accuracy and a second skin recognizer 332 that provides a high accuracy rating.

&Lt; Method of determining the property value of skin and the degree of skin &

In the above, a method of generating skin recognizers 331 and 332 by the skin condition evaluating apparatus 301 has been described with reference to Fig. Hereinafter, a method for determining the attribute values and the grades of the skin to be evaluated will be described with reference to FIG. 27, which is the skin condition evaluating apparatus 301 generated by the above-described process.

Hereinafter, it is assumed that the skin recognizers 331 and 332 are generated by the skin condition evaluating device 301 by the above-described process.

FIG. 27 illustrates a method of determining the attribute value and the grade of the skin to be evaluated by the skin condition evaluator 301 according to an embodiment of the present invention using the skin recognizers 331 and 332. FIG.

Referring to FIG. 27, the controller 304 of the skin condition evaluating apparatus 301 according to an embodiment of the present invention can receive the skin image 411 of the skin to be evaluated.

At this time, the control unit 304 may receive the skin image 411 from the user terminal 400 or may receive the skin image 411 from the skin measurement device 200.

The control unit 304 according to an embodiment of the present invention may generate the first feature vector 421 for the skin image 411. [ As described in Fig. 26, the control unit 304 can generate the first feature vector based on the image analysis on the skin image 411. Fig. For example, the control unit 304 can recognize the face region in the skin image 411 for more accurate evaluation of the skin condition, and will be described with reference to FIG. The control unit 304 can determine the face area in the image 510 by using the recognition method of contour ratio and the recognition method of contour. The control unit 304 can generate the first feature vector 520 based on the image 511 corresponding to the recognized face area. In other words, the control unit 304 can generate the first feature vector 520 only from the image 511, which is the object of the state evaluation, except for the region not subject to the state evaluation in the skin image 510. [ Thus, the present invention can exclude the elements of inaccuracy of skin condition evaluation according to the acquisition state or method of image.

On the other hand, the controller 304 may generate the first feature vector by considering the physical quantity of at least one physical quantity of the skin or the environment in which the skin is exposed in the generation of the first feature vector.

Images only contain visual information. Thus, from the image, it may be difficult to obtain the rest of the information other than the visual information about the skin (for example, the elasticity of the skin, the moisture content of the skin, the thickness of the skin, the thickness of the makeup painted on the skin, etc.). The controller 304 according to an embodiment of the present invention may generate the first feature vector by considering at least one physical quantity of the skin in generating the first feature vector.

Also, the result may be different depending on the acquisition environment. For example, when an image is acquired under a lighting condition of a specific color, the color of the skin on the image may be different from the color of the original skin. The controller 304 may generate the first feature vector by considering the physical quantity of the environment in which the skin is exposed in the generation of the first feature vector.

Meanwhile, one or more physical quantities for the skin or physical quantities for the environment in which the skin is exposed may be acquired and transmitted by the skin measurement device 200 and / or the user terminal 400 described above.

Thus, the present invention can evaluate the condition of the skin more accurately in consideration of various environmental factors.

The control unit 304 according to an embodiment of the present invention generates a second feature vector 422 corresponding to an attribute value of at least one attribute of the skin based on the first feature vector 421 and the first skin recognizer 331 Can be determined.

As described above, the first skin recognizer 331 includes a first feature vector corresponding to each of a plurality of images of the skin, generated by a machine learning technique, and a second feature vector corresponding to one or more attribute values of each of the plurality of skin The correlation between the second feature vectors, i.e., the mapping information of both of them.

The controller 304 according to an embodiment of the present invention inputs the first feature vector 421 generated from the skin image 411 to the first skin recognizer 331 and outputs the second feature vector 422 as the output result, Can be obtained. Wherein the second feature vector 422 may comprise a vector component corresponding to each of at least one attribute of the skin. For example, the second feature vector 422 may include two vector components corresponding to the flushing degree of the skin, six vector components corresponding to the degree of skin wrinkles, and three vector components corresponding to the flatness of the skin have.

Thus, the present invention can obtain an attribute value for one or more attributes of the skin from the skin image 411. At this time, the attribute value itself can not only have a meaning as an index indicating the state of the skin, but also can have a meaning as a basis for determining the skin's level.

The controller 304 may then determine the skin's rating based on the second feature vector 422 and the second skin recognizer 332. [

As described above, the second skin recognizer 332 includes a second feature vector corresponding to one or more attribute values of each of the plurality of skin generated by the Machine Learning technique, and a second feature vector corresponding to the class of each of the plurality of skin The correlation between the three feature vectors, that is, the mapping information of the two.

Therefore, the control unit 304 according to the embodiment of the present invention inputs the second feature vector 422 obtained by the above-described process to the second skin recognizer 332, and outputs the third feature vector 431 as the output result Can be obtained. At this time, the third feature vector 431 may have a meaning as a vector representing the skin's level. Of course, the third feature vector 431 may include a skin component and a corresponding vector component.

Thus, the present invention can confirm the attribute value of each attribute of the skin and determine the objective rating of the skin on the basis thereof.

The control unit 304 according to an embodiment of the present invention may provide at least a part of the information corresponding to the second feature vector and the third feature vector determined by the above process to the user terminal 400. [ At this time, the information corresponding to the second feature vector may be an attribute value for each attribute of the skin. Further, the information corresponding to the third characteristic vector may be an evaluation value of the skin.

In an alternative embodiment, the control unit 304 may provide at least some of the information corresponding to the second feature vector and the third feature vector determined by the above-described procedure to the skin-measurement device 200. [

In this case, the information corresponding to the third feature vector, i.e., the evaluation level of the skin, may have a meaning as an overall state of the skin, and the information corresponding to the second feature vector, It can have meaning as individual information that tells you what part of the treatment needs improvement.

In addition, the control unit 304 according to an embodiment of the present invention determines a recommendation management product (micro needle patch) based on the attribute values and the skin class of each attribute of the above-described skin, . Thus, the present invention can integrally provide a state solution based on each state in addition to the state analysis of the skin.

On the other hand, the control unit 304 receives the user's selection information on the recommended management product provided to the user terminal 400 by the above-described process, and based on the selection information of the user, And transmit the rating to a third server (not shown). At this time, the third server (not shown) may be the server of the management subject of the recommended management product.

29 is a flowchart for explaining a skin condition evaluation method performed by the skin condition evaluation apparatus 301 according to an embodiment of the present invention.

Hereinafter, it is assumed that the skin recognizers 331 and 332 are generated by the skin condition evaluating device 301 by the above-described process. In other words, it is assumed that the first skin recognizer 331 and the second skin recognizer 332 are trained by the skin condition evaluating device 301 in accordance with S61 and S62.

The skin condition evaluating apparatus 301 according to an embodiment of the present invention can receive the skin image of the evaluation target skin (S63)

27, the skin condition evaluating apparatus 301 may receive the skin image 411 from the user terminal 400, receive the skin image 411 from the skin measurement apparatus 200 have.

The skin condition evaluating apparatus 301 according to an embodiment of the present invention may generate a first feature vector 421 for the skin image 411. [ As described in Fig. 26, the skin condition evaluating apparatus 301 can generate the first feature vector based on the image analysis on the skin image 411. Fig.

The skin condition evaluating apparatus 301 may generate the first feature vector by considering the physical quantity of at least one physical quantity of the skin or the environment in which the skin is exposed in the generation of the first feature vector.

Images only contain visual information. Thus, from the image, it may be difficult to obtain the rest of the information other than the visual information about the skin (for example, the elasticity of the skin, the moisture content of the skin, the thickness of the skin, the thickness of the makeup painted on the skin, etc.). The skin condition evaluating apparatus 301 according to an embodiment of the present invention may generate the first feature vector by considering at least one physical quantity of the skin in generating the first feature vector.

Also, the result may be different depending on the acquisition environment. For example, when an image is acquired under a lighting condition of a specific color, the color of the skin on the image may be different from the color of the original skin. The skin condition evaluating apparatus 301 according to an embodiment of the present invention may generate the first feature vector considering the physical quantity of the skin exposed environment in generating the first feature vector.

Meanwhile, one or more physical quantities for the skin or physical quantities for the environment in which the skin is exposed may be acquired and transmitted by the skin measurement device 200 and / or the user terminal 400 described above.

Thus, the present invention can evaluate the condition of the skin more accurately in consideration of various environmental factors.

Next, the skin condition evaluating apparatus 301 according to an embodiment of the present invention calculates a skin condition based on the first feature vector 421 and the first skin recognizer 331, based on the attribute values of at least one attribute of the skin, The feature vector 422 can be determined (S65)

As described above, the first skin recognizer 331 includes a first feature vector corresponding to each of a plurality of images of the skin, generated by a machine learning technique, and a second feature vector corresponding to one or more attribute values of each of the plurality of skin The correlation between the second feature vectors, i.e., the mapping information of both of them.

Therefore, the skin condition evaluating apparatus 301 according to an embodiment of the present invention inputs the first feature vector 421 generated from the skin image 411 to the first skin recognizer 331, Gt; 422 &lt; / RTI &gt; Wherein the second feature vector 422 may comprise a vector component corresponding to each of at least one attribute of the skin. For example, the second feature vector 422 may include two vector components corresponding to the flushing degree of the skin, six vector components corresponding to the degree of skin wrinkles, and three vector components corresponding to the flatness of the skin have. Thus, the present invention can obtain an attribute value for one or more skin attributes from a skin image. At this time, the attribute value itself can not only have the meaning as an index indicating the state of the skin, but also can have a meaning as a basis for determining the skin's level.

The skin condition evaluating apparatus 301 according to an embodiment of the present invention can determine the skin level based on the second feature vector 422 and the second skin recognizer 332. (S66)

As described above, the second skin recognizer 332 includes a second feature vector corresponding to one or more attribute values of each of the plurality of skin generated by the Machine Learning technique, and a second feature vector corresponding to the class of each of the plurality of skin The correlation between the three feature vectors, that is, the mapping information of the two.

Therefore, the skin condition evaluating apparatus 301 according to an embodiment of the present invention inputs the second feature vector 422 obtained by the above-described procedure to the second skin recognizer 332 and outputs the third feature vector 422 431). At this time, the third feature vector 431 may have a meaning as a vector representing the skin's level. Of course, the third feature vector 431 may include a skin component and a corresponding vector component.

Thus, the present invention confirms the attribute value of each attribute of the skin, and based on this, an objective rating of the skin is determined so that appropriate measures can be taken for the skin.

The skin condition evaluating apparatus 301 according to an embodiment of the present invention may provide at least a part of the information corresponding to each of the second feature vector and the third feature vector determined by the above described procedure to the user terminal 400 (S67) At this time, the information corresponding to the second feature vector may be an attribute value for each attribute of the skin. Further, the information corresponding to the third characteristic vector may be an evaluation value of the skin.

In an alternative embodiment, the skin condition evaluating apparatus 301 may provide at least part of the information corresponding to each of the second feature vector and the third feature vector determined by the above-described procedure to the skin-

In this case, the information corresponding to the third feature vector, i.e., the evaluation level of the skin, may have a meaning as an overall state of the skin, and the information corresponding to the second feature vector, It can have meaning as individual information that tells you what part of the treatment needs improvement.

In addition, the skin condition evaluating apparatus 110 according to an embodiment of the present invention determines a recommendation management product on the basis of the attribute value and the skin rating of each attribute of the skin described above, and further provides the recommendation management product to the user terminal 200 . At this time, the recommendation management product may include at least one of a treatment service for managing skin, a product for managing skin, and an educational content for managing skin. That is, in addition to the micro needle patch, general treatment service information may be provided.

Thus, the present invention can provide an integrated solution for skin condition analysis as well as a solution based on each state.

On the other hand, the skin condition evaluating apparatus 110 receives the user's selection information on the recommended management product provided to the user terminal 200 by the above-described process, and based on the selection information of the user, Value and skin rating to a third server (not shown). At this time, the third server (not shown) may be the server of the management subject of the recommended management product.

For example, when the selection information for 'treatment service for skin management' is received from the user terminal 200, the skin condition evaluating unit 110 is a server of the medical institution providing the treatment service, And skin rating. At this time, the skin condition evaluating apparatus 110 may transmit the skin image together. The transmitted information can be used in a series of processes (eg, placement of a specialist) for the treatment of the skin.

 In addition, when receiving the selection information on 'product or content for management of skin' from the user terminal 200, the skin condition evaluating device 110 determines whether the attribute value And skin rating.

Thus, the present invention not only enables accurate diagnosis of the skin from the image of the skin, but also provides an appropriate treatment method depending on the skin condition in conjunction with the subsequent procedure.

The embodiments of the present invention described above can be embodied in the form of a computer program that can be executed on various components on a computer, and the computer program can be recorded on a computer-readable medium. At this time, the medium may be a computer-executable program. Examples of the medium include a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, an optical recording medium such as CD-ROM and DVD, a magneto-optical medium such as a floptical disk, And program instructions including ROM, RAM, flash memory, and the like.

Meanwhile, the computer program may be designed and configured specifically for the present invention or may be known and used by those skilled in the computer software field. Examples of computer programs may include machine language code such as those produced by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like.

The specific acts described in the present invention are, by way of example, not intended to limit the scope of the invention in any way. For brevity of description, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of such systems may be omitted. Also, the connections or connecting members of the lines between the components shown in the figures are illustrative of functional connections and / or physical or circuit connections, which may be replaced or additionally provided by a variety of functional connections, physical Connection, or circuit connections. Also, unless explicitly mentioned, such as &quot; essential &quot;, &quot; importantly &quot;, etc., it may not be a necessary component for application of the present invention.

Accordingly, the spirit of the present invention should not be construed as being limited to the above-described embodiments, and all ranges that are equivalent to or equivalent to the claims of the present invention as well as the claims .

Claims (12)

Obtaining a primary skin image using a skin meter; Analyzing the primary skin image; And And transmitting an analysis result of the primary skin image to a user terminal, Wherein the transmitting to the user terminal comprises: A patch matching the analysis result of the skin image is selected, And transmitting the information about the patch together with the analysis result of the skin image. The method according to claim 1, Wherein the patch is a micro needle patch. The method according to claim 1, And detecting whether or not the patch is used after the step of transmitting the patch to the user terminal. The method of claim 3, The step of detecting whether or not the patch is used comprises: And receiving the tagging information of the patch from the user terminal. The method of claim 1, wherein the skin analysis result indicates that the user uses the patch. 5. The method of claim 4, The step of detecting whether or not the patch is used comprises: Acquiring attribute information of a patch matched with the tagging information, Generating a use end timer of the patch based on the attribute information; and alarming the user to terminate the use of the patch through the user terminal when the timer ends, based on the skin analysis result. 5. The method of claim 4, After the step of detecting whether or not the patch is used Obtaining a secondary skin image, Reanalyzing the secondary skin image; And And transmitting an analysis result of the secondary skin image to a user terminal, Wherein the transmitting the analysis result of the secondary skin image to the user terminal comprises determining skin rejuvenation degree and determining whether the patch currently being used is reused or not. The method according to claim 6, And a skin analysis result suggesting use of a different kind of patch when the degree of skin improvement is less than a preset reference value. The method according to claim 1, Wherein analyzing the primary skin image comprises: Generating a first feature vector from the primary skin image; Determining a second feature vector corresponding to an attribute value for at least one attribute of the skin based on the first feature vector and a skin recognizer; And Determining a grade of the skin based on the second feature vector and the second skin recognizer, The first skin recognizer A data set representing a correlation between a first feature vector corresponding to each of a plurality of skin images and a second feature vector corresponding to one or more attribute values of each of the plurality of skin, The second skin recognizer A patch proposal method based on a skin analysis result that is a data set expressing a correlation between a second feature vector corresponding to one or more attribute values of each of a plurality of skin and a third feature vector corresponding to a grade of each of the plurality of skin. 9. The method of claim 8, The attribute The degree of flushing of the skin, the degree of wrinkling of the skin, and the flatness of the skin, The second feature vector And at least one vector component corresponding to the degree of flushing, the degree of wrinkles and the degree of flatness, respectively. The method according to claim 1, Wherein analyzing the primary skin image comprises: A skin analyzer for acquiring a plurality of skin images taken in different directions to generate a stereoscopic image, and analyzing a skin condition using the stereoscopic image. 3. The method of claim 2, The skin measuring device includes: Body; An image sensor disposed on the body for photographing a user's skin; A temperature sensor disposed in the body for measuring a temperature of the user; A distance adjusting device disposed in the body and capable of adjusting an appropriate distance from the image sensor; And And a controller communicating with the image sensor and the temperature sensor, The body has a convex shape in a direction perpendicular to the longitudinal direction, Wherein the body includes a first region having a larger sectional area in the longitudinal direction and a second region having a smaller sectional area in the longitudinal direction, Wherein the first region has a concave surface formed by cutting-out a part of the region, Wherein the image sensor, the temperature sensor, and the distance adjustment device are based on skin analysis results that are arranged on the concave surface. 3. The method of claim 2, The micro needle patch A base layer; And a needle array disposed on the base layer, The needle array matrix; A plurality of microstructures disposed on the matrix, Wherein the plurality of microstructures have a triangular pyramid shape, Wherein the microstructure is based on a skin analysis result that includes gold silver.

Images