KR101963427B1 - Image processing and analysis system for measuring estrogen cycle and method using thereof - Google Patents

Abstract

An embodiment of the present invention relates to an electronic device including a camera portion, a saliva receiving portion for receiving a saliva of a target object, and an inserting portion for receiving the saliva accommodating portion, A body portion having an opening formed on one surface thereof for mounting the electronic device on one surface thereof and a body portion having an opening formed on the surface of the body portion; An ovulation date predicting device including an insertion part formed on one side and a light source part disposed inside the body part and providing light to the saliva obtaining device, and a controller for obtaining an image of the saliva from the camera part, Extracting a crystal structure image of a hormone contained in the saliva, Based on the crystal structure of the image and provides the image processing and analysis system for a controller for determining whether ovulation of the target object, the female hormone (estrogen) measurement period.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing and analysis system for measuring a female hormone (estrogen) cycle,

Embodiments of the present invention are directed to an image processing and analysis system for measuring female hormone (estrogen) cycle, and a control method thereof.

As society changes, the importance of pregnancy planning and contraceptive planning becomes increasingly important. In contraception, natural contraception, which considers women's ovulation cycle, and artificial contraception using separate medications and tools, A method of regulating sexual intercourse in consideration of the ovulation cycle of the ovary, and an artificial in vitro / in vivo fertilization through surgery etc. have been widely applied. However, anthropogenic methods have a high probability of success in contraception and pregnancy, but can adversely affect the body of women or men, thus encouraging natural methods that take into account the female ovulation cycle.

The method of measuring the ovulation status of a woman is classified into various methods according to the parameters for determining whether or not the ovulation state of the woman is a method of measuring the content of the lutein hormone from the body fluid of the human body It is the most accurate. However, since this method requires special safety rules, it is inconvenient for a specialist of a designated institution to request an inspection, and women are in fact avoiding it.

On the other hand, the method of determining the ovulation condition by measuring the basal body temperature of a woman and judging whether ovulation has occurred through mediation thereof or collecting mucus in the neck of a throat and observing the crystals in its drying process is very convenient, Is the easiest to use. However, since the mucus crystals and the basal body temperature of a woman can be changed by an external factor such as a disease or a change in the surrounding environment, there is a problem that the reliability of the judgment of ovulation is greatly reduced.

An object of the present invention is to provide an image processing and analysis system capable of measuring the ovulation date through image analysis of saliva and a control method thereof in order to solve the above problems and / or limitations.

An embodiment of the present invention relates to an electronic device including a camera portion, a saliva receiving portion for receiving a saliva of a target object, and an inserting portion for receiving the saliva accommodating portion, A body portion having an opening formed on one surface thereof for mounting the electronic device on one surface thereof and a body portion having an opening formed on the surface of the body portion; An ovulation date predicting device including an insertion part formed on one side and a light source part disposed inside the body part and providing light to the saliva obtaining device, and a controller for obtaining an image of the saliva from the camera part, Extracting a crystal structure image of a hormone contained in the saliva, Based on the crystal structure of the image and provides the image processing and analysis system for, ovulation measured to a control unit for determining whether ovulation of the target object.

In one embodiment of the present invention, the controller divides the obtained captured image into a plurality of unit pixels, and extracts the crystal structure image from the captured image by digitizing each of the plurality of unit pixels .

In one embodiment of the present invention, the controller extracts a plurality of corner points from the obtained captured image, and has a numerical value within a first numerical range on the basis of the numerical value of the corner point, It is possible to extract first pixels connected and determine whether the extracted first pixels correspond to the crystal structure of the hormone based on the extracted first pixels.

In an embodiment of the present invention, the plurality of corner points may be relatively moved through numerical comparison of any unit pixel in each of a plurality of regions included in the obtained captured image and neighboring pixels adjacent to the arbitrary unit pixel Can be extracted.

In one embodiment of the present invention, when the first pixels are connected to a length greater than or equal to a predetermined first reference value, the control unit can determine the crystal structure of the hormone.

In one embodiment of the present invention, the controller calculates the length or thickness of each of the extracted crystal structure images, classifies the extracted crystal structure images based on the length or thickness, generates classification data , The probability of the ovulation can be calculated using the classification data.

In one embodiment of the present invention, the controller may determine the validity of the crystal structure image using the directionality of the first pixels.

In one embodiment of the present invention, when the saliva obtaining device is inserted into the ovulation prediction device, the central axis passing through the through hole and the central axis passing through the opening can substantially coincide with each other.

According to an embodiment of the present invention, the apparatus for predicting an ovulation date may further include a camera mount part including an inlet formed in a shape corresponding to an outer shape of the camera part, the camera mount part being attachable to and detachable from an area on one side of the body part .

In one embodiment of the present invention, the ovulation date predicting apparatus may further include an optical part disposed between the opening and the insertion part, and having at least one lens for enlarging an image of the saliva.

In one embodiment of the present invention, the ovulation-date predicting apparatus may further include a drying unit drying the saliva stored in the saliva-collecting apparatus.

In one embodiment of the present invention, the saliva retrieval device includes a guide groove formed in the case along a longitudinal direction of the case and a guide groove formed in the case to protrude to the outside of the case, A possible slider;

In one embodiment of the present invention, the saliva retrieval device includes: a protrusion disposed on an inner surface of the case so as to be spaced apart from the entrance, the protrusion protruding into the case; And a latching part connected to one side of the saliva receiving part and fixing the saliva receiving part by being caught by the protruding part.

In one embodiment of the present invention, the protrusion may include an inclined surface inclined at a predetermined angle toward the entrance.

In one embodiment of the present invention, the saliva retrieval apparatus may further include a product information part disposed adjacent to the through hole and including at least one of an encrypted pattern and a serial number.

An embodiment of the present invention is a method of controlling an image processing and analysis system for measurement of ovulation date comprising an electronic device including a camera unit, a saliva acquisition device in which saliva is contained, and an ovulation date prediction device into which the saliva acquisition device is inserted A step of inserting the saliva-collecting apparatus containing the saliva into the ovulation prediction apparatus; Acquiring an image of the saliva using the camera unit; Analyzing the acquired image to extract a crystal structure image of a hormone contained in the saliva; And determining whether the subject is ovulation based on the extracted crystal structure image. The present invention also provides a control method of an image processing and analysis system for ovulation date measurement.

In one embodiment of the present invention, the step of extracting the crystal structure image includes: dividing the obtained image into a plurality of unit pixels; And extracting the crystal structure image from the captured image by digitizing each of the plurality of unit pixels.

In one embodiment of the present invention, the step of extracting the crystal structure image may include comparing numerical values of arbitrary unit pixels and neighboring pixels adjacent to the arbitrary unit pixel in each of a plurality of regions included in the obtained captured image, Extracting a plurality of corner points relative to each other; Extracting first pixels having a numerical value within a first numerical range based on the numerical value of the corner point for each of the plurality of regions and continuously connected from the corner point; And determining whether the extracted first pixels correspond to the crystal structure of the hormone based on the extracted first pixels.

In one embodiment of the present invention, the step of extracting the crystal structure image may determine the crystal structure of the hormone when the first pixels are connected to a length longer than a predetermined first reference value.

In one embodiment of the present invention, the step of determining whether the subject is ovulation may include calculating a length or a thickness of each of the extracted crystal structure images; Classifying the extracted crystal structure images based on the length or the thickness to generate classification data; And calculating a probability of the ovulation using the classification data.

Other aspects, features, and advantages will become apparent from the following drawings, claims, and detailed description of the invention.

The image processing and analysis system and the control method thereof for measuring ovulation date according to the embodiments of the present invention can clearly acquire the sensed image of saliva using the ovulation date predicting apparatus. In addition, the image processing and analysis system for measurement of ovulation date can accurately predict the ovulation date by extracting the crystal structure images from the image, classifying them, and calculating the probability.

1 is a conceptual diagram schematically illustrating an image processing and analysis system for measuring ovulation date according to an embodiment of the present invention.
2 is a cross-sectional view taken along line II-II 'of the apparatus for predicting the ovulation date of FIG.
Fig. 3 is a perspective view schematically showing the saliva acquisition device of Fig. 1; Fig.
Fig. 4 is a conceptual diagram for explaining a method of operating the saliva obtaining apparatus of Fig. 3; Fig.
5 is an enlarged view showing the area S in Fig.
FIG. 6 is a schematic view showing the correlation between the crystal structure of the luteinizing hormone contained in the saliva and the ovulation cycle. FIG.
FIG. 7 is a diagram showing the crystal structure of luteinizing hormone according to ovulation. FIG.
8 is a flowchart sequentially illustrating a control method in a controller of an image processing and analysis system for measuring ovulation date according to an embodiment of the present invention.
FIG. 9 is a conceptual diagram schematically showing an image processing and analysis system for measuring ovulation date according to another embodiment of the present invention.
10 is a flowchart sequentially showing control methods in the image processing and analysis system of FIG.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or corresponding parts throughout the drawings, and a duplicate description thereof will be omitted.

These embodiments are capable of various transformations, and specific embodiments are illustrated in the drawings and described in detail in the detailed description. The effects and features of the embodiments, and how to achieve them, will be apparent from the following detailed description taken in conjunction with the drawings. However, the embodiments are not limited to the embodiments described below, but may be implemented in various forms.

In the following embodiments, the terms first, second, and the like are used for the purpose of distinguishing one element from another element, not the limitative meaning.

In the following examples, the singular forms "a", "an" and "the" include plural referents unless the context clearly dictates otherwise.

In the following embodiments, terms such as inclusive or having mean that a feature or element described in the specification is present, and do not exclude the possibility that one or more other features or elements are added in advance.

In the following embodiments, when a unit, a region, an element, or the like is on or on another portion, not only the case where the portion is directly on another portion but also another unit, region, .

In the following embodiments, terms such as joining or joining do not necessarily mean a direct and / or fixed connection or coupling of two members unless the context clearly indicates otherwise, and it is understood that other members are interposed between the two members It is not excluded.

Means that there is a feature or element described in the specification and does not preclude the possibility that one or more other features or components will be added.

In the drawings, components may be exaggerated or reduced in size for convenience of explanation. For example, the sizes and thicknesses of the components shown in the drawings are arbitrarily shown for convenience of explanation, and therefore, the following embodiments are not necessarily drawn to scale.

FIG. 1 is a conceptual diagram schematically illustrating an image processing and analysis system 10 for measuring ovulation date according to an embodiment of the present invention. FIG. 2 is a schematic view illustrating an ovulation date prediction apparatus 100 of FIG. 1 along a line II-II ' FIG.

1, an image processing and analysis system 10 for measuring ovulation date may include an apparatus for predicting an ovulation date 100, a saliva acquisition apparatus 200, an electronic device 300, and a control unit 400.

The electronic device 300 is an electronic device including a camera unit 310 disposed on one surface, and may be a portable device that can be moved. The electronic device 300 may include a display unit (not shown), which may be a surface opposite to a surface on which a display unit (not shown) is disposed (see FIG. 1) (Not shown) may be disposed. In another embodiment, the electronic device 300 may include two or more camera units 310, and may be disposed on both sides of a surface on which a display unit (not shown) is disposed. For example, it can be a mobile phone, a tablet, a notebook, a graphing calculator, a portable game machine, a digital camera, a digital camcorder, a portable media player, and the like.

Although not shown, the camera unit 310 may include a lens module including at least one lens, and an image sensor that senses a light image provided by the lens module, to capture an image of the saliva acquisition device 200 .

1 and 2, the apparatus 100 for predicting an ovulation date includes a body 110 on which an electronic device 300 is mounted on one side A1, And an insertion unit 120 formed at one side of the body 110. The apparatus 100 for predicting the ovulation date includes an opening 115 formed in one surface A1 of the body 110 and an opening 115 formed in the inside of the body 110 so that the camera 310 of the electronic device 300 is positioned. And a light source 140 for irradiating light to the saliva acquiring apparatus 200.

The body 110 of the apparatus 100 may be formed in a predetermined size and shape. The body 110 may have a flat surface A1 which is an upper surface disposed in a direction perpendicular to the direction in which the saliva acquisition device 200 is inserted through the insertion portion 120, The electronic device 300 can be mounted. One side A1 of the body 110 is made of a material capable of imparting a constant frictional force to the electronic device 300, so that the electronic device 300 can be stably mounted. For example, one side A1 of the body part 110 may include a rubber material. However, the present invention is not limited thereto, and it goes without saying that various materials capable of stably mounting the electronic device 300 can be employed. The body 110 may have an opening 115 on one side A1 so that the camera unit 310 of the electronic device 300 is positioned. The camera unit 310 of the electronic device 300 mounted on the body 110 can face the saliva acquisition device 200 through the opening 115. [ On the other hand, when the saliva obtaining device 200 is inserted into the ovulation prediction device 100, the center axis passing through the through hole 215 of the saliva acquiring device 200 and the center axis passing through the opening 115 coincide with each other An opening 115 may be formed.

The insertion portion 120 may be formed at one side of the body 110 to allow the saliva acquisition device 200 to be inserted at a predetermined depth. The insertion portion 120 is formed in a size and shape corresponding to the saliva acquisition device 200 so that the saliva acquisition device 200 can be stably inserted. The insertion unit 120 may form the first exposed unit 121 at a position overlapping the opening 115 so that the camera unit 310 of the electronic device 300 can capture the inserted saliva acquisition device 200 have. The insertion unit 120 may be formed with a second exposed unit 123 so that the light from the light source unit 140 can be irradiated to the saliva obtaining apparatus 200. The first exposed portion 121 and the second exposed portion 123 may be positioned in a straight line with the opening 115 of the body 110. In addition, the sizes of the first exposed portion 121 and the second exposed portion 123 may be different from each other. For example, the size of the second exposed portion 123 may be larger than the size of the first exposed portion 121. The second exposed portion 123 may be formed to have a larger size than the first exposed portion 121 because the second exposed portion 123 performs the function of entering the light emitted from the light source portion 140.

The light source 140 may be disposed inside the body 110 and may provide light to the saliva acquisition device 200. The light source unit 140 may apply any kind of source device capable of providing light to the saliva obtaining apparatus 200, and may be an LED device, for example. In one embodiment, the light source 140 may be positioned on an extension line C1 passing through the center of the opening 115 of the body 110, as shown in the figure. The light source unit 140 may be disposed at any position that allows the camera unit 310 of the electronic device 300 to image the saliva acquisition device 200 through the light provided by the light source unit 140 . For example, when the light source unit 140 is not located on the extension line C1 passing through the center of the opening 115, the light supplied from the light source unit 140 is transmitted to the saliva obtaining apparatus 200 (Not shown) that changes the path of the light so that the light can be transmitted to the light source (not shown). The optical path changing means (not shown) may guide the light from the light source unit 140 to the saliva obtaining apparatus 200, including a mirror or a lens.

Although one light source 140 is shown in the drawing, the apparatus 100 for predicting the ovulation date may include one or more light sources 140. The ovulation day predicting apparatus 100 not only can provide light to the saliva obtaining apparatus 200 through the light source unit 140 but also can provide light outside the ovulation day predicting apparatus 100. [ At this time, the body 110 is formed of a transparent or translucent material so that the light emitted from the light source 140 can be transmitted to the outside. Thus, the apparatus 100 for predicting the ovulation date can also function as an illumination. When performing the function of illumination, the apparatus 100 for predicting the date of ovulation can be used in a state in which one side A1 of the body 110 is turned upside down.

The ovulation prediction apparatus 100 may further include an optical unit 150, a drying unit 170, a camera mounting unit 130, and a power unit (not shown).

The optical unit 150 may be disposed between the opening 115 of the body 110 and the insertion unit 120 and may include at least one lens for enlarging the image of the saliva. In one embodiment, the optical portion 150 includes a wide angle lens 152 and a macroscopic lens 153, and may include a fixing member 151 for fixing these lenses. The optical unit 150 can enlarge the saliva image of the inserted saliva acquisition device 200 by using the wide angle lens 152 and the macro lens 153 and can also enlarge the saliva image in the body part 110 Can be fixed. The optical part 150 is fixed inside the body part 110 and is disposed between the optical part 150 and the saliva acquisition device 200 between the camera part 310 and the optical part 150 of the electronic device 300, May be constant. Accordingly, the image processing and analysis system 10 for measuring the ovulation date can clearly acquire the sensed image of the saliva through the apparatus 100 for predicting the ovulation date.

The drying unit 170 can dry the saliva contained in the saliva obtaining apparatus 200. [ The drying unit 170 may use at least one of air and heat. For example, the drying unit 170 may include a fan to dry the saliva contained in the saliva-collecting device 200. In another embodiment, the drying unit 170 can use the heat supplied from the Peltier element or dry the saliva contained in the saliva acquisition device 200 using electric resistance heat. Or the drying unit 170 may include both a fan and a Peltier element to dry the saliva using air and heat. Meanwhile, the drying unit 170 may be formed integrally with the light source unit 140. Specifically, the light source 140 may use an incandescent lamp, and the saliva may be dried using heat generated by driving the incandescent lamp. Needless to say, a drying apparatus using various drying methods may be used.

The camera mount 130 includes an inlet 135 formed in a shape corresponding to the outer shape of the camera unit 310 and may be removably attached to one area of the one surface A1 of the body 110. [ When the electronic device 300 is a smartphone distributed on the market, the shape of the camera unit 310 of the smartphone may be different depending on the type of the smartphone. The camera mount 130 can correspond to the outer shape of the camera 310 of the user and can stably acquire an image of saliva. At this time, the central axis of the inlet 135 and the central axis of the opening 115 may coincide. The camera mount 130 may be formed in a replaceable form and may be disposed on one side A1 of the body 110 as required. The body 110 may further include a seating groove (not shown) formed in a shape corresponding to the outer periphery of the camera mount 130 on one side A1 of the body 110. The electronic device 300 And can be stably mounted on the body 110.

The ovulation day predicting apparatus 100 may further include a power source unit (not shown) for supplying power to the light source unit 140 or the drying unit 170. The power source unit (not shown) may be connected to an external power source unit or may supply power through a built-in battery. When the ovulation day predicting apparatus 100 supplies power using the built-in battery, the ovulation day predicting apparatus 100 may perform a portable battery function using the built-in battery. Although not shown, in this case, the ovulation prediction device 100 may further include a charging port for charging the built-in battery and a supply port for supplying the power of the battery to the outside.

FIG. 3 is a perspective view schematically showing the saliva acquisition device 200 of FIG. 1, and FIG. 4 is a conceptual diagram illustrating a method of operating the saliva acquisition device 200 of FIG. 5 is an enlarged view showing the area S in Fig.

3 and 4, the saliva obtaining apparatus 200 may include a case 210, a saliva receiving unit 220, a slider 230, and a guide groove 240.

The saliva receiving portion 220 can receive the saliva of the object. Here, saliva may be saliva containing luteinizing hormone capable of predicting ovulation date. The saliva receiving part 220 may be made of a transparent material such as an acrylic material. In addition, the saliva receiving part 220 can be made of a flexible material, so that the saliva of the target body can be collected not only from the upper part of the tongue but also from the lower part of the tongue. In addition, the saliva receiving part 220 can protrude to the outside of the case 210 by a predetermined length, so that the user can easily collect the saliva.

The case 210 may be disposed inside the saliva receiving portion 220. One end of the case 210 is provided with an entrance 211 through which the saliva receiving part 220 can enter and exit and a through hole 215 may be formed on one side of the case 210 to expose the saliva to the outside. The guide groove 240 may be formed in the case 210 along the longitudinal direction of the case 210. Although the guide groove 240 is formed on the same surface as the through hole 215 in the drawing, the present invention is not limited thereto. The guide groove 240 may be formed on the other side of the through hole 215. The case 210 may further include a ventilation hole 217 penetrating the other surface opposite to the through hole 215. Air or heat of the drying unit 170 is transferred to the saliva through the ventilation hole 217, and the saliva can be effectively dried. The ventilation hole 217 may be formed on the other surface of the case 210 that is not the other surface opposite to the through hole 215. [

The slider 230 may be connected to one side of the saliva receiving part 220 and protrude to the outside of the case 210 to be movable along the guide groove 240. In other words, the user can move the saliva receiving portion 220 to the outside or inside of the case 210 through an operation of pushing or pulling the slider 230. [ The slider 230 may be made of a material having a frictional force to facilitate the user's operation or may have a plurality of protrusions formed on the upper surface thereof.

Referring to FIG. 4A, the slider 210 of the saliva acquiring apparatus 200 may be positioned at 'A' before use of the product. At this time, the saliva receiving part 220 is disposed inside the case 210 to prevent contamination. The slider 230 is moved to the position 'B' along the guide groove 240 as shown in FIG. 4 (b) to collect the saliva using the saliva receiving part 220, 211 to the outside. The user can collect the saliva of the target object by using the saliva receiving part 220 exposed to the outside.

Referring to FIG. 4 (c), the user can move the slider 230 to 'C' to draw the saliva receiving part 220 into the case 210. The saliva contained in the saliva receiving part 220 may be exposed to the outside through the through hole 215. In this state, the saliva-acquiring apparatus 200 can be inserted into the ovulation-date predicting apparatus 100 to acquire an image of saliva using the camera unit 310 of the electronic device 300. [

On the other hand, the saliva acquiring apparatus 200 can be used for hygiene and disposable for accurate analysis. The saliva acquiring apparatus 200 may further include a protruding portion 270 and an engaging portion 235 for imparting a one-time function.

The protrusion 270 may be disposed on the inner surface of the case 210 so as to be spaced apart from the entrance 211 and protrude into the case 210. The latching part 235 is connected to one side of the saliva receiving part 220 and can be held by the protruding part 270 to fix the saliva receiving part 220. At this time, the projecting portion 270 may include an inclined surface 271 inclined at a predetermined angle toward the entrance 211 to facilitate entry of the engagement portion 235. As a result, the engaging portion 235 and the protruding portion 270 are unidirectional, so that if the engaging portion 235 passes the protruding portion 270, it can not be reused. On the other hand, the latching part 235 may be formed integrally with the slider 230.

Referring to FIG. 5, the saliva obtaining apparatus 200 may further include a product information unit 260. The product information unit 260 is disposed adjacent to the through hole 215 and may include at least one of an encrypted pattern and a serial number. The encrypted pattern may include a bar code (L2), a QR code, a character code, a graphic code (L1), and the like. Alternatively, the encrypted pattern may form the edge structure of the product information section as a pattern. The saliva acquiring apparatus 200 can confirm whether the saliva acquiring apparatus 200 is a genuine product or a normal position through the product information section 260. In other words, when the saliva acquiring apparatus 200 is inserted into the ovulation day predicting apparatus 100, both the image of the saliva image as well as the image of the product information section 260 are acquired, Or to confirm that the insertion position of the saliva acquisition device 200 is correct, and notify the user. The product information unit 260 may be configured to place the encrypted pattern L1 or the serial number on the surface of the case 210 adjacent to the through hole 215. However, To insert an encrypted pattern or serial number into the clear window. Meanwhile, the product information unit 260 may include a chip such as a radio frequency identification (RFID) or an integrated circuit (IC). The image processing and analysis system 10 for measuring ovulation date according to an embodiment includes a pattern recognition unit (not shown) for recognizing an encrypted pattern through an image of the captured product information unit 260 or recognizing an encrypted pattern . For example, a component interlocked with a reader such as an RFID, an IC, or the like.

Meanwhile, the control unit 400 can acquire an image of saliva using the camera unit 310, and process the acquired image to extract a crystal structure image of the hormone contained in the saliva. In addition, the control unit 400 can determine whether the subject is ovulation based on the extracted crystal structure image. Here, the control unit may include all kinds of devices capable of processing data, such as a processor. Herein, the term " processor " may refer to a data processing apparatus embedded in hardware, for example, having a circuit physically structured to perform a function represented by a code or an instruction contained in the program. As an example of the data processing apparatus built in hardware, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, an application-specific integrated circuit (ASIC) circuit, and a field programmable gate array (FPGA), but the scope of the present invention is not limited thereto.

In one embodiment, the control unit 400 may be located within the electronic device 300. The control unit 400 may implement the above-described operation by driving an application program or an application stored in a memory unit (not shown) of the electronic device 300. [ In another embodiment, the control unit 400 may be disposed in the ovulation date predicting apparatus 100. [ In this case, the ovulation day predicting apparatus 100 may be equipped with a separate camera unit to process and analyze images without the electronic device 300. Hereinafter, for the sake of convenience of explanation, the case where the control unit 400 is disposed in the electronic device 300 will be described.

Hereinafter, a control method in the control unit 400 of the image processing and analysis system 10 for measuring ovulation date according to an embodiment of the present invention will be described.

FIG. 6 is a schematic view showing the correlation between the crystal structure of luteinizing hormone (LH) contained in saliva and the ovulation cycle, and FIG. 7 is a graph showing the crystal structure of luteinizing hormone (LH) Fig.

6 and 7, it can be seen that the crystal structure of the luteinizing hormone (LH) contained in the saliva changes according to the ovulation cycle. 7 (a)), transient (Fig. 7 (b)) and ovulatory period (Fig. 7 (c)) can be determined using the difference in crystal structure. The luteinizing hormone contained in the saliva may have a tooth-like crystal structure in which straight lines cross the ovulation period. However, it was difficult to judge the exact date of ovulation by the human eye even if there is a tooth-like crystal structure in the saliva. The image processing and analysis system for measuring ovulation date according to an embodiment of the present invention extracts a crystal structure image from an image of saliva acquired from the camera unit 310 and analyzes the crystal structure images to determine the probability of ovulation date to the user Can accurately provide.

FIG. 8 is a flowchart sequentially illustrating a control method in the control unit 400 of the image processing and analysis system 10 for measuring ovulation date according to an embodiment of the present invention.

Referring to FIG. 8, personal information and hormone information including menstrual cycle information of a subject may be stored in the controller 400 in advance. When an application is executed in the electronic device 300, a main page such as an initial idle screen, a calendar screen, and environment settings can be activated. At this time, the application may store the user's personal information to store the user's periodic or aperiodic data. The personal information or the hormone information may be directly input and stored after the user operates the application, and the derived judgment information may be stored in the database (not shown) of the controller 400 whenever the ovulation date is measured. The personal information of the object may include the key, the weight, the date of birth, the last menstrual period of the last three months, the menstrual cycle days, and the like.

Next, when the saliva acquisition device 200 is inserted into the ovulation prediction device 100, the controller 400 can acquire an image of the product information section of the saliva acquisition device 200 (S10). Since the product information unit 260 includes at least one of the encrypted pattern and the serial number, the control unit 400 can check whether the product information is normal or not (S20). Alternatively, the control unit 400 can also check the number of times of use, the state of coupling, and whether or not it is cleaned by using the encrypted pattern or serial number. Alternatively, the controller 400 may check the color of the saliva receiving unit 220 to check whether the sample is genuine. At this time, if the inserted saliva acquiring apparatus 200 is not a genuine product or a normal product, or if the position is wrong, the control unit 400 requests the user to exchange the product, or adjusts the position because the position of the saliva acquiring apparatus 200 is wrong (S15).

If the inserted saliva acquiring apparatus 200 is a genuine one and the position is normal, the control unit 400 acquires an image of saliva using the camera unit 310 (S30), processes the obtained image, The crystal structure of the hormone can be extracted (S40). The picked-up image of the saliva may include a foreign substance as well as a crystal structure. In order to distinguish between the crystal structure of the hormone and the foreign substance, the control unit 400 divides the obtained image into a plurality of unit pixels, and quantizes each of the plurality of unit pixels to extract a crystal structure image from the captured image . For example, each of the plurality of unit pixels may be divided into gray scale of 0 to 255 levels. At this time, the controller 400 can relatively extract a plurality of corner points by comparing numerical values of arbitrary unit pixels and neighboring pixels adjacent to arbitrary unit pixels in each of a plurality of regions included in the obtained captured image. Here, the corner point may be a starting point or an end point for the longitudinal direction of the hormone crystal structure. Specifically, when a corner point exists for one area, neighboring pixels adjacent to the corner point may have a bright numerical value relative to the corner point. In other words, if neighboring pixels adjacent to an arbitrary unit pixel have numerical values brighter than the arbitrary unit pixel and are continuously connected along the periphery, the corresponding unit pixel can be extracted as a corner point.

Then, the controller 400 may extract the first pixels continuously connected from the corner point with a numerical value within the first numerical range based on the numerical value of the corner point. Here, the first pixels may be unit pixels having a value similar to the numerical value of the corner point. When these first pixels are continuously connected from the corner point, the controller 400 may determine that the extracted first pixels include a tooth-like crystal structure in which the lines are connected as shown in FIG. 7C.

At this time, when the first pixels are connected to a length longer than a preset first reference value, the controller 400 can determine that the crystal structure is a hormone. In other words, even if the first pixels are continuously connected from the corner point, if it is lower than the first reference value, it is determined that it is not a tooth-like type crystal structure corresponding to the ovulation date yet, and the crystal structure image may not be extracted. The first reference value serving as a reference of such a length may be different for each object, for example, and may be determined on the basis of the personal information and the hormone information of the object. In addition, the controller 400 may determine the validity of the crystal structure image using the directionality of the first pixels. For example, since the luteinizing hormone of the fern structure forms an elongated shape without forming a circle shape, it can be determined that the extracted first pixels are effective as a crystal structure image when they have unidirectionality.

Next, the controller 400 calculates the length or thickness of each of the extracted crystal structure images, and classifies the extracted crystal structure images based on the length or thickness (S50). The control unit 400 can generate classification data by associating the classification items and the number of the crystal structure images corresponding to the respective classification items (S60). Referring to FIG. 7 (C), a plurality of luteinizing hormones may form a crystal structure in saliva, and a plurality of crystal structures may have respective lengths and thicknesses. The control unit 400 can generate classification data by classifying valid crystal structure images using length or thickness. Thereafter, the control unit 400 may calculate the probability of ovulation using the classification data (S70). For example, the classification items of the extracted crystal structure images can be divided into grades, and the number of the crystal structure images corresponding to the grades can be numerically calculated, so that the probability of the ovulation date can be calculated. In one embodiment, when 15 to 20 pixels of the first pixel are serially connected, the controller 400 classifies the crystal structure image into a first class, and when 10 to 15 of the first pixels are consecutively connected , The corresponding crystal structure image can be classified into the second grade. The control unit 400 scales the first grade to 90 points and the second grade to 70 points. The controller 400 can calculate the total score over the entire image using the number of the grades and the number of the crystal structure images included in each grade, and calculate the probability of the ovulation date through the total score. However, this is only an example, and the present invention is not limited thereto.

The control unit 400 may display the calculated probability externally or may determine the ovulation date and display it externally (S80). The user can select whether the probability is displayed or the result of the ovulation date determination is displayed. The control unit 400 can determine that it is an ovulation date when the probability of the ovulation date is equal to or higher than a predetermined reference probability. At this time, the reference probability may be determined based on the existing database of the object, or may be determined by the user's choice.

As described above, the image processing and analysis system and the control method thereof for measuring ovulation date according to an embodiment of the present invention can clearly acquire an image of saliva by using an ovulation date predicting apparatus. In addition, the image processing and analysis system for measurement of ovulation date can accurately predict the ovulation date by extracting the crystal structure images from the image, classifying them, and calculating the probability.

FIG. 9 is a conceptual diagram schematically showing an image processing and analysis system 20 for measuring ovulation date according to another embodiment of the present invention, and FIG. 10 is a flowchart illustrating a control method in the image processing and analysis system 20 of FIG. And Fig.

9 and 10, an image processing and analysis system 20 for measuring ovulation date according to another embodiment of the present invention includes an ovulation date prediction device (not shown), a saliva acquisition device (not shown), a plurality of electronic devices (300), a management server (500), and a hospital server (600). The image processing and analysis system 20 for measuring the ovulation date according to another embodiment of the present invention has the same configuration as the ovulation prediction apparatus 100, the saliva obtaining apparatus 200 and the electronic apparatus 300 of the embodiment, The server 500 and the hospital server 600 can be further used. A detailed description will be omitted for the convenience of explanation. At this time, the control unit may be located in each of the plurality of electronic devices 300.

The electronic device 300 may include a camera unit 310. The user can take the saliva of the target object by using the saliva acquiring device 200, insert it into the ovulation day predicting device 100, and generate the sensed image of the saliva using the camera part 310.

Hospital server 600 may store hospital information including ovulation date information, hormone information, and the like of the subject measured at the hospital (S100).

Personal information of a plurality of objects may be stored in the management server 500. The personal information of the plurality of objects may include the key, the weight, the date of birth, the last three months of the month, and the number of menstrual cycles.

First, the plurality of electronic devices 300 can be installed with an application that can be connected to the management server, and the user can log in by driving the application (S110). When the log-in signal is input, the management server 500 can request hospital information of the object to the hospital server 600 (S120). In the drawing, a user requests hospital information after requesting a login, and the hospital server 600 transmits hospital information (S125). However, the present invention is not limited to this, and the hospital server 600 may transmit the hospital information to the management server 500 in advance and store it in advance.

The user can take the saliva of the saliva acquisition device 200 using the electronic device 300. [ At this time, the camera unit 310 of the electronic device 300 may acquire the product information part image and the sensed image by photographing the product information part image of the saliva acquisition device 200 together (S130).

The electronic device 300 may first determine whether the saliva acquisition device 200 is a genuine product or a normal product by using an encrypted pattern or a serial number in the product information image or determine whether the saliva acquisition device 200 is normally inserted (S150). The electronic device 300 is in a normal position, and if it is a normal product, the crystal structure image may be extracted using the sensed image (S160). However, if it is not a normal position, or is not a normal product or a genuine product, the user can send a message to adjust the position or send a message to exchange the product (S140).

The electronic device 300 can extract the crystal structure image of the hormone contained in the saliva by processing the sensed image of the saliva when the inserted saliva acquiring device 200 is a genuine product and the position is normal (S160). The electronic device 300 may divide the obtained captured image into a plurality of unit pixels and quantize each of the plurality of unit pixels to extract a crystal structure image from the captured image. In the above process, the corner points may be extracted, and the first pixels connected to the corner point having numerical values in the first numerical value range and based on the numerical values of the corner points may be extracted. The electronic device 300 may extract the crystal structure image using the extracted first pixels.

Next, the electronic device 300 calculates the length or thickness of each of the extracted crystal structure images, and classifies the extracted crystal structure images based on the length and the thickness (S163). The electronic device 300 may generate classification data by associating the classification items and the number of the crystal structure images corresponding to the respective classification items. The classification data can be generated by classifying valid crystal structure images corresponding to the reference level using the length and the thickness.

The electronic device 300 may calculate the probability of whether or not ovulation has occurred using the classification data (S165). The electronic device 300 may display the calculated probability externally or may determine the ovulation date and display it externally (S190). The user can select whether the probability is displayed or the result of the ovulation date determination is displayed. The electronic device 300 may determine that it is an ovulation date when the probability of the ovulation date is equal to or higher than a preset reference probability. At this time, the reference probability may be determined based on the existing database of the object, or may be determined by the user's choice. The electronic device 300 may include a communication unit (not shown) that can be connected to the management server 500, and may transmit probability data including a probability related to the ovulation date generated through the wired / wireless communication network to the management server 500 .

The management server 500 can generate personal data by linking the transmitted probability data with the personal information. The management server 500 may store personal data for a plurality of objects to store the big data. In addition, the management server 500 may transmit the personal data to the hospital server 600. [ At this time, the hospital server 600 can analyze the personal data using the big data stored in the management server 500 (S180). For example, in the management server 500, the big data in which the personal information including the BMI, the menstrual cycle, the body weight, the key, and the exercise amount of a plurality of objects is linked with the probability data transmitted from the electronic device 300 is stored . The hospital server 600 can provide a customized solution that compares and analyzes comparative subjects having weight and height similar to those of a subject requiring a customized solution from such big data and raises the exercise amount or lower the BMI index to increase the probability of ovulation have. The hospital server 600 may send it to the direct electronic device 300 or provide a customized solution to the management server 500 at step S185 and send the customized solution to the electronic device 300 via the management server 500 (S187). The electronic device 300 may display the custom solution externally (S200).

The present invention has been described above with reference to preferred embodiments. It will be understood by those skilled in the art that the present invention may be embodied in various other forms without departing from the spirit or essential characteristics thereof. Therefore, the above-described embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is indicated by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

100: ovulation prediction device
110:
120:
130: camera mount
140: Light source
200: saliva acquisition device
210: Case
220: saliva receiving part
300: electronic device
310:
400:
500: management server
600: Hospital server

Claims (20)

An electronic device including a camera portion;
A saliva collecting device having a saliva receiving part for receiving the saliva of a target object, a case having the saliva receiving part disposed therein, an inlet and an outlet through which the saliva accommodating part can enter and exit at one end, and a case having a through hole formed on one surface thereof;
An inserting portion formed at one side of the body for inserting the saliva collecting device at a predetermined depth, and an inserting portion formed at an inner side of the body portion, An ovulation date predicting device including a light source part for supplying light to the saliva obtaining device; And
Obtaining a sensed image of the saliva from the camera unit, processing the obtained sensed image to extract a crystal structure image of the hormone contained in the saliva, and determining whether the subject is ovulation based on the extracted crystal structure image And a control unit for determining,
The control unit divides the obtained captured image into a plurality of unit pixels, digitizes each of the plurality of unit pixels to extract the crystal structure image from the captured image, and acquires a plurality of corner points Extracting first pixels connected in succession from the corner point with a numerical value in a first numerical range on the basis of the numerical value of the corner point and extracting the extracted pixels based on the extracted first pixels, And determining whether one pixel corresponds to the crystal structure of the hormone. delete delete The method according to claim 1,
Wherein the plurality of corner points are relatively extracted through numerical comparison of any unit pixel in each of a plurality of regions included in the obtained captured image and neighboring pixels adjacent to the arbitrary unit pixel, And analysis system. The method according to claim 1,
Wherein the controller determines that the crystal structure of the hormone is the crystal structure of the first pixels when the first pixels are connected to a length longer than a predetermined first reference value. The method according to claim 1,
The control unit may calculate the length or thickness of each of the extracted crystal structure images, classify the extracted crystal structure images based on the length or thickness, generate classification data, Image processing and analysis system for measuring ovulation date, calculating the probability of whether or not ovulation. The method according to claim 6,
Wherein the controller determines the validity of the crystal structure image using the directionality of the first pixels. The method according to claim 1,
Wherein the central axis passing through the through hole and the central axis passing through the opening substantially coincide when the saliva acquisition device is inserted into the ovulation prediction device. The method according to claim 1,
The ovulation date prediction apparatus according to claim 1, further comprising: a camera mount part which includes an inlet formed in a shape corresponding to an outer shape of the camera part, and which can be detachably attached to one area of one side of the body part; Processing and analysis system. The method according to claim 1,
The ovulation date predicting apparatus further comprising an optical part disposed between the opening and the insertion part, the optical part including at least one lens for enlarging an image of the saliva, wherein the image processing and analysis for estrogen cycle measurement system. The method according to claim 1,
Wherein the ovulation date predicting apparatus further comprises a drying unit for drying the saliva stored in the saliva retrieval apparatus. The method according to claim 1,
The saliva acquisition device includes:
A guide groove formed in the case along a longitudinal direction of the case; And
And a slider connected to one side of the saliva receiving part and protruding outside the case and movable along the guide groove. 13. The method of claim 12,
The saliva acquisition device includes:
A protrusion disposed on an inner surface of the case so as to be spaced apart from the entrance and protruding into the case; And
And a latching part connected to one side of the saliva receiving part and fixing the saliva receiving part by being caught by the protruding part. 14. The method of claim 13,
Wherein the protrusion comprises a sloped surface inclined at a predetermined angle toward the entrance. The method according to claim 1,
Wherein the saliva retrieval apparatus further comprises a product information section disposed adjacent to the through hole and including at least one of an encrypted pattern and a serial number. A control method of an image processing and analysis system for measuring ovulation date, comprising an electronic device including a camera unit, a saliva acquisition device in which saliva is contained, and an ovulation date prediction device into which the saliva acquisition device is inserted,
Inserting the saliva-collecting device containing the saliva into the ovulation-date predicting device;
Acquiring an image of the saliva using the camera unit;
Dividing the obtained captured image into a plurality of unit pixels and digitizing each of the plurality of unit pixels to extract a crystal structure image of a hormone contained in the saliva from the captured image; And
And determining whether the subject is ovulation based on the extracted crystal structure image,
The step of extracting the crystal structure image
Extracting a plurality of corner points relatively by comparing numerical values of arbitrary unit pixels and neighboring pixels adjacent to the arbitrary unit pixel in each of a plurality of regions included in the obtained captured image;
Extracting first pixels having a numerical value within a first numerical range based on the numerical value of the corner point for each of the plurality of regions and continuously connected from the corner point; And
And determining whether the extracted first pixels correspond to a crystal structure of the hormone based on the extracted first pixels. delete delete 17. The method of claim 16,
Wherein the step of extracting the crystal structure image determines that the crystal structure of the hormone is the crystal structure of the first pixels when the first pixels are connected to a length longer than a predetermined first reference value. 20. The method of claim 19,
The step of determining whether the subject is ovulation,
Calculating the length or thickness of each of the extracted crystal structure images;
Classifying the extracted crystal structure images based on the length or the thickness to generate classification data; And
And calculating a probability related to the ovulation using the classification data. 2. The method according to claim 1, wherein the probability of the ovulation is calculated using the classification data.

Images