KR20250123977A - A method and system for provide customized exercise solutions - Google Patents

Abstract

The present invention provides a method and system for providing a customized exercise solution, comprising: (a) a step in which a photographing unit photographs a subject to be measured, (b) a step in which a vision sensor unit obtains location information on skeleton points for each part of the subject to be measured, (c) a step in which an image processing unit displays a virtual line for measuring a plurality of postures on an image captured from the photographing unit, (d) a step in which an information processing unit generates physical fitness evaluation information for evaluating the physical fitness of the subject to be measured based on the image in which the virtual line is displayed, (e) a step in which an information processing unit generates posture evaluation information for evaluating the posture of the subject to be measured based on the location information, and (f) a step in which a solution unit reflects the posture evaluation information in the physical fitness evaluation information to provide a customized exercise solution suitable for the subject to be measured.

Description

A method and system for providing customized exercise solutions

The present invention relates to a method and system for providing a customized exercise solution, and more particularly, to a method and system for providing a customized exercise solution that provides an exercise solution suited to the physical condition of a subject by reflecting the subject's posture evaluation information into the physical evaluation information that evaluates the subject's physical strength.

In general, exercise is known to be an essential element for maintaining health, and the needs of modern people who want to lead a healthy life are increasing.

Accordingly, fitness centers, Pilates studios, and yoga studios are popping up all over society to promote the health of modern people.

However, busy modern people often find it difficult to consistently visit fitness centers with set workout times. For this reason, interest in home workouts, or exercise programs done at home, is on the rise, and the number of YouTube workout content and home workout apps is on the rise.

In the case of existing video content or applications for home training, feedback is provided to help users achieve the correct posture by comparing the image of the trainer or avatar teaching exercise movements with the user's skeleton data.

However, this method has the problem of being inefficient because it follows a set exercise video without considering the user's physical characteristics or physical condition, resulting in the user not being able to follow the exercise video or not knowing which exercises can supplement the deficiencies.

(Patent Document 1) Patent Registration No. 10-1945339 (January 29, 2019)

The purpose of the present invention to solve the above problems is to provide a method and system for providing a customized exercise solution, in which a camera unit captures images of various postures of a subject in real time, a vision sensor unit generates physical evaluation information that evaluates the physical strength of the subject by using the skeleton points of the subject displayed in the images, a posture evaluation information that evaluates the posture of the subject based on images of the frontal posture and side posture of the subject, and a solution unit reflects the posture evaluation information in the physical evaluation information to provide a customized exercise solution suitable for the subject.

The technical problems to be solved by the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

In order to achieve the above object, the present invention provides a method for providing a customized exercise solution, comprising: (a) a step in which a photographing unit photographs a subject; (b) a step in which a vision sensor unit obtains location information on skeleton points for each part of the subject; (c) a step in which an image processing unit displays a virtual line for measuring a plurality of postures on an image captured by the photographing unit; (d) a step in which an information processing unit generates physical fitness assessment information for evaluating the physical fitness of the subject based on the image in which the virtual line is displayed; (e) a step in which an information processing unit generates posture assessment information for evaluating the posture of the subject based on the location information; and (f) a step in which a solution unit reflects the posture assessment information in the physical fitness assessment information to provide a customized exercise solution suitable for the subject.

In an embodiment of the present invention, the step (a) may be characterized by including: (a1) a step in which the photographing unit photographs the front of the subject of measurement; and (a2) a step in which the photographing unit photographs the side of the subject of measurement.

In an embodiment of the present invention, the step (a1) may be characterized by including: (a11) a step of the photographing unit photographing the front of the subject in a standing state; and (a12) a step of the photographing unit photographing the front of the subject in a sitting state on a chair.

In an embodiment of the present invention, the step (b) may be characterized by including: (b1) a step in which the vision sensor unit receives an image of the subject of measurement transmitted from the photographing unit; (b2) a step in which the vision sensor unit displays a skeleton point for each joint of the subject of measurement in the image; and (b3) a step in which the vision sensor unit obtains location information for the skeleton point displayed for each joint.

In an embodiment of the present invention, the image includes a first image taken from the front of the subject while sitting on a chair, a second image taken from the front of the subject while standing, a third image taken from the side of the subject while standing, and a fourth image taken from the side of the subject while standing and a space in front of the subject while standing, and the virtual lines include a first reference line (PL1), a second reference line (PL2), a third reference line (PL3), a fourth reference line (PL4), a fifth guide line (PL5), a first guide line (GL1), a second guide line (GL2), a third guide line (GL3), and a fourth guide line (GL4), and the plurality of postures include a first posture in which the subject sits on the chair and then stands up 30 seconds later and then sits on the chair again, a second posture in which the subject stands up and down with both heels, and a second posture in which the subject lifts one of both feet off the ground while standing. Including a third posture in which the other foot of the two feet is moved back and forth by half the length of the other foot in the state, and then moved back and forth by the length of the other foot, and a fourth posture in which the subject walks, wherein step (c) comprises: (c1) a step in which the image processing unit generates the first reference line (PL1) horizontally with respect to the ground in the first image so as to connect both shoulders of the subject in the first image; (c2) a step in which the image processing unit generates the second reference line (PL2) horizontally with respect to the ground in the second image so as to connect both pelvises of the subject in the second image; (c3) a step in which the image processing unit generates the third reference line (PL3) horizontally with respect to the ground in the second image so as to connect both ankles of the subject in the second image; (c4) a step in which the image processing unit generates the fourth reference line (PL4) vertically with respect to the ground in the third image so as to divide the subject into left and right halves in the third image; (c5) a step in which the image processing unit generates the first guide line (GL1) in the third image so as to pass through one shoulder and one arm of the subject while being positioned on one side of the fourth reference line (PL4) in the third image; (c6) a step in which the image processing unit generates the second guide line (GL2) in the third image so as to pass through the other shoulder and the other arm of the subject while being positioned on the other side of the fourth reference line (PL4) in the third image; (c7) a step in which the image processing unit generates the fifth reference line (PL5) in the fourth image so as to be perpendicular to the ground so as to divide the subject into left and right sides in the fourth image; (c8) a step in which the image processing unit generates the third guide line (GL3) in the fourth image so as to be positioned in front of the fifth reference line (PL5) in the fourth image so as to be parallel to the fifth reference line (PL5); And (c9) the image processing unit may be characterized by including a step of generating the fourth guide line (G4) in the fourth image so that the fourth guide line (G4) is positioned in front of the third guide line (GL3) in the fourth image and is parallel to the fifth reference line (PL5).

In an embodiment of the present invention, the physical fitness evaluation information includes first counting information, second counting information, motion information, and walking speed information, and the step (d) comprises: (d1) a step in which, when the subject of measurement assumes the first posture, the information processing unit counts each time the subject's both shoulders and the first reference line (PL1) coincide, thereby generating the first counting information; (d2) a step in which, when the subject of measurement assumes the second posture, the information processing unit counts each time the subject's both heels alternately coincide with the third reference line (PL3) in a state in which the subject's both shoulders and the second reference line (PL2) coincide, thereby generating the second counting information; (d3) a step of generating distance information about a distance that the fourth reference line (PL4) of the measurement subject moves toward at least one of the first guide line (GL1) and the second guide line (GL2) during the measured time and motion information about a shaking motion at the same time as the information processing unit measures time when the measurement subject assumes the third posture; (d4) a step of generating the walking speed information of the measurement subject by measuring the time that both shoulders of the measurement subject pass from the third guide line (GL3) to the fourth guide line (GL4) when the measurement subject assumes the fourth posture;

In an embodiment of the present invention, the posture evaluation information includes frontal posture evaluation information and side posture evaluation information, and the step (e) may include: (e1) a step in which the information processing unit generates the frontal posture evaluation information for frontal posture evaluation items including head alignment, shoulder alignment, hip alignment, knee alignment, and ankle alignment in the second image; and (e2) a step in which the information processing unit generates the side posture evaluation information for side posture evaluation items including head tilt, shoulder roll, thoracic kyphosis, lumbar lordosis, and back teeth in the third image.

In an embodiment of the present invention, the step (e1) includes: (e11) a step in which the information processing unit determines that the head alignment is normal if the first angle formed by the first virtual line connecting both ears of the subject is less than 3 and the second reference line (PL2); (e12) a step in which the information processing unit determines that the shoulder alignment is normal if the second angle formed by the second virtual line connecting both shoulders of the subject is less than 3 and the second reference line (PL2); (e13) a step in which the information processing unit determines that the hip alignment is normal if the third angle formed by the third virtual line connecting both hips of the subject is less than 3 and the second reference line (PL2); (e14) a step in which the information processing unit determines that the knee alignment is normal if the fourth angle formed by the fourth virtual line connecting both knees of the subject is less than 3 and the second reference line (PL2); And (e15) a step of the information processing unit determining that the ankle alignment is normal if the fifth angle formed by the fifth virtual line connecting both ankles of the subject of measurement and the second reference line (PL2) is less than 3;

In an embodiment of the present invention, the step (e2) comprises: (e21) a step in which the information processing unit determines that the head tilt is normal if the sixth angle formed by the sixth virtual line connecting the nose and the neck of the subject and the fifth reference line (PL5) is less than 3; (e22) a step in which the information processing unit determines that the shoulder tilt is normal and there is no shoulder roll if the seventh angle formed by the seventh virtual line connecting the shoulder and the elbow of the subject and the fifth reference line (PL5) is less than 3; (e23) a step in which the information processing unit determines that the subject is normal and there is no thoracic kyphosis if the eighth angle formed by the eighth virtual line connecting the center of the distance between the 6th and 7th vertebrae of the subject and the chest is less than 3; (e24) a step in which the information processing unit determines that the subject is normal without lumbar lordosis if the ninth angle formed by the ninth virtual line connecting the center of the distance between the 6th and 7th vertebrae of the subject and the hip and the fifth reference line (PL5) is less than 3; and (e25) a step in which the information processing unit determines that the subject is normal without lumbar lordosis if the tenth angle formed by the tenth virtual line connecting the knee and ankle of the subject and the fifth reference line (PL5) is less than 3.

In an embodiment of the present invention, the step (f) may be characterized by including: (f1) a step in which the solution unit reflects the posture evaluation information in the physical evaluation information; and (f2) a step in which the solution unit provides a customized exercise solution necessary for the subject of measurement based on a result of reflecting the posture evaluation information in the physical evaluation information.

In addition, the present invention for achieving the above-described purpose provides a customized exercise solution providing system characterized by including a photographing unit as described above; a vision sensor unit as described above; an image processing unit as described above; an information processing unit as described above; and a solution unit as described above.

The effect of the present invention according to the above configuration is that the shooting unit shoots images of various postures of the subject in real time, the vision sensor unit generates physical evaluation information that evaluates the physical strength of the subject by using the skeleton points of the subject displayed in the image, the posture evaluation information that evaluates the posture of the subject based on images of the frontal posture and side posture of the subject is generated, and the solution unit reflects the posture evaluation information in the physical evaluation information to provide a customized exercise solution suitable for the subject, thereby supporting effective exercise.

The effects of the present invention are not limited to the effects described above, and should be understood to include all effects that can be inferred from the detailed description of the present invention or the composition of the invention described in the claims.

FIG. 1 is a flowchart illustrating a method for providing a customized exercise solution according to one embodiment of the present invention.
FIG. 2 is a block diagram showing a system for providing a customized exercise solution according to one embodiment of the present invention.
FIG. 3 is a drawing showing an image processing unit setting a first reference line for a first posture of a measurement subject in a method for providing a customized exercise solution according to one embodiment of the present invention.
FIG. 4 is a drawing showing an image processing unit setting a second reference line and a third reference line for a second posture of a subject of measurement in a method for providing a customized exercise solution according to one embodiment of the present invention.
FIG. 5 is a drawing showing an image processing unit setting a fourth reference line, a first guide line, and a second guide line for a third posture of a subject of measurement in a method for providing a customized exercise solution according to one embodiment of the present invention.
FIG. 6 is a drawing showing an image processing unit setting a fifth reference line, a third guide line, and a fourth guide line for a fourth posture of a measurement subject in a method for providing a customized exercise solution according to one embodiment of the present invention.
FIG. 7 is a conceptual diagram showing a vision sensor unit setting a skeleton point in a method for providing a customized exercise solution according to one embodiment of the present invention.

Hereinafter, the present invention will be described with reference to the attached drawings. However, the present invention can be implemented in various different forms and is therefore not limited to the embodiments described herein. In the drawings, irrelevant parts have been omitted for clarity of description, and similar parts have been designated with similar reference numerals throughout the specification.

Throughout the specification, when a part is said to be "connected (connected, contacted, or coupled)" to another part, this includes not only cases where it is "directly connected," but also cases where it is "indirectly connected" with another part in between. Furthermore, when a part is said to "include" a component, this does not exclude other components, but rather implies that it may include other components, unless otherwise specifically stated.

The terminology used herein is merely used to describe specific embodiments and is not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this specification, it should be understood that the terms "comprises" or "has" indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but do not exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

FIG. 1 is a flowchart illustrating a method for providing a customized exercise solution according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating a method for providing a customized exercise solution according to an embodiment of the present invention.

Referring to FIGS. 1 and 2, a method for providing a customized exercise solution according to an embodiment of the present invention includes (a) a step (S100) in which a photographing unit (110) photographs a subject to be measured, (b) a step (S200) in which a vision sensor unit (120) obtains location information on skeleton points for each body part of the subject to be measured, (c) a step (S300) in which an image processing unit (130) displays a virtual line for measuring a plurality of postures on an image captured from the photographing unit (110), (d) a step (S400) in which an information processing unit (140) generates physical fitness evaluation information that evaluates the physical fitness of the subject to be measured based on the image on which the virtual line is displayed, (e) a step (S500) in which an information processing unit (140) generates posture evaluation information that evaluates the posture of the subject to be measured based on the location information, and (f) a step (S600) in which a solution unit (150) reflects the posture evaluation information in the physical fitness evaluation information to provide a customized exercise solution suitable for the subject to be measured.

Specifically, the above step (a) includes a step (a1) in which the photographing unit (110) photographs the front of the subject of measurement, and a step (a2) in which the photographing unit (110) photographs the side of the subject of measurement.

Here, the camera unit (110) may be a web cam.

FIG. 3 is a diagram showing that the image processing unit sets a first reference line for the first posture of the subject in a method for providing a customized exercise solution according to an embodiment of the present invention. FIG. 4 is a diagram showing that the image processing unit sets a second reference line and a third reference line for the second posture of the subject in a method for providing a customized exercise solution according to an embodiment of the present invention. FIG. 5 is a diagram showing that the image processing unit sets a fourth reference line, a first guide line, and a second guide line for the third posture of the subject in a method for providing a customized exercise solution according to an embodiment of the present invention. FIG. 6 is a diagram showing that the image processing unit sets a fifth reference line, a third guide line, and a fourth guide line for the fourth posture of the subject in a method for providing a customized exercise solution according to an embodiment of the present invention.

Specifically, the above step (a1) includes a step of photographing the front of a subject in a standing state by the photographing unit (110) as illustrated in FIG. 4 (a11) and a step of photographing the front of a subject in a sitting state by the photographing unit (110) as illustrated in FIG. 3 (a12).

FIG. 7 is a conceptual diagram showing a vision sensor unit setting a skeleton point in a method for providing a customized exercise solution according to one embodiment of the present invention.

Referring to FIG. 7, the step (b) includes (b1) a step in which the vision sensor unit (120) receives an image of the subject being measured transmitted from the photographing unit (110), (b2) a step in which the vision sensor unit (120) displays skeleton points for each joint of the subject being measured in the image, and (b3) a step in which the vision sensor unit (120) obtains location information for the skeleton points displayed for each joint.

Here, the images captured by the shooting unit (110) and transmitted to the vision sensor unit (120) include a first image captured from the front of the subject in a sitting position on a chair as shown in FIG. 3, a second image captured from the front of the subject in a standing position as shown in FIG. 4, a third image captured from the side of the subject in a standing position as shown in FIG. 5, and a fourth image captured from the side of the subject in a standing position and the space in front of the subject in a standing position as shown in FIG. 6.

In addition, the virtual lines include the first reference line (PL1) illustrated in FIG. 3, the second reference line (PL2) illustrated in FIG. 4, the third reference line (PL3) illustrated in FIG. 4, the fourth reference line (PL4) illustrated in FIG. 5, the fifth guide line (PL5) illustrated in FIG. 6, the first guide line (GL1) illustrated in FIG. 5, the second guide line (GL2) illustrated in FIG. 5, the third guide line (GL3) illustrated in FIG. 6, and the fourth guide line (GL4) illustrated in FIG. 6.

In addition, the plurality of postures include a first posture in which the subject sits on the chair, stands up 30 seconds later, and then sits on the chair again, as shown in FIG. 3; a second posture in which the subject stands and raises and lowers both heels, as shown in FIG. 4; a third posture in which the subject stands and lifts one of the feet off the ground and then steps back and forth by half the length of the other foot, as shown in FIG. 5; and a fourth posture in which the subject walks, as shown in FIG. 6.

Specifically, the first posture (30-second chair sit-stand) is one cycle in which the subject sits on a chair for 30 seconds, stands up, and then sits on the chair again. The second posture (walking in place) is one cycle in which the subject walks in place, with one foot going up and down, and the other foot going up and down. The third posture (side-by-side, semi-tendon, tendon) is one cycle in which the subject places both feet side by side, then one foot goes back and forth half the length of the other foot, and then the other foot goes back and forth the length of the other foot. The fourth posture (walking) is one cycle in which the subject walks along the third guide line (GL3) and the fourth guide line (GL4).

In the above step (b2), the skeleton points are the nose (0), both eyebrows (the other eyebrow (1, 2, 3), one eyebrow (5, 6, 7)), both ends of the mouth (9, 10), both shoulders (the other shoulder (11), one shoulder (10)), both elbows (the other elbow (13), one elbow (14)), both wrists (the other wrist (15), one wrist (16)), both fingertips (one little finger (17), one middle finger tip (19), one thumb tip (21), the other little finger tip (18), the other middle finger tip (20), the other thumb tip (22)), both ends of the waist (the other end of the waist (23), one end of the waist (24)), both knees (the other knee (25), one knee (26)), both ankles (the other The ankle (27), one ankle (28)), both feet (the other foot heel (29), the other foot toe tip (31), one foot heel (30), one toe tip (32)) can be set and displayed in the video.

The step (c) above comprises: (c1) a step in which the image processing unit (130) creates a first reference line (PL1) horizontally to the ground in the first image to connect both shoulders of the subject in the first image; (c2) a step in which the image processing unit (130) creates a second reference line (PL2) horizontally to the ground in the second image to connect both pelvises of the subject in the second image; (c3) a step in which the image processing unit creates a third reference line (PL3) horizontally to the ground in the second image to connect both ankles of the subject in the second image; (c4) a step in which the image processing unit (130) creates a fourth reference line (PL4) vertically to the ground in the third image to divide the subject in the third image into left and right; (c5) a step in which the image processing unit (130) creates a first guide line (GL1) in the third image to pass through one shoulder and one arm of the subject in the third image while being located on one side of the fourth reference line (PL4) in the third image; (c6) a step of generating a second guide line (GL2) in the third image so as to pass through the other shoulder and the other arm of the subject while the image processing unit (130) is positioned on the other side of the fourth reference line (PL4) in the third image, (c7) a step of generating a fifth reference line (PL5) in the fourth image so as to be perpendicular to the ground so as to divide the subject into left and right sides in the fourth image, (c8) a step of generating a third guide line (GL3) in the fourth image so as to be parallel to the fifth reference line (PL5) while the image processing unit (130) is positioned in front of the fifth reference line (PL5) in the fourth image, and (c9) a step of generating a fourth guide line (G4) in the fourth image so as to be parallel to the fifth reference line (PL5) while the image processing unit is positioned in front of the third guide line (GL3) in the fourth image.

In the above step (c1), the image processing unit (130) sets a first reference line (PL1) that connects both shoulders of the measurement subject while being parallel to the ground in the first image as shown in FIG. 3, and displays it in the first image.

Additionally, the first reference line (PL1) is fixed at the set position once it is set.

Next, in the above steps (c2) and (c3), the image processing unit (130) sets a second reference line (PL2) and a third reference line (PL3) that are parallel to the ground and connect both sides of the pelvis of the subject and both ankles of the subject, respectively, in the second image, as shown in FIG. 4, and displays them on the second image.

Additionally, the second reference line (PL2) and the third reference line (PL3) are fixed to the set positions once set.

Next, in the above steps (c4), (c5) and (c6), the image processing unit (130) sets the fourth reference line (PL4), the first guide line (GL1) and the second guide line (GL2) to be parallel to each other in the third image as shown in FIG. 5 and displays them in the third image.

Here, the first and second guide lines (GL1, GL2) are fixed at the set positions once set, while the fourth reference line (PL4) moves along with the movement of the subject of measurement.

Next, in the above steps (c7), (c8) and (c9), the image processing unit (130) sets a fifth reference line (PL4) that is perpendicular to the ground and divides the left and right sides of the measurement subject as shown in FIG. 6, a third guide line (GL3) positioned in front of the fifth reference line (PL4), and a fourth guide line (GL4) that is spaced a predetermined distance from the third guide line (GL3) and is parallel to the third guide line (GL3), and these are displayed in the fourth image.

Although Figure 6 is a photograph taken from above looking at the front side of the subject of measurement, it is preferable that the photographing unit (110) be horizontal to the ground and photograph the space in which the subject of measurement walks.

Here, the third and fourth guide lines (GL3, GL4) are fixed at the set positions once set, while the fifth reference line (PL5) moves along with the movement of the subject of measurement.

Physical fitness evaluation information includes first counting information, second counting information, movement information, and walking speed information.

The step (d) above is a step in which (d1) when the subject of measurement assumes a first posture, the information processing unit (140) counts each time the subject's both shoulders and the first reference line (PL1) coincide, thereby generating first counting information, (d2) when the subject of measurement assumes a second posture, the information processing unit (140) counts each time the subject's both heels alternately coincide with the third reference line (PL3) while the subject's both shoulders and the second reference line (PL2) coincide, thereby generating second counting information, (d3) when the subject of measurement assumes a third posture, the information processing unit (140) measures the time and simultaneously generates distance information and motion information on the shaking motion of the subject's fourth reference line (PL4) during the measured time, (d4) when the subject of measurement assumes a fourth posture, the information processing unit (140) generates the It includes a step of generating walking speed information of a subject by measuring the time it takes for both shoulders to pass from the third guide line (GL3) to the fourth guide line (GL4).

Specifically, referring to FIG. 3, in the step (d1), the information processing unit (140) counts once each time the shoulders of the measurement subject in the first posture coincide with the first reference line (PL1) or go below the first reference line (PL1), thereby generating first counting information.

Next, referring to FIG. 4, in step (d2), the information processing unit (140) counts once each time when the shoulders of the subject in the second posture are aligned with the second reference line (PL2) and the heels of the subject in the second posture are aligned with the third reference line (PL3) or go below the third reference line (PL3), thereby generating second counting information.

Specifically, when the subject's shoulders are aligned with the second reference line (PL2), and one of the subject's heels rises and then falls, if the heel of one of the subject's heels aligns with the third reference line (PL3) or falls below the third reference line (PL3), and when the other of the subject's heels rises and then falls, if the other heel aligns with the third reference line (PL3) or falls below the third reference line (PL3), it is counted as one time.

Next, referring to FIG. 5, in the step (d3), the information processing unit (140) calculates the degree to which the fourth reference line (PL4) moves toward the first and second guide lines (GL1, GL2) when the fourth reference line (PL4) moves due to the movement of the measurement subject taking the third posture, thereby generating motion information.

Motion information can be calculated through the slope of the fourth reference line (PL4) moving based on the first and second guide lines (GL1, GL2), the change in distance between the first and second guide lines (GL1, GL2) and the fourth reference line (PL4), etc.

Referring to Fig. 5, one cycle is defined as one in which the subject's feet are positioned side by side as shown in Fig. 5A, one foot of the subject's feet moves as shown in Fig. 5B, and then is positioned again as shown in Fig. 5A, and one foot of the subject moves as shown in Fig. 5C and then is positioned again as shown in Fig. 5A.

Accordingly, the information processing unit (140) generates motion information each time the subject of measurement performs the third posture in one cycle.

Next, referring to FIG. 6, in step (d4), when the subject of measurement performs the fourth posture, the information processing unit (140) measures the measurement time from when the subject's shoulder passes the third guide line (GL3) to when it passes the fourth guide line (GL4), and then measures the subject's walking speed by dividing the preset distance between the third guide line (GL3) and the fourth guide line (GL4) by the measurement time.

Posture evaluation information includes frontal posture evaluation information and side posture evaluation information.

The above step (e) includes a step of (e1) generating frontal posture evaluation information for frontal posture evaluation items including head alignment, shoulder alignment, hip alignment, knee alignment, and ankle alignment in the second image by the information processing unit (140), and a step of (e2) generating side posture evaluation information for side posture evaluation items including head tilt (Forward Head Posture), shoulder roll (Round Shoulder), thoracic kyphosis (Thoracic Kyphosis), lumbar lordosis (Lumbar Lordosis), and back knee (Back Knee) in the third image by the information processing unit (140).

In the frontal posture evaluation information, head alignment is classified as normal or abnormal according to the head alignment angle calculated in [Mathematical Formula 1] below, and the degree of abnormality is determined.

The head alignment angle (θ1) is the angle (=inclination) formed by the first imaginary line connecting both ears and the horizontal line.

[Mathematical Formula 1]

Head alignment angle (θ1) =

Next, shoulder alignment is classified as normal or abnormal based on the shoulder alignment angle calculated in [Mathematical Formula 2] below, and the degree of abnormality is determined.

The shoulder alignment angle (θ2) is the angle (= slope) formed by the second imaginary line connecting both shoulders and the horizontal line.

[Equation 2]

Shoulder alignment angle (θ2) =

Next, hip alignment is classified as normal or abnormal based on the hip alignment angle calculated in [Mathematical Formula 3] below, and the degree of abnormality is determined.

The hip alignment angle (θ3) is the angle (= slope) formed by the third imaginary line connecting both hips and the horizontal line.

[Equation 3]

Hip alignment angle (θ3) =

Next, knee alignment is classified as normal or abnormal based on the knee alignment angle calculated in [Mathematical Formula 4] below, and the degree of abnormality is determined.

The knee alignment angle (θ4) is the angle (= slope) formed by the fourth imaginary line connecting both knees and the horizontal line.

[Equation 4]

Knee alignment angle (θ4) =

Next, ankle alignment is classified as normal or abnormal based on the ankle alignment angle calculated in [Mathematical Formula 5] below, and the degree of abnormality is determined.

The ankle alignment angle (θ5) is the angle (=inclination) formed by the fifth imaginary line connecting both ankles and the horizontal line.

[Equation 5]

Ankle alignment angle (θ5) =

Evaluation items
(Skeleton Point) Normal range Abnormal Clinical significance 1 degree (mild) 2 degrees (medium) 3rd degree (severe) Head Alignment
(Ear-Left, Ear_Right) θ1<3 3≤θ1<5 5≤θ1<10 10≤θ1 head asymmetry Shoulder Alignment (Shoulder-Left, Shoulder_Right) θ2<3 3≤θ2<5 5≤θ2<10 10≤θ2 shoulder asymmetry Hip Alignment (Hip-Left, Hip_Right) θ3<3 3≤θ3<5 5≤θ3<10 10≤θ3 pelvic asymmetry Knee Alignment (Knee-Left, Knee_Right) θ4<3 3≤θ4<5 5≤θ4<10 10≤θ4 knee asymmetry Ankle Alignment (Ankle-Left, Ankle_Right) θ5<3 3≤θ5<5 5≤θ5<10 10≤θ5 ankle asymmetry

Meanwhile, in the side evaluation information, the head tilt (Forward Head Posture) is classified as normal or abnormal according to the head tilt angle calculated in [Mathematical Formula 6] below, and the degree of abnormality is determined.

The head tilt angle (θ6) is the angle (=inclination) that the sixth imaginary line connecting the nose and neck makes with the vertical line.

[Equation 6]

Head tilt angle (θ6) =

Next, the round shoulder is classified as normal or abnormal based on the shoulder rounding angle calculated in [Mathematical Formula 7] below, and the degree of abnormality is determined.

The shoulder roll angle (θ7) is the angle (= slope) that the seventh imaginary line connecting the shoulder and elbow makes with the vertical line.

[Equation 7]

Shoulder roll angle (θ7) =

Next, thoracic kyphosis is classified as normal or abnormal based on the angle calculated in [Mathematical Formula 8] below, and the degree of abnormality is determined.

Here, thoracic kyphosis is the degree to which the back is curved, and the back angle (θ8) is the angle (=inclination) that the 8th imaginary line connecting one of the vertebrae (Mid Spine) and the chest (Chest) makes with the vertical line.

For example, one of the 12 vertebrae (Mid Spine) can be either the 6th vertebra or the 7th vertebra.

More specifically, it is preferable that the back angle (θ8) be the angle formed by the 8th imaginary line connecting the center of the distance between the 6th and 7th vertebrae of the subject and the chest and the 5th reference line (PL5).

[Equation 8]

Back angle (θ8) =

Next, lumbar lordosis is classified as normal or abnormal based on the lumbar angle calculated in [Mathematical Formula 9] below, and the degree of abnormality is determined.

Here, lumbar lordosis is a condition in which the lower back is excessively extended and the hips are pushed back compared to the normal body shape, giving the appearance of a duck's buttocks, and the lumbar angle (θ9) is the angle (=inclination) that the ninth imaginary line connecting one of the vertebrae (Mid Spine) and the hips makes with the vertical line.

For example, one of the 12 vertebrae (Mid Spine) can be either the 6th vertebra or the 7th vertebra.

More specifically, it is desirable that the back angle (θ8) be the angle formed by the ninth imaginary line connecting the center of the distance between the 6th and 7th vertebrae of the subject and the hip.

[Equation 9]

Waist angle (θ9) =

Next, the back knee is classified as normal or abnormal based on the shin angle calculated in [Mathematical Formula 10] below, and the degree of abnormality is determined.

Here, Back Knee refers to the state in which the knee is hyperextended backward when the knee is straightened, and the shin angle (θ10) refers to the angle (=inclination) formed by the 10th imaginary line connecting the knee and ankle and the vertical line.

[Equation 10]

Shin angle (θ10) =

Evaluation items
(Skeleton Point) Normal range Abnormal Clinical significance 1 degree (mild) 2 degrees (medium) 3rd degree (severe) Forward Head Posture
(Nose, Neck) θ1<3 3≤θ1<5 5≤θ1<10 10≤θ1 Forward head posture Round Shoulder(Shoulder, elbow) θ2<3 3≤θ2<5 5≤θ2<10 10≤θ2 round shoulders Thoracic Kyphosis (Mid Spine, Chest) θ3<3 3≤θ3<5 5≤θ3<10 10≤θ3 thoracic kyphosis Lumbar Lordosis (Mid Spine, Hip) θ4<3 3≤θ4<5 5≤θ4<10 10≤θ4 lumbar lordosis Back Knee (Knee, Ankle) θ5<3 3≤θ5<5 5≤θ5<10 10≤θ5 Jeonbanseul

Next, referring to [Table 1], the step (e1) is: (e11) a step in which the information processing unit (140) determines that the head alignment is normal if the first angle (θ1) formed by the first virtual line connecting the ears of the subject and the second reference line (PL2) is less than 3, (e12) a step in which the information processing unit (140) determines that the shoulder alignment is normal if the second angle (θ2) formed by the second virtual line connecting the shoulders of the subject and the second reference line (PL2) is less than 3, (e13) a step in which the information processing unit (140) determines that the hip alignment is normal if the third angle (θ3) formed by the third virtual line connecting the hips of the subject and the second reference line (PL2) is less than 3, (e14) a step in which the information processing unit (140) determines that the hip alignment is normal if the fourth angle (θ4) formed by the fourth virtual line connecting the knees of the subject and the second reference line (PL2) is less than 3, A step of determining that the knee alignment is normal and (e15) a step of determining that the ankle alignment is normal by the information processing unit (140) if the fifth angle (θ5) formed by the fifth virtual line connecting both ankles of the subject of measurement with the second reference line (PL2) is less than 3.

In the above steps (e11) to (e15), if the first to fifth angles (θ1, θ2, θ3, θ4, θ5) are 3 or more, the information processing unit (140) determines that the frontal posture of the subject of measurement is abnormal.

Specifically, the information processing unit (140) determines that the first to fifth angles (θ1, θ2, θ3, θ4, θ5) are minor when they are 3 or more and less than 5, determines that the degree of abnormality is moderate when they are 5 or more and less than 10, and determines that the degree of abnormality is serious when they are 10 or more when they are 10 or more.

Next, referring to [Table 2], the step (e2) is a step in which the information processing unit (140) determines that the head tilt is normal if the sixth angle (θ6) formed by the sixth virtual line connecting the nose and neck of the subject and the fifth reference line (PL5) is less than 3, (e21) a step in which the information processing unit (140) determines that the head tilt is normal if the seventh angle (θ7) formed by the seventh virtual line connecting the shoulder and elbow of the subject and the fifth reference line (PL5) is less than 3, (e22) a step in which the information processing unit (140) determines that the subject is normal without shoulder rolling if the seventh angle (θ7) formed by the seventh virtual line connecting the shoulder and elbow of the subject and the fifth reference line (PL5) is less than 3, (e23) a step in which the information processing unit (140) determines that the subject is normal without thoracic kyphosis if the eighth angle (θ8) formed by the eighth virtual line connecting the center of the distance between the 6th and 7th vertebrae of the subject and the chest is less than 3, (e24) a step in which the 9th angle formed by the center of the distance between the 6th and 7th vertebrae of the subject and the hip is less than 3, If the ninth angle (θ9) formed by the virtual line with the fifth reference line (PL5) is less than 3, the information processing unit (140) determines that the subject is normal without lumbar lordosis, and (e25) if the tenth angle (θ10) formed by the tenth virtual line connecting the knee and ankle of the subject is less than 3, the information processing unit (140) determines that the subject is normal without lumbar lordosis.

In the above steps (e21) to (e25), if the 6th to 10th angles (θ6, θ7, θ8, θ9, θ10) are 3 or more, the information processing unit (140) determines that the lateral posture of the subject of measurement is abnormal.

Specifically, the information processing unit (140) determines that the abnormality is minor when the 6th to 10th angles (θ6, θ7, θ8, θ9, θ10) are 3 or more and less than 5, determines that the abnormality is moderate when the 6th to 10th angles (θ6, θ7, θ8, θ9, θ10) are 5 or more and less than 10, and determines that the abnormality is serious when the 6th to 10th angles (θ6, θ7, θ8, θ9, θ10) are 10 or more.

Lastly, the above step (f) includes a step (f1) in which the solution unit (150) reflects the detailed evaluation information in the physical evaluation information, and a step (f2) in which the solution unit (150) provides a customized exercise solution necessary for the subject of measurement based on the result of reflecting the detailed evaluation information in the physical evaluation information.

Specifically, in the above step (f1), the solution unit (150) reflects the physical fitness evaluation information (=one of upper, middle, lower) and the posture evaluation information (=1st, 2nd, 3rd degree among normal and abnormal).

Next, in the above step (f2), the solution unit (150) provides a customized exercise solution necessary for the subject of measurement based on the result of reflecting the detailed evaluation information in the physical fitness evaluation information.

In the above step (f2), the dance-type exercise solution includes seated exercise (step 1 exercise), standing bodyweight exercise (step 2 exercise), and standing vigorous exercise (including ball games, etc.) (step 3 exercise).

If the physical fitness evaluation information for the first to fourth postures is upper and the posture evaluation information is normal, the solution unit (150) provides a three-stage exercise as a customized exercise solution.

In addition, if the physical fitness evaluation information for the first to fourth postures is high, while the posture evaluation information is one of the first, second, and third degrees of abnormality, the solution unit (150) suggests the second-stage exercise, which is one level lower than the third-stage exercise, as a dance-type exercise.

2. Customized exercise solution provision system (100)

Hereinafter, a customized exercise solution providing system according to one embodiment of the present invention will be described with reference to FIG. 2.

Referring to FIG. 2, a customized exercise solution providing system (100) for implementing a method for providing a customized exercise solution according to the above-described method includes a photographing unit (110), a vision sensor unit (120), an image processing unit (130), an information processing unit (140), and a solution unit (150).

The photographing unit (110) is a device for photographing the subject of measurement and the space in which the subject of measurement will walk. For a detailed description thereof, please refer to the above.

The vision sensor unit (120) obtains location information for skeleton points for each part of the subject of measurement, and for a detailed description of the vision sensor unit (120), refer to the above.

The image processing unit (130) displays a virtual line for measuring multiple postures on the image captured from the photographing unit (110). For a detailed description of the image processing unit (130), refer to the above.

The information processing unit (140) generates physical fitness evaluation information that evaluates the physical fitness of the subject based on an image with a virtual line displayed, and generates posture evaluation information that evaluates the posture of the subject based on location information. For a detailed description of the information processing unit (140), refer to the above.

The solution unit (150) reflects the detailed evaluation information in the physical fitness evaluation information to provide a customized exercise solution suitable for the subject of measurement. For a detailed description of the solution unit (150), please refer to the above.

The foregoing description of the present invention is for illustrative purposes only, and those skilled in the art will readily appreciate that the present invention can be readily modified into other specific forms without altering the technical spirit or essential characteristics of the present invention. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single entity may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined manner.

The scope of the present invention is indicated by the claims described below, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention.

100: Customized Exercise Solution System
110: Filming Department
120: Vision sensor section
130: Image processing unit
140: Information Processing Department
150: Solutions Department

Claims (11)

(a) A step in which the filming unit films the subject of measurement;
(b) a step in which the vision sensor unit acquires location information for skeleton points for each part of the subject of measurement;
(c) a step in which the image processing unit displays a virtual line for measuring multiple postures on the image captured from the photographing unit;
(d) A step in which the information processing unit generates physical fitness assessment information that evaluates the physical fitness of the subject of measurement based on the image in which the virtual line is displayed;
(e) a step in which the information processing unit generates posture evaluation information that evaluates the posture of the subject of measurement based on the location information; and
(f) A method for providing a customized exercise solution, characterized in that it includes a step in which the solution unit reflects the posture evaluation information in the physical fitness evaluation information to provide a customized exercise solution suitable for the subject of measurement.
In the first paragraph,
Step (a) above,
(a1) a step in which the photographing unit photographs the front of the subject of measurement; and
(a2) A method for providing a customized exercise solution, characterized in that it includes a step of the photographing unit photographing the side of the subject of measurement.
In the second paragraph,
The above step (a1) is:
(a11) a step of taking a picture of the front of the subject of measurement while the photographing unit is standing; and
(a12) A method for providing a customized exercise solution, characterized by including a step of the photographing unit photographing the front of the subject of measurement while sitting on a chair.
In the first paragraph,
Step (b) above,
(b1) a step in which the vision sensor unit receives an image of the measurement subject transmitted from the photographing unit;
(b2) a step in which the vision sensor unit displays skeleton points for each joint of the measurement subject in the image; and
(b3) A method for providing a customized exercise solution, characterized by including a step of obtaining location information for skeleton points displayed for each joint by the vision sensor unit.
In the fourth paragraph,
The above image includes a first image taken from the front of the subject while sitting on a chair, a second image taken from the front of the subject while standing, a third image taken from the side of the subject while standing, and a fourth image taken from the side of the subject while standing and the space in front of the subject while standing.
The above virtual lines include a first reference line (PL1), a second reference line (PL2), a third reference line (PL3), a fourth reference line (PL4), a fifth guide line (PL5), a first guide line (GL1), a second guide line (GL2), a third guide line (GL3), and a fourth guide line (GL4).
The above multiple postures include a first posture in which the subject sits on the chair, stands up 30 seconds later, and then sits on the chair again, a second posture in which the subject raises and lowers both heels while standing, a third posture in which the subject lifts one of the feet off the ground while standing and then steps back and forth by half the length of the other foot, and then steps back and forth by the length of the other foot, and a fourth posture in which the subject walks.
Step (c) above,
(c1) A step in which the image processing unit creates the first reference line (PL1) horizontally to the ground in the first image so as to connect both shoulders of the measurement subject in the first image;
(c2) A step in which the image processing unit creates the second reference line (PL2) horizontally to the ground in the second image so as to connect both sides of the pelvis of the subject of measurement in the second image;
(c3) A step in which the image processing unit creates the third reference line (PL3) horizontally to the ground in the second image so as to connect both ankles of the subject of measurement in the second image;
(c4) A step in which the image processing unit creates the fourth reference line (PL4) perpendicular to the ground in the third image so as to divide the measurement subject into left and right sides in the third image;
(c5) A step in which the image processing unit generates the first guide line (GL1) in the third image so as to pass through one shoulder and one arm of the measurement subject while being located on one side of the fourth reference line (PL4) in the third image;
(c6) A step in which the image processing unit generates the second guide line (GL2) in the third image so as to pass through the other shoulder and other arm of the measurement subject while being located on the other side of the fourth reference line (PL4) in the third image;
(c7) A step in which the image processing unit creates the fifth reference line (PL5) perpendicular to the ground in the fourth image so as to divide the measurement subject into left and right sides in the fourth image;
(c8) a step of generating the third guide line (GL3) in the fourth image so that the image processing unit is positioned in front of the fifth reference line (PL5) in the fourth image and parallel to the fifth reference line (PL5); and
(c9) A method for providing a customized exercise solution, characterized in that it comprises a step of generating the fourth guide line (G4) in the fourth image so that the fourth guide line (G4) is positioned in front of the third guide line (GL3) in the fourth image and is parallel to the fifth reference line (PL5).
In paragraph 5,
The above physical fitness evaluation information includes first counting information, second counting information, movement information, and walking speed information.
Step (d) above,
(d1) A step in which the information processing unit counts each time the shoulders of the subject and the first reference line (PL1) coincide when the subject assumes the first posture, thereby generating the first counting information;
(d2) A step of generating the second counting information by counting each time the heels of the subject's feet alternately coincide with the third reference line (PL3) while the subject's shoulders coincide with the second reference line (PL2) when the subject assumes the second posture;
(d3) A step of generating distance information on the distance that the fourth reference line (PL4) of the measurement subject moves toward at least one of the first guide line (GL1) and the second guide line (GL2) during the measured time and the motion information on the shaking motion at the same time as the information processing unit measures the time when the measurement subject takes the third posture;
(d4) A method for providing a customized exercise solution, characterized in that it includes a step of generating the walking speed information of the subject by measuring the time taken by the information processing unit for both shoulders of the subject to pass from the third guide line (GL3) to the fourth guide line (GL4) when the subject takes the fourth posture.
In paragraph 5,
The above detailed evaluation information includes frontal posture evaluation information and side posture evaluation information.
Step (e) above,
(e1) a step in which the information processing unit generates frontal posture evaluation information for frontal posture evaluation items including head alignment, shoulder alignment, hip alignment, knee alignment, and ankle alignment in the second image; and
(e2) A method for providing a customized exercise solution, characterized in that it comprises a step in which the information processing unit generates the lateral posture evaluation information for the lateral posture evaluation items including head tilt, shoulder roll, thoracic kyphosis, lumbar lordosis, and back teeth in the third image.
In paragraph 7,
The above step (e1) is,
(e11) If the first angle formed by the first virtual line connecting both ears of the subject of measurement with the second reference line (PL2) is less than 3, the step of the information processing unit determining that the head alignment is normal;
(e12) If the second angle formed by the second virtual line connecting the shoulders of the subject of measurement with the second reference line (PL2) is less than 3, the step of the information processing unit determining that the shoulder alignment is normal;
(e13) If the third angle formed by the third virtual line connecting both hips of the subject of measurement with the second reference line (PL2) is less than 3, the step of the information processing unit determining that the hip alignment is normal;
(e14) If the fourth angle formed by the fourth virtual line connecting both knees of the subject of measurement with the second reference line (PL2) is less than 3, the step of the information processing unit determining that the knee alignment is normal; and
(e15) A method for providing a customized exercise solution, characterized in that it includes a step of the information processing unit determining that the ankle alignment is normal if the fifth angle formed by the fifth virtual line connecting both ankles of the subject of measurement with the second reference line (PL2) is less than 3.
In paragraph 7,
The above step (e2) is,
(e21) If the sixth angle formed by the sixth virtual line connecting the nose and neck of the subject of measurement with the fifth reference line (PL5) is less than 3, the step of the information processing unit determining that the head tilt is normal;
(e22) If the seventh angle formed by the seventh virtual line connecting the shoulder and elbow of the subject of measurement with the fifth reference line (PL5) is less than 3, the step of the information processing unit determining that the shoulder is normal and does not have a roll;
(e23) If the eighth angle formed by the eighth virtual line connecting the center of the distance between the 6th and 7th vertebrae of the subject and the chest and the fifth reference line (PL5) is less than 3, the step of the information processing unit determining that the subject is normal without thoracic kyphosis;
(e24) If the ninth angle formed by the ninth virtual line connecting the center of the distance between the 6th and 7th vertebrae of the subject and the hip is less than 3, the step of the information processing unit determining that the subject is normal without lumbar lordosis; and
(e25) A method for providing a customized exercise solution, characterized in that it includes a step of determining, by the information processing unit, that the subject is normal without the white teeth if the 10th angle formed by the 10th virtual line connecting the knee and ankle of the subject is less than 3.
In the first paragraph,
Step (f) above,
(f1) a step in which the solution unit reflects the posture evaluation information in the physical fitness evaluation information; and
(f2) A method for providing a customized exercise solution, characterized by including a step of providing a customized exercise solution necessary for the subject of measurement based on the result of the solution unit reflecting the posture evaluation information in the physical fitness evaluation information.
The filming unit according to Article 1;
Vision sensor unit according to Article 1;
Image processing unit according to Article 1;
Information processing unit according to Article 1; and
A customized exercise solution providing system characterized by including a solution unit according to Article 1.