KR20190104085A - Method and system for step recommender based on pose calibration - Google Patents

Abstract

According to one embodiment of the present invention, a method for recommending a step based on the posture measurement can comprise the steps of: analyzing an image of a posture of a user and determining whether the posture correction is necessary by a smartphone; receiving pressure distribution of a weight of the user from sensors attached to shoes of the user by the smartphone; and providing an alarm when it is determined that the posture correction of the user is necessary and the weight distribution of the weight is biased.

Description

Step proposed method and system based on pose measurement {Method and system for step recommender based on pose calibration}

The present invention relates to a method and a system for suggesting a step based on posture measurement. More specifically, the present invention relates to a method for measuring a subject's posture, analyzing a measured posture, and suggesting a step capable of correcting the analyzed posture, and a system for performing the method.

As the aging society progresses, the fall issue of the elderly is becoming a social issue. A fall is a sudden fall of your body due to an unintentional posture change, regardless of your intention. Maintaining the right posture and gait may be helpful as a way to resolve falls.

According to statistics from the National Statistical Office, women aged 65 or older had a 25.9% chance of falling for one year and a 54% chance of experiencing sequelae after falling. In order to minimize such fall damage, it is important to determine this early and cope with it quickly. Therefore, studies are being conducted to determine the fall in real time.

For example, in the invention of 10-2017-0133003 A (2017.12.05) of the Korea Advanced Institute of Science and Technology, a wearable device such as a smart band is worn and a fallback is determined in real time by responding to a wearable device such as a smart band. I'm trying to.

In the existing researches, we developed an algorithm to determine the fall based on the acceleration and angular velocity measured at a specific part of the human body (chest / waist / thigh) when the fall occurs.However, when using the inertial sensor, the inertial value observed in everyday life and falls Because there was no obvious difference in the change of, the fall was not detected properly or the normal operation was mistaken as a fall.

Therefore, there is a growing need for a method that can prevent falls at the source prior to a fall determination method that can distinguish a fall from a behavior in everyday life in real time.

The problem to be solved by the present invention is to provide a step proposal method based on the posture measurement and a system for performing the method.

The problem to be solved by the present invention is not limited to the problem (s) mentioned above, and other object (s) not mentioned will be clearly understood by those skilled in the art from the following description.

According to one or more exemplary embodiments, a method for suggesting a step based on posture measurement includes: analyzing, by a smartphone, an image of a user's posture and determining whether posture correction is necessary; Receiving, by the smartphone, a pressure distribution of the weight of the user from a sensor attached to the shoe of the user; And providing an alarm when the weight distribution of the weight is biased when the smartphone determines that the posture correction of the user is necessary.

Preferably, analyzing the image of the posture of the user, and determining whether or not posture correction is necessary, the smart phone, using augmented reality on a user screen (GUI) for capturing the posture of the user Providing a grid may include.

Preferably, analyzing the photographed image of the user's posture and determining whether posture correction is necessary, determining whether posture correction is necessary based on the position of the anatomical part of the user in the image. It may include.

Preferably, the step of determining whether posture correction is necessary based on the position of the anatomical part of the user in the image, when the image of the back of the user, connecting the ends of both ears of the user The method may include determining whether a left and right deflection occurs based on whether the horizontal line is tilted and the tilted angle.

Preferably, the step of determining whether posture correction is necessary based on the position of the anatomical part of the user in the image, when the image of the back of the user, connecting both shoulders of the user The method may include determining whether left and right deflections are generated based on whether the horizontal line is inclined and the inclined angle.

Preferably, the step of determining whether posture correction is necessary based on the position of the anatomical part of the user in the image, when the image is photographing the back of the user, connecting the two charging of the user The method may include determining whether left and right deflections are generated based on whether the horizontal line is inclined and the inclined angle.

Preferably, determining whether posture correction is necessary on the basis of the position of the anatomical part of the user in the image, when the image of the side of the user is taken, the ear, shoulder, shoulder of the user The method may include determining whether the front and rear deflections are generated based on whether the vertical line connecting the electrons, the knees, and the peach bones is inclined and the inclination angle.

Preferably, when it is determined that the posture correction of the user is necessary, the step of providing an alarm when the pressure distribution of the body weight is biased, the posture of the user is left and right deflection occurs, the angle of the left and right deflection Only when it is determined that posture correction is necessary based on the above, it may include providing an alarm when the distribution of the pressure is left or right.

Preferably, the step of providing an alarm when the distribution of pressure is left or right biased, calculating a threshold of left and right deflection of body weight based on the left and right deflection angles; And providing an alarm when the pressure distribution is included in a preset range based on a threshold of left and right deflection of the weight.

Preferably, in the case where it is determined that the posture correction of the user is necessary, the step of providing an alarm when the pressure distribution of the body weight is biased, the posture of the user is generated before and after deflection, the angle of the front and rear deflection Only when it is determined that posture correction is necessary based on the above, it may include providing an alarm when the distribution of the pressure is shifted before or after.

Preferably, the step of providing an alarm when the distribution of the pressure is before or after the shifting comprises: calculating a threshold of forward and backward deflection of the body weight based on the angle of the forward and backward deflection; And providing an alarm when the pressure distribution is included in a preset range based on a threshold of the front and rear deflection of the weight.

According to another aspect of the present invention, there is provided a step proposal system based on a posture measurement, comprising: a sensing device attached to a user's shoe and measuring a pressure distribution of the user's weight; And analyzing the photographed image of the user's posture, determining whether posture correction is necessary, receiving the pressure distribution from the sensing device, and determining that the posture correction of the user is necessary. If a bias occurs, it may include a smartphone that provides an alarm.

By using the present invention, it is possible to propose a gait for measuring the posture of the examinee and analyzing the measured posture to correct the posture. In other words, it is possible to maintain the health of the foot by suggesting the width of the step and the speed of the step according to the characteristics of each individual. This can help prevent falls and reduce accidents.

Furthermore, based on foot plantar pressure, the positional change of the human body pressure center may be observed, and postural stability may be determined. Through this, the behavior of everyday life and the fall can be compared and applied to the development of fall judgment method.

Effects of the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a view for explaining a process of taking a picture in a conventional posture measuring method.
2A to 2B are diagrams for explaining an actual state of photographing a posture in a conventional posture measuring method.
3 is a view for explaining a process of taking a picture to measure the posture in the proposed step proposed by the present invention.
4 is a view for explaining the actual state of taking a picture for measuring the posture in the proposed method proposed in the present invention.
5 to 6 are diagrams for explaining a process of calibrating the gait in the method for suggesting a step based on the posture measurement according to an embodiment of the present invention.
8 is a view for explaining a step suggestion system based on posture measurement according to an embodiment of the present invention.
9 is a flowchart illustrating a step suggestion method based on a posture measurement according to an embodiment of the present invention.

As the present invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. In describing the drawings, similar reference numerals are used for similar elements.

Terms such as first, second, A, and B may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art, and are not construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention will be described in detail.

1 is a view for explaining a process of taking a picture in a conventional posture measuring method.

Posture is a shape that maintains the body and the human posture is maintained by the coordination of the ligaments and muscles, which are attached to the head, spine, pelvis, lower extremity, and control. Its center is the spine, which is a very flexible column where many vertebrae are joined by an elastic body called an intervertebral disc, which causes changes in posture due to the antagonism of many bends and extensions.

A good posture is a state in which the most efficient and forgetting of the minimum fatigue is performed in a timely manner, and the minimum necessary muscles are released to release all tensions, that is, the unnecessary energy is not consumed. If you look like this:

The good and bad of the posture is generally assessed by the lateral posture when standing at rest. Kendall, in the United States, is guided by a centerline based on a vertical line suspended from a thread in physiological and epidemiological terms. In a correct posture, the centerline passes from the ear to the shoulder joint, through the rib cage, the middle of the abdomen, and the antagonist.

Then, the deviation from this line is classified as a bad posture. When a part of the body is deviated from a certain arrangement, it becomes unstable, and another part moves to maintain an equilibrium relationship to compensate for the instability at this time. At this time, the posture habits that compensate for the instability will be formed bad posture.

As for sitting posture, the height, depth, inclination and inclination of the back and back of the seating surface are important. The height is equal to the length of the lower thigh, the thigh is horizontal or the knee is a little higher, but higher than this will be easy to fatigue because the extensor of the waist is working.

If the depth is not shorter than the length of the thigh, the back of the knee is compressed, and for a long time, blood circulation disorders of the lower leg. The slope is suitable for offices at 3-5 ° and for relaxation at 15 °. The backrest should be 100 ~ 110 ° for office and 115 ~ 130 ° for rest. The bend of the backrest should be gentler than the bend of the recess when standing.

If the bend is large, stress is exerted on the intervertebral disc and the back is prone to fatigue. In a good chair, it is balanced and does not work on the extension or flexion of the waist, but the important thing is that it is easy to bend muscles and intervertebral discs, even if you sit in a good chair, so it is good to change the position and move constantly.

In the stomach and the stomach, the higher the pillow, the neck becomes the frontal vertebrae, which causes stiff shoulders. Lying down is governed by whether your bed or lying floor is soft or hard. In a soft, soft bed, the stomach and stomach are rounded, causing the entire spinal column to circulate, compressing the intestines, obstructing breathing, and stretching the abdominal muscles, leaving fatigue in the morning. In the side and stomach, the spine causes only side. On a rather hard bed, the side and position can be taken so that the centerline of the spine is parallel to the bed.

This posture, which is beyond the good posture described above, corresponds to the bad posture. Specifically, the head includes a forward head, a backward head, a backward head, a crooked neck, and the like. Chests include flat chests, funnel chests, pigeon chests, and one sided chest.

Shoulders also include round shoulders, high-low shoulders, winged scapula shoulders, and weak development shoulders. In addition, the spine includes scoliosis, spinal lordosis, and kyphosis. Finally, the legs include O-shaped legs, X-shaped legs, Tibia torsion, and Pronated legs.

In particular, lifestyles created by bad posture have been pointed out as a major cause of fall of the elderly. However, falls can be lowered by prevention and prediction rather than by accident, and efforts to identify the fall situation and identify the risk factors of falls are necessary to effectively prevent falls.

Fall prevention exercises include strength exercises, balance exercises, and taping therapies. In particular, if you try to maintain a good posture with your usual lifestyle through balance exercise, you can effectively prevent falls. To this end, it is necessary to determine whether the user's posture is a good posture or a bad posture.

Referring to Figure 1, you can see taking a picture in a standing posture. In order to take a picture, a grid is displayed on a background 1 m behind the examinee, and a picture is taken at a distance of about 3 m from the examinee. In this way, you can take pictures of the front, side, and back to see how your posture is in everyday life.

That is, conventionally, the screen is installed on the wall, and the T-shaped lines are 50 cm in the direction of the wall at a distance of 1 m, and the digital camera is installed so as to be parallel to the display line of the digital camera monitor at 3 m from the horizontal line of the T. Was done. The postures were taken by the examinee looking at the wall and standing at the T-shaped vertical line, and turned to the side by 90 degrees.

At this time, the examinee induces the most comfortable posture so that the examinee is not aware of the shooting. If you're a woman, tie your hair with a braid to make your ears visible. The posture allows the arms to fall down naturally without gathering the arms, and the feet naturally stand shoulder width. Do not induce a specific foot shape.

In addition, the examiner should take care that the hand holding the camera does not leave the shooting position, and measure the screen, the center of the examiner, and the camera in a straight line. In addition, the camera screen should be leveled with the back of the camera and leveled for accurate measurement.

You can shoot front, side, and back in a comfortable position, and take the front, side, and back side six times by telling you to take the most correct posture that you feel.You can determine whether posture correction is necessary by analyzing the shots. have. However, such a conventional posture measuring method has a lot of inconvenience.

2A to 2B are diagrams for explaining an actual state of photographing a posture in a conventional posture measuring method.

Referring to FIG. 2A, there is a background in which a grid is displayed, and the photograph is taken from the front of the examinee, and it can be seen that the captured image is analyzed. Referring to FIG. 2B, there is a background in which a grid is displayed, and the photograph is taken from the side of the examinee to analyze the captured image. As such, in the related art, a background such as a grid paper is set for the posture measurement, and the posture is photographed in front of it. This method requires preparation for posture measurement, and it is inconvenient because it can be taken only in a predetermined space.

In addition, conventionally, in order to determine the information on the posture, the point is set at a position corresponding to the main skeleton in the photographed picture. Referring to Figure 2a or 2b it can be seen that the red point is set on the points such as shoulders, neck, waist. In the past, the examiner added to the image of such a point. In other words, prior to analyzing the image, a posture measurement expert manually set points and analyzed the images.

In order to solve such a conventional space constraint and manual inconvenience, the present invention proposes a method for providing a grid on a photographing screen in an augmented reality (Augmented Reality) method. We also suggest a method for setting points automatically using image analysis or markers.

3 is a view for explaining a process of taking a picture to measure the posture in the proposed step proposed by the present invention.

Referring to FIG. 3, the present invention does not require a background on which a grid is displayed, unlike in FIG. 1. It also eliminates the need to place the camera at a point marked by a separate T and about 3m away from it. Instead, the present invention can simplify the process of taking a picture for measuring posture using a device such as a smartphone.

To this end, in the present invention, it is possible to position the grid on the screen and take a picture through the AR. In addition, the examiner can skip the process of additionally displaying the skeleton and automatically determine the position of the skeleton through image analysis. This will be described in more detail with reference to FIG. 4.

In the present invention, after taking an image, it may be determined whether posture correction is necessary by analyzing the image. For this purpose, the posture can be confirmed by displaying a horizontal line connecting both shoulder peaks, a horizontal line connecting protrusions on both thighs, and a vertical line connecting the spine.

In addition, the side-image shows the vertical warfare between the ear canal, shoulder center, trochanter, one-third of the knee, in front of the ankle bone, and one quarter of the foot length to determine how well you are standing. Can be. Later, he can measure the angle of the vertical and horizontal lines to determine if posture correction is necessary.

FIG. 4 is a diagram for describing an actual image of photographing a posture in a step suggesting method based on posture measurement according to an embodiment of the present invention.

Referring to FIG. 4, a screen for capturing an image through a photographing device such as a smartphone can be seen. At this time, you can see that the grid is located on the screen, not the actual background. In addition, by taking a picture, an image obtained by synthesizing a grid with the captured image can be generated.

At this time, the smartphone's 3-axis sensor is used to check if the position of the smartphone is balanced in the horizontal and vertical directions from the ground. If the balance is not achieved, the camera provides a visual or audio alarm to prevent the photographer from moving horizontally and vertically. Encourage them to take pictures while in balance.

In addition, instead of manually setting the points for skeletal analysis by the examinee, image analysis can automatically set the points. Alternatively, the subject may automatically set a point by taking a marker made in the form of a sticker before taking a picture, and identifying the marker.

Referring to the left photograph of the rear side of FIG. 4, the first horizontal line connecting both ear ends, the second horizontal line connecting both shoulder ends, the third horizontal line connecting both armpits, and the fourth horizontal line connecting both waists. You can check it. In addition to this horizontal line, the first vertical line drawn from the parietal to the spine can be identified.

In addition, referring to the right photograph of the side of Figure 4, by drawing a second vertical line connecting the ears, shoulders, trochanter, knees, peach bones to determine whether the subject's posture bent forward or backward relative to the side can do. Here, the lime green line is the reference line, and the red line shows the second vertical line connecting the anatomical positions mentioned above in the photograph of the actual examinee. By comparing the reference line with the second vertical line, it is possible to determine the correct posture of the examinee.

At this time, the degree of inclination of the left and right heads may be determined by measuring the degree of inclination of the first horizontal line connecting both ears. In addition, it is possible to determine whether the left and right shoulder deflection by measuring the degree of inclination of the second horizontal line connecting both shoulder ends. In addition, the degree of inclination of the waist left and right may be determined by measuring the degree of inclination of the fourth horizontal line connecting both waists. In addition, it is possible to determine whether the left and right deflection of the spine by measuring the inclination of the first vertical line drawn along the spine.

Such deformation may also be determined through a second vertical line connecting anatomical positions in the image of the rear surface. Through the second vertical line, it is possible to determine whether the front and rear of the spine and the head before and after the deflection. In this way, deflection is found for each position, and if the degree of deflection is severe, a gait step for correcting the deflection may be suggested.

In particular, the degree of deflection appears as a shift in weight, which is reflected in the gait. Thus, the present invention provides an alarm to the user so that the gait can be corrected by analyzing the pressure of the gait. Through this, it is possible to correct the posture by correcting the gait from the usual lifestyle, and further prevent the fall caused by the unstable posture.

5 to 8 are diagrams for explaining a process of calibrating a gait in a step suggestion method based on posture measurement according to an embodiment of the present invention.

In the image photographing the front or the rear of the user, the left and right deflections and the degree of the left and right deflections may be obtained based on the horizontal line. In addition, the image of the user's side can be obtained whether the front and rear deflection and the degree of forward and backward deflection based on the vertical line. The correct posture should have no slope of the horizontal line as shown in FIG. 5 and the vertical line should also be straight.

With this in mind, it is possible to use a shoe with a pressure sensor as shown in FIG. 6 so that the user can walk correctly. The pressure sensor is attached to one 110, two balls (120, 130) on both sides of the big toe, two (140, 150) on the heel. However, this is only an example to help understand the invention, the position or number of the pressure sensor may vary.

Shoes can tell whether the user's weight is carried in front, behind, left or right. This can encourage the user to distribute the left and right weights to offset the tilt of the horizon. Similarly, the user can recommend front and rear weight variance to offset the tilt of the vertical line in the image taken from the side.

For example, looking at the picture taken the back side in Figure 4, it can be seen that the inclination to the right of the first horizontal line connecting both ends of the ear. When walking in such a posture, the weight is loaded to the right, and when analyzing the actual weight of the weight sensor, the second pressure sensor 120 corresponding to the right part in FIG. 6 is the third pressure sensor. Weight will be higher than 130.

In this case, therefore, if more weight is carried on the right side, an alarm may be provided to induce the user to intentionally carry the weight to the left. Of course, even after measuring the posture, the user who actually takes the correct posture can see the weight-bearing portion depending on the terrain when walking, so in this case there is no need to provide an alarm for posture correction.

In other words, if a user simply attaches a pressure sensor to a shoe and provides information for correcting a gait based only on the measured value of the pressure sensor, the pressure may be temporarily unevenly distributed according to the user's posture depending on the terrain. Since an alarm is not necessary, the present invention aims to provide an alarm by measuring a posture separately and in conjunction with the posture.

In particular, it can be used as a reference for providing an alarm of the gait based on the degree of deflection of the posture measured during the posture measurement process. For example, in the image photographing the back of the user, the degree of left and right deflection may be calculated using several horizontal lines and vertical lines.

More specifically, a first horizontal line connecting both ears, a second horizontal line connecting both shoulders, a third horizontal line connecting both axillas, a fourth horizontal line connecting both waists, and a first vertical line drawn from the crown to the spine Suppose you have At this time, each horizontal line can be displayed as 0 degrees when the left and right balance is in a balanced state, and +/- angles can be displayed accordingly when it is biased to either the left or right. In addition, even when the vertical line is biased to either the left or the right, +/- angle can be displayed accordingly.

7 shows the results of photographing and analyzing the back of a specific user. The first horizontal line is shifted to the left side and the right side is lifted by about +1 degree, the third horizontal line is shifted to the left side and the right side is lifted by about +1.5 degrees, and the second horizontal line and the fourth horizontal line are left to right balanced. The first vertical line connecting the central portion of the hip along the spine from the first parietal is in a left-right balance state. In this case, the weight imbalance caused by the left and right deflection of each horizontal line can be calculated by the following Equation 1.

[Equation 1]

W = p1 * pw1 + p2 * pw2 + p3 * pw3 + p4 * pw4 + v * vw

In Equation 1, p1, p2, p3, and p4 are angles at which the fourth horizontal line is inclined left and right, respectively, and pw1, pw2, pw3, and pw4 are weights to be applied to the left and right deflection angles of each horizontal line. And v is the angle at which the first vertical line is inclined, and vw is a weight to be applied to the first vertical line.

To aid the convenience of the invention, suppose that it has a weight of pw1 = 0.5, pw2 = 1, pw3 = 2, pw4 = 4, vw = 8. Then, in the case of Figure 7 has a value of W = 1 * 0.5 + 1.5 * 2 = 3.5. That is, in the case of FIG. 7 according to Equation 1, about 3.5% of the weight is loaded on the left side of the right side.

Therefore, as shown in FIG. 6, the user's foot pressure is measured to calculate the weight of the right shoe and the left shoe, respectively, and if the difference is within a certain range based on 3.5%, the user walks step by step and intentionally loses the weight. You may suggest that you take a step further.

This provides a temporary weight deflection due to the curvature of the terrain, or if the user repeatedly walks on the stairs or the ground and repeatedly weighs the right foot and the left foot, and does not provide an alarm. You can provide an alarm and suggest that you take the right steps.

Proposing a gait based on posture measurements like this is more precisely tailored to the individual than simply installing pressure sensors on the right and left shoes and comparing their weights to provide an alarm if a certain threshold is exceeded. It is an advantage that an alarm can be provided by setting a threshold.

At this time, the weight in Equation 1 for calculating the difference in left and right weights generated by each horizontal line and vertical line may be obtained through supervised learning of machine learning. This allows an accurate correlation analysis of how much the angles of inclination of the horizontal and vertical lines affect the left and right deflections of body weight, respectively.

Similarly, by analyzing the image of the user's side and how much the angle of inclination before and after the second vertical line affects the forward and backward deflection of the weight, the machine learning can be used to calculate the weight to be applied to the forward and backward deflection. have. Through this, it is possible to more accurately set the threshold to suggest the gait to the user by the front and rear deflection of the weight.

8 is a view for explaining a step suggestion system based on posture measurement according to an embodiment of the present invention.

Referring to FIG. 8, the step suggesting system proposed by the present invention includes a sensing device 200 attached to a shoe together with a pressure sensor, and a smartphone 300 receiving and analyzing data from the sensing device and providing an alarm to a user. do.

The sensing device 200 may include a power supply unit 210, a pressure sensor 230, a control unit 220, and a communication unit 230. The communicator 230 transmits data measured by a smart phone through a wireless communication such as Bluetooth. Of course, the sensing device 200 may perform a role of analyzing data and providing an alarm, but the sensing device 200 performs only sensing and the smart phone 300 due to the limitation of the size to be attached to the shoe and the limitation of power and power. It is desirable to provide this analysis and alarm.

The smartphone 300 determines whether to provide an alarm by synthesizing the information on the posture of the user photographed together with the information on the pressure distribution of the sole. That is, when the user's posture is in a state in which the general posture is not correct and the correction is necessary, when the pressure deflection appears, the alarm may be provided by a method such as visual or auditory.

Conversely, if the user's posture is generally the correct posture, there is no need to provide an alarm even if pressure bias temporarily occurs. This may be because the bias is temporarily displayed due to geographic problems. In this case, the user's convenience can be enhanced by not providing an alarm.

9 is a flowchart illustrating a step suggestion method based on a posture measurement according to an embodiment of the present invention.

First, an image of a user is photographed (S1100). In this case, the screen is installed as in the prior art and the photographing is performed by using a device such as the smartphone 300 instead of photographing under a limited environment. This makes shooting easy.

Based on the photographic information of the user, the photographed image is analyzed to display a horizontal line and a vertical line. A correct posture will not cause bias, but a user with an incorrect posture will generally have left and right or back and forth biases.

If bias occurs and the degree of bias exceeds a preset threshold, it is determined that posture correction is necessary (S1200). When it is determined that posture correction is necessary, the user's pressure distribution is actually measured (S1300), and whether the posture correction is necessary is compared with the bias of the pressure (S1400).

For example, if the pressure distribution of the user whose usual posture is biased to the left is also biased to the left, an alarm is provided (S1500). Alternatively, if the pressure distribution of the user having a normal posture biased forward also biases forward, an alarm is provided (S1500).

At this time, if the alarm is provided using a threshold value for the difference between the left and right or the front and back of the weight calculated by the angle of inclination of the left and right or the front and rear, it may be able to provide a more personalized alarm. Through this, it is possible to recognize the occurrence of weight skew caused by a temporary terrain problem or the user walking continuously, and to exclude the alarm.

This process can help you easily correct your posture correction with your steps in your daily life. In addition, the user's convenience can be enhanced by reducing the frequency of alarms compared to simply providing alarms with only a pressure sensor. This induces the user to take a correct posture in normal times, thereby preventing a fall that is likely to occur due to the disturbance of the balance.

So far I looked at the center of the preferred embodiment for the present invention. Those skilled in the art will appreciate that the present invention can be implemented in a modified form without departing from the essential features of the present invention. Therefore, the disclosed embodiments should be considered in descriptive sense only and not for purposes of limitation. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the scope will be construed as being included in the present invention.

Claims (12)

Analyzing, by the smart phone, the image of the user's posture and determining whether posture correction is necessary;
Receiving, by the smartphone, a pressure distribution of the weight of the user from a sensor attached to the shoe of the user; And
If the smartphone determines that the posture correction of the user needs to include the step of providing an alarm when the pressure distribution of the weight is biased,
Step suggestion based on posture measurement. The method of claim 1,
Analyzing the image of the user's posture, and determining whether posture correction is necessary,
Comprising the step of providing the grid using augmented reality on the user screen (GUI) for capturing the posture of the user,
Step suggestion based on posture measurement. The method of claim 1,
Analyzing the image of the user's posture, and determining whether posture correction is necessary,
Determining whether posture correction is necessary based on the position of the anatomical part of the user in the image,
Step suggestion based on posture measurement. The method of claim 3,
Determining whether posture correction is necessary based on the position of the anatomical part of the user in the image,
When the image photographs the rear surface of the user, determining whether a horizontal line connecting both ends of the user is inclined and whether left and right deflection is generated based on the inclined angle,
Step suggestion based on posture measurement. The method of claim 3,
Determining whether posture correction is necessary based on the position of the anatomical part of the user in the image,
When the image photographs the rear surface of the user, determining whether a horizontal line connecting both shoulders of the user is inclined and whether left and right deflection is generated based on the inclined angle,
Step suggestion based on posture measurement. The method of claim 3,
Determining whether posture correction is necessary based on the position of the anatomical part of the user in the image,
When the image photographs the rear side of the user, determining whether a horizontal line connecting both of the user's opponents is inclined and whether left and right deflection is generated based on the inclined angle,
Step suggestion based on posture measurement. The method of claim 3,
Determining whether posture correction is necessary based on the position of the anatomical part of the user in the image,
When the image is photographed on the side of the user, determining whether a vertical line connecting the ear, the shoulder, the great trochanter, the knee, and the peach bone of the user is inclined and whether the front and rear deflection is generated based on the inclined angle Including,
Step suggestion based on posture measurement. The method of claim 1,
When it is determined that the posture correction of the user is necessary, the step of providing an alarm when the pressure distribution of the weight is biased,
And providing an alarm when the distribution of pressure is left or right only when it is determined that the posture of the user is left and right biased and that posture correction is necessary based on the angle of the left and right deflection. doing,
Step suggestion based on posture measurement. The method of claim 8,
Providing an alarm when the distribution of pressure is shifted left or right,
Calculating a threshold of left and right deflection of the body weight based on the left and right deflection angles; And
Providing an alarm when the pressure distribution falls within a preset range based on a threshold of left and right deflection of the body weight,
Step suggestion based on posture measurement. The method of claim 1,
When it is determined that the posture correction of the user is necessary, the step of providing an alarm when the pressure distribution of the weight is biased,
And providing an alarm when the distribution of the pressure is shifted forward or backward only when it is determined that the posture of the user occurs before and after deflection and the posture correction is necessary based on the angle of the forward and backward deflection. doing,
Step suggestion based on posture measurement. The method of claim 10,
Providing an alarm when the distribution of pressure occurs before or after,
Calculating a threshold of forward and backward deflection of body weight based on the angle of forward and backward deflection; And
Providing an alarm when the distribution of pressure falls within a preset range based on a threshold of front and rear deflection of the body weight,
Step suggestion based on posture measurement. A sensing device attached to a shoe of a user to measure a pressure distribution of the weight of the user; And
Analyzing the image of the user's posture, determining whether posture correction is necessary, receiving the pressure distribution from the sensing device, and determining that the posture correction of the user is necessary, the pressure distribution of the weight is biased If there is a smart phone that provides an alarm,
A step suggestion system based on posture measurement.

Images