KR102624020B1 - Automatic musculoskeletal diagnosis system using transitional posture evaluation method - Google Patents

Abstract

The present invention provides a posture selection unit that receives a captured image of a user's transitional posture movement captured by a 3D camera and extracts an image of the preparation posture and an image of the end posture from the received captured image, the posture selection unit A joint image measuring unit that extracts three-dimensional coordinates for each main feature point of the body from the images of the preparation posture and the end posture extracted from , and measures the plantar pressure distribution in the preparation posture and the plantar pressure distribution in the end posture. 3-dimensional coordinates for each main feature point of the body in the preparation posture and the end posture extracted from the plantar pressure distribution measurement unit and the joint image measurement unit, and in the preparation posture and the end posture measured by the plantar pressure distribution measurement unit It includes a posture analysis unit that performs movement analysis and evaluation of the transitional posture and analysis and evaluation of the plantar pressure distribution using the plantar pressure distribution of the user, and performs musculoskeletal evaluation of the user using the movement evaluation and plantar pressure distribution evaluation. This is about an automatic musculoskeletal system diagnosis system using a transitive posture assessment method.

Description

Automatic musculoskeletal diagnosis system using transitional posture evaluation method}

The present invention relates to a technology capable of automatically diagnosing musculoskeletal diseases. In particular, the preparatory position and the end position are automatically selected during an overhead squat operation, and the movement analysis line and foot pressure distribution of the main feature points of the body in the corresponding posture are acquired respectively. , It is about an automatic musculoskeletal diagnosis system using a transitional posture assessment method that performs musculoskeletal diagnosis by comparing it to a reference value or reference range and recommends a customized exercise program according to the evaluation results.

Movement shows the integrated function of the human body and systems including the muscular, skeletal, and nervous systems. There must be no structural problems in the skeleton, smooth nerve and muscle control, and normal movement occurs when the normal length-tension relationship that compensates for the appropriate length and strength of each muscle around the joint is within the normal range.

On the other hand, if normal movement is not possible and symptoms such as pain appear, musculoskeletal disease should be suspected.

In general, musculoskeletal diseases are health disorders caused by factors such as repetitive movements, inappropriate working posture, use of excessive force, physical contact with sharp surfaces, vibration, and temperature, and affect the nerves and muscles of the neck, shoulders, waist, and limbs. It is a disease that appears in the body and surrounding body tissues.

These musculoskeletal diseases are increasing every year due to changes in lifestyle patterns and aging, and accordingly, technologies and devices that can measure musculoskeletal diseases are being developed.

However, conventional technologies and devices for measuring musculoskeletal disorders can only measure static posture or the range of motion of some joints, and there is no device to diagnose musculoskeletal disorders by analyzing transitional posture evaluation movements such as overhead squats.

The problem to be solved by the present invention is to provide an automatic musculoskeletal diagnosis system using a transitional posture assessment method that diagnoses musculoskeletal problems for each body part through analysis of the user's specific exercise posture.

In addition, the problem that the present invention aims to solve is to rehabilitate transitional movements such as overhead squats by combining a joint image analysis device that can measure the movement of key body features and a foot pressure analysis device that can more accurately measure foot movement. It provides an automatic musculoskeletal diagnosis system using a transitional posture evaluation method that automatically evaluates using an engineering method and recommends a customized exercise program for each region based on the results.

In addition to the above tasks, embodiments according to the present invention can be used to achieve other tasks that are not specifically mentioned.

To solve the above problem, an automatic musculoskeletal system diagnosis system using a transitive posture assessment method according to an embodiment of the present invention receives images of the user's transitive posture movements captured by a 3D camera, and A posture selection unit that extracts images of the preparation posture and images of the end posture, and joint image measurement that extracts 3D coordinates for each main feature point of the body from the images of the preparation posture and the end posture extracted from the posture selection unit. A plantar pressure distribution measurement unit that measures the plantar pressure distribution in the preparation position and the plantar pressure distribution in the end position, and the main feature points of the body in the preparation position and the end position extracted from the joint image measurement unit. Perform movement analysis and evaluation for transitional postures and analysis and evaluation of plantar pressure distribution using the three-dimensional coordinates and plantar pressure distribution in the preparation position and the end position measured by the plantar pressure distribution measurement unit. It includes a posture analysis unit that performs a musculoskeletal evaluation of the user using movement evaluation and plantar pressure distribution evaluation.

The posture analysis unit generates a target motion analysis line and a reference motion analysis line for the first movement using the three-dimensional coordinate values of each main feature point corresponding to the preparation posture and the end posture, and the target motion analysis line and the reference motion analysis line. A movement evaluation unit that calculates the included angle between analysis lines and assigns an evaluation score according to the size of the calculated included angle, analyzes the user's plantar pressure distribution in the preparation position and the user's plantar pressure distribution in the end position. A plantar pressure distribution evaluation unit that measures changes in the intensity of the plantar pressure distribution in real time and assigns a score corresponding to the magnitude of the intensity change, and a score evaluated by the movement evaluation unit and a score evaluated by the plantar pressure distribution evaluation unit. It includes a musculoskeletal evaluation unit that identifies vulnerable body parts whose scores are below the standard.

In the above, when the first movement is a lumbar-pelvic-hip complex (LPHC) movement, the movement evaluation unit uses a straight line to connect the coordinates of the spine base feature point and the coordinates of the spine shoulder feature point in the image of the end posture. Generate a first vector for, generate a second vector for an ankle-knee auxiliary analysis line connecting the ankle feature point on one side and the knee feature point on one side with a straight line, and the angle between the first vector and the second vector. is calculated in the Y-Z plane and a preset score is assigned according to the size of the calculated included angle.

In the above, when the first movement is a shoulder complex movement, the movement evaluation unit generates a fourth vector for the shoulder complex movement analysis line connecting the coordinates of one shoulder feature point and the coordinates of one wrist feature point in the end posture with a straight line, , Generate a first vector for the LPHC motion analysis line connecting the coordinates of the spine base feature point and the coordinates of the spine shoulder feature point in the image of the end posture with a straight line, and the angle between the first vector and the fourth vector is Y-Z. It is calculated on a plane, and a preset score is assigned according to the size of the calculated included angle.

In the above, when the first movement is a pelvic movement, the movement evaluation unit calculates the difference between the Calculate and assign a preset score according to the size of the calculated difference value, generate a seventh vector from the coordinates of the right hip feature point to the coordinates of the left hip feature point, and between the eighth vector, which is a unit vector in the X direction, and the seventh vector. After calculating the included angle, a set score is assigned according to the size of the calculated included angle.

In the above, when the first movement is a lumbar arch movement, the movement evaluation unit calculates a ninth vector connecting the coordinates of the spine middle feature point at the center of the spine extracted from the end posture and the coordinates of the spine shoulder feature point located at the center of the shoulder, and the spine middle feature point. Generate a 10th vector connecting the coordinates of the spine base feature point located in the center of the pelvis, calculate the angle between the 9th vector and the 10th vector in the Y-Z plane, and score a score set according to the size of the calculated angle. Allocate.

In the above, when the first movement is a knee movement, the movement evaluation unit determines the 11th vector connecting the coordinates of one knee feature point and the coordinates of one pelvic feature point extracted from the end posture, and the coordinates of one ankle feature point and one knee feature point. An 12th vector located on an auxiliary line connecting the coordinates is generated, an included angle between the 11th vector and the 12th vector is calculated in the X-Y plane, and an evaluation score is assigned according to the size of the calculated included angle.

The posture selection unit determines that the time when the y-axis coordinate of one main feature point of the body begins to increase above a certain value is the first time when the user finishes the preparation posture and begins the descent movement, and sets the time point from the first time. The video frame before the time is selected as the image for the preparation posture, or the user selects the ending posture at the second time when the y-coordinate of one key feature point of the body, which had been increasing since the point of entering the lowering motion, begins to decrease again above a certain value. It is determined that the evaluation has ended, and an image frame before the set time from the second time point is selected as the image for the end posture.

The automatic musculoskeletal system diagnosis system using the transitive posture evaluation method according to an embodiment of the present invention may further include an exercise program providing unit that selects and provides exercise programs that can strengthen the user's vulnerable body parts received from the musculoskeletal system evaluation unit. You can.

According to an embodiment of the present invention, while the user performs a continuous overhead squat movement, the preparation posture and end posture that serve as evaluation standards are automatically selected and movement analysis is performed from the extracted feature points of major body joints in each selected posture. By providing precise analysis of lines and foot pressure distribution, the convenience of filming and analysis can be improved.

Additionally, according to an embodiment of the present invention, the accuracy of transitive motion analysis can be improved by simultaneously measuring movement of key feature points of body joints and measuring plantar pressure.

Additionally, according to an embodiment of the present invention, by presenting a personalized rehabilitation exercise program according to the evaluation results, rehabilitation training for vulnerable areas can be performed without the help of medical staff.

In addition to the above tasks, embodiments according to the present invention can be used to achieve other tasks that are not specifically mentioned.

Figure 1 is a conceptual diagram of an automatic musculoskeletal system diagnosis system using a transitive posture assessment method according to an embodiment of the present invention.
Figures 2 and 3 are diagrams showing the preparatory posture and the final posture of the overhead squat and the main characteristic points of the body according to an embodiment of the present invention.
Figure 4 is a block diagram of an automatic musculoskeletal system diagnosis system using a transitive posture assessment method according to an embodiment of the present invention.
Figure 5 is a diagram for explaining the creation and evaluation of a lumbar-pelvic-hip complex movement analysis line according to an embodiment of the present invention.
Figure 6 is a diagram for explaining the generation and evaluation of a shoulder complex movement analysis line according to an embodiment of the present invention.
Figure 7 is a diagram for explaining the creation and evaluation of a pelvic movement analysis line according to an embodiment of the present invention.
Figure 8 is a diagram for explaining the creation and evaluation of a lumbar arch movement analysis line according to an embodiment of the present invention.
Figure 9 is a diagram for explaining the creation and evaluation of a knee movement analysis line according to an embodiment of the present invention.
Figure 10 is a diagram for explaining plantar pressure distribution evaluation according to an embodiment of the present invention.
Figure 11 is a flowchart showing the operation of an automatic musculoskeletal system diagnosis system using a transitive posture assessment method according to an embodiment of the present invention.
Figure 12 is a diagram showing a screen outputting evaluation results of an automatic musculoskeletal system diagnosis system using a transitive posture evaluation method according to an embodiment of the present invention.

Below, with reference to the attached drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily implement the present invention. The present invention may be implemented in many different forms and is not limited to the embodiments described herein. In order to clearly explain the present invention in the drawings, parts not related to the description are omitted, and the same reference numerals are used for identical or similar components throughout the specification. Additionally, in the case of well-known and well-known technologies, detailed descriptions thereof are omitted.

In this specification, when a part “includes” a certain component, this means that it may further include other components rather than excluding other components, unless specifically stated to the contrary.

Hereinafter, an automatic musculoskeletal system diagnosis system using a transitive posture assessment method according to an embodiment of the present invention will be described with reference to the attached drawings.

First, with reference to Figure 1, the concept of automatic musculoskeletal system diagnosis technology using the transitive posture assessment method according to an embodiment of the present invention will be explained. Figure 1 is a conceptual diagram of an automatic musculoskeletal system diagnosis technology using a transitive posture assessment method according to an embodiment of the present invention.

In order to diagnose musculoskeletal diseases through posture analysis, it is important to select a posture that can confirm the range of possible joint movement, degree of muscle activation, and neuromuscular control ability, and transitional postures such as overhead squats are suitable for this posture. do.

Therefore, the automatic musculoskeletal diagnosis technology of the present invention performs musculoskeletal diagnosis by analyzing and evaluating transitional postures such as overhead squat.

In addition, the movement of the feet in transitional posture movements such as overhead squats is a clinically very important checkpoint and requires images taken from various directions for accurate diagnosis. The automatic musculoskeletal diagnosis technology of the present invention uses a 3D camera (10 ) to take pictures.

However, the 3D coordinates of the foot and ankle joints extracted from the 3D camera 10 are inaccurate due to mutual interference between the foot and the ground, object occlusion, whether shoes are worn, etc., and are not sufficient to observe and diagnose the compensation action of the foot.

Therefore, the automatic musculoskeletal system diagnosis technology of the present invention includes a joint image analysis technology that can measure the movement of the main feature points of the body shown in FIGS. 2 and 3 using images captured by the 3D camera 10, and a footrest 20. By combining foot pressure analysis technology that can more accurately measure foot movements using the user's foot pressure distribution acquired through the process, transitional movements such as overhead squats are automatically evaluated using a rehabilitation engineering method, and customized exercises for each part are provided based on the results. I recommend the program.

Figure 2 is a diagram showing the positions of main feature points of the body corresponding to the ready posture image viewed from the front, and Figure 3 (a) is a diagram showing the positions of main feature points of the body corresponding to the ready posture image viewed from the right side, Figure 3 (b) is a diagram showing the positions of main body features corresponding to the end posture image viewed from the right.

A system according to an embodiment of the present invention that implements the concept of the present invention described above will be described with reference to FIG. 4. Figure 4 is a block diagram of an automatic musculoskeletal system diagnosis system using a transitive posture assessment method according to an embodiment of the present invention.

Referring to Figure 4, the musculoskeletal system automatic diagnosis system (hereinafter referred to as 'musculoskeletal system automatic diagnosis system') using the transitive posture assessment method according to an embodiment of the present invention (100) includes a posture selection unit 110 and a joint image measurement unit. (120), a plantar pressure distribution measuring unit 130, a posture analysis unit 140, a storage unit 150, an exercise program providing unit 160, and a display unit 170. Here, the exercise program providing unit 160 ) can be omitted in some cases, and even when the display unit 170 is configured separately, the display unit 170 can be omitted.

The posture selection unit 110 receives the user's captured image captured by the 3D camera 10, and extracts an image for the preparation posture and an image for the final posture from the received captured image. Here, the user's captured image is an image captured while the user is performing an overhead squat operation. The overhead squat movement is a transitional movement in which the preparation position, lowering position, and ending position are performed sequentially.

Looking at the operation of selecting an image for the preparation posture, the posture selection unit 110 determines when the y-axis coordinate of the spine base feature point (P1) among the main feature points of the body begins to increase above a certain value It is determined that this is the first time point at which the preparation posture is completed and the descent movement begins, and the video frame before the set time from the first viewpoint is selected as the image for the preparation posture. As another example, in the example of selecting the preparation posture, when entering the descending motion, the y coordinates of all other main body feature points in addition to the feature points of the foot and ankle, which are fixed to the ground, also decrease, so that the spine base feature point (P1) In addition, other body characteristic points or multiple body main characteristic points can be used.

Next, looking at the operation of selecting an image for the end posture, the posture selection unit 110 causes the y-coordinate of the spine base feature point (P1), which increased after entering the descending motion, to begin to decrease again above a certain value. The second time point is determined to be the time when the user completes the end posture and the evaluation is completed, and the video frame before the set time from the second time point is selected as the image for the end posture. As another example, when the posture selection unit 110 monitors the y-coordinate change of the spine base feature point P1 on the time axis, the image of the section in which the slope of the y-coordinate change is maintained within a certain range may be selected as the image for the end posture. there is.

The joint image measurement unit 120 extracts three-dimensional coordinates for each main feature point of the body from the image for the preparation posture extracted from the posture selection unit 110, and each Extract 3D coordinates for key feature points of the body.

The plantar pressure distribution measuring unit 130 measures the user's foot pressure distribution and detects the user's plantar pressure distribution in the preparation posture and the user's plantar pressure distribution in the completion posture in conjunction with the posture selection unit 110. That is, the plantar pressure distribution measurement unit 130 detects the plantar pressure distribution at a first point in time when the posture selection unit 110 determines that the posture is the preparation posture, and detects the plantar pressure distribution at a second time point when it determines the end posture. Of course, the plantar pressure distribution measuring unit 130 can measure the plantar pressure distribution only at the first and second time points.

This plantar pressure distribution measuring unit 130 is installed on the footrest 20, detects the pressure applied by the user performing an overhead squat operation on the footrest 20, and measures the user's plantar pressure distribution with the sensed pressure. Measure. The foot pressure distribution measuring unit 130 can detect the user's plantar pressure using an array-type pressure measurement sensor array capable of measuring plantar pressure distribution.

The posture analysis unit 140 calculates the three-dimensional coordinates of each main feature point of the body for the preparation and end postures extracted from the joint image measurement unit 120 and the user's plantar pressure distribution measured by the plantar pressure distribution measurement unit 130. It performs a movement evaluation and plantar pressure distribution evaluation for the user's posture, that is, the user's transitional posture, and uses the movement evaluation and plantar pressure distribution evaluation to perform a musculoskeletal evaluation of the user and provide evaluation results.

To this end, the posture analysis unit 140 includes a movement evaluation unit 141, a plantar pressure distribution evaluation unit 142, and a musculoskeletal system evaluation unit 143.

The movement evaluation unit 141 uses the three-dimensional coordinate values of each main feature point corresponding to the preparation posture and the end posture to create a lumbar-pelvis-hip complex (LPHC) movement analysis line, a shoulder complex movement analysis line, a pelvic movement analysis line, At least one of the lumbar arch movement analysis line and the knee movement analysis line is created and evaluated using the created analysis line.

Here, with reference to FIG. 5 , the creation and evaluation of the lumbar-pelvis-hip complex (LPHC) movement analysis line performed by the movement evaluation unit 141 will be described. Figure 5 is a diagram for explaining the creation and evaluation of a lumbar-pelvic-hip complex movement analysis line according to an embodiment of the present invention.

The movement evaluation unit 141 is an LPHC movement analysis line that connects the coordinates of the spine base feature point (P1), which is the center of the pelvis, and the coordinates of the spine shoulder feature point (P2), which is the center feature point of the shoulder, in the image of the end posture with a straight line. is identified, and the first vector (V1) for the LPHC motion analysis line is generated. Here, if it is difficult to calculate the joint coordinates of the center of the shoulder in the process of creating the LPHC movement analysis line, the joint coordinates of the center of the chest or waist can be used.

And the movement evaluation unit 141 uses an ankle-knee assistance analysis line connecting the right ankle feature point (Ankel Right) (P3) and the right knee feature point (Knee Right) (P4) with a straight line and a second vector (V2) connecting them. Create. Of course, if the image of the end posture is an image taken of the user's left side, an ankle-knee auxiliary analysis line connecting the left ankle feature point (Ankel Left) and the left knee feature point (Knee Left) with a straight line can be created and the corresponding vector can be generated.

The motion evaluation unit 141 calculates the included angle between the first vector (V1) and the second vector (V2) in the Y-Z plane, and if the calculated included angle is greater than the reference value, it may be considered that there is excessive upper body bending, A preset score is assigned according to the size of the calculated included angle. In Figure 5, for easier graphical understanding, the origin of the second vector (V2) is moved to the spine base (P1).

Here, the degree of upper body and knee bending can be separately displayed by calculating the angle between the first vector (V1), the second vector (V2), and the third vector (V3), which is a unit vector in the z direction.

Next, with reference to FIG. 6 , the generation and evaluation of the shoulder complex movement analysis line performed by the movement evaluation unit 141 will be described. Figure 6 is a diagram for explaining the generation and evaluation of a shoulder complex movement analysis line according to an embodiment of the present invention.

The movement evaluation unit 141 generates a shoulder complex movement analysis line connecting the right shoulder feature point (Spine Right) (P4) and the right wrist feature point (Wrist Right) (P5) with a straight line in the end posture, and Generate a fourth vector (V4) for And the motion evaluation unit 141 calculates the included angle between the second vector (V2) generated from the LPHC movement analysis line and the fourth vector (V4) generated from the shoulder-wrist connection line in the Y-Z plane, and the calculated included angle A preset score is assigned according to size. At this time, if the calculated included angle is greater than the standard value, it can be considered that the arm has fallen too far forward.

Meanwhile, since the movement of the shoulder joint is not large on the Y-Z plane, the right shoulder feature point (P4) is replaced with the spine shoulder feature point (P2), and a fifth vector (V5) containing these two feature points (P2, P4) is generated, A set score can be assigned by calculating the angle between the second vector (V2) and the fifth vector (V5). In the above-described embodiment, analysis of the movement line of the shoulder complex from the right side was used as an example, and analysis of the movement line of the left shoulder complex can be performed in the same manner.

Next, with reference to FIG. 7 , the creation and evaluation of the pelvic movement analysis line performed by the movement evaluation unit 141 will be described. Figure 7 is a diagram for explaining the creation and evaluation of a pelvic movement analysis line according to an embodiment of the present invention.

The movement evaluation unit 141 determines the Calculate the difference between At this time, the size of the calculated displacement (size of the difference value) corresponds to the size of the sixth vector (V6) connecting the center line and the spine base feature point (P1) in the X-axis direction, and the motion evaluation unit 141 determines the calculated displacement. Assign a score set according to. And the movement evaluation unit 141 generates a seventh vector (V7) between the coordinates of the Hip Right feature point (P6) and the coordinates of the Hip Left feature point (P7), and the X-direction unit vector is The included angle between the eighth vector (V8) and the seventh vector (V7) is calculated, and a set score is assigned according to the size of the calculated included angle.

Next, with reference to FIG. 8, the creation and evaluation of the lumbar arch movement analysis line performed by the motion evaluation unit 141 will be described. Figure 8 is a diagram for explaining the creation and evaluation of a lumbar arch movement analysis line according to an embodiment of the present invention.

The movement evaluation unit 141 is a ninth vector (V9) connecting the spine middle feature point (P9) in the center of the spine extracted from the end posture and the spine shoulder feature point (P2) located in the center of the shoulder, the spine middle feature point (P9), and the center of the pelvis. Generate the 10th vector (V10) connecting the spine base feature point (P1) located in , calculate the angle between the 9th vector (V9) and the 10th vector (V10) in the Y-Z plane, and calculate the size of the calculated included angle. Assign points set accordingly.

Lastly, with reference to FIG. 9 , the creation and evaluation of the knee motion analysis line performed by the motion evaluation unit 141 will be described. Figure 9 is a diagram for explaining the creation and evaluation of a knee movement analysis line according to an embodiment of the present invention.

The movement evaluation unit 141 generates an 11th vector (V11) connecting the right knee feature point (Knee Right) (P10) and the right pelvic feature point (P7) from the joint coordinates extracted from the end posture, and the right ankle feature point (P3) A twelfth vector (V12) located on the auxiliary line connecting the right knee feature point (P10) is generated. Then, the motion evaluation unit 141 calculates the included angle between the 11th vector (V11) and the 12th vector (V12) in the x-y plane, and assigns an evaluation score according to the size of the calculated included angle. Of course, the movement evaluation unit 141 can generate and evaluate the knee movement analysis line for the left knee in the same way.

The plantar pressure distribution evaluation unit 142 analyzes the user's plantar pressure distribution in the preparation posture and the user's plantar pressure distribution in the end position, measures the change in intensity of the plantar pressure distribution in real time, and measures the intensity change according to the magnitude of the intensity change. Evaluate the measurement results. That is, the plantar pressure distribution evaluation unit 142 calculates the pressure distribution (A1) for the right foot in the preparation posture and the end posture and the pressure distribution for the left foot in the preparation posture and the end posture, as shown in FIG. 10. (A2) is received from the plantar pressure distribution measuring unit 130, and the received pressure distribution (A1, A2) of each foot is divided into parts such as the forefoot, middle, and heel, and then each part is divided into left and right or multiple Separate into zones and compare the difference in average or maximum pressure distribution for each area with the standard value to measure the degree of foot pronation or pronation and heel lift, and then assign a score corresponding to the difference in degree.

The musculoskeletal evaluation unit 143 receives the scores evaluated by the movement evaluation unit 141 and the scores evaluated by the plantar pressure distribution evaluation unit 142, and synthesizes each received score to identify vulnerable body parts whose scores are below the standard value. do.

The storage unit 150 stores the evaluation results of each evaluation unit (141, 142, and 143) and stores the measurement date and measurement time.

The exercise program provider 160 selects exercise programs that can strengthen the user's weak body parts received from the musculoskeletal evaluation unit 143 and notifies them to the user through the display unit 170.

The display unit 170 displays posture analysis results and recommended exercise programs for each region.

Hereinafter, the operation of the automatic musculoskeletal diagnosis system using the transitive posture assessment method according to an embodiment of the present invention will be described with reference to FIGS. 11 and 12.

Figure 11 is a flowchart showing the operation of an automatic musculoskeletal diagnosis system using a transitive posture assessment method according to an embodiment of the present invention, and Figure 12 is a flow chart showing the operation of an automatic musculoskeletal diagnosis system using a transitive posture evaluation method according to an embodiment of the present invention. This diagram shows the screen where the evaluation results are printed.

The automatic musculoskeletal system diagnosis system 100 outputs a measurement guide image and a guide image through the display unit 170 to enable the user to perform an overhead squat movement (S1101). Accordingly, the user takes the overhead squat preparation position on the footrest 20 according to the screen guide on the display unit 170 and then performs the overhead squat movement. Of course, when the musculoskeletal system automatic diagnosis system 100 is configured with a voice information unit (not shown), it provides voice instructions such as 'Please take the preparation position', 'Perform the lowering motion', and 'Please take the ending position'. You can do it.

The musculoskeletal system automatic diagnosis system 100 receives the user's overhead squat image captured by the 3D camera 10 through the joint image measuring unit 120 when the user performs an overhead squat movement, and simultaneously detects the user's overhead squat image of the footrest 20. The plantar pressure distribution measuring unit 130 measures the plantar pressure distribution in the preparation position, lowering motion, and end position (S1102). Here, the musculoskeletal system automatic diagnosis system 100 can enable the joint image measurement unit 120 to receive the image captured by the 3D camera 10 at the point when the user's plantar pressure is detected by the plantar pressure distribution measurement unit 130. there is.

The musculoskeletal system automatic diagnosis system 100 selects (extracts) the user's overhead squat image and plantar pressure distribution in the preparation position and the user's overhead squat image and plantar pressure distribution in the finishing position from the measured images and plantar pressure distribution. ) (S1103).

Then, the musculoskeletal system automatic diagnosis system 100 determines the three-dimensional coordinates of the main feature points of the body from the images of the preparation and end postures through the joint image measurement unit 120 (S1104), and the plantar pressure distribution measurement unit (S1104) 130) to determine the plantar pressure distribution in the preparation and end postures (S1105).

In order to diagnose the musculoskeletal system, the automatic musculoskeletal system 100 generates a movement analysis line in the end posture through the posture analysis unit 140, calculates an evaluation score using the generated movement analysis line (S1106), and plantar pressure. Calculate an evaluation score for foot movement using the change value (or difference value) of the distribution (S1107), diagnose the vulnerable area through each calculated evaluation score, and then select a customized exercise program to improve the vulnerable area. and provides it to the user (S1108).

At this time, the musculoskeletal system automatic diagnosis system 100 displays the evaluation results, diagnosis results, and information about the customized exercise program on the screen through the display unit 170 and stores them in the storage unit 150 (S1109).

Although the implementation of the present invention has been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements made by those skilled in the art in the field to which the present invention pertains are also entitled to the present invention. belongs to the range

100: Automatic musculoskeletal diagnosis system 110: Posture selection unit
120: Joint image measuring unit 130: Plantar pressure distribution measuring unit
140: posture analysis unit 150: storage unit
160: exercise program provision unit 170: display unit
141: Movement evaluation unit 142: Plantar pressure distribution evaluation unit
143: Musculoskeletal evaluation department

Claims (10)

A posture selection unit that receives a captured image of the user's transitional posture movement captured by a 3D camera and extracts an image for the preparation posture and an image for the end posture from the received captured image;
A joint image measurement unit that extracts three-dimensional coordinates for each main feature point of the body from the images of the preparation posture and the end posture extracted by the posture selection unit;
A plantar pressure distribution measuring unit that measures the plantar pressure distribution in the preparation position and the plantar pressure distribution in the end position, and
Using the three-dimensional coordinates of each main feature point of the body in the preparation posture and the end posture extracted from the joint image measurement unit and the plantar pressure distribution in the preparation posture and the end posture measured by the plantar pressure distribution measurement unit Comprising a posture analysis unit that performs movement analysis and evaluation of transitional posture and analysis and evaluation of plantar pressure distribution, and performs musculoskeletal evaluation of the user using movement evaluation and plantar pressure distribution evaluation.
An automatic musculoskeletal diagnosis system using a transitive posture assessment method. In paragraph 1:
The posture analysis unit,
Generate a target motion analysis line and a reference motion analysis line for the first movement using the 3-dimensional coordinate values of each main feature point corresponding to the preparation posture and the end posture, and between the target motion analysis line and the reference motion analysis line. A movement evaluation unit that calculates the angle and assigns an evaluation score according to the size of the calculated included angle;
Plantar pressure that analyzes the user's plantar pressure distribution in the preparation position and the user's plantar pressure distribution in the end position, measures the intensity change in the plantar pressure distribution in real time, and assigns a score corresponding to the magnitude of the intensity change. distribution evaluation unit, and
Comprising a musculoskeletal evaluation unit that combines the scores evaluated by the movement evaluation unit and the scores evaluated by the plantar pressure distribution evaluation unit to identify vulnerable body parts whose scores are below the standard value,
An automatic musculoskeletal diagnosis system using a transitive posture assessment method. In paragraph 2,
The movement evaluation unit,
When the first movement is a lumbar-pelvis-hip complex (LPHC) movement,
In the image of the end posture, a first vector for the LPHC movement analysis line is generated by connecting the coordinates of the spine base feature point and the coordinates of the spine shoulder feature point with a straight line, and the ankle feature point on one side and the knee feature point on one side are connected with a straight line. - Generating a second vector for the knee assistance analysis line, calculating the included angle between the first vector and the second vector in the YZ plane, and assigning a preset score according to the size of the calculated included angle,
An automatic musculoskeletal diagnosis system using a transitive posture assessment method. In paragraph 2,
The movement evaluation unit,
When the first movement is a shoulder complex movement,
In the end posture, a fourth vector is generated for the shoulder complex movement analysis line connecting the coordinates of one shoulder feature point and the coordinates of one wrist feature point with a straight line, and the coordinates of the spine base feature point and the spine shoulder feature point in the image of the end posture are generated. A first vector for the LPHC motion analysis line connecting the coordinates with a straight line is generated, the included angle between the first vector and the fourth vector is calculated in the YZ plane, and a preset score is assigned according to the size of the calculated included angle. assigning,
An automatic musculoskeletal diagnosis system using a transitive posture assessment method. In paragraph 2,
The movement evaluation unit,
When the first movement is a pelvic movement,
Calculate the difference between the X-coordinate value of the center line located at the center of the left ankle feature point and the right ankle feature point in the XY plane of the end posture and the , generate a seventh vector from the coordinates of the right hip feature point to the coordinates of the left hip feature point, calculate the included angle between the eighth vector, which is a unit vector in the X direction, and the seventh vector, and then score set according to the size of the calculated included angle. to assign,
An automatic musculoskeletal diagnosis system using a transitive posture assessment method. In paragraph 2,
The movement evaluation unit,
When the first movement is a lumbar arch movement,
A ninth vector connecting the coordinates of the spine middle feature point in the center of the spine extracted from the end posture and the coordinates of the spine shoulder feature point located in the center of the shoulder, and the tenth vector connecting the coordinates of the spine middle feature point and the coordinates of the spine base feature point located in the center of the pelvis. Generating each, calculating the included angle between the 9th vector and the 10th vector in the YZ plane, and assigning a set score according to the size of the calculated included angle,
An automatic musculoskeletal diagnosis system using a transitive posture assessment method. In paragraph 2,
The movement evaluation unit,
When the first movement is a knee movement,
Generate an 11th vector connecting the coordinates of one knee feature point and the coordinates of one pelvis feature point extracted from the end posture, and a 12th vector located on an auxiliary line connecting the coordinates of one ankle feature point and the coordinates of one knee feature point, Calculating the included angle between the 11th vector and the 12th vector in a plane, and assigning an evaluation score according to the size of the calculated included angle,
An automatic musculoskeletal diagnosis system using a transitive posture assessment method. In paragraph 1 or 2:
The posture selection unit,
It is determined that the time when the y-axis coordinate of one main feature point of the body begins to increase above a certain value is the first time when the user completes the preparation posture and begins to enter the descending motion, and the video frame before the set time from the first time point Select this as the image for the ready posture,
An automatic musculoskeletal diagnosis system using a transitive posture assessment method. In paragraph 1 or 2:
The posture selection unit,
The second point in time when the y-coordinate of one main feature point of the body, which had been increasing since the point of entering the descending motion, begins to decrease again above a certain value is determined to be the point in time when the user completes the end posture and ends the evaluation, and the second point in time is Selecting the video frame before the set time as the image for the ending posture,
An automatic musculoskeletal diagnosis system using a transitive posture assessment method. In paragraph 2,
Further comprising an exercise program providing unit that selects and provides exercise programs that can strengthen the user's vulnerable body parts received from the musculoskeletal evaluation unit,
An automatic musculoskeletal diagnosis system using a transitive posture assessment method.

Images