KR20100128605A - System for computing biodata using virtual marker technique and automatic processing method of thereof - Google Patents

Abstract

PURPOSE: A bio data calculation system integrating virtual marker technique and an automated treating method thereof are provided to calculate the accurate biomechanical parameter by obtaining the biomechanical data according to the data collection reference. CONSTITUTION: A video input part(110) is inputted with the image of a tested person recorded. An interface module(130) generates the virtual marker on a plurality of positions selected by a measurer from the image. A data calculation part(150) produces at least one of the distance, the angle, and the degree of tilt between the virtual markers through the position of the virtual markers.

Description

SYSTEM FOR COMPUTING BIODATA USING VIRTUAL MARKER TECHNIQUE AND AUTOMATIC PROCESSING METHOD OF THEREOF}

Embodiments of the present invention relate to a biometric data calculation system and an automated processing method for more easily collecting biomechanical data for diagnosing musculoskeletal disorders.

In general, in order to diagnose musculoskeletal disorders, a biomechanical parameter that is clinically meaningful by visually confirming the skeletal condition of the human body required for diagnosis using an angulometer and an tractograph. Measure Such a method involves the subjective conception of a person, which is not only inaccurate but also cannot measure dynamic changes.

In addition, although biomechanical data can be measured using motion capture equipment, it is not measured in terms of biomechanical parameters. That is, only biomechanical data, which is one point of the elements constituting the biomechanical parameters, is measured. Therefore, it does not have the same clinical meaning as biomechanical parameters. For example, the position of the biomechanical data may be displayed, such as the position of the marker such as the shoulder blade of the left shoulder, the shoulder blade of the right shoulder, etc., rather than being represented by a biomechanical parameter such as the difference between the two shoulder heights. In order to measure biomechanical parameters in this way, there is a problem that it is necessary to know all the anatomical positions of the relevant biomechanical data accurately and to perform various additional tasks such as calculating biomechanical parameters again from the position of the biomechanical data. .

On the other hand, musculoskeletal disorders can be diagnosed using electronic diagnostic devices such as X-rays, magnetic resonance imaging (MRI), tomography (CT). Likewise, these devices cannot obtain diagnostic data that must be obtained in an operational state because they provide only the measured results when the subject is in a static state and cannot measure biomechanical information when the subject is in operation.

In addition, the diagnostic method through gait analysis may include a motion analysis based on a vision system using markers, plantar pressure analysis, and the like. Image information (visual raw data, or technical raw data) acquired through such a version system can be applied to clinical after data processing as biomechanical parameters.

However, biomechanical analyzes using conventional vision systems are cumbersome to attach markers directly to the subject, difficulty in using secondary illumination or in more formal environments, and visual information through the human eye. Analysis method predicts the result by the approximate method, so the analysis result is not reliable.

One embodiment of the present invention is to provide a system usage criteria and data collection criteria for the vision system to more effectively acquire the biomechanical data required for the diagnosis of musculoskeletal disorders.

One embodiment of the present invention provides a biometric data calculation system and an automatic processing method capable of accurately and efficiently collecting biomechanical data for diagnosing musculoskeletal disorders.

Biometric data calculation system incorporating a virtual marker method according to an embodiment of the present invention comprises an image input unit for receiving a photographed image of the subject; An interface module for generating a virtual marker at a plurality of positions selected from a measurer in the input image; A data calculator configured to calculate at least one biomechanical data among distances, angles, and inclinations between the virtual markers through the positions of the generated virtual markers; And a result determination unit determining a result related to the biomechanical symptom of the subject from the calculated biomechanical data. Here, the plurality of positions selected from the measurer mean a skeletal position of the subject in the image required to calculate biomechanical data corresponding to at least one biomechanical parameter.

In an embodiment of the present disclosure, the image input unit may receive an image loaded by the subject through the web, and the result determination unit may provide the determined result on the web.

In one embodiment of the present invention, the interface module includes a display unit for displaying the input image and a marker generator for generating the virtual marker at a skeleton position of the subject selected from the measurer in the displayed image. .

In one embodiment of the present invention, the interface module provides guide information on the skeleton position necessary for calculating the biomechanical data so that the measurer selects a position for generating the virtual marker.

In one embodiment of the present invention, the interface module includes a screen adjusting unit that calculates a distance per pixel of the image by using the size of the actual background and the resolution of the image.

In one embodiment of the present invention, the data calculator calculates the distance, angle, and slope between the virtual markers using the distance per pixel.

In one embodiment, an automatic biometric data processing method using a virtual marker method includes an image input unit, an interface module, a data calculator, and a result determiner. Receiving a photographed image by the subject; Generating a virtual marker at a plurality of positions selected from a measurer in the input image by the interface module; Calculating at least one biomechanical data among a distance, an angle, and a slope between the virtual markers by using the generated position of the virtual marker in the data calculator; And determining, by the result determining unit, a result related to the biomechanical symptom of the subject from the calculated biomechanical data.

According to one embodiment of the present invention, by providing data collection criteria for biomechanical data necessary for the diagnosis of musculoskeletal disorders, accurate data can be measured more effectively.

According to an embodiment of the present invention, by obtaining biomechanical data based on data collection criteria, it is possible to calculate more accurate biomechanical parameters and further provide a reliable diagnosis system.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited or limited by the embodiments. Like reference numerals in the drawings denote like elements.

One embodiment of the present invention relates to a biometric data calculation system for application to a vision system for diagnosing biomechanical musculoskeletal disorders, wherein biomechanical parameters of clinical significance are collected based on the comprehensive or individual collection of biomechanical data. Can get them.

1 is a diagram illustrating a configuration of a biometric data calculation system using a virtual marker method according to an embodiment of the present invention.

Referring to FIG. 1, a bio data calculation system incorporating a virtual marker method according to an embodiment of the present invention may include an image input unit 110, an interface module 130, a data calculator 150, and a storage unit 170. And a result determination unit 190.

The image input unit 110 receives a photographed image (hereinafter, referred to as an “input image”).

The interface module 130 generates a virtual marker at a plurality of positions selected from the measurer in the input image. The interface module 130 may generate and display a virtual marker at the selected skeleton position when the measurer selects the skeleton position of the subject in the input image.

The data calculator 150 determines the position of the virtual marker and calculates at least one biomechanical data among the distance, angle, and slope between the virtual markers through the position of the virtual marker.

The storage unit 170 maintains various data necessary for the entire system and stores biomechanical data calculated by the data calculator 150.

The result determiner 190 automatically determines a result related to the biomechanical symptom of the subject from the biomechanical data calculated by the data calculator 150.

More specifically, in one embodiment of the present invention, the image input unit 110 may be directly connected to a photographing means such as a web camera, a camcorder, a stereo camera, etc. to receive an input image photographed through the photographing means. In addition, the image input unit 110 may be connected to a terminal device such as a computer or a memory (eg, USB) to receive an input image stored in the terminal device. In addition, the image input unit 110 may receive the loaded image from the web when the subject loads an image such as a photograph taken by the subject through the web.

When the photographing means is provided, an embodiment of the present invention presets the size of the actual background that has entered the frame 210 of the image, as shown in FIG. 2. For example, the photographing means is fixed so that the basic board 230 having a known size matches the frame 210 of the image, and the subject 250 is placed in front of the basic board 230 at a predetermined position. You can shoot. At this time, if the photographing means is fixed to match the frame 210 of the image and the base board 230, the base board 230 may be removed and the subject 250 may be photographed. One embodiment of the present invention can set the length of the horizontal and vertical corresponding to the size of the actual background to the value defined by the measurer, and when using the base board to make the reference board arbitrarily the size of the reference board to the size of the actual background Can be set to

The interface module 130 includes a display unit 131, a screen adjuster 133, and a marker generator 135.

The display unit 131 displays the input image so that the measurer can select the position of the skeleton of the subject in the input image. The marker generator 135 generates a virtual marker at the skeleton position selected by the measurer when the measurer selects a skeleton position of the subject in the input image displayed on the display unit 131 through a predetermined input means. The position selected from the measurer means a skeletal position of the subject required to calculate biomechanical data corresponding to at least one biomechanical parameter. Here, the biomechanical parameters may include shoulder height difference, pelvis height difference, knee flexion degree, knee height difference, spine flexion degree, cervical spine slope, upper body tilt, and the like. For example, if the position of the left shoulder and the position of the right shoulder (ie, biomechanical data) can be calculated, a biomechanical parameter called 'difference in shoulder height' can be obtained.

3 to 5 are diagrams for describing a process of generating a virtual marker.

Referring to FIG. 3, in the case of the input image photographed in the standing position in which the subject 310 faces the front, the left or right height difference or the inclination of the shoulder, the left or right height difference or the inclination of the superior scapula, and the patella ), Such as shoulder, iliac spine, patella, astragalus, etc., to measure the difference between the left and right height or the slope, and the degree of flexion of the leg (the angle between the patella and the malleolus and the vertical line between the ground and the astragalus). The virtual marker 301 may be generated by selecting the skeleton position. Referring to FIG. 4, in the case of the input image photographed from the standing position in which the subject 410 faces the back, the spine and the superior epithelium (IC The virtual marker 401 may be generated by selecting a skeletal position such as). Referring to FIG. 5, in the case of the input image photographed in the standing posture in which the subject 510 faces the side, the angle between the reference line passing through the shoulder and the ear, the distance between the reference line passing through the shoulder and the ear, the ear and the thoracic spine (Thoracic) Virtual marker (501) by selecting skeletal positions such as skeletal, shoulder, spine, anterior flexion (ASIS), posterior iliac spine (PSIS), etc. ) Can be created.

That is, the exemplary embodiment of the present invention displays the virtual marker generated through the marker generator 135 on the input image displayed on the display unit 131, so that the marker is attached to the subject without directly attaching the marker to the subject. The same result as the captured image may be obtained, and biomechanical data may be calculated using the position of the virtual marker.

6 is a diagram for describing a process of selecting a skeleton position of a subject to generate a virtual marker.

The interface module 130 provides guide information on the skeleton position so that the measurer can select the position of the virtual marker more conveniently and accurately. Referring to FIG. 6, the display unit 131 provides a biomechanical parameter list 601 so that the measurer can select at least one biomechanical parameter and the biomechanical parameter selected by the measurer through the biomechanical parameter list 501. Accordingly, a guide screen 603 for guiding a skeleton position necessary for calculating biomechanical data corresponding thereto may be provided. That is, the measurer may select the correct skeleton position by referring to the guide information on the skeleton position provided through the guide screen 603. In addition, as another method for accurately positioning the virtual marker, the marker may be directly attached to the skeleton position of the subject to obtain an input image, and then a virtual marker may be generated at the marker position of the input image.

In addition, the screen adjuster 133 performs a screen correction function that calculates a distance per pixel of the input image by using the size of the actual background and the resolution of the input image that enter the frame of the image. In this case, the actual background size may be stored in the storage unit 170 in the horizontal length and the vertical length, or may be preset as a reference value for calculating the distance per pixel.

As an example of using the basic board 701 as described above, as illustrated in FIG. 7, the screen adjusting unit 133 may have a width (1.20m) and a vertical height (1.20m) of the basic board 701 corresponding to the actual background. 2.00m) may be divided by the number of pixels of the input image, that is, the resolution (1600 * 1200), to calculate the distance per pixel, and the size per pixel from the distance per pixel.

The data calculator 150 may determine the position of the virtual marker generated at the skeleton position of the subject and calculate the distance, angle, and slope between the virtual markers using the distance per pixel or the size per pixel. For example, as shown in FIG. 3, the position of the left virtual marker AM # 1 created on the left shoulder of the subject and the right virtual marker AM # 2 created on the right shoulder of the virtual markers are determined to the left. The distance between the left virtual marker (AM # 1) and the right virtual marker (AM # 2) is calculated from the distance per pixel between the virtual marker (AM # 1) and the right virtual marker (AM # 2). It is possible to calculate the height difference.

In this case, the data calculator 150 transmits the calculated distance, angle, and slope between the virtual markers to the interface module 130, and the interface module 130 may analyze the distance, angle, and slope between the virtual markers by the measurer. Can be provided as dynamic data.

In addition, the result determining unit 190 compares the biomechanical data calculated by the data calculating unit 150 with a predetermined reference value in a predetermined range, and the result of the biomechanical symptom of the subject, such as normal, severe, or mild. Automatic analysis is possible. The reference value may be changed by the measurer but basically provides a reference range. This is to prevent errors in measurement results due to different standards and different standards for each measurer. As shown in FIG. 8, the result determination unit 190 may include a result screen 803 for providing a result for biomechanical data together with a measurement screen 801 of biomechanical data using a virtual marker. Can be provided via The result determining unit 190 may compare the left / right side with a right upper side (right side is higher than the left side), left top side (left side is higher than the right side), and the like, where the reference unit for interpreting the results of the biomechanical data is small. Can be expressed according to predefined reference values such as, severity, and mild. In addition, the result determination unit 190 together with the measurement screen 801 for the biomechanical data through the interface module 130 when the image input to the image input unit 110 is an image loaded through the web connection of the subject. The result screen 803 may be provided on the web.

9 is a view showing the entire process of the automatic processing method of the biometric data calculation system incorporating the virtual marker method according to an embodiment of the present invention. Here, the automatic processing method of the biometric data calculation system according to an embodiment of the present invention may be executed by the biometric data calculation system shown in FIG.

Referring to FIG. 9, the biometric data calculation system according to an embodiment of the present invention receives an input image photographed by a subject (S901). Here, the input image may be an image received from a photographing means connected to the system, or may be an image received through various data transmission methods such as a web.

In the biometric data calculation system according to an exemplary embodiment of the present invention, when the photographing means connected to the system is used, the input image photographing the subject is input after setting the size of the actual background that is in the frame of the photographed image. Receive. In operation S902, the biometric data calculation system calculates a distance per pixel of the input image using the size of the actual background and the resolution of the input image.

The biometric data calculation system according to an embodiment of the present invention generates a virtual marker at a plurality of positions selected from a measurer in an input image. That is, when the measurer selects the skeleton position of the subject in the input image, the selected skeleton position is set as the position of the virtual marker and a virtual marker is generated at the corresponding position (S903).

The biometric data calculation system according to an embodiment of the present invention calculates the biomechanical data such as the distance, angle, and slope between the virtual markers by determining the position of the virtual marker generated at the skeleton position of the subject using the distance per pixel. (S904). On the other hand, the biometric data calculation system according to an embodiment of the present invention does not know the size of the actual background when the image of the subject is input from the outside without using the photographing means connected to the system, so that the position of the virtual marker is not included. Biomechanical data can be provided in a manner that represents a relative result.

The biometric data calculation system according to an exemplary embodiment of the present invention may calculate tilt, angle, and length with respect to various selected skeletal positions by selecting a skeletal position of a subject in the input image and positioning a virtual marker. In addition, an embodiment of the present invention is to calculate the biomechanical data using the virtual markers and the automated results (eg, severe, mild, normal, etc.) for the biomechanical symptoms associated with musculoskeletal diseases based on the biomechanical data This may provide a guideline (S905).

Embodiments of the present invention include computer readable media including program instructions for performing various computer implemented operations. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The media may be program instructions that are specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

As described above, the present invention has been described by specific embodiments such as specific components and the like. For those skilled in the art to which the present invention pertains, various modifications and variations are possible.

Therefore, the spirit of the present invention should not be limited to the described embodiments, and all the things that are equivalent to or equivalent to the claims as well as the following claims will belong to the scope of the present invention. .

1 is a diagram illustrating a configuration of a biometric data calculation system using a virtual marker method according to an embodiment of the present invention.

2 is a view for explaining an image of a subject using a basic board.

3 to 5 are diagrams for describing a process of generating a virtual marker.

6 is a diagram for describing a process of selecting a skeleton position of a subject to generate a virtual marker.

7 is a diagram for describing a screen correction process of an image.

8 is a diagram illustrating an interface screen showing an automation result for biomechanical data calculated through a virtual marker.

9 is a view for explaining the entire process of the automatic biometric data processing method incorporating the virtual marker method according to an embodiment of the present invention.

<Explanation of symbols for the main parts of the drawings>

110: video input unit

130: interface module

131: display unit

133: screen adjustment unit

135: marker generation unit

150: data calculation unit

170: storage unit

190: result judgment

Claims (13)

An image input unit configured to receive an image captured by the subject; An interface module for generating a virtual marker at a plurality of positions selected from a measurer in the input image; A data calculator configured to calculate at least one biomechanical data among distances, angles, and inclinations between the virtual markers through the positions of the generated virtual markers; And, A result determination unit that determines a result related to the biomechanical symptom of the subject from the calculated biomechanical data, A plurality of positions selected from the measurer, And a virtual marker method that is a skeletal position of the subject in the image required to calculate biomechanical data corresponding to at least one biomechanical parameter. The method of claim 1, The image input unit receives an image loaded by the subject through the web, And a result determining unit providing the determined result on the web. The method of claim 1, The interface module, A display unit which displays the input image; And a marker generator configured to generate the virtual marker at a skeleton position of the subject selected from the measurer in the displayed image. The method of claim 1, The interface module, And guiding information on a skeleton position necessary for calculating the biomechanical data so that the measurer selects a position for generating the virtual marker. The method of claim 1, The interface module, And a screen adjusting unit configured to calculate a distance per pixel of the image by using the size of the actual background and the resolution of the image, which are in the frame of the image. The method of claim 5, The data calculation unit, And calculating a distance, an angle, and an inclination between the virtual markers using the distance per pixel. In the biological data automatic processing method of the biometric data calculation system including an interface module composed of an image input unit, a display unit, a marker generator, a screen adjustment unit, a data calculator, and a result determiner, Receiving an image captured by a subject from the image input unit; Generating a virtual marker at a plurality of positions selected from a measurer in the input image by the interface module; Calculating at least one biomechanical data among a distance, an angle, and a slope between the virtual markers by using the generated position of the virtual marker in the data calculator; And, And determining, by the result determining unit, a result related to the biomechanical symptom of the subject from the calculated biomechanical data. A plurality of positions selected from the measurer, A method of automatically processing biometric data incorporating a virtual marker method, which is a skeletal position of the subject in the image required for calculating biomechanical data corresponding to at least one biomechanical parameter. The method of claim 7, wherein The image photographed by the subject is an image input by the subject through the web and input to the image input unit, And providing the determined result on the web by the result determination unit. The method of claim 7, wherein Generating the virtual marker, Displaying the input image on the display unit; And generating the virtual marker at a skeleton position of the subject to be selected from the measurer in the displayed image by the marker generation unit. The method of claim 7, wherein Generating the virtual marker, And guiding information on a skeleton position necessary for calculating the biomechanical data so that the measurer selects the skeleton position of the subject. The method of claim 7, wherein Generating the virtual marker, And calculating a distance per pixel of the image by using the size of the actual background and the resolution of the image, which are input into the frame of the image, by the screen adjusting unit. The method of claim 11, Computing at least one of a distance, an angle, and a slope between the virtual markers, And calculating a distance, an angle, and a slope between the virtual markers using the distance per pixel. A computer-readable recording medium having recorded thereon a program for performing the method of any one of claims 7 to 12.

Images