KR20230128809A - Hand power measurement apparatus and measurement method using hand power measurement apparatus - Google Patents

Abstract

The present invention relates to a digital strength measuring device capable of precisely measuring digital strength, which is a rehabilitation evaluation method for the elderly, and more particularly, in an imaging inspection apparatus for a digital strength test (FTT), the imaging test The device combines at least two or more cameras that take pictures from multiple angles so that there is no blind spot for one object that performs a hand grip or finger taping operation, and the camera information is individually fused with pre-stored basic information to obtain motion information Including a control unit that obtains, but there are a total of 21 recognition points for each of the photographing information and basic information, and a Python library media pipe capable of extracting coordinate data of x, y, and z for each location of each recognition point is formed.

Description

Resin force measuring device and resin force measuring method using the same {HAND POWER MEASUREMENT APPARATUS AND MEASUREMENT METHOD USING HAND POWER MEASUREMENT APPARATUS}

The present invention relates to a digital force measurement device capable of precisely measuring digital force, which is a rehabilitation evaluation method for the elderly.

In recent years, as the elderly population is increasing compared to the non-aged population due to the development of medical technology, etc., the aging index is gradually increasing. The situation is.

As the elderly population increases, the number of patients with geriatric diseases (for example, Parkinson's disease, stroke, etc.) is increasing.

Among the rehabilitation methods for patients with geriatric diseases, there is a rehabilitation treatment method that corrects the posture of the hand and increases the range of motion, and the easiest method is a finger tapping task (FTT: Finger Tapping Task ) is there.

There are many ways to measure FTT, but one that does not have a sensor attached and can be evaluated quantitatively is an AI-based evaluation method.

However, the AI-based FTT measurement often has a problem of not recognizing the hand due to the direction and movement of the camera.

That is, in the conventional FTT measurement, since the patient's hand is photographed in only one direction, a blind spot exists, resulting in a problem in which the satisfaction of the measurement result is lowered due to the blind spot.

Domestic Public Utility No. 20-1995-20354 (Public Date: 1995.07.26.) Domestic Registered Utility No. 20-0256277 (Announcement date: 2002.02.20.) Domestic Registered Utility No. 20-0422392 (Announcement Date: 2006.07.26.)

In order to compensate for the above-mentioned problems of the conventional FTT method, the present invention measures using multiple cameras to eliminate blind spots in the conventional method of photographing and recognizing only one direction, and fuses the measured images to obtain the measurement results. The purpose is to improve satisfaction with

In order to solve the above-mentioned technical problem, the digital force measuring device according to the present invention is a photographic inspection device for a digital force test (FTT), wherein the photographic test device is used for one object that performs a hand grip or finger taping operation. Including at least two or more cameras 100 that shoot from multiple angles without blind spots and a control unit 200 that obtains motion information by individually fusing the photographing information for the cameras 100 with pre-stored basic information, , There are a total of 21 recognition points for each of the shooting information and basic information, and a Python library media pipe capable of extracting coordinate data of x, y, and z for each location of each recognition point is formed.

In addition, the acquisition of motion information by the control unit 200 rotates the fixed coordinate set of the media pipe formed in the basic information to match the fixed coordinate set of the media pipe formed in the photographing information at different angles. It is preferable to obtain motion information by executing a point set registration task.

In addition, it is preferable that the plurality of cameras 100 take pictures so that all of the wrists and fingers of the object are exposed.

According to the present invention, unlike the prior art, an object, which is a patient's hand for measuring hand power, is photographed without a blind spot by a plurality of cameras and the photographing information is transmitted to the controller, wherein the controller transmits shooting information in the form of a media pipe and By obtaining motion information based on basic information, an effect of precisely measuring the patient's resin power through the corresponding motion information is realized.

1 is a view showing a resin force measuring device according to the present invention.
2 and 3 are diagrams illustrating a point set registration operation based on photographing information and basic information for the digital force measuring device according to the present invention.
Figure 4 is a graph showing the distance from No. 4 to No. 8 after the photographing information for the digital force measuring device according to the present invention is fused in the form of a media pipe.
5 is a graph showing a state in which graphs showing distances from numbers 4 to 8 in FIG. 4 are extracted and applied to a detection graph.
Figure 6 is a flow chart showing a method for measuring the resin force using the resin force measuring device according to the present invention.
FIG. 7 is a diagram illustrating a control unit displayed through a terminal for FIG. 6;
FIG. 8 is a diagram illustrating a state in which an object photographed by a camera according to the preview of FIG. 7 is displayed;
FIG. 9 is a diagram illustrating a state in which photographing information is obtained by photographing an object displayed in FIG. 8;
FIG. 10 is a view showing how motion information is displayed based on the photographing information of FIG. 9;
11 to 13 are diagrams showing how motion information according to mode selection with respect to FIG. 10 is displayed.
14 is a table showing numerical values for distances when fingers are spread out during a finger taping operation of an object for a method for measuring digital force using a digital force measuring device according to the present invention.
15 is a table showing numerical values for distances when fingers are closed during the finger taping operation of the object of FIG. 14;

Hereinafter, various embodiments will be described in more detail with reference to the accompanying drawings. The embodiments described in this specification may be modified in various ways. Certain embodiments may be depicted in the drawings and described in detail in the detailed description. However, specific embodiments disclosed in the accompanying drawings are only intended to facilitate understanding of various embodiments. Therefore, the technical idea is not limited by the specific embodiments disclosed in the accompanying drawings, and it should be understood to include all equivalents or substitutes included in the spirit and technical scope of the invention.

Terms including ordinal numbers, such as first and second, may be used to describe various components, but these components are not limited by the above terms. The terminology described above is used only for the purpose of distinguishing one component from another.

In this specification, terms such as "comprise" or "having" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded. It is understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, but other elements may exist in the middle. It should be. On the other hand, when an element is referred to as “directly connected” or “directly connected” to another element, it should be understood that no other element exists in the middle.

In addition, in describing the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be abbreviated or omitted.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a hydraulic power testing device (hereinafter, simply referred to as a 'testing device') according to the present invention will be described in detail with reference to the accompanying drawings.

Prior to the description, the control unit 200 described below refers to a program for measuring the resin force by an algorithm set to be installed in a typical terminal.

First, as shown in FIG. 1, the inspection apparatus 1 according to the present invention largely includes at least two or more cameras 100 and a control unit that obtains motion information through a plurality of photographing information transmitted through the cameras 100. Includes (200).

More specifically, the camera 100 takes a hand of a patient performing a hand grip or finger taping operation as an object H and takes pictures from various angles so that no blind spots of the object H exist, thereby taking multiple shots. This is a configuration for transmitting information to the control unit 200.

For example, as shown, at least two or more cameras 100 are provided to take pictures from various angles based on the object H, and take pictures so that there is no blind spot for the object H.

Here, although two cameras 100 in the present invention are described and shown to be connected to the control unit 200, this is only one embodiment, and three or more installations are possible for precise resin force measurement Note

The photographing information captured by the camera 100 is photographed so that the wrist and fingers of the object H are fully exposed in order to increase the reliability of the motion information to be acquired, but the object H is hand-grip It is filmed in such a way that at least one of the motions can be realized, either the gripping and releasing motion) or the finger taping method (attaching and releasing the index finger and thumb while the fingers are spread out).

And, the control unit 200 is a component for obtaining motion information for measuring the resin force based on the photographing information individually transmitted from the camera 100 described above.

To this end, the control unit 200 in the present invention stores basic information for obtaining motion information by fusing with the transmitted photographing information, and the photographing information and the basic information are each a Python library media pipe capable of extracting data. is converted so that it can be formed.

As shown in the figure, a media pipe has a total of 21 recognition points, which means that coordinate data of x, y, and z can be extracted for each location of each recognition point, and motion information is obtained through the convergence of these recognition points.

In other words, general recognition point fusion of basic information and photographing information is inconvenient because the photographing angle of the camera 100 is different from each other, so in the present invention, point set registration programmed in the controller 200 (Point set registration) ) to obtain motion information.

That is, as shown in FIGS. 2 and 3, photographing information photographed at different angles is 3D rotated, and the position of the recognition point displayed in the corresponding photographing information is the criterion to match the position of the recognition point of the basic information to the most similar. The control unit 200 performs a point set registration operation in which a set of coordinates acquired through a plurality of shooting information is rotated to the fixed coordinate set of basic information and rotated to be most similar to the set of fixed coordinates at the same time, and then a set of transformed coordinates, which is fused motion information, is obtained. ) to obtain motion information.

The control unit 200 receives photographing information multiple times for a precise hand strength test, sequentially obtains motion information several times based on the corresponding photographing information, and uses the results as data for the hand strength test. do.

On the other hand, the operator needs a process of checking through the controller 200 whether the operation of the object H is accurately implemented in order to accurately measure the resin force. ), the control unit 200 obtains motion information in the form of a media pipe as shown in FIG. 3 through convergence with basic information, and recognizes points 4, 5, and 6 of the corresponding motion information. A graph using coordinates No. 7, No. 8 shows the waveform shown in FIG. 4, and as can be seen from this graph, the deeper the depth of the corresponding waveform, the greater the distance between the fingers. As a result, it can be seen that the distance of 4 to 8 is the largest and the distance of 4 to 5 is the shortest.

Here, as shown in FIG. 5, the graphs from recognition points 4 to 8 are separately separated because the angle between the 4th and 8th is measured when measuring the angle of the finger to measure the hand power, This extracted graph is confirmed by applying it to a detection graph in order to determine the reliability of the stop and operation sections by the object H.

That is, as shown in the figure, it is possible to confirm whether the operation of the object (H) has been accurately implemented by checking the stop and operation sections of the finger taping through the coincidence of the red columns in the section where the signal of the extracted graph goes down and goes up. do.

Hereinafter, a measuring method (hereinafter, simply referred to as a 'measuring method') using the hydraulic force tester according to the present invention will be described in detail with reference to the accompanying drawings.

Prior to the description, as shown in FIG. 6, the measurement method 2 in the present invention largely consists of 1) installing at least two or more cameras 100 to be connected to the control unit 200 installed in the terminal to measure the object H. Taking a picture and transmitting the photographing information to the controller 200 (S10), 2) obtaining motion information by fusing the transmitted photographing information with basic information stored in the controller 200 (S20), and 3) A step S30 of calculating a resultant value through the control unit 200 based on the obtained motion information and measuring the resin force.

First, the operator installs a plurality of cameras 100 (two cameras in the present invention) so that there is no blind spot of the object to be photographed, and then executes the control unit 200, which is a MATLAB program pre-installed in the terminal. Step 1) Execute (see Figure 1).

After that, as shown in FIG. 7, the operator clicks the 'Searching Camera' icon of the control unit 200 displayed on the terminal, and the image taken by the set camera 100 can be divided and displayed on the control unit 200. set so that

In this process, as shown in FIG. 8, the operator clicks the 'Preview CAM' icon provided in the controller 200 to set the images captured by each camera 100 to be displayed as a preview, through which the object It is determined whether it is possible to take a picture of .

Then, when the setting is finished, as shown in FIG. 9, the patient places his or her hand, which is the object H, in front of the camera 100, but the operator executes the 'START-Recording' icon provided in the control unit 200. to obtain photographing information for an object H having no blind spot through each of the cameras 100, and transmits the photographing information to the controller 200.

At this time, it is preferable for the operator to enable the control unit 200 to match the synchronization for each camera 100 in order to prevent the creation of a blind spot for the object H.

In addition, the photographing information of the object H is photographed so that the wrist and fingers of the object are fully exposed in order to increase the reliability of the motion information, but the object is hand gripped (clamping and opening a fist) or finger taping Shoot in such a way that at least one of the motions (movement of attaching and releasing the index finger and thumb in the state of spreading the fingers) can be realized.

Thereafter, the operator selects pre-stored shooting information through the selection of the 'Motion' icon in the controller 200 to obtain motion information, and then clicks the 'Losd Video' icon to divide and display a plurality of stored shooting information. If necessary, it is also possible to click the 'Play' icon to check whether the shooting of the object was filmed as the desired image by the operator.

Then, as shown in FIG. 10 , the operator extracts motion information by clicking the 'Convert' icon provided in the controller 200 .

Here, the motion information to be extracted based on the shooting information, as described above, has a total of 21 recognition points, but basic information using the Python library media pipe that can extract x, y, z coordinate data for each location of each recognition point Step 2) of obtaining motion information by recognizing photographic information captured through each camera 100 is performed.

At this time, as shown in FIGS. 11 to 13, the obtained motion information is based on the 'original mode' in which only shooting information is displayed in proportion to the number of cameras 100 according to the operator's manipulation of the control unit 200, and the shooting information It is preferable to operate so that any one of a 'skeleton mode' displaying only acquired motion information and a 'synthesis mode' in which the skeleton mode screen is applied to the original mode screen can be displayed.

In addition, in the present invention, a plurality of motion information is stored in the control unit 200 by executing the above-described procedure multiple times to accurately measure the resin force, and a result value is calculated based on the stored plurality of motion information to perform the resin force test. run

In this process, the operator may perform a confirmation step for confirming whether the correct operation (hand grip or finger taping) for the object H is implemented before performing the hand power test, and this confirmation step is shown in the table of FIG. 14 is sequentially shown by performing 10 times the distance when the fingers are spread during the finger paping operation of the object (H). As can be seen from the table, from 4 to 5 As you go from 4 to 8, you can see that the value increases.

Conversely, the table of FIG. 15 sequentially shows the distance when the finger is closed (ie, when the thumb and index finger are attached) during the finger paping operation of the object H by performing it 10 times, and through a plurality of recognition points It can be seen that the value decreases from 4 to 5 to 4 to 8.

Based on these results, the control unit 200 can calculate the close to open time, which is the time per time for opening and closing the finger once while executing the finger taping operation 10 times, Through a plurality of corresponding close-to-open times, it is also possible to check the calculated value of the average close-to-open time.

Furthermore, the controller 200 can also measure the angle between the thumb and forefinger of the object H performing the finger taping operation, and the patient can measure the hand power through the angle result value and the above-described close-to-open time result value. It becomes available as data that can confirm how much effort has been made for improvement.

As described above, the measuring device 1 according to the present invention according to the present invention, unlike the prior art, photographs the object H, which is the patient's hand, without blind spots by using a plurality of cameras 100 for measuring hand power. and transmits the shooting information to the control unit 200, and the control unit 200 acquires motion information based on the media pipe-type shooting information and basic information, and precisely measures the patient's holding power through the corresponding motion information effect that can be achieved.

As described above, the present invention has been described by specific details such as specific components and limited embodiments and drawings, but these are provided to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , Those skilled in the art in the field to which the present invention belongs can make various modifications and variations from these descriptions.

Therefore, the spirit of the present invention should not be limited to the described embodiments, and it will be said that not only the claims to be described later, but also all modifications equivalent or equivalent to these claims belong to the scope of the present invention. .

1: Resin force measuring device according to the present invention
2: Resin force measurement method using the resin force measuring device according to the present invention
100: camera
200: control unit
H: object

Claims (8)

In the imaging inspection device for digital force test (FTT),
The photographing inspection device
At least two or more cameras 100 that take pictures from multiple angles without blind spots for one object H that performs a hand grip or finger taping operation; and
A control unit 200 that obtains motion information by separately fusing the photographing information of the camera 100 with pre-stored basic information;
A total of 21 recognition points exist for each of the shooting information and basic information, and a digital force measuring device characterized in that a Python library media pipe capable of extracting coordinate data of x, y, and z for each location of each recognition point is formed.
According to claim 1,
Acquisition of motion information in the control unit 200
In the fixed coordinate set of the media pipe formed in the basic information,
Measurement of bearing force, characterized in that the motion information is obtained by executing a point set registration operation in which the coordinate set of the media pipe formed in the photographing information photographed at different angles is rotated to match the fixed coordinate set. Device.
According to claim 1,
A plurality of the cameras 100
The digital force measuring device, characterized in that for photographing so that the wrist and fingers of the object (H) are all exposed.
1) installing at least two or more cameras 100 to be connected to the control unit 200 installed in the terminal, photographing an object H, and transmitting photographing information to the control unit 200;
2) obtaining motion information by converging the transmitted photographing information with basic information stored in the controller 200; and
3) measuring the resin force by calculating the result through the control unit 200 based on the obtained motion information;
The method of claim 4 (paragraph 6)
In step 1), the object (H)
Resin force measurement method using a resin force measuring device, characterized in that the shooting is carried out by hand grip method or finger taping method.
According to claim 4,
After step 2), to step 2-1),
A method for measuring resin force using a resin force measuring device, characterized in that it further comprises; a confirmation step of confirming whether the hand grip or finger taping operation for the object (H) has been accurately executed.
According to claim 4,
Acquisition of motion information in step 2)
In the fixed coordinate set of the media pipe formed in the basic information,
Measurement of bearing force, characterized in that the motion information is obtained by executing a point set registration operation in which the coordinate set of the media pipe formed in the photographing information photographed at different angles is rotated to match the fixed coordinate set. Method for measuring resin force using the device.
According to claim 4,
The result in step 3) above is
It is characterized in that the calculated value of the close to open time, which is the time to open and close the thumb and index finger once when the object (H) executes the finger taping operation, and the result value of the angle between the thumb and index finger Resin force measuring method using a resin force measuring device to be.

Images