KR102152498B1 - Platform service related to remedial exercise - Google Patents

Abstract

The present invention relates to a platform service related to rehabilitation exercises. In a method of using a first server for storing first information related to a rehabilitation exercise of a plurality of users according to an aspect of the present invention, a request for transmitting information related to a first user, which is at least one of the plurality of users, is received from an external device. The first step; A second step of determining information related to the first user from among the stored first information in response to the information delivery request; A third step of transmitting information related to the first user to the external device; And when the external device determines second information using information related to the first user, and the rehabilitation device performs a rehabilitation exercise for the first user based on the second information, the external device and rehabilitation A fourth step of receiving third information related to the performed rehabilitation exercise from at least one of the devices; It may include.

Description

Platform service related to remedial exercise}

The present invention relates to a platform service related to rehabilitation exercises. Specifically, the present invention provides information related to a rehabilitation exercise of a plurality of users based on a server, receiving a request for transmission of information related to a first user, at least one of the plurality of users, from an external device, and When the related information is transmitted to the external device, the external device determines the second information using the information related to the first user, and the rehabilitation device performs a rehabilitation exercise for the first user based on the second information, the external device It relates to a platform service related to a rehabilitation exercise for receiving third information related to a rehabilitation exercise performed from at least one of a device and a rehabilitation device.

Due to the development of science and medical technology, aging is rapidly progressing not only in Korea but also worldwide, and industrial trends are changing to prepare for an aging society.

The field that receives the most attention is healthcare, and according to the National Health Insurance Service, the analysis of health insurance medical expenses payment data from 2005 to 2010 revealed that the total medical expenses due to senile diseases increased by 271% and the copayment from the corporation increased by 272.5%. It makes them realize the importance of healthcare for the elderly.

One of the most representative of senile diseases is degenerative joint disease, and recently, it is occurring not only in the elderly and middle/aged, but also in the young.

The main causes of this are incorrect posture habits, excessive sodium and sugar intake, weight gain, heavy work and stress, lack of exercise, or joint injuries due to vigorous exercise.

Rehabilitation exercises are very important because the joints are not immediately recovered even after surgery, but the range of motion and the speed of recovery vary depending on the subsequent recovery treatment.

However, since a lot of pain is involved in joint rehabilitation exercise, it is difficult for the patient to exercise by himself, and eventually, limitation of the range of motion (LOM) appears due to contracture and inflammation.

To prevent this, joint motion range exercise is performed. The most common joint motion is continuous passive motion (CPM), which is an exercise performed by pure external force such as a therapist or mechanical device. By providing continuous passive movement to all patients or surgery patients, the joint function is restored.

Because CPM is a passive exercise by a mechanical device rather than the patient's own movement, it helps to recover the range of motion (ROM) without causing muscle fatigue, and helps reduce pain and prevent complications. Accordingly, the number of companies that rent CPM devices so that patients with joint disease can exercise at home has also increased significantly.

However, the conventional CPM device has a problem that the physical therapist or the patient himself sets the movement angle, speed, and number of times, and it is practically difficult to change the initially set exercise setting in real time according to the patient's condition.

In addition, according to such a problem, there is a problem that side effects occur due to excessive exercise, or rehabilitation exercises are not properly performed due to too weak exercise.

In addition, since the CPM device alone cannot determine the extent of a patient's recovery, there is a problem that customized rehabilitation treatment cannot be realized unless data such as pain, ROM, frequency, and time are separately recorded and managed for each patient's exercise.

Therefore, there is a need for rehabilitation treatment devices, systems, and control methods that can solve these problems.

Korean Intellectual Property Office Registration No. 10-1501838 Korean Intellectual Property Office Registration No. 10-1646914

The present invention is to provide a platform service related to rehabilitation exercises.

Specifically, the present invention provides information related to a rehabilitation exercise of a plurality of users based on a server, receiving a request for transmission of information related to a first user, at least one of the plurality of users, from an external device, and When the related information is transmitted to the external device, the external device determines the second information using the information related to the first user, and the rehabilitation device performs a rehabilitation exercise for the first user based on the second information, the external device An attempt is made to propose a platform service related to a rehabilitation exercise that receives third information related to a rehabilitation exercise performed from at least one of a device and a rehabilitation device.

Meanwhile, the technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems that are not mentioned are clearly to those of ordinary skill in the technical field to which the present invention belongs from the following description. It will be understandable.

In a method of using a first server for storing first information related to a rehabilitation exercise of a plurality of users, which is an aspect of the present invention for achieving the above technical problem, the first is at least one of the plurality of users from an external device. A first step of receiving a request for information delivery related to a user; A second step of determining information related to the first user from among the stored first information in response to the information delivery request; A third step of transmitting information related to the first user to the external device; And when the external device determines second information using information related to the first user, and the rehabilitation device performs a rehabilitation exercise for the first user based on the second information, the external device and rehabilitation A fourth step of receiving third information related to the performed rehabilitation exercise from at least one of the devices; It may include.

In addition, between the second step and the third step, step 2-1 of determining the advertisement content based on the information related to the first user; further includes, between the third step and the fourth step, the It may further include a 3-1 step of transmitting the advertisement content to the rehabilitation device.

In addition, when the third information is received from the external device in the fourth step, the fourth step is a step 4-1 of receiving notification information on the rehabilitation exercise performance of the first user from the external device. ; A 4-2 step of requesting the third information from the external device in response to the received notification information; And a 4-3 step of receiving the third information from the external device in response to the request.

In addition, when the third information is received from the rehabilitation device in the fourth step, the fourth step is a fourth step of requesting the third information from the terminal of the first user who has established a network with the rehabilitation device. -6 steps; And a 4-7 step of receiving the third information from the terminal in response to the request.

In addition, between the third step and the fourth step, the fourth step of requesting the third information from the external device; And a 4-5 step of receiving rejection information for refusing transmission of the third information from the external device in response to the request.

On the other hand, in the method of using an external device for transmitting information to a rehabilitation device according to another aspect of the present invention for achieving the above technical problem, a plurality of the first server storing first information related to the rehabilitation exercise of a plurality of users A first step of transmitting an information delivery request related to a first user who is at least one of the users of A second step of receiving information related to the first user from the first server when determining information related to the first user among the stored first information in response to the information delivery request; A third step of determining second information by using the information related to the first user; A fourth step of transmitting the second information to the rehabilitation device; And a fifth step of receiving third information related to the performed rehabilitation exercise from the rehabilitation device when the rehabilitation device performs the rehabilitation exercise for the first user based on the second information. have.

In addition, the sixth step of transmitting notification information notifying the reception of the third information to the first server; A seventh step of receiving a request for the third information from the first server in response to the transmitted notification information; And an eighth step of transmitting the third information to the first server in response to the request for the third information.

In a method for controlling a rehabilitation device according to another aspect of the present invention for achieving the above technical problem, an external device from a first server storing first information related to a rehabilitation exercise of a plurality of users is A first step of receiving at least one information related to a first user and, when the external device determines second information by using the information related to the first user, receiving the second information from the external device; A second step of performing a rehabilitation exercise for the first user based on the second information; And a third step of transmitting third information related to the performed rehabilitation exercise to the external device.

Also, between the first step and the second step or in the second step, receiving advertisement content from the first server based on information related to the first user; And playing the advertisement content through a display unit.

Further, after the third step, a fourth step of establishing a network with the terminal of the first user; And a fifth step of transmitting the third information to the terminal.

The present invention can provide a platform service related to rehabilitation exercises.

Specifically, the present invention provides information related to a rehabilitation exercise of a plurality of users based on a server, receiving a request for transmission of information related to a first user, at least one of the plurality of users, from an external device, and When the related information is transmitted to the external device, the external device determines the second information using the information related to the first user, and the rehabilitation device performs a rehabilitation exercise for the first user based on the second information, the external device A platform service related to a rehabilitation exercise for receiving third information related to a rehabilitation exercise performed from at least one of a device and a rehabilitation device may be provided.

In addition, the present invention, in performing rehabilitation treatment by moving at least a part of a fixed body, a vision for photographing at least one motion of a fixed part and an exercise part, and determining information related to rehabilitation treatment using the captured image data. Rehabilitation exercise equipment using the system can be provided to users.

In addition, the present invention relates to (1) a problem that a difference between the patient's motion angle and the patient's movement angle occurs in measuring the angle of the device, (2) the conventional problem that patient data recording depends on the therapist's handwriting, (3) the angle of the frame and the actual It can solve all of the problems that the patient's angle is different, (4) the problem that it is impossible to grasp the patient's actual ROM, and (5) the problem that the wrong treatment is provided due to a misjudgment.

In addition, the data stored according to the present invention can be converted into big data by applying cloud computing technology as needed in the future, so that it can be used as research data on the treatment and recovery of joint diseases, as well as the development of new medical devices and remote medical treatment. It can also be used.

On the other hand, the effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those of ordinary skill in the art from the following description. I will be able to.

1 is a view for explaining an example of degenerative arthritis of the knee according to the present invention.
Figure 2 shows a conventional rehabilitation exercise device and an example of use related to the present invention.
3 shows a block diagram of a rehabilitation exercise system proposed by the present invention.
4 is a block diagram of a rehabilitation device and a vision system among the rehabilitation exercise systems proposed by the present invention.
FIG. 5 shows a specific example of an exercise module among exercise devices proposed by the present invention described in FIG. 4.
6 shows a specific example of an exercise module having a vision system in the exercise device proposed by the present invention described in FIG. 4.
7 shows a specific example of obtaining an image through motion capture applied to the present invention.
8 is a diagram illustrating an active marker method, a passive marker method, and a method without using a marker applied to the present invention.
9 shows a specific example of identifying the position of a target using a retroreflective sheet or the like, which is an example of a marker according to the present invention.
10 shows a specific example of attaching a marker to an exercise device of a rehabilitation treatment system equipped with a vision system proposed by the present invention.
11 is a flowchart illustrating a rehabilitation exercise method using a vision system proposed by the present invention.
12 to 14 are diagrams for explaining minimum necessary information and obtainable information for accurate measurement related to rehabilitation exercises.
15 is a flowchart illustrating a method of reducing processing load and time by using a closed curve connecting multiple points of a marker.
16A to 16D are diagrams illustrating a process of reducing processing load and time by using a closed curve connecting multiple points described in FIG. 15.
17A and 17B illustrate an example of a rehabilitation device according to the present invention that can be transformed into CPM and CAM to determine a range of motion (ROM) before or after a rehabilitation exercise.
18 is a flowchart illustrating a process of determining a range of motion (ROM) and performing a rehabilitation exercise through the use of a CAM device prior to rehabilitation exercise in connection with the present invention.
19 is a flowchart illustrating a process of determining a range of motion (ROM) through the use of a CAM device after a rehabilitation exercise and notifying the server for user management in connection with the present invention.
20 is a flowchart illustrating a method of coping with a pain event and a method of managing a user through the same in relation to the present invention.
21 is a flow chart illustrating a first method of identifying a user in a rehabilitation exercise platform service according to the present invention.
22 is a flowchart illustrating a second method of identifying a user in a rehabilitation exercise platform service according to the present invention.
23 is a flowchart illustrating a first method of providing user confirmation and advertisement content in the rehabilitation exercise platform service according to the present invention.
24 is a flowchart illustrating a second method of providing user confirmation and advertisement content in the rehabilitation exercise platform service according to the present invention.
25 is a flowchart illustrating a first method related to a rehabilitation exercise and a service in the rehabilitation exercise platform service according to the present invention.
26 is a flowchart illustrating a second method related to rehabilitation exercise and service in the rehabilitation exercise platform service according to the present invention.
27 is a flowchart illustrating a method of using a service after a database is established in a rehabilitation exercise platform service according to the present invention.

One of the most representative of senile diseases is degenerative joint disease, and recently, it is occurring not only in the elderly and middle/aged, but also in the young.

The main causes of this are incorrect posture habits, excessive sodium and sugar intake, weight gain, heavy work and stress, lack of exercise, or joint injuries due to vigorous exercise.

1 is a view for explaining an example of degenerative arthritis of the knee according to the present invention.

1(a) shows an example of a knee joint in a normal person, FIG. 1(b) shows an example of early degenerative arthritis, and FIG.1(c) shows an example of severe degenerative arthritis will be.

Rehabilitation exercises are very important because the joints are not immediately recovered even after surgery, but the range of motion and the speed of recovery vary depending on the subsequent recovery treatment.

However, since a lot of pain is involved in joint rehabilitation exercise, it is difficult for the patient to exercise by himself, and eventually, limitation of the range of motion (LOM) appears due to contracture and inflammation.

In order to prevent this, joint motion range exercise is performed.The most common joint motion is continuous passive motion (CPM), which is an exercise performed by pure external force such as a therapist or mechanical device, and joint stiffness is turned on. It is to restore the function of the joint by continuously providing passive movement to the patient or surgical patient.

In addition, active joint movable motion (CAM: Continuous Active Motion) is also used for rehabilitation exercises.

As a type of joint motion range motion, there is a passive joint motion motion (PROM: Passive Range of Motion).

Manual joint movement exercise is an exercise within the range of motion within the pain range by external force (therapist, mechanical device, etc.) without voluntary muscle contraction.

In addition, manual joint movement exercise is necessary early after fracture, and the primary purpose is to prevent tissue construction and adhesion. It was introduced and used in the late 1970s.

Manual joint movement may cause additional damage due to the range of motion beyond the pain range, and the movement must be carefully progressed according to the patient's endurance.

As another joint motion range exercise, there is Active-Assist Range of Motion (AAROM).

Joint movement exercise is a form of active exercise that is assisted by external force when the main muscle is not sufficient to perform a complete movement.

As another joint motion range exercise, AROM (Active Range of Motion) refers to a joint motion range motion performed by active contraction of muscles without assistance or resistance.

The active joint movement exercise is executed as the next stage of AAROM, and is an exercise performed by one's own strength without giving any assistance to the patient.

Because CPM is a passive exercise by a mechanical device rather than the patient's own movement, it helps to recover the range of motion (ROM) without causing muscle fatigue, and helps to reduce pain and prevent complications.

Figure 2 shows an example of use and a CPM device for a knee joint related to the present invention.

The CPM device for knee joints shown in FIGS. 2A and 2B can easily control the speed, angle, time, number of times, etc. according to the patient's condition, and check the motion state.

However, there is a problem in that the deviation between the maximum movement angle specified on the CPM device and the actual joint motion range of the patient is large, and the difference cannot be confirmed or corrected through the CPM device, so that the degree of recovery of the patient is highly likely to be misjudged.

In addition, since physical therapists or exercise prescribers believe only the ROM on the CPM device and do not take into account the patient's pain, actual ROM, etc., the pain after exercise becomes severe, or side effects such as rupture and recurrence of the surgical site occur.

In addition, it is impossible to store individual exercise data in CPM devices commonly used by many patients, such as large hospitals and rehabilitation clinics, and personalized management for each patient is possible only when handwritten records of physical therapists or exercise prescriptions are concurrently performed.

However, in reality, it is difficult to check and record the condition of a patient undergoing CPM exercise in real time, so there is a problem that it is almost impossible to manage data on the history of exercise treatment and the degree of recovery for each patient.

In addition, as shown in (b) of FIG. 2, in order to measure the patient's actual ROM, a separate device called a ROM goniometer or a joint motion range measurer (ROM measuring device) should be used. Even so, there are still limitations in terms of accurate understanding of the patient's recovery and data management.

Therefore, in the present specification, in performing rehabilitation treatment by moving at least a part of a fixed body to solve this problem, information related to rehabilitation treatment is performed by photographing at least one motion of the fixed part and the exercise part, and using the captured image data. It is intended to provide users with a rehabilitation exercise device using a vision system that determines the value.

Meanwhile, in the present specification, for convenience of explanation, rehabilitation treatment for the knee is described below as a specific example, but the content of the present invention is not limited to knee rehabilitation, and can be applied to various fields related to physical rehabilitation of a patient. .

Whole system

3 shows a block diagram of a rehabilitation exercise system proposed by the present invention.

3, the rehabilitation exercise system 1 proposed by the present invention is composed of a rehabilitation system 10 and a server 20.

In addition, the rehabilitation system 10 according to the present invention may include a rehabilitation device 100 and a vision system 200.

It is possible to exchange data between the rehabilitation system 10 and the server 20 through short-range communication or long-distance communication.

Here, the short-range communication may include Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and Wireless Fidelity (Wi-Fi) technologies.

In addition, long-distance communication is CDMA (code division multiple access), FDMA (frequency division multiple access), TDMA (time division multiple access), OFDMA (orthogonal frequency division multiple access), SC-FDMA (single carrier frequency division multiple access) technology It may include.

The server 20 may process or store data received from the rehabilitation system 10 and provide the processed or stored data according to an external request.

Rehabilitation equipment and vision system

Hereinafter, components of the rehabilitation device 100 and the vision system 200 will be described in more detail with reference to FIG. 4.

4 is a block diagram of a rehabilitation device and a vision system among the rehabilitation exercise systems proposed by the present invention.

4, the rehabilitation device 100 according to the present invention includes a wireless communication unit 110, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an exercise unit 170, It may include a control unit 180 and a power supply unit 190.

However, since the components shown in FIG. 4 are not essential, a terminal having more components or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the rehabilitation device 100 and a wireless communication system or between the rehabilitation device 100 and a network in which the rehabilitation device 100 is located.

The wireless communication unit 110 transmits and receives a wireless signal with at least one of a base station, an external rehabilitation device 100, and a server 20 on a mobile communication network.

The wireless signal may include various types of data according to transmission/reception of an audio signal, an image signal, a video signal, and a text/multimedia message.

The wireless communication unit 110 can use short-range communication, and is a short-range communication technology such as Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), and Ultra-Wideband (UWB). , ZigBee, etc. may be used.

In addition, the wireless communication unit 110 may operate as a module for acquiring the position of the rehabilitation device 100, and a representative example thereof is a GPS (Global Position System) module.

Next, the user input unit 130 generates input data for the user to control the operation of the rehabilitation device 100. The user input unit 130 may include a key pad, a dome switch, a touch pad (positive pressure/power failure), a jog wheel, a jog switch, and the like.

The sensing unit 140 is a rehabilitation device 100 such as an open/closed state of the rehabilitation device 100, a location of the rehabilitation device 100, whether a user is in contact, an orientation of the rehabilitation device 100, and acceleration/deceleration of the rehabilitation device 100. ) To generate a sensing signal for controlling the operation of the rehabilitation device 100 by detecting the current state.

In particular, the sensing unit 140 may sense at least one of a user's electrocardiogram, blood pressure, oxygen level, body temperature, respiration, blood, urine, and body fluid components related to the rehabilitation device 100 and generate a sensing signal. .

In addition, the output unit 150 is for generating an output related to visual, auditory or tactile sense, and may include a display unit 151 and an audio output module 152.

Here, the display unit 151 displays (outputs) information processed by the rehabilitation device 100. When the rehabilitation device 100 is in the photographing mode, a photographed or/and received image, UI, or GUI is displayed.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display. display) and a 3D display.

Some of these displays may be configured as a transparent type or a light-transmitting type so that the outside can be seen through them. This may be referred to as a transparent display, and a representative example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be configured as a light transmission type structure. With this structure, the user can see an object located behind the body of the rehabilitation device 100 through an area occupied by the display unit 151 of the body of the rehabilitation device 100.

Two or more display units 151 may exist depending on the implementation form of the rehabilitation device 100. For example, in the rehabilitation device 100, a plurality of display units may be spaced apart or integrally disposed on one surface, or may be disposed on different surfaces.

When the display unit 151 and a sensor (hereinafter referred to as'touch sensor') for detecting a touch motion form a mutual layer structure (hereinafter, referred to as a'touch screen'), the display unit 151 It can also be used as an input device. The touch sensor may have, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or a capacitance generated at a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only a touched position and area, but also a pressure at the time of touch.

When there is a touch input to the touch sensor, a signal(s) corresponding thereto is transmitted to the touch controller. The touch controller processes the signal(s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know whether an area of the display unit 151 is touched.

In addition, the display unit 151 may be provided separately, such as a bed, a wall surface of a hospital room in which a patient is admitted, and the like, not only provided in the rehabilitation device.

That is, it is possible to display information transmitted and received through the communication unit on the display unit 151 provided in the rehabilitation device or on the display unit 151 provided in another place separated from the rehabilitation device under the control of the controller 180. Do.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a recording mode, a voice recognition mode, an image output mode, or the like. The sound output module 152 also outputs sound signals related to functions performed by the rehabilitation device 100. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The memory unit 160 may store a program for processing and control of the controller 180, and performs a function for temporary storage of input/output data (eg, audio, still image, video, etc.) You may. The memory unit 160 may store data regarding vibrations and sounds of various patterns output when a touch input on the touch screen is performed.

The memory 160 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), and RAM. (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic It may include at least one type of storage medium among a disk and an optical disk. The rehabilitation device 100 may operate in connection with a web storage that performs a storage function of the memory 160 over the Internet.

The exercise unit 170 provides a function of supporting a rehabilitation exercise of a patient in need of rehabilitation.

The exercise unit 170 according to the present invention may include a seating unit 171, a driving unit 172, a moving unit 173, and the like.

First, the seating unit 171 provides a function of seating and fixing at least a part of the body of a patient in need of rehabilitation.

Next, the moving unit 173 receives power from the driving unit 172 and provides a function of performing a rehabilitation exercise by moving a part of the body of the patient fixed through the seating unit 171.

FIG. 5 shows a specific example of an exercise module among the rehabilitation device 100 proposed by the present invention described in FIG. 4.

Referring to FIG. 5, the seating unit 171 provides a function of seating and fixing a leg area of a patient requiring rehabilitation.

In addition, referring to FIG. 5, the moving unit 173 receives power from the driving unit 172 and provides a function of performing a rehabilitation exercise by moving a fixed patient's foot back and forth through the seating unit 171.

In addition, the controller 180 typically controls the overall operation of the rehabilitation device 100.

The controller 180 may perform a pattern recognition process capable of recognizing a handwriting input or a drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for the operation of each component.

Various embodiments described herein may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions, in some cases herein. The described embodiments may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as procedures and functions described in the present specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. The software code can be implemented as a software application written in an appropriate programming language. The software code may be stored in the memory 160 and executed by the controller 180.

In addition, the vision system 200 is a module that secures an image related to a patient through motion capture.

Representatively, the vision system 200 may include a camera 210 or the like.

The camera 210 processes image frames such as still images or moving pictures obtained by the image sensor in the photographing mode.

Also, the processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 210 may be stored in the memory 160 or transmitted to the server 20 through the wireless communication unit 110.

Here, two or more cameras 210 may be provided depending on the use environment.

In addition, FIG. 6 shows a specific example of an exercise module having a vision system in the exercise apparatus proposed by the present invention described in FIG. 4.

Referring to FIG. 6, a camera 210 is disposed on one side of the exercise unit 170, and the disposed camera 210 may acquire motion image data of a patient's rehabilitation treatment through motion capture.

On the other hand, in the present invention, in order to solve the conventional problem, when the vision system 200 acquires the motion image data of the patient's rehabilitation treatment through motion capture, the rehabilitation treatment of the patient is based on the position change recognized through image processing. It is possible to provide a user with a rehabilitation treatment device, system, and control method that extracts and uses information related to exercise.

The inventor of the present application conducted an investigation on the requirements of a doctor/physical therapist, and as a result of the interview, 100% of the respondents answered that data recording was necessary, but only 40% of them answered that they recorded data on rehabilitation treatment.

However, since they answered that there was no response data in case of friction with the patient due to incorrect CPM exercise or manual therapy, the reliability of the data was found to be very low.

In addition, most of the respondents answered that a CPM device that can automatically record and manage patient exercise data is needed for systematic rehabilitation management and medical dispute prevention and resolution.

In addition, the inventor of the present application conducted an investigation on the patient's requirements, and it is a reality that there is a large difference between the ROM on the device and the ROM of the actual patient during rehabilitation exercise through a CPM device after joint surgery, and patients who want to rent a CPM device I was able to easily meet the demands of their "find a CPM device with a good angle of view."

In addition, in severe cases, the difference between the ROM on the CPM device and the actual patient ROM by at most 40° decreases the treatment effect, and in this case, the exercise therapist must directly perform manual therapy, and the ROM must be checked directly with a joint goniometer. It was confirmed that there were many difficulties in obtaining treatment tools and grasping the degree of patient recovery. In the community of patients with joint disease and joint surgery, the review of rehabilitation treatment that there was a difference between the angle on the CPM device and the actual angle was confirmed.

Therefore, the inventor of the present application decided to combine the image acquisition and image processing method applying motion capture technology in order to develop a CPM that can accurately measure the actual ROM in real time and grasp the user's request in advance.

In the present invention, the motion image of the patient is acquired through the VISION H/W 200, and the motion image of the patient is analyzed using the image processing S/W according to the controller 180 to determine the number of movements, time, speed, and maximum/ Data such as minimum ROM can be stored.

By storing this in the DB of the connected server 20 and allowing it to be checked through an application (APP), it facilitates systematic storage, management, and utilization of treatment data, and based on this, customized treatment according to the recovery speed of individual patients is possible. can do.

The rehabilitation system 10 equipped with the vision system 200 enables real-time measurement during exercise, and not only the specified number of exercises/speed/time, but also the ROM/number/speed/time of the actual patient and the presence of pain. ).

In addition, since it is automatically stored in DB, it is easy to manage treatment history and customized treatment for each patient.

In addition, since the present technology is implemented by combining medical big data and cloud computing technology at the server 20 stage, it has timely fit to meet industry trends and market demands, and is a creative technology that provides innovative functions and convenience.

Based on the rehabilitation system 10 provided with the vision system 200 proposed by the present invention, the patient's actual ROM and data such as movement speed, time, and frequency can be extracted through image processing S/W, It is possible to prevent the problem that occurs because the CPM device and the actual patient's motion angle do not match.

In other words, since exercise data remains as an objective number during the treatment process, both the patient himself and the exercise therapist can accurately know the degree of recovery, and a data infrastructure capable of appropriate customized treatment for each patient can be established.

Meanwhile, in order to implement this technology proposed in the specification, basic CPM driving technology such as mechanism design and control of CPM devices, motor control, etc., and VISION H/W, S/W, and cloud used for transmission to DB for image acquisition and analysis. Application development technology for computing and checking stored data, and big data construction technology for storing and storing transmitted data are required.

For the complete implementation of this technology, all technologies must be closely fused. Through this, the limitations of existing products can be overcome, user convenience and the function of the product itself can be greatly improved, further improving the quality of medical services and It can contribute to the development of new medical devices.

Motion capture technology

Meanwhile, in the present invention, in relation to image acquisition by the camera 210, a motion capture technique is applied.

Motion capture technology to be applied for image acquisition in this technology is mostly used in entertainment fields such as games, movies, and animations, but in this technology, it is used to acquire medical images.

7 shows a specific example of obtaining an image through motion capture applied to the present invention.

Referring to FIG. 7, the vision system 200 acquires data related to the rehabilitation device 100 through motion capture, and extracts information related to the rehabilitation treatment exercise of the patient based on the position change recognized through image processing. Each step used is shown.

7A to 7D, the motion capture method is a contact-type motion recognition technology that recognizes the motion of an object by attaching a sensor to the object.It is used in CG of movies, and can recognize relatively accurate motion. There is an advantage that there is.

As techniques for such motion capture, an active marker method, a passive marker method, and a method that does not use a marker may be applied.

8 is a diagram illustrating an active marker method, a passive marker method, and a method without using a marker applied to the present invention.

Referring to FIG. 8A, an active marker scheme is shown.

The active marker method may include a mechanical method (gyro method), a magnetic field method (magnetic), a video method (image tracking), an active optical (frequency method), and the like.

Here, the mechanical method (gyro method) is a method that measures and transmits the rotating shaft of a mechanical joint in the joint. It is possible to obtain data with little noise, but the attachment equipment is heavy and the object's movement is restricted, resulting in poor precision.

In addition, the magnetic field method (magnetic) is a method that measures and transmits the position value of the sensor by radiating a magnetic field. The price and maintenance cost of the equipment are lower than that of the optical method, but the operation of the object is limited because the cable is used. There is a risk of data loss due to metal objects.

In addition, the video method (image tracking) is a method of calculating a position value by analyzing an image captured as a video.

Video is composed of a series of image frames, and there is spatiotemporal similarity (similar position, size, shape, etc. of an object in the image) between adjacent image frames. In tracking, history information is used to track a specific object, and the price is low. There are no restrictions on the motion and shooting location, but there is also a disadvantage in that the precision of the data is poor.

In addition, active optical (frequency method) is a method in which an optical sensor transmits its own frequency to a number of camera sensors, and RED-LED is mainly used as a marker, and the inexpensive method has few restrictions on places, and there is little interference between sensors. However, the radical operation is limited, but there is also a limitation that you must always carry the power pack.

Referring to (b) of FIG. 8, a passive marker method is shown.

The passive marker method is representative of the passive optical (optical method), and the most widely used method is frequently used as a method in which a camera photographs each sensor and calculates the position.

In other words, reflective markers are attached to the body, captured with an infrared camera that emits infrared light, and these markers provide a two-dimensional position, and motion capture software calculates it as 3D data.

The actor can move the body freely, and even if two or more quick fights are performed, it can be captured almost completely, but the equipment is expensive, and there are disadvantages that it is affected by the surrounding light a lot.

Referring to (c) of FIG. 8, a markerless method that does not use a marker is shown.

The markerless method uses a number of color video cameras and image processing technology to detect and track the position of an actor's head, body, hands, and feet in real time without a marker, and does not attach a marker or sensor to the body. No special lighting is required, and it can be applied not only to animation production, but also to a motion interface for the general public.

In the present invention, the active marker method, the passive marker method, and the method not using a marker described above with reference to FIG. 8 may be applied, but for convenience of explanation, in the present invention, the marker 30 is attached to the exercise device 100 A method of recognizing the patient's rehabilitation treatment behavior is proposed.

The marker 30 proposed by the present invention can be applied in three ways. However, the content of the marker 30 proposed by the present invention is not limited to three methods, and more various methods may be applied.

As for the marker 30 proposed by the present invention, an element capable of emitting light may be applied to the outside, and the three methods according to this are as follows.

(1) Method using retroreflective sheet and lighting

(2) Self-luminous lighting method

(3) A method of scattering a single color corresponding to a specific frequency

First, “(1) a method using a retroreflective sheet and lighting” is provided with a separate lighting unit in the camera 210 of the exercise device 100, and the retroreflective sheet is attached to at least a part of the exercise device 100. .

In this case, the retroreflective sheet receiving the light output from the lighting unit reflects the light, so that the camera 210 can photograph the position of the marker 30.

Next, “(2) lighting method that emits light by itself” is a method in which the marker 30 itself serves as a lighting unit.

That is, the marker 30 supplied with power from the power supply unit 190 emits light on its own, and the camera 210 captures this so that the position and position change of the marker 30 can be grasped.

In the second method, the camera 210 does not need to provide a separate lighting unit.

In addition, "(3) a method of scattering a single color corresponding to a specific frequency"" can be provided with a separate lighting unit in the camera 210, and the marker 30 scatters light using natural light without the lighting unit. It is possible.

That is, the marker 30 is made of a material that scatters light only at a specific frequency, and the light received from the lighting unit of the camera 210 or a specific light corresponding to natural light is scattered, and the camera 210 photographs it, It is possible to grasp the position and position change of the marker 30.

Meanwhile, as described above, the content of the present invention is not limited to the marker 30, and other methods, that is, an active marker method, a passive marker method, and a marker may also be applied.

Hereinafter, "(1) a method using a retroreflective sheet and lighting" will be described in more detail with reference to the drawings.

9 shows a specific example of identifying the position of a target using a retroreflective sheet or the like, which is an example of a marker according to the present invention.

In this proposed technology, a motion capture method is applied, and instead of attaching a sensor, a target of a square, square, and hemispherical shape is manufactured using retro-reflective paper, and it is planned to be attached to the rehabilitation device 100.

The retroreflective technology applied to the present invention is mainly used to measure distances using light sources having different wavelengths, and is used to improve the recognition of road signs/road signs, or to measure the three-dimensional position of underground facilities.

Retroreflection is a reflection that returns incident light rays as they are, and reflects light in the direction of the light source no matter which direction the light comes in.

Because of this characteristic, it is mainly used for signs of severely curved roads or work signs on night roads, and is widely used in safety products for night workers.

9A and 9B, an example of a road sign using a retroreflective sheet is shown.

In addition, referring to (c) and (d) of FIG. 9, when the sensor in the motion capture method is replaced with a retroreflective, and the image is processed by photographing using a camera, the motion is recognized in a manner similar to that of attaching the sensor. As an example that can be done, an example of recognizing a golf motion is shown.

Referring to FIG. 10 to apply an image acquisition method and a marker through motion capture described in FIG. 9.

10 shows a specific example of attaching a marker to an exercise device of a rehabilitation treatment system equipped with a vision system proposed by the present invention.

Referring to FIG. 10, in addition to the camera 210 and the exercise device 170 described in FIG. 4, an example of attaching the marker 30 to at least a partial area of the moving unit 173 is illustrated.

In the present invention, the sensor in the conventional motion capture method is replaced with a marker (retroreflective paper, 30), and a method of photographing and processing an image using the camera 121 is applied.

As illustrated in FIG. 10, a plurality of markers 30 may be disposed at a position of the moving unit 173 corresponding to a joint portion of a patient.

Method for determining information related to rehabilitation treatment using captured image data

11 is a flowchart illustrating a rehabilitation exercise method using a vision system proposed by the present invention.

Referring to FIG. 11, first, a step (S11) of fixing at least a part of the user's body through the seating part 171 is performed.

Thereafter, a step S12 of performing rehabilitation treatment by moving the moving unit 173 by receiving the power of the driving unit 172 is performed on at least a part of the fixed body.

At this time, the camera 210 of the vision system 200 photographs operations such as the seating unit 171, the driving unit 172, and the moving unit 173 (S13 ).

Then, using the captured image data, the controller 180 determines first information related to the rehabilitation treatment (S14), and transmits the determined first information to the outside through the wireless communication unit 110 (S15).

Thereafter, when the rehabilitation device 100 receives second information corresponding to the first information from the server 20 or the like through the communication unit 110, displaying the second information through the display unit 151 (S16). ) Proceeds.

At this time, the seating unit 171, the driving unit 172, the moving unit 173, etc. may include at least one identifier, a marker 30, and in step S14, the control unit 180 The first information is determined using one identifier (marker 30).

Here, the at least one identifier is a singular point provided in at least a part of the seating unit 171, the driving unit 172, and the moving unit 173, and the seating unit 171, the driving unit 172, and the moving unit ( 173) may be at least one of markers provided on at least a portion of the etc.

That is, it is possible to analyze by using a specific point of the moving unit 173 as a singular point without attaching the marker 30 separately.

Meanwhile, the marker 30 may be divided into a first marker provided on at least a part of a fixing part such as the seating part 171 and a second marker provided on at least part of the moving part 173.

In this case, in step S14, the controller 180 may recognize the first marker and the second marker in the image data, and determine the first information by using the position change of the recognized first marker and the second marker.

Meanwhile, as shown in FIGS. 5 and 6, the seating part 171 according to the present invention may include a configuration that compresses and fixes the user's thigh in addition to the shape associated with the sole.

The body fixing mechanism for compressing the thigh may be used as a sensor for measuring the thickness of the user's body.

In addition, it is possible to additionally apply an auxiliary movement device to the rehabilitation device 100 and attach a marker 30 to the auxiliary movement device to more accurately determine the movement.

At this time, even at the same angle and speed, exercise application may vary depending on the initial setting value (the height of the rehabilitation device, etc.) and the body thickness (fixing device), so in the present invention, the controller 180 uses the initial setting value and the body thickness together. Thus, the patient's movement and degree of movement can be grasped.

In addition, in the present invention, an effective motion range value can be set through the maximum angle at which the patient can move.

The setting of the motion range value may be utilized to determine the motion range of the patient in advance prior to applying the rehabilitation device 100.

In addition, in the present invention, a method of controlling the operation of an external device by using a marker attached to an operation device (exterior + operation unit) and using a marker attached to the exterior and a position change of the marker of the operation unit may be combined.

On the other hand, in the present invention, in order to determine the degree of adhesion of the fixing part or the seating part 171 (fixing the thigh, calf, etc.), three markers 30 are attached to the fixing part 171 so as to be triangles of different lengths. , It is possible to grasp the shape of the rehabilitation patient by using the change (position, angle, etc.) of the marker 30.

In addition, it is determined whether the arrangement between the camera 210 and the rehabilitation device 100 is normal using the arrangement shape and separation distance of the marker 30 obtained through the camera 210, and according to the determination result, the camera ( 210) can also be changed.

In addition, in the present invention, it is possible to additionally place a guide line along the leg line and separately attach a marker 30 to the guide line for additional use.

In addition, in the present invention, it is possible to propose a solution when a normal motion is not performed according to an adhesion error of the fixing part 171 (fixing the thigh, calf, etc.).

That is, if the exercise is continuously performed, and the exercise value performed after the abnormal exercise value differs by more than a preset value, the result value of the abnormal case is ignored (deleted).

In addition, the responsibility for abnormal conditions can be attributed to a physical therapist who does not properly adhere to the fixture (it will not be the responsibility of the hospital).

Regarding step S14, the controller 180 finds the marker 30, identifies the marker 30, determines a body region corresponding to the marker 30, determines a virtual line, and tracks the virtual line. You can track the movement of the rehabilitation patient.

In addition, in the present invention, by attaching a plurality of identifiable markers 30 to the thigh or calf fixing part 171, information on the movement and thickness of the patient's body can be obtained at once, and the number of markers attached to other points can be reduced. I can.

In addition, since a finder for the location of the marker 30 is required before the content of the marker 30 is grasped, in the present invention, a technique of indicating the location of the marker 30 by placing three points may be applied.

In addition, in the present invention, by specifying the angle of the device before the patient's rehabilitation exercise (for example, 0 degrees) and setting the device according to the angle, the alignment value is set based on a specific marker, which is used as an initial alignment technique. It is possible.

In addition, in the present invention, when applying the fixing portion 171 that does not wrinkle with a large area, a surface marker and a detection method for a curved surface can be applied.

If an LED is used as the marker 30, it is also possible to increase the type of identification of the marker by using an emission color, a blinking pattern, or the like.

In addition, in the present invention, information about the leg before surgery is collected, information about the length of an artificial joint inserted into the human body is acquired during surgery, and the rehabilitation range is set by using the data before the surgery and the artificial joint data together during the rehabilitation exercise. It is possible.

Meanwhile, in the present invention, information obtained through X-ray, CT, MRI, etc. is accumulated and obtained, coordinate information related to bone and body thickness is accumulated and extracted based on the obtained information, and the extracted coordinate information is used as auxiliary information. By using it, the user's body position can be accurately identified.

For example, it is possible to extract coordinate information related to a bone from user information acquired through X-ray, and use the coordinate information related to the bone together with a marker to grasp the movement of the user.

In addition, in the present invention, a method of additionally arranging an auxiliary marker around the marker 30 and finding the center of the marker may be applied.

That is, the location can be identified using the shape (ID) of the marker, and the center can be found using the auxiliary marker.

In the band-shaped fixing part 171, a material having elasticity is applied to the side invisible from the camera 210, but a material having no elasticity and no wrinkles may be applied to a region in which a three-point marker or the like is disposed.

In addition, storing information on the marker 30 in advance in the server 20 or the like, and approximately grasping the location of the marker 30 based on the stored content, does not require a large operation and can be easily processed.

Among the driving units 172 applied to the present invention, a method of shooting with the camera 210 only for a certain area from the maximum point at which the motor 172 can move other than the method of always shooting with the camera 210 related to the 3-axis motor Can be applied.

Hereinafter, with reference to the drawings, information used in the image data captured by the controller 180 in step S14 will be described, and first information determined based on this information will be described.

In addition, in order to set up an accurate device tailored to the patient, what is the second information will be described, and a method of using the data measured by the server 20 will be described in detail.

12 to 14 are diagrams for explaining minimum necessary information and obtainable information for accurate measurement related to rehabilitation exercises.

First, information used in image data captured by the controller 180 in step S14 will be described.

,

값, 재활환자의 종아리 및 허벅지 두께가 될 수 있다.Referring to Figure 12, the information used by the control unit, L1, L2,

,

Value, can be the thickness of the rehabilitation patient's calf and thigh.

이 도출될 수 있다.Where L1 is the length including the variable point at the end of the device, through L1

Can be derived.

를 도출할 수 있다.Also, L2 is the length including the variable point at the other end of the device, through L2.

Can be derived.

,

값은 재활기기(100)의 위치를 기준으로 환자(사용자)에 의해 변화된 벡터값으로서, 도 12 상의

및

값이 될 수 있다.Also, due to the body

,

The value is a vector value changed by the patient (user) based on the location of the rehabilitation device 100,

And

Can be a value.

In addition, the thickness of the calf and thigh of a rehabilitation patient is necessary for accurate rehabilitation exercise.

값이 도출된다.In addition, referring to FIG. 13, the necessary information L1 can be derived through M1 and (M1 or M3 or M9) in FIG. 13, through which

The value is derived.

값이 도출된다.In addition, referring to FIG. 13, the necessary information L2 is derived through M7 and (M5 or M6 or M9) shown in FIG. 13, through which

The value is derived.

Next, as necessary information, vector value and thickness information, band markers located on the thigh and calf are utilized.

과 L1과 BM2 를 이용하여 BL1은 도출 가능하고, BM1으로 두께정보 도출도 가능하다.In other words, based on the thigh-related band marker [BM1],

Using L1 and BM2, BL1 can be derived, and thickness information can be derived with BM1.

와 BM2 를 이용하여 BL2 도출이 가능하고, BM2으로 두께정보 도출도 가능하다. In addition, based on the calf-related band marker [BM2],

BL2 can be derived using and BM2, and thickness information can be derived using BM2.

Next, first information determined by the controller 180 will be described.

,

,

,

정보를 획득할 수 있다.Referring to FIG. 14, M1, M7, M8, M9, M10, BM1, and BM2 may be used as the minimum necessary information among the information obtained in FIGS. 12 and 13, and through this, the controller 180 , L1, L2,

,

,

,

Information can be obtained.

In the present invention, based on the obtained information, it is also possible to grasp the rotational motion.

In addition, second information for setting an accurate device tailored to the patient will be described.

First, the second information may be patient recognition and patient-customized rehabilitation information.

Here, ① information is provided directly to the patient terminal through patient authentication, ② provided to a physical therapist using a terminal, etc., and ③ a display 151 is placed on the device 100 for display.

In addition, the second information may be information for setting the rehabilitation device 100.

In this case, the method of ① providing setting information directly to the patient through patient authentication or ② providing the physical therapist using a terminal or the like is applied.

Meanwhile, elements set through the second information may include ① L1 and L2 lengths.

In addition, as shown in Table 1 below, the values of ② LL1 and LL2 may also be included.

In addition, the second information may include ③ speed, number of times, ④ L1, L2, LL1, LL2, speed, number of times information.

In the case of setting the rehabilitation device 100 through the second information, ① a method of setting to LEVEL when the user band is connected may be used.

In addition, in the present invention, as a case of resetting the rehabilitation device 100, the following events may be mentioned.

First, there are cases where an error message occurs when the patient presses the emergency button.

In addition, as a result of checking through the vision system 200, if there is a difference from the past data, a difference from the doctor's prescription, or an error in the setting value, the reset may be performed and the server 20 may be notified again.

Finally, a method of utilizing the data measured by the server 20 will be described.

As shown in Table 2 below, it can be used as a method of modifying patient-related schedules and setting values.

In addition, it can be used to identify faults and liables, and can be used to determine whether or not to be responsible and liable based on video information + schedule information + execution information.

In addition, it is possible to use it as big data to develop, derive, and propose a treatment method or optimal treatment program based on body information + PHR + surgery information + artificial joint material.

On the other hand, in the present invention, as a service provision method for rehabilitation patients during rehabilitation time (15 minutes-20 minutes), a method of converting surroundings for pain, a method of generating revenue through advertisements, etc. may be applied.

Representatively, ① to provide enjoyment, contents such as music and movies can be provided, and ② to provide health information, determine the current state of health (determining a stroke through voice is also possible), and to proceed later based on the stored information. A plan may be explained and guidance on changes in health conditions may be provided as the rehabilitation progresses.

In addition, as ③ advertisements (charged to the advertisement requesting company), based on PHR information, health food, equipment, medicine, etc. may be displayed.

At this time, advertisements may be possible by determining patient-specific content based on DB.

In addition, as a method of determining whether a rehabilitation patient is abnormal, input an exercise program, predict movement of the device 100, determine a standard pattern according to the movement of the device 100, and check whether the movement of the patient over a preset range deviates from the standard pattern. In case of deviation, judgment and action may be applied.

In addition, in the present invention, based on the display unit 151, 1) a guide to the patient's movement state, 2) an advertisement content display, 3) a guide content display for a physical therapist, 4) remote medical treatment-a video call of a doctor , 5) Through augmented reality, a rehabilitation patient's movement can be displayed.

In addition, as a binding device for fixing the patient's body, a pressure sensor, a load cell, a gyro sensor, and the like may be additionally used.

In addition, in relation to the arrangement of the camera 210 in relation to the rehabilitation device 100, 1) a separate space (for example, a box, a frame, etc.) for inserting the camera is provided, and 2) the size of the vision system is an adult fist It can be implemented to the extent of its size, and 3) apply a special camera that improves the depth of the camera.

In the present invention, it is most preferable to place the camera at the positions of markers 10 and 4 in FIGS. 12 to 14, but a position of marker 7 is also possible.

In addition, in the case of arranging the 4th marker, the display 151 may be disposed together.

In addition, in connection with the change of the shape of the device and the position of the camera, the rehabilitation device 100 may be manufactured in a folded or unfolded shape, and the position of the camera may be changed by matching the left hand/right hand or the left foot/right foot. In addition, cameras based on specific hands and feet can be fixedly manufactured.

On the other hand, as the user information that the server 20 can acquire through the terminal used by the user, ID (name), age, sex, surgery (rehabilitation) hospital, surgery content (proceed with related multiple-choice questions)-disease name, It may include an operation method, an operation date, and the like.

In addition, as important information related to rehabilitation obtained by the server 20, the maximum angle picture, the minimum angle picture, a preset number of images/videos for a repetitive period, the start and end time of the exercise, the number of times, whether an emergency emergency occurs. (the number of times the emergency button was pressed, etc.).

How to use a closed curve

On the other hand, in finding and analyzing the above-described marker 30, a problem of increasing processing load and time may occur.

Therefore, in the present invention, by using a closed curve connecting multiple points and analyzing within a region, it is intended to reduce the processing load and time.

15 is a flowchart illustrating a method of reducing the processing load and time using a closed curve connecting multiple points of a marker, and FIGS. 16A to 16D are a processing rod and a processing rod using a closed curve connecting multiple points described in FIG. 15. It is a diagram of the process of reducing time.

Referring to FIG. 15, a step (S21) of loading a closed loop in which at least one identifier is connected is performed.

Referring to FIG. 16A, each point of a marker attached to the rehabilitation device 100 is displayed, and referring to FIGS. 16B and 16C, a closed loop connecting each point is shown.

In step S21, a closed loop as shown in FIG. 16C is loaded.

After step S21, a step (S22) of recognizing at least one of the fixed part, the exercise part, and the at least one identifier in the image data using a closed loop is performed.

That is, as shown in FIG. 16D, since the fixed part, the exercise part, and at least one identifier (marker 30) of the rehabilitation device 100 are identified using a specific closed loop, processing load and time can be reduced. I can.

Thereafter, the step (S23) of determining the first information by using the identifier in the image data proceeds.

Therefore, in the present invention, by using a closed curve connecting multiple points and analyzing within a region, it is possible to reduce the processing load and time.

In addition, in the present invention, in using a closed curve, a deep learning technique can be additionally applied.

For example, when deep learning is performed by performing a marker identification operation using a closed curve repeated tens of times, even if two of the preset 10 markers are not identified, they are not identified based on the information accumulated through deep learning. Since the positions of the two markers that are not indicated are estimated without separate instructions, and at least one identifier (marker 30) is identified based on the estimated information value, processing load and time can be reduced.

In addition, in the present invention, a deep learning technique may be additionally utilized. Deep learning refers to a machine learning technology built on the basis of an artificial neural network (ANN) in order to be able to learn by itself like a human using multiple data.

In deep learning, the human brain learns a machine to discern objects by imitating the information processing method that distinguishes objects after discovering patterns in a number of data, and when deep learning technology is applied, humans set all criteria for judgment. Without giving, the computer can recognize, reason, and judge by itself.

An embodiment that can transform a rehabilitation device into CPM and CAM

Meanwhile, as an embodiment according to the present invention, the rehabilitation device 100 may be transformed into CAM and CPM.

That is, the rehabilitation device 100 may be manufactured to operate with both CPM and CAM, and after the end of the CPM exercise, the patient's condition may be provided as a report through a game using the CAM mode.

Alternatively, prior to the rehabilitation exercise, it is possible to grasp the patient's ROM, etc. through the CAM mode, and perform a patient-customized rehabilitation exercise program through CPM based on the identified patient's condition.

Specifically, the present invention uses an exercise unit for performing rehabilitation treatment by moving at least a part of a fixed body at a predetermined speed and number of times in a certain section, but the exercise unit can be driven by force by at least a part of the fixed body. Therefore, CPM method and CAM method can be used together.

17A and 17B illustrate an example of a rehabilitation device according to the present invention that can be transformed into CPM and CAM to determine a range of motion (ROM) before or after a rehabilitation exercise.

Referring to FIG. 17A, CPM equipment constituting a joint restraint and motion part through a motor 174, a coupling 175, and a ball screw guide 176 is displayed.

In the CPM equipment shown in FIG. 17A, the motor 174 and the ball screw guide 176 are connected (fixed) to act as a load.

In the present invention, as shown in Fig. 17A, it is not only used as a CPM device, but proposes a rehabilitation device 100 that can use a CAM together to extend a range of motion (ROM) before or after a rehabilitation exercise.

Referring to FIG. 17B, unlike that shown in FIG. 17A, the motor 174 and the ball screw guide 176 may be separated by an electric force.

That is, instead of the coupling 175, the electromagnetic clutch 177 and the electromagnetic brake 178 are applied and used.

Here, when used as a CPM, the electronic brake 178 is connected to exercise with a motor force, but when used as a CAM, the connection with the electronic brake 178 may be released to allow the patient to exercise by magnetic force.

As described above, in order to extend the range of motion (ROM) before or after the rehabilitation exercise, it can be used as a CAM equipment.

18 is a flowchart illustrating a process of determining a range of motion (ROM) and performing a rehabilitation exercise through the use of a CAM device prior to rehabilitation exercise in connection with the present invention.

Referring to FIG. 18, a step S31 of determining a range of motion (ROM) of a fixed body is performed based on an exercise unit that can be driven by force by at least a part of the fixed body.

Thereafter, according to the determined ROM, the exercise unit moves at least a part of the fixed body at a predetermined speed and number of times in a predetermined section to perform rehabilitation treatment (S32).

Therefore, before applying CPM, since the patient's ROM (range of motion) is determined through the CAM, efficient exercise can be induced.

In addition, FIG. 19 is a flowchart illustrating a process of determining a range of motion (ROM) through the use of a CAM device after a rehabilitation exercise and notifying a server for user management in connection with the present invention.

Referring to FIG. 19, a step S33 of performing rehabilitation treatment by moving at least a part of a fixed body at a predetermined speed and number of times in a predetermined section is performed.

Thereafter, a ROM is determined (S34) based on an exercise unit that can be driven by a force by at least a part of the fixed body, and the determined ROM is transmitted to the outside (S35).

Therefore, after the rehabilitation exercise through CPM, the degree of rehabilitation progress of the patient can be grasped and shared through the CAM, so that it can be effectively used for the rehabilitation treatment of the patient.

How to cope with pain events and manage users

On the other hand, at present, since the patient's pain and problems can be recognized only through the operation of pressing the patient's emergency switch, a method of coping with a pain event and a method of managing a user through the same are required.

As a method of stopping the movement of the device due to incorrect rehabilitation treatment, ① the user manually stops ② the device 100 automatically stops when certain conditions are satisfied, and ③ the physical therapist stops the method.

In particular, in the present invention, while performing rehabilitation treatment by moving at least a part of a fixed body, information on rehabilitation treatment is transmitted to the server, and feedback information received from the server, user body information sensed by the sensor, and input from the user. It is possible to determine that an emergency event has occurred by using at least one of the commands, and to stop a rehabilitation treatment operation when the emergency event occurs.

20 is a flowchart illustrating a method of coping with a pain event and a method of managing a user through the same in relation to the present invention.

Referring to FIG. 20, first, a step (S41) of performing rehabilitation treatment by moving at least a part of a fixed body is performed.

As described above, the rehabilitation device 100 transmits the first information on the rehabilitation treatment to the server 20 (S42).

At this time, the step (S43) of receiving feedback information from the server, sensing user body-related information or inputting a user's command is performed, and an emergency event is generated using at least one of feedback information, sensing information, and input information. It is possible to determine what has occurred (S44).

When an emergency event occurs, the rehabilitation treatment operation of the exercise unit may be stopped (S45), and information on the occurrence of the emergency event may be transmitted to the server 20 (S46).

In addition, by receiving (S47) resetting information of the exercise unit according to the occurrence of an emergency event from the server 20, the rehabilitation exercise may be performed later.

Here, the feedback information received from the server 20 may include plan information related to the rehabilitation treatment.

Further, the controller 180 determines that the emergency event has occurred when the rehabilitation treatment performed by the exercise unit is different from the plan information.

In addition, the sensing unit 140 may sense at least one of electrocardiogram, blood pressure, oxygen sac, body temperature, respiration, blood, urine, and body fluid components.

In this case, the controller 180 may determine that the emergency event has occurred when at least one factor sensed by the sensing unit 140 is out of a preset range.

In addition, the input information input through the user input unit 130 may be command information for the user to manually stop the rehabilitation treatment operation of the exercise unit due to pain.

Accordingly, the present invention transmits information on rehabilitation treatment to a server while performing rehabilitation treatment by moving at least a part of a fixed body, and feedback information received from the server, user body information sensed by a sensor, and a command input from the user. It is possible to provide a rehabilitation exercise device related to a pain event for determining that an emergency event has occurred by using at least one of and stopping a rehabilitation treatment operation when the emergency event occurs.

Rehabilitation exercise platform service

Hereinafter, a method of providing a platform service related to a rehabilitation exercise using the rehabilitation device 100 and the server 20 of the present invention will be described.

Specifically, the present invention provides information related to a rehabilitation exercise of a plurality of users based on a server, receiving a request for transmission of information related to a first user, at least one of the plurality of users, from an external device, and When the related information is transmitted to the external device, the external device determines the second information using the information related to the first user, and the rehabilitation device performs a rehabilitation exercise for the first user based on the second information, the external device It relates to a platform service related to a rehabilitation exercise for receiving third information related to a rehabilitation exercise performed from at least one of a device and a rehabilitation device.

(1) User verification method

First, in the present invention, prior to providing a platform service related to rehabilitation movement, a process of confirming a user may be performed.

Meanwhile, the server 20 proposed by the present invention may be divided into a server 1 (21) of a company providing rehabilitation equipment and a server 2 (22) used in a hospital.

In addition, the user identification method proposed by the present invention may be divided into a first method and a second method.

First, a first method will be described with reference to FIG. 21.

21 is a flow chart illustrating a first method of identifying a user in a rehabilitation exercise platform service according to the present invention.

Referring to FIG. 21, first, a step S51 of transmitting, by the rehabilitation device 10, user identification information input from the user to the server 2 22 is performed.

The server 2 (22) checks whether or not the user prescribed in the hospital intends to use the rehabilitation device 10 based on the received user identification information (S52).

Thereafter, when the user confirmation is finished, the server 2 22 transmits prescription information related to the rehabilitation exercise to the rehabilitation device 10 (S53).

After step S53, in order to establish a rehabilitation exercise platform service of the server 1 (21), the rehabilitation device 10 transmits rehabilitation exercise information related to the user, including prescription information, to the server 1 (21) (S54).

In addition, the rehabilitation device 10 performs a rehabilitation exercise for the user according to the prescription information received from the server 2 (22) (S55).

In the present embodiment, it is described that step S54 is performed before step S55, but the content of the present invention is not limited thereto, and step S54 may be performed after step S55 is performed first.

Next, a second method will be described with reference to FIG. 22.

22 is a flowchart illustrating a second method of identifying a user in a rehabilitation exercise platform service according to the present invention.

Referring to FIG. 22, the rehabilitation device 10 may receive user identification information and prescription information from the server 2 22 (S61).

Thereafter, when information is input from the user (S62), the rehabilitation device checks whether the user is correct based on the previously received user confirmation information, and if it is, it can transmit information indicating that the user has been confirmed to the server 1 (21). Yes (S63).

Thereafter, the server 1 (21) may transmit new prescription information associated with the user to the rehabilitation device 10 (S64), and the rehabilitation device 10 may transmit the prescription information received from the server 1 (21) and the server 2 (22). After checking the user by using at least one of the prescription information received from (S65), the rehabilitation exercise may be performed (S66).

However, in the present embodiment, step S65 is described as being performed after step S63, but step S65 may be performed before step S63.

(2) User verification and advertising content provision method

Next, a method of determining and providing advertisement content to be provided to a user through a user verification process will be described.

Meanwhile, the server 20 proposed by the present invention may be divided into a server 1 (21) of a company providing rehabilitation devices, a server 2 (22) used in a hospital, and an advertisement server (23).

In addition, the user identification method proposed by the present invention may be divided into a first method and a second method.

First, a first method will be described with reference to FIG. 23.

23 is a flowchart illustrating a first method of providing user confirmation and advertisement content in the rehabilitation exercise platform service according to the present invention.

In the first method of FIG. 21, it is assumed that the server 1 21 and the advertisement server 23 form a network in advance, and the server 1 21 can receive advertisement-related content from the advertisement server 23.

Referring to FIG. 23, first, a step (S71) of transmitting, by the rehabilitation device 10, user identification information input from the user, to the server 2 22 is performed.

The server 2 (22) checks whether or not the user prescribed by the hospital intends to use the rehabilitation device 10 based on the received user identification information (S72).

Thereafter, when the user confirmation is finished, the server 2 22 transmits prescription information related to the rehabilitation exercise to the rehabilitation device 10 (S73).

After step S53, in order to establish a rehabilitation exercise platform service of the server 1 21, the rehabilitation device 10 transmits information related to the user including prescription information to the server 1 21 (S74).

At this time, the server 1 (21) determines a customized advertisement associated with the user received through step S74 among a plurality of advertisement contents received from the advertisement server 23 (S75), and transmits the determined advertisement content to the rehabilitation device 10 do.

Thereafter, the rehabilitation device 10 displays the advertisement content received while performing the rehabilitation exercise on the user according to the prescription information received from the server 2 22 through the display unit 151 (S77).

Next, a second method will be described with reference to FIG. 24.

In the second method of FIG. 24, it is assumed that the server 1 21 and the advertisement server 23 form a network in advance, and the server 1 21 can receive advertisement-related content from the advertisement server 23.

24 is a flowchart illustrating a second method of providing user confirmation and advertisement content in the rehabilitation exercise platform service according to the present invention.

Referring to FIG. 24 and FIG. 22, the rehabilitation device 10 may receive user identification information and prescription information from the server 2 22 (S81).

Thereafter, when information is input from the user (S82), the rehabilitation device checks whether the user is correct based on the user confirmation information received in advance, and if it is, may transmit information on the user to the server 1 (21) ( S83).

At this time, the server 1 (21) determines a customized advertisement associated with the user received through step S83 from among the plurality of advertisement contents received from the advertisement server 23 (S84), and transmits the determined advertisement content to the rehabilitation device 10 Do (S85).

Thereafter, the rehabilitation device 10 displays the advertisement content received while performing the rehabilitation exercise on the user according to the prescription information received from the server 2 22 through the display unit 151 (S86).

(3) Rehabilitation exercise and service provision method

Next, a method of providing rehabilitation exercises and services through a user verification process will be described in detail.

The service for this embodiment can be classified into a first method and a second method, and first, a first method will be described in detail with reference to FIG. 25.

25 is a flowchart illustrating a first method related to a rehabilitation exercise and a service in the rehabilitation exercise platform service according to the present invention.

Referring to FIG. 25, first, a user confirmation step is performed (S91).

In step S91, the method according to FIG. 21 or the method according to FIG. 22 may be applied, and a description is omitted for the sake of simplicity of the specification.

After step S92, the rehabilitation device 10 performs a rehabilitation exercise (S92), the camera 210 acquires image data (S93), and the controller 180 analyzes the motion (S94).

Thereafter, the rehabilitation device 10 transmits at least one of patient information, analysis result information, and image information to the server 1 (21) (S95), and the server 1 (21) transmits the information received over time to the patient. It is classified and stored by each (S96).

After step S96, the user verification step described in step S91 is once again performed (S97), and thereafter, the step of supporting the prescription provided by the server 2 22 proceeds.

Specifically, when the user is confirmed, the server 2 (22) transmits a signal for requesting information related to the identified user to the server 1 (21).

In this case, the server 1 (21) transmits rehabilitation-related information that can help the patient's rehabilitation treatment and/or prescription among the previously accumulated information to the server 2 (22).

Thereafter, the server 2 22 may easily determine the prescription information related to the rehabilitation treatment based on the information received from the server 1 21 (S100).

After step S100, the server 2 22 transmits the determined prescription information to the rehabilitation device 10 (S101), and the rehabilitation device 10 performs a rehabilitation exercise (S102).

In addition, the rehabilitation device 10 transmits at least one of the acquired patient information, analysis result information, and image information through the rehabilitation exercise to the server 1 (21) (S103), and the server 1 (21) is Accordingly, the received information is classified and stored for each patient (S104).

In addition, the information stored in the server 1 (21) may be used not only as a prescription, but also as a rehabilitation support step to determine whether rehabilitation treatment has been properly performed.

That is, after step S104, the server 2 (22) may request a patient-related information request signal to the server 1 (21), and the server 1 (21) is the patient-related information (for example, the patient's rehabilitation exercise The image information, etc.) photographed may be transmitted to the server 2 (22) (S106).

Therefore, the server 2 (22) can determine whether or not the rehabilitation treatment has been properly performed using patient-related information (S107).

In addition, server 1 21 builds a platform based on information received from a plurality of users and rehabilitation devices 10 over time, and performs a platform service that provides information in response to various needs ( S108).

Referring to Fig. 26, the second method will be described.

26 is a flowchart illustrating a second method related to rehabilitation exercise and service in the rehabilitation exercise platform service according to the present invention.

Referring to FIG. 26, first, a user confirmation step is performed (S91).

In step S91, the method according to FIG. 21 or the method according to FIG. 22 may be applied, and a description is omitted for the sake of simplicity of the specification.

After step S92, the rehabilitation device 10 performs a rehabilitation exercise (S92), the camera 210 acquires image data (S93), and the controller 180 analyzes the motion (S94).

Thereafter, the rehabilitation device 10 transmits at least one of patient information, analysis result information, and image information to the server 2 22 (S111).

After step S111, the server 1 (21) establishes user information.

Specifically, after step S111, the server 2 22 may transmit information indicating that the patient information has been received from the rehabilitation device 10 to the server 1 21 (S112).

In response, the server 1 21 may request whether the server 2 22 can provide information on the patient (S113).

In response to the request of S113, the server 2 22 may provide a yes or no feedback (S114), but when a yes feedback is sent, anonymized user-related information is transmitted to the server 1 21 (S119). ).

If no feedback is sent, the server 1 21 should collect information related to the user and user rehabilitation using the rehabilitation device 10 and the terminal 300 used by the user.

Specifically, the server 1 (21) requests a user confirmation through the user terminal 300 to the rehabilitation device 10 side (S115), and the rehabilitation device 10 responds to this, the application installed in the user terminal 300 Through the process of verifying the user (S116).

After step S116, the rehabilitation device 10 transmits important information related to the user's rehabilitation exercise to the terminal 300 (S117), and the terminal transmits the important information related to the rehabilitation exercise received through the application and information related to the user to the server. Transfer to 1 (21) (S118).

Accordingly, the server 1 21 may receive user and rehabilitation related information from the server 2 22 or may receive user and rehabilitation related information through a network between the rehabilitation device 10 and the terminal 300.

Thereafter, the server 1 21 separates and stores the information received according to the passage of time for each patient (S120).

After step S120, the step of supporting the prescription provided by the server 2 22 proceeds.

Specifically, the server 2 (22) transmits a signal for requesting information related to the identified user to the server 1 (21) (S121).

At this time, the server 1 (21) transmits rehabilitation-related information that can help the patient's rehabilitation treatment and/or prescription among the previously accumulated information to the server 2 (22) (S122).

Thereafter, the server 2 22 can easily determine the prescription information related to the rehabilitation treatment based on the information received from the server 1 21 (S123).

After step S123, the server 2 22 transmits the determined prescription information to the rehabilitation device 10 (S124), and the rehabilitation device 10 performs a rehabilitation exercise (S125).

After step S125, the steps of establishing user information in steps S112 to S120 are repeatedly performed (S126).

In step S126, server 1 (21) and server 2 (22) accumulate data, and in server 2 (22), it is possible to determine whether or not rehabilitation treatment has been properly performed using patient-related information (S127). .

In addition, server 1 21 builds a platform based on information received from a plurality of users and rehabilitation devices 10 over time, and performs a platform service that provides information in response to various needs ( S128).

(4) How to use the established database

In addition, when the database is constructed through the method described in FIGS. 25 and 26, the server 1 21 or the server 2 22 may be used as a platform-to-platform service.

Specifically, 1) a platform for hospital-only management programs, 2) a recruitment/recruitment platform (caregiver, physical therapist, etc.), 3) an equipment platform, 4) a form of linking with the insurance company and the Health Insurance Corporation-Patient-related health information It can be used in a way that you can have in

Most representatively, a service related to advertisement may be provided.

27 is a flowchart illustrating a method of using a service after a database is established in a rehabilitation exercise platform service according to the present invention.

Referring to FIG. 27, in a state in which a database is established in server 1 21, server 2 22 may transmit a user-related information request to server 1 21 (S131).

Server 1 (21) may determine rehabilitation-related information in response to the received request and transmit it to server 2 (22) (S132).

Server 2 (22) based on the information received through step S132 determines the prescription information (S133), at this time, server 1 (21) based on the user information received in step S131 from the server 2 (22) It is possible to determine the customized advertisement in connection with the advertisement server 23 (S134).

Thereafter, through step S133, when the server 2 223 transmits prescription information to the rehabilitation device 10 (S135), the server 1 21 transmits the determined customized advertisement content to the rehabilitation device 10 It becomes (S136).

Accordingly, through the rehabilitation device 10, the user views a customized advertisement and performs a rehabilitation exercise at the same time (S137).

Information obtained from a plurality of patients through the above-described method is shared with the patient's terminal (smart phone), a PC control program of a hospital, a server management program, etc., thereby providing a function as an IOT-based convergence medical platform.

First, with regard to the smartphone application used by the patient, considering that the main patient is the elderly, it is designed so that anyone can easily operate it with an intuitive and simple design, so that individual exercise data can be viewed, and treatment effect using statistical data A GUI environment developed so that you can check at a glance can be provided through the platform.

In addition, as a PC control program, it is developed so that users who operate the device, such as doctors and physical therapists, can grasp the status of the device and the movement status of the patient at a glance when used in a hospital, and it is developed so that a number of patient movement information can be easily identified. In addition, a GUI environment developed to enable real-time confirmation of the patient's movement state through the camera 121 may be provided through the platform.

In addition, in connection with the server management program, an integrated management system for exercise information is developed through the web connection of the server 20, and a management system such as operation time of the device 100, AS information, etc. is developed, and the existing exercise treatment information is used. Thus, a UI environment that provides customized treatment for each patient may be provided through the platform.

In addition, according to the present invention, when a patient undergoes treatment at a specific hospital and then moves to another hospital, it is guaranteed that the patient can transfer from the previous treatment step to the next treatment step based on accurate information.

In addition, when a device development company wants to develop a device by grasping the needs of patients, it is possible to receive specific patient-related data from the server 20 and develop the device based on this.

Based on the above-described rehabilitation treatment device, system, and control method having a photographing device according to the present invention, when a marker is attached to the rehabilitation treatment device, and the photographing device acquires the rehabilitation treatment motion image data of the patient through motion capture, , It is possible to provide a user with a rehabilitation treatment device, a system, and a control method that extracts and uses information related to a patient's rehabilitation exercise based on a change in the position of a marker recognized through image processing.

In addition, the present invention is easy to systematically preserve, manage, and utilize treatment data by measuring the actual ROM, exercise speed, time, and number of times, etc. as an image while the patient performs CPM exercise and storing it in a DB connected to the CPM device, Based on this, it is possible to enable customized treatment according to the recovery rate of individual patients.

In addition, the data stored according to the present invention can be converted into big data by applying cloud computing technology as needed in the future, so that it can be used as research data on the treatment and recovery of joint diseases, as well as the development of new medical devices and remote medical treatment. It can also be used.

Meanwhile, the embodiments of the present invention described above may be implemented through various means. For example, embodiments of the present invention may be implemented by hardware, firmware, software, or a combination thereof.

In the case of implementation by hardware, the method according to embodiments of the present invention includes one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), and Programmable Logic Devices (PLDs). , Field Programmable Gate Arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, and the like.

In the case of implementation by firmware or software, the method according to the embodiments of the present invention may be implemented in the form of a module, procedure, or function that performs the functions or operations described above. The software code may be stored in a memory unit and driven by a processor. The memory unit may be located inside or outside the processor, and may exchange data with the processor through various known means.

Detailed description of the preferred embodiments of the present invention disclosed as described above has been provided to enable those skilled in the art to implement and implement the present invention. Although the above has been described with reference to preferred embodiments of the present invention, those skilled in the art will understand that various modifications and changes can be made to the present invention without departing from the scope of the present invention. For example, those skilled in the art may use the configurations described in the above-described embodiments in a manner that combines with each other. Thus, the invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The present invention may be embodied in other specific forms without departing from the spirit and essential features of the present invention. Therefore, the detailed description above should not be construed as restrictive in all respects and should be considered as illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention. The invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein. In addition, the embodiments may be configured by combining claims that do not have an explicit citation relationship in the claims, or may be included as new claims by amendment after filing.

Claims (10)

In the method of using a first server for storing first information related to a rehabilitation exercise of a plurality of users,
A first step of receiving an information delivery request related to a first user, which is at least one of the plurality of users, from an external device;
A second step of determining information related to the first user from among the stored first information in response to the information delivery request;
A third step of transmitting information related to the first user to the external device; And
When the external device determines second information using information related to the first user, and the rehabilitation device performs a rehabilitation exercise for the first user based on the second information, the external device and the rehabilitation device A fourth step of receiving third information related to the performed rehabilitation exercise from at least one of; Including,

The rehabilitation device may include a fixing part fixing at least a part of the first user's body; An exercise unit for performing rehabilitation treatment by moving at least a part of the fixed body; A camera for photographing the motion of at least one of the fixing part and the exercise part; And a controller configured to determine the third information by using the image data captured by the camera. Including,

At least a part of the exercise part further includes at least one identifier, and the at least one identifier includes a singular point provided in at least a part of the exercise part and a marker provided in at least a part of the exercise part. ), and the marker includes a first marker provided on at least a part of the fixing part and a second marker provided on at least a part of the exercise part,

In the fourth step,
The control unit of the rehabilitation device recognizes the first marker and the second marker in the image data, and determines the third information by using the position change of the recognized first and second markers,
The control unit of the rehabilitation device extracts first vector information from the rotation of the first marker induced by a body fixing motion of the fixing unit of the rehabilitation device, and second vector information of the first marker according to the length of the exercise unit And determining the third information by comparing the first vector information and the second vector information.
The method of claim 1,
Between the second and third steps,
The second step of determining advertisement content based on information related to the first user; further comprising,
Between the third and fourth steps,
The method further comprises a 3-1 step of transmitting the advertisement content to the rehabilitation device. The method of claim 1,
When receiving the third information from the external device in the fourth step,
The fourth step,
A 4-1 step of receiving notification information regarding the rehabilitation exercise performance of the first user from the external device;
A 4-2 step of requesting the third information from the external device in response to the received notification information; And
And a 4-3 step of receiving the third information from the external device in response to the request. The method of claim 1,
When receiving the third information from the rehabilitation device in the fourth step,
The fourth step,
A 4-6 step of requesting the third information from the terminal of the first user that has established a network with the rehabilitation device; And
And a 4-7 step of receiving the third information from the terminal in response to the request. The method of claim 4,
Between the third step and the 4-5 step,
A 4-4 step of requesting the third information from the external device; And
And a 4-5 step of receiving rejection information for rejecting transmission of the third information from the external device in response to the request. In the method of using an external device to transmit information to a rehabilitation device,
A first step of transmitting an information delivery request related to at least one of the plurality of users to a first server that stores first information related to the rehabilitation exercise of the plurality of users;
A second step of receiving information related to the first user from the first server when determining information related to the first user among the stored first information in response to the information delivery request;
A third step of determining second information by using the information related to the first user;
A fourth step of transmitting the second information to the rehabilitation device; And
When the rehabilitation device performs the rehabilitation exercise for the first user based on the second information, a fifth step of receiving third information related to the performed rehabilitation exercise from the rehabilitation device; including,

The rehabilitation device may include a fixing part fixing at least a part of the first user's body; An exercise unit for performing rehabilitation treatment by moving at least a part of the fixed body; A camera for photographing the motion of at least one of the fixing part and the exercise part; And a controller configured to determine the third information by using the image data captured by the camera. Including,

At least a part of the exercise part further includes at least one identifier, and the at least one identifier includes a singular point provided in at least a part of the exercise part and a marker provided in at least a part of the exercise part. ), and the marker includes a first marker provided on at least a part of the fixing part and a second marker provided on at least a part of the exercise part,

In the fifth step,
The control unit of the rehabilitation device recognizes the first marker and the second marker in the image data, and determines the third information by using the position change of the recognized first and second markers,
The control unit of the rehabilitation device extracts first vector information from the rotation of the first marker induced by a body fixing motion of the fixing unit of the rehabilitation device, and second vector information of the first marker according to the length of the exercise unit And determining the third information by comparing the first vector information and the second vector information.
The method of claim 6,
A sixth step of transmitting notification information indicating reception of the third information to the first server;
A seventh step of receiving a request for the third information from the first server in response to the transmitted notification information; And
And an eighth step of transmitting the third information to the first server in response to the request for the third information. In the control method of the rehabilitation device,
An external device receives information related to a first user who is at least one of the plurality of users from a first server that stores first information related to a rehabilitation exercise of a plurality of users, and the external device receives information related to the first user A first step of receiving the second information from the external device when the second information is determined by using;
A second step of performing a rehabilitation exercise for the first user based on the second information; And
A third step of transmitting third information related to the performed rehabilitation exercise to the external device; including,

The rehabilitation device may include a fixing part fixing at least a part of the first user's body; An exercise unit for performing rehabilitation treatment by moving at least a part of the fixed body; A camera for photographing the motion of at least one of the fixing part and the exercise part; And a controller configured to determine the third information by using the image data captured by the camera. Including,

At least a part of the exercise part further includes at least one identifier, and the at least one identifier includes a singular point provided in at least a part of the exercise part and a marker provided in at least a part of the exercise part. ), and the marker includes a first marker provided on at least a part of the fixing part and a second marker provided on at least a part of the exercise part,

In the third step,
The control unit of the rehabilitation device recognizes the first marker and the second marker in the image data, and determines the third information by using the position change of the recognized first and second markers,
The control unit of the rehabilitation device extracts first vector information from the rotation of the first marker induced by a body fixing motion of the fixing unit of the rehabilitation device, and second vector information of the first marker according to the length of the exercise unit And determining the third information by comparing the first vector information and the second vector information.
The method of claim 8,
Between the first step and the second step or in the second step,
Receiving advertisement content from the first server based on information related to the first user; And
And playing the advertisement content through a display unit. The method of claim 8,
After the third step,
A fourth step of establishing a network with the terminal of the first user; And
And a fifth step of transmitting the third information to the terminal.

Images