WO2012165882A2 - Appareil d'exercice de rééducation, appareil de communication portatif, et système d'application et procédé d'application correspondant - Google Patents

Appareil d'exercice de rééducation, appareil de communication portatif, et système d'application et procédé d'application correspondant Download PDF

Info

Publication number
WO2012165882A2
WO2012165882A2 PCT/KR2012/004313 KR2012004313W WO2012165882A2 WO 2012165882 A2 WO2012165882 A2 WO 2012165882A2 KR 2012004313 W KR2012004313 W KR 2012004313W WO 2012165882 A2 WO2012165882 A2 WO 2012165882A2
Authority
WO
WIPO (PCT)
Prior art keywords
hand
rehabilitation
user
rehabilitation exercise
information
Prior art date
Application number
PCT/KR2012/004313
Other languages
English (en)
Korean (ko)
Other versions
WO2012165882A3 (fr
WO2012165882A9 (fr
Inventor
최용근
Original Assignee
주식회사 네오펙트
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020110051945A external-priority patent/KR101367801B1/ko
Priority claimed from KR1020110051984A external-priority patent/KR20120133348A/ko
Priority claimed from KR1020110051982A external-priority patent/KR20120133347A/ko
Priority claimed from KR1020110146158A external-priority patent/KR101263129B1/ko
Application filed by 주식회사 네오펙트 filed Critical 주식회사 네오펙트
Publication of WO2012165882A2 publication Critical patent/WO2012165882A2/fr
Publication of WO2012165882A3 publication Critical patent/WO2012165882A3/fr
Publication of WO2012165882A9 publication Critical patent/WO2012165882A9/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B23/00—Exercising apparatus specially adapted for particular parts of the body
    • A63B23/035—Exercising apparatus specially adapted for particular parts of the body for limbs, i.e. upper or lower limbs, e.g. simultaneously
    • A63B23/12—Exercising apparatus specially adapted for particular parts of the body for limbs, i.e. upper or lower limbs, e.g. simultaneously for upper limbs or related muscles, e.g. chest, upper back or shoulder muscles
    • A63B23/16—Exercising apparatus specially adapted for particular parts of the body for limbs, i.e. upper or lower limbs, e.g. simultaneously for upper limbs or related muscles, e.g. chest, upper back or shoulder muscles for hands or fingers
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B23/00—Exercising apparatus specially adapted for particular parts of the body
    • A63B23/035—Exercising apparatus specially adapted for particular parts of the body for limbs, i.e. upper or lower limbs, e.g. simultaneously
    • A63B23/03516—For both arms together or both legs together; Aspects related to the co-ordination between right and left side limbs of a user
    • A63B23/03533—With separate means driven by each limb, i.e. performing different movements
    • A63B23/03541—Moving independently from each other
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B22/00—Exercising apparatus specially adapted for conditioning the cardio-vascular system, for training agility or co-ordination of movements
    • A63B2022/0092—Exercising apparatus specially adapted for conditioning the cardio-vascular system, for training agility or co-ordination of movements for training agility or co-ordination of movements
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B22/00—Exercising apparatus specially adapted for conditioning the cardio-vascular system, for training agility or co-ordination of movements
    • A63B2022/0094—Exercising apparatus specially adapted for conditioning the cardio-vascular system, for training agility or co-ordination of movements for active rehabilitation, e.g. slow motion devices
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B2071/0647—Visualisation of executed movements
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2225/00—Miscellaneous features of sport apparatus, devices or equipment
    • A63B2225/20—Miscellaneous features of sport apparatus, devices or equipment with means for remote communication, e.g. internet or the like
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2225/00—Miscellaneous features of sport apparatus, devices or equipment
    • A63B2225/50—Wireless data transmission, e.g. by radio transmitters or telemetry

Definitions

  • the present invention relates to a rehabilitation exercise device, a wearable communication device that can be used for a variety of purposes such as exercise (training), game / entertainment, data input, and remote cooperative rehabilitation training, remote control of electronic devices using such devices
  • This relates to a possible application system and a training schedule optimization method applicable to the above apparatus or application system.
  • finger assist force required for rehabilitation of the hand function of a stroke patient does not need sufficient force to perform normal hand function like the general person, and it is more effective to assist the minimum force for performing specific task training. Finger assist forces need not be constant and need to be constantly changed to appropriate values depending on other factors such as rehabilitation status and motivation.
  • the data input device may be used by attaching a device such as a keyboard, a mouse, or a joystick when implementing the external type of the wireless terminal device, but it is inconvenient to carry.
  • a device such as a keyboard, a mouse, or a joystick
  • the built-in keyboard, key buttons, direction keys, etc. are inconvenient for the user to operate due to the small size.
  • the size of the terminal device is small, the size of the keypad and keys is also small, so data input is not easy. It is inconvenient to use a small input device compared to the user's hand, and a person with a thick finger may make a mistake of wrongly pressing a key.
  • the wearable game control device as disclosed in Korean Patent Laid-Open No. 2011-0012334, is provided with a separate key button, direction selection button, and the like for game operation. Accordingly, there is a difficulty in implementing various hand gestures, postures, position variations, and the like of the user, and thus, there are limitations in various game operations, and there are aspects that are difficult to be utilized in various application fields other than games.
  • a first object of the present invention is to provide a rehabilitation exercise apparatus and a method for assisting finger rehabilitation of a patient with a finger disorder or a person in need of rehabilitation of a finger.
  • a third object of the present invention is to use a wearable communication device capable of sensing various body motions of a user and quickly and easily perform operations of an electronic device, an operation of an application running on the electronic device, and data input through communication interworking therewith.
  • the present invention provides a remote control system using a wearable communication device, which can be controlled and enables more intuitive data input and motion control.
  • a fourth object of the present invention is to provide a training schedule optimization method using a brain science exercise learning model and an optimal control theory when training a single or a plurality of exercise tasks.
  • a device for finger rehabilitation exercise there is provided a device for finger rehabilitation exercise
  • a wireless communication module configured to detect hand motion information according to at least one of a finger movement, a change in posture of a hand, and a change in position of a hand;
  • a rehabilitation exercise glove including a control unit for controlling the user's hand motion information detected by the detection unit to be transmitted to a communication terminal located remotely through the wireless communication module, and manufactured in the form of a glove;
  • An object generator configured to generate a virtual hand-shaped object corresponding to the received hand gesture information of the user when the hand gesture information is received from the rehabilitation exercise glove by the communication module;
  • a finger rehabilitation exercise apparatus including a communication terminal including a control unit for controlling the hand-shaped object generated by the object generating unit to be displayed on a display screen.
  • a device comprising: a first finger rehabilitation exercise device including a first rehabilitation exercise glove and a first communication terminal, and used for a finger rehabilitation exercise of a first user; And a communication server configured to perform data communication with the first communication terminal and to relay data communication between a second communication terminal by a second user located at a distance with the first communication terminal and cooperating with a rehabilitation exercise of the first user.
  • a remote cooperative rehabilitation training system comprising a.
  • a first wireless communication module A first detector configured to detect hand motion information according to at least one of a movement of a finger of the first user, a change in posture of a hand, and a change in position of a hand; And a control unit which transmits the hand gesture information detected by the first sensing unit to the first communication terminal through the first wireless communication module.
  • the first communication terminal the first communication terminal
  • a first communication module Create a virtual first hand-shaped object corresponding to the hand motion information of the first user received from the first rehabilitation exercise gloves, and rehabilitation of the first user from the second communication terminal by relaying the communication server
  • a first object generation unit generating a virtual cooperation object corresponding to the received rehabilitation exercise cooperation information when the cooperation information regarding the exercise is received;
  • a controller configured to display, on a display screen, a first rehabilitation exercise assistance image in which the first hand-shaped object and the virtual cooperative object are generated by the first object generator.
  • the apparatus may further include a second finger rehabilitation exercise device used for the finger rehabilitation exercise of the second user.
  • a second wireless communication module A second sensor configured to detect hand motion information according to at least one of a movement of a finger of the second user, a change in posture of a hand, and a change in position of a hand;
  • a second rehabilitation exercise glove including a control unit for transmitting the hand gesture information detected by the second detection unit to the second communication terminal through the second wireless communication module, and the second communication terminal.
  • the second communication terminal the second communication terminal
  • a second communication module A second object generator configured to generate a virtual second hand-shaped object corresponding to the hand gesture information of the second user received from the second rehabilitation exercise glove; And a control unit for transmitting the received hand gesture information of the second user to the communication server through the second communication module and displaying the generated second hand object on a display screen.
  • a remote control system using a wearable communication device, the wearable communication device which is worn on a user's body and transmits motion sensing information generated at a worn portion to a remote electronic device; And an electronic device that is driven by the electronic device, performs network connection with the wearable communication device, obtains user motion information from the motion sensing information received from the wearable communication device, and corresponds to the obtained user motion information.
  • a remote control system comprising a device interworking agent, which controls the operation of any one of the applications running on the electronic device.
  • a method of optimizing a training schedule when training a single or a plurality of exercise tasks comprising: measuring an initial learning level of an individual exercise task, and brain science exercise learning for the individual exercise task; Predicting the parameters of the model, optimizing the long-term learning based on the learning level of the individual exercise task, the brain science exercise learning model, the parameters of the brain science exercise learning model corresponding to the individual exercise task, and the optimal control theory
  • a training schedule optimization method comprising the step of finding a training schedule.
  • the effect of the rehabilitation exercise can be enhanced by assisting the finger rehabilitation therapist to make the rehabilitation exercise more enjoyable and visually stimulating the rehabilitation exercise.
  • the rehabilitation training by the cooperation of two or more persons in the remote, there is an effect that can improve the sociality of rehabilitation patients.
  • a wearable communication device that can sense a variety of body movements of the user and through the communication interworking with the operation of the electronic device, the operation of the application running on the electronic device, data input, etc. Quick and easy control, more intuitive data input, motion control is possible.
  • the present invention when the present invention is applied as a game control system, there is an effect that can maximize the user's interest through the reproduction of more various application operations, more intuitive game control.
  • the fourth aspect of the present invention in training a single or a plurality of exercise tasks, there is an effect that can optimize the training schedule using the brain science exercise learning model and the optimal control theory.
  • it is widely applied to athlete training, music equipment training, and rehabilitation training to which exercise learning is applied, thereby maximizing the training effect.
  • FIG. 1 is a view for explaining the overall finger rehabilitation exercise device according to the first aspect of the present invention.
  • FIG. 2 is a view for explaining the rehabilitation exercise gloves according to the first aspect of the present invention.
  • FIG. 3 is a block diagram of a communication terminal according to the first aspect of the present invention performing communication with a rehabilitation exercise glove and performing a finger rehabilitation exercise assistance method.
  • FIG. 4 is a view for explaining a finger rehabilitation exercise assistance method according to a first aspect of the present invention.
  • FIG. 5 is a view showing an application example of the finger rehabilitation exercise assistance method according to the first aspect of the present invention.
  • FIG. 6 is a view for explaining the overall cooperative rehabilitation training system according to a second aspect of the present invention.
  • FIG. 7 is a diagram showing an application example of the remote cooperative rehabilitation training method according to the second aspect of the present invention.
  • FIG. 8 is a view for explaining a rehabilitation training method according to a second aspect of the present invention by a remote cooperative rehabilitation training system.
  • FIG 9 is an overview of a remote control system using the wearable communication device according to the third aspect of the present invention.
  • FIG. 10 is a block diagram of a device interlocking agent driven on a wearable communication device and an electronic device according to a third aspect of the present invention.
  • FIG. 11 is a flowchart schematically illustrating a remote control method according to interworking between a wearable communication device and a device interworking agent according to a third aspect of the present invention.
  • FIG. 12 is a diagram illustrating a training schedule optimization method using a brain science exercise learning model and an optimal control theory according to a fourth aspect of the present invention.
  • one component when one component is referred to as “connected” or “connected” with another component, the one component may be directly connected or directly connected to the other component, but in particular It is to be understood that, unless there is an opposite substrate, it may be connected or connected via another component in the middle.
  • ⁇ unit refers to a unit for processing at least one function or operation, which means hardware or software or hardware and It can be implemented in a combination of software.
  • the rehabilitation patient will be described in the case of using the rehabilitation exercise (training) through the finger movement, the rehabilitation exercise apparatus according to the present invention, in addition to the purpose of rehabilitation, to increase the muscle strength of the finger or to practice the fine hand movement
  • the required person may use it for a specific purpose.
  • the finger rehabilitation exercise device of the present invention is useful to those who have a specific purpose of increasing the strength of the finger (for example, a person who needs to greatly increase the grip of the hand such as a wrestler, a gymnast, etc.). Make it clear first that it can be used.
  • an apparatus and a rehabilitation exercise assisting method for a finger rehabilitation exercise in connection with a finger rehabilitation exercise are disclosed.
  • FIGS. 1 to 5 of the accompanying drawings an apparatus and a rehabilitation exercise assisting method for a finger rehabilitation exercise according to a first aspect of the present invention will be described with reference to FIGS. 1 to 5 of the accompanying drawings.
  • 1 is a view for explaining the overall finger rehabilitation exercise device.
  • the finger rehabilitation exercise device may include a rehabilitation exercise glove 100b and a communication terminal 200b connected thereto.
  • the rehabilitation exercise glove 100b may be manufactured in the form of a glove that can be worn on the hand to assist the rehabilitation exercise (training) of the finger rehabilitation patient (see FIG. 2), as in the block diagram of FIG. 1,
  • the wireless communication module 14 may include a detector 12 and a controller 16.
  • FIG. 1 illustrates only some of the main components, and in addition, a configuration for performing basic functions (for example, the battery of FIG. 2) or a configuration required for adding various functions (for example, EMG It is obvious that the addition of a measurement function may further include an EMG sensor.
  • the rehabilitation exercise glove 100b basically transmits various hand motion information (ie, finger movement, hand posture change, hand position change (movement), etc.) of a user wearing the glove by a wireless communication method. It serves to transmit to the external communication terminal (200b). Detailed configuration description for this will be described later with reference to FIG.
  • the communication terminal 200b receives the hand motion information transmitted from the rehabilitation exercise glove 100b, and a virtual hand object corresponding to the received hand motion information of the user (hereinafter, referred to as a user hand object). Name) and display it on the display screen. Accordingly, the finger rehabilitation patient can immediately visually check his or her hand movement in the process of the finger rehabilitation exercise, thereby being able to be motivated to the rehabilitation exercise and become interested in the rehabilitation exercise. . This will be more clearly understood from the following description, and the specific configuration of the communication terminal 200b for this will be described later with reference to FIG. 3.
  • the rehabilitation exercise glove 100b may include a wireless communication module 14, a sensor 12, and a controller 16.
  • a wireless communication module 14 may include a wireless communication module 14, a sensor 12, and a controller 16.
  • each component is demonstrated in order.
  • the detection unit 12 serves to detect various hand motion information of a rehabilitation patient wearing the rehabilitation exercise glove 100b.
  • the hand motion information that may be sensed by the sensor 12 may include at least one of a finger movement, a change in posture of the hand, and a change (movement) of the hand.
  • the sensing unit 12 may include the following detailed components.
  • the detector 12 may include a finger angle sensor as indicated in FIG. 2.
  • the finger angle sensor may be installed at a portion corresponding to the position where each finger is inserted when the user wears gloves.
  • the finger angle sensor may be installed to extend in the longitudinal direction of the finger on the glove portion corresponding to the back surface or the bottom surface of the finger.
  • a finger angle sensor may be separately installed at each portion corresponding to each node of the finger. That is, the installation site and the number of installation of the finger angle sensor may be variously modified according to needs and designs.
  • the sensing unit 12 may further include a sensor (eg, a gyro sensor, a gravity sensor, an acceleration sensor, etc.) for detecting a change in posture of a user's hand and / or a change in position of the hand.
  • a sensor eg, a gyro sensor, a gravity sensor, an acceleration sensor, etc.
  • the sensing unit 12 can confirm a change in posture, such as hand inversion, rotation, and the like, and can also confirm a position change of the hand indicating a two-dimensional or three-dimensional movement trajectory by the hand.
  • the sensing unit 12 may further include a pressure sensor, a force sensor, and the like, if necessary, so that the rehabilitation patient may sense a force (grip force, etc.) input during the finger rehabilitation exercise process.
  • the controller 16 may determine that the information is included. Control to be transmitted to the communication terminal 200b remotely located through the wireless communication module 14.
  • the controller 16 may transmit the hand gesture information detected by the sensor 12 to the communication terminal 200b as it is, and collect or / or predefine the sensing data output from each sensor. After processing to transmit to the communication terminal 200b.
  • the rehabilitation exercise glove 100b and the communication terminal 200b may be connected in a wired manner.
  • the wireless communication module 14 is mounted on the rehabilitation exercise glove 100b. Therefore, a description will be given mainly on the case of transmitting the corresponding hand gesture information to the communication terminal 200b through a wireless communication method.
  • a Bluetooth communication method may be used as shown in FIG. 2.
  • the communication terminal 200b since the communication terminal 200b also includes a Bluetooth communication module, the communication terminal 200b may be connected to the rehabilitation glove 100b and peer-to-peer to directly receive the hand gesture information.
  • a communication method for transmitting and receiving hand gesture information is not limited to the above-described Bluetooth method, and various short-range wireless communication methods such as WIFI Direct technology may be used.
  • the communication method between the rehabilitation exercise glove 100b and the communication terminal 200b is not limited to the short range wireless communication method.
  • the communication terminal 200b may receive the user's hand motion information transmitted from the rehabilitation exercise glove 100b through a wireless relay device such as an access point (AP).
  • AP access point
  • the rehabilitation exercise glove 100b has been described.
  • the configuration of the communication terminal 200b for assisting the finger rehabilitation exercise of the rehabilitation patient will be described with reference to FIG. 3.
  • FIG. 3 is a block diagram of a communication terminal communicating with a rehabilitation exercise glove and performing a finger rehabilitation exercise assistance method.
  • the communication terminal 200b may include a communication module 210, a camera module 220, a user input unit 230, a storage unit 240, an image output device 250, and an audio output device ( 255, an object generator 260, an image processor 270, a controller 280, and a power source 290.
  • the components shown in FIG. 3 are components provided according to an example of the communication terminal 200b, and may be implemented as a communication terminal having fewer components or a communication terminal having more components. .
  • the communication terminal 200b for performing a function to assist the finger rehabilitation exercise in accordance with the communication connection with the rehabilitation exercise gloves 100b such as a mobile phone, a smartphone, a tablet PC (smart pad), a notebook, etc. It may have a form of a terminal (or mobile terminal) having portability. However, this is because, in the case of having a portable terminal, the rehabilitation patient has the advantage of being able to perform the rehabilitation exercise anytime and anywhere without a specific spatial limitation, and the communication terminal 200b is in the form of a fixed terminal such as a desktop PC or a smart TV. You may have.
  • the communication terminal 200b includes a communication module 210 capable of receiving hand motion information from the rehabilitation exercise glove 100b, and virtualizes the hand motion information on the screen.
  • the terminal type is not particularly limited.
  • the communication terminal 200b is a portable terminal used by the rehabilitation patient.
  • the camera module 220, the user input unit 230, the storage unit 240, the image output device 250, the audio output device 255, the image processor 270, the power supply unit 290, and the like are illustrated. Since the basic configuration of a mobile terminal such as a smartphone, a detailed description thereof will be omitted.
  • Figure 5 is a view showing an application example of the finger rehabilitation exercise assistance method.
  • a communication connection is made between the rehabilitation glove 100b and the communication terminal 200b.
  • the boot loader is automatically set to search for a nearby Bluetooth communication device by the boot loader.
  • the rehabilitation gloves 100b in the vicinity may be identified and a communication connection may be made thereto.
  • the control unit 280 of the communication terminal 200b as the communication connection is made between the rehabilitation gloves 100b and the communication terminal 200b, the rehabilitation exercise program 282 installed in the communication terminal 200b. It can be executed automatically (see step S102).
  • the rehabilitation exercise assistance screen (see FIG. 5) may be displayed on the display screen (see step S104).
  • the rehabilitation exercise auxiliary screen initially displayed on the screen may be a predetermined default screen.
  • a default screen may have various screen configurations depending on how the rehabilitation exercise program 282 is implemented.
  • a virtual user hand object which will be described later, may be set in a default screen to be displayed at a predetermined position and a finger posture.
  • the corresponding position and posture may be changed accordingly.
  • a virtual demonstration hand object and / or a virtual rehabilitation tool which will be described later, may also be displayed in advance in the default screen.
  • the communication connection step, the rehabilitation program execution step, and the like described through the steps S100, S102, and S104 may be different from those in FIG. 4. That is, in FIG. 4, the case in which the communication terminal 200b communicates with the rehabilitation exercise gloves 100b by searching for a nearby device capable of short-range communication in the booting process of the communication terminal 200b has been described. have. That is, the communication connection between the rehabilitation exercise glove 100b and the communication terminal 200b may be made after step S106 of FIG. 4. For example, only when the hand motion information of the user is detected in the rehabilitation exercise glove 100b, before performing step S108 (that is, transmitting the hand motion information to the communication terminal 200b) of FIG. 4, The rehabilitation exercise glove 100b may attempt to connect with the corresponding communication terminal 200b by searching for a surrounding communication device.
  • FIG. 4 illustrates the case where the execution step S102 of the rehabilitation exercise program is made after the communication connection step S100, the order may be reversed.
  • the rehabilitation patient or another person (guardian, therapist, etc.) executes the rehabilitation exercise program 282 installed in the communication terminal 200b, the communication connection between the devices may be made.
  • FIG. 4 illustrates a case in which the rehabilitation exercise program 282 is set to be executed automatically when a communication connection is established, on the contrary, after the hand motion information is received from the rehabilitation exercise glove 100b in step S108 of FIG. 4.
  • the rehabilitation exercise program 280 may be set to be automatically executed.
  • the rehabilitation exercise program 282 may be manufactured in the form of a software application and installed in the communication terminal 200b, or may be downloaded and installed from an external application providing server or the like.
  • the rehabilitation exercise program 282 includes information on a rehabilitation sequence that defines the order of the finger rehabilitation exercise, information on each rehabilitation operation required for the finger rehabilitation exercise, and an operation guide for guiding the rehabilitation operation. At least one of information and information on a rehabilitation tool to be used in the finger rehabilitation exercise may be included.
  • the operation guide information for guiding the rehabilitation operation may be composed of any one of text, voice, image, video or a combination of two or more thereof.
  • a rehabilitation operation of holding and releasing a hand may be used to guide the rehabilitation patient by text or voice, or an image or video demonstrating such an operation may correspond to the operation guide information.
  • the information on the rehabilitation tool is information on actual aids and objects that can be used for the finger rehabilitation exercise, which is then generated by the object generator 260 as a virtual object and displayed on the screen. This is to give the rehabilitation patient the experience of training with a real tool or object.
  • the cylindrical object of FIG. 5 corresponds to this.
  • the rehabilitation exercise program 282 may be updated in real time or periodically.
  • a rehabilitation exercise is performed by the communication terminal 200b receiving or periodically downloading training schedules, training guidance data, and the like, which are given by doctors, therapists, and the like who are in charge of rehabilitation of the rehabilitation patient from the server of the medical institution.
  • Program 282 may be updated continuously.
  • the hand motion information detected by the rehabilitation exercise glove 100b according to step S108 is transmitted to the communication terminal 200b. Is sent).
  • the transmission of the hand gesture information may be periodically performed at a predetermined time interval (for example, 0.2 seconds). Alternatively, only when a change occurs in the hand gesture information, the hand gesture information may be transmitted.
  • the object generation unit 260 of the communication terminal 200b virtually corresponds to the received user's hand motion information. Creates a hand-shaped object. Accordingly, the controller 280 of the communication terminal 200b displays the generated user hand object on the display screen (that is, the rehabilitation exercise assistance screen) in step S112.
  • FIG. 5 An example of this is shown in FIG. 5. Referring to FIG. 5, it can be seen that a virtual hand-shaped object that is performing the same hand gesture as the hand gesture actually taken by the user is displayed together on the rehabilitation exercise assistance screen.
  • the process of the above steps S110 and S112 may be repeated continuously whenever the user's hand motion information is received from the rehabilitation gloves 100b. That is, the object generator 260 continuously updates the virtual user hand object whenever the user's hand motion information is received, and the controller 280 updates the hand object when the hand object is updated.
  • the image of the hand-shaped object may be reflected in real time through the rehabilitation exercise assistance screen.
  • the communication terminal 200b may transmit the image related to the rehabilitation exercise assistance screen generated by the communication terminal 200b to another medium having a large display screen so that the corresponding screen is displayed through the screen of the other medium.
  • the cable may be connected to another large screen medium (for example, a TV, etc.) provided in a corresponding space through an HDMI (High Definition Multimedia Interface) terminal provided in the terminal.
  • the rehabilitation exercise assistance screen may be displayed on a large screen medium.
  • the screen may be transmitted to another medium through a wireless communication method or a near field communication method, rather than a wired connection method such as a cable.
  • the rehabilitation exercise program 282 may include information on various rehabilitation tools that can be used for finger rehabilitation exercises. Accordingly, when a rehabilitation tool is determined according to the rehabilitation exercise program 282 that can be usefully used to train the rehabilitation according to a specific rehabilitation operation, the object generator 260 may be configured to the rehabilitation tool in addition to the user's hand-shaped object. You can also create more virtual objects.
  • a cylindrical virtual object is illustrated as the virtual rehabilitation tool object. Accordingly, the rehabilitation patient may perform the rehabilitation exercise by changing his hand motion in accordance with a specific rehabilitation motion while viewing this on the screen. Examples are described below.
  • the controller 280 of the communication terminal 200b may overlap the area where the user hand-shaped object is displayed on the screen with the area where the rehabilitation tool object is displayed by a predetermined ratio or more, and receive the hand gesture of the received user. Based on the information, when it is determined that the user's finger is bent at a predetermined angle or more, it may be determined that the user has taken a virtual operation of grasping (holding) the virtual rehabilitation object.
  • the controller 280 determines that a change has occurred in the position of the user's hand according to the user's hand motion information which is subsequently received while the virtual operation of holding the rehabilitation tool object by hand is performed.
  • the tool object may be moved and displayed on the screen in response to a change in the position of the hand object.
  • the rehabilitation operation is the bending and releasing of the hands
  • the virtual rehabilitation tool has the shape of a flexible ball, for example.
  • the control unit of the communication terminal 200b may receive the user's hand motion information successively received in a state where an area where a user's hand object is displayed on the screen and a portion overlapping with the area where the rehabilitation tool object is displayed are present.
  • the shape of the rehabilitation tool object displayed on the screen may be modified as much as the user's hand object and the rehabilitation tool object overlap.
  • a demonstration hand object corresponding to a rehabilitation operation to be performed by a rehabilitation patient may be further displayed on the rehabilitation exercise assistance screen.
  • the object generator 260 may further generate a demonstration hand-shaped object for demonstrating the corresponding rehabilitation operation.
  • the demonstration hand object may be displayed on a screen area that does not overlap with the user's hand object on the rehabilitation exercise assistance screen.
  • a small window may be displayed at the bottom of the screen.
  • a demonstration hand object may be displayed on the left side of the screen, and a user hand object may be displayed on the right side.
  • the demonstration hand object may overlap the user's hand object, but may be displayed in a state that can be distinguished from each other.
  • a demonstration hand object that demonstrates rehabilitation behavior is displayed in a translucent state, and the user's hand object is initially displayed in a position overlaid with the user so that the user has the same hand as the demonstration hand object. It may be displayed so that it is easy to check whether or not the coincidence between the hand gestures of both when taking an action.
  • the background screen may be configured as an augmented reality screen of the above-described rehabilitation exercise assistance screen. That is, the communication terminal 200b sets the preview image (ie, the camera front image) obtained through the camera module 220 as a background screen, and then displays the finger-shaped object and the rehabilitation tool object described above, thereby rehabilitation of the rehabilitation. It may also implement an augmented reality environment for exercise.
  • the preview image ie, the camera front image
  • rehabilitation exercises performed through the rehabilitation exercise assistance screen may be configured as a type of game progression.
  • the rehabilitation exercise program 282 may also include game progress algorithms and data therefor.
  • the rehabilitation exercise may be implemented in a game form such as building blocks, blowing balloons, etc., depending on the implementation of the rehabilitation exercise program 282.
  • a rehabilitation patient can obtain a virtual experience such as moving a real block by performing a virtual action such as stacking a block, which is a virtual rehabilitation tool, at a specific position.
  • the rehabilitation patient repeats the action of squeezing and releasing the hand, and then a virtual action such as blowing a balloon through a virtual action such as repeatedly pressing an actual air injector.
  • a virtual action such as blowing a balloon through a virtual action such as repeatedly pressing an actual air injector.
  • an air injector may be displayed as a virtual rehabilitation tool object on the rehabilitation exercise assistance screen.
  • a rehabilitation training system that enables finger rehabilitation training through cooperation between respective users of two or more communication terminals remotely.
  • FIGS. 6 to 8 of the accompanying drawings a remote cooperative rehabilitation training system according to a second aspect of the present invention will be described with reference to FIGS. 6 to 8 of the accompanying drawings.
  • FIG. 6 is a view for explaining the overall remote cooperative rehabilitation training system.
  • 7 is a diagram illustrating an application example of the remote cooperative rehabilitation training method.
  • a remote cooperative rehabilitation training system is a device for assisting a finger rehabilitation exercise of a first user (eg, a rehabilitation patient) who wants to perform finger rehabilitation training (hereinafter, referred to as a first finger).
  • a rehabilitation exercise device and a communication server 300b.
  • the remote cooperative rehabilitation training system is a second user side device (hereinafter referred to as a second finger rehabilitation exercise device) for cooperating with the first user to assist or perform rehabilitation training together with the finger of the first user. ) May be included.
  • a second finger rehabilitation exercise device for cooperating with the first user to assist or perform rehabilitation training together with the finger of the first user.
  • the first finger rehabilitation exercise device may include a rehabilitation exercise glove 1 (100c) and a communication terminal 1 (200c).
  • the second finger rehabilitation exercise device may also include a rehabilitation exercise glove 1 (100d) and a communication terminal 2 (200d), as shown in FIG.
  • the communication server 300b performs data communication with the communication terminal 1 200c and the communication terminal 2200d, thereby rehabilitating the first user by remotely communicating with the communication terminal 1 200c. It serves to relay data communication between the communication terminal 2 (200d) by the second user cooperating with.
  • both the first user and the second user may be rehabilitation patients requiring rehabilitation training
  • either one of the first user and the second user may serve only as a collaborator who cooperates in another finger rehabilitation training process. It can also be done.
  • a collaborator who cooperates in the finger rehabilitation training process may include a rehabilitation therapist, a doctor, a caregiver, and the like.
  • first finger rehabilitation exercise device and the second finger rehabilitation exercise device may be configured differently according to their respective roles in the rehabilitation training process, both may have the same configuration.
  • the second finger rehabilitation exercise device may be used. 1, the rehabilitation gloves 2 (100d) may be omitted.
  • the therapist may assist the rehabilitation training of the first user while directly wearing the rehabilitation exercise gloves 2 (100d), since the rehabilitation training may be protected / cooperated using only the communication terminal 2 (200d). to be.
  • the first therapist while using the rehabilitation exercise gloves 2 (100d), while watching the rehabilitation exercise auxiliary image to be described later screen sharing through his terminal (that is, communication terminal 2 (200d)), the first It can assist / cooperate the user's rehabilitation training.
  • the therapist may drag and drop a rehabilitation tool object (refer to reference numeral 208 of FIG. 7) to be described later on a screen displaying a rehabilitation exercise assistance image of a first user shared together through his terminal.
  • a rehabilitation tool object (refer to reference numeral 208 of FIG. 7)
  • rehabilitation training of a first user who shares this image can be assisted / cooperated.
  • the therapist's virtual hand object is displayed at a specific position on the rehabilitation exercise assisted image, the therapist uses the mouse, touch manipulation, key input, and the like to position and shape the virtual hand object. If implemented to operate the back, the therapist will be able to fully assist / cooperate with the rehabilitation training of the first user even if not necessarily using the rehabilitation exercise gloves 2 (100d).
  • the wireless communication module 12 may include a detector 14 and a controller 16.
  • FIG. 6 illustrates only some of the main components, and additionally, a configuration for performing basic functions (for example, a battery) or a configuration required for adding various functions (for example, adding an EMG measurement function). In this case, the EMG sensor may be further included.
  • Rehabilitation exercise glove 1 is basically a variety of hand motion information (ie, finger movements, hand posture change, hand position change (movement), etc.) of the first user wearing the glove by using a wireless communication method It serves to transmit to the communication terminal 1 (200c). This is the same as the detailed content of the rehabilitation exercise gloves 100b described above with reference to FIGS. 1 and 2, and thus redundant description will be omitted.
  • the communication terminal 1 (200c) receives the hand gesture information of the first user transmitted from the rehabilitation exercise glove 1 (100c), the virtual hand-shaped object corresponding to the received hand gesture information of the first user (hereinafter, This is called 'first hand object' and displays it on the display screen. Accordingly, the finger rehabilitation patient can immediately visually check his or her hand movement in the process of the finger rehabilitation exercise, thereby being able to be motivated to the rehabilitation exercise and become interested in the rehabilitation exercise. .
  • the specific configuration of the communication terminal 1 (200c) for this purpose may be the same as that of the communication terminal 200b of FIG. 3 described above, the description thereof will be omitted.
  • the contents related to the configuration and function of the rehabilitation exercise glove 1 (100c) may be applied to the rehabilitation exercise glove 2 (100d) as it is, and the contents related to the configuration and the function of the communication terminal 1 (200c) are also the communication terminal 2 (200d). Edo can be applied as it is by using only different subjects.
  • the rehabilitation exercise assistance process performed between the rehabilitation exercise glove 1 (100c) and the communication terminal 1 (200c) or / and between the rehabilitation exercise glove 2 (100d) and the communication terminal 2 (200d) is the same as described above in / It can be processed by a similar process, a detailed description thereof will be omitted.
  • the contents related to the "configuration method of the rehabilitation exercise assistance screen" described through the description of the finger rehabilitation exercise apparatus and the rehabilitation exercise assistance method according to the first aspect of the present invention may be equally applied thereto.
  • both the first user and the second user use a finger rehabilitation exercise device (i.e., the first and second finger rehabilitation exercise devices) having the same configuration, The case of cooperation in liver rehabilitation training will be described.
  • FIG. 8 is a view for explaining a rehabilitation training method according to an embodiment of the present invention by a remote cooperative rehabilitation training system.
  • FIG. 8 it is assumed that two rehabilitation patients perform cooperative rehabilitation training remotely for convenience of explanation.
  • step S210 as the communication terminal 1 (200c) constituting the first finger rehabilitation exercise device enters the cooperative rehabilitation training mode, in step S220, the communication terminal 1 (200c) and the communication terminal 2 (200d) is a communication server 300b. Communication connection through the relay of data communication.
  • the entry into the cooperative rehabilitation training mode is, for example, after the first user executes a rehabilitation exercise program of his or her communication terminal 1 (200c), the upper part of the rehabilitation exercise assistance screen that is driven according to the corresponding program and displayed on the screen. It may be entered by selecting a particular button for entering the cooperative rehabilitation training mode. In this case, the counterpart to cooperate in the cooperative rehabilitation training mode may be predetermined, but may be directly selected by the user. That is, the entry into the cooperative rehabilitation training mode is a communication through the relay of the communication server 300b with the requested counterpart terminal in response to a request by any one of two or more persons to be subjected to the cooperative rehabilitation training. By connection.
  • two or more patients who are to perform the cooperative rehabilitation training may execute a rehabilitation exercise program installed in the corresponding terminal in their respective terminals, thereby connecting to the communication server 300b, respectively, thereby establishing a communication connection with each other.
  • an IP address of the communication server 300b may be stored in advance in a rehabilitation exercise program installed in each terminal.
  • the communication server 300b may have a phone number and network connection information (for example, an IP address or a MAC address) of each terminal owned by patients, doctors and therapists capable of cooperative rehabilitation training.
  • the rehabilitation exercise program (for example, can be implemented in the form of a rehabilitation training application) installed in each terminal is connected to each other, so that the rehabilitation exercise program in each terminal Accordingly, a state in which mutual rehabilitation exercise information and cooperation information for the rehabilitation exercise (training) can be exchanged with each other may be achieved.
  • step S230 when the hand motion information of the rehabilitation patient 1 is received from the rehabilitation exercise glove 1 100c of the first user (hereinafter referred to as rehabilitation patient 1) to the communication terminal 1 200c.
  • the communication terminal 1 200c generates the virtual hand object of the rehabilitation patient 1 in correspondence with the received hand motion information.
  • the communication terminal 1 (200c) constructs a rehabilitation exercise assistance screen including the generated virtual hand object of the rehabilitation patient 1 and displays it on the display screen (see step S240 and reference numeral 206 of FIG. 7).
  • the rehabilitation exercise assistance screen displayed up to this step is, for example, a hand-shaped object 207 (which is a hand-shaped object that virtually expresses the hand motion of the second user, ie, the rehabilitation patient 2) on the screen 205 of FIG. 7.
  • the excluded screen may be configured.
  • step S235 is shown as preceded by step S240, but the order may be reversed and may be processed in parallel.
  • the communication terminal 2 200d may also generate a virtual hand object corresponding to the received hand motion information of the rehabilitation patient 1 according to the method described above, and configure the rehabilitation exercise assistance screen.
  • the rehabilitation exercise assistance screen displayed through the display screen of the communication terminal 1 200c is referred to as the rehabilitation exercise assistance screen 1 and the rehabilitation exercise assistance displayed through the display screen of the communication terminal 2 200c.
  • the screen will be referred to as rehabilitation exercise assistance screen 2.
  • FIG. 7 the case where the rehabilitation exercise assistance screen 1 and the rehabilitation exercise assistance screen 2 have the same screen configuration is illustrated.
  • the position and shape of the hand object of each patient are displayed in the same manner in both screens, the background screen may be differently displayed.
  • the hand shape is expressed the same on each screen, the position where the hand object is displayed may be displayed differently on both screens.
  • various modifications are possible depending on the implementation method.
  • step S2205 when the hand motion information of the rehabilitation patient 2 is received from the rehabilitation exercise glove 2 (100d) of the second user (that is, the rehabilitation patient 2) to the communication terminal 2 (200d), the communication terminal 2 (200d) ) May transmit the hand motion information of the rehabilitation patient 2 to the communication terminal 1 200c through the relay of the communication server 300b as in step S255.
  • the communication terminal 1 (200c) further generates a hand-shaped object corresponding to the hand motion information of the rehabilitation patient 2 transmitted from the communication terminal 2 (200d) through the object generating unit 160, and thus generated
  • the first rehabilitation exercise assistance screen is reconstructed so that the hand object of the rehabilitation patient 2 can be reflected and displayed on its first rehabilitation exercise assistance screen (see step S260).
  • the communication terminal 2 (200c) also generates a hand object (hereinafter referred to as a second hand object) for the rehabilitation patient 2 corresponding to the hand motion information received from the rehabilitation exercise glove 2 (100d) on its side. Then, the second rehabilitation exercise assistance screen can be reconstructed so as to be reflected in its second rehabilitation exercise assistance screen (see step S265).
  • a hand object hereinafter referred to as a second hand object
  • FIG. 7 A screen when the processes of steps S260 and S265 have been performed are shown in FIG. 5, where reference numeral 207 of FIG. 7 denotes the second hand object.
  • FIG. 7 a case in which the first rehabilitation exercise assistance screen displayed on the communication terminal 1 200c and the second rehabilitation exercise assistance screen displayed on the communication terminal 2 200d have exactly the same screen is illustrated.
  • the first rehabilitation exercise assistance screen and the second rehabilitation exercise assistance screen may have different screen configurations, but when they have the same screen configuration, they may be more effective in cooperative rehabilitation training of each rehabilitation patient. Therefore, hereinafter, methods of synchronizing both screens will be described.
  • the synchronization of the background screen constituting each rehabilitation exercise auxiliary screen may be used as follows.
  • the other terminal receives information regarding the augmented reality environment (for example, information about a preview image acquired through a camera from one terminal).
  • the screen reconstruction information such as identification information on the background screen selected by either terminal in the rehabilitation exercise program installed in each terminal may be synchronized to each other by transmitting to the other terminal.
  • both terminals may synchronize both by connecting to a cooperative rehabilitation training channel configured by a specific background screen in a rehabilitation exercise program.
  • the position and shape synchronization with respect to the hand-shaped object of each rehabilitation patient to be displayed on the background screen and the virtual rehabilitation tool object used for the cooperative rehabilitation exercise are, for example, the display position with respect to the rehabilitation tool object. That is, the coordinate) and the object selection (identification) information and the coordinate information about the display position of the hand-shaped object of each rehabilitation patient can be shared with each other through the relay of the communication server 300b to synchronize. There will be.
  • the rehabilitation exercise auxiliary screen displayed on both terminals can be shared the same, and each of the rehabilitation patients on the screen by taking a specific hand gesture, as if progressing a kind of game Rehabilitation training is available.
  • the hand-shaped object of the rehabilitation patient 1 and the hand-shaped object of the rehabilitation patient 2 are displayed overlapping each other with a specific rehabilitation tool object or more than a predetermined ratio, and the hand of the rehabilitation patient 1
  • the shape object and the hand object of the rehabilitation patient 2 each have a hand shape such that a finger is bent over a predetermined angle
  • the hand of the rehabilitation patient 1 and the hand of the rehabilitation patient 2 cooperate to grab the rehabilitation tool object.
  • Cooperative rehabilitation training may be possible, such as taking a fictitious action and then taking a cooperative action such as moving the rehabilitation tool object to a specific location.
  • FIG. 8 a description is given of a case in which cooperative rehabilitation training is performed by exchanging hand motion information of each rehabilitation patient in both terminals, but the cooperative information shared for giving and receiving cooperative rehabilitation training may vary.
  • the rehabilitation patient and the doctor share the above rehabilitation exercise assistance screen between the respective terminals, the doctor watches the rehabilitation training process of the rehabilitation patient through his terminal, and the rehabilitation timely necessary in the rehabilitation training process
  • the tool may be recommended, and in this case, the communication terminal of the rehabilitation patient may generate and reconfigure the object so that the virtual object related to the rehabilitation tool is displayed on the screen.
  • a remote control system using a wearable communication device is disclosed.
  • a remote control system using a wearable communication device according to a third aspect of the present invention will be described in detail with reference to FIGS. 9 to 11 of the accompanying drawings.
  • FIG. 9 is an overview of a remote control system using a wearable communication device
  • FIG. 10 is a block diagram of a device interworking agent driven on the wearable communication device and the electronic device.
  • a remote control system may include a wearable communication device 100e and an electronic device 200e interoperating therewith.
  • the electronic device 200e is a device including a communication module (see 1130 in FIG. 10) and a display (see 1110 in FIG. 10) for communicating with the wearable communication device 100e. If the device interworking agent 1200 is to be mounted or installed, this may be the case without any limitation. Of course, as a general configuration, as shown in FIG. 2, the power supply unit 1120, the memory 1140, and the electronic device controller 1150 may be further included. However, in the present specification, for convenience and concentration of the description, the electronic device 200e will be described with reference to a smart TV as shown in FIG. 1.
  • the wearable communication device 100e is worn on a user's body to obtain motion sensing information generated at a corresponding wearing portion according to a user's motion, and the predetermined communication device (in this embodiment, a short range wireless communication module). If the device can transmit the acquired information to the remote electronic device 200e through (refer to 50e of FIG. 10), of course, there is no particular limitation. That is, the wearable communication device 100e will be described with reference to the communication device in the form of a glove worn on the user's hand as shown in FIG. 9, but the wearing portion is not necessarily limited to the hand.
  • the wearable communication device 100e does not need to be worn only on any one body part of the user, and a plurality of wearable communication devices 100e are configured as one set, and are worn on the user's hands, both feet, and the like, respectively. It may work. This may be more clearly understood by the following description.
  • the wearable communication device 100e may include motion detection units 20e and 30e, a controller 40e, a short range wireless communication module 50e, and a battery 60e.
  • the present invention is not limited only to these components, and additional components may be further included according to needs and designs. Exemplary configurations and functions of the wearable communication device 100e applied to the remote control system according to the third aspect of the present invention will be described in detail several times with reference to the drawings of FIGS. 7, 8, and 2. In the following description, redundant description will be omitted.
  • the device interworking agent 1200 may include a network manager 1210, an information interpreter 1220, a device interworking manager 1230, and a lookup table 1240. Of course, it may further include an additional configuration in addition to the need or design, the lookup table 1240 may be included in the memory 1140 of the electronic device (200e).
  • the device interworking agent 1200 may be pre-loaded or installed in the electronic device 200e and driven on the electronic device 200e, but may be implemented in the form of firmware or software (application) and be a user of the electronic device 200e. You can also download and install it. For example, although not installed in advance in a smart TV, the user purchases the wearable communication device 100e according to the embodiment of the present invention separately and uses the wearable communication device 100e to use the electronic device 200e. ) And a device interworking agent 1200 suitable for the electronic device 200e to remotely control the operation of a specific application (for example, a specific game application to be described later, etc.) driven by the electronic device 200e. It can also be installed.
  • a specific application for example, a specific game application to be described later, etc.
  • the device interworking agent 1200 is driven on the electronic device 200e to perform device interworking and control between the electronic device 200e and the wearable communication device 100e. same.
  • the network manager 1210 When the wearable communication device 100e is identified through the communication module 1130 mounted on the electronic device 200e, the network manager 1210 performs a network connection for exchanging data with the wearable communication device 100e. .
  • the information interpreter 1220 may, from the motion sensing information received from the wearable communication device 100e, user motion information to be used for controlling any one of an operation of the electronic device 100e and an application running on the electronic device 100e. Acquire.
  • the user motion information is interpreted to be meaningful information for performing the remote control according to the present invention among the motion sensing information received from the wearable communication device 100e (that is, the intention of the user among the various actions taken by the user Operation information which is confirmed to be an operation for remote control).
  • the information interpreter 1220 filters the meaningful information with a remote control intention. It is responsible for extracting only actions. To this end, the information interpreter 1220 may refer to a specific table (hereinafter, referred to as a first lookup table) stored in the lookup table 1240.
  • the first lookup table may exist as, for example, the following table.
  • the information interpreter 1220 ignores the operations except the hand gestures defined in the table, and remotely controls only the hand gestures defined in the table. By determining that the user's intentional motion for the user can obtain only the user's motion information corresponding to the operation.
  • the user operation information to be transmitted to the device interworking manager 1230 which will be described later, may be operation identification information (ie, # 1) of the table.
  • the first lookup table is merely an example, and more various operations may be defined as meaningful user motion information.
  • a game application such as "tennis game” or “table tennis game”
  • a virtual player displayed on the game execution screen and identified with a user who enjoys the game.
  • the user behavior corresponding to the (virtual player) swinging the racket can be defined through the lookup table above.
  • a hand motion ie, bending the index finger or bending the index finger at the same time, moving the thumb, etc.
  • a hand motion ie, bending the index finger or bending the index finger at the same time, moving the thumb, etc.
  • the first lookup table may be defined differently according to the control target, the type and characteristic of the application, the virtual object, and the like.
  • the device interworking manager 1230 may perform an operation of the electronic device and an application running on the electronic device in response to the user operation information. It serves to control the operation and so on.
  • the device interworking manager 1230 may refer to a specific table stored in the lookup table 1240 (hereinafter referred to as a second lookup table) for the same control as described above.
  • a second lookup table a specific table stored in the lookup table 1240
  • An example second lookup table corresponding to the previous example may be as follows.
  • the second lookup table of the above example may be defined differently according to the control target, the type and characteristic of the application, the virtual object, and the like.
  • the second lookup table is merely an example in which user motion information and application motion control are mapped one-to-one assuming a first-person shooting game. Therefore, if it is utilized to control the motion of the electronic device itself, user motion information # 7 (move right hand) is channel up, # 8 (hand move left) is channel down, # 9 (move hand down) Volume down, # 10 (move up) may be mapped, such as volume up.
  • the execution application is a document writing application (for example, notepad, WORD, etc.)
  • the above user action information may correspond to each "Character". In the case of a CALL application, each "number" May be the equivalent of ".
  • the device interworking manager 1230 may perform different control operations according to the object of device control. For example, in the case of controlling the operation of the electronic device, the function of each device (audio volume, channel selection, screen switching, etc.) of the electronic device may be controlled based on the user operation information and the second lookup table. In the case of controlling the execution operation of the letter / number input application, the letter / number input may be performed through a virtual keyboard displayed on the screen. As another example, a user action may be performed to select icons displayed on the home screen. The pointer displayed in the application screen running on the electronic device may be controlled to follow the information. In addition, as will be described below, an operation corresponding to the user's motion information may be controlled to be reflected in the virtual object (see "Hand-shaped virtual object" in FIG. 5 described above) displayed in the running application screen.
  • FIG. 11 is a flowchart briefly illustrating a remote control method according to interworking between a wearable communication device and a device interworking agent.
  • the wearable communication device 100e when the wearable communication device 100e is turned on [step S12], when a connection request message is transmitted from the wearable communication device 100e [step S14], the network of the device interworking agent 1200 is connected.
  • the manager 1210 may identify the wearable communication device 100e (step S16). If so identified, the network manager 1210 performs a network connection with the wearable communication device 100e (step S18).
  • the device interworking manager 1220 may transfer control authority to at least one of an operation of the electronic device and an application running on the electronic device to the wearable communication device 100e.
  • Switch step S20
  • instruct the device list or the application list controllable by the wearable communication device 100e to be displayed on the screen of the electronic device 200e to the GUI (Graphic User Interface) [step] S22].
  • Such an instruction (request) is transmitted to the controller 1150 of the electronic device 200e, so that the electronic device controller 1150 generates a corresponding GUI and expresses it on the display screen.
  • the user of the wearable communication device 100e may visually check the objects that can be controlled through the screen of the electronic device 200e. Subsequently, when motion sensing information for selecting a control target is transmitted from the wearable communication device 100e according to the user selection (that is, the user takes an action of instructing such selection) [step S24], the device interworking agent 1200 ) May obtain user motion information related thereto through the information analyzer 1220. Based on the acquired information, the device interlocking manager 1230 performs setting for device control as intended by the user and completes the setting (step S26).
  • the device interworking manager 1230 is an information analyzer.
  • the control unit 1150 of the electronic device 200e is instructed (requested) to perform a corresponding control operation according to the user operation information acquired by the 1220 (step S32).
  • a process for selecting a control target to be remotely controlled by this that is, receiving motion sensing information regarding a GUI display process in step S22 and a selection operation in step S24).
  • this step may be omitted as needed or according to the implementation of the invention.
  • the wearable communication device 100e is set to have authority only for operation control of a specific application, the above step may be omitted.
  • the device interworking manager 1230 may perform the setting for device control by automatically executing the specific application related to the wearable communication device 100e.
  • the setting process for controlling the device through the device interworking manager 1230 according to step S26 may further include the following process. For example, if it is assumed that a specific application is running in the electronic device 200e, a specific control element (see "Hand virtual object" in FIG. 5 described above) among the elements displayed in the application execution screen is described. The process of converting the control right to the wearable communication device 100e may be further included.
  • the GUI presentation process according to the above-described step S22 may further include the following process according to the situation. For example, assuming that there are a plurality of identified wearable communication devices, it may be necessary to identify in which manner the plurality of wearable communication devices will be used by whom. Accordingly, in the above case, the device interworking manager 1230, for each of the identified wearable communication devices, may include a first selection item for selecting a user who will use the device and a second part for selecting a wearing part of the device. The GUI including at least one of the selection items may be displayed on the screen of the electronic device.
  • the device interworking manager 1230 may display the virtual displayed in the application screen running on the electronic device.
  • the control authority for each control element of the object may correspond to the plurality of wearable communication devices one by one.
  • the device interworking manager 1230 distinguishes the user operation information obtained by the information analyzing unit 1220 based on the identification information of the plurality of wearable communication devices, thereby allowing the virtual object to be classified by the control element. It can also be controlled independently.
  • the user wishes to remotely control the virtual player displayed through the "tennis game" screen using the wearable communication device 100e, the user wears one wearable communication device 100e on the right hand to perform operation / control.
  • one may want to operate by wearing a plurality of wearable communication devices. That is, in addition to one wearable communication device that controls the racket held by the right hand of the virtual player, the wearer may further wear the wearable communication device on both ankles, thereby controlling the left / right movement of the virtual player.
  • motion sensing information received from each of the set of wearable communication devices needs to be independently controlled in correspondence with each control element (i.e. racket, player's left / right movement) regarding the virtual player. For these cases, the above control can be useful.
  • control schemes may be utilized. This is described as follows. If the plurality of wearable communication devices are assigned to a single user by different wearing parts, two or more wearable communication devices may be provided in one control element due to a property of a virtual object displayed in a running application screen. There may be times when groups need to be set up. For example, a handle as a virtual object in a "car racing" game may correspond to this control element.
  • the device interworking manager 1230 may control the control element corresponding to the combined operation of the user motion information of each of the grouped wearable communication devices (for example, devices worn on the right hand and the left hand, respectively).
  • the handle can be controlled. That is, in this case, the user may remotely control the manipulation of the virtual handle displayed on the game execution screen by performing an operation such as operating a steering wheel using a communication device worn on both hands.
  • a plurality of wearable communication devices may be used differently for each user. That is, two or more users (i.e. game players) each want to remotely control a virtual object (e.g. a car race or a boxing match) assigned to them with their own communication device. can do.
  • the device interworking manager 1230 corresponds to the control authority for each virtual object expressed in the running application screen for each user, and the user action information acquired by the information analyzer 1220 is used for the plurality of wearables. By distinguishing based on each identification of the communication device, the virtual object can be controlled independently for each user.
  • a training schedule optimization method using a brain science exercise learning model and an optimal control theory when training a single or multiple exercise tasks is disclosed.
  • the training schedule optimization method to be described below may be programmed by a user terminal (not shown) such as a portable terminal, a PC, or a training schedule management server (not shown) connected to the user terminal and implemented by one or more processors. have.
  • the long-term learning level of the exercise task (measured after 24 hours after completing the training) has no correlation with the learning level observed during the exercise task training or the learning level of the fast learning module. Instead, it has been found that there is a significant positive correlation with the learning level of the slow learning module (Joiner and Smith, 2008 J Neuro Physiol).
  • the optimal control theory is a theory that finds an array of manipulated variables that optimizes a specific evaluation function on a target system expressed as a function of status and control.
  • Dynamic programming and the Fontryagin's maximum principle are two ways to find an array of manipulated values that optimize the evaluation function (Kirk 1970, Todorov 2007).
  • the present invention provides a method of finding a learning schedule that maximizes long-term learning levels when training single or multiple athletic tasks.
  • Long-term learning level refers to the learning level of an exercise task measured after a certain period of time (typically 24 hours or more) after completing the exercise task training.
  • maximizing long-term learning means optimizing a specific assessment function expressed as a function of the learning levels of the individual exercise tasks.
  • a feature of the present invention is to propose a method for finding a theoretically proven optimal learning schedule that maximizes long-term learning by applying a brain science exercise learning model and an optimal control theory to exercise training.
  • the present invention measures and normalizes the initial learning level of individual exercise tasks (see S400 of FIG. 12). Initial learning level measurements are typically performed before training, but can be included in the training process.
  • the individual exercise task When measuring the initial learning level before training, the individual exercise task is repeated a certain number of times before training, and then the average of the obtained values is averaged.
  • the measured value is inserted by randomly inserting the learning level measurement schedule in the middle of the training schedule.
  • the initial learning level measurement does not give the trainer feedback on the learning level to prevent learning from occurring during the measurement and inaccurate measurements.
  • the initial learning level value measured through the measurement process is normalized to the maximum possible learning level of the individual exercise task.
  • the present invention predicts the parameters of the brain science exercise learning model for the individual exercise task in order to apply the brain science exercise learning model (see S420 of FIG. 12).
  • Motor learning model parameters for individual exercise tasks are typically predicted using training data from other trainer groups, but may be predicted in real time from training data of individual trainers.
  • the exercise learning model parameters that best reproduce the training data of other trainer groups of individual exercise tasks may be the maximum likelihood method or the like. Obtained by regression analysis such as least square method.
  • real-time prediction methods such as non-linear Kalman filter are used to estimate the maximum posterior probability (from the trainee's learning level accumulated at each moment during training). Obtain the motor learning model parameters that guarantee the maximum posterior probability.
  • the present invention expresses an object system using an exercise learning model, an exercise learning model parameter of an individual exercise task, a trainee's learning level for an individual exercise task, and a training schedule to apply an optimal control theory (see S440 of FIG. 12). ).
  • the training level of the trainer for the individual exercise task is a state quantity, and the initial learning level value measured for the individual exercise task is used as an initial value.
  • the training schedule uses a value obtained by converting an exercise task presented at each time point as a manipulated variable into a mathematical vector.
  • the exercise learning model is an object system formula, and the parameter is a value predicted in the parameter prediction process of the exercise learning model.
  • the evaluation function uses the criteria that the trainer wants to achieve as a function of the state quantity and the manipulated quantity. For example, an evaluation function may be used to minimize the long-term mean-square error of multiple exercise tasks or to maximize the long-term mean-square performance.
  • the present invention uses an optimal control theory method, such as dynamic programming and the maximum principle of Fontriyagin, to find a training schedule that optimizes the evaluation function (see S460 in FIG. 12).
  • the optimal control theory can be used to find the optimal training schedule before training or in real time during training.
  • the optimal training schedule is found using the optimal control theory before the training using the predicted parameters.
  • the present invention converts the problem of selecting a training schedule in exercise learning into a formula for applying control theory using a brain science exercise learning model, and then theoretically optimizes long-term learning level by applying an optimal control theory. Show how to find a training schedule.
  • the present invention can be used to search for an optimal training schedule in tennis training.
  • the trainer To learn tennis, the trainer must learn two separate exercise tasks: the forehand stroke and the backhand stroke.
  • the present invention measures the trainee's learning level on an individual exercise task before training. To determine the level of training, the trainer performs a random forehand stroke and backhand stroke five times each. Make sure to close your eyes after the stroke so that the trainer does not receive visual feedback on the level of learning during the measurement.
  • the learning level for each stroke is expressed as a function of the geometric distance from the designated target point on the opposite side of the court to the ball's falling point after the stroke:
  • the maximum geometry is the geometry between the learner and the target.
  • the effective range of the learning level is 0 to 1, so that no normalization is required.
  • xf (t + 1) Af (t) * xf (t) + Bf (t) * e (t)
  • xs (t + 1) As (t) * xs (t) + Bs (t) * e (t) * c (t)
  • xf (t) is the state amount of the fast learning process at time t
  • Af is the forgetting speed parameter of the fast learning process
  • Bf is the learning speed parameter of the fast learning process.
  • xs (t) is a state vector of the slow learning process state value at time t, and is a mathematical vector of the slow learning process state values of the forehand stroke and the backhand stroke.
  • xs (t) (xs_1 (t), xs_2 (t)) '
  • Bs is the learning speed parameter of the slow learning process
  • e (t) is the error learning level at time t
  • c (t) is the manipulated value at time t.
  • y (t) is the learning level observed at time t
  • f (t) is the ideal learning level for the motor task presented at time t.
  • the training learning model parameters Af_1, Bf_1, As_1, Bs_1, Af_2, Bf_2, As_2, and Bs_2 are predicted using the training data of another trainer group. Two other groups of trainers train the forehand stroke and the backhand stroke, respectively, and then use least squares regression to find the motor learning model parameters that best represent the training data for each group. In other words,
  • y (i) is the actual training data at time i
  • y_hat (i) is the prediction obtained from the model equation at time i
  • N is the total number of training.
  • the maximum principle of the fontriagin which is one of the optimal control theory methods, may be used.
  • the expression function uses the following function to minimize long-term mean square error.
  • f_1 is the abnormal learning level for the forehand stroke
  • f_2 is the abnormal learning level for the backhand stroke
  • xs_1 (N) is the slow learning level for the forehand stroke at time N
  • xs_2 (N) is the backhand stroke at time N.
  • N is the total number of training.
  • H_1, H_2 and related variables are defined as follows.

Abstract

L'invention concerne un appareil d'exercice de rééducation des doigts, qui comprend; un gant d'exercice de rééducation, en forme de gant, qui comprend un module de communication sans fil, un capteur de détection des informations de mouvement de la main en fonction d'au moins un mouvement de doigt, et un changement dans la forme de la main, un changement dans la position de la main, et une partie de contrôle destinée à contrôler que les informations de mouvement de la main d'un utilisateur détectées par la partie de détection. soient transmises à un terminal de communication à distance par l'intermédiaire d'un module de communication sans fil; et le terminal de communication comprenant un module de communication, une partie de génération d'objet destinée à générer un objet en forme de main virtuelle qui correspond aux informations de mouvement de la main de l'utilisateur reçues, lorsque ces informations sont reçues par le gant d'exercice de rééducation au moyen du module de communication, et une partie de contrôle destinée à contrôler que l'objet en forme de main virtuelle qui est généré par la partie de génération d'objet est affiché sur un écran d'affichage.
PCT/KR2012/004313 2011-05-31 2012-05-31 Appareil d'exercice de rééducation, appareil de communication portatif, et système d'application et procédé d'application correspondant WO2012165882A2 (fr)

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
KR1020110051945A KR101367801B1 (ko) 2011-05-31 2011-05-31 손가락 재활 운동 장치 및 재활 운동 보조 방법
KR1020110051984A KR20120133348A (ko) 2011-05-31 2011-05-31 훈련 일정 최적화 방법
KR10-2011-0051982 2011-05-31
KR1020110051982A KR20120133347A (ko) 2011-05-31 2011-05-31 원격 협동 재활 훈련 시스템
KR10-2011-0051984 2011-05-31
KR10-2011-0051945 2011-05-31
KR1020110146158A KR101263129B1 (ko) 2011-12-29 2011-12-29 착용형 통신 장치를 이용한 원격 제어 시스템
KR10-2011-0146158 2011-12-29

Publications (3)

Publication Number Publication Date
WO2012165882A2 true WO2012165882A2 (fr) 2012-12-06
WO2012165882A3 WO2012165882A3 (fr) 2013-04-25
WO2012165882A9 WO2012165882A9 (fr) 2013-10-31

Family

ID=47260093

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2012/004313 WO2012165882A2 (fr) 2011-05-31 2012-05-31 Appareil d'exercice de rééducation, appareil de communication portatif, et système d'application et procédé d'application correspondant

Country Status (1)

Country Link
WO (1) WO2012165882A2 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103251419A (zh) * 2013-04-25 2013-08-21 西安交通大学苏州研究院 用于手功能康复训练与评估的数据手套及其监测方法
CN106371585A (zh) * 2016-08-23 2017-02-01 塔普翊海（上海）智能科技有限公司 扩增实境系统及其方法
CN107049325A (zh) * 2016-11-23 2017-08-18 上海健康医学院 一种新型的穿戴式手部外骨骼力‑位移实时检测系统及检测方法
CN111450511A (zh) * 2020-04-01 2020-07-28 福建医科大学附属第一医院 一种脑卒中的肢体功能评估和康复训练系统及方法
CN112401845A (zh) * 2020-11-19 2021-02-26 华侨大学 一种握力康复训练设备
CN112619065A (zh) * 2020-11-27 2021-04-09 山东海天智能工程有限公司 一种手功能综合康复训练平台
WO2023245696A1 (fr) * 2022-06-23 2023-12-28 东南大学 Système d'entraînement de coordination main-œil assisté par robot basé sur une poursuite de mouvement oculaire lisse et un champ de force de guidage

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104436526B (zh) * 2014-11-10 2017-09-15 汪毅 双上肢协调运动训练器

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5429140A (en) * 1993-06-04 1995-07-04 Greenleaf Medical Systems, Inc. Integrated virtual reality rehabilitation system
US6454681B1 (en) * 1998-01-05 2002-09-24 Thomas Brassil Hand rehabilitation glove
JP2007244437A (ja) * 2006-03-13 2007-09-27 Motorika Inc リハビリテーション並びにトレーニングのための方法及び器械
WO2010085476A1 (fr) * 2009-01-20 2010-07-29 Northeastern University Gant intelligent pour multiples utilisateurs pour rééducation basée sur un environnement virtuel

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5429140A (en) * 1993-06-04 1995-07-04 Greenleaf Medical Systems, Inc. Integrated virtual reality rehabilitation system
US6454681B1 (en) * 1998-01-05 2002-09-24 Thomas Brassil Hand rehabilitation glove
JP2007244437A (ja) * 2006-03-13 2007-09-27 Motorika Inc リハビリテーション並びにトレーニングのための方法及び器械
WO2010085476A1 (fr) * 2009-01-20 2010-07-29 Northeastern University Gant intelligent pour multiples utilisateurs pour rééducation basée sur un environnement virtuel

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103251419A (zh) * 2013-04-25 2013-08-21 西安交通大学苏州研究院 用于手功能康复训练与评估的数据手套及其监测方法
CN106371585A (zh) * 2016-08-23 2017-02-01 塔普翊海（上海）智能科技有限公司 扩增实境系统及其方法
CN107049325A (zh) * 2016-11-23 2017-08-18 上海健康医学院 一种新型的穿戴式手部外骨骼力‑位移实时检测系统及检测方法
CN107049325B (zh) * 2016-11-23 2023-09-05 上海健康医学院 一种新型的穿戴式手部外骨骼力-位移实时检测系统及检测方法
CN111450511A (zh) * 2020-04-01 2020-07-28 福建医科大学附属第一医院 一种脑卒中的肢体功能评估和康复训练系统及方法
CN112401845A (zh) * 2020-11-19 2021-02-26 华侨大学 一种握力康复训练设备
CN112619065A (zh) * 2020-11-27 2021-04-09 山东海天智能工程有限公司 一种手功能综合康复训练平台
WO2023245696A1 (fr) * 2022-06-23 2023-12-28 东南大学 Système d'entraînement de coordination main-œil assisté par robot basé sur une poursuite de mouvement oculaire lisse et un champ de force de guidage

Also Published As

Publication number Publication date
WO2012165882A3 (fr) 2013-04-25
WO2012165882A9 (fr) 2013-10-31

Similar Documents

Publication Publication Date Title
WO2012165882A2 (fr) Appareil d'exercice de rééducation, appareil de communication portatif, et système d'application et procédé d'application correspondant
US10838495B2 (en) Devices for controlling computers based on motions and positions of hands
JP2022500729A (ja) 拡張現実システムの神経筋制御
WO2016117758A1 (fr) Système d'exercice de rééducation de la main et méthode associée
KR101367801B1 (ko) 손가락 재활 운동 장치 및 재활 운동 보조 방법
WO2016182181A1 (fr) Dispositif portable et procédé permettant de fournir une rétroaction d'un dispositif portable
WO2016105166A1 (fr) Dispositif et procédé de commande d'un dispositif pouvant être porté
WO2012165880A9 (fr) Appareil d'exercice de rééducation, procédé et dispositif de régulation de l'aide proactive d'un appareil d'exercice de rééducation, et appareil en forme de gant relié mobile destiné à entrer des données
CN107896508A (zh) 可以作为多个目标/端点（设备）和的整合点的以人为中心的“设备的超ui”体系结构的方法和设备，以及面向“模块化”通用控制器平台以及输入设备虚拟化的具有动态上下文意识的手势输入的相关方法/系统
WO2018124809A1 (fr) Terminal vestimentaire et son procédé de commande
EP3238012A1 (fr) Dispositif et procédé de commande d'un dispositif pouvant être porté
WO2016208930A1 (fr) Système et procédé de visée automatique pour jeu mobile
WO2022080548A1 (fr) Dispositif de sport interactif à réalité augmentée utilisant des capteurs lidar
WO2013133583A1 (fr) Système et procédé de réhabilitation cognitive par interaction tangible
CN101422656B (zh) 可感应人体动作的电子游戏操控装置
WO2020087999A1 (fr) Dispositif de capture d'action manuelle ayant une rétroaction de force
US20190294249A1 (en) Systems and methods for haptic feedback in a virtual reality system
WO2018056755A1 (fr) Terminaux de communication mobile, leurs unités d'entrée directionnelle, et procédés associés
WO2020054954A1 (fr) Procédé et système pour fournir une rétroaction virtuelle en temps réel
WO2023074980A1 (fr) Procédé d'interaction basé sur la reconnaissance de mouvement et support d'enregistrement
WO2024053989A1 (fr) Système et procédé de recommandation d'exercice de rééducation sur la base d'une détection d'environnement de vie à l'aide d'une reconnaissance d'image numérique
TWI599389B (zh) 結合人體手勢辨識及骨架追蹤之虛擬人物控制系統
KR20120133347A (ko) 원격 협동 재활 훈련 시스템
TWI681271B (zh) 無線控制裝置、位置標定器及配件
WO2017119523A1 (fr) Ceinture intelligente et procédé de commande associé

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12792319

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12792319

Country of ref document: EP

Kind code of ref document: A2