WO2022145258A1 - 運動教示装置、運動教示システム、運動教示方法およびプログラム - Google Patents

運動教示装置、運動教示システム、運動教示方法およびプログラム Download PDF

Info

Publication number
WO2022145258A1
WO2022145258A1 PCT/JP2021/046747 JP2021046747W WO2022145258A1 WO 2022145258 A1 WO2022145258 A1 WO 2022145258A1 JP 2021046747 W JP2021046747 W JP 2021046747W WO 2022145258 A1 WO2022145258 A1 WO 2022145258A1
Authority
WO
WIPO (PCT)
Prior art keywords
motion
skin
user
exercise
physical
Prior art date
Application number
PCT/JP2021/046747
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
新 堀江
敦 檜山
昌彦 稲見
Original Assignee
国立研究開発法人科学技術振興機構
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 国立研究開発法人科学技術振興機構 filed Critical 国立研究開発法人科学技術振興機構
Priority to JP2022572995A priority Critical patent/JPWO2022145258A1/ja
Publication of WO2022145258A1 publication Critical patent/WO2022145258A1/ja

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N1/00—Electrotherapy; Circuits therefor
    • A61N1/18—Applying electric currents by contact electrodes
    • A61N1/32—Applying electric currents by contact electrodes alternating or intermittent currents
    • A61N1/36—Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass

Definitions

  • the present invention relates to an exercise teaching device, an exercise teaching system, an exercise teaching method and a program.
  • the head-mounted display can play back the first-person viewpoint image taken by a stereo camera that matches the viewpoint position of the expert during operation, and the ambient sound of the expert recorded by the binoral microphone is binoral.
  • a skill teaching system that can be regenerated, has a vibration device provided at a position corresponding to the mounting position of a myoelectric sensor attached to a skilled person, and can vibrate the vibrating device based on a signal of the myoelectric sensor of a skilled person is disclosed. (See, for example, Non-Patent Document 1).
  • Non-Patent Document 1 can sequentially teach the user a plurality of muscles to be moved in conjunction with each other when only the vibration device is used, but it is a stimulation by vibration.
  • the stimulus is easily diffused, and in particular, it may not be possible to express a state in which the muscles are still tense, and the physical sensation of a skilled person has not been induced. Therefore, there is a problem that a particularly superior teaching effect is not obtained as compared with the teaching when only the video information is used.
  • the present invention has been made in view of the above problems, and an object thereof is a wearable device capable of teaching a user the teaching motion of a motion instructor by inducing a physical sensation of the motion instructor. Is to provide.
  • the exercise teaching device is a wearable exercise for inducing a physical sensation of a motion teacher by presenting a force sense on the skin of a user to teach physical exercise.
  • This motion teaching device includes a body motion information acquisition unit that acquires body motion information of a motion teacher, a plurality of stimulating elements arranged on the skin close to the surface of a plurality of muscles of the user, and a plurality of stimuli. It includes a control unit that controls the element. Each of the plurality of stimulating elements stimulates the skin close to the surface of the user's muscles. The control unit controls a plurality of stimulating elements so as to form a mechanical distribution on the skin that generates a target force sensation based on the body movement information acquired by the body movement information acquisition unit. This force sensation induces the user to feel the body of the motion teacher.
  • the exercise teaching device may include a storage unit that stores information on the physical exercise of the motion instructor.
  • the physical exercise information acquisition unit may acquire physical exercise information from the storage unit.
  • the stimulating element may stimulate the skin by rotational movement.
  • the control unit may control the rotation angle and rotation direction of the stimulating element.
  • the control unit may control the stimulating element so that the larger the target force sense is, the larger the rotation angle of the stimulating element is.
  • the stimulating element stimulates the skin by rotational movement
  • the control unit may control the rotational speed and rotation direction of the stimulating element.
  • the control unit may control the stimulator element so that the larger the target force sense is, the larger the rotation speed of the stimulator element is.
  • the stimulating element may stimulate the skin by rotational movement
  • the control unit may control the rotational torque and the rotational direction of the stimulating element.
  • the control unit may control the stimulating element so that the larger the target force sense, the larger the rotational torque of the stimulating element.
  • the spacing between adjacent stimulating elements may be such that the ranges of force sense presented by the adjacent stimulating elements overlap.
  • the stimulating element may be placed on the skin close to the surface of the user's upper arm, forearm, wrist, fingers, thigh, lower leg, ankle, toe, neck, torso or lumbar muscles. .. Further, the stimulating element may be arranged at one place on the skin near the thickest part of each muscle, at each part of the skin near the tendons at both ends of each muscle, or at a plurality of places so as to cover the skin on the surface of each muscle. good.
  • the stimulating element may stimulate the skin by electrical stimulation in addition to rotational movement.
  • Another aspect of the present invention is an exercise teaching system.
  • This system includes the above-mentioned motion teaching device and a motion instructor motion measuring device that measures information on the body motion of the motion instructor in real time.
  • the physical exercise information acquisition unit may acquire information on the physical exercise of the motion instructor from the motion instructor motion measuring device.
  • the motion instructor's physical exercise information may include myoelectric potential, muscle tension, or amount of skin deformation.
  • the exercise teaching system may include a user exercise measuring device that measures information on the user's physical exercise in real time.
  • the control unit controls a plurality of stimulus elements based on the difference between the motion teacher's body motion information measured by the motion instructor motion measuring device and the user's body motion information measured by the user motion measuring device. You may.
  • the control unit may be characterized by controlling a plurality of stimulating elements so that the user forms a mechanical distribution on the skin that generates a force sensation that increases muscle activity so that the difference becomes small.
  • the exercise teaching system machine-learns the physical motion information of the motion instructor and the mechanical distribution of the motion instructor's skin estimated from the motion instructor information as learning data. Even if the motion information acquisition unit is further provided with a learning unit that outputs a mechanical distribution that generates a desired force sense when the motion information of the motion instructor acquired from the motion instructor motion measuring device is input. good.
  • the motion teaching system may include a wearable display device that displays a first-person video captured at the viewpoint position of the motion instructor.
  • the motion teaching system may include a microphone that binaurally records ambient sounds during the teaching motion of the motion instructor, and a wearable playback device that reproduces the voice recorded by the microphone.
  • This method is an exercise teaching method for inducing a physical sensation of a motion instructor to teach physical exercise by presenting a force sense to the user's skin, and acquires information on the physical exercise of the motion instructor. It comprises a step and a step of stimulating the skin close to the surface of the user's muscle using a plurality of stimulating elements placed on the skin close to the surface of the user's muscle.
  • the plurality of stimulating elements form a mechanical distribution on the skin that generates a desired force sensation based on the information of the body movement, and this force sensation induces the user to induce the physical sensation of the motion teacher.
  • This program is an exercise teaching method for inducing a physical sensation of a motion instructor to teach physical exercise by presenting a force sense to the user's skin, and acquires information on the physical exercise of the motion instructor.
  • the plurality of stimulating elements form a mechanical distribution on the skin that generates a desired force sensation based on the information of the body movement, and this force sensation induces the user to induce the physical sensation of the motion teacher.
  • FIG. 3 is a view of a user wearing the motion teaching device of FIG. 3 viewed from diagonally rear left. It is a perspective view of the stimulating element unit of the motion teaching apparatus of FIG. It is a graph which shows the positive correlation between the intensity of activity based on exercise, and the intensity of stimulation. It is a functional block diagram of the exercise teaching system which concerns on the twelfth embodiment. It is a functional block diagram of the exercise teaching system which concerns on 14th Embodiment.
  • strain energy density distribution a distribution of mechanical quantities per unit volume, for example, a distribution of strain energy (hereinafter referred to as “strain energy density distribution”) is formed on the skin. That is, when a person exercises in contact with a sheet or the like, strain is generated in each part of the skin. The temporal and spatial distribution of the energy density of this strain is considered to reflect the characteristics such as the type, magnitude, and direction of the motion. In the mechanoreceptors inside the skin that control the sense of force, the frequency of neuron firing is determined by this strain energy density distribution. Therefore, if the strain energy density distribution corresponding to various movements is formed on the skin by stimulating the skin of the person, the person can perform such movements without actually moving the person. It is thought that it can induce a feeling of being, or what kind of exercise you are going to do.
  • the part of the skin that gives irritation is not limited to the buttocks, but the back, abdomen, head, upper arm, forearm, wrist, fingers, thigh, lower leg, ankle, toes, neck, torso, waist, etc.
  • Any site may be used as long as it is a site for forming a strain energy density distribution corresponding to the desired motion.
  • the distribution of mechanical quantities corresponding to the target motion (hereinafter referred to as "mechanical distribution”) is not limited to the strain energy density distribution, but the distribution of strain (for example, main strain and equivalent strain) and force. It also includes the distribution of (eg, shear forces, vertical strains, etc.), stresses (ie, forces per unit area, such as pressure, principal stress, Mieses stress, etc.).
  • the sensation of muscle movement and load felt when a person moves or is about to move the body is referred to as "physical sensation”.
  • the force sense force sense
  • presenting the magnitude and direction of the force is called “presenting the force sense”.
  • the technique that serves as a model can be accurately and accurately used. It can be taught efficiently.
  • Information on such model physical movements can be acquired and accumulated by measuring or estimating the physical movements of the motion instructor. Based on this information, the user can perform correct exercise and muscles by stimulating the skin close to the surface of the user's muscles so as to form a mechanical distribution on the skin that produces the desired force sensation. You can learn how to use it. On the contrary, it is also conceivable to use such means to induce the movement instructor to have a physical sensation when the user is moving. By understanding the physical sensation of the user in this way, it is expected that the motion instructor can more accurately provide guidance for motion instruction.
  • FIG. 1 shows a functional block of the exercise teaching device 1 according to the first embodiment.
  • the exercise teaching device 1 teaches physical exercise by presenting a sense of force to the skin S close to the surface of the user's muscle M.
  • the exercise teaching device 1 is wearable. That is, the user can wear the exercise teaching device 1 on the body.
  • the exercise teaching device 1 includes n stimulating elements 11, 12, ..., 1n, a body exercise information acquisition unit 20, and a control unit 30 (n is an integer of 2 or more).
  • the physical exercise information acquisition unit 20 acquires information on the physical exercise of the motion instructor.
  • the physical exercise of the motion instructor is the exercise of the muscles when the motion instructor performs the technique, and serves as a model for the user.
  • the body movement information acquisition unit 20 may acquire information stored in advance in a storage device or the like of a server, or may acquire the actual body movement of the motion instructor in real time by communication.
  • the physical exercise information acquisition unit 20 transmits the acquired information to the control unit 30.
  • the control unit 30 controls the stimulating elements 11, 12, ..., 1n so as to form a mechanical distribution on the skin S that generates a target force sensation based on the information acquired by the body movement information acquisition unit 20. ..
  • the control unit 30 may be configured using known computer hardware and software.
  • the stimulating elements 11, 12, ..., 1n are arranged on the skin S close to the surface of the user's muscle M.
  • Each of the stimulating elements 11, 12, ..., 1n stimulates the skin S close to the surface of the user's muscle M.
  • the method in which the stimulating elements 11, 12, ..., 1n stimulate the skin S may be a mechanical method such as rotational movement, pulling in the shear direction, compression, or suction.
  • Each of the stimulating elements 11, 12, ..., 1n may be capable of presenting a sense of force by itself. Alternatively, it may be possible to present a sense of force only when a plurality of stimuli jointly form a predetermined mechanical distribution.
  • the interval between adjacent stimulating elements may be an interval capable of presenting a spatially continuous force sense.
  • the spacing between adjacent stimulating elements may be, for example, such that the ranges of force sense presented by the adjacent stimulating elements overlap. Alternatively, the spacing between adjacent stimulating elements may be within the range of the two-point discrimination threshold in the area of the skin.
  • FIG. 13 is a time-series signal of muscle tensions of the rectus femoris, vastus lateralis, adductor magnus, and gastrocnemius muscles for about 2 seconds when a person starts kicking up the foot.
  • each muscle starts to move almost at the same time, but after that, each muscle individually performs a complicated contraction.
  • humans are not consciously performing such complex contractions of muscles at the level of individual muscles, but are demonstrating what they have learned as an overall movement of kicking up. Therefore, if the user is given a time-series change in the mechanical distribution obtained from the physical motion of the motion instructor, the user is experiencing the physical sensation of the motion instructor, and the motion is most effectively performed. You will learn.
  • the physical exercise of the motion instructor can be effectively taught to the user.
  • FIG. 2 shows a functional block of the exercise teaching device 2 according to the second embodiment.
  • the exercise teaching device 2 also teaches physical exercise by presenting a sense of force to the skin S close to the surface of the user's muscle M.
  • the exercise teaching device 2 includes n stimulating elements 11, 12, ..., 1n, a body exercise information acquisition unit 20, a control unit 30, and a storage unit 40 (n is an integer of 2 or more). That is, the motion teaching device 2 includes a storage unit 40 in addition to the configuration of the motion teaching device 1 of FIG.
  • the storage unit 40 stores information on the physical movement of the motion instructor.
  • the body movement information acquisition unit 20 acquires information on the body movement of the motion instructor from the storage unit 40.
  • the storage unit 40 may memorize the ideal physical movement of the motion instructor.
  • the user can learn the physical exercise that serves as a model stored in the storage unit 40.
  • the storage unit 40 may store the physical information of the user when the user is in the best condition. In this case, the user can regain the physical exercise when he / she is in the best condition when he / she falls into a slump or the like.
  • the user can acquire the desired physical exercise by storing the physical exercise information of the motion instructor in the storage unit 40.
  • the stimulating elements 11, 12, ..., 1n may stimulate the skin by rotational movement.
  • the control unit 30 may control the rotation angle and rotation direction of the stimulation elements 11, 12, ..., 1n.
  • the stimulus applied to the skin is not due to suction, electrical stimulation, temperature stimulation, compression, or translational movement along the shear direction of the skin. It is desirable that it is due to rotational movement.
  • the reason is as follows. For one thing, in such a form, it is premised that the stimulus is applied to the skin through clothing. In this case, stimuli such as suction, electrical stimulus or temperature stimulus cannot be directly applied.
  • the stimulation by compression is not suitable for teaching physical exercise because it causes the user to interfere with the exercise.
  • the mechanism becomes complicated, and there is a problem that it is difficult to apply it to a form in which stimulating elements are densely arranged on the skin.
  • the presentation of the stimulus by the rotational movement can be applied to the embodiment without the above-mentioned problems.
  • FIG. 3 is a perspective view of the motion teaching device 3.
  • FIG. 4 is a view of a user wearing the exercise teaching device 3 as viewed from diagonally rear left.
  • FIG. 5 is a perspective view of the stimulating element unit 50 of the motion teaching device 3.
  • the exercise teaching device 3 is attached to the left and right thighs and the left and right lower legs of the user.
  • four stimulating elements 11, 12, ..., 1n are combined into one stimulating element unit. That is, the motion teaching device 3 includes a total of eight stimulating element units.
  • the stimulating element unit 50 is substantially square. Stimulating elements are arranged at the four corners of the stimulating element unit 50, respectively.
  • FIG. 5 shows a state in which the stimulating elements 11, 12, 13 and 14 are grouped together in the stimulating element unit 50. Eight stimulating element units are arranged in the motion teaching device 3. That is, as shown in FIGS. 3 and 4, the stimulating elements 11, 12, ..., 132 are on the skin in which the three stimulating element units are close to the surfaces of the left and right biceps femoris and quadriceps muscles, respectively.
  • One stimulator unit is placed on the skin close to the surface of the soleus muscle of the left and right thighs, respectively.
  • Each of the stimulating elements 11, 12, ..., 132 has a disk shape with a diameter of 20 mm and a thickness of 5 mm. If the stimulating elements 11, 12, ..., 124 are too hard, they do not fit into the body, and the pain caused by the contact of the edges of the stimulating elements 11, 12, ..., 132, and the stimulating elements 11, 12, ..., 132 and clothes Sliding between is likely to occur. On the contrary, if the stimulating elements 11, 12, ..., 132 are too soft, it becomes difficult to transmit the rotational force. In consideration of these characteristics, an appropriate chloroprene rubber sponge is used as a material for the stimulating elements 11, 12, ..., 132.
  • a small servo motor is used for the actuator for rotating the stimulating elements 11, 12, ..., 132.
  • the maximum output torque of this servomotor is 0.2 Nm, which is sufficient to deform the skin on the back.
  • the stimulating elements 11, 12, ..., 132 are controlled to rotate at a rotation angle of 30 degrees and a rotation speed of 60 degrees / sec.
  • the present inventor has experimentally confirmed that a mechanical distribution that generates a physical sensation can be formed on the skin by appropriately controlling the rotation angle and rotation direction of the stimulating elements 11, 12, ..., 1n. In this case, not only the rotation angle but also the time until the rotation angle is reached may be included in the control parameter.
  • the body movement can be taught accurately and efficiently by stimulating the user's skin by rotational movement and controlling the angle and direction of the rotation.
  • the control unit 30 may control the stimulating elements 11, 12, ..., 1n so that the larger the target force sense, the larger the rotation angle of the stimulating elements 11, 12, ..., 1n.
  • the present inventor has found that the magnitude of the desired force sensation (that is, the intensity of activity based on motion) and the strain energy density often have a positive correlation. It can also be seen that the strain energy density and the rotation angles of the stimulating elements 11, 12, ..., 1n also have a positive correlation. Therefore, the larger the target force sense, the larger the rotation angle of the stimulating elements 11, 12, ..., 1n.
  • the stimulating elements 11, 12, ..., 1n By controlling the stimulating elements 11, 12, ..., 1n, the physical sensation is induced. be able to.
  • stimulating elements 11, 12, ..., 1n that stimulate the skin by rotational movement are used to appropriately control the rotational speed and rotational direction of these stimulating elements to generate physical sensations.
  • a mechanical distribution may be formed on the skin. In this case, not only the rotation speed but also the time until the rotation speed is reached may be included in the control parameter.
  • the body movement can be taught accurately and efficiently by stimulating the user's skin by rotational movement and controlling the speed and direction of the rotation.
  • the control unit 30 increases the target force sense (that is, the intensity of the activity based on the movement), the stimulation elements 11, 12, ..., The stimulation elements 11, 12, ... 1n may be controlled. It can also be seen that the strain energy density has a positive correlation with the rotational speeds of the stimulating elements 11, 12, ..., 1n. Therefore, the greater the target force sensation, the greater the rotational speed of the stimulating elements 11, 12, ..., 1n. By controlling the stimulating elements 11, 12, ..., 1n, the physical sensation is induced. be able to.
  • stimulating elements 11, 12, ..., 1n that stimulate the skin by rotational movement are used to appropriately control the rotational torque and rotational direction of these stimulating elements to generate bodily sensations.
  • a mechanical distribution may be formed on the skin. In this case, not only the rotational torque but also the time until the rotational torque is reached may be included in the control parameters.
  • the body movement can be taught accurately and efficiently by stimulating the user's skin by rotational movement and controlling the torque and direction of the rotation.
  • the control unit 30 increases the rotational torque of the stimulating elements 11, 12, ...,
  • the greater the target force sense that is, the intensity of the activity based on the movement
  • the greater the stimulating elements 11, 12, ... 1n may be controlled.
  • the strain energy density has a positive correlation with the rotational torque of the stimulating elements 11, 12, ..., 1n. Therefore, the larger the target force sense, the larger the rotational torque of the stimulating elements 11, 12, ..., 1n.
  • control is performed based on the rotation angle and the rotation speed, the control becomes inaccurate.
  • control is performed based on the rotational torque, accurate control is possible even if the user moves and the stimulation electrode and the user's skin slip or slip.
  • the spacing between adjacent stimulating elements may be such that the ranges of force sense presented by the adjacent stimulating elements overlap.
  • the present inventor has found that spatially continuous force sensation can be more reliably presented by providing such an interval between adjacent stimulating elements.
  • the stimulator was placed on the skin close to the surface of the muscles of the user's thighs and lower legs.
  • the stimulating element is not limited to this, and the stimulating element may be placed at any site in the vicinity of the muscles that control movement, such as the user's upper arm, forearm, wrist, finger, ankle, toe, neck, torso, and lumbar region. .. According to this embodiment, the range of application to the body part of the user can be expanded.
  • the stimulating element may stimulate the skin by electrical stimulation in addition to rotational movement. That is, the stimulating element combines rotational motion stimulus and electrical stimulus to form a force sensation on the skin that generates a more realistic sensation of physical motion. According to this embodiment, it is possible to accurately teach physical exercise.
  • FIG. 7 shows a functional block of the exercise teaching system 4 according to the twelfth embodiment.
  • the motion teaching system 4 includes a motion teaching device 1 according to the first embodiment and a motion instructor motion measuring device 60.
  • the motion instructor motion measuring device 60 measures the body motion information of the motion instructor in real time.
  • the body movement information acquisition unit 20 acquires information on the body movement of the movement instructor from the movement instructor movement measuring device 60.
  • the motion instructor motion measuring device 60 is, for example, a biosensor attached to various parts of the body of the motion instructor.
  • the control unit 30 forms a mechanical distribution on the user's skin based on the body movement information of the motion instructor that the body movement information acquisition unit 20 acquires from moment to moment.
  • the motion teaching device is not limited to this, and the motion teaching device may be any of the above-described embodiments.
  • the physical motion information of the motion instructor may include the myoelectric potential, muscle tension, skin deformation, etc. of the motion instructor.
  • the motion instructor motion measuring device 60 includes a myoelectric potential sensor, a muscle strength measuring device, a skin strain measuring device, and the like. According to this embodiment, it is possible to acquire the body movement information of the motion instructor from various biological information.
  • FIG. 8 shows a functional block of the exercise teaching system 5 according to the fourteenth embodiment.
  • the motion teaching system 5 includes a motion teaching device 1 according to the first embodiment, a motion instructor motion measuring device 60, and a user motion measuring device 70.
  • the user motion measuring device 70 measures the user's physical motion information in real time.
  • the body movement information acquisition unit 20 is a stimulus element 11 based on the difference between the body movement information of the movement teacher measured by the movement teacher movement measuring device 60 and the body movement information of the user measured by the user movement measuring device 70. , 12, ..., 1n is controlled.
  • the user motion measuring device 70 is, for example, a biosensor attached to various parts of the user's body.
  • the control unit 30 forms a mechanical distribution on the skin of the user based on the difference in physical movement between the motion teacher and the user, which changes from moment to moment. As a result, the user can acquire the target physical exercise while modifying his / her own physical exercise with respect to the physical exercise of the motion instructor as a model.
  • the motion teaching system 5 has described an example including the motion teaching device 1, the motion teaching device is not limited to this, and the motion teaching device may be any of the above-described embodiments.
  • the control unit 30 allows the user to perform muscle activity so that the difference between the physical motion information of the motion instructor measured by the motion instructor motion measuring device 60 and the physical motion information of the user measured by the user motion measuring device 70 becomes small.
  • the stimulating elements 11, 12, ..., 1n are controlled so as to form a mechanical distribution on the skin that generates a force sensation. That is, the control unit 30 forms a mechanical distribution on the user's skin that generates a physical sensation that causes the user to move muscles stronger or faster in order to bring the user's physical movement closer to that of the motion teacher. do. This allows the user to master the target physical movement by modifying his or her physical movement to move the muscles stronger or faster with respect to the physical movement of the model motion teacher. ..
  • the control unit 30 allows the user to perform muscle activity so that the difference between the physical motion information of the motion instructor measured by the motion instructor motion measuring device 60 and the physical motion information of the user measured by the user motion measuring device 70 becomes small.
  • the stimulating elements 11, 12, ..., 1n are controlled so as to form a mechanical distribution on the skin that generates a force sensation that causes the body to rest. That is, in order to bring the user's physical movement closer to the physical movement of the motion instructor, the control unit 30 applies a mechanical distribution on the user's skin to generate a physical sensation that causes the muscle currently being exercised by the user to stand still. Form.
  • the user can acquire the target physical movement by modifying his / her own physical movement so as to keep the muscles stationary with respect to the physical movement of the motion instructor as a model.
  • FIG. 9 shows a functional block of the exercise teaching system 6 according to the 17th embodiment.
  • the motion teaching system 6 includes a motion teaching device 1 according to the first embodiment, a motion teacher motion measuring device 60, a learning unit 80, and a mechanical distribution estimation unit 21.
  • the learning unit 80 has two operation modes, that is, a first operation mode and a second operation mode.
  • the first operation mode is the learning mode
  • the second operation mode is the control mode.
  • the learning unit 80 uses a large amount of physical motion information of the motion instructor and the mechanical distribution of the skin of the motion instructor estimated by the mechanical distribution estimation unit 21 from the physical motion information as learning data.
  • Machine learning is a large amount of physical motion information of the motion instructor and the mechanical distribution of the skin of the motion instructor estimated by the mechanical distribution estimation unit 21 from the physical motion information as learning data.
  • the mechanical distribution may be directly observed using a myoelectric sensor or the like as a motion instructor motion measuring device, or may be estimated by a finite element method or the like from the state of skin deformation.
  • the learning unit 80 is mechanically estimated based on the learning result when the body movement information of the movement teacher acquired by the body movement information acquisition unit 20 from the movement teacher movement measuring device 60 is input.
  • the distribution is output to the control unit 30.
  • the control unit 30 controls each stimulating element on the user's skin to form the mechanical distribution on the user's skin, and induces the user to have a physical sensation of the motion instructor.
  • the conversion from the mechanical distribution to the controlled variable of each stimulus element is performed using a table in which the relationship between the two is previously tabulated.
  • Machine learning may be performed by a known AI.
  • the specific method of AI is not particularly limited, but for example, a convolutional neural network (CNN), a recursive neural network (RNN), an LSTM network (Long Short Term Memory), etc.
  • CNN convolutional neural network
  • RNN recursive neural network
  • LSTM Long Short Term Memory
  • different neural networks may be mixed for each calculation model after sharing the input layer.
  • a large number of pairs of the presented force sense and the mechanical distribution that generates the force sense are prepared, and AI is made to learn these as learning data.
  • the AI can output a mechanical distribution that generates a desired force sensation when the body movement information of the motion instructor is input.
  • FIG. 10 shows a functional block of the exercise teaching system 7 according to the eighteenth embodiment.
  • the motion teaching system 7 includes a motion teaching device 1 according to the first embodiment, a motion instructor motion measuring device 60, a camera 90, and a display device 92.
  • the camera 90 captures the physical movement of the motion instructor.
  • the display device 92 is a wearable display device that displays an image taken by the camera 90 to the user.
  • the camera 90 may be, for example, a high-definition camera or a stereo camera.
  • the display device 92 may be, for example, an HMD (head-mounted display). According to the present embodiment, by using the skin stimulation by the stimulating elements 11, 12, ..., 1n and the visual stimulation by the display device 92 in combination, it is possible to teach the physical sensation with a higher sense of presence.
  • FIG. 11 shows a functional block of the exercise teaching system 8 according to the nineteenth embodiment.
  • the motion teaching system 8 includes a motion teaching device 1 according to the first embodiment, a motion instructor motion measuring device 60, a microphone 94, and a reproduction device 96.
  • the microphone 94 records the voice accompanying the physical exercise of the motion instructor.
  • the reproduction device 96 is a wearable reproduction device that reproduces the voice recorded by the microphone 94 to the user.
  • the microphone 94 may be a stereo microphone such as a binaural microphone.
  • the playback device 96 may be, for example, headphones. According to the present embodiment, by using the skin stimulation by the stimulating elements 11, 12, ..., 1n and the auditory stimulation by the regenerating device 96 in combination, it is possible to teach the physical sensation with a higher sense of presence.
  • FIG. 12 shows a processing flow of the exercise teaching method according to the twentieth embodiment.
  • This motion teaching method uses step S1 to acquire information on the body movement of the motion instructor and a plurality of stimulating elements arranged on the skin close to the surface of the user's muscle, and the surface of the user's muscle.
  • the step S2 which stimulates the skin in the vicinity of the skin, is provided.
  • the plurality of stimulating elements form a mechanical distribution on the skin that generates a desired force sensation based on body movement information.
  • the interval between the adjacent stimulating elements is an interval capable of teaching a spatially continuous force sense. Force sensation induces the user to feel the physical sensation when the motion instructor is performing physical exercise.
  • this exercise teaching method acquires information on the physical exercise of the motion instructor.
  • the physical exercise of the motion instructor is the exercise of the muscles when the motion instructor performs the technique, and serves as a model for the user.
  • the information stored in advance in the storage device or the like may be acquired, or the actual physical exercise of the motion instructor may be acquired in real time.
  • this exercise teaching method stimulates the skin close to the surface of the user's muscle by using a plurality of stimulating elements arranged on the skin close to the surface of the user's muscle.
  • the method of stimulating the skin by the stimulating element may be a mechanical method such as rotational movement, pulling in the shear direction, compression, or suction.
  • Each stimulating element may be capable of presenting a sense of force by itself. Alternatively, it may be possible to present a sense of force only when a plurality of stimuli jointly form a predetermined mechanical distribution.
  • the interval between adjacent stimulating elements is an interval that can present a spatially continuous force sense. If the distance between the stimulating elements is too large, the force sense becomes spatially discontinuous. In this case, it is not possible to form a mechanical distribution on the skin that produces the desired force sensation.
  • the spacing between adjacent stimulating elements may be, for example, such that the ranges of force sense presented by the adjacent stimulating elements overlap. Alternatively, the spacing between adjacent stimulating elements may be within the range of the two-point discrimination threshold in the area of the skin.
  • the force sense induces the user to feel the physical sensation when the motion instructor is performing physical exercise. That is, by the force sensation presented by this movement teaching method, the user should move which muscle with what strength in order to reproduce the body movement of the movement teacher (that is, to perform the ideal body movement). You can get a good feeling, including the change over time.
  • the physical exercise of the motion instructor can be accurately taught to the user.
  • the 21st embodiment is a program. This program causes a computer to execute the exercise teaching method according to the twentieth embodiment described above. According to this embodiment, it is possible to realize teaching of physical exercise with high reality as software.
  • the mechanical distribution formed on the skin by the stimulating element may be a strain energy density distribution.
  • the mechanical distribution may be a strain distribution, which strain may be the principal strain or the equivalent strain.
  • the mechanical distribution may be a force distribution, which may be a shear force or a normal force.
  • the mechanical distribution may be a stress distribution, which stress may be either pressure, principal stress or von Mises stress.
  • the present invention can be industrially used as an exercise teaching device, an exercise teaching system, an exercise teaching method and a program.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Human Computer Interaction (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Biomedical Technology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Rehabilitation Tools (AREA)
PCT/JP2021/046747 2020-12-28 2021-12-17 運動教示装置、運動教示システム、運動教示方法およびプログラム WO2022145258A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022572995A JPWO2022145258A1 (enrdf_load_stackoverflow) 2020-12-28 2021-12-17

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-219284 2020-12-28
JP2020219284 2020-12-28

Publications (1)

Publication Number Publication Date
WO2022145258A1 true WO2022145258A1 (ja) 2022-07-07

Family

ID=82259330

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/046747 WO2022145258A1 (ja) 2020-12-28 2021-12-17 運動教示装置、運動教示システム、運動教示方法およびプログラム

Country Status (2)

Country Link
JP (1) JPWO2022145258A1 (enrdf_load_stackoverflow)
WO (1) WO2022145258A1 (enrdf_load_stackoverflow)

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000501033A (ja) * 1995-11-30 2000-02-02 ヴァーチャル テクノロジーズ インコーポレイテッド 触覚をフィードバックする人間／機械インターフェース
JP2001166676A (ja) * 1999-12-09 2001-06-22 Sony Corp 触覚提示機構及びこれを用いた力触覚提示装置
WO2009035100A1 (ja) * 2007-09-14 2009-03-19 National Institute Of Advanced Industrial Science And Technology バーチャルリアリティ環境生成装置及びコントローラ装置
JP2017504443A (ja) * 2013-10-29 2017-02-09 コウアヒェ, ノルディンKouache, Nordin 人体に触覚指示を伝達するための方法およびシステム
WO2017213202A1 (ja) * 2016-06-08 2017-12-14 株式会社国際電気通信基礎技術研究所 運動教示システム及び運動教示方法
JP2018008250A (ja) * 2016-07-15 2018-01-18 国立大学法人電気通信大学 力覚及び振動覚提示装置
WO2019010435A1 (en) * 2017-07-06 2019-01-10 Icuemotion Llc SYSTEMS AND METHODS FOR TRAINING SKILL TRAINING WITH DATA
US20190019431A1 (en) * 2017-07-13 2019-01-17 Kabushiki Kaisha Toshiba Information processing device, method, and storage medium
JP2019070987A (ja) * 2017-10-11 2019-05-09 国立研究開発法人産業技術総合研究所 身体動きガイドシステム、刺激呈示装置、刺激呈示方法およびプログラム
US20190283247A1 (en) * 2018-03-15 2019-09-19 Seismic Holdings, Inc. Management of biomechanical achievements
US20200237031A1 (en) * 2019-01-13 2020-07-30 Kinaptic, LLC Fabric, Connections and Functional Structures for Wearable Electronic Garments and Applications for the Same
WO2021049296A1 (ja) * 2019-09-09 2021-03-18 国立研究開発法人科学技術振興機構 力覚提示装置及び力覚提示方法

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000501033A (ja) * 1995-11-30 2000-02-02 ヴァーチャル テクノロジーズ インコーポレイテッド 触覚をフィードバックする人間／機械インターフェース
JP2001166676A (ja) * 1999-12-09 2001-06-22 Sony Corp 触覚提示機構及びこれを用いた力触覚提示装置
WO2009035100A1 (ja) * 2007-09-14 2009-03-19 National Institute Of Advanced Industrial Science And Technology バーチャルリアリティ環境生成装置及びコントローラ装置
JP2017504443A (ja) * 2013-10-29 2017-02-09 コウアヒェ, ノルディンKouache, Nordin 人体に触覚指示を伝達するための方法およびシステム
WO2017213202A1 (ja) * 2016-06-08 2017-12-14 株式会社国際電気通信基礎技術研究所 運動教示システム及び運動教示方法
JP2018008250A (ja) * 2016-07-15 2018-01-18 国立大学法人電気通信大学 力覚及び振動覚提示装置
WO2019010435A1 (en) * 2017-07-06 2019-01-10 Icuemotion Llc SYSTEMS AND METHODS FOR TRAINING SKILL TRAINING WITH DATA
US20190019431A1 (en) * 2017-07-13 2019-01-17 Kabushiki Kaisha Toshiba Information processing device, method, and storage medium
JP2019070987A (ja) * 2017-10-11 2019-05-09 国立研究開発法人産業技術総合研究所 身体動きガイドシステム、刺激呈示装置、刺激呈示方法およびプログラム
US20190283247A1 (en) * 2018-03-15 2019-09-19 Seismic Holdings, Inc. Management of biomechanical achievements
US20200237031A1 (en) * 2019-01-13 2020-07-30 Kinaptic, LLC Fabric, Connections and Functional Structures for Wearable Electronic Garments and Applications for the Same
WO2021049296A1 (ja) * 2019-09-09 2021-03-18 国立研究開発法人科学技術振興機構 力覚提示装置及び力覚提示方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
HIYAMA ATSUSHI: "Artisan skill training system using multisensory experience data from first-person standpoint", TRANSACTIONS OF THE VIRTUAL REALITY SOCIETY OF JAPAN, vol. 16, no. 4, 1 January 2011 (2011-01-01), pages 643 - 652, XP055948025, DOI: 10.18974/tvrsj.16.4_643 *

Also Published As

Publication number Publication date
JPWO2022145258A1 (enrdf_load_stackoverflow) 2022-07-07

Similar Documents

Publication Publication Date Title
JP7169590B2 (ja) 錯触力覚を誘起する方法及び錯触力覚を誘起する装置
Yem et al. Wearable tactile device using mechanical and electrical stimulation for fingertip interaction with virtual world
Bark et al. Effects of vibrotactile feedback on human learning of arm motions
Sigrist et al. Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning
Alahakone et al. Vibrotactile feedback systems: Current trends in rehabilitation, sports and information display
Quek et al. Augmentation of stiffness perception with a 1-degree-of-freedom skin stretch device
Lieberman et al. TIKL: Development of a wearable vibrotactile feedback suit for improved human motor learning
Huang et al. Recent developments in biofeedback for neuromotor rehabilitation
Stanley et al. Design of body-grounded tactile actuators for playback of human physical contact
Sisto et al. Virtual reality applications for motor rehabilitation after stroke
Barzilay et al. Adaptive rehabilitation games
Turolla et al. Haptic‐Based Neurorehabilitation in Poststroke Patients: A Feasibility Prospective Multicentre Trial for Robotics Hand Rehabilitation
Lieberman et al. Development of a wearable vibrotactile feedback suit for accelerated human motor learning
Takhashi et al. Development of an upper limb patient simulator for physical therapy exercise
JP7627059B2 (ja) 力覚提示装置及び力覚提示方法
Kurita et al. Stiffness display by muscle contraction via electric muscle stimulation
Hirao et al. Leveraging tendon vibration to enhance pseudo-haptic perceptions in VR
Lee et al. Effects of visual feedback on out-of-body illusory tactile sensation when interacting with augmented virtual objects
WO2022145258A1 (ja) 運動教示装置、運動教示システム、運動教示方法およびプログラム
Robertson et al. Augmented feedback, virtual reality and robotics for designing new rehabilitation methods
Umesawa et al. Development and evaluation of a device for inducing kinesthetic illusion of dual joint movements
Chamnongthai et al. Fingertip force learning with enhanced haptic sensation using stochastic resonance
Nakamura et al. Perceptual force on the wrist under the hanger reflex and vibration
Bergamasco et al. Haptic interfaces for embodiment in virtual environments
Cibulskis et al. Tendon Vibration for Creating Movement Illusions in Virtual Reality

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21915118

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022572995

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21915118

Country of ref document: EP

Kind code of ref document: A1