JP7419616B2 - Measurement systems, methods and programs - Google Patents

Description

The present disclosure relates to a measurement system, method, and program.

It is expected that the average lifespan of humans will increase and the population will continue to age. It is becoming increasingly important for humans to maintain their health. In order to maintain health, adjusting your walking posture will allow your body to function at its full potential. In addition, by adjusting the walking posture, it is possible to walk without putting an excessive burden on the body, and it is possible to prevent people from accumulating fatigue.

Furthermore, by adjusting the walking posture, it is possible to give the impression of ``walking beautifully''. In other words, by avoiding unnecessary movements as much as possible so that the body can perform its functions, it can become a beautiful walking posture.

As a technique for analyzing walking posture, there is Japanese Patent Application Publication No. 2018-69035 (Patent Document 1).

Patent Document 1 describes that as the elderly population increases, an objective evaluation standard for determining the average age level (walking age) of walking ability is provided. Patent Document 1 describes a gait analysis system that analyzes lateral differences in gait speed and gait rhythm to calculate gait age.

Unexamined Japanese Patent Publication No. 2018-69035

However, the technique disclosed in Patent Document 1 only calculates the walking age and outputs the calculation result. Therefore, with the technique of Patent Document 1, even if it is possible to evaluate the current state of the user's walking posture, it remains difficult to obtain guidelines for how the user should change the walking posture.

Therefore, in the present disclosure, a technique is provided that encourages a user to maintain a beautiful walking posture and make it easier to perform bodily functions.

According to one embodiment, a measurement system is provided for measuring body movements of a user. The measurement system includes a control unit and a measurement unit for measuring the movement of the user's whole body including the limbs. a step in which the control unit causes the measurement unit to measure the movement of the user's whole body during the walking motion; a step in which the control unit identifies a plurality of stages constituting a cycle of the user's walking motion based on the measurement results; For each step, the posture during walking is evaluated based on the measurement results of each step, and the evaluation results for each of the plurality of steps are presented to the user.

According to the present disclosure, by presenting the user with evaluation results for each stage of the cycle of the user's walking motion, it is possible to encourage the user to improve his or her walking posture.

1 is a diagram showing the overall configuration of a measurement system 1. FIG. FIG. 2 is a block diagram of a terminal device 10 that constitutes the measurement system 1 of the first embodiment. 2 is a diagram showing a functional configuration of a server 20. FIG. 3 is a diagram showing data structures of a user information database 281, measurement item information 282, measurement history database 283, and friend list 284 stored in the server 20. FIG. A situation in which a user measures body movements using the measurement system 1 is shown. 3 is a diagram showing details of a mat 32. FIG. It is a flowchart which shows the process by which the terminal device 10 performs a ROM check and updates a measurement history. 2 is a flowchart illustrating a process in which the terminal device 10 evaluates joint range of motion by measuring the movement of the user's foot. 2 is a flowchart illustrating a process in which the terminal device 10 evaluates joint range of motion by measuring the user's upper body twisting motion. FIG. 4 is a diagram illustrating an example of notification content from the terminal device 10 in a situation where the user's body movement is measured. A situation in which a user's walking motion is measured by the measurement system 1 in the second embodiment is shown. Each part of the user's body identified by the terminal device 10 is shown based on the measurement results of the measuring device 31. It is a figure which shows the data structure of the measurement result database 287 and the evaluation result database 288 which the server 20 in 2nd Embodiment stores. It is a flowchart which shows the process which the terminal device 10 measures and evaluates a user's walking motion in 2nd Embodiment. FIG. 7 is a diagram illustrating an example of output when the terminal device 10 outputs a measurement result of measuring a user's walking motion and an evaluation result of evaluating the user's walking motion based on the measurement result in the second embodiment. FIG. 7 is a diagram illustrating an example of output when the terminal device 10 outputs a measurement result of measuring a user's walking motion and an evaluation result of evaluating the user's walking motion based on the measurement result in the second embodiment. 5 is a diagram illustrating an example in which the terminal device 10 outputs an evaluation result of the burden on the knee during the user's walking motion. FIG. This corresponds to step S1409 in FIG. 12 is a flowchart showing a process in which the terminal device 10 measures and evaluates the balance of the user's trunk in the third embodiment. FIG. 7 is a diagram showing an example in which the terminal device 10 outputs a measurement result of measuring the balance of the user's trunk and an evaluation result of the balance of the trunk in the third embodiment. It is a figure which shows the data structure of various data which the server 20 in 3rd Embodiment stores. This is an example of a screen in which the terminal device 10 presents possible troubles to the user's body based on measurement results and evaluation results of the user's body movements, and proposes an exercise menu corresponding to the troubles.

Embodiments of the present invention will be described below with reference to the drawings. In the following description, the same parts are given the same reference numerals. Their names and functions are also the same. Therefore, detailed descriptions thereof will not be repeated.

<First embodiment>
<Summary>
In the following embodiments, the flexibility of the user's body is evaluated by measuring the balance of the user's body and the movement of the user's body, and an exercise menu is provided to help the user acquire a beautiful posture (for example, a beautiful walking posture). The measurement system 1 for providing the following will be explained.

If the user's walking posture is not correct, the user will perform movements that are not necessarily necessary for walking, and the user's strength will be consumed unnecessarily, making it easy for the user to accumulate fatigue. By improving the user's walking posture, the user can move his or her body functionally, and as a result, the user can walk with less fatigue. Therefore, the measurement system 1 (1) measures the user's walking movements and evaluates the walking posture (evaluates whether the user is able to walk beautifully and with good balance), and (2) measures the user's movements while walking. Performs a ROM check that measures joint flexibility and evaluates joint range of motion (ROM: Range of motion); and (3) evaluates the user's muscle strength status and provides a training menu. .

If the user can walk in a well-balanced manner (the left and right movements of the body are not biased, the movement of muscles during walking is ideal, etc.), the way the user moves the body is functional. Here, the functional way of movement means that the user is able to move his muscles for walking without consuming unnecessary force. In other words, the user moves his/her muscles to obtain propulsive force for walking, and muscle movements lead to propulsive force with high efficiency. As a result, it is possible to give the impression that the user is walking beautifully. In order for users to learn how to walk in a well-balanced manner, it is effective to evaluate joint range of motion, and measurement system 1 not only evaluates joint range of motion but also uses the results of these joint range of motion evaluations. Based on this assumption, the user is also provided with muscle training necessary to make their walking posture look beautiful.

As described above, the measurement system 1 provides measurement (check) of the movement of the user's body and exercises for moving the user's body.

The measurement system 1 can be installed, for example, in a business office of a business company, in a commercial facility, in a store space, in a studio, in an individual's home, or the like. For example, a business company may introduce the measurement system 1 to further encourage employees to manage their health. Furthermore, by deploying the measurement system 1 at a store in a commercial facility, health management services may be provided to consumers.

<1 Configuration diagram of the entire system>
FIG. 1 is a diagram showing the overall configuration of a measurement system 1. As shown in FIG.

As shown in FIG. 1, the measurement system 1 includes a plurality of measurement units (in the illustrated example, measurement units 30A, 30B, and 30C are shown) configured by various sensors that measure the movement of the user's body. Each measurement unit is sometimes referred to as a "measurement unit 30"), a terminal device 10 that controls the operation of the measurement unit, and a server 20 that accumulates the measurement results of the user's body movements. .

The measurement unit 30 is connected to the terminal device 10 by wire or wirelessly. As shown in the figure, a plurality of measurement units 30 may be connected to one terminal device 10, or one terminal device 10 may be connected to each measurement unit 30 (that is, one measurement unit 30 may be connected to one terminal device 30). It is also possible to prepare two terminal devices 10 and measure users.

The measuring unit 30 includes measuring devices (in the illustrated example, measuring devices 31A, 31B, and 31C are shown. These may be collectively referred to as "measuring devices 31"), and a mat (in the illustrated example, measuring devices 31A, 31B, and 31C are shown. , mats 32A, 32B, and 32C (these may also be collectively referred to as "mats 32"), and poles that are three-dimensional objects (in the illustrated example, poles 33A, 33B, and 33C are shown). These are sometimes collectively referred to as "Paul 33").

The measuring device 31 is for measuring the movement of the user's body, and detects the distance and direction to the object to be measured using, for example, an RGB-D camera (depth sensor). The measurement device 31 may also include a microphone array or the like to detect the user's voice, the direction from which the voice is coming, and the like. For example, the measuring device 31 may be a device, such as a Kinect (registered trademark), that can accept gestures and voice recognition operations from the user. The measuring device 31 detects the user's position and the position of each joint of the user's body by detecting the user's body. Thereby, the measuring device 31 measures the movement of the user's body by setting a virtual bone that virtually connects the joints that make up the user. Furthermore, the measuring device 31 may be a terminal such as a smartphone, in addition to Kinect (registered trademark). For example, if a smartphone is equipped with a depth camera, the smartphone can acquire the user's body as point cloud data.

Furthermore, even if the measuring device 31 does not have a function to measure distance, it can identify the subject based on the captured image and use a trained model to estimate the distance between the subject and the camera. The distance to the subject (for example, the distance to each joint of the subject) may be acquired based on the following. Furthermore, even when the measuring device 31 cannot measure distance (such as an RGB camera), each part of the subject may be identified based on the photographed image and the skeleton (bone) may be estimated. Furthermore, the distance to the subject may be estimated by providing a plurality of cameras as the measuring device 31 and obtaining captured images with parallax.

The mat 32 is for displaying an approximate position of the user in order to measure the movement of the user's body. The mat 32 is placed at a position having a predetermined positional relationship with respect to the measuring device 31. That is, the mat 32 is placed within a range where the measuring device 31 can measure the movement of the user's body. The mat 32 includes a plurality of patterns for guiding the user's standing position, as will be described later. The user adjusts the position of the foot or takes a step while visually recognizing the pattern.

The pole 33 is used in conjunction with the mat 32 to measure the movement of the user's body, for example, the twisting movement of the user's body. The pole 33 is placed on the mat 32 at a position associated with a pattern that is a guideline for the standing position where the user's feet are placed. While keeping both feet on the mat 32 (that is, without moving the standing position of both feet), the user twists his body and moves to touch a pair of poles placed on both sides of the mat 32 with his hands. Therefore, the mat 32 is used as a target point for moving the user's arm in order to perform a body twisting motion. The mat 32 may be set at a height that corresponds to the user's height so that the user can grasp it with his/her hand when twisting the user's body.

As mentioned above, the combination of the measuring device 31, the mat 32, and the pole 33 that constitute the measuring unit 30 has been described. In the following description, it is assumed that one user uses one measurement unit 30. However, one measurement device 31 may be used to measure the body movements of a plurality of users. That is, a plurality of users may move their bodies within the measurement range of one measuring device 31.

The terminal device 10 and the server 20 are communicatively connected via a network 80. Furthermore, in this embodiment, each device (terminal device, server, etc.) can also be understood as an information processing device. That is, a collection of devices can be understood as one "information processing device", and the measurement system 1 may be formed as a collection of a plurality of devices. How to allocate the multiple functions required to realize the measurement system 1 according to this embodiment to one or more pieces of hardware depends on the processing capacity of each piece of hardware and/or the specifications required for the measurement system 1, etc. It can be determined as appropriate in view of the above.

The terminal device 10 is a device operated by each user. The terminal device 10 may be, for example, a stationary PC (Personal Computer) or a laptop PC. In addition, the terminal device 10 is realized by a mobile terminal such as a smartphone or a tablet that is compatible with a mobile communication system. As shown as a terminal device 10B in FIG. 1, the terminal device 10 includes a communication IF (Interface) 12, an input device 13, an output device 14, a memory 15, a storage section 16, and a processor 19. The server 20 includes a communication IF 22 , an input/output IF 23 , a memory 25 , a storage 26 , and a processor 29 .

The terminal device 10 is communicably connected to the server 20 via the network 80. The terminal device 10 is compatible with communication standards such as 5G and LTE (Long Term Evolution), and wireless LAN (Local Area Network) standards such as IEEE (Institute of Electrical and Electronics Engineers) 802.11, and is compatible with communication equipment. It is connected to the network 80 by communicating with.

The communication IF 12 is an interface for inputting and outputting signals so that the terminal device 10 communicates with an external device. The input device 13 is an input device (for example, a touch panel, a touch pad, a pointing device such as a mouse, a keyboard, etc.) for receiving input operations from a user. The output device 14 is an output device (display, speaker, etc.) for presenting information to the user. The memory 15 is for temporarily storing programs and data processed by the programs, and is a volatile memory such as DRAM (Dynamic Random Access Memory). The storage unit 16 is a storage device for storing data, and is, for example, a flash memory or an HDD (Hard Disc Drive). The processor 19 is hardware for executing a set of instructions written in a program, and is composed of an arithmetic unit, registers, peripheral circuits, and the like.

As illustrated, the terminal device 10 is connected to the measurement unit 30 by wire or wirelessly. By measuring the movement of the user's body by the measurement unit 30, it is possible to evaluate the flexibility of the user's body and the extent of joint range of motion.

The server 20 manages information about each user. The server 20 manages, as user information, parameters (for example, height) that are referred to when measuring the body movements of each user.

Specifically, the server 20 performs user matching, etc. in order to support multiple users in moving their bodies for health management and measuring their body movements as a process for promoting interaction between users. I do. Additionally, the server 20 transmits and receives messages between users.

The server 20 may manage virtual points held by each user. For example, suppose that a business company has an in-house point system that each employee can use like virtual currency. The points can be used like virtual currency for purchasing within the company (for example, they can be used for payments at in-house vending machines, etc.), or can be given to other employees. For example, when a user takes a measurement using the measurement system 1, the server 20 may give the points to the user, or when the user takes a measurement together with other users using the measurement system 1 (for example, the same Measurements may be taken at different locations, measurements taken at the same location at the same time, etc.), and the points may be given to the user, or the points may be given when the joint range of motion evaluation result exceeds a predetermined value. Good too.

The communication IF 22 is an interface for inputting and outputting signals so that the server 20 communicates with external devices. The input/output IF 23 functions as an interface with an input device for accepting input operations from a user and an output device for presenting information to the user. The memory 25 is for temporarily storing programs and data processed by the programs, and is a volatile memory such as DRAM (Dynamic Random Access Memory). The storage 26 is a storage device for storing data, and is, for example, a flash memory or an HDD (Hard Disc Drive). The processor 29 is hardware for executing a set of instructions written in a program, and is composed of an arithmetic unit, registers, peripheral circuits, and the like.

<1.1 Configuration of terminal device 10>
FIG. 2 is a block diagram of the terminal device 10 that constitutes the measurement system 1 of the first embodiment. As shown in FIG. 2, the terminal device 10 includes a plurality of antennas (an antenna 111, an antenna 112), a wireless communication section (a first wireless communication section 121, a second wireless communication section 122) corresponding to each antenna, and an operation A reception unit 130 (includes a touch sensitive device 131; may also include various pointing devices such as a mouse and a touch pad, or may include a keyboard and a gesture detection device), and a display 132 , an audio processing section 140 , a microphone 141 , a speaker 142 , a position information sensor 150 , a camera 160 , a storage section 180 , and a control section 190 . The terminal device 10 also has functions and configurations that are not particularly illustrated in FIG. 2 (for example, a battery for holding power, a power supply circuit that controls the supply of power from the battery to each circuit, etc.). As shown in FIG. 2, each block included in the terminal device 10 is electrically connected by a bus or the like.

The antenna 111 radiates a signal emitted by the terminal device 10 as a radio wave. Further, the antenna 111 receives radio waves from space and provides a received signal to the first wireless communication unit 121.

The antenna 112 radiates a signal emitted by the terminal device 10 as a radio wave. Further, the antenna 112 receives radio waves from space and provides a received signal to the second wireless communication unit 122.

The first wireless communication unit 121 performs modulation and demodulation processing for transmitting and receiving signals via the antenna 111 so that the terminal device 10 communicates with other wireless devices. The second wireless communication unit 122 performs modulation and demodulation processing for transmitting and receiving signals via the antenna 112 so that the terminal device 10 communicates with other wireless devices. The first wireless communication unit 121 and the second wireless communication unit 122 are communication modules including a tuner, an RSSI (Received Signal Strength Indicator) calculation circuit, a CRC (Cyclic Redundancy Check) calculation circuit, a high frequency circuit, and the like. The first wireless communication unit 121 and the second wireless communication unit 122 perform modulation, demodulation and frequency conversion of wireless signals transmitted and received by the terminal device 10 and provide received signals to the control unit 190.

The operation reception unit 130 has a mechanism for accepting user input operations. Specifically, the operation reception unit 130 includes a touch sensitive device 131 and the like as a pointing device. Touch sensitive device 131 receives input operations from the user of terminal device 10 . The touch sensitive device 131 uses, for example, a capacitive touch panel to detect the position of the user's touch on the touch panel. The touch sensitive device 131 outputs a signal indicating the user's touch position detected by the touch panel to the control unit 190 as an input operation. Note that the terminal device 10 may communicate with the measuring device 31 and receive the measurement results of the measuring device 31, thereby receiving input operations from the user. For example, when the measurement device 31 acquires point cloud data, it detects the user's body and each joint that makes up the user's body based on the point cloud data, and uses the user's gestures as input based on the detection results. accept. Gestures that can be input by the user include body movements such as hand movements and head movements. For example, the operation reception unit 130 may detect that the user takes a predetermined pose (raise both hands horizontally and take a "T"-shaped pose), or the operation reception unit 130 may detect that the user takes a predetermined pose with both hands raised horizontally, or that the user holds the hands in a predetermined shape. It is also possible to detect that the

The display 132 displays data such as images, videos, and text under the control of the control unit 190. The display 132 is realized by, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display. The terminal device 10 and the output device (display 132, speaker 142) may be realized as separate devices.

The audio processing unit 140 modulates and demodulates the audio signal. The audio processing unit 140 modulates the signal provided from the microphone 141 and provides the modulated signal to the control unit 190. The audio processing unit 140 also provides an audio signal to the speaker 142. The audio processing unit 140 is realized, for example, by a processor for audio processing. The microphone 141 receives a voice input and provides a voice signal corresponding to the voice input to the voice processing unit 140 . The speaker 142 converts the audio signal provided from the audio processing unit 140 into audio and outputs the audio to the outside of the terminal device 10 .

The position information sensor 150 is a sensor that detects the position of the terminal device 10, and is, for example, a GPS (Global Positioning System) module. A GPS module is a receiving device used in a satellite positioning system. The satellite positioning system receives signals from at least three or four satellites, and detects the current position of the terminal device 10 equipped with a GPS module based on the received signals. For example, in the measurement system 1, when recording the location where the user performed the measurement, the detection result of the location information sensor 150 (information on latitude and longitude, information on a facility specified by latitude and longitude and map information, information on a facility identified by the latitude and longitude and map information, (e.g., information on business establishments that can be used) may be stored in the server 20 in association with the measurement results. In other words, the terminal device 10 may determine the location where the user performed the measurement based on the detection result of the position information sensor 150 without the user inputting the location.

The camera 160 is a device that receives light with a light receiving element and outputs it as a photographed image. The camera 160 is, for example, a depth camera that can detect the distance from the camera 160 to the object to be photographed. In this embodiment, the measuring device 31 may be realized by the camera 160 of the terminal device 10. That is, in addition to realizing the terminal device 10 and the measuring device 31 as separate devices, the terminal device 10 may be equipped with the functions of the measuring device 31.

The storage unit 180 is configured with, for example, a flash memory, and stores data and programs used by the terminal device 10. In one aspect, the storage unit 180 stores user information 181, measurement item information 182, measurement history information 183, friend list 184, and training item information 185. The details of these will be described later, but the outline is as follows. The terminal device 10 may acquire this information from various databases of the server 20, which will be described later.

User information 181 is information about users in measurement system 1. The user information includes information that identifies the user, the user's name, the user's affiliation, the user's physical information (height, weight, age, etc.), and the like.

The measurement item information 182 is information on each measurement item when performing a ROM check. The measurement item information 182 includes information on an audio guide output to the user for each measurement item.

The measurement history information 183 indicates the history of measurement results obtained by measuring the user's body movements.

The friend list 184 shows information about users who are registered as friends. It is also possible to allow messages to be sent and received between users registered as friends.

Training item information 185 includes information on each training item when providing a muscle training menu to the user. For example, it includes the name of the training and video and audio information that serves as a guide for the user to move his or her body. The terminal device 10 uses the measuring device 31 to measure the movement of the user's body using video and audio as a guide, and sequentially displays the measurement results on the display 132. The terminal device 10 compares the ideal way of moving the body with the measurement results (movements of each joint) when the user moves the body on the display 132, and determines the ideal way of moving the body. It is also possible to prompt the user to do so.

The control unit 190 controls the operation of the terminal device 10 by reading a program stored in the storage unit 180 and executing instructions included in the program. Control unit 190 is, for example, an application processor. The control unit 190 functions as an input operation reception unit 191, a transmission/reception unit 192, a data processing unit 193, and a notification control unit 194 by operating according to a program.

The input operation reception unit 191 performs a process of accepting a user's input operation on an input device such as the touch sensitive device 131. The input operation reception unit 191 determines whether the user's operation is a flick operation, a tap operation, or a drag (swipe) operation based on the information of the coordinates where the user touches the touch sensitive device 131 with a finger or the like. Determine the type of operation, such as whether it is an operation.

The transmitting/receiving unit 192 performs processing for the terminal device 10 to transmit and receive data with external devices such as the server 20 and the measurement unit 30 according to a communication protocol.

The data processing unit 193 performs calculations on the data input by the terminal device 10 according to a program, and outputs the calculation results to a memory or the like.

The notification control unit 194 performs processes such as displaying a display image on the display 132 and outputting audio to the speaker 142. For example, when checking the ROM, the notification control unit 194 outputs an audio guide, and when providing a training menu for exercise, the notification control unit 194 outputs an audio guide and a video showing a model body movement to the user. present.

<1.2 Functional configuration of server 20>
FIG. 3 is a diagram showing the functional configuration of the server 20. As shown in FIG. 3, the server 20 functions as a communication section 201, a storage section 202, and a control section 203.

The communication unit 201 performs processing for the server 20 to communicate with an external device such as the terminal device 10.

The storage unit 202 stores data and programs used by the server 20. The storage unit 202 stores a user information database 281, measurement item information 282, a measurement history database 283, a friend list 284, and the like.

The user information database 281 shows information on each user who performs measurements using the measurement system 1. Details will be described later.

Measurement item information 282 indicates information on each of a plurality of measurement items. Details will be described later.

The measurement history database 283 shows the history of measurements performed by each user. Details will be described later.

The friend list 284 is a database for holding information on users registered as friends by each user.

The training item information 285 includes information on each training item when providing a training menu for exercise to the user. The training menu includes information on a plurality of training items depending on the load on the user's body, the body part to be trained, and the like.

The control unit 203 performs functions shown as various modules by the processor of the server 20 performing processing according to a program.

The operation content acquisition module 2041 acquires the user's operation content. The operation content acquisition module 2041 includes, for example, an operation for the user to acquire past measurement results by the measurement unit 30 and evaluation results of the user's body movements, an operation for sending and receiving messages with other users, and a measurement by the measurement unit 30. We accept operations to apply to participate in measurements when there is an opportunity to do so.

The reception control module 2042 controls the process by which the server 20 receives signals from an external device according to a communication protocol.

The transmission control module 2043 controls the process by which the server 20 transmits a signal to an external device according to a communication protocol.

Matching module 2044 matches users. For example, the matching module 2044 may detect that a plurality of users have taken measurements using the measurement system 1 at the same measurement venue, match the plurality of users, and prompt them to register as friends. Further, the matching module 2044 may extract and match users who have the same history of measurement by the measurement system 1, or may extract and match users whose ROM check results by the measurement unit 30 are similar. It is also possible to do so. By matching multiple users in this way and encouraging them to register as friends, it is possible to encourage multiple users to train together to achieve a beautiful posture, so measurement can be continued using the measurement system 1. can support.

The measurement progress module 2045 advances the process of measuring the movement of the user's body by the measurement unit 30. The measurement progress module 2045 reads out each measurement item shown in the measurement item information 282, and sequentially outputs to the user audio guidance for measurement according to the measurement item. For example, the server 20 may transmit each measurement item to the terminal device 10 and may sequentially measure the movement of the user's body according to each measurement item.

The training progress module 2046 advances the process of providing a training menu to the user through video and audio. The training progress module 2046 reads each training item shown in the training item information 285 and sequentially outputs to the user an audio guide, a video guide, etc. for training according to the training item.

<2 Data structure>
FIG. 4 is a diagram showing the data structure of the user information database 281, measurement item information 282, measurement history database 283, and friend list 284 stored in the server 20.

As shown in FIG. 4, each record of the user information database 281 includes the item "user identification information (user ID)", the item "user name", the item "gender", the item "height", and the item " ``Weight'', item ``affiliation'', item ``evaluation value'', item ``company points'', etc.

The item "user identification information (user ID)" is information that identifies each user.

The item "user name" is a name set by the user.

The item "gender" indicates the gender of the user. For example, when a user registers user information in order to start using the measurement system 1, the gender may be set.

The item "height" indicates the height of the user as information to be referred to when measuring the movement of the user's body.

The item "weight" indicates information about the user's weight. In cases where weight information is not referred to when measuring the user's body movements, data regarding the item "weight" may not be retained.

The item "Affiliation" indicates information about the user's affiliation, such as when the user belongs to an organization. For example, the item "Affiliation" includes information such as company name, organization name, office name, etc. The item "affiliation" may include information about the location of the office where the user works.

The item "evaluation value" includes information on an evaluation value evaluated based on a measurement result obtained by a user performing a ROM check in the measurement system 1, and an evaluation value based on a measurement result obtained by measuring the user's walking posture. The evaluation value includes, for example, information on the classification results when the terminal device 10 classifies the results of the user's ROM check based on the measurement results by the measurement unit 30.

The item "Internal points" indicates the amount of virtual points that the user has, if there are virtual points used in the business company to which the user belongs.

Each record of the measurement item information 282 includes the item "Measurement item number (measurement item No.)", the item "Measurement site", the item "Guide voice", the item "Foot position on the mat", and the item " body part to be measured.

The item "measurement item number (measurement item No.)" is information for identifying each measurement item.

The item "measurement site" indicates the body site to be measured. For example, the following areas can be evaluated for joint range of motion:

(i) Measurement of upper limbs - Shoulder blade: Directions of movement include flexion, extension, fist-up, and pull-down.
- Shoulder: Directions of movement include flexion, extension, abduction, adduction, external rotation, and internal rotation.
・Elbow: The directions of movement include flexion and extension.
・Forearm: There are two directions of movement: pronation and supination.
- Hand: Directions of movement include flexion, extension, flexion, and ulnar flexion.

(ii) Measurement of fingers: Thumb: Directions of movement include flexural abduction, ulnar adduction, palmar abduction, palmar adduction, flexion, and extension.
・Fingers: Directions of movement include flexion, extension, abduction, and adduction.

(iii) Measurement of lower limbs - Crotch: Directions of movement include flexion, extension, abduction, adduction, external rotation, and internal rotation.
・Knee: The direction of movement is flexion and extension.
・Legs: Directions of movement include flexion and extension.
・Foot: Directions of movement include eversion, inversion, abduction, and adduction.
- Thumb: Directions of movement include flexion and extension.
・Toes: Directions of movement include flexion and extension.

(iv) Measurement of the trunk - Neck: Directions of movement include flexion, extension, rotation (left rotation, right rotation), and lateral flexion (left flexion, right flexion).
- Thoracolumbar region: Directions of movement include flexion, extension, rotation (left rotation, right rotation), and lateral flexion (left flexion, right flexion).

The item "guide audio" indicates the content of the audio that is notified to the user when performing the measurement indicated in the measurement item. The audio guide includes a voice when the user does not place their feet in the specified position on the mat 32 (for example, "Please place both feet on the specified position on the mat"), and a voice when the user does not place their feet on the mat 32 for measurement. When the terminal device 10 detects that the user has placed their feet in a prescribed position on the mat, a voice prompting the user to move their body (for example, "Please twist your body while placing both feet in the prescribed position on the mat") and a voice (for example, "measured successfully") when measurement data of the user's body movement is obtained based on the measurement results of the measurement device 31.

The item "position of feet on mat" includes information on where on the mat 32 the user's feet are placed (position where the user places his feet on the mat 32) when performing measurement. For example, the terminal device 10 detects whether the user's feet are placed at a prescribed position on the mat, based on the information of the item “position of feet on the mat”. Upon this detection, the terminal device 10 outputs to the user a voice indicating the content of the body movement for measurement.

The item "body part to be measured" indicates a part of the user's body to be measured in the measurement item.

Each record in the measurement history database 283 includes an item "measurement number (measurement No.)", an item "date and time", an item "user identification information (ID)", an item "measurement location", and an item "measurement data". and the item “evaluation results”. The server 20 receives the measurement results of the user's body movements from the terminal device 10 . The server 20 updates the records in the measurement history database 283 based on the information received from the terminal device 10.

The item "measurement number (measurement No.)" indicates each measurement result when the user measures the movement of the body using the measurement unit 30.

The item “date and time” indicates the timing at which the user performed the measurement using the measurement unit 30. .

The item “user identification information (ID)” indicates information for identifying the user whose body movement was measured by the measurement unit 30.

The item “measurement location” indicates the location where the user performed measurement using the measurement unit 30. When the server 20 receives a measurement result from the terminal device 10, the server 20 refers to the user information associated with the measurement result and determines whether the user has performed the measurement based on the information associated with the user (user information database 281). You may also specify the location. For example, based on the information on the user's affiliation shown in the user information database 281, the information on the location where the affiliation is located may be the location where measurement was performed by the measurement unit 30. Alternatively, the terminal device 10 may obtain location information using the location information sensor 150, so that the location of the terminal device 10 may be determined as the location where the measurement was performed by the measurement unit 30.

The item “measurement data” indicates the measurement result of the user's body movement measured by the measurement unit 30. For example, when the user's body movement is measured as time-series point cloud data, the time-series point cloud data may be the measurement result in the item "measurement data." Further, regarding the user's body measured by the measuring device 31, the terminal device 10 identifies the positions of the user's joints based on the measurement results, and the movement of each joint is stored in the server 20 as the measurement result of the user's body movement. It may also be retained. For example, the terminal device 10 can measure the chronological movement of the user's joints by detecting specific body parts such as shoulders and elbows based on captured images of the user's body.

The item "evaluation result" indicates the evaluation result of the level of the user's body movement based on the measurement results shown in the item "measurement data." For example, when holding time-series data of the user's joint movements in the item "measurement data," the terminal device 10 evaluates the user's body movements by comparing it with reference body movement data. do. For example, the terminal device 10 may store multiple levels of data as reference data depending on the degree of the user's body movement, so that the terminal device 10 can select a movement that is most similar to the measurement result of the user's body movement. Reference data can be specified.

Each of the records in the friend list 284 includes the item "User 1", the item "User 2", the item "Friend registration date", the item "Measurement history at the same timing", the item "Message sending/receiving history", etc. include.

The item "User 1" indicates one of the users who are mutually registered as friends.

The item "User 2" indicates the other user among the users who are mutually registered as friends.

The item "friend registration date" indicates the date and time when the users were registered as friends.

The item "Measurement history at the same timing" indicates a history in which each user registered as a friend performed measurements at the same location or at the same timing. For example, when the measurement unit 30 is placed in an office space of a business, multiple users may perform measurements at the same timing by performing measurements within a certain time period. . The item "Measurement history at the same timing" may include information on locations where multiple users have performed measurements. For example, by referring to the friend list 284, the server 20 can identify the frequency with which a plurality of users are both measuring body movements using the measurement unit 30 and training using the training menu.

The item "Message transmission/reception history" indicates the history of messages sent/received between users who are registered as friends.

<3 Configuration of measurement unit 30>
FIG. 5 shows a situation in which a user measures body movements using the measurement system 1. FIG. 5 shows an example in which a plurality of measurement units 30 are installed and a plurality of users perform measurements. Further, an example is shown in which one terminal device 10 is connected to a plurality of measurement units 30.

The measuring device 31A measures the movement of the body of the first user User_A in a sensing range 38A. In the detection range 38A, a mat 32A is installed at a position that has a predetermined positional relationship with the measuring device 31A. Here, the position of the mat 32A may be, for example, a certain distance (for example, about several meters) from the front of the measuring device 31A. The mat 32A may be installed with respect to the measuring device 31A so that when the first user User_A rides on the mat 32A, the measuring device 31A can measure the movement of the user's whole body. Pole 33A is installed on the right side and left side of mat 32A, respectively. For example, if there is a pattern on the mat 32A that indicates a predetermined position (which may also be called a home position) for the user to place both feet, a set of poles 33A is placed on the outside of the mat 32A based on the pattern. It may also be arranged. The pole 33A is installed as a guide for the user to grab when the user twists his or her upper limbs on the mat 32A with both feet in a prescribed position. As a result, when the user makes a twisting motion of the upper limb, the user is prompted to move his/her hand toward the pole 33A, so that the form of the upper limb movement can be stabilized to some extent even when measurement opportunities are increased. In other words, variations in time-series measurement results when measuring the user's body movements can be suppressed.

The measuring device 31B measures the movement of the second user User_B's body in a sensing range 38B. In the detection range 38B, a mat 32B is installed at a position that has a predetermined positional relationship with the measuring device 31B. Here, the position of the mat 32B may be, for example, a certain distance (about several meters) from the front of the measuring device 31B. The mat 32B may be installed relative to the measuring device 31B so that when the second user User_B rides on the mat 32B, the measuring device 31B can measure the movement of the user's whole body. Pole 33B is installed on the right side and left side of mat 32B, respectively.

The first user User_A moves his body by checking the position of his feet using the pattern on the mat 32A as a guide while visually checking the video and audio displayed on the display 132A. Similarly, the second user User_B moves his body according to the video and audio guide displayed on the display 132B. Thereby, the body movements of the first user User_A and the second user User_B can be measured by the measurement devices 31A and 31B, respectively.

In the illustrated example, the first user User_A is about to start a bending and stretching exercise after placing both feet at the home position on the mat 32A based on the output from the display 132A. The second user User_B is making a step with his right foot according to the output from the display 132B.

FIG. 6 is a diagram showing details of the mat 32. As shown in the figure, patterns that serve as a guide for placing the user's right foot and left foot are arranged at multiple locations.

For example, positions for placing the right foot such as a first home position 41R, a second home position 42R, and a third home position 43R are used as a guide for placing both feet of the user across multiple measurement items. are shown multiple times.

For the left foot, a plurality of positions for placing the left foot are shown, such as a first home position 41L, a second home position 42L, and a third home position 43L.

Note that in the following description, the home positions 41R and 41L may be collectively referred to as the home position 41, etc. Similarly, home positions 42R and 42L may be collectively referred to as home position 42, and home positions 43R and 43L may be collectively referred to as home position 43.

For each measurement item (measurement item information 282), the terminal device 10 guides the user to perform a predetermined body movement after specifying the interval at which the user spreads the right and left legs. For example, information on the home position to be used may be provided in the audio guide accompanying the measurement of the measurement item.

When measuring the measurement item, the terminal device 10 determines whether the user is using a predetermined home position based on the measurement result of the measurement device 31. For example, when the terminal device 10 identifies each of the home position patterns shown on the mat 32 based on the sensing results of the measuring device 31, based on the detection results of the user's ankles, etc. It may be possible to identify the pattern. If a user places their feet in a position different from the expected home position when measuring a measurement item, prompt the user to place their feet in the appropriate position using audio or video guidance. This may also be done by giving a notification.

In addition, the terminal device 10 includes, as a measurement item, the movement of each joint when the user makes a step-stepping motion, which the terminal device 10 uses the measurement unit 30 to measure. Using the measurement items, the terminal device 10 can evaluate, for example, the level of balance when the user moves his or her body by taking a step.

The mat 32 includes a pattern group 45R that is a target for stepping with the right foot when there is a stepping motion as a measurement item. Similarly, it includes a pattern group 45L that is a target for stepping with the left foot.

These pattern groups 45R and 45L may be collectively referred to as "pattern group 45."

The pattern group 45 includes patterns that serve as a guideline for a plurality of stepping positions depending on the user's height. In the illustrated example, patterns are arranged in 10 cm increments in a range of user heights from "140 cm" to "200 cm." By making the pattern imitate the toe portion of a foot, the user can easily recognize that this is the target position for stepping forward. For example, the user places both feet at the initial positions of the home positions 41R and 41L or the positions of the patterns 44R and 44L (these may be collectively referred to as "patterns 44"), and moves one foot at a time according to the user's height. Make a step motion to reach the position of the pattern. The terminal device 10 uses the measurement unit 30 to measure the movement of the user's body (movement of the joints) when performing the stepping motion. When measuring the stepping action of the user, the terminal device 10 specifies the home positions 41 to 43 or the pattern 44 as the initial position of the foot, depending on the distance the user wants the user to step, and prompts the user to do so. It can also be used as a guide.

In the illustrated example, the position of the pole 33 is also shown. For example, the poles 33 (on the right and left sides) may be arranged so as to be lined up in a straight line with respect to the home positions 41, 42, and 43. For example, the user attempts to grasp the pole 33 by twisting the upper limbs while placing both feet at one of the home positions 41, 42, and 43.

Note that, as shown in the figure, arrow patterns may be arranged in the pattern groups 45R and 45L. In the illustrated example, the arrow pattern is arranged to overlap the patterns corresponding to the heights of the pattern groups 45R and 45L. Thereby, the user can be made aware of the action of stepping forward, and when the user looks at the mat 32, it is possible to reduce the possibility that the user is confused about how to move the body during measurement.

In addition, as shown in the figure, regarding the size of the pattern, since the pattern serves as a guide for the user to place their foot, the length in the vertical direction (direction in which the foot is stepped) is the size of a typical foot. It may be about the same size (length about 22 cm to 28 cm). The shape of the pattern may be a footprint or a shape similar to a footprint so that the user can easily understand that the user is placing his or her foot on the pattern.

<4 Operation>
Hereinafter, a measurement process in which the terminal device 10 measures the movement of the user's body will be described.

FIG. 7 is a flowchart showing a process in which the terminal device 10 performs a ROM check and updates the measurement history.

In step S700, the control unit 190 of the terminal device 10 displays a screen on the display 132 for logging in by a user who performs measurements, and receives an operation for logging in from the user. The terminal device 10 authenticates the user by, for example, reading information from a recording medium such as an IC card owned by each user, or by reading a two-dimensional code displayed on a communication terminal owned by the user. Get information. For example, by communicating with the server 20, the terminal device 10 registers information such as the user's height (user information database 281), past measurement history (measurement history database 283), and the user as a friend. information on other users (friend list 284). Additionally, the terminal device 10 acquires measurement item information (measurement item information 282) from the server 20 and stores it as measurement item information 182.

In step S701, the terminal device 10 detects that the mat 32 and the pole 33 are installed in the measurement range of the measurement device 31 based on the measurement results of the measurement device 31. For example, the terminal device 10 detects the mat 32 and the pole 33 by performing image recognition using the measurement result of the measuring device 31 as a two-dimensional image. The terminal device 10 detects that the mat 32 and the pole 33 are at predetermined positions with respect to the measuring device 31. That is, the terminal device 10 detects that the mat 32 and the pole 33 are in a position suitable for measurement and in a position where the user can easily check the audio and video of the guide.

In step S703, the terminal device 10 refers to the measurement item information 182 and performs a process of sequentially measuring each measurement item. The terminal device 10 reads out the first measurement item and outputs information (such as the position where the user places the foot on the mat 32) that serves as a guide for the measurement using audio and video. The terminal device 10 detects the user's joints based on the measurement results of the measuring device 31, and detects that the user's feet are placed at predetermined positions on the mat (positions defined by the measurement items).

In step S705, the terminal device 10 outputs a voice urging the user to make a predetermined movement with his or her body. The terminal device 10 measures the movement of the user's body by detecting the movement of the user's body using the measuring device 31 .

In step S707, the terminal device 10 sequentially reads the measurement items from the measurement item information 182, outputs audio guidance, detects that the user's feet are in the specified position on the mat 32, and detects the movement of the user's body. Measure.

In step S709, when the measurement of each measurement item is completed, the terminal device 10 evaluates the range of motion of the user's joints based on the measurement results of the user's body movements. Specifically, the terminal device 10 identifies the position of each joint of the user based on the measurement results of the measuring device 31, and performs the measurement based on time-series data of the joint position (movement of the joint position that changes over time). Assess the range of motion of the target body part. The terminal device 10 outputs the evaluation result of the joint range of motion on the display 132 or the like, and transmits it to the server 20.

In step S753, the server 20 receives the user's ROM check result from the terminal device 10, and updates the database (measurement history database 283, user information database 281) based on the user's measurement result.

Next, a description will be given of the processing of each device when measuring the movement of a user stepping forward as a measurement item.

FIG. 8 is a flowchart showing a process in which the terminal device 10 evaluates joint range of motion by measuring the movement of the user's foot.

In step S801, the terminal device 10 determines that the user's feet are placed at a prescribed position on the mat 32 (item "Foot position on mat" of measurement item information 282) based on the measurement results of the measuring device 31. Detect. The terminal device 10 may guide the user to place the user's feet in the prescribed position if the user's feet are not placed in the prescribed position.

In step S803, the terminal device 10 outputs audio and video that guide the user to step the user's right foot from a prescribed position to a stepping position corresponding to the user's height.

In step S805, the terminal device 10 detects that the user's right foot has stepped from a prescribed position to another position on the mat based on the measurement result by the measuring device 31, and measures the movement of the user's right foot. Record the results. If the user's right foot steps to a position different from the target position, the terminal device 10 guides the user to step the right foot to the target position again in order to re-measure. It may also be a thing.

In step S807, the terminal device 10 outputs a voice that guides the user to step the left foot from a prescribed position to a step position corresponding to the user's height (step length).

In step S809, the terminal device 10 detects that the user's left foot has stepped from a prescribed position to another position on the mat based on the measurement result of the measuring device 31, and measures the movement of the user's left foot. Record the results.

In step S<b>811 , the terminal device 10 evaluates the range of motion of the joints of the lower limbs based on the measurement results of the movement of the user stepping on the mat 32 , outputs the evaluation results to the display 132 , etc., and transmits them to the server 20 .

Next, the processing of each device when measuring a user's upper body twisting motion will be described.

FIG. 9 is a flowchart showing a process in which the terminal device 10 evaluates joint range of motion by measuring the user's twisting motion of the upper body.

In step S901, the terminal device 10 detects that the user's feet are placed at prescribed positions on the mat based on the measurement results of the measuring device 31.

In step S903, the terminal device 10 determines whether the height of the pole 33 is appropriate based on information on the user's height. For example, the terminal device 10 associates and stores information about the height of the pole 33 that is appropriate depending on the height of the user, so that the height of the pole 33 detected by the measurement result of the measuring device 31 is appropriate. Determine whether it exists or not. For example, the appropriate height of the pole 33 may be determined based on the position of the user's hand when the user stands upright. Here, the position of the hand when the user stands upright may vary depending on the height of the user. In other words, it is assumed that the taller the person is, the higher the position of their hands will be when standing upright. Further, the terminal device 10 detects the position of the user's hand (height from the ground) when the user is in an upright posture based on the measurement result of the measuring device 31, and thereby determines the appropriate height of the pole 33. The determination may be made based on the position of the hand. That is, the height of the pole 33 may be adjusted according to the measurement result of the user's body by the measuring device 31.

Note that the height of the pole 33 is determined by, for example, determining the first position where the pole 33 contacts the ground and the second position where the top of the pole 33 is located based on the measurement results of the measuring device 31. The determination may be made based on information on the distances from the position of the device 31 to the first and second positions of the poles 33. In addition, if the pole 33 has a structure that allows it to be stretched, the pattern of the pole 33 includes a pattern indicating the height of the pole 33, and the terminal device 10 indicates the height of the pole 33. It is also possible to detect a pattern.

The terminal device 10 may determine whether the position where the pole 33 is installed is appropriate. For example, the terminal device 10 detects a pattern indicating the home position etc. on the pole 33, and determines whether the position of the pole 33 is appropriate based on the positional relationship between the position of the pattern and the position where the pole 33 is in contact with the ground. It may also be determined whether or not there is.

In step S905, the terminal device 10 twists the user's body to the right side while keeping both feet on the mat at the specified positions, puts the right pole with the left hand (pole 33 placed on the right side), and the left pole with the right hand (pole 33 placed on the left side). It outputs audio and video that guide the user to grab the pole 33).

In step S907, the terminal device 10 records the measurement result of the user's twisting of the body to the right based on the measurement result of the measurement device 31.

In step S909, the terminal device 10 outputs a voice that guides the user to twist his or her body to the left while keeping both feet on the mat at a prescribed position, and to grasp the left pole with the right hand and the right pole with the left hand.

In step S911, the terminal device 10 records the measurement result of the user's twisting of the body to the left based on the measurement result.

In step S913, the terminal device 10 evaluates the range of motion of each joint of the body based on the measurement result of the user's body twisting motion, and outputs the evaluation result. In evaluating the range of motion of a joint, whether or not the user was able to grasp the pole 33 by twisting his or her upper body may also be used as an evaluation item.

As described above, by setting the height of the pole 33 to be approximately the same as the height of the user's hand when standing upright, when the user twists his/her upper body, the pole 33 can be seen while looking back. I am trying to move my hands and arms with a goal of 33. Thereby, it is possible to reduce the amount of vibration caused by the user's twisting of the upper body, and when the terminal device 10 accumulates measurement results, it becomes easy to compare the time-series data of the measurement results.

<5 Screen example>
FIG. 10 is a diagram illustrating an example of notification content from the terminal device 10 in a situation where the user's body movement is measured.

The example screen in FIG. 10A shows a situation in which the terminal device 10 receives an operation from the user to log in to perform measurement. This corresponds to the process of step S700 in FIG. For example, the measurement unit 30 is installed in a business office, a store space, etc. of a business company, and when a plurality of users use the measurement unit 30, the users are first authenticated.

As shown in FIG. 10(A), the terminal device 10 displays a notification section 132L on the display 132. The terminal device 10 displays operation details for the user to log in on the notification section 132L. In the illustrated example, the measurement unit 30 is installed in a business office, and the notification section 132L indicates that login is possible by reading the user's employee ID card. The terminal device 10 displays on the notification unit 132C that another user is attempting to perform measurement at the same timing. As in the example of FIG. 5, when a plurality of measurement units 30 are installed and a plurality of users take measurements together, the terminal device 10 displays the progress of another user making the measurements on the notification unit 132C. . In the example of FIG. 10(A), the terminal device 10 displays on the notification unit 132C that another user who performs measurement at the same timing has already completed the login process.

The example screen in FIG. 10(B) shows a situation in which the terminal device 10 measures the movement of the user stepping forward. This corresponds to the processing in steps S801 to S811 in FIG.

As shown in FIG. 10(B), the terminal device 10 displays a notification section 132D, a notification section 132E, a guide output section 132F, and a detection result display section 132G on the display 132.

The terminal device 10 displays information on the logged-in user (that is, the user performing the measurement) on the notification unit 132D. This allows the user to easily check whether he or she is mistakenly performing measurements as a different user.

The terminal device 10 displays a history of measurements performed by the user on the notification unit 132E. In the illustrated example, the number of times the user has performed measurements using the measurement unit 30 is displayed, but in addition to this, evaluation results of past measurements, etc. may also be displayed. Thereby, the user can easily confirm that the measurement is being continued, and can be motivated to continue the measurement.

In the guide output unit 132F, the terminal device 10 notifies the user of information on the target pattern for stepping according to the user's height using video and audio. Thereby, the user can easily imagine stepping toward the target pattern, and can easily perform the measurement operation.

The terminal device 10 displays the detection result by the measuring device 31 on the detection result display section 132G. For example, the terminal device 10 displays information such as that both feet of the user are in a prescribed position for measurement (both feet are placed at the home position) on the detection result display section 132G. As a result, the user can easily recognize that the measurement is being performed in accordance with the correct procedure, and can perform the measurement with a sense of security that no measurement errors will occur.

The screen example in FIG. 10C shows a situation in which the user's upper body twisting motion is measured on the terminal device 10.

In the screen example of FIG. 10(C), the terminal device 10 detects that the height of the pole 33 is not appropriate, and instructs the user to extend the pole 33 to a predetermined height using the guide output unit 132F. There is a display encouraging you to do so. This corresponds to the process of step S903 in FIG.

The example screen in FIG. 10(D) shows a situation in which the terminal device 10 notifies the user that the measurement has been completed, the evaluation result based on the measurement result, and a request to register as a friend with another user.

In the screen example shown in FIG. 10(D), the terminal device 10 displays, on the guide output unit 132F, the fact that measurement has been completed for all of the plurality of measurement items, and the results of evaluating the user's body movements for the measurement items. The terminal device 10 refers to the user's past measurement history and displays the comparison results with the past measurement results (such as a change in joint range of motion compared to the previous time) on the guide output unit 132F.

The terminal device 10 displays, on the notification unit 132M, a message prompting the user to register the user as a friend with another user, and the reason for suggesting the other user as a friend candidate (measurements were taken at the same location, etc.).

<Summary>
(1) As described above, according to the present embodiment, when checking the ROM, there is no need to apply a physical measuring instrument such as an angle meter to the user's body. You can easily measure it yourself. Further, by proceeding with the measurement according to the measurement items, it is possible to evaluate the range of motion of each joint of the user's lower body and upper body.

(2) When measuring the movement of the user's body, the mat 32 and the pole 33 can be used to make the user recognize the target point where the user moves the body. This stabilizes the form in which the user moves his or her body, making it easier for the user to accumulate and compare measurement results and check changes in body movement. For example, by using the mat 32, it is possible to (i) specify the stride length and range of movement when the user takes a step, and to instruct the user to perform the specified movement in the measurement; can be encouraged. When the user's body motion is continuously measured, by defining the motion that the user performs during the measurement, it is possible to easily compare the measurement results over time. In other words, by defining the user's body movements, it is possible to more easily evaluate how the user's body movements have changed. Furthermore, by using the mat 32, (ii) the user's standing position with respect to the measuring device 31 can be defined. The terminal device 10 can determine whether the mat 32 is placed at a predetermined position with respect to the measuring device 31 based on the measurement result of the measuring device 31. Therefore, when measuring the movement of the user's body using the mat 32, the user's standing position is defined by each pattern of the mat 32. Thereby, the movement of the user's body can easily fall within the measurement range of the measuring device 31. For example, even if the user makes a motion of sticking out their arm directly above or to the side, by placing the mat 32 in a predetermined position relative to the measuring device 31 in advance, the movement of the user's body will be controlled by the measuring device 31. It is possible to prevent the sensor from going out of the measurement range. Furthermore, by using the mat 32, (iii) when having the user take a specific action, it is possible to make the user take an appropriate posture before taking measurements. For example, the home position can define the user's standing position, and when the user performs a predetermined action (squatting, raising one leg, etc.), the user is in a position suitable for measurement (e.g., with a predetermined foot width). measurement can be started.

With these, the flexibility of each joint of the user's whole body can be easily evaluated.

(3) Furthermore, in the first embodiment, the terminal device 10 may suggest an exercise suitable for the user according to the measurement results of the user's body movements (such as the results of a ROM check). . For example, assume that the terminal device 10 holds exercise menus (training item information 185, 285) in association with classification results of ROM check evaluation results (measurement history information 183, measurement history database 283). That is, it is assumed that information on a proposed training menu is held in advance in association with measurement results and evaluation results of the user's body movements. The terminal device 10 refers to the measurement history database 283, identifies an exercise menu to be proposed to the user based on the measurement results and evaluation results of the user's body movements such as ROM check, and displays the identified exercise menu on the display 132, etc. It is also possible to present the information to the user by displaying the information on the screen or the like. For example, the range of motion of each joint of the user can be evaluated as a result of the ROM check. The server 20 may predetermine in the training item information 285 the range of motion of a joint necessary for the user to perform an exercise. For example, as a result of the ROM check, if the range of motion of the user's hip joint is smaller than a certain level (if the hip joint is stiff), the predetermined training item is not provided to the user as an exercise (the terminal device 10 Processing such as displaying images may not be executed). Further, based on the results of the ROM check, the user may be provided with an exercise menu according to the evaluation results of each joint of the user's body.

In addition, the terminal device 10 measures the movement of the user's body while performing the training shown in the training item, and determines whether the user is able to move the body as specified in the training. Determine. As the user continues to exercise, it is expected that the muscle strength of each part of the body will gradually improve to improve the walking posture, and the user will be able to perform the movements required for exercise. Thereby, the terminal device 10 may determine that the user has completed the exercise menu, and may present another exercise menu to the user.

Further, an exercise menu may be proposed to the user based on the evaluation results of the measurement results of the user's body movements and the history of exercise menus executed by other users of the same degree.

(4) In the above description of the first embodiment, an example has been described in which the movement of the user's body is measured and evaluated by installing the measuring device 31, the mat 32, and the pole 33 in the real world.

In addition, an object corresponding to the mat 32 and an object corresponding to the pole 33 may be placed in the virtual space, and the movement of the user's body may be measured. For example, assume that the user views the display 132 or wears a head-mounted display (HMD). The terminal device 10 displays a field-of-view image according to the settings of the virtual camera in the virtual space on the display 132 or the HMD. The terminal device 10 tracks the movement of the user's body by attaching motion sensors to each part of the user's body (head, shoulders, elbows, hands, hips, knees, feet, etc.). The user moves his or her body while visually recognizing each object installed in the virtual space. Thereby, the movement of the user's body can be measured and evaluated without installing the mat 32 and the pole 33 in the real world.

In addition to installing the mat 32 and pole 33 in the real world, it is also possible to irradiate an image corresponding to the mat 32 onto the floor, etc., and to place an image (such as a stereoscopic image) corresponding to the pole 33 in the real world. It may also be displayed in . For example, in the real world, the virtual mat 32 and pole 33 may be displayed so as to be visible to the user by irradiating light from a laser, a projector, or the like.

<Second embodiment>
A measurement system 1 in a second embodiment will be explained. In the second embodiment, the user's walking motion is measured and the walking posture is evaluated, and thereby the user is supported to acquire a walking style that is beautiful and allows the user to easily exert the functions of the body. I will explain about it.

FIG. 11 shows a situation in which a user's walking motion is measured by the measurement system 1 in the second embodiment.

<1 Overview>
The measuring device 31A measures the motion of the first user User_A walking from a predetermined position to the measuring device 31A in the detection range 38A. The terminal device 10A notifies the first user User_A on the display 132A that the walking state will be measured and how to move the body when walking. As shown in the figure, the terminal device 10A notifies the user to urge the user to walk so as to put his or her weight on the front foot during the walking motion.

In the example of FIG. 11, the coordinate axes are defined as follows. That is, with the position of the first user User_A as a reference, the direction of walking is defined as "front", the direction opposite to the direction of walking is defined as "back", and the axis determined by the direction of walking is defined as "front-back axis". On the other hand, with the position of the first user User_A as a reference, the direction perpendicular to the walking direction on the surface where the walking feet touch the ground is defined as the "left-right axis", and the direction of the user's right half of the body is defined as the "right direction". The direction of the left side of the body is defined as the "left direction." The axis in the torso direction from the feet of the first user User_A to the top of the head is defined as a "vertical axis."

The terminal device 10A notifies the first user User_A via the display 132A to walk toward the measuring device 31A starting from a position a predetermined distance away from the measuring device 31A. Here, the starting point from which the first user User_A starts the walking movement is, for example, a position several meters away from the measuring device 31A, and the walking cycle of the first user User_A (the movement of stepping with the right foot and the movement of stepping with the left foot) The starting point may be set at a position where it is possible to repeat (one cycle) a plurality of times. The measuring device 31A can measure the walking cycle of the first user User_A multiple times. When the terminal device 10A measures the user's walking motion using the measuring device 31A, if the first user User_A is not located at the starting point, the terminal device 10A sends a notification urging the first user User_A to move to the starting point. may be displayed on the display 132A or the like. In response to the presence of the first user User_A at the starting point, the terminal device 10A notifies the first user to start measuring the walking motion (or a notification prompting the first user to start the walking motion). You can.

FIG. 12 shows the parts of the user's body identified by the terminal device 10 based on the measurement results of the measuring device 31. The terminal device 10 identifies joints of extremities, head, shoulders, trunk, pelvis, feet, heels, toes, ribs, anterior superior iliac spine, etc. as characteristics of the user's body. do. The terminal device 10 identifies the thoracic vertebrae (the center of the trunk), the center of the pelvis, and the like. For example, the terminal device 10 prompts the user to take a predetermined pose (a pose in which both arms are stuck out to the side to form a T-shape, a pose in which both arms are attached to the torso, etc.), and the measurement device in these predetermined poses The position of each joint of the user in the measurement results of the measurement device 31 may be specified based on the measurement results of the measurement device 31.

<2 Data structure>
FIG. 13 is a diagram showing the data structure of the measurement result database 287 and the evaluation result database 288 stored in the server 20 in the second embodiment.

The measurement result database 287 is a database that holds the measurement results of each user's body movements (for example, walking movement, trunk balancing movement, etc.) measured by the measuring device 31.

Each of the records of the measurement result database 287 includes the item "measurement data ID", the item "date and time", the item "user ID", the item "elapsed time from the start of measurement", and the item "measurement data".

The item “measurement data ID” indicates information for identifying each piece of measurement data measured by the measurement device 31. In the second embodiment, the terminal device 10 starts and ends the measurement of the user's body movement (for example, the measurement of the walking cycle), and thereby associates information identifying each piece of measurement data with the measurement data. and save it on the server 20.

The item “date and time” indicates the date and time when the user's body movement was measured by the measuring device 31.

The item “user ID” is information that identifies each user whose body movement is measured by the measurement device 31.

The item “time elapsed since the start of measurement” indicates the time elapsed since the measurement device 31 started measuring the movement of the user's body.

The item "measurement data" indicates the position of each part of the user's body (head, shoulders, . . . ) as described in FIG. 12 at the timing indicated in the item "elapsed time from start of measurement". For example, in the item "measurement data", measurement results obtained by measuring distances from the position of the measuring device 31 to each part of the user's body in a coordinate system based on the position of the measuring device 31 may be stored.

The evaluation result database 288 is a database that holds evaluation results obtained by evaluating the user's body movement (for example, walking movement) based on the measurement results of the measuring device 31 (measurement result database 287).

Each record of the evaluation result database 288 includes the item "evaluation result ID", the item "measurement data ID", the item "measurement object", and the item "evaluation result".

The item “evaluation result ID” is information that identifies each evaluation result obtained by evaluating the measurement results of the user's body motion by the measuring device 31.

The item "measurement data ID" is information that identifies each measurement result (measurement result database 287) of the measurement device 31 that is the target of evaluation.

The item "measurement target" indicates the content to be measured as a user's body movement. Examples of objects to be measured include the user's posture during walking motion, the balance of the user's trunk, and the like.

The item “evaluation result” indicates the evaluation result of the user's body movement based on the measurement result of the measuring device 31. For example, when evaluating a user's posture during walking, the evaluation targets include ``the user's step,'' ``whether the user is able to shift their weight to the front foot,'' and ``whether the user is able to shift their weight to the front foot.'' Are you ready?” and so on. Details will be described later. Further, when evaluating the balance of the user's trunk, evaluation targets include "are the positions of the shoulders, hips, and feet misaligned?" Details will be described later.

<3 Operation>
Hereinafter, a process in which the terminal device 10 measures the user's body movement and evaluates it based on the measurement results in the second embodiment will be described.

FIG. 14 is a flowchart showing a process in which the terminal device 10 measures and evaluates a user's walking motion in the second embodiment.

In step S1403, the terminal device 10 detects that the user is at a predetermined position within the measurement range of the measurement device 31 based on the measurement result of the measurement device 31.

In step S1405, the terminal device 10 outputs a guide (audio, video) to the user to make a walking motion. The terminal device 10 detects each joint of the user based on the measurement results of the measuring device 31, and records the position of each joint during the user's walking motion.

In step S1407, the terminal device 10 classifies the cycle of the user's walking motion into a plurality of phases based on the measurement results of the measurement device 31. The terminal device 10 determines an evaluation value for evaluating the walking motion according to evaluation items for each aspect of the user's walking motion.

In step S1409, the terminal device 10 outputs the measurement results of the measuring device 31 and the evaluation results of the walking motion, together with the ideal walking posture model, to the display 132 or the like. The terminal device 10 transmits the measurement results and evaluation results to the server 20.

In step S1453, the server 20 updates the measurement result database 287 and the evaluation result database 288 based on the measurement results and evaluation results of the user's walking motion.

<4 Output examples of measurement results and evaluation results>
FIG. 15 is a diagram illustrating an output example when the terminal device 10 outputs measurement results of measuring the user's walking motion and evaluation results of evaluating the user's walking motion based on the measurement results in the second embodiment. It is. In the illustrated example, the terminal device 10 displays these measurement results and evaluation results on the display 132. It is also possible to output the results.

FIG. 15A shows a situation in which the terminal device 10 prompts the measuring device 31 to walk a certain number of steps (for example, about several meters) in order to measure the user's walking motion. This corresponds to the processing in steps S1403 and S1405 in FIG.

On the display 132, the terminal device 10 displays on the display unit 132P1 a "notification urging the user to walk so as to put his/her weight on the front foot when stepping forward" when performing a walking motion. The terminal device 10 displays, on the display units 132P2 and 132P3, an image showing the identified position of each part of the user's body (each part of the body illustrated in FIG. 12) as the measurement result of the measuring device 31. The terminal device 10 connects each part of the user's body in a linear manner to display the measurement results of the user's body in a way that is easy for the user to visually recognize. In the example of FIG. 15, parts of the right side of the user's body are connected by dotted lines, and parts of the left side of the user's body are connected by solid lines. Thereby, the user can easily recognize whether the measurement result of the measuring device 31 is a movement of the right side of the user's body or a movement of the left side of the user's body.

The terminal device 10 displays, on the display unit 132P2, the results of specifying the position of each part of the user when viewed from the front of the user (anterior-posterior axis shown in FIG. 11) at any time based on the measurement results of the measuring device 31. .

The terminal device 10 displays, on the display unit 132P3, the results of specifying the position of each part of the user when viewed from the user's side (left-right axis shown in FIG. 11) at any time based on the measurement results of the measuring device 31. . That is, the terminal device 10 displays the measurement results by the measurement device 31 on the display units 132P2 and 132P3 in real time. This allows the user to obtain feedback on the measurement results of the user's own body movements in real time.

The terminal device 10 notifies the user to urge the user to perform a walking motion to approach the measuring device 31. Here, the terminal device 10 may display the measurement results as if the movement of the user's body was measured at a position a certain distance from the user's body on the display units 132P2 and 132P3. For example, the terminal device 10 generates a three-dimensional virtual section, and based on the measurement results of the measuring device 31 (that is, the distance from the position of the measuring device 31 to the position of each part of the first user User_A), the terminal device 10 generates a three-dimensional virtual section. Objects corresponding to the positions of each part of the user's body are placed in the virtual space. For example, the terminal device 10 specifies the coordinates corresponding to the measuring device 31 in the three-dimensional virtual space, and determines the position of each part based on the measurement results of the measuring device 31 with respect to the coordinates corresponding to the measuring device 31. Place objects corresponding to each part at the corresponding coordinates. The terminal device 10 holds information on the position of the object corresponding to each part in the three-dimensional virtual space in association with the elapsed time accompanying the measurement by the measuring device 31. That is, by reproducing the locus of movement of the object corresponding to the position of each part of the user in the three-dimensional virtual space, the user's walking motion can be reproduced as the locus of the position of each part of the user. The terminal device 10 determines coordinates that have a certain positional relationship (for example, a position a certain distance from the "shoulder center" on the front-back axis, or a chest The virtual camera may be set at a position a certain distance from the waist on the left-right axis) and moved in conjunction with the movement of objects corresponding to the positions of each body part.

The terminal device 10 notifies information for appropriately performing measurement by the measuring device 31 on the display section 132P4. This corresponds to step S1403 in FIG. For example, when measuring the user's walking motion using the measuring device 31, the terminal device 10 determines whether the user starts walking at a predetermined position and prompts the user to start walking from the predetermined position. Give notice. As shown in the figure, if the position at which the user starts walking is too close to the measuring device 31, the terminal device 10 issues a notification urging the user to start walking from further back.

FIG. 15(B) shows a situation in which the terminal device 10 outputs measurement results and evaluation results regarding a certain aspect of the user's walking motion. This corresponds to the process of step S1409 in FIG.

In FIGS. 15(B) and 15(C), the measurement results of the user's body are displayed with the vertical axis as a reference. Thereby, it is possible to present to the user how the user's body is able to rotate with respect to the vertical axis.

The terminal device 10 outputs, on the display 132, the evaluation results of the balance of the rotation of the shoulders and the balance of the rotation of the hips during the walking motion, as the evaluation results of the beauty of the user's walking posture. The terminal device 10 divides the walking motion into a plurality of phases, and outputs evaluation results for each phase, such as the balance of shoulder rotation and the balance of hip rotation. In this way, by presenting the user with measurement results and evaluation results regarding multiple aspects of walking motion, it is possible to provide suggestions for making the user's walking motion more beautiful.

The terminal device 10 displays, on the display unit 132P5, the inclination of the rotation of the shoulder in each of the left rotation and the right rotation in a walking motion cycle (one cycle is an action of stepping with the right foot and then stepping with the left foot).

The terminal device 10 displays, on the display unit 132P6, a "line connecting both shoulders" determined by the positions of the right shoulder and left shoulder, a "line connecting both hip joints" determined by the positions of both hip joints, and the center of the positions of the right shoulder and left shoulder. Displays the "center position of the shoulder" and the "center position of the waist" determined by the position of the hip joints (for example, the positions of the right pelvis and left pelvis). In one cycle of walking motion, the terminal device 10 determines the degree of left rotation of the shoulder with respect to the vertical axis ( Assess how far the shoulders are rotating. For example, the terminal device 10 draws a "line connecting both shoulders" based on the amount by which the shoulders rotate due to counterclockwise rotation in one cycle with the position of the waist as a reference. The terminal device 10 displays the score (score "4.8 points") as the evaluation result on the display unit 132P6.

The terminal device 10 displays a "line connecting both shoulders", "a line connecting both hip joints", "center position of shoulder", and "center position of waist" on display unit 132P7. In one cycle of walking motion, the terminal device 10 determines the degree of left rotation of the shoulder with respect to the vertical axis based on the position of the right shoulder (or both shoulders) when the user takes a step with the right foot and the position of the hip joint. Evaluate. The terminal device 10 draws a "line connecting both shoulders" based on the amount by which the shoulders rotate due to clockwise rotation in one cycle with the position of the waist as a reference. The terminal device 10 displays a score as an evaluation result (score "4.5 points") on the display unit 132P7, which is a lower score than the left rotation.

The terminal device 10 displays, on the display units 132P6 and 132P7, the "center position of the shoulder" and the "center position of the waist" in the left foot stepping motion and the right foot stepping motion in one cycle of walking motion. This allows the user to recognize how the upper body is tilted with respect to the position of the waist during walking. For example, the user can be made aware of the degree to which the user's body is moving in the left-right axis and the degree to which it is moving in the front-back axis when the user is walking. In the illustrated example, in the display part 132P6, the degree of overlap between the "center position of the shoulder" and the "center position of the waist" during left rotation is large, and the upper body is not shaken, whereas in the display part 132P7, When rotating to the right, the overlap between the "center position of the shoulders" and the "center position of the waist" is relatively small, and the upper body is swayed laterally more than when rotating to the left. Therefore, the score that is the evaluation result is lower when rotating to the right than when rotating to the left.

FIG. 15C shows a phase in which the terminal device 10 outputs measurement results and evaluation results when the user's front foot touches the ground during the walking motion, as a phase of the user's walking motion. This corresponds to step S1409 in FIG.

The terminal device 10 displays, on the display unit 132P8, the measurement results and evaluation results of the inclination of the hip rotation when the user puts his or her front feet on the ground during walking motion.

The terminal device 10 displays, on the display unit 132P9, a "line connecting both hip joints" when the left foot is placed on the ground as the front foot. As shown in the figure, since the "line connecting both hip joints" is tilted, it is shown that the user is able to rotate his or her hips when the user puts his left foot on the ground.

The terminal device 10 displays, on the display unit 132P10, a "line connecting both hip joints" when the right foot is placed on the ground as the front foot. As shown in the figure, the "line connecting both hip joints" is slanted, which indicates that the user is able to rotate his or her hips when the user puts his right foot on the ground.

FIG. 16 is a diagram illustrating an output example when the terminal device 10 outputs measurement results of measuring the user's walking motion and evaluation results of evaluating the user's walking motion based on the measurement results in the second embodiment. It is. This corresponds to the processing in steps S1407 and S1409 shown in FIG.

In the example of FIG. 16, the terminal device 10 displays the measurement results and evaluation results of one cycle of the user's walking motion in a manner that can be compared with a reference example (model example, role model) for making the walking posture look beautiful. The output example shown in FIG. 16 may also be output by the terminal device 10 by printing it on a paper medium using a printer or the like.

On the display 132, the terminal device 10 divides one cycle of walking motion into a plurality of steps, and in each step displays a model for making the walking posture look beautiful, a measurement result of the user's walking motion, and an evaluation result for the measurement result. and is displayed.

In the example of FIG. 16, one cycle of walking motion is divided into the first step "stepping forward", the second step "trying to put your weight on the front foot that you have stepped forward (trying to get on the front foot)", and the second step "stepping your foot forward". It is divided into step 3, ``Put all your weight on the front foot that you took the step with (get over the front foot)''.

Here, the items evaluated by the terminal device 10 in the first step, second step, and third step include items that are common in each of these steps and items that are not common in each step.
(1) Evaluation items for the first step - Tilt of the upper body during walking: Whether the parts of the upper body (head, shoulders, etc.) are tilted forward or backward relative to the position of the waist. For example, is the angle of inclination of the line determined by the position of the pelvis, the position of the thoracolumbar region, and the position of the center of the shoulder within a certain range with respect to the vertical axis?
・The distance between the front and back of the feet when trying to step forward: The extent to which the front and back of both feet are opened. For example, is the distance between the ankle of the front foot and the ankle of the rear foot greater than a certain distance?
・The position of your hips when you try to step forward: Are your hips left behind when you try to take a step forward? For example, is the position of the pelvis anterior or posterior relative to the shoulders and thorax?

(2) Evaluation items for the second step・Tilting of the upper body when the front feet touch the ground: Are the parts of the upper body (head, shoulders, etc.) leaning forward or backward relative to the position of the waist?・Bend of the knee when the front foot touches the ground: Are each part of the front foot (ankle, knee, pelvis) bent significantly or not? For example, is the angle formed by the line connecting the ankle and knee and the line connecting the knee and pelvis within a certain angle? (3) Third step evaluation item The inclination of the upper body at the time of placing the weight on the front foot: Is the upper body part (head, shoulders, etc.) tilted forward or backward relative to the position of the waist? - The extension of the pivot leg when the weight is placed on the front foot: Stepping When you place your weight on the front foot that you landed on, do the parts of the pivot foot (ankle, knee, pelvis) extend or bend? For example, whether the angle formed by the line connecting the ankle and the knee and the line connecting the knee and the pelvis is within a certain angle, specifically, the terminal device 10 displays the following on the display unit 132P11: Display a model for the first step. The terminal device 10 displays the measurement results of the user's body in the first step on the display unit 132P21. The terminal device 10 displays the evaluation result of the user's body movement in the first step on the display unit 132P31.

The terminal device 10 displays, on the display units 132P11, 132P12, and 132P13, the position of each body part (joint) when each of these evaluation items is favorable for a beautiful walking posture. For example, in the display section 132P11, if the upper body is not tilted, the front and hind legs are spread apart to a certain extent (the stride length is not too short), and the hip position is appropriate (not too far back). The location of each part of the body is shown.

In the illustrated example, the display section 132P31 displays, as evaluation results, the evaluation result RF_ic of the right foot when stepping with the right foot and the evaluation result LF_ic of the left foot when stepping with the left foot for the evaluation item "Inclination of the upper body". It is displayed superimposed on a predetermined bar. The predetermined bar is drawn according to the possible range of the evaluation result. The terminal device 10 distinguishes and displays areas with good evaluation results and areas with poor evaluation results in the predetermined bar, and in the illustrated example, emphasizes and displays areas with good evaluation results. are doing. The terminal device 10 sets the evaluation result RF_ic of the right leg and the evaluation result LF_ic of the left leg in the evaluation item "Tilting of the upper body", in which the evaluation results are in a good range, with neither leaning too much forward nor leaning too far back. are displayed in association.

The terminal device 10 also associates the evaluation results of the right foot and the left foot with a predetermined bar for the evaluation item "front and back spread of the legs" and the evaluation item "hip position" as evaluation results on the display unit 132P31. is displayed.

The terminal device 10 displays a model for the second step on the display unit 132P12. The terminal device 10 displays the measurement results of the user's body in the second step on the display unit 132P22. The terminal device 10 displays the evaluation result of the user's body movement in the second step on the display unit 132P32.

The terminal device 10 displays a model for the third step on the display unit 132P13. The terminal device 10 displays the measurement results of the user's body in the third step on the display unit 132P23. The terminal device 10 displays the evaluation result of the user's body movement in the third step on the display unit 132P33.

FIG. 17 is a diagram illustrating an example in which the terminal device 10 outputs an evaluation result of the burden on the knee during the user's walking motion. This corresponds to step S1409 in FIG.

FIG. 17(A) shows an example in which measurement results and evaluation results of hip joint adduction and abduction in the user's walking motion are output. The terminal device 10 displays the measurement results of the user's walking motion on the display 132 based on the front-back axis (as viewed from the front of the user), so that the user can easily check the bending of the knee during the walking motion. Do it like this.

The terminal device 10 displays the measurement results during walking motion on the display section 132P41. The terminal device 10 displays, on the display unit 132P42, the measurement results when walking with the right foot as the pivot foot. The terminal device 10 displays, on the display unit 132P43, the measurement results when walking with the left foot as the pivot foot.

On the display unit 132P44, the terminal device 10 displays a pattern of preferable measurement results ("Both pivot and swing legs are straight") and a pattern of measurement results that may hurt the knee ("Knee ``Possibility of hurting the outside of the knee'' and ``Possibility of hurting the inside of the knee.'' In other words, if the hip joint is internally rotated too much or externally rotated too much during walking, there is a risk of knee pain during walking.

As described above, by referring to the output results of the terminal device 10, the user can be prompted to walk without hurting his knees.

FIG. 17(B) is a diagram showing an example of outputting an evaluation result as to whether the knee is too far ahead of the ankle in the user's walking motion. The terminal device 10 displays the measurement results of the user's walking motion on the display 132 based on the left-right axis (as viewed from the side of the user), and checks whether the user is moving his or her knees too much in advance during the walking motion. Allow users to easily check the information.

The terminal device 10 displays the measurement results during walking motion on the display section 132P51. The terminal device 10 displays, on the display unit 132P52, the measurement results when walking with the right foot as the pivot foot. The terminal device 10 displays, on the display unit 132P53, the measurement results when walking with the right foot as the pivot foot. The terminal device 10 displays, on the display unit 132P51, "the front load on the knee is small" as the evaluation result of the user's walking posture.

On the display unit 132P54, the terminal device 10 displays a pattern of preferred measurement results ("good") and a pattern of measurement results that may hurt the knee ("knees are too far forward") for the user's reference. ) and display. In other words, if the user tries to take a step with the front foot and the knee is too far ahead of the ankle, the user may injure the knee. The terminal device 10 determines whether the angle at which the line connecting the ankle position and the knee position and the line connecting the knee position and the pelvis position intersect is greater than or equal to a predetermined angle (if the angle from the knee to the ankle is forward). When the user tries to take a step forward, it is evaluated whether the knee is moving too far in front of the user.

As described above, the walking motion of the user is evaluated regarding multiple aspects of the user's walking cycle, such as when the user tries to take a step with the pivot foot, when the pivot foot lands, and when the user tries to put weight on the pivot foot. Thereby, the user is prompted to make his walking motion more beautiful by referring to the evaluation results of each aspect. Furthermore, by allowing the user to refer to the model body movement and the measurement results of the user's body movement, the user is encouraged to approach a beautiful walking posture.

<Third embodiment>
A measurement system 1 in a third embodiment will be explained. In the third embodiment, a process for displaying the measurement results of the balance of the user's trunk and enabling the user to obtain a state in which the trunk is balanced will be described.

<Operation>
Hereinafter, in the third embodiment, a process in which the terminal device 10 measures the movement of the user's body and evaluates it based on the measurement results will be described.

FIG. 18 is a flowchart showing a process in which the terminal device 10 measures and evaluates the balance of the user's trunk in the third embodiment.

In step S1803, the terminal device 10 outputs a guide (audio, video) to measure the balance of the user's trunk (shoulders, hips, legs) based on the measurement results of the measuring device 31. The terminal device 10 displays the measurement results of the positions of the user's shoulders, hips, and feet by displaying them in circles based on the vertical axis. The terminal device 10 outputs a guide that prompts the user to balance his/her trunk, depending on how the positions of the user's shoulders, hips, and feet overlap.

In step S1805, the terminal device 10 evaluates the balance of the user's trunk based on the measurement results of the measurement device 31 and outputs an evaluation value. The terminal device 10 transmits the measurement results of the measurement device 31 and the evaluation results to the server 20.

In step S1853, the server 20 updates the measurement result database 287 and the evaluation result database 288 based on the measurement results and evaluation results of the user's trunk balance.

<Output example>
FIG. 19 is a diagram illustrating an example in which the terminal device 10 outputs a measurement result of measuring the balance of the user's trunk and an evaluation result of the balance of the trunk in the third embodiment.

FIG. 19(A) shows an example of a screen in which the terminal device 10 outputs measurement results in real time in order to measure the balance of the user's trunk using the measuring device 31. This corresponds to the process of step S1803 in FIG. In the example of FIG. 19A, the display unit 132P61 displays circular figures (such as a perfect circle or an ellipse) corresponding to each of the shoulders, hips, and legs of the user's body.

The terminal device 10 displays the measurement results of each part of the user's body on the display unit 132P62 based on the anteroposterior axis.

The terminal device 10 displays, on the display unit 132P63, the positions of the shoulders, hips, and feet of the user's body based on the measurement results of the measuring device 31 based on the vertical axis. The terminal device 10 displays the measurement results of the measurement device 31 on the display section 132P63 at any time. Therefore, when the user's body shakes, the circular figures corresponding to the shoulders, hips, and legs do not overlap, causing deviations. The screen example of FIG. 19(A) shows that each part of the user's body is not aligned and shifted along the vertical axis. The user is prompted to move his or her body to balance the trunk while looking at the display on the display section 132P63 of the display 132.

The terminal device 10 provides a notification on the display unit 132P64 to urge the user to maintain a balanced state of the trunk. Based on the measurement results of the measuring device 31, the terminal device 10 specifies the movement of the user's body necessary to balance each part of the user's body. In the illustrated example, the head and feet are located on the back side of the user's waist. In other words, the position of the user's waist is in a state of protruding forward. The terminal device 10 displays, on the display unit 132P64, a prompt to adjust the inclination of the body in the front-back direction. This allows the user to easily recognize the body movements necessary to bring the trunk into a balanced state.

FIG. 19(B) shows a display example of measurement results in a state where the user's trunk is well balanced. In the display section 132P63, the user's shoulders, hips, and legs are lined up along the vertical axis, and the body trunk is balanced. The terminal device 10 notifies the user on the display unit 132P64 that the trunk is in a balanced state.

FIG. 19C shows a display example when the measurement of trunk balance is finished and the evaluation result is output. This corresponds to the process of step S1805 in FIG.

The terminal device 10 displays on the display unit 132P65 that the measurement of the trunk balance has been completed, and outputs an evaluation result based on the measurement result.

The terminal device 10 determines a training menu for adjusting the balance of the trunk as a training menu to propose to the user based on the evaluation result of the trunk balance. In the illustrated example, the terminal device 10 displays, on the display unit 132P65, the evaluation result of the user's trunk balance and training menu candidates to be proposed to the user according to the evaluation result. The terminal device 10 receives, on the display section 132P66, an operation for starting a training menu proposed to the user. The terminal device 10 reads the corresponding training menu in response to the user's input operation on the display unit 132P66.

The terminal device 10 receives a training menu designation from the user on the display unit 132P67. That is, the display unit 132P67 accepts input operations for starting other training, regardless of the training menu that the terminal device 10 proposes to the user based on the evaluation result of trunk balance.

The items described in each of the above embodiments may be combined.

<Fourth embodiment>
In the description of the fourth embodiment, the measurement results of the user's body movements include a ROM check (first embodiment), a walking posture check (second embodiment), and a measurement of trunk balance. (Third Embodiment) A technique for proposing a training menu suitable for a user will be described. By measuring and evaluating the user's body movements as described above, the terminal device 10 can specify which parts of the user's body should be trained, and perform training according to the identified results. , suggest a suitable training menu.

With this configuration, when adding new training menu content, it is possible to determine which part of the body the training menu content is suitable for, and whether it is appropriate for any concerns that may arise in the user's body. By associating the content with the user, content can be provided to the user according to the measurement results of the user's body movement, and content can be added even more easily.

(1) As described above, the terminal device 10 may propose an exercise menu to the user based on the measurement results and evaluation results at each step of the user's walking cycle. For example, the terminal device 10 compares a model body movement with the user's body movement (example in FIG. 16), and identifies muscle parts that the user would like to improve. For example, the server 20 may select an exercise menu that is expected to allow the user to take a large step if the front and rear opening of the foot is small in the evaluation results of the first step (stepping the foot forward) as the user's walking motion. This is specified by referring to the training item information 285. That is, the server 20 may store the proposed exercise menu in advance in association with the evaluation results of the evaluation items of each step of walking motion and the evaluation item of trunk balance.

(2) The terminal device 10 may propose a training menu to the user so that the left-right difference in the user's body movements can be resolved. As described above, the terminal device 10 evaluates the left-right balance of the user's body movements by checking the ROM and checking the walking posture. For example, the terminal device 10 evaluates the left-right balance of the rotation movement with respect to the vertical axis based on the evaluation results of the shoulder rotation and hip rotation during the user's walking movement. The terminal device 10 identifies the muscle region that is the cause of the asymmetrical movement of the user's body. For example, the terminal device 10 holds in advance information about muscle parts that are the cause of the left-right difference in the amount of shoulder rotation. As described above, the terminal device 10 can eliminate the balance difference between the left and right by associating and storing in advance the target of evaluation during walking motion and the information on the muscle parts that are the cause of the left-right difference. It is possible to identify the muscle parts that should be trained for this purpose.

(3) Based on the evaluation result of the user's body movement, the terminal device 10 predicts the state that may occur in the user's body in the future, and proposes a training menu to the user based on the prediction result. Good too.

For example, the terminal device 10 identifies (i) "stiff neck/shoulders", "sagging upper arms", "rolled shoulders, forward head posture", "lower back pain", " Items such as ``leg swelling'' and ``arm bulge'' are associated with (ii) information on the user's body parts and stored as predetermined information. Further, the terminal device 10 stores information on a training menu to be proposed as training in association with each of the above-mentioned problems that may occur in the user's body.

The terminal device 10 performs a ROM check and a walking movement check to identify muscle parts that are desired to be improved based on these measurement results and evaluation results. For example, in the ROM check, if the body is not well twisted, the terminal device 10 stores in advance which muscle parts are associated. For example, in the ROM check, the terminal device 10 stores muscle information in association with evaluation items for range of motion of shoulders, hips, and the like.

The terminal device 10 identifies troubles that may occur in the future by referring to the predetermined information, such as by identifying the part of the muscle that moves stiffly. In accordance with this identification result, the terminal device 10 determines a training menu to be proposed to the user in order to cope with future problems that may arise in the user's body.

As described above, information on each part of the muscle is associated with the evaluation items of balance during walking movement and torsion of the body, and information on each part of the muscle is associated with each item of trouble that may occur in the user's body. information is associated with the information. Thereby, the terminal device 10 can propose a training menu customized to each user based on the evaluation result of the user's body movement.

<Data structure in the fourth embodiment>
FIG. 20 is a diagram showing the data structure of various data stored in the server 20 in the fourth embodiment.

In the measurement item information 282, the server 20 maintains, for each measurement item, the item "Possible future worries" and the item "Related muscle parts."

The item "Possible future troubles" includes information that identifies troubles that may occur in the user's body in the future (for example, tags such as "stiff shoulders" and "stiff neck") depending on the evaluation results of the measurement results for each measurement item. ).

The item "related muscle part" is information about a body part (muscle part) that is desirable to be trained depending on the evaluation result of the measurement result for each measurement item. In the item "Related muscle parts", information on body parts may be held in stages depending on the degree of the evaluation result.

In the training item information 285, the server 20 holds, for each training item, the item "content", the item "corresponding worries", and the item "related muscle part".

The item "content" indicates content (video, motion data that serves as a reference for the user's body movements, audio data, etc.) that is presented to the user when performing training.

The item "corresponding trouble" is information (for example, tags such as "stiff shoulders" and "stiff neck") that identifies troubles that may occur in the user's body in the future depending on the evaluation result for each training item.

The item "related muscle part" is information about a body part (muscle part) that is desirable to train depending on the evaluation result for each training item. In the item "Related muscle parts", information on body parts may be held in stages depending on the degree of the evaluation result.

The server 20 maintains the item "possible future troubles" in the evaluation result database 288. The item "Possible future troubles" is information (for example, tags such as "stiff shoulders" and "stiff neck") that specifies, for each evaluation result, troubles that may occur in the user's body in the future depending on the evaluation results.

As described above, the server 20 updates the evaluation result database 288 according to the evaluation result of the user's body movement. For example, in accordance with the measurement results of the ROM check (measurement item information 282), information about troubles that may occur in the user's body in the future can be specified. The server 20 refers to the evaluation result database 288 to identify information about possible future troubles about the user, and refers to the training item information 285 to extract training items to be proposed to the user. When extracting a plurality of training items to be proposed to the user, the server 20 sets priorities based on predetermined rules. For example, the server 20 may prioritize training items that can resolve problems corresponding to unfavorable evaluation results of the user's body movements, depending on the degree to which the evaluation results of the user's body movements are unfavorable.

<Screen example in the fourth embodiment>
FIG. 21 shows an example of a screen in which the terminal device 10 presents possible troubles to the user's body based on the measurement results and evaluation results of the user's body movements, and proposes an exercise menu corresponding to the troubles. be.

In FIG. 21A, the terminal device 10 displays the results of identifying troubles that may occur in the user's body based on the measurement results and evaluation results of the user's body movements.

The terminal device 10 displays, on the display section 132P71, a display prompting the user to take measurements every day via the terminal device 10, and displays, on the display section 132P72, conditions that may occur in the user's body in the future. In the illustrated example, the operation reception unit 132P73 displays the possibility of suffering from “stiff neck and shoulders” and, in response to the user's input operation to the operation reception unit 132P73, displays the message “Stiff neck and shoulders”. Display the training menu that corresponds to the . In addition, the terminal device 10 displays, in the operation reception unit 132P74, that the problem of “sagging upper arms” may occur, and in response to the user's input operation to the operation reception unit 132P74, the terminal device 10 displays “sagging upper arms”. Display a training menu that addresses your concerns. In addition, the terminal device 10 responds to the user's input operation to the operation reception unit 132P75 while displaying that troubles such as “rolled shoulders and forward head posture” may occur in the operation reception unit 132P75. to display a training menu that addresses concerns about ``rolled-in shoulders and forward-headed posture.''

The terminal device 10 displays, on the display section 132P76, a message for starting training menus that are smaller in number than those displayed on the display section 132P76 among the training menu candidates proposed to the user for users who do not have time. The operation reception section 132P77 is displayed. Based on predetermined rules, the terminal device 10 sets priorities and the like for training menu candidates to be proposed to the user, and displays them on the display unit 132P76.

The terminal device 10 receives, on the display unit 132P78, an operation from the user to edit a training menu desired to be executed, such as "favorites".

The terminal device 10 presents a questionnaire to the user by accepting an input operation to the operation receiving unit 132P91, and receives responses to the questionnaire. The terminal device 10 may identify the user's concerns based on the input results of the questionnaire, and propose a training menu corresponding to the identified concerns.

FIG. 21(B) shows a situation in which a recommended training menu is proposed to the user.

For example, in response to an input operation to the operation reception section 132P73, the terminal device 10 displays operation reception sections 132P83 to 132P87 for starting training based on a recommended training menu, as shown on the display section 132P82. The terminal device 10 may play back a video for starting training in response to input operations to these operation receiving units 132P83 to 132P87.

In response to the input operation to the operation reception unit 132P77, the terminal device 10 displays the operation reception unit with the number of training menus to be proposed narrowed down for users who do not have time, as shown on the display unit 132P88. 132P83 to 132P85 are displayed.

Thereby, the user can be encouraged to continue training depending on the user's current state.

<Additional notes>
The matters explained in each of the above embodiments are additionally described below.

(Additional note 1)
A measurement system (1) for measuring the movement of the user's body, comprising a control unit (190, 203) and a measurement unit (31) for measuring the movement of the user's whole body including the limbs, The control unit causes the measurement unit to measure the movement of the user's whole body during the walking motion (S1405, S1803), and the step of identifying a plurality of stages constituting the cycle of the user's walking motion based on the measurement results. and (S1407), a step of evaluating the posture during walking motion for each of the plurality of stages based on the measurement results of each stage, and presenting the evaluation results for each of the plurality of stages to the user (FIG. 16, 132P21~ 132P23, 132P31 to 132P33).

(Additional note 2)
In the presenting step, the position of each part of the user's body is presented as a measurement result for each of the plurality of stages, and for each stage, the measurement results (132P21 to 132P23) and the evaluation results (132P31 to 132P33) are associated. The measurement system according to Supplementary Note 1, which is presented to a user.

(Additional note 3)
In the step of presenting, the position of each part serving as a walking posture model (132P11 to 132P13) for each of the plurality of stages is presented to the user in association with the measurement results and the evaluation results. system.

(Additional note 4)
In the step of measuring, the position of each joint of the user is measured and in the step of presenting the position, the measurement result of the inclination of the shoulder that rotates when the user takes a step with his right foot as a cycle of walking motion (132P5, 132P7), 4. The measurement system according to any one of Supplementary Notes 1 to 3, which presents the measurement result (132P5, 132P6) of the inclination of the shoulder rotating when stepping with the left foot to the user in comparison.

(Appendix 5)
In the step to be presented, as a cycle of walking motion, the measurement result of the inclination of the rotation of the waist at the timing when the user touches the ground with the right foot as the front foot, and the measurement result of the slope of the rotation of the waist when the user touches the ground with the left foot as the front foot (132P8) The measurement system according to any one of Supplementary Notes 1 to 4, which is presented to a user in comparison with the above.

(Appendix 6)
In the step of presenting, the measurement results of the user's body movement are presented (132P41) as to whether the user's hip joint is adducted or abducted during the walking movement based on the walking direction, and the hand of the user in the walking posture is presented (132P41). The measurement system according to any one of Supplementary notes 1 to 5, which presents the position of each part of the body based on the axis of the walking direction (132P44).

(Appendix 7)
In the presenting step, the measurement result of the user's body movement is presented as to whether the user's knee is moving appropriately during the walking movement based on a lateral axis different from the walking direction axis ( 132P51), the measurement system according to any one of appendices 1 to 6, which presents the position of each body part serving as a walking posture model based on a lateral axis (132P54).

(Appendix 8)
In the step to be identified, there are a plurality of stages, including a first stage (132P11, 132P21, 132P31) in which the user tries to step forward with the foot, and a step in which the foot that stepped forward touches the ground and the user puts his/her weight on the foot with the foot as the pivot foot. A second stage (132P12, 132P22, 132P32) and a third stage (132P13, 132P23, 132P33) in which the user puts his/her weight on the pivot foot, as described in any one of Supplementary Notes 1 to 7. measurement system.

(Appendix 9)
If the first step is included as multiple steps, evaluate whether the step to be presented is appropriate at the timing of landing the foot that is about to step forward, and whether the preparatory movement for placing the weight on that foot as the pivot foot is appropriate. (132P31), and if the second step is included as a plurality of steps, in the step to be presented, after landing the pivot foot, evaluate whether the movement to put weight on the pivot foot is appropriate (132P32), In the case where the third stage is included as the plurality of stages, the measurement system according to appendix 8 evaluates whether the patient can put his or her weight on the pivot foot in the presented step (132P33).

(Appendix 10)
When the first stage is included as a plurality of stages, in the step to be presented, at least one of the degree of the front and back spread of both legs or the position of the waist is evaluated as the evaluation of the first stage (132P31); The measurement system described in Appendix 9.

(Appendix 11)
When a second stage is included as the plurality of stages, the measuring system according to appendix 9, in which, in the presenting step, the degree of bending of the knee of the pivot leg is evaluated as evaluation of the second stage (132P32).

(Appendix 12)
When a third stage is included as the plurality of stages, the measuring system according to supplementary note 9, in which the degree of extension of the pivot leg is evaluated as an evaluation of the third stage in the presenting step (132P33).

(Appendix 13)
In the step of measuring, the position of the user's shoulders, the position of the waist, and the position of the feet are measured (S1803), and the control unit further measures the direction of the user's body from the feet to the top of the head around the torso. , the measurement result is presented to the user by superimposing the measurement result of the shoulder position, the measurement result of the waist position, and the measurement result of the foot position (132P63), any one of appendices 1 to 12. Measurement system described in.

10 terminal device, 20 server, 30 measurement unit, 31 measurement device, 32 mat, 33 pole, 132 display, 181 user information, 182 measurement item information, 183 measurement history information, 184 friend list, 185 training item information, 281 user information Database, 282 Measurement item information, 283 Measurement history database, 284 Friend list, 285 Training item information, 287 Measurement result database, 288 Evaluation result database.

Claims (5)

A measurement system for measuring a user's body movement, the measurement system comprising:
comprising a control unit and a measurement unit for measuring a user's walking motion without measuring a walking track and without measuring plantar pressure , the control unit comprising:
The user does not have to perform an operation to explicitly start exercise each time, and the measurement result is not input into the measurement system, and the user can easily measure the full power of the user's walking ability or a step of causing the measurement unit to measure movement during normal walking motion that is not maximum;
Evaluating the condition of the user's left foot and the condition of the user's right foot during the walking movement of the user based on the measurement results;
presenting the results of the evaluation to the user in a manner that allows the user to recognize the difference between the condition of the left foot and the condition of the right foot;
measurement system. The measuring system according to claim 1, wherein the step of evaluating is a step of evaluating the condition of the user's left foot and the condition of the user's right foot at a timing when the user steps forward. The measuring system according to claim 1, wherein the step of evaluating is a step of evaluating the condition of the user's left foot and the condition of the user's right foot at the timing when the user puts his foot on the ground. 1. A method performed by a measurement system for measuring body movements of a user, the method comprising:
The measurement system includes a control unit and a measurement unit for measuring a user's walking motion without measuring a walking track and without measuring plantar pressure ,
In the method, the control unit:
The user does not have to perform an operation to explicitly start exercise each time, and the measurement result is not input into the measurement system, and the user can easily measure the full power of the user's walking ability or a step of causing the measurement unit to measure movement during normal walking motion that is not maximum;
Evaluating the condition of the user's left foot and the condition of the user's right foot during the walking movement of the user based on the measurement results;
presenting the results of the evaluation to the user in a manner that allows the user to recognize the difference between the condition of the left foot and the condition of the right foot;
How to do it. A program that operates a control unit in a measurement system for measuring body movements of a user, the program comprising:
The measurement system includes a control unit and a measurement unit for measuring a user's walking motion without measuring a walking track and without measuring plantar pressure ,
The program causes the control unit to
The user does not have to perform an operation to explicitly start exercise each time, and the measurement result is not input into the measurement system, and the user can easily measure the full power of the user's walking ability or a step of causing the measurement unit to measure movement during normal walking motion that is not maximum;
Evaluating the condition of the user's left foot and the condition of the user's right foot during the walking movement of the user based on the measurement results;
presenting the results of the evaluation to the user in a manner that allows the user to recognize the difference between the condition of the left foot and the condition of the right foot;
A program to run.