JP2023072656A - Information processing method, device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To evaluate from a moving image whether forward-bending in a standing position is good or bad.

SOLUTION: An information processing method to be executed by an information processing device, includes: acquisition processing of acquiring a moving image obtained by capturing an image of motion including at least one of forward-bending motion and getting-up motion of a user; extraction processing of extracting skeleton information of he user from the moving image; first calculation processing of calculating a first distance, the distance of two points of an upper body of the user, based on the skeleton information; and evaluation processing of evaluating the motion of the user based on the first distance.

SELECTED DRAWING: Figure 8

COPYRIGHT: (C)2023,JPO&INPIT

Description

The present invention relates to an information processing method, apparatus and program.

Conventionally, there has been known a technique for evaluating motion using skeleton information extracted from moving images. For example, Cited Document 1 describes a system for evaluating a user's body movement related to a user terminal, which includes an image analysis unit that analyzes an image of the body and identifies a plurality of parts of the body. , an evaluation generation unit that evaluates the movement of each of the plurality of parts and generates evaluation information, and a screen generation unit that generates a screen for communication between the user terminal and the instructor terminal, and the screen An exercise evaluation system is disclosed in which a generator generates a screen to display the evaluation information on at least a part of the communication screen. According to this system, movements such as pitching can be evaluated from moving images.

Japanese Patent Application Laid-Open No. 2021-49208

There is a need for a technology that evaluates the quality of standing forward bending from videos.

The present invention has been made in view of the above problems, and an object of the present invention is to evaluate the quality of standing body forward bending from moving images.

An information processing method according to an embodiment is an information processing method executed by an information processing apparatus, and includes an acquisition process of acquiring a moving image of a motion including at least one of a forward bending motion and a rising motion of a user; a first calculation process for calculating a first distance that is a distance between two points on the user's upper body based on the skeleton information; and a first calculation process for calculating the first distance based on the first distance and an evaluation process for evaluating the action of the user.

According to one embodiment, it is possible to evaluate whether standing body forward bending is good or bad from a moving image.

It is a schematic diagram explaining standing body forward bending. It is a figure showing an example of composition of an information processing system concerning this embodiment. It is a figure which shows an example of the hardware constitutions of an information processing apparatus. It is a figure which shows an example of the functional structure of an evaluation apparatus. It is a figure explaining the upper body length L. FIG. FIG. 4 is a diagram for explaining a forward bending distance D; 4 is a flowchart showing an example of processing executed by the evaluation device 1; FIG. 4 is a diagram showing an example of a forward bending distance D and an upper body length L (ratio L/Lr); FIG. 4 is a diagram showing an example of a forward bending distance D and an upper body length L (ratio L/Lr); It is a schematic diagram explaining standing body forward bending. It is a figure which shows an example of the display screen of the evaluation result displayed on a user terminal.

Hereinafter, each embodiment of the present invention will be described with reference to the accompanying drawings. Regarding the descriptions of the specifications and drawings according to each embodiment, components having substantially the same functional configuration are denoted by the same reference numerals, thereby omitting redundant description.

<System Overview>
First, an outline of an information processing system according to this embodiment will be described. The information processing system according to the present embodiment is a system that evaluates whether the user's upright forward bending is good or bad based on the user moving image 121 and notifies the user of the evaluation result. The user moving image 121 is a moving image of standing body forward bending performed by the user photographed from the side of the user. A user is a person performing a standing body forward bend. Standing body forward bending is a stretch that stretches the back muscles by bending the upper body forward, and is used in Pilates and the like.

FIG. 1 is a schematic diagram for explaining standing body forward bending. As shown in FIG. 1, the standing body forward bending is performed by performing a forward bending motion (rolling down) from a state in which the user stands upright, stopping in the forwardly bent state, and performing a rising motion (rolling up). , a series of motions until it shifts to an upright position again.

<System configuration>
FIG. 2 is a diagram showing an example of the configuration of the information processing system according to this embodiment. As shown in FIG. 2, the information processing system according to this embodiment includes an evaluation device 1 and a user terminal 2, which are connected to each other via a network N so as to be able to communicate with each other. The network N is, for example, a wired LAN (Local Area Network), a wireless LAN, the Internet, a public line network, a mobile data communication network, or a combination thereof. In the example of FIG. 2, the information processing system includes one evaluation device 1 and one user terminal 2, but may include a plurality of each.

The evaluation device 1 is an information processing device that evaluates whether the user's upright forward bending is good or bad based on the user moving image 121 and notifies the user of the evaluation result. The evaluation device 1 is, for example, a PC (Personal Computer), a smart phone, a tablet terminal, a server device, or a microcomputer, but is not limited thereto. The evaluation device 1 will be described later in detail.

The user terminal 2 is an information processing device that transmits the user moving image 121 to the evaluation device 1 and displays the evaluation result of standing body forward bending. The user terminal 2 is, for example, a PC, smart phone, tablet terminal, server device, or microcomputer, but is not limited thereto. The user terminal 2 may acquire the user moving image 121 from the external device and transmit the acquired user moving image 121 to the evaluation device 1 . Further, the user terminal 2 may be equipped with a camera, and transmit the user moving image 121 captured by the camera to the evaluation device 1 . In this case, the user may shoot his or her user moving image 121 himself or may have a photographer other than the user shoot his or her user moving image 121 . Further, the user terminal 2 that transmits the user moving image 121 and the user terminal 2 that displays the evaluation result may be different information processing devices.

<Hardware configuration>
Next, the hardware configuration of the information processing device 100 will be described. FIG. 3 is a diagram showing an example of the hardware configuration of the information processing apparatus 100. As shown in FIG. As shown in FIG. 3, the information processing apparatus 100 includes a processor 101, a memory 102, a storage 103, a communication I/F 104, an input/output I/F 105, and drives, which are interconnected via a bus B. a device 106;

The processor 101 expands various programs including an OS (Operating System) stored in the storage 103 into the memory 102 and executes them, thereby controlling each configuration of the information processing apparatus 100 and executing the functions of the information processing apparatus 100 . Realize. The processor 101 is, for example, a CPU (Central Processing Unit), MPU (Micro Processing Unit), GPU (Graphics Processing Unit), ASIC (Application Specific Integrated Circuit), DSP (Digital Signal Processor), or a combination thereof.

The memory 102 is, for example, ROM (Read Only Memory), RAM (Random Access Memory), or a combination thereof. ROM is, for example, PROM (Programmable ROM), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), or a combination thereof. RAM is, for example, DRAM (Dynamic RAM), SRAM (Static RAM), or a combination thereof.

The storage 103 stores various programs including an OS and data. The storage 103 is, for example, flash memory, HDD (Hard Disk Drive), SSD (Solid State Drive), SCM (Storage Class Memories), or a combination thereof.

The communication I/F 104 is an interface for connecting the information processing device 100 to an external device via the network N and controlling communication. The communication I/F 104 is, for example, Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), Ethernet (registered trademark), or an adapter conforming to optical communication, but is not limited thereto. .

The input/output I/F 105 is an interface for connecting the input device 107 and the output device 108 to the evaluation device 1 . The input device 107 is, for example, a mouse, keyboard, touch panel, microphone, scanner, camera, various sensors, operation buttons, or a combination thereof. Output device 108 is, for example, a display, projector, printer, speaker, vibrator, or a combination thereof.

The drive device 106 reads and writes data on the disk media 109 . Drive device 106 is, for example, a magnetic disk drive, an optical disk drive, a magneto-optical disk drive, or a combination thereof. The disk medium 109 is, for example, a CD (Compact Disc), DVD (Digital Versatile Disc), FD (Floppy Disk), MO (Magneto-Optical disk), BD (Blu-ray (registered trademark) Disc), or a combination thereof. is.

In this embodiment, the program may be written in the memory 102 or the storage 103 at the manufacturing stage of the information processing device 100, may be provided to the information processing device 100 via the network N, or may be stored in a disk medium. 109 or other non-transitory computer-readable recording medium.

<Functional configuration>
Next, the functional configuration of the evaluation device 1 will be described. FIG. 4 is a diagram showing an example of the functional configuration of the evaluation device 1. As shown in FIG. As shown in FIG. 4 , the evaluation device 1 includes a communication section 11 , a storage section 12 and a control section 13 .

Communication unit 11 is implemented by communication I/F 104 . The communication unit 11 transmits and receives information to and from the user terminal 2 via the network N. FIG. The communication unit 11 receives the user video 121 from the user terminal 2 . Also, the communication unit 11 transmits the evaluation result information 124 to the user terminal 2 .

The storage unit 12 is implemented by the memory 102 and storage 103 . The storage unit 12 stores a user moving image 121, skeleton information 122, distance information 123, and evaluation result information 124. FIG.

The user moving image 121 is a moving image of standing body forward bending performed by the user photographed from the side of the user. The user moving image 121 may be a moving image in which at least one of the forward bending motion and the standing up motion of the user is captured. Also, the user moving image 121 may be a moving image obtained by photographing a plurality of upright body forward bends.

The skeleton information 122 is information indicating the coordinates of a plurality of feature points in the user's body (skeleton) captured in the user moving image 121 . Feature points include, but are not limited to, the head, eyes, nose, mouth, shoulders, throat, elbows, wrists, fingers, waist, hips, knees, ankles, heels, or toes. The skeleton information 122 is stored as time series information corresponding to each frame of the user moving image 121 .

The distance information 123 is information indicating the body length L and the forward bending distance D calculated by the first calculator 133 and the second calculator 134, which will be described later. The torso length L and the forward bending distance D are stored as time-series information corresponding to each frame of the user moving image 121 . The upper body length L and the forward bending distance D will be described later in detail.

The evaluation result information 124 is information indicating an evaluation result obtained by evaluating the user's upright forward bending. The evaluation result may be an evaluation value for each evaluation item, or may be a comment or advice for each evaluation item. Evaluation items include, for example, at least one of back extension, speed, and depth of forward bending.

The control unit 13 is implemented by the processor 101 reading and executing a program from the memory 102 and cooperating with other hardware configurations. The control unit 13 controls the overall operation of the evaluation device 1 . The control unit 13 includes an acquisition unit 131 , an extraction unit 132 , a first calculation unit 133 , a second calculation unit 134 , a determination unit 135 , an evaluation unit 136 and a notification unit 137 .

The acquisition unit 131 acquires the user video 121 received by the communication unit 11 from the user terminal 2 and stores it in the storage unit 12 .

The extracting unit 132 extracts the skeleton information 122 of the user appearing in the user moving image 121 from the user moving image 121 stored in the storage unit 12 by skeleton extraction (orientation estimation) processing, and stores the information in the storage unit 12 . The extraction unit 132 can use any skeleton extraction method.

The first calculator 133 calculates the torso length L of the user corresponding to each frame of the user moving image 121 based on the skeleton information 122 corresponding to each frame of the user moving image 121 . The torso length L is the distance between two points on the user's upper body and corresponds to the first distance. More specifically, the torso length L is the distance from the lower feature point to the upper feature point on the user's upper body. For example, the lower feature point is the waist or buttocks, and the upper feature point is the shoulder, throat, eyes, nose, mouth, or head, but is not limited to this. The first calculation unit 133 stores the distance information indicating the body length L corresponding to each frame of the user moving image 121 in the storage unit 12 as time-series information.

FIG. 5 is a diagram for explaining the torso length L. As shown in FIG. As shown in FIG. 5, the upper body length L is the linear distance on the image (frame) from the lower feature point to the upper feature point on the user's upper body. Although the upper body length L is the distance from the waist to the shoulder in the example of FIG. 5, it is not limited to this.

The second calculator 134 calculates the forward bending distance D of the user corresponding to each frame of the user moving image 121 based on the skeleton information 122 corresponding to each frame of the user moving image 121 . The forward bending distance D is the distance from the reference line R to the user's upper body, and corresponds to the second distance. More specifically, the forward bending distance D is the distance from the reference line R to the feature point on the user's upper body. For example, the feature points on the user's upper body are shoulders, throat, eyes, nose, mouth, or head, but are not limited to these. The reference line R can be any straight line that varies in distance to the user's upper body depending on how much the user bends forward. The reference line R is, for example, an arbitrary perpendicular line on the image (frame) of the user moving image 121 . Also, the reference line R may be a straight line passing through the user's hips or buttocks and the user's shoulders, throat, eyes, nose, mouth or head before starting the forward bending motion. The second calculation unit 134 stores distance information indicating the forward bending distance D corresponding to each frame of the user moving image 121 in the storage unit 12 as time-series information.

FIG. 6 is a diagram for explaining the forward bending distance D. FIG. As shown in FIG. 6, the forward bending distance D is the linear distance from the feature point on the user's upper body to the reference line R on the image (frame). In the example of FIG. 6, the forward bending distance D is the distance from the user's shoulders to a straight line passing through the user's waist and shoulders before starting the forward bending motion, but is not limited to this.

Based on the forward bending distance D, the determination unit 135 determines each movement portion of the user in the user moving image 121 . More specifically, the determination unit 135 determines at least one of the forward bending motion portion and the rising motion portion included in the user moving image 121 . The forward bending motion portion is a portion of the user moving image 121 in which the user is performing the forward bending motion. The sit-up motion portion is a portion of the user moving image 121 in which the user is performing the sit-up motion. A determination method will be described later.

The evaluation unit 136 evaluates whether the user's upright forward bending is good or bad based on the torso length L, and stores evaluation result information 124 indicating the evaluation result in the storage unit 12 . The evaluation method will be described later.

The notification unit 137 transmits the evaluation result information 124 stored in the storage unit 12 to the user terminal 2 and notifies the user of the evaluation result.

<Processing executed by the evaluation device>
Next, processing executed by the evaluation device 1 will be described. FIG. 7 is a flowchart showing an example of processing executed by the evaluation device 1. As shown in FIG.

(Step S101)
The acquisition unit 131 acquires the user video 121 received by the communication unit 11 from the user terminal 2 and stores it in the storage unit 12 .

(Step S102)
The extraction unit 132 extracts the skeleton information 122 of the user appearing in the user moving image 121 from the user moving image 121 stored in the storage unit 12 by the skeleton extraction process, and stores the information in the storage unit 12 .

(Step S103)
The first calculator 133 calculates the body length L corresponding to each frame of the user moving image 121 based on the skeleton information 122 stored in the storage unit 12 . The first calculation unit 133 stores the calculated body length L in the storage unit 12 as the distance information 123 .

(Step S104)
The second calculator 134 sets the reference line R in the user moving image 121 based on the skeleton information 122 stored in the storage unit 12 . The second calculation unit 134 may set a straight line passing through the waist or buttocks of the user and the shoulders, throat, eyes, nose, mouth or head of the user in the first frame of the user video 121 as the reference line R. good. In addition, the second calculation unit 134 detects the start timing of the forward bending motion by some method, and the user's waist or buttocks and the user's shoulders, throat, eyes, nose, mouth, or the like in the frame immediately before the detected start timing. A straight line passing through the head may be set as the reference line R. In either method, the second calculation unit 134 sets a straight line passing through the user's waist or buttocks and the user's shoulders, throat, eyes, nose, mouth, or head as the reference line R before the start of the forward bending motion. Can be set.

(Step S105)
The second calculation unit 134 calculates the forward bending distance D of the user corresponding to each frame of the user moving image 121 based on the reference line R set in step S104 and the skeleton information 122 corresponding to each frame of the user moving image 121. Calculate The second calculation unit 134 stores the calculated forward bending distance D in the storage unit 12 as the distance information 123 .

(Step S106)
The determination unit 135 determines each movement portion of the user in the user moving image 121 based on the forward bending distance D calculated in step S105.

Here, FIGS. 8 and 9 are diagrams showing an example of the forward bending distance D and the body length L (ratio L/Lr). FIG. 8 is a diagram showing the forward bending distance D and the upper body length L (ratio L/Lr) when the user performs good standing forward bending. FIG. 9 is a diagram showing the forward bending distance D and the upper body length L (ratio L/Lr) when the user performs bad standing forward bending. In the examples of FIGS. 8 and 9, the forward bending distance D and the upper body length L when the user performs standing forward bending three times are shown in chronological order.

As shown in FIGS. 8 and 9, the forward bending distance D is small while standing upright, rapidly increases during forward bending, remains substantially constant while standing, and rapidly decreases during standing up. For this reason, the determining unit 135 determines, for example, a portion in which the forward bending distance D rises from a stable value equal to or less than the threshold value to a peak with a predetermined momentum as a forward bending motion portion, The user moving image 121 is determined by discriminating the portion that descends to the value with a predetermined force as the rising portion, discriminating the portion between the forward bending motion portion and the rising motion portion as the stopping portion, and discriminating the remaining portion as the standing portion. Each operation part can be distinguished as shown in FIGS. 8 and 9. FIG. Note that the determination method is not limited to the above example.

(Step S107)
The first calculator 133 sets the reference length Lr based on the torso length L stored in the storage unit 12 and the discrimination result of each motion part by the discriminator 135 . The reference length Lr is a reference length of the torso length L, and corresponds to the torso length L of the user in an upright state. The first calculator 133 may set the reference length Lr based on the torso length L of the first upright portion in the user moving image 121 . The reference length Lr is, for example, the body length L of the last frame of the first upright portion, the body length L of the first frame of the first upright portion, or the average value of the body length L of the first upright portion. is not limited to

(Step S108)
Based on the torso length L stored in the storage unit 12 and the reference length Lr calculated in step S107, the first calculation unit 133 calculates the torso length L and the reference length Lr corresponding to each frame of the user video 121. , the ratio L/Lr is calculated. The first calculation unit 133 stores the calculated ratio L/Lr in the storage unit 12 as the distance information 123 .

(Step S109)
The evaluation unit 136 evaluates the forward bending of the user based on the ratio L/Lr stored in the storage unit 12 and the determination result of each motion part by the determination unit 135 . Evaluation items include back extension, speed, and depth of forward bending.

Here, a method for evaluating standing body forward bending will be described. FIG. 10 is a schematic diagram for explaining standing body forward bending. FIG. 1 is a schematic diagram explaining good upright forward bending. FIG. 10 is a schematic diagram illustrating bad upright forward bending.

(1) Lengthening of the back As shown in Fig. 1, in order to stretch the muscles of the back, it is best to bend the neck forward and round the back while performing the forward bending motion in standing posture forward bending. preferable. Therefore, when the user appropriately performs the forward bending motion, the body length L during the forward bending motion becomes shorter than the reference length Lr, which is the body length L before the start of the forward bending motion. That is, as shown in FIG. 8, the ratio L/Lr during the forward bending motion becomes smaller than 1.

Similarly, standing body forward bending is preferably performed with the neck bent forward and the back rounded. Therefore, when the user properly performs the sit-up motion, the body length L during the sit-up motion is shorter than the reference length Lr, which is the body length L before the start of the forward bending motion. That is, as shown in FIG. 8, the ratio L/Lr becomes smaller than 1 during the rising motion.

On the other hand, as shown in FIG. 10, when the forward bending motion is performed with the neck and back straight, the muscles of the back do not stretch so much, so that a sufficient effect cannot be obtained. Therefore, when the user does not perform the forward bending motion appropriately, the reference length Lr, which is the body length L before the start of the forward bending motion, and the body length L during the rising motion become substantially equal. That is, as shown in FIG. 9, the ratio L/Lr is approximately 1 during the rising motion.

Similarly, standing body forward bending is not sufficiently effective if the standing motion is performed with the neck and back straight. Therefore, when the user does not properly perform the sit-up motion, the reference length Lr, which is the body length L before the start of the sit-up motion, and the body length L during the sit-up motion become substantially equal. That is, as shown in FIG. 9, the ratio L/Lr is approximately 1 during the rising motion.

Therefore, when the ratio L/Lr during the forward bending motion is smaller than 1, the evaluation unit 136 highly evaluates the stretching degree of the user's back during forward bending (forward bending motion). The evaluation unit 136 may give a higher evaluation when the average value of the ratio L/Lr during the forward bending motion is less than 1, or give a higher evaluation when the period during which the ratio L/Lr is less than 1 during the forward bending motion is longer. You can make it higher. Thus, in the example of FIG. 8, all three forward bending actions are highly evaluated. On the other hand, in the example of FIG. 9, only the first forward bending motion is evaluated highly, and the remaining two forward bending motions are evaluated low.

Similarly, when the ratio L/Lr during the standing-up motion is smaller than 1, the evaluation unit 136 highly evaluates the stretching degree of the back in the user's upright forward bending (standing-up motion). The evaluation unit 136 may give a higher evaluation when the average value of the ratio L/Lr during the sit-up motion is smaller than 1, or may give a higher evaluation when the period during which the ratio L/Lr is smaller than 1 during the sit-up motion is longer. may Thus, in the example of FIG. 8, all three standing-up actions are highly evaluated. On the other hand, in the example of FIG. 9, all three standing-up actions are evaluated low.

(2) Speed In standing forward bending, it is not preferable to perform the forward bending motion with momentum. In other words, it is preferable to perform forward bending at a slow and constant pace. Therefore, for example, the evaluation unit 136 evaluates the speed of the user's upright forward bending (forward bending motion) higher as the time of the forward bending motion increases. In addition, the evaluation unit 136 may evaluate the speed of the user's standing body forward bending (forward bending motion) higher as the speed of the forward bending motion (slope of the forward bending distance D) is more constant.

Similarly, in standing body forward bending, it is not preferable to perform the rising motion with momentum. In other words, it is preferable to perform the sit-up motion at a slow and constant pace. Therefore, for example, the evaluation unit 136 evaluates the speed of the user's upright forward bending (sitting motion) higher as the time of the sitting motion increases. In addition, the evaluation unit 136 may evaluate the speed of the user's upright forward bending (standing-up motion) higher as the speed of the standing-up motion (slope of the forward bending distance D) is more constant.

(3) Depth of forward bending In order to stretch the muscles of the back, the deeper the forward bending, the better. Therefore, for example, the evaluation unit 136 highly evaluates the depth of forward bending in the user's upright forward bending as the inclination of the upper body while stopped is closer to vertical. The inclination of the upper body is, for example, the inclination of a straight line connecting two points on the user's upper body used to calculate the forward bending distance D, but is not limited to this.

The evaluation unit 136 stores in the storage unit 12 the evaluation result information 124 indicating the evaluation result of the user's upright forward bending evaluated by the method described above. Note that the evaluation method by the evaluation unit 136 is not limited to the above example.

(Step S110)
The notification unit 137 notifies the user of the evaluation result by transmitting the evaluation result information 124 stored in the storage unit 12 to the user terminal 2 . Upon receiving the evaluation result information 124, the user terminal 2 displays the evaluation result indicated by the evaluation result information 124 on the display.

FIG. 11 is a diagram showing an example of an evaluation result display screen displayed on the user terminal 2. As shown in FIG. The display screen of FIG. 11 has a playback area Im1 for the user moving image 121, an evaluation value area Im2, and an evaluation comment area Im3. The reproduction area Im1 reproduces the user moving image 121 . The evaluation value area Im2 displays the total standing body forward bending and the evaluation value (evaluation result) of each evaluation item. The evaluation comment area Im3 displays a comment (evaluation result) on the user's upright forward bending. Note that the evaluation result displayed on the display screen of the user terminal 2 is not limited to the example of FIG. 11 .

<Summary>
As described above, the evaluation device 1 calculates the body length L based on the skeleton information 122 extracted from the user moving image 121, and evaluates the user's upright forward bending based on the body length L. FIG. Thus, the evaluation device 1 can evaluate how the back stretches in forward bending of the upright body.

In addition, the evaluation apparatus 1 calculates the forward bending distance D based on the skeleton information 122 extracted from the user moving image 121, and determines each action portion in the user moving image 121 based on the forward bending distance D. FIG. As a result, the evaluation device 1 can automatically determine each action portion of the user moving image 121 .

In addition, the evaluation apparatus 1 calculates the forward bending distance D based on the skeleton information 122 extracted from the user moving image 121, and evaluates the user's standing forward bending based on the forward bending distance D. FIG. Thereby, the evaluation device 1 can evaluate the velocity and depth in standing body forward bending.

<Appendix>
This embodiment includes the following disclosure.

(Appendix 1)
An information processing method executed by an information processing device,
Acquisition processing for acquiring a moving image of a motion including at least one of a forward bending motion and a rising motion of the user;
an extraction process for extracting skeleton information of the user from the moving image;
a first calculation process of calculating a first distance, which is a distance between two points on the user's upper body, based on the skeleton information;
an evaluation process for evaluating the user's motion based on the first distance;
Information processing methods, including

(Appendix 2)
2. The information processing method according to Supplementary Note 1, wherein the evaluation process evaluates the forward bending motion highly when the first distance during the forward bending motion is shorter than the first distance before the start of the forward bending motion.

(Appendix 3)
The information processing according to appendix 1 or appendix 2, wherein the evaluation process evaluates the sit-up motion highly when the first distance during the sit-up motion is shorter than the first distance before the start of the forward bending motion. Method.

(Appendix 4)
The information processing method according to any one of appendices 1 to 3, wherein the first distance is a distance from the user's waist or buttocks to the user's shoulders, throat, eyes, nose, mouth, or head.

(Appendix 5)
The information processing method according to any one of appendices 1 to 4, wherein the moving image is a moving image of the user photographed from the side.

(Appendix 6)
6. The information processing method according to any one of appendices 1 to 5, further including a second calculation process of calculating a second distance, which is a distance from a reference line to the user's upper body, based on the skeleton information.

(Appendix 7)
The information processing method according to appendix 6, wherein the second distance is a distance from the reference line to the user's shoulder, throat, eyes, nose, mouth, or head.

(Appendix 8)
7. Information according to appendix 6 or appendix 7, wherein the reference line is a vertical line or a straight line passing through the user's hips or buttocks and the user's shoulders, throat, eyes, nose, mouth or head before the start of the forward bending motion. Processing method.

(Appendix 9)
8. The information processing method according to any one of appendices 6 to 8, further comprising a determination process of determining at least one of a forward bending motion portion and a rising motion portion included in the moving image based on the second distance.

(Appendix 10)
an acquisition unit that acquires a moving image of a motion including at least one of a forward bending motion and a rising motion of the user;
an extraction unit that extracts the skeleton information of the user from the moving image;
a first calculator that calculates a first distance, which is a distance between two points on the user's upper body, based on the skeleton information;
an evaluation unit that evaluates the motion of the user based on the first distance;
Information processing device.

(Appendix 11)
An information processing method executed by an information processing device,
Acquisition processing for acquiring a moving image of a motion including at least one of a forward bending motion and a rising motion of the user;
an extraction process for extracting skeleton information of the user from the moving image;
a first calculation process of calculating a first distance, which is a distance between two points on the user's upper body, based on the skeleton information;
an evaluation process for evaluating the user's motion based on the first distance;
A program for causing a computer to execute an information processing method including

The embodiments disclosed this time are illustrative in all respects and should be considered not restrictive. The scope of the present invention is indicated by the scope of the claims rather than the meaning described above, and is intended to include all modifications within the scope and meaning equivalent to the scope of the claims. In addition, the present invention is not limited to the above-described embodiments, but can be modified in various ways within the scope of the claims, and can be obtained by appropriately combining technical means disclosed in different embodiments. Embodiments are also included in the technical scope of the present invention.

1: Evaluation Device 2: User Terminal 11: Communication Unit 12: Storage Unit 13: Control Unit 101: Processor 102: Memory 103: Storage 104: Communication I/F
105: Input/output I/F
106: Drive Device 107: Input Device 108: Output Device 109: Disk Media 121: User Video 122: Skeleton Information 123: Distance Information 124: Evaluation Result Information 131: Acquisition Unit 132: Extraction Unit 133: First Calculation Unit 134: Third 2 calculation unit 135: determination unit 136: evaluation unit 137: notification unit

Claims (11)

An information processing method executed by an information processing device,
Acquisition processing for acquiring a moving image of a motion including at least one of a forward bending motion and a rising motion of the user;
an extraction process for extracting skeleton information of the user from the moving image;
a first calculation process of calculating a first distance, which is a distance between two points on the user's upper body, based on the skeleton information;
an evaluation process for evaluating the user's motion based on the first distance;
Information processing methods, including 2. The information processing method according to claim 1, wherein the evaluation process evaluates the forward bending motion highly when the first distance during the forward bending motion is shorter than the first distance before the start of the forward bending motion. . 3. The evaluation process according to claim 1, wherein, if the first distance during the rising motion is shorter than the first distance before the start of the forward bending motion, the rising motion is highly evaluated. Information processing methods. The information processing method according to any one of claims 1 to 3, wherein the first distance is a distance from the user's waist or buttocks to the user's shoulder, throat, eyes, nose, mouth, or head. . 5. The information processing method according to any one of claims 1 to 4, wherein said moving image is a moving image of said user photographed from the side. 6. The information processing method according to any one of claims 1 to 5, further comprising a second calculation process of calculating a second distance, which is a distance from a reference line to the user's upper body, based on the skeleton information. 7. The information processing method according to claim 6, wherein said second distance is a distance from said reference line to said user's shoulder, throat, eyes, nose, mouth or head. 8. The reference line according to claim 6 or 7, wherein the reference line is a vertical line or a straight line passing through the user's hips or buttocks and the user's shoulders, throat, eyes, nose, mouth or head before the start of the forward bending motion. information processing method. 9. The information processing method according to any one of claims 6 to 8, further comprising determining processing for determining at least one of a forward bending motion portion and a rising motion portion included in the moving image based on the second distance. an acquisition unit that acquires a moving image of a motion including at least one of a forward bending motion and a rising motion of the user;
an extraction unit that extracts the skeleton information of the user from the moving image;
a first calculator that calculates a first distance, which is a distance between two points on the user's upper body, based on the skeleton information;
an evaluation unit that evaluates the motion of the user based on the first distance;
Information processing device. An information processing method executed by an information processing device,
Acquisition processing for acquiring a moving image of a motion including at least one of a forward bending motion and a rising motion of the user;
an extraction process for extracting skeleton information of the user from the moving image;
a first calculation process of calculating a first distance, which is a distance between two points on the user's upper body, based on the skeleton information;
an evaluation process for evaluating the user's motion based on the first distance;
A program for causing a computer to execute an information processing method including

Images