JP2019093152A - Information processing device, information processing method and program - Google Patents

Abstract

To provide a specification capable of identifying walking speed of a subject even when passage of the subject cannot be identified at a prescribed timing.SOLUTION: The invention is configured so that, when passage of the subject cannot be identified at a first prescribed timing, when passage of the subject can be identified at another timing, walking speed of the subject is identified based on a distance and a required time between the another timing and a second prescribed timing.SELECTED DRAWING: Figure 12

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program, and more particularly to a mechanism capable of specifying the walking speed of a target person even when the passage of the target person can not be specified at a predetermined timing.

  In recent years, the effect measurement in care and rehabilitation has been performed using a motion capture technology that digitally records the movement of a person or an object.

  As one of the motion capture technology methods, a marker is attached to a subject (also called a target person) and a marker is detected by shooting from multiple directions by a camera, and the motion of the subject is converted into digital data and recorded. is there. There is also a method of measuring the distance from the sensor to the subject using an infrared sensor without using a marker, and recording the motion of the subject based on the measured value.

  Patent Document 1 discloses a mechanism using motion capture technology at a rehabilitation site.

JP, 2015-61577, A

  By the way, in the item of effect measurement, the walking speed is specified from the time taken when the subject walked from the first predetermined position to the second predetermined position, and the item for effect measurement is performed (hereinafter referred to as “normal walking There is a

  However, in the case of measuring the distance from the sensor to the subject using the infrared sensor described in Patent Document 1 and recording the movement of the subject based on the measured value, the subject is an infrared sensor. In order to identify the subject's movement assuming that it is facing to the front, the subject's event is to be performed for the effect measurement in a state where the subject is facing sideways to the infrared sensor as in normal walking. It was hard to identify the movement.

  Therefore, when the subject passes the first predetermined position, there is a possibility that the motion of the subject can not always be identified, and in the conventional mechanism, the first predetermined position is fixed, so the walking speed of the subject There was a risk that it could not identify the effect correctly.

  An object of the present invention is to provide a mechanism capable of specifying the walking speed of a subject even when the passage of the subject can not be specified at a predetermined timing.

  The information processing apparatus according to the present invention uses generation means for generating superimposed moving picture data on which position information of a subject who is performing a walking motion is superimposed, and the superimposed moving picture data generated by the generating means. Passage specifying means for specifying a first timing at which the subject passes the first position above and a second timing at which the subject passes the second position on the superimposed moving image data; Identifying a first required time taken for the subject to walk a predetermined distance between the first position and the second position from the first timing and the second timing specified in An information processing apparatus comprising: time specifying means; and walking speed specifying means for specifying the walking speed of the subject based on the predetermined distance and the first required time specified by the time specifying means. , Said passing special Even when the first timing can not be specified by the means, the passing of the object person can be specified at the position between the first position and the second position using the superimposed moving image data The time specifying means determines a second required time from the passage timing of the position between the first position and the second position where the passage of the subject is specified and the second timing. The walking speed specifying means determines the walking speed based on the second required time and the distance between the first position and the second position and the second position. To identify.

  Further, an information processing method according to the present invention is a control method of an information processing apparatus including a generation unit that generates superimposed moving image data on which position information of a subject who is performing a walking motion is superimposed. The passage specifying means uses the superimposed moving image data generated by the generation means, and a first timing at which the subject passes the first position on the superimposed moving image data, and a second position on the superimposed moving image data A second identification step of identifying a second timing at which the target person passes, and a first identification timing of the information processing apparatus from the first timing identified in the second identification step and the second timing. A time specifying step of specifying a first required time taken for the subject to walk a predetermined distance between the second position and the second position, and the walking speed specifying means of the information processing apparatus distance And a walking speed specifying step for specifying the walking speed of the subject based on the first required time specified in the time specifying step, and the first timing can not be specified in the passage specifying step. Even in the case where the passage of the subject can be specified at the position between the first position and the second position using the superimposed moving image data, the time specifying step may A second required time is specified from the passage timing of the position between the first position and the second position where the passage of the subject is specified and the second timing, and the walking speed specifying step is A walking speed is specified based on the second required time, and a distance between a position between the first position and the second position, and the second position.

  Furthermore, a program according to the present invention is a program read and executed by an information processing apparatus including a generation unit that generates superimposed moving image data on which position information of a subject who is performing a walking motion is superimposed, Using the superimposed moving image data generated by the generation means, a first timing at which the subject passes the first position on the superimposed moving image data, and a second position on the superimposed moving image data A predetermined distance between the first position and the second position from the passage specifying means for specifying the second timing through which the vehicle passes and the first timing and the second timing specified by the passage specifying means The object is determined based on a time specifying means for specifying a first required time taken for the subject to walk, the predetermined distance and the first required time specified by the time specifying means. Function as the walking speed specifying means for specifying the walking speed of the vehicle, and even if the passage specifying means can not specify the first timing, the first position and the second using the superimposed moving image data If the passage of the subject can be identified at a position between the first position and the second position, the time specifying means determines between the first position and the second position at which the subject's passage is specified. A second required time is specified from position passing timing and the second timing, and the walking speed specifying means determines between the second required time, the first position, and the second position. A walking speed is specified based on the distance between the position and the second position.

  According to the present invention, it is possible to specify the walking speed of the object person even when the passage of the object person can not be identified at a predetermined timing.

A diagram showing a functional configuration of the information processing apparatus 101 A diagram showing a hardware configuration of the information processing apparatus 101 Flow chart showing the process of performing measurement while photographing the subject Flow chart showing measurement processing of various eyes when using previously recorded motion information Flow chart showing the report creation process Figure showing an example of the subject list A diagram showing an example of coordinate information of each joint A diagram showing the state of the subject acquired by the motion information acquisition unit 151 A diagram showing an example of skeleton information of a subject formed from coordinate information of each joint In the present invention, it is a figure showing an example of a screen which receives from an user selection of a subject displayed on display 212 of information processor 101. In the present invention, it is a figure showing an example of processing which CPU201 of information processor 101 performs, when selection of a item of "normal walk" is received from a user at Step S301. In the present invention, it is a figure showing an example of a screen displayed on display 212 of information processor 101, when selection of an item of "normal walk" is received from a user at Step S301. FIG. 13 is a diagram showing an example of processing executed by the CPU 201 of the information processing apparatus 101 when the selection of the item “open eye one foot standing” is received from the user in step S301 in the present invention. In the present invention, it is a figure showing an example of a screen displayed on display 212 of information processing device 101 when information processing device 101 starts photography of a subject at Step S302. FIG. 13 is a diagram showing an example of processing in which the CPU 201 of the information processing apparatus 101 extracts a measurement result in step S502 in the present invention. FIG. 13 is a diagram showing an example of processing in which the CPU 201 of the information processing apparatus 101 creates a report in step S503 in the present invention. FIG. 8 is a diagram showing an example of a screen displayed on the display 212 of the information processing apparatus 101 when extracting a measurement result in the present invention. In the present invention, it is a figure showing an example of the screen displayed on display 212 of information processor 101 after extracting a measurement result. FIG. 8 is a diagram showing an example of a measurement result management table storing measurement results in the storage device 204 of the information processing apparatus 101 in the present invention. FIG. 6 is a diagram showing an example of a report created by the CPU 201 of the information processing apparatus 101 and output to a printing apparatus or the like in the present invention. An example of a screen obtained by combining the image captured and acquired by the motion information acquisition unit 151 and the skeleton information An example of a screen in which the area of the region in which skeletal information is displayed is adjusted An example of a screen displaying the video to be evaluated and the video to be compared vertically An example of a screen that displays a video to be evaluated and a video to be compared side by side Diagram showing an example of a table where layouts are registered for each item The figure which shows the case where the horizontal motion of the upper moving image on the screen of FIG. 23 is reversed. An example of a screen on which the moving image to be compared is superimposed and displayed An example of a screen displaying only skeletal information without displaying the background etc. Flow chart showing the process of evaluating the motion of the subject and displaying the message for the subject and the caregiver Diagram showing an example of evaluation conditions Diagram showing an example of a message table

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram showing a functional configuration of the information processing apparatus 101. As shown in FIG.

  The motion information acquisition unit 151 detects the movement of a person (in the present invention, a subject (a person who receives care or rehab) in a space where care or rehabilitation is performed) and acquires motion information of the subject.

  Specifically, the motion information acquisition unit 151 is a sensor group known as Kinect (registered trademark), and incorporates an RGB camera, a depth sensor, an audio sensor, etc., and a subject (in the present invention, a subject (career or rehab Can receive the position, movement, voice, face etc.

  The depth sensor uses a method of measuring the distance to the subject using infrared light. According to this method, it is possible to measure the distance from the sensor to the subject without attaching a marker or the like to the subject.

  Each data acquired by the motion information acquisition unit 151 is also referred to as moving image data (also referred to as superimposed moving image data or superimposed image data, and the superimposed moving image data or superimposed image data from each data acquired by the motion information acquisition unit 151 It stores in the storage unit as moving image data extracted from the specified skeleton information).

  Motion information acquired by each sensor of the motion information acquisition unit 151 is transmitted to the motion information analysis unit 152, and data analysis is performed.

  The motion information analysis unit 152 analyzes each data acquired by the motion information acquisition unit 151, and converts the motion of the subject into coordinate information.

  FIG. 8 shows the state of the subject acquired by the motion information acquisition unit 151. The motion information acquisition unit 151 detects the motion of the subject and matches the human body pattern stored in advance to obtain the coordinates of the human body surface of the subject. Then, the coordinates of each joint forming the skeleton of the subject are calculated, and the skeleton of the subject is formed based on the calculated coordinate information.

  An example of coordinate information of each joint is shown in FIG. Further, an example of skeleton information of a subject formed from coordinate information of each joint is shown in FIG.

  By calculating the coordinate information of each joint in this manner and detecting the change in the coordinate of each joint, it becomes possible to recognize the action of the subject raising the foot or bending the knee.

  The measuring unit 153 performs the measurement in the item based on the motion information analyzed by the motion information analyzing unit 152 and the setting according to the various eyes.

  FIG. 2 is a block diagram showing an example of the hardware configuration of the information processing apparatus 101 according to the embodiment of the present invention.

As shown in FIG. 2, in the information processing apparatus 101, a CPU (central processing unit) 201 and a ROM (Read Only) via the system bus 200.
A memory 202, a random access memory (RAM) 203, a storage device 204, an input controller 205, an audio input controller 206, a video controller 207, a memory controller 208, and a communication I / F controller 209 are connected.

  The CPU 201 centrally controls the devices and controllers connected to the system bus 200.

  The ROM 202 or the storage device 204 is a control program executed by the CPU 201, such as a BIOS (Basic Input / Output System) or an OS (Operating System), a computer readable and executable program for realizing the information processing method, and various necessary items. It holds data (including data tables).

  The RAM 203 functions as a main memory, a work area, and the like of the CPU 201. The CPU 201 loads programs and the like necessary for execution of processing from the ROM 202 or the storage device 204 to the RAM 203, and implements various operations by executing the loaded programs.

  The input controller 205 controls an input from an input device such as the keyboard / touch panel 210. The input device is not limited to this, and may be a touch panel capable of detecting a position touched with a plurality of fingers, such as a mouse or a multi touch screen.

  Various instructions can be given by the user pressing (touching with a finger or the like) in accordance with an icon, a cursor or a button displayed on the touch panel.

  This input device is used to input a destination for a communication destination that can be used by various communication devices.

  The voice input controller 206 controls an input from the microphone 211. It is possible to perform voice recognition of the voice input from the microphone 211.

  The video controller 207 controls display on an external output device such as the display 212. The display shall also include the display of a notebook computer integrated with the main unit. The external output device is not limited to the display, and may be, for example, a projector. Further, with regard to devices that can be received by the above-described touch operation, it is also possible to receive an input from the keyboard / touch panel 210.

  The video controller 207 can control a video memory (VRAM) for display control, and can use a part of the RAM 203 as a video memory area, or can separately provide a dedicated video memory. It is possible.

  In the present invention, the first video memory area used for display when the user normally operates the information processing apparatus and the display content superimposed on the display content of the first video memory area when the predetermined screen is displayed And a second video memory area used for The video memory area is not limited to two, and can be plural as long as the resource of the information processing apparatus permits.

  The memory controller 208 controls access to the external memory 213. The external memory is connected via an adapter to an external storage device (hard disk) that stores a boot program, various applications, font data, user files, editing files, various data, etc., a flexible disk (FD), or a PCMCIA card slot. Compact flash (registered trademark) memory etc. can be used.

  The communication I / F controller 209 connects and communicates with an external device via the network 214, and executes communication control processing in the network. For example, communications using TCP / IP, telephone lines such as ISDN, and 3G lines of mobile phones are possible.

  The storage device 204 is a medium for permanently storing information, and the form thereof is not limited to a storage device such as a hard disk. For example, a medium such as a solid state drive (SSD) may be used.

  Moreover, it can also be used as a temporary memory area at the time of various processes performed by the communication terminal in the present embodiment.

  Next, processing for measuring while photographing a subject will be described using the flowchart shown in FIG. The process illustrated in the flowchart of FIG. 3 is a process in which the CPU 201 of the information processing apparatus 101 reads and executes a predetermined program.

  In step S301, the selection of the subject and the selection of the item are received from the user.

  The subject information is assumed to be registered in the subject list shown in FIG. In addition, as an event, open the eyes and measure the time spent standing with one foot, "open one leg standing", measure the number of times you can stand and sit within the time limit, "stand up and sit", and set the maximum stride "Maximum step" to measure, "normal walk" to measure the time taken to walk 5m distance, "TUG (TimedUp & Go)" to stand up from the chair and measure the time to sit on the chair is there.

  By accepting the selection of the item, the setting file and program necessary for the measurement of the item are read.

  The subject information may be newly registered as well as selected from already registered information.

  In step S302, an imaging instruction is received from the user. When the imaging instruction is received, the motion information acquisition unit 151 of the information processing apparatus 101 starts imaging of the subject. Also, motion information that is information obtained by each sensor (coordinate information of each joint, etc.) is acquired. Step S302 is an example of a generation unit that generates superimposed moving image data on which position information of a subject who is performing a walking motion is superimposed in the present invention.

  In step S303, when there are a plurality of persons in the photographed video, selection of which person is the subject is accepted.

  The details of the process of step S303 will be described below with reference to FIG.

  FIG. 10 is a screen in which the information processing apparatus 101 receives from the user a selection of which person is the subject in step S303, and the screen of FIG. 10 is displayed on the display 212 of the information processing apparatus 101.

  A moving image acquired by the motion information acquisition unit 151 of the information processing apparatus 101 is displayed at 1003 in FIG. 10.

  At 1001 in FIG. 10, the appearance of a person (subject or assistant) acquired by the motion information acquisition unit 151 is displayed together with skeleton information specified by coordinate information of each joint.

  First, when the person switching button 1005 is pressed by the operation of the mouse pointer 1004 by the user, based on the information acquired by the motion information acquiring unit 151, skeleton information of the subject is displayed on 1001.

  Next, by the operation of the mouse pointer 1004 by the user, a subject among the persons displayed in 1001 of FIG. 10 is designated.

  Then, the user who is the person selected by the mouse pointer 1004 is selected from the drop-down list 1002 by the mouse pointer 1004 by the user.

  In the drop-down list 1002, the names of the subjects included in the subject list (FIG. 6) managed in advance by the information processing apparatus 101 are displayed.

In step S304, coordinate information of each joint of the subject is acquired from the motion information acquired in step S302. When using a playback moving image, coordinate information of each joint of a subject is acquired using motion information included in moving image data to be played back.
An example of coordinate information of each joint is shown in FIG.

  In step S305, the image acquired in step S303 and the skeleton information acquired based on the coordinate information of each joint acquired in step S304 are combined and displayed on the display 212.

  FIG. 21 shows an example of a screen obtained by combining the image captured and acquired by the motion information acquisition unit 151 and the skeleton information.

  In 2101 of FIG. 21, the image and the skeleton information are displayed in a combined state. Also, in 2102, skeletal information when the subject is viewed from above is displayed, and in 2103, skeletal information when the subject is viewed from the side is displayed.

  The skeleton information displayed in the regions 2102 and 2103 is calculated and generated based on the coordinate information of each joint acquired by the motion information acquisition unit 151.

  It is assumed that the area of the display region 2102 or 2103 is adjusted to an area that can display skeletal information. For example, the screen shown in FIG. 21 is a screen when adjustment is not performed. In this case, although the skeleton information displayed in 2103 hardly moves, a large margin occurs around the skeleton information.

  FIG. 22 shows an example of the screen when the size adjustment is performed. The frame information is adjusted to fit, and the margin is reduced.

  As described above, by controlling so as not to display useless blanks, three pieces of skeleton information can be collected close to each other, which makes it easier to observe.

  As a method of determining the display range, for example, a method can be considered in which a rectangle in which skeleton information fits is specified, and a predetermined width is displayed as a margin from the rectangle.

  In step S306, measurement according to the item selected in step S301 is performed using the skeleton information analyzed in step S304.

  Specific contents of the process will be described with reference to FIGS. 11, 13, and 29.

  Next, processing executed by the CPU 201 of the information processing apparatus 101 when the selection of the item of “normal walking” is received from the user in step S301 in the present invention will be described using FIG.

Note that the screen displayed on the display 212 of the information processing apparatus 101 in the process of FIG. 11 is, for example, FIG.
Here, FIG. 12 will be described.

  Measurement start (end) coordinates 1201 in FIG. 12 indicate (x, y, z) coordinates to start or end measurement of normal walking set in advance, and x coordinates of the toe of the subject and measurement start (end) coordinates The count of seconds is started at the timing when the x coordinate of 1201 overlaps for the first time, and the count of seconds is ended at timing when the x coordinate of measurement start (end) coordinate 1201 overlaps for the second time.

  For example, when the subject walks from the left side of the screen of FIG. 12, counting of seconds is performed when the x coordinate of measurement start (end) coordinate 1201 on the left side of the screen of FIG. When the x coordinate of the measurement start (end) coordinate 1201 on the right side of the screen in FIG. 12 and the x coordinate of the toe of the subject overlap, the counting of the number of seconds is ended.

  Due to the characteristics of the motion information acquisition unit 151, the specified distance from the left and right ends of the shooting range is lower in the accuracy of specifying the coordinates of joints, so the measurement start (end) coordinates 1201 are slightly smaller It is set to the open position (coordinates).

  Reference numeral 1202 in FIG. 12 denotes a timeline, and the timeline 1202 is displayed when evaluating the recorded shooting data.

An evaluation time designating unit 1203 in FIG. 12 is an evaluation time designating unit, which evaluates the motion of the subject in a section different from the measurement start (end) coordinates 1201 when evaluating the recorded imaging data. The user can designate the evaluation time designation unit 1203 by moving the mouse by operating the mouse or the like.
It returns to the explanation of FIG.

  In step S1101, the information processing apparatus 101 specifies the coordinates of the toe of the subject from the image of the frame currently being processed.

  In step S1102, the information processing apparatus 101 determines whether or not the coordinates of the toe of the subject can be specified from the image of the frame currently being processed in step S1101. If so, the process proceeds to step S1103. If this can not be identified, this processing ends.

  The reason for executing the process of step S1102 will be described. The motion information acquisition unit 151 specifies the position coordinates of each joint of the subject on the premise that the subject is facing the front with respect to the motion information acquisition unit 151. Therefore, when the subject is facing in the lateral direction with respect to the motion information acquisition unit 151 as in normal walking, it is difficult to acquire coordinate information of each joint of the subject by steps S304 and S305 in FIG. It is. If the coordinate information of each joint can not be acquired, the processing of step S1103 and subsequent steps can not be executed. Therefore, it is determined by the processing of step S1102 whether the processing of step S1103 and subsequent steps can be executed.

  In step S1103, the information processing apparatus 101 determines whether the coordinates of the toe of the subject specified in step S1101 are outside coordinates rather than between two measurement start (end) coordinates 1201 set in advance.

  If the toe coordinates of the subject identified in step S1101 are coordinates outside the two measurement start (end) coordinates 1201 set in advance, the information processing apparatus 101 ends the present processing, and the information processing apparatus 101 identifies in step S1101. If the toe of the subject has coordinates other than the outside of the two measurement start (end) coordinates 1201 set in advance, the information processing apparatus 101 proceeds to step S1104.

  In step S1104, the information processing apparatus 101 determines which of the two measurement start (end) coordinates 1201 the coordinates of the toe of the subject specified in step S1101 are set in advance.

  If the toe coordinates of the subject specified in step S1101 are on any of the two measurement start (end) coordinates 1201 set in advance, the information processing apparatus 101 proceeds to step S1105. If the toe coordinates of the subject specified in step S1101 are not on any of the two measurement start (end) coordinates 1201 set in advance, the information processing apparatus 101 determines that the toe of the subject specified in step S1101. It is determined that the coordinates are between two measurement start (end) coordinates 1201 set in advance, and the process proceeds to step S1109.

  In step S1105, the information processing apparatus 101 determines whether it is the first determination that any one of the two measurement start (end) coordinates 1201 set in advance in step S1104 is made.

  If it is determined in step S1104 that it is the first time that one of the two measurement start (end) coordinates 1201 determined in advance is determined to be on the first coordinate, the information processing apparatus 101 proceeds to step S1106. When it is determined that the process proceeds, and it is determined in step S1104 that it is not the first time (that is, the second time) determined to be on any of the two measurement start (end) coordinates 1201 set in advance. The process proceeds to step S1107.

  In step S1106, the information processing apparatus 101 executes counting of the number of seconds, and terminates the present process.

  In step S1107, the information processing apparatus 101 ends the counting of the number of seconds executed in step S1106. Then, in step S1108, evaluation of the motion of the subject is performed, and stored in the measurement result management table (FIG. 19).

  More specifically describing the process of step S1108, the information processing apparatus 101 first determines the walking distance in the X direction between the measurement start point (X1, Y1, Z1) and the measurement end point (X2, Y2, Z2). The distance is determined by the absolute value (unit is meter) of X1-X2.

  The measurement start point mentioned here is the measurement start (end) coordinates 1201 on the left side of the screen of FIG. 12 when the subject walks from the left of the screen of FIG. 12 (the measurement on the right side when walked from the right The coordinates of the toe of the subject included in the image of the frame when the start (end) coordinates 1201) or the determination of No is made in step S1109.

  Furthermore, the measurement end point mentioned here means that the measurement start (end) coordinate 1201 on the right side of the screen in FIG. 12 (when the subject walks from the left on the screen in FIG. 12) Measurement start (end) coordinates 1201). In this embodiment, the coordinates of the toe of the subject are used, but as another embodiment, the coordinates of the head of the subject or the coordinates of the hand may be used, or the average value of the coordinates of each part may be used. Also good. However, it is preferable that the measurement start point and the site used at the measurement end point coincide with each other.

  In the present embodiment, it is conceivable that the subject may shift diagonally (in front of or behind the screen in FIG. 12) without being able to walk straight, so basically the subject walks just beside and walk distance I'm calculating.

  However, as another example, when considering the case of being shifted obliquely (in front of or behind the screen in FIG. 12), measurement start point (X1, Y1, Z1), measurement end point (X2, Y2) , Z2) may be used to calculate the walking distance.

  Next, the information processing apparatus 101 obtains the walking speed of the subject by dividing the walking distance previously obtained by the time taken to complete the count in step S1107.

  Finally, the information processing apparatus 101 calculates the time required to walk 5 m at the previously determined walking speed, and the normal walking is correct depending on whether the time is longer or shorter than the time set in advance. Determine if it has been done. The number 5 m is the distance needed to determine the subject's normal walking behavior.

  By performing the calculation as described above, for example, even in a narrow room where the subject can not walk 5 m, it is possible to determine whether the normal walking operation has been correctly performed.

  In step S1109, the information processing apparatus 101 determines that the toe coordinates of the subject specified in step S1101 are on any of the two measurement start (end) coordinates 1201 set in advance. It is determined whether it is after the start of counting the number.

  That is, when it is determined YES in step S1109, even if the information processing apparatus 101 can not specify the first timing by the passage specifying unit, the first position using the superimposed moving image data When it is possible to specify the passage of the subject at a position between the second position and the second position, the time specifying means determines the first position and the second position at which the pass of the object is specified. Identifying the second required time from the passing timing of the position between and the second timing, and the walking speed specifying means determines the second required time, the first position, and the second position. The walking speed is specified based on the distance between the second position and the position between the second position and the second position.

  If it is determined that it is after the start of counting of the number of seconds, the information processing apparatus 101 ends the present processing, and if it is determined that it is before the start of counting of the number of seconds, the processing of step S1106 Migrate

  In the case where it is determined No in step S1109, for example, when processing of an image of a frame prior to the image of the frame currently being processed is being executed, the subject's toe identified in step S1101. The coordinates overlap with any one of the two measurement start (end) coordinates 1201 set in advance, and where the counting of the number of seconds should originally be started is described with respect to the image of the frame in steps S304 and S305 of FIG. When the coordinate information of each joint of the test subject can not be specified, it is determined No in step S1109.

  In that case, in step S1106, by counting the number of seconds from the point where the subject's toe coordinates can be recognized between the measurement start (end) coordinates 1201, the subject's action can be performed without re-shooting. It becomes possible to evaluate.

Steps S1104 to S1108 of FIG. 11 use the generation unit for generating superimposed moving image data on which the positional information of the subject who is performing the walking motion is superimposed, and the superimposed moving image data generated by the generating unit in the present invention. Pass specifying means for specifying a first timing at which the subject passes the first position on the superimposed moving image data, and a second timing at which the subject passes the second position on the superimposed moving image data; A first required time taken for the subject to walk a predetermined distance between the first position and the second position from the first timing specified by the passage specifying means and the second timing. And a walking speed specifying means for specifying the walking speed of the subject based on the predetermined distance and the first required time specified by the time specifying means.
This is the end of the description of FIG.

  Next, processing that is executed by the CPU 201 of the information processing apparatus 101 in the present invention when the selection of the item of “open eye one foot standing” is received from the user in step S301 will be described using FIG. 13.

  In step S1301, the information processing apparatus 101 determines whether the subject's foot is raised.

  More specifically, first, before executing the process of step S1301, the information processing apparatus 101 identifies the y-coordinate value of the heels of both feet of the subject, and the difference between the coordinate values of the heels of the respective feet. Is determined to be within the predetermined range, it is determined that both feet are aligned on the ground.

  Next, in step S1301, the value of the y-coordinate of any foot changes by a predetermined amount or more than the value of the y-coordinate of the heels of both feet of the subject specified by the information processing apparatus 101 before performing the process of step S1301. If the information processing apparatus 101 determines from the image of the frame that is currently to be processed, the information processing apparatus 101 determines that the foot is up when the information processing apparatus 101 has changed more than a predetermined amount.

  If it is determined in step S1301 that the subject's foot is up, the information processing apparatus 101 proceeds to the process of step S1302, and if it is determined that the subject's foot is not up, the information processing apparatus 101 The process proceeds to step S1304.

  In step S1302, the information processing apparatus 101 determines whether the foot of the subject determined to be raised in step S1301 is raised to a predetermined height.

  If it is determined in step S1301 whether the subject's foot determined to be raised has risen to a predetermined height, the information processing apparatus 101 starts counting the number of seconds in step S1303 and determines that the height is increased in step S1301. If it is determined that the subject's foot has not risen to the predetermined height, the information processing apparatus 101 ends the present process.

  More specifically, in step S1302, the value of the y-coordinate of each foot causes the process of step S1301 to determine whether the subject raises his / her foot to the height at which the subject should raise his / her foot in "open eye one leg standing". It is specified from the image of the frame currently being processed by the information processing apparatus 101 whether the information processing apparatus 101 has changed by a predetermined amount or more than the value of the y coordinate of the heel of the subject's feet specified by the information processing apparatus 101 before execution. If the above changes, the information processing apparatus 101 determines that the foot has risen to a predetermined height.

  Note that the value of “predetermined” in step S1302 is a value larger than the value of “predetermined” in step S1301.

  In step S1304, the information processing apparatus 101 determines whether or not the test subject's foot is rising in a frame before the image of the frame currently being processed (YES in step S1301). .

  If it is determined that the subject's foot is raised in the image of the frame prior to the image of the frame currently being processed (YES in step S1301), the information processing apparatus 101 performs the process in step S1305. In a case where it is determined that the subject's foot has not risen (YES in step S1301) in the image of the frame before the transition and the image of the frame currently being measured, the information processing apparatus 101 determines that It is determined that the foot has not been raised yet, and this processing ends.

  In step S1305, the information processing apparatus 101 determines whether the subject's foot has fallen.

  More specifically, in step S1305, the value of the y-coordinate of each foot is changed by a predetermined amount or more than the value of the y-coordinate of the heel of both feet of the subject specified by the information processing apparatus 101 before performing the process of step S1301. The information processing apparatus 101 specifies whether the information processing apparatus 101 is currently processing a target, and if the information processing apparatus 101 has not changed more than a predetermined amount, the information processing apparatus 101 determines that the foot is falling.

  If it is determined in step S1305 that the subject's foot is down, the information processing apparatus 101 proceeds to the process of step S1306, ends the counting of the number of seconds executed in step S1303, and the subject's foot falls. If it is determined that the subject is not moving, the information processing apparatus 101 determines that the subject is still raising his leg, and the present process ends.

Whether the number of seconds counted from the start of counting the number of seconds in step S1303 to the end of counting in step S1306 is less than a predetermined number of seconds (for example, 24 seconds) in step S1307 Evaluate the subject's motor ability depending on whether it is exceeded or not. The evaluation results are stored in the measurement result management table (FIG. 19).
This is the end of the description of FIG.

  In FIG. 13, the information processing apparatus 101 automatically determines whether the subject's foot is raised or lowered. However, as shown in FIG. 14, the user (e.g., the evaluator) manually designates the subject's foot raised or lowered. It is possible.

  Therefore, hereinafter, with reference to FIG. 14, a mechanism will be described in which the user (for example, an evaluator) manually designates raising and lowering of the subject's foot.

  FIG. 14 is a screen displayed on the display 212 of the information processing apparatus 101 when the information processing apparatus 101 starts photographing the subject in step S302.

  In 1401, a moving image acquired by the motion information acquisition unit 151 of the information processing apparatus 101 is displayed.

  When the raise / lower button 1402 is pressed for the first time by the user operating the mouse etc., the information processing apparatus 101 stops the process of FIG. 13 and the raise / lower button 1402 is pressed for the first time. The information processing apparatus 101 determines that the subject raised his leg at the above timing, and starts counting the number of seconds.

  Then, when the raise / lower button 1402 is pressed a second time by the user operating the mouse or the like, the information processing apparatus 101 determines that the subject lowers his / her foot, and the count of seconds is ended. Then, according to the counted number of seconds, the subject's exercise ability is evaluated.

  In the present embodiment, the information processing apparatus 101 stops the process of FIG. 13 when the up / down button 1402 is pressed for the first time by the user operating the mouse etc. However, as another embodiment, FIG. When the up / down button 1402 is pressed by the user's operation of the mouse or the like after the process of step S1303, the information processing apparatus 101 ends counting of the number of seconds without executing the processes of steps S1304 and S1305. When the up / down button 1402 is pressed by the user's operation of the mouse or the like before the process of step S1302, the information processing apparatus 101 starts counting the number of seconds without executing the processes of steps S1301 and S1302. The process after step S1304 may be executed thereafter.

As shown in FIG. 14, when the user (e.g., the evaluator) allows manual designation of raising and lowering of the subject's foot, as shown in FIG. 13, the information processing apparatus 101 automatically determines raising and lowering of the subject's foot. If the information processing apparatus determines that the subject does not lift their feet despite the fact that the subject is lifting their feet, or that the subject does not lift their feet despite the fact that the subjects are lowering their feet Even in the case where it ends up, it is possible to correct the determination result.
This is the end of the description of FIG.

  Next, processing of evaluating a subject's motion and displaying a message for the subject and a caregiver will be described using FIG. The process illustrated in the flowchart of FIG. 29 is a process in which the CPU 201 of the information processing apparatus 101 reads and executes a predetermined control program.

  In step S2901, it is determined whether the specified skeleton information satisfies a predetermined evaluation condition.

  If the evaluation condition is satisfied (step S2901: YES), the process proceeds to step S2902.

  If the evaluation condition is not satisfied (step S2901: NO), the process proceeds to step S2903.

  An example of evaluation conditions is shown in FIG. As shown in FIG. 30, the evaluation condition and the evaluation content are associated with each item.

  For example, “Item: Chair standing and sitting” is evaluated as a standing motion when the knee angle is 175 degrees or more, and is rated as a sitting motion when the knee angle is 95 degrees or less. Then, when a standing up operation and a sitting operation are performed, it is evaluated that the standing and sitting operation is performed once.

  In the case of single-leg standing, when the difference in height between the left and right legs is 5 cm or more, it is evaluated that one leg is raised.

  In step S2902, the evaluation value is added or the like. For example, if the chair is sitting and sitting, one is added. In addition, in the case of single-leg standing with an eye, measurement of the single-leg standing time is started when the start condition of one-leg standing is satisfied. If the end condition is satisfied, the measurement of one foot standing time is ended.

  In step S2903, a message is identified based on the identified skeletal coordinates.

  The contents of the message are identified based on the message table shown in FIG. For example, in the event: in the chair standing and sitting, when the angle of the knee reaches 175 degrees or more, a message of "please sit down" is identified. In addition, when the movement to sit down with the knee angle less than 175 degrees (when the knee angle becomes smaller), a message "Please stand firmly" is identified.

  Also, in the open-eye single-legged stance, if the foot is not raised, the message "Please raise the foot" will be displayed, and if the height of the raised leg is low, the message "Please raise more feet" will be displayed. If the foot is firmly raised, the message "measuring" is identified.

  By displaying the message in this manner, it is possible for the subject or the caregiver to recognize whether or not the operation being evaluated is performed properly, or what operation is to be evaluated.

In step S2904, the message identified in step 2903 is displayed. 2201 of FIG. 22 is shown as an example.
It returns to the explanation of FIG.

  The processes of steps S304 to S306 are processes that are performed each time the motion information acquisition unit 151 acquires a moving image frame. By recognizing the skeleton information each time a frame is acquired in this manner, it is possible to detect a change in coordinate information of each joint and recognize an operation.

  In step S307, the CPU 201 of the information processing apparatus 101 stores the result measured in step S306 (FIG. 19).

  Next, measurement processing of various eyes when using previously recorded motion information will be described using FIG.

  Note that whether the measurement in real time shown in FIG. 3 (the process of performing measurement while acquiring motion information) is to be executed or the measurement using motion information recorded in advance shown in FIG. Determined by

  In step S401, the user receives a selection of a moving image to be played back (a moving image obtained by capturing the action of a subject to be measured), and receives an instruction to play the moving image.

  The moving image data includes data acquired by each sensor of the motion information acquisition unit 151.

  In step S402, the selection of the moving image to be compared with the moving image accepted in step S401 is accepted.

  In step S403, various settings are received for the moving image to be reproduced and the moving image to be compared.

  In step S404, the setting accepted in step S402 is saved. When the save button 2801 in FIG. 28 is pressed, save processing is executed.

  In step S405, the moving image set as the comparison target with the moving image instructed to be reproduced is reproduced.

  At this time, when the simultaneous reproduction button is pressed, both moving images are simultaneously reproduced, and when the individual reproduction button is pressed, the pressed moving images are individually reproduced.

  And the process after step S304 of FIG. 3 is performed.

  As shown in FIG. 3 and FIG. 4, for example, it is possible to switch between a case where the motion is evaluated in real time while shooting the subject and a case where the moving image shooting the subject is stored and the motion is evaluated later. If you want to give feedback to the subject on the spot, set the user to evaluate the action in real time, record the multiple subjects first, and want to evaluate it later, or repeat the fine motion etc. (evaluator If you want to check while watching), if you want to evaluate the captured moving image as another item, if you want to check the angle of the subject's skeleton with the annotation function, or if the subject and the evaluator are the same, It is possible for the user to save the captured moving image and to evaluate the operation later.

In addition, when the moving image obtained by photographing the subject is evaluated and the movement is evaluated later, there is an advantage that the user can manually change the evaluation result without taking a picture again when there is an erroneous detection.
23 and 24 show an example of the comparison screen.

  FIG. 23 shows an example of a screen on which a moving image to be evaluated and a moving image to be compared are vertically arranged.

  FIG. 24 is an example of a screen on which a moving image to be evaluated and a moving image to be compared are displayed side by side.

  As to the layout of the comparison screen (whether to arrange vertically or horizontally), for example, there is a method of registering, for each item, whether to align vertically or horizontally and display according to the registered contents. A table in which the layout is registered for each item is shown in FIG.

  As shown in FIG. 25, the chair stands are shown side by side, and the normal walking is shown vertically. In this way, by registering in advance, items that the subject moves in the vertical direction (such as "chair standing") are arranged side by side, and items that move in the horizontal direction (such as "normal walking") are It becomes possible to arrange vertically. By determining the arrangement according to the moving direction as described above, it is possible to display with a layout that is easy to compare.

  The method of pre-registering in this way is effective when the item is specified in advance.

  There is also a method of determining the layout based on the trajectory of the subject. For example, the layout is determined based on the motion of the subject such that the subject's trajectory is vertically arranged if the trajectory is in the left and right direction, and is aligned left and right if the trajectory of the subject is in the vertical direction.

  Thus, according to the method of making a determination based on the trajectory of the subject, even when the item is not specified in advance, it is possible to display in a layout that is easy to compare.

  In addition, on the comparison screen, it is possible to invert the left and right of the moving image.

  FIG. 26 is a diagram showing a case where the left and right of the upper moving image on the screen of FIG. 23 are reversed. As shown in FIG. 26, the person appearing in the upper moving image is directed to the right in FIG. 23, but is directed to the left in FIG.

  The instruction to reverse is accepted by checking the check box indicated by 2601 in FIG. When the "upper screen reverse" in the box 2601 is checked, the upper screen is reversed. The lower screen is reversed when "reverse screen" is checked. If both are checked, the upper and lower screens will be reversed.

  By reversing in this way, for example, one month ago, we walked from left to right of the image and measured it, but when we measured from right to left this time, unify the walking directions of both Can be compared easily, and it becomes possible to grasp the difference between the two in detail.

  Further, in the comparison screen, not only the images to be compared may be displayed side by side, but also may be displayed superimposed.

  An example of superimposed display is shown in FIG. Reference numerals 2701 and 2702 in FIG. 27 denote images to be compared. An image 2703 is an image obtained by superposing the images 2701 and 2702.

  On the comparison screen, it is possible to adjust the size and position of the image to be compared.

  As for the size, by checking “Size” in the automatic adjustment menu 2704 in FIG. 27, for example, using the lengths from the head and the waist, the lengths can be matched between the skeletal information to be compared Adjusted.

  In addition to automatic adjustment, it is also possible to perform adjustment by user operation. In this case, adjustment can be performed by pressing the size adjustment buttons 2705 and 2706 in FIG.

  The ability to adjust the size in this way makes it easier to compare people when they compare different heights, or when magnifications differ from those taken in the past, etc., and the difference between the two can be grasped in detail It becomes possible.

  As for the position, by checking “Position” in the automatic adjustment menu 2704 in FIG. 27, for example, the position of the head is adjusted so as to match the pieces of skeletal information to be compared. Also, the position is adjusted so that the person appears in the center of the composite image.

  The position can also be adjusted by the user performing a drag operation.

  In this way, by making the position adjustable, it becomes possible to place and compare skeletal information to be compared at a desired position or to superimpose and compare, which makes it easy to compare, and the difference between the two. It becomes possible to grasp in detail.

  In addition, when “both” of the automatic adjustment menu 2704 is checked, both the size and the position are adjusted.

In addition, on the comparison screen, it is possible to display only the skeleton information without displaying the background and the like.
An example of a screen on which only skeletal information is displayed is shown in FIG.

  For example, when the moving images to be compared are photographed in different rooms, the difference in background interferes with the comparison of the movement of the skeleton. In particular, in a composite image, different backgrounds are superimposed and displayed, which makes it very difficult to see and to be difficult to compare. Therefore, by erasing the background, the comparison object can be clearly displayed, and it becomes possible to grasp the difference between the two in detail.

  The contents (combination of comparative moving images, screen layout, position, size, etc.) set on the various screens described above can be stored as a comparison scenario and reused.

  The information of the comparison scenario includes moving image file information, reproduction start position, reproduction end position, zoom state, adjusted position of composite video, and setting of horizontal flip.

  As described above, by saving the set content as a comparison scenario, it is possible to save time and effort for setting again even if it is desired to review it later.

  Next, report creation processing will be described using FIG.

  In step S501, the selection of the subject from the user is accepted, and the output instruction of the measurement result (report) of the subject is accepted.

  In step S502, the measurement result of the subject who has received the output instruction is extracted.

  Here, the details of the measurement result extraction process will be described with reference to FIG.

  In step S1501, the information processing apparatus 101 receives setting of extraction conditions from the user. FIG. 17 shows an image of the extraction condition setting screen. In the screen of FIG. 17, a start date 1701 and an end date 1702 are set as extraction conditions.

  In step S1502, the information processing apparatus 101 receives an item selection from the user. In the screen of FIG. 17, as the event 1703, the user chooses one of the foot-opening, the chair standing, the maximum step, the normal walking, and the TUG as the event 1703.

  In step S1503, the information processing apparatus 101 extracts the current and previous measurement results from the measurement result management table shown in FIG. 19 according to the extraction conditions and items received in steps S1501 and S1502. Specifically, this process is executed by pressing the extraction button 1704 in FIG. 17, and the measurement result management table for the selected item 1703 in the range of the start date 1701 and the end date 1702 which are extraction conditions The current measurement result and the second new measurement result are extracted as the present result and the previous result.

  By extracting the latest measurement result included in the designated period range and the second new result as the current measurement result and the previous measurement result, for the item (generally multiple designations) designated in this way, It is possible to extract measurement results for report output without performing a series of tasks such as setting search conditions for each item and searching for measurement results and selecting the current measurement result and the previous measurement result. .

  Here, the measurement result management table will be described with reference to FIG. The measurement result management table includes, as items, a measurement result ID 1901, a subject 1902, a measurement date and time 1903, an item 1904, a measurement value 1905, an evaluation point 1906, and a moving image file 1907. The measurement result ID 1901 is a character string for uniquely identifying the measurement result. A subject 1902 is a subject who has received the measurement. The measurement date and time 1903 is the date and time when the measurement was started. The event 1904 is a measured event, which is one of standing on one leg, standing on a chair, maximum step, normal walking, and TUG. The measured value 1905 is a numerical value representing the measurement result. An evaluation point 1906 is a point evaluated based on the measured value 1905. A moving image file 1907 is a file name of moving image data corresponding to the measurement result or a link to the moving image data.

In step S1504, the information processing apparatus 101 displays the measurement result extracted in step S1503 on the display 212 or the like. FIG. 18 shows an image of the extraction result display screen. On the screen of FIG. 18, a thumbnail image 1801 of moving image data corresponding to the extracted measurement result is displayed.
It returns to the explanation of FIG.

  In step S503, a report is created based on the result extracted in step S502.

  Here, the details of the report creation process will be described with reference to FIG.

  The processes in steps S1601 to S1605 are repeatedly executed for each item for which selection has been received in step S1502.

  In step S1601, the information processing apparatus 101 acquires the current and previous measurement results extracted in step S1503.

  In step S1602, the information processing apparatus 101 determines whether the measurement result acquired in step S1601 has been evaluated. Specifically, the determination is made based on whether a value is set to the evaluation point 1906 of the measurement result management table. If it has been evaluated, the process proceeds to step S1604. If it is not evaluated, the process proceeds to step S1603.

  In step S 1603, the information processing apparatus 101 performs evaluation on the unevaluated measurement results, and registers them in the measurement value 1905 and the evaluation point 1906 of the measurement result management table.

  In step S1604, the information processing apparatus 101 searches each frame image of the moving image from the moving image corresponding to the measurement result, and extracts a frame image of a characteristic timing for the item. The conditions for determining the characteristic timing are determined for each item. For example, when the eye is standing with one eye open, the timing at which the foot is put on the ground, that is, the state transitions from the state where the foot is raised to the state where the foot is attached. The timing is determined as the timing at which the legs are opened the most if it is the maximum step, that is, the timing at which the foot is raised from when the leg is determined to be the highest record. Specific conditions are set based on the value of coordinate data for each joint, the change state, the correlation of coordinate data of a plurality of joints, and the like. In addition, the frame image of the characteristic timing may be extracted in the main processing, or may be extracted and stored at the time of evaluation and may be called in the main processing. Further, in the present embodiment, one characteristic frame image is extracted for each item, but a plurality of frame images may be extracted depending on conditions.

  In step S1605, the information processing apparatus 101 outputs, as report elements, thumbnail images of the characteristic frame images extracted in step S1604 and evaluation results of various eyes. When a plurality of characteristic frame images are extracted in step S1604, corresponding thumbnail images may be arranged and output in a plurality, or may be narrowed down to one and output.

  As described above, by outputting evaluation results for various eyes and thumbnail images of characteristic frame images as report elements, not only grasping the situation by numerical data, but visually and intuitively grasping the quality of measurement results etc. be able to.

In step S1606, the report elements output to the various eyes are aggregated, and a report is created by adding information on measurement such as report creation date, subject information, measurement location information, and the like.
It returns to the explanation of FIG.

  In step S504, the CPU 201 of the information processing apparatus 101 outputs the report created in step S503.

  FIG. 20 shows an output example of the report created in this processing and output in step S504. In the output example of FIG. 20, the report information column 2001 displays the creation date, the implementer (subject), the implementation location, and the person in charge, the general comment column 2002 provides a comment from the evaluator, and the radar chart column 2003 for each item. The radar chart of the evaluation point of is displayed. The pickup item column 2004 displays thumbnails and skeleton images from the characteristic images extracted in step S1605 for the items selected by the user. In the item result column 2005, the current and previous implementation dates by item, results (measured values), the degree of improvement determined from the current and previous evaluation points, comments from the evaluator on the item, and extraction in step S1605 The thumbnail image of the characteristic frame image is displayed.

  As described above, according to the present invention, it is possible to provide a mechanism capable of specifying the walking speed of the target person even when the passage of the target person can not be specified at a predetermined timing.

  Further, a program according to the present invention is a program that causes a computer to execute the processing of FIGS. 3 to 5, 11, 11, 13, 15, 16, and 29. The program according to the present invention may be a program for each process of FIGS. 3 to 5, 11, 13, 13, 15, 16, and 29.

  As described above, the recording medium recording the program for realizing the functions of the above-described embodiments is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by reading and executing.

  In this case, the program itself read out from the recording medium realizes the novel function of the present invention, and the recording medium recording the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, non-volatile memory card, ROM, EEPROM, silicon A disk etc. can be used.

  Further, by executing the program read by the computer, not only the functions of the above-described embodiment are realized, but also an operating system (OS) or the like running on the computer is actually executed based on the instructions of the program. It goes without saying that the processing is partially or entirely performed, and the processing realizes the functions of the above-described embodiments.

  Furthermore, after the program read from the recording medium is written to the memory provided to the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is read based on the instruction of the program code. It goes without saying that the case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiment are realized by the processing.

  Further, the present invention may be applied to a system constituted by a plurality of devices or to an apparatus comprising a single device. It goes without saying that the present invention can also be applied to the case where it is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can receive the effects of the present invention.

  Further, by downloading and reading out a program for achieving the present invention from a server on a network, a database or the like by a communication program, the system or apparatus can receive the effects of the present invention. In addition, the structure which combined each embodiment mentioned above and its modification is also contained in this invention altogether.

101 Information processing apparatus

Claims (5)

Generation means for generating superimposed moving image data on which position information of a subject who is performing a walking motion is superimposed;
Using the superimposed moving image data generated by the generation means, the target person passes the first position on the superimposed moving image data at a first timing when the subject passes the second position on the superimposed moving image data Passage specifying means for specifying a second timing to pass;
A first requirement for the target person to walk a predetermined distance between the first position and the second position from the first timing and the second timing specified by the passage specifying means. A time specifying means for specifying a time;
An information processing apparatus comprising: a walking speed specifying means for specifying a walking speed of the subject based on the predetermined distance and a first required time specified by the time specifying means;
Even when the first timing can not be specified by the passage specifying means, the passing of the object person is specified at the position between the first position and the second position using the superimposed moving image data In the case where it is possible, the time specifying means is configured to calculate a second passing timing of the position between the first position where the passing of the object person is specified and the second position, and the second timing. Identify the time required,
The walking speed specifying means specifies the walking speed based on the second required time, and the distance between the first position and the second position and the second position. An information processing apparatus characterized by   The information processing apparatus according to claim 1, wherein an evaluation value regarding the walking motion of the subject is calculated based on the walking speed specified by the walking speed specifying means. It further comprises storage means for storing a reference time which is a reference of the time required to walk a specific distance,
The walking time is calculated based on the walking speed and the specific distance, and the evaluation value is calculated by comparing the walking time with the reference time stored in the storage means. An information processing apparatus according to Item 2. A control method of an information processing apparatus, comprising: generation means for generating superimposed moving image data on which position information of a subject who is performing a walking motion is superimposed,
The passage specifying means of the information processing apparatus uses the superimposed moving image data generated by the generation means, and a first timing at which the target person passes the first position on the superimposed moving image data, and the superimposed moving image data Passing identification step of identifying a second timing at which the subject passes the second position of
The target person specifies a predetermined distance between the first position and the second position from the first timing and the second timing specified in the passage specifying step by the time specifying means of the information processing apparatus. A time specifying step of specifying a first required time taken to walk;
The walking speed identifying step of the information processing apparatus includes the walking speed identifying step of identifying the walking speed of the subject based on the predetermined distance and the first required time identified in the time identifying step. And
Even if the first timing can not be identified in the passage identification step, the passage of the object person is identified at the position between the first position and the second position using the superimposed moving image data. In the case where it is possible, in the time specifying step, a second passing timing of the position between the first position and the second position where the passing of the subject is specified and a second timing Identify the time required,
The walking speed specifying step specifies the walking speed based on the second required time and the distance between the first position and the second position and the second position. And controlling the information processing apparatus. A program which is read and executed by an information processing apparatus including generation means for generating superimposed moving image data on which position information of a subject who is performing a walking motion is superimposed,
The information processing apparatus uses the superimposed moving image data generated by the generation unit, a first timing at which the subject passes the first position on the superimposed moving image data, and a second position on the superimposed moving image data Passing specifying means for specifying a second timing at which the subject passes through
A first requirement for the target person to walk a predetermined distance between the first position and the second position from the first timing and the second timing specified by the passage specifying means. A time specifying means for specifying a time;
It functions as a walking speed specifying means for specifying the walking speed of the subject based on the predetermined distance and the first required time specified by the time specifying means,
Even when the first timing can not be specified by the passage specifying means, the passing of the object person is specified at the position between the first position and the second position using the superimposed moving image data In the case where it is possible, the time specifying means is configured to calculate a second passing timing of the position between the first position where the passing of the object person is specified and the second position, and the second timing. Identify the time required,
The walking speed specifying means specifies the walking speed based on the second required time, and the distance between the first position and the second position and the second position. A program characterized by

Images