JP2017229081A - Dynamic image comparison device, method and program thereof, and dynamic image comparison system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To efficiently and easily perform form confirmation work in which an operation of the same pattern is repeated many times.SOLUTION: In a dynamic image, an operation pattern is extracted which iteratively appears in the dynamic image, the operation patterns at a plurality of positions of different temporal positions in the extracted dynamic image are compared to each other from a predetermined point of view, and a comparison result is outputted as a dynamic image or a still image. The comparison result includes e.g., only a reference operation pattern to be a reference and a comparative operation pattern which is significantly different from the reference operation pattern in other operation patterns. As an output style of the comparison result, e.g., a reference operation pattern g1 and a comparative operation pattern g2 are displayed so as to be identified on a screen such as displayed side by side on the screen or displayed while being superimposed. Even without watching all the dynamic images, form confirmation work can be performed.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a moving image comparison apparatus, a method and program for comparing moving images, and a moving image comparison system.

  Conventionally, during sports training, for example, a person's form during training is recorded as a video, and the quality of the form is confirmed from the captured moving images and the results of the training are used as reference for subsequent training. Yes.

  Here, for example, Patent Document 1 below discloses a technique for automatically extracting only a portion in which an operation of substantially the same pattern is repeated from a moving image obtained by training and storing it as a new moving image. . According to such a technique, it is possible to easily confirm the form during training by omitting unnecessary portions other than the operation of the same pattern from the captured moving image.

JP 2004-173202 A

  However, in the above technique, it is possible to omit a useless portion from a moving image. However, when a motion of almost the same pattern is repeated many times during training, the form at which time point during training is good and at which time point. Whether a form is bad or not can only be judged by the user carefully watching the stored video. For this reason, there has been a problem that it is not possible to efficiently confirm the form.

  The present invention has been made in view of such conventional problems, and a moving image comparison apparatus and method that can efficiently and easily perform comparison of moving images in which operations of the same pattern are frequently repeated. It is an object to provide a program and a moving image comparison system.

In order to solve the above-mentioned problem, the invention according to the first aspect is a moving image comparison device, wherein a moving image includes an extracting means for extracting a motion pattern in which a subject repeatedly appears in the moving image, and the extracting means. A comparison unit that identifies a reference operation pattern from the operation patterns at a plurality of positions extracted by the above and compares the reference operation pattern with an operation pattern at another plurality of positions, and a comparison result by the comparison unit. Output means for outputting, wherein the comparing means specifies the reference operation pattern according to a predetermined value in each operation pattern and a predetermined reference relating to the value from the operation patterns at the plurality of positions. Features.
The invention according to the second aspect is a moving image comparison apparatus, wherein the moving image is an extraction unit that extracts a motion pattern in which a subject repeatedly appears in the moving image, and the extraction unit extracts the movement pattern. Comparing means for comparing operation patterns at a plurality of positions having different time positions in a moving image from a predetermined viewpoint; and output means for outputting a comparison result by the comparing means; and the output form of the comparison result in the output means is The time position between a reference operation pattern among the operation patterns extracted by the extraction means and an operation pattern other than the operation pattern is displayed on the screen in an identifiable manner.

The invention according to the third aspect is a moving image comparison system comprising an information terminal and a server to which the information terminal is connected, wherein the server repeatedly displays the subject in the moving image. An extraction unit for extracting a pattern, and a reference operation pattern is identified from the operation patterns at a plurality of positions extracted by the extraction unit, and the reference operation pattern is compared with an operation pattern at another plurality of positions. Comparing means and providing means for providing a comparison result by the comparing means to the information terminal, wherein the comparing means determines a predetermined value in each operation pattern from the operation patterns at the plurality of positions, and a predetermined value related to the value. The operation pattern serving as the reference is specified in accordance with the reference, and the information terminal transfers the moving image to the server; And output means for outputting the comparison result provided from Ba, and further comprising a.
According to the fourth aspect of the invention, there is provided a moving image comparison system including an information terminal and a server to which the information terminal is connected. Extraction means for extracting a motion pattern that appears repeatedly, comparison means for comparing motion patterns at a plurality of positions at different time positions in the moving image extracted by the extraction means, and a comparison result by the comparison means Providing means for providing to the information terminal, the information terminal comprises transfer means for transferring the moving image to the server, and output means for outputting the comparison result provided from the server, The output form of the comparison result in the output means is a reference operation pattern among the operation patterns extracted by the extraction means, and the operation The time position of the operation pattern other than the turn is intended to identifiably displayed on the screen, characterized in that.

  According to the present invention, it is possible to efficiently and easily perform confirmation of a form in which operations of the same pattern are frequently repeated.

It is a figure which shows the form confirmation assistance system which concerns on this invention common to each embodiment. It is a flowchart which shows the content of operation | movement of the information terminal 1 in 1st Embodiment. It is a flowchart which shows the content of operation | movement of the assistance server 2 in 1st Embodiment. (A) is a figure which shows a 1st form confirmation screen, (b) is a figure which shows a 3rd form confirmation screen. (A) is a figure which shows a 2nd form confirmation screen, (b) is a figure which shows a 4th form confirmation screen. It is a flowchart which shows the content of operation | movement of the information terminal 1 in 2nd Embodiment. It is a flowchart which shows the content of operation | movement of the assistance server 2 in 2nd Embodiment. (A) is a figure which shows a 5th form confirmation screen, (b) is a figure which shows a 6th form confirmation screen.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(First embodiment)
FIG. 1 is a diagram showing an embodiment of a form confirmation support system according to the present invention, which supports a work for confirming whether a form is good or bad by using a moving image obtained by photographing a person during sports training.

  As shown in FIG. 1, the form confirmation support system of this embodiment includes an information terminal 1 that can be connected to a network 100 and a support server 2 to which an arbitrary information processing apparatus including the information terminal 1 is connected via the network 100. It consists of.

  First, the information terminal 1 will be described. The information terminal 1 is realized by a mobile phone terminal including a smartphone, for example, and mainly includes a control unit 11, an imaging unit 12, a communication unit 13, a storage unit 14, a display unit 15, a power supply unit 16, and an operation unit 17. I have.

  The control unit 11 includes a CPU (Central Processing Unit) and its peripheral circuits, a ROM storing various programs, and a working RAM. The CPU executes a predetermined program, whereby the information terminal 1 as a whole. By controlling the above, various functions of the information terminal 1 are realized. The ROM also stores a program for causing the control unit 11 to perform processing described later.

  The imaging unit 12 includes a CCD (Charge Coupled Device) or CMOS (Complementary Meta 10xide Semiconductor) type imaging device, and a signal processing circuit that generates image data based on an imaging signal output from the imaging device. The image data generated by the imaging unit 12 is finally stored in the storage unit 14 as still image data or moving image data by the control unit 11. The still image data and moving image data stored in the storage unit 14 are reproduced by the control unit 11 and displayed on the display unit 15.

  The storage unit 14 includes a flash memory built in the main body of the information terminal 1 and various memories that are detachable from the main body of the information terminal 1.

  The communication unit 13 connects the information terminal 1 to the network 100 using wireless or wired communication such as Wi-Fi or BlueTooth (registered trademark), and transmits and receives data to and from the support server 2.

  The display unit 15 includes a color liquid crystal display panel and a display drive circuit that drives the color liquid crystal display panel. The display unit 15 displays a still image, a moving image, and other information based on image data read from the storage unit 14 and supplied by the control unit 11, and also displays a form confirmation screen described later.

  The power supply unit 16 includes a power supply battery (for example, a rechargeable battery such as a nickel metal hydride battery), a DC / DC converter, and the like, and supplies electric power required by each unit.

  The operation unit 17 includes various keys, a power switch, a touch sensor that causes the color liquid crystal display panel to function as a touch panel, and the like.

  When the information terminal 1 is a mobile phone terminal including a smartphone, the information terminal 1 includes a well-known circuit (not shown) for performing telephone communication, that is, a voice input circuit that modulates and transmits input voice, There are a circuit, a reception circuit that receives and decodes a received audio signal, a reproduction circuit, and the like.

  Next, the support server 2 will be described. The support server 2 mainly includes a control unit 21, a communication unit 22, a storage unit 23, and an image processing unit 24.

  Although not shown, the control unit 21 includes a CPU, a peripheral circuit of the CPU, a working memory such as a RAM, and the like, and controls the entire support server 2 based on a program stored in the storage unit 23. Various processes including the process to be performed are executed.

  The communication unit 22 transmits and receives data to and from the information terminal 1 connected via the network 100.

  The storage unit 23 stores various data and the like transmitted / received to / from the information terminal 1 in addition to the above-described program.

  The image processing unit 24 performs various types of image processing on moving images and still images in accordance with instructions from the control unit 21. In particular, the image processing unit 24 performs various moving image processes on moving image data sent from the information terminal 1 or the like via the network 100.

  In the form confirmation support system having the above-described configuration, the information terminal 1 and the support server 2 operate as described below, so that the user captures a moving person (person or another person). Support the work to check the quality of running form using images.

  Hereinafter, the operation of the information terminal 1 and the support server 2 according to the present invention when the user uses the form confirmation support system will be specifically described. Here, the storage unit 14 of the information terminal 1 is a moving image in which a running person is photographed, and one or a plurality of moving image data of only the portion that is actually running is stored. And

  FIG. 2 is a flowchart showing the processing contents of the control unit 11 in the information terminal 1. When the operation is started by a predetermined operation by the user, the control unit 11 displays, for example, a predetermined selection screen on the display unit 15, and sends a desired moving image from the moving images stored in the storage unit 14 to the user. By specifying, a moving image to be a confirmation target of the form is specified (step SA1).

  Next, after connecting to the support server 2 via the network 100 (step SA2), the control unit 11 uploads the moving image data to be confirmed to the support server 2 (step SA3). Thereafter, the control unit 11 stands by until confirmation video data and analysis result data, which will be described later, can be received from the support server 2 (step SA4: NO).

  On the other hand, FIG. 3 is a flowchart showing the processing contents of the control unit 21 in the support server 2 during that time. In the support server 2, when the moving image data is uploaded from the information terminal 1, the control unit 21 receives it via the communication unit 22 (step SB1), and the image processing unit 24 immediately targets the uploaded moving image data. By performing various image processing such as contour extraction, the following processing is performed.

  First, in the moving image represented by the moving image data, the control unit 21 analyzes the operation of each part of the main subject (hereinafter simply referred to as a subject) of the moving image (step SB2). During such processing, the control unit 21 detects each part of the subject, that is, each part that can be determined as the left and right feet and hands of the runner, and acquires a change in position in the moving image at each detected part.

  More specifically, the control unit 21 sets a representative point suitable for tracking between frames such as the tip of each part for each part, and sets the coordinate position of the set representative point for each frame (several frames) of the moving image. And may be stored in the storage unit 23 for each part to create a database.

  Next, the control unit 21 extracts the motion pattern of the subject based on the temporal change of each part (representative point) stored in the storage unit 23 (step SB3). The motion pattern extracted here is a series of motions of the runner that appears repeatedly in the moving image. After the right foot (or left foot) climbs from the grounded state, it descends at a certain point in time and then rises again. This is the operation until it starts.

  Then, in the processing of step SB3, the control unit 21 acquires the frame number (time position) at the start time and the frame number (time position) at the end time of each operation pattern for the entire period of the moving image, and the storage unit 23.

  Next, the control unit 21 acquires the average period of the operation patterns, that is, the average value of the operation time from the start time to the end time in each operation pattern (step SB4). Note that the average period of the motion pattern may be acquired from each motion pattern in the first half period instead of the entire period of the moving image.

  If there is an operation pattern that stops or rolls and varies greatly, the standard deviation is calculated, etc., so that the operation pattern that deviates greatly is excluded, and a more appropriate average period is acquired. Good.

  Next, the control unit 21 acquires the average position of each part for the entire period of the moving image (step SB5). The average position of each part acquired here is an average position at the specific timing of each part in each operation pattern. The specific timing is a timing at which the left and right feet and the left and right hands stop while reciprocating in each motion pattern, that is, a timing at which the moving direction is reversed. That is, two types of positions are acquired for each part, and an average value of each is acquired.

  In the same manner as described above, an operation pattern that deviates greatly may be excluded, and a more appropriate average position may be acquired.

  As with the average period of the motion pattern, the average position of each part may be acquired from each motion pattern in the first half period instead of the whole period of the moving image. When acquiring from the period, the average position of each part is also acquired from the first half period of the moving image.

  However, in the process of step SB5, the control unit 21 also acquires the left and right legs and the left and right for every motion pattern in the entire period of the moving image, even when the average position of each part is acquired from the first half period of the moving image. The specific timing positions (two types) of the hand are respectively confirmed and stored in the storage unit 23 to form a database.

  Next, the control unit 21 specifies a reference operation pattern from the average period acquired in the process of step SB4 (step SB6). More specifically, the control unit 21 specifies an operation pattern whose cycle (operation time) is closest to the average value among the operation patterns repeatedly appearing in the moving image as a reference operation pattern.

  Next, the control unit 21 sets a threshold value used for specifying a comparison operation pattern to be compared with a reference operation pattern (step SB7). Here, the first threshold value and the second threshold value are set as the threshold values. The first threshold value relates to the cycle of the operation pattern, and is a difference from the above-described average cycle. The second threshold value relates to the position of the specific timing of each part, and is a difference from the above-described average position.

  Next, the control unit 21 specifies, as comparison operation patterns, operation patterns exceeding the first threshold and operation patterns exceeding the second threshold among the operation patterns other than the reference operation pattern (step SB8). ). As a result, an operation pattern whose period is significantly different from the average period, and an operation pattern whose position at a specific timing of any part is greatly different from the average position in the part are specified as the comparison operation pattern.

  Note that the comparison operation pattern set here may include an operation pattern in which the cycle is significantly different from the average cycle and at the same time the position of the specific timing of any part is significantly different from the average position in the part. .

  Here, in the process of step SB7, a predetermined ratio with respect to the average period can be set as the first threshold value regarding the period of the operation pattern, not the difference with the average period. Even in that case, in the process of step SB8, an operation pattern whose period is significantly different from the average period can be specified as the comparison operation pattern.

  Similarly, in the process of step SB7, a predetermined ratio with respect to the average position can be set as the second threshold value regarding the position of the specific timing of each part, not the difference from the average position. Even in that case, in the process of step SB8, an operation pattern in which the position of the specific timing of any part is significantly different from the average position in the part can be specified as the comparison operation pattern.

  Next, the control unit 21 newly generates moving image data for confirmation from the original moving image to be confirmed (step SB9). In this process, the control unit 21 first obtains the data of the moving image portion corresponding to the reference motion pattern identified in the process of step SB6 and the comparison motion pattern (one or more) identified in the process of step SB8 from the original moving image. Extract. Next, a portion corresponding to the main subject (runner) is cut out from the extracted moving image portion of each motion pattern, and moving image data for each motion pattern is generated using the portion as a new frame image. Then, confirmation moving image data is generated by merging the generated moving image data for each operation pattern.

  Thereafter, the control unit 21 transmits the generated moving image data to the information terminal 1 together with the analysis result data regarding the reference operation pattern and the comparison operation pattern (step SB10).

  The analysis result data includes the following data for each operation pattern of the reference operation pattern and the comparison operation pattern (one or more) in the moving image. The specific data includes the frame positions at the start time and end time of each motion pattern indicating the time position in the moving image, and the part where the position of the specific timing is greatly different from the average position (hereinafter referred to as a target part). A position (coordinate position) at a specific timing.

  That is, the control unit 21 determines the operation pattern at a plurality of positions with different time positions in the moving image to be confirmed, the cycle (operation time), and the position of the predetermined part (left and right feet and hands) of the subject at a specific timing. As a result of comparison as a viewpoint, moving image data for confirmation and analysis result data are transmitted to the information terminal 1.

  On the other hand, as shown in FIG. 2, when the information terminal 1 receives the confirmation moving image data and analysis result data from the support server 2 via the communication unit 13 (step SA4: YES), the control unit 11 Based on the received analysis result data, the display unit 15 displays a form confirmation screen that displays the above-described moving images representing the reference operation pattern and the comparison operation pattern in an identifiable manner (step SA5).

  There are two display forms of the moving images on the form confirmation screen: a parallel display and a superimposed display, as will be described later.

  FIG. 4A is a diagram showing a first form confirmation screen G1 displayed on the display unit 15 immediately after receiving the confirmation moving image data and analysis result data.

  As shown in the figure, on the first form confirmation screen G1, the reference video g1 representing the reference motion pattern is arranged on the left side of the screen, the comparison video g2 representing the comparison motion pattern is arranged on the right side of the screen, and the reference video The position gauge g3 is arranged below g1 and the comparative moving image g2. That is, the display form of the moving image on the first form confirmation screen G1 is parallel display.

  When the first form confirmation screen G1 is displayed, the control unit 11 sets the moving image of the reference motion pattern merged with the moving image for confirmation received from the support server 2 as the reference moving image g1, and the moving image for confirmation. The moving image of the comparison operation pattern merged with the image is set as the comparison moving image g2, and display on each screen is started.

  Note that the moving images of the reference operation pattern and the comparison operation pattern are moving images of only the runner portion as described above. Further, the comparison moving image g2 at the beginning of the display of the first form confirmation screen G1 has a comparison operation with the earliest time position in the original moving image to be confirmed when there are a plurality of comparison operation patterns. It represents a pattern.

  Further, when the first form confirmation screen G1 is displayed, the control unit 11 displays the position gauge g3 on the screen based on the frame numbers at the start time point and the end time point in the moving image for each operation pattern included in the analysis result data. Let The position gauge g3 indicates the time position of the reference moving image g1 and the comparative moving image g2 in the entire period (the period indicated by blackening or hatching in the drawing) with the entire extending direction as the entire period of the moving image. It is.

  When the first form confirmation screen G1 is displayed, the control unit 11 performs the time position (elapsed time from the beginning) and the operation in the moving image to be confirmed regarding the currently displayed frame in the reference moving image g1 and the comparison moving image g2. The period of the pattern is also displayed on the display unit 15.

  In addition, during the display of the first form confirmation screen G1, the control unit 11 repeatedly displays the reference moving image g1 and the comparative moving image g2, and the display periods of both are made to coincide with each other. That is, when the frame period of the reference video g1 is shorter than the frame period of the comparison video g2, the display start timing of the next cycle of the reference video g1 is delayed, and conversely, the frame period of the reference video g1 is the frame period of the comparison video g2. If it is longer, the display start time of the next cycle of the comparative moving image g2 is delayed.

  Further, while the first form confirmation screen G1 is displayed, the control unit 11 repeatedly displays the reference moving image g1 and the comparative moving image g2 as described above, while displaying the mark g4 (the broken line in the example in the figure) indicating the target region of interest. ) Are superimposed on both moving images g1 and g2. Note that, as described above, the site of interest is a site where the position at the specific timing is significantly different from the average position in the comparison video g2 (comparison operation pattern), and FIG. This is an example of a foot.

  In addition, after displaying the first form confirmation screen G1 described above, the control unit 11 determines whether there is an end operation for instructing the user to end the confirmation operation, whether there is a display switching operation for switching the display mode, and a sending operation. , Presence / absence of still image expansion operation, presence / absence of time adjustment operation are sequentially confirmed (steps SA6, SA7, SA9, SA12, SA14). Then, after the first form confirmation screen G1 is displayed, the control unit 11 continues to display the first form confirmation screen G1 if any of the above operations is not performed by the user (step SA14: NO).

  On the other hand, when there is a display switching operation by the user (step SA7: YES), the control unit 11 switches the display form of the reference moving image g1 and the comparative moving image g2 from parallel display to superimposed display. The second form confirmation screen G2 shown in FIG. 5 (a) is displayed on the display unit 15 (step SA8).

  As shown in the figure, the second form confirmation screen G2 is a screen in which the reference video g1 and the comparative video g2 described above are superimposed on the center of the screen and the position gauge g3 described above is disposed below the second video. .

  Even during the display of the second form confirmation screen G2, the control unit 11 repeatedly displays the reference moving image g1 and the comparative moving image g2 in a state in which both display cycles coincide with each other, and also displays the attention site of the subject. A mark g4 to be displayed is superimposed on the moving images g1 and g2.

  In FIG. 5A, for convenience, the subject portion of the reference moving image g1 is shown in black, and the subject portion of the comparative moving image g2 is shown in diagonal lines. Can be distinguished from the reference moving image g1 and the comparative moving image g2. Moreover, although the example which overlapped the comparative moving image g2 on the reference | standard moving image g1 was shown here, the up-and-down relationship of both may be reverse.

  If the user performs a feed operation while the first form confirmation screen G1 or the second form confirmation screen G2 is displayed (step SA9: YES), the control unit 11 at that time It is confirmed whether or not there is a comparison operation pattern other than the comparison operation pattern being displayed as the comparison moving image g2 (step SA10). That is, it is confirmed whether the moving image portion of another comparison operation pattern is merged with the confirmation moving image.

  If there is no other comparison operation pattern (step SA10: NO), the control unit 11 continues to display the current comparison video g2 on the first form confirmation screen G1 and the second form confirmation screen G2. That is, do nothing.

  On the other hand, if there is another comparison operation pattern (step SA10: YES), the control unit 11 displays the operation pattern (step SA11). In other words, the control unit 11 displays the moving image portion of the comparison operation pattern whose time position in the moving image to be confirmed is one after the comparison operation pattern being displayed as the comparison moving image g2 on the screen as the new comparison moving image g2. To start. In this case, the reference moving image g1 is also displayed from the top in conjunction with this.

  Although not shown in FIG. 2, the user's feed operation is permitted to return the operation pattern to the previous operation pattern in time, and the feed operation returns the operation pattern to the previous operation pattern in time. If so, in step SA11, the control unit 11 performs a process reverse to the above. That is, the display on the screen is started with the moving image portion of the comparison operation pattern whose time position in the moving image to be confirmed is the previous comparison operation pattern being displayed as the comparison moving image g2 as the new comparison moving image g2.

  If the user performs a still image expansion operation (step SA12: YES), the control unit 11 switches the presence / absence of still image expansion (step SA13).

  That is, in the process of step SA13, the control unit 11 displays the position gauge g3 described above at the time when the still image developing operation is performed while the first form confirmation screen G1 and the second form confirmation screen G2 are displayed. 4 (b), as shown in FIG. 5 (b), in a state in which switching is made to a predetermined number of still image groups f1 constituting the reference moving image g1 and a predetermined number of still image groups f2 constituting the comparative moving image g2. 3 form confirmation screen G3 and fourth form confirmation screen G4 are displayed on the display unit 15.

  Here, the predetermined number of still image groups f1 constituting the reference moving image g1 and the predetermined number of still image groups f2 constituting the comparative moving image g2 are each a still image of the currently displayed frame and a plurality of still images immediately before that. It consists of still images for frames.

  On the other hand, in the process of step SA13, the controller 11 reverses the above, while the third form confirmation screen G3 and the fourth form confirmation screen G4 are displayed, the first form confirmation screen G1 and the second form. A confirmation screen G2 is displayed on the display unit 15.

  Furthermore, when there is a time adjustment operation by the user (step SA14: YES), the control unit 11 switches the presence / absence of time adjustment (step SA15). Here, the time adjustment refers to the display time of the reference moving image g1 (the period of the comparison operation pattern) that is displayed on any of the first to fourth form confirmation screens G1 to G4 described above. This is a process for matching with (period of the basic operation pattern).

  More specifically, when the display time of the comparative video g2 is shorter than the display time of the reference video g1, the frame images for the shortage time are complemented and displayed, and conversely, the display time of the comparative video g2 is displayed. If the display time is longer than the display time, frame images corresponding to the excess time are thinned and displayed.

  Note that the complement of the frame images corresponding to the shortage time is performed, for example, by generating a new frame from frames that follow each other for every predetermined number of frames, or by overlappingly using the preceding frame or the subsequent frame.

  When the time adjustment operation is not performed at the time when the time adjustment operation is performed, the control unit 11 performs the reference moving image g1 and the comparative moving image g2 in the state where the time adjustment is performed by the above processing. And display.

  In addition, when the time adjustment operation is performed at the time when the time adjustment operation is performed, the control unit 11 stops the time adjustment by the above processing and maintains the display time in a different state during the process of step SA15. The display of the moving image g1 and the comparative moving image g2 is resumed.

  When the reference video g1 and the comparative video g2 are repeatedly displayed with different display times, the display is first started so that the heads are aligned, and the display with the shorter time is displayed with the longer display. The next repeated display is waited until the end of, and after the longer display is finished, the display is started so that the head is aligned again.

  Thereafter, the control unit 11 repeats the processing from step SA7 to step SA15 described above until the user performs an end operation (step SA6: NO), and if there is an end operation by the user (step SA6: YES), at that time To finish all processing.

  In the form confirmation support system of the present embodiment described above, when the user confirms whether the running form is good or bad using a moving image obtained by photographing a person who is running (the person or another person) using it, Among the operation patterns that appear repeatedly during running by the first to fourth form confirmation screens G1 to G4 displayed on the information terminal 1, only the reference operation pattern that is a reference and the comparison operation pattern that is largely different from the reference operation pattern are displayed. You can easily compare and confirm.

  Therefore, it is possible to check which form is good and which form is bad during training without carefully checking the moving image. Even for sports such as running where there are many repetitions of the same pattern operation, the work of checking the form during training can be performed efficiently and easily.

  In particular, the reference moving image g1 and the comparative moving image g2 displayed on the first to fourth form confirmation screens G1 to G4 each represent a series of operations for one cycle of the runner specified as the operation pattern in the moving image. Since it is a moving image, the reference operation pattern can be compared with one or more comparison operation patterns very easily.

  In addition, since the reference moving image g1 and the comparative moving image g2 express the difference in period between the reference operation pattern and the comparison operation pattern, it is possible to easily check the difference in the period between the two.

  In addition, since the reference moving image g1 and the comparative moving image g2 are displayed side by side on the first and third form confirmation screens G1 and G3, there is a period shift between the reference operation pattern and the comparison operation pattern. Can more easily confirm the shift in the period between the two.

  In addition, since the mark g4 is displayed so as to overlap the reference moving image g1 and the comparative moving image g2, if there is a position shift of a part such as a foot or a hand of the runner between the reference operation pattern and the comparison operation pattern, It can be easily confirmed.

  Further, on the second and fourth form confirmation screens G2 and G4, the reference moving image g1 and the comparison moving image g2 are displayed so as to overlap each other, so that the runner's feet and hands are between the reference operation pattern and the comparison operation pattern. If there is a position shift, it can be confirmed more easily.

  Further, since the above-described position gauge g3 is displayed on the first and second form confirmation screens G1 and G2, the operation pattern at which position in the moving image is extracted as the reference operation pattern and the comparison operation pattern being displayed. It is possible to easily confirm whether it has been done.

  Further, since the period of the reference moving image g1 and the comparison moving image g2 can be matched by performing the time adjustment operation, there is a difference in both the cycle and the position of an arbitrary part that operates. Even if it exists, only the difference in the position of the arbitrary part which operate | moves can be confirmed.

  On the other hand, in this embodiment, since the support server 2 automatically extracts an operation pattern from a moving image to be confirmed using an image processing technique, information other than the moving image is used to extract the operation pattern. It is unnecessary and does not require other devices such as sensors, and can ensure high convenience for the user.

  Further, the support server 2 identifies the reference motion pattern from the motion patterns at a plurality of positions extracted from the confirmation target moving image, and identifies the comparison motion pattern by comparing the difference between the reference motion pattern and other motion patterns. Therefore, a more appropriate operation pattern can be specified as the comparison operation pattern.

  In addition, since the support server 2 extracts a series of motions of substantially the same subject that appear periodically in the moving image to be confirmed as motion patterns, the difference between the reference motion pattern and other motion patterns can be easily compared. Can do.

  In addition, since the support server 2 extracts the motion pattern from the elements of the subject that appear periodically in the moving image to be confirmed, a change in a part such as a foot or hand is used as a reference motion by a part of the motion pattern such as a still image. The difference between the pattern and other operation patterns can be compared more easily.

  In addition, when the support server 2 extracts the motion pattern from the moving image to be confirmed, the motion pattern is extracted by discriminating the periodicity of the change in position in each part that is an element of the subject. An operation pattern can be automatically extracted.

  Further, in the support server 2, an operation pattern whose period is significantly different from the average period and an operation pattern whose specific timing position of any part is greatly different from the average position in the part are specified as the comparison operation pattern. Therefore, it is possible to automatically acquire a comparison operation pattern that is more suitable for the form confirmation work.

(Second Embodiment)
Next, a second embodiment of the present invention will be described. Unlike the first embodiment, the present embodiment is different from the first embodiment in the form confirmation support system having the same configuration as that of the first embodiment (see FIG. 1), and the user selects a running person (person or other person). As information for supporting the operation of confirming whether the running form is good or bad using the captured moving image, a still image is provided instead of a moving image.

  Hereinafter, operations of the information terminal 1 and the support server 2 in the present embodiment will be described.

  FIG. 6 is a flowchart showing the processing contents of the control unit 11 in the information terminal 1. Also in the present embodiment, the control unit 11 causes the user to specify a desired moving image, specifies a moving image that is to be a form confirmation target (step SA51), and connects to the support server 2 (step S51). (SA52), the moving image data to be confirmed is uploaded to the support server 2 (step SA53). Thereafter, the control unit 11 stands by until confirmation still image data and analysis result data described later can be received from the support server 2 (step S54: NO).

  On the other hand, FIG. 7 is a flowchart showing the processing contents of the control unit 21 in the support server 2 during that time. Also in the present embodiment, the control unit 21 receives the moving image data from the information terminal 1 via the communication unit 22 (step SB51), and then analyzes the operation of each part of the subject in the moving image represented by the moving image data ( Step SB52).

  The details of the processing are the same as in the first embodiment, and the control unit 21 detects each part of the subject, that is, each part that can be determined as the left and right feet and hands of the runner, and within the moving image in each detected part. Get the change in position at. That is, for each part, a representative point suitable for tracking is set between frames such as the tip of each part, the coordinate position of the set representative point is acquired for each frame (may be every several frames) of the moving image, and the storage unit 23 stores each part and creates a database.

  Next, unlike the first embodiment, the control unit 21 determines a specific part (representative point) having the largest position change based on a temporal change of each part (representative point) stored in the storage unit 23. ) Only (step SB53).

  And the control part 21 extracts the operation pattern of the runner of several positions from which a time position differs in a moving image by confirming the periodic change of the position of the specific site | part with the largest position change (step SB54). At that time, the control unit 21 acquires the frame number (time position) at the start time of each operation pattern and the frame number (time position) at the end time, and stores them in the storage unit 23.

  Furthermore, in the present embodiment, in the process of step SB54, the control unit 21 acquires the position at the specific timing of the specific part in the frame period from the start time to the end time in each operation pattern, and the position and the specific The frame number of the timing frame is acquired and stored in the storage unit 23. The specific timing is one of two types of positions that are timings when the left and right feet and left and right hands reciprocate in each motion pattern, that is, timings when the moving direction is reversed.

  Next, the control unit 21 obtains the average period of the operation patterns, that is, the average value of the operation time from the start time to the end time in each operation pattern (step SB55).

  Next, the control part 21 acquires an average position about the specific site | part extracted by the process of step SB53 (step SB56). This average position is an average position at a specific timing of a specific part in each operation pattern, as in the first embodiment. Note that the average period of the motion pattern and the average position of the specific part may be acquired only for the first half period, not the whole period of the moving image.

  Next, the control unit 21 specifies a reference operation pattern from the average period acquired in the process of Step SB55 (Step SB57). Also in the present embodiment, the control unit 21 specifies, as a reference operation pattern, an operation pattern whose cycle (operation time) is closest to the average value among the operation patterns that appear repeatedly in the moving image.

  Next, the control unit 21 sets a threshold value used for specifying the comparison operation pattern to be compared with the reference operation pattern (step SB58). Also in this embodiment, the control unit 21 sets the first threshold value and the second threshold value as threshold values. The first threshold value relates to the cycle of the operation pattern, and is a difference from the above-described average cycle. The second threshold is related to the position of the specific timing of the specific part where the position change is the largest, and is the difference from the above-described average position.

  Next, the control unit 21 specifies, as comparison operation patterns, operation patterns exceeding the first threshold and operation patterns exceeding the second threshold among the operation patterns other than the reference operation pattern (step SB59). ).

  Also in this embodiment, in the process of step SB58, a predetermined ratio with respect to the average period can be set as the first threshold value regarding the period of the operation pattern, not the difference from the average period. In addition, as the second threshold value regarding the position at the specific timing of the specific part having the largest change in position, a predetermined ratio with respect to the average position can be set instead of the difference from the average position.

  Next, the control unit 21 generates confirmation still image data from the original moving image to be confirmed (step SB60). In such processing, the control unit 21 firstly changes the position of the reference motion pattern and the comparison motion pattern (one or more) from the original moving image in the frame section corresponding to each motion pattern. Data of a still image of a frame corresponding to the specific timing described above in the specific part is extracted. Next, portions corresponding to the main subject (runner) are cut out from the extracted still images of the respective motion patterns, and still image data for confirmation is generated by merging the still image data of the cut out portions.

  Thereafter, the control unit 21 transmits the generated still image data to the information terminal 1 together with the analysis result data regarding the reference motion pattern and the comparison motion pattern (step SB61).

  The analysis result data of the present embodiment includes the following data for each operation pattern of the reference operation pattern and the comparison operation pattern (one or more) in the moving image. The specific data is the frame number stored in step SB54 indicating the time position of the specific timing in the specific part of the subject in the moving image and the position (coordinate position) at the specific timing in the specific part of the subject.

  That is, the control unit 21 determines the operation pattern at a plurality of positions with different time positions in the moving image to be confirmed, the cycle (operation time), and the position of the predetermined part (left and right feet and hands) of the subject at a specific timing. As a result of comparison as a viewpoint, the still image data for confirmation and the analysis result data are transmitted to the information terminal 1.

  On the other hand, as shown in FIG. 6, when the information terminal 1 receives the confirmation still image data and analysis result data from the support server 2 (step SA54: YES), the control unit 11 via the communication unit 13 is received. Is displayed on the display unit 15 on the display unit 15 so that the still images representing the reference motion pattern and the comparison motion pattern described above can be identified (step SA55).

  Also in the present embodiment, there are two display forms of both still images on the form confirmation screen, that is, parallel display and superimposed display, as in the first embodiment.

  FIG. 8A is a diagram showing a fifth form confirmation screen G21 displayed on the display unit 15 immediately after receiving the confirmation moving image data and analysis result data.

  As shown in the figure, on the fifth form confirmation screen G21, the reference image g21 representing the reference operation pattern is arranged on the left side of the screen, the comparison image g22 representing the comparison operation pattern is arranged on the right side of the screen, and the reference image is displayed. The g21, the comparison image g22, and the position gauge g23 are arranged below. That is, the display form of the still image on the fifth form confirmation screen G21 is parallel display.

  Note that the moving images of the reference operation pattern and the comparison operation pattern are moving images of only the runner portion as described above. In addition, the comparison image g22 at the beginning of the display of the fifth form confirmation screen G21 shows the comparison operation pattern with the earliest time position in the moving image to be confirmed when there are a plurality of comparison operation patterns. It represents.

  When the fifth form confirmation screen G21 is displayed, the control unit 11 sets the frame number in the still image for each operation pattern included in the analysis result data, that is, the frame number at the specific timing of the specific part of the subject (runner) described above. Based on this, the position gauge g23 indicating the time position in the moving image to be confirmed is displayed on the screen.

  When the fifth form confirmation screen G21 is displayed, the control unit 11 together with the position gauge g23, as shown in the figure, displays the time within the moving image to be confirmed in the reference image g21 and the comparison image g22 (from the beginning). Elapsed time) and the cycle of the operation pattern are also displayed on the display unit 15, respectively.

  Further, when displaying the fifth form confirmation screen G21, the control unit 11 causes the above-described mark g4 indicating the specific part of the subject (runner) to be displayed superimposed on the reference image g21 and the comparison image g22. FIG. 8A shows an example in which the specific part is the foot of the subject.

  Further, after displaying the above-described fifth form confirmation screen G21, the control unit 11 determines whether there is an end operation for instructing the user to end the confirmation work, whether there is a display switching operation for switching the display mode, and a sending operation. The presence or absence of this is sequentially confirmed (steps SA56, SA57, SA59). Then, after the fifth form confirmation screen G21 is displayed, the control unit 11 continues to display the fifth form confirmation screen G21 if any of the above operations is not performed by the user (step SA59: NO).

  On the other hand, when there is a display switching operation by the user (step SA57: YES), the control unit 11 switches the display form of the reference image g21 and the comparison image g22 from parallel display to superimposed display. The sixth form confirmation screen G22 shown in FIG. 8B is displayed on the display unit 15 (step SA58).

  As shown in the figure, the sixth form confirmation screen G22 displays the reference image g21 and the comparative image g22 superimposed on the center of the screen, and the position gauge g23 described above is arranged below the reference image g21. . Also, when displaying the sixth form confirmation screen G22, the control unit 11 causes the mark g4 indicating the specific part of the subject to be superimposed on the reference image g21 and the comparison image g22.

  In FIG. 8B, for convenience, the subject portion of the reference image g21 is shown in black, and the subject portion of the comparative image g22 is shown in diagonal lines. Can be distinguished from the reference image g21 and the comparison image g22. Moreover, although the example which overlapped the comparison image g22 on the reference | standard moving image g21 was shown here, the up-and-down relationship of both may be reverse.

  Further, in the state in which the sixth form confirmation screen G22 is displayed on the display unit 15, if there is a display switching operation by the user later (step SA57: YES), the control unit 11 displays the fifth form confirmation screen G21 again. It is displayed on the display unit 15.

  If the user performs a feeding operation while displaying the fifth form confirmation screen G21 or the sixth form confirmation screen G22 (step SA59: YES), the control unit 11 at that time It is checked whether there is a comparison operation pattern other than the comparison operation pattern being displayed as the comparison image g22 (step SA60). That is, it is confirmed whether or not still images of other comparison operation patterns are merged as confirmation still images.

  If there is no other comparison operation pattern (step SA60: NO), the control unit 11 continues displaying the current comparison image g22 on the fifth form confirmation screen G21 and the sixth form confirmation screen G22. That is, do nothing.

  On the other hand, if there is another comparison operation pattern (step SA60: YES), the control unit 11 displays the operation pattern (step SA61). That is, the control unit 11 displays a still image of a comparison operation pattern whose time position in the moving image to be confirmed is one after the comparison operation pattern being displayed as the comparison image g22 on the screen as a new comparison image g22. .

  Although omitted in FIG. 6, the user's feed operation is permitted to return the operation pattern to the previous operation pattern in time, and the feed operation returns the operation pattern to the previous operation pattern in time. If so, in step SA61, the control unit 11 performs the reverse process. That is, the still image of the comparison operation pattern whose time position in the moving image to be confirmed is the previous comparison operation pattern being displayed as the comparison image g22 is displayed on the screen as a new comparison image g22.

  Thereafter, the control unit 11 repeats the above-described processing from step SA57 to step SA61 until there is an end operation by the user (step SA56: NO), and if there is an end operation by the user (step SA56: YES), at that time To finish all processing.

  In the form confirmation support system of the present embodiment described above, when the user confirms whether the running form is good or bad using a moving image obtained by photographing a person who is running (the person or another person) using it, Of the motion patterns that appear repeatedly during running, the reference motion pattern that is the reference repeatedly compared to the reference motion pattern that is displayed during the running by the fifth and sixth form confirmation screens G21 and G22 displayed on the information terminal 1 is large. Only operation patterns can be easily compared and confirmed.

  Therefore, it is possible to check which form is good and which form is bad during training without carefully checking the moving image. Even for sports such as running where there are many repetitions of the same pattern operation, the work of checking the form during training can be performed efficiently and easily.

  In particular, in the present embodiment, the support server 2 extracts a motion pattern from an element of a subject that appears periodically in a moving image to be confirmed, so that comparison with a comparison image g22 and changes in parts such as feet and hands is large. The comparison image g22 showing only the operation pattern can be displayed, and the operation pattern to be noticed that has changed during training can be efficiently confirmed during the confirmation of the form.

  In the present embodiment, among the effects described in the first embodiment, the same effects as those in the first embodiment are provided except for the effects caused by expressing the reference operation pattern and the comparison operation pattern as moving images. Can be obtained.

(Modifications, etc.)
Hereinafter, modified examples of the present embodiment will be described. That is, in the first and second embodiments described above, the reference operation pattern and the comparison operation pattern are automatically specified from the operation patterns repeatedly appearing in the confirmation target moving image. Good.

  For example, the reference operation pattern is an operation pattern at an arbitrary time position designated by the user, and the comparison operation pattern is automatically specified by comparing the difference between the reference operation pattern and another operation pattern. Also good. In that case, an operation pattern having a large difference from the operation pattern arbitrarily designated by the user can be automatically set as the comparison operation pattern.

  In the first and second embodiments, the reference motion pattern and one or more comparison motion patterns are extracted from the confirmation target moving image, and these are compared with the motion patterns at a plurality of positions in the confirmation target moving image. The configuration to be displayed as a result has been described.

  However, in carrying out the present invention, for example, a set of operation patterns whose time positions in the moving image to be confirmed are used as comparison targets, and each operation pattern of the comparison target is set as the next operation pattern. You may make it compare continuously, changing in order.

  In that case, by displaying an image (moving image or still image) representing a set of motion patterns in a form that indicates the comparison result or continuously on the screen together with information indicating the comparison result. Thus, it is possible to efficiently and easily check the form during the training of a sport where the operation of the same pattern is frequently repeated.

  Further, as in the first and second embodiments, without displaying images (moving images or still images) representing the reference operation pattern and the comparison operation pattern, the difference between them (period and position of an arbitrary part) Only the difference) may be displayed or notified as advice.

  In addition, for extracting motion patterns that repeatedly appear in the moving image to be checked, for example, a predetermined sensor such as an acceleration sensor attached to the hand or foot is used, and the motion pattern is extracted based on the detection value of the sensor during shooting of the moving image. It does not matter as a structure to do. In this case, the processing load required for extracting the operation pattern in the support server 2 can be reduced as compared with the case where the operation pattern is extracted by image processing.

  Further, the operation pattern may be extracted by using both the predetermined sensor and the image processing technique. In that case, the extraction accuracy of the operation pattern can be increased.

  Also, unlike the first and second embodiments, the information server 1 causes the support server 2 to perform a part of the processing related to the display of the confirmation image generated by the support server 2 (for example, the moving image reproduction process). The image may be displayed by a Web UI (Web User Interface) function. Furthermore, all of the functions of the support server 2 described in the first and second embodiments may be realized only by the information terminal 1.

  Further, in the above description, the case where the form to be confirmed mainly using the moving image is the running form, but the present invention is not limited to running but also to a swimming form and further to a form such as dance not limited to sports. It can also be applied to.

As mentioned above, although several embodiment of this invention and its modification were demonstrated, if these are in the range in which the effect of this invention is acquired, it can change suitably, and embodiment after change is also a claim. It is included in the scope of the invention described in the scope of the invention and the invention equivalent to the invention. The invention described in the scope of the claims of the present application will be appended below.
[Claim 1]
In the moving image, extraction means for extracting an operation pattern in which the subject repeatedly appears in the moving image;
Comparison means for comparing operation patterns at a plurality of positions at different time positions in the moving image extracted by the extraction means from a predetermined viewpoint;
An output means for outputting a comparison result by the comparison means.
[Claim 2]
The comparing means compares motion patterns at a plurality of positions having different time positions in the extracted moving image from a predetermined viewpoint, and identifies a time position of an operation pattern that satisfies a predetermined condition. Item 1. A form confirmation support apparatus according to Item 1.
[Claim 3]
The form confirmation support apparatus according to claim 2, wherein the predetermined condition is high or low similarity in the predetermined point of view with another plurality of operation patterns.
[Claim 4]
The comparison unit specifies a reference operation pattern from the operation patterns at a plurality of positions extracted by the extraction unit, and compares the reference operation pattern with an operation pattern at another plurality of positions. The form confirmation support apparatus according to any one of claims 1 to 3.
[Claim 5]
5. The form confirmation support apparatus according to claim 1, wherein the extraction unit extracts a series of motions of a subject periodically appearing in the moving image as the motion patterns. 6.
[Claim 6]
5. The form confirmation support apparatus according to claim 1, wherein the extraction unit extracts the motion pattern from an element that periodically appears in the moving image. 6.
[Claim 7]
The form confirmation support apparatus according to any one of claims 1 to 6, wherein the extraction unit determines the periodicity of a change in position of a subject at a predetermined part and extracts the operation pattern.
[Claim 8]
The said comparison means specifies the operation pattern used as the said reference according to the predetermined value in each operation pattern and the predetermined reference | standard regarding the said value from the operation pattern in the said several position. Form confirmation support device.
[Claim 9]
The predetermined standard is based on a predetermined standard value,
9. The form confirmation support apparatus according to claim 8, wherein an operation pattern in which the predetermined value exceeds a predetermined threshold from the reference value is specified as the other operation pattern.
[Claim 10]
9. The form confirmation support apparatus according to claim 8, wherein the predetermined value is an operation time of a series of movements of an object, and the difference between the predetermined reference and an average value of the operation times is smaller.
[Claim 11]
9. The form confirmation support according to claim 8, wherein the predetermined value is an attention position at a specific timing of a predetermined part of the subject, and the difference between the predetermined reference and the average position of the attention position is smaller. apparatus.
[Claim 12]
The comparison means specifies an operation pattern at an arbitrary time position designated by the user as the reference operation pattern, and determines a difference between the reference operation pattern and another operation pattern having a different time position. The form confirmation support apparatus according to any one of claims 5 to 8, wherein comparison is performed.
[Claim 13]
The form confirmation support apparatus according to claim 1, wherein the extraction unit extracts the operation pattern using an image processing technique.
[Claim 14]
The extraction means extracts the motion pattern based on position change information indicating a change in position of the predetermined part detected during imaging of the moving image by a detection means attached to the predetermined part of the subject. The form confirmation support apparatus according to claim 1, wherein the form confirmation support apparatus is characterized in that
[Claim 15]
The comparison means takes the operation pattern at the plurality of positions as a comparison target with a set of operation patterns whose time positions are in succession, and sequentially changes each operation pattern of the comparison target to the next operation pattern at the time position. The form confirmation support apparatus according to any one of claims 1 to 14, wherein the comparison is performed while comparing.
[Claim 16]
The output form of the comparison result in the output means is an identifiable display of each image of a set of operation patterns having different time positions on the screen. Form confirmation support device according to item.
[Claim 17]
The form confirmation support apparatus according to claim 16, wherein the output form of the comparison result in the output means is to display the moving images of the set of operation patterns side by side on a screen.
[Claim 18]
The form confirmation support apparatus according to claim 16, wherein the output form of the comparison result in the output means is to display the moving images of the set of operation patterns superimposed on a screen.
[Claim 19]
The output form of the comparison result in the output means is an operation time of a series of movements of the subject in any one of the set of operation patterns when displaying each image of the set of operation patterns on the screen. The form confirmation according to any one of claims 16 to 18, characterized in that an adjustment is made to coincide with an operation time of a series of movements of a subject in any one of the set of operation patterns. Support device.
[Claim 20]
The said output means outputs the difference information showing the difference of a set of operation | movement patterns from which the said time position differs as a comparison result by the said comparison means, The any one of Claims 1 thru | or 15 characterized by the above-mentioned. Form confirmation support device.
[Claim 21]
21. The form confirmation support apparatus according to claim 20, wherein the output unit outputs information indicating a difference in operation time of the series of operations in the set of operation patterns as the difference information.
[Claim 22]
The output means includes, as the difference information, information indicating a position difference related to a part where a position difference at a determined timing among the parts of the subject in the series of motions in the set of motion patterns is greater than or equal to a reference. The form confirmation support apparatus according to claim 20, wherein the form confirmation support apparatus outputs the form confirmation function.
[Claim 23]
The output form of the comparison result in the output means is displayed on the screen so that the time position between the reference operation pattern among the operation patterns extracted by the extraction means and the operation pattern other than the operation pattern can be identified on the screen. The form confirmation support apparatus according to any one of claims 1 to 19, wherein the form confirmation support apparatus is configured to cause a problem.
[Claim 24]
In the moving image, an extraction step of extracting an operation pattern in which the subject repeatedly appears in the moving image;
A comparison step of comparing operation patterns at a plurality of positions at different time positions in the moving image extracted by the extraction step from a predetermined viewpoint;
An output step of outputting a comparison result of the comparison step.
[Claim 25]
On the computer,
In a moving image, an extraction procedure for extracting an operation pattern in which a subject repeatedly appears in the moving image;
A comparison procedure for comparing operation patterns at a plurality of positions at different time positions in the moving image extracted by the extraction procedure from a predetermined viewpoint;
An output procedure for outputting a comparison result according to the comparison procedure.
[Claim 26]
A form confirmation support system comprising an information terminal and a support server to which the information terminal is connected,
The support server
Obtaining means for obtaining a moving image transferred from the information terminal;
Extraction means for extracting an action pattern in which a subject repeatedly appears in the moving image acquired by the acquisition means;
Comparison means for comparing operation patterns at a plurality of positions at different time positions in the moving image extracted by the extraction means from a predetermined viewpoint;
Providing means for providing the information terminal with a comparison result by the comparing means;
The information terminal
Transfer means for transferring the moving image to the support server;
An output means for outputting the comparison result provided from the support server. A form confirmation support system, comprising:

DESCRIPTION OF SYMBOLS 1 Information terminal 11 Control part 12 Imaging part 13 Communication part 14 Storage part 15 Display part 16 Power supply part 17 Operation part 2 Support server 21 Control part 22 Communication part 23 Storage part 24 Image processing part 100 Network G1 1st form confirmation screen G2 2nd form confirmation screen G3 3rd form confirmation screen G4 4th form confirmation screen G21 5th form confirmation screen G22 6th form confirmation screen g1 moving image g2 comparative video g3 position gauge g4 mark g21 reference image g22 comparison Image g23 Position gauge

Claims (11)

In the moving image, extraction means for extracting an operation pattern in which the subject repeatedly appears in the moving image;
A comparison unit that identifies a reference operation pattern from operation patterns at a plurality of positions extracted by the extraction unit, and compares the reference operation pattern with an operation pattern at another plurality of positions;
Output means for outputting a comparison result by the comparison means;
With
The moving image comparison apparatus characterized in that the comparison means identifies the reference operation pattern according to a predetermined value in each operation pattern and a predetermined reference regarding the value from the operation patterns at the plurality of positions. The predetermined standard is based on a predetermined standard value,
The moving image comparison apparatus according to claim 1, wherein an operation pattern in which the predetermined value exceeds a predetermined threshold value from the reference value is specified as the other operation pattern.   The moving image comparison apparatus according to claim 1, wherein the predetermined value is an operation time of a series of movements of a subject, and the predetermined reference has a smaller difference from an average value of the operation times.   The moving image comparison according to claim 1, wherein the predetermined value is a target position at a specific timing of a predetermined part of the subject, and the predetermined reference has a smaller difference from an average position of the target position. apparatus. In the moving image, extraction means for extracting an operation pattern in which the subject repeatedly appears in the moving image;
Comparison means for comparing operation patterns at a plurality of positions at different time positions in the moving image extracted by the extraction means from a predetermined viewpoint;
Output means for outputting a comparison result by the comparison means;
With
The output form of the comparison result in the output means is displayed on the screen so that the time position between the reference operation pattern among the operation patterns extracted by the extraction means and the operation pattern other than the operation pattern can be identified on the screen. A moving image comparison apparatus characterized by that. In the moving image, an extraction step of extracting an operation pattern in which the subject repeatedly appears in the moving image;
A comparison step of identifying a reference operation pattern from the operation patterns at a plurality of positions extracted by the extraction step, and comparing the reference operation pattern with an operation pattern at another plurality of positions;
An output step of outputting a comparison result by the comparison step;
Including
The moving image comparison method characterized in that the comparison step specifies the reference operation pattern according to a predetermined value in each operation pattern and a predetermined reference regarding the value from the operation patterns at the plurality of positions. In the moving image, an extraction step of extracting an operation pattern in which the subject repeatedly appears in the moving image;
A comparison step of comparing operation patterns at a plurality of positions at different time positions in the moving image extracted by the extraction step from a predetermined viewpoint;
An output step of outputting a comparison result by the comparison step;
Including
The output form of the comparison result in the output step is such that the time position between the reference operation pattern among the operation patterns extracted in the extraction step and the operation pattern other than the operation pattern can be identified on the screen. A moving image comparison method, characterized in that: On the computer,
In the moving image, extraction means for extracting an operation pattern in which the subject repeatedly appears in the moving image;
A comparison unit that identifies a reference operation pattern from operation patterns at a plurality of positions extracted by the extraction unit, and compares the reference operation pattern with an operation pattern at another plurality of positions;
Output means for outputting a comparison result by the comparison means;
A program for executing
The comparison means identifies a reference operation pattern according to a predetermined value in each operation pattern and a predetermined reference relating to the value from the operation patterns at the plurality of positions. On the computer,
In the moving image, extraction means for extracting an operation pattern in which the subject repeatedly appears in the moving image;
Comparison means for comparing operation patterns at a plurality of positions at different time positions in the moving image extracted by the extraction means from a predetermined viewpoint;
Output means for outputting a comparison result by the comparison means;
A program for executing
The output form of the comparison result in the output means is displayed on the screen so that the time position between the reference operation pattern among the operation patterns extracted by the extraction means and the operation pattern other than the operation pattern can be identified on the screen. A program characterized by what is to be made. A moving image comparison system comprising an information terminal and a server to which the information terminal is connected,
The server
In the moving image, extraction means for extracting an operation pattern in which the subject repeatedly appears in the moving image;
A comparison unit that identifies a reference operation pattern from operation patterns at a plurality of positions extracted by the extraction unit, and compares the reference operation pattern with an operation pattern at another plurality of positions;
Providing means for providing the information terminal with a comparison result by the comparing means;
With
The comparison means identifies the reference operation pattern according to a predetermined value in each operation pattern and a predetermined reference related to the value from the operation patterns at the plurality of positions,
The information terminal
Transfer means for transferring the moving image to the server;
Output means for outputting the comparison result provided from the server;
With
A moving image comparison system characterized by this. A moving image comparison system comprising an information terminal and a server to which the information terminal is connected,
The server
In the moving image, extraction means for extracting an operation pattern in which the subject repeatedly appears in the moving image;
Comparison means for comparing operation patterns at a plurality of positions at different time positions in the moving image extracted by the extraction means from a predetermined viewpoint;
Providing means for providing the information terminal with a comparison result by the comparing means;
With
The information terminal
Transfer means for transferring the moving image to the server;
Output means for outputting the comparison result provided from the server;
With
The output form of the comparison result in the output means is displayed on the screen so that the time position between the reference operation pattern among the operation patterns extracted by the extraction means and the operation pattern other than the operation pattern can be identified on the screen. Is what
A moving image comparison system characterized by this.

Images