JP2010127639A - Image processing device, image processing method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing device performing swing analysis with high accuracy by a simple system structure. <P>SOLUTION: From one or more groups of asynchronous moving images obtained by photographing an object which performs swing actions from a plurality of directions including front and back directions, a static image for each of the groups is generated. A static image wherein an action scene in one of the generated static images and an action scene of another static image corresponding to the action scene are synchronized is memorized. A head position in a swing action of the object photographed in the memorized static image is inputted, and a head speed is calculated based on the distance between the adjacent heads out of a plurality of head positions inputted to display the calculated head speed. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

  In recent years, golf hitting measuring machines have been installed in golf shops, driving ranges, etc., and various measurement values can be calculated from the measured hitting information to measure the flight distance, flight direction, and the like. This type of golf hitting measuring machine measures a player's golf swing. Based on the measured values, predicted calculation values such as head speed, launch ball initial speed, launch angle, spin direction, flight distance, etc. are calculated and notified to the player. The player can obtain objective data related to the swing such as a flight distance and a jump direction for each swing, which can be used to improve the golf swing.

The objective data obtained by the golf hitting measuring instrument has a problem that it is impossible to objectively grasp at what swing the flight distance is extended or the flying ball trajectory is bent. As a countermeasure to this problem, for example, Patent Document 1 discloses a technique for performing an efficient swing check by functionally relating a measurement value at the time of hitting and a swing image.
JP 2003-88604 A

  However, with the conventional swing analysis method, when synchronizing the timing to acquire the image data (swing image) necessary for the analysis or actually measuring the head speed, a special device or complex image analysis is required. Needed processing. For this reason, it has been extremely expensive to perform swing analysis.

  An object of the present invention is to provide an image processing apparatus capable of performing swing analysis with high accuracy with a simple system configuration.

  The invention described in claim 1 was made to achieve the above-described object, and was obtained by photographing an imaging target performing a swing operation from a plurality of imaging directions including the front and rear in an image processing apparatus. Corresponding to a still image generating unit that generates a still image of each of the plurality of groups from a plurality of groups of asynchronous moving images, an operation scene of one still image among the still images generated by the still image generating unit, and the corresponding operation scene Storage means for storing a still image synchronized with an operation scene of another still image to be operated, and an operation input for inputting a head position in the swing operation of the subject to be photographed in the still image stored in the storage means And a calculation method for calculating a head speed based on a distance between adjacent head positions among a plurality of head positions input by the operation input means. When, characterized in that it comprises a display means for displaying a head speed calculated by the calculating means.

  According to a second aspect of the present invention, in the image processing apparatus according to the first aspect, the calculating means includes a change amount of a head position in a still image photographed from the front and a still image photographed from the rear. The distance between the head positions is calculated from the amount of change in the head position and the inclination of the body during the swing operation.

  According to a third aspect of the present invention, the still image generating means is configured to obtain a plurality of groups of asynchronous moving images obtained from a plurality of groups of asynchronous moving images obtained by photographing a subject to be swung from a plurality of photographing directions including the front and back. A still image generation step of generating a still image of the image, and a storage unit that operates the operation scene of one still image among the still images generated by the still image generation unit and the operation scene of another still image corresponding to the operation scene A storage step of storing a synchronized still image, and an operation input unit for inputting a head position in the swing motion of the subject to be photographed in the still image stored in the storage unit, A calculating step of calculating a head speed based on a distance between adjacent head positions among a plurality of head positions input by the operation input means; Display means is an image processing method characterized by including a display step of displaying the head speed calculated by the calculating means.

  According to a fourth aspect of the present invention, a still image of each of the plurality of groups is obtained from a plurality of groups of asynchronous moving images obtained by photographing a subject to be swung from a plurality of photographing directions including the front and back. A still image generating means for generating a still image generated by synchronizing a motion scene of one still image and a motion scene of another still image corresponding to the motion scene among the still images generated by the still image generating means. Storage means for storing, operation input means for inputting a head position in the swing motion of the subject to be photographed in a still image stored in the storage means, adjacent among a plurality of head positions input by the operation input means Calculating means for calculating the head speed based on the distance between the head positions to be displayed, and displaying the head speed calculated by the calculating means Is a program for causing the shown unit functions as a.

  According to the present invention, it is possible to provide an image processing apparatus capable of performing swing analysis with high accuracy with a simple system configuration.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 shows a golf swing analysis system 1 using an image processing apparatus according to an embodiment of the present invention. The golf swing analysis system 1 includes three cameras 2, 3, 4, a HUB 5, an image processing device 10, a printer 6, and a disc writer 7.

The cameras 2, 3, and 4 image the subject H performing a golf swing or the pin P on which a golf ball is placed and the vicinity thereof from different angles. In the following description, the direction in which the golf ball flies is the front, the opposite side is the rear, and the side on which the golf ball is placed as viewed from the subject H is the front. In this embodiment, the cameras 2, 3 and 4 are high-speed digital cameras capable of shooting a high-speed moving image of 1200 [fps].
The camera 2 images the subject H from the front side of the subject H performing a golf swing, and the camera 3 images the subject H from the rear of the subject H. The camera 4 images the pin P and its vicinity from the front side of the subject H. The captured image displayed during image editing is a still image, but the cameras 2, 3, and 4 output the captured image as a moving image.
The cameras 2, 3, and 4 have a buffer memory (not shown), and each camera stores a captured image in the buffer memory and later transfers and outputs it to the outside.

  The cameras 2, 3, and 4 can set the number of frames per second (hereinafter referred to as “fps”) at the time of moving image capturing to 300 to 1200 [fps]. In this embodiment, the cameras 2 and 3 perform imaging at 300 [fps], and the camera 4 performs imaging at 1200 [fps].

  The HUB 5 is a line concentrator interposed between the three cameras 2, 3, 4 and the image processing apparatus 10, and connects the three cameras 2, 3, 4 and the image processing apparatus 10.

  The image processing apparatus 10 performs swing analysis. Swing analysis refers to storage of captured moving images by the three cameras 2, 3, and 4 and various processes based on the captured moving images. Details of the swing analysis will be described later.

The printer 6 is a device that performs printing on a print medium (for example, paper or the like) by printing processing performed by the image processing apparatus 10. The printer 6 is configured by a printing device such as a page printer.
The disc writer 7 is a device that writes digital data to a DVD medium under the control of the image processing apparatus 10.

Next, the configuration of the image processing apparatus 10 will be described. FIG. 2 is a block diagram illustrating a configuration of the image processing apparatus 10.
The image processing apparatus 10 includes a CPU 11, a RAM 12, a ROM 13, a storage device 14, an input device 15, a display device 16, interfaces 17, 18, and 19, and a bus 20 that interconnects these components, Have
In the present embodiment, the image printing apparatus 10 is configured by an information processing apparatus such as a personal computer or a desktop computer.

The CPU 11 reads a program, data, and the like from the ROM 13 and the storage device 14 and executes them, and controls the operation of each unit of the image processing apparatus 10 and each component connected to the image processing apparatus 10. A program, data, and the like read by the CPU 11 and parameters temporarily generated in the processing of the CPU 11 are stored in the RAM 12.
For example, the CPU 11 generates a still image in units of a plurality of groups from a plurality of groups of asynchronous moving images obtained by asynchronously capturing a subject to be swung from a plurality of shooting directions including the front and back. Image generating means). Further, the CPU 11 calculates a head speed based on a distance between adjacent head positions among a plurality of head positions plotted by a plotting operation to be described later (calculation means).

The ROM 13 is, for example, a ROM chip or the like, and stores programs, data, and the like so as not to be rewritten.
The storage device 14 is, for example, a hard disk drive or a flash memory, and can store a program, data, and the like in a rewritable manner. For example, a still image synchronized with each operation scene is stored (storage means).

  The input device 15 is, for example, a keyboard or a mouse, and enables input processing to the image processing device 10 by an operator manually. For example, it is possible to input a head position in a swing operation of a subject to be photographed shown in a still image (operation input means).

  The display device 16 is configured by, for example, an LCD (Liquid Crystal Display), an organic EL (Electro-Luminescence) display, or the like, and displays contents according to the screen output processing of the image processing device 10. For example, the transition of the head speed calculated by the CPU 11 (calculation means) is displayed as a graph (display means).

  The interfaces 17, 18, and 19 are bus interfaces such as USB (Universal Serial Bus), for example, and enable connection between the image processing apparatus 10 and an external device. The cameras 2, 3, 4 are connected to the interface 17 via the HUB 5, the printer 6 is connected to the interface 18, and the discwriter 7 is connected to the interface 19.

  Next, the content of the swing analysis process will be described. FIG. 3 is a flowchart showing the contents of the swing analysis process.

  First, photographing is performed (step S1). Photographing is a process in which the image input apparatus 10 operates the three cameras 2, 3, and 4 to photograph the subject H by a predetermined input operation by an operator. The moving images captured by the three cameras 2, 3, 4 are transferred to the image processing device 10, and the image processing device 10 stores the transferred captured moving images in the storage device 14.

  Next, the image processing apparatus 10 generates a still image (step S2). Still image generation is processing for generating a still image from each captured moving image stored in the storage device 14. The generated still image is stored in the storage device 14.

  Next, the image processing apparatus 10 performs swing target extraction based on the input contents of the operator (step S3). Swing target extraction is a process of determining a range (swing target) of an image captured during a golf swing for an image captured by the camera 2 among images divided into still images. This is a process that is performed because a captured image that is not during a golf swing may be included when moving images are captured by the cameras 2, 3, and 4. Examples of the captured image that is not during the golf swing include a captured image in which the subject H is performing an operation of adjusting the posture, and a subject H is performing other operations (for example, smoking a cigarette). . Swing target extraction is not performed on images captured by the cameras 3 and 4, but the swing target is determined by swing image synchronization described later.

  Next, the image processing apparatus 10 performs swing image synchronization based on the input contents of the operator (step S4). Swing image synchronization is a process of synchronizing still images from three directions, and associates still images captured at the same timing with still images captured by the cameras 2, 3, and 4, respectively.

  Next, the image processing apparatus 10 performs a movement state plot based on the input contents of the operator (steps S5 to S7). The moving state plot is a process of storing the position of the golf club head in each still image as coordinate data for each of the images from the three directions. Among the still images after the impact timing, for the still image in which the golf ball is reflected, the position of the golf ball is also stored as coordinate data. The golf club head position and the golf ball position are input manually by the operator. The movement state plot is individually performed for each of the still images captured by the cameras 2, 3, and 4.

  Next, the image processing apparatus 10 performs swing speed analysis (step S8). The swing speed analysis is a calculation process of the moving speed of the head of the golf club during the golf swing. The swing speed analysis is performed based on the golf club head position input by the moving state plot.

  Next, the image processing apparatus 10 performs swing form printing (step S9). Swing form printing is a process of picking up and printing an image during a golf swing based on a predetermined rule.

  In parallel with the operation state plot, swing analysis, and swing form printing, or in a separate process, the image processing apparatus 10 can create a synchronized moving image (step S10). Synchronized video creation is processing for converting a still image for which swing image synchronization has been completed into a video again, and creating a video file that can be confirmed by playing the video captured by the three cameras 2, 3, and 4. .

  The embodiment of the present invention focuses on the swing speed analysis in step S8 among the above processes. In this embodiment, in order to perform the swing speed analysis, it is indispensable that the swing image synchronization and the movement state plot are performed. Therefore, regarding the swing image used in the present embodiment, it is assumed that the swing image synchronization and the movement state plot are performed in advance.

FIG. 4 is a diagram showing the trajectory of the head position that moves for each shooting.
FIG. 4A shows the locus of the swing motion taken from the front. FIG. 4B is a trajectory of the swing motion taken from behind. Circles in the figure indicate the locus of the head position during the swing operation.
The swing speed is calculated based on the distance between the two head positions (for example, P _n and P _{n + 1} ) shown in FIG. Actually, however, as shown in FIG. 4B, since the player is tilting and swinging, the correct swing speed is calculated by correcting the tilt θ. A swing plane L is a line segment representing the inclination of the body during the swing operation.

実際には、表示装置１６上でプロットしたヘッド位置間の距離と実際のヘッド位置間の距離は異なる。上記演算を行う際には、プロットしたヘッド位置の距離に係数を掛けて補正を行い、実際の距離に変換する。
以下、スイングスピード解析の一連の流れについて、図６〜図１１を用いて詳細に説明する。 FIG. 5 is an enlarged view of a portion A shown in FIG.
FIG. 5A is a view taken from the front. FIG. 5B is a view taken from behind.
In order to calculate the swing speed, it is necessary to calculate the movement amount (distance) of the locus of the head position. As shown in FIG. 5C, the actual moving distance is shown as a result of combining the distance when photographing from the front and the distance when photographing from the rear in a three-dimensional space. The swing speed can be calculated, for example, by calculating Equation 1.

Actually, the distance between the head positions plotted on the display device 16 is different from the distance between the actual head positions. When the above calculation is performed, the plotted head position distance is corrected by multiplying it by a coefficient, and converted to an actual distance.
Hereinafter, a series of flow of the swing speed analysis will be described in detail with reference to FIGS.

  6 and 7 are flowcharts illustrating an example of the swing speed analysis process performed in the image processing apparatus 10 according to the present embodiment. The swing speed analysis process is realized by the CPU 11 executing a swing speed analysis program stored in the ROM 13 when the user's plotting of the head position is completed.

  First, the coordinate information of the swing plane (oblique line segment) L set for the rear image is read (step S101). The swing plane L set for the rear image is, for example, a line segment connecting both arms and the golf club during the swing operation, as shown in FIG. The swing plane L is drawn at the time of plotting. The start coordinates and end coordinates of the swing plane L are stored in the storage device 14.

  Next, the coordinate information read in step S101 is converted into the inclination θ of the swing plane using a trigonometric function (step S102).

  Next, since the front image is used to analyze the swing speed, the range of the front image to be analyzed is read from the reference position information shown in FIG. Among the read reference position information, the start image number (takeback start 0001558) is set to STARSPD and SPD, and the end image number (follow-through end 0002023) is set to STOPSPD (step S103).

  Next, the frame rate (FRfps) when the front image is taken is read (step S104). In the present embodiment, since the head position is not plotted for all captured images, the skipped (thinned-out) image does not have coordinate information. Therefore, by calculating a value obtained by multiplying the read frame rate by the number of skipped images, the time taken for the head to move between the plotted coordinates can be obtained.

  Next, the distance correction value DD is read (step S105). The coordinates obtained by plotting the head positions are the coordinates of the screen displayed on the display device 16, and the distance between the coordinates is different from the actual swing distance. The distance correction value DD is a coefficient for converting the distance between the coordinates into the actual swing distance. Since the distance correction value DD differs depending on the shooting state (camera position, etc.), the coefficient is determined by comparing with the coordinates plotted on the display device 16 when shooting is actually performed.

  Next, the head position change time DT is initialized (DT = 0) (step S106). The head position change time DT stores the number of skipped images having no coordinate information.

  Next, it is determined whether or not the analysis image number SPD is within the image range (step S107). If the current analysis image number SPD is less than the end image number STOPSPD, it is determined that it is within the image range. On the other hand, if the current analysis image number SPD is greater than or equal to the end image number STOPSPD, the swing speed analysis process is terminated with no analysis image.

  If it is determined in step S107 that the analysis image number SPD is within the image range, it is determined whether there is coordinate information associated with the image number (step S108). If there is coordinate information, the process proceeds to the next step S109, and if there is no coordinate information, the process proceeds to step S110.

  If it is determined in step S108 that there is coordinate information, the coordinate is set to (Xs, Ys) as the start coordinate position of the swing speed analysis (step S109).

  If it is determined in step S108 that there is no coordinate information, 1 is added to the analysis image number SPD to check the next coordinate information (step S110). When 1 is added to the analysis image number SPD, the process proceeds to step S107.

  When the start coordinate position (Xs, Ys) is set, 1 is added to the analysis image number SPD to check the next coordinate information (step S111).

  Next, 1 is added to the head position change time DT (step S112).

  Next, it is determined whether or not the analysis image number SPD updated in step S111 is within the image range (step S113). If the updated analysis image number SPD is equal to or less than the end image number STOPSPD, it is determined that the image is within the image range. On the other hand, if the updated analysis image number SPD is larger than the end image number STOPSPD, the process proceeds to step S121.

  If it is determined in step S113 that the analysis image number SPD is within the image range, it is determined whether there is coordinate information associated with the image number (step S114). If there is coordinate information, the process proceeds to the next step S115, and if there is no coordinate information, the process proceeds to step S111.

  If it is determined in step S113 that there is coordinate information, the coordinate is set to (Xe, Ye) as the end coordinate position of the swing speed analysis (step S115).

Next, the swing speed is calculated (step S116). The swing speed is automatically calculated based on the start coordinates (Xs, Ys), end coordinates (Xe, Ye), distance correction value DD, head position change time DT, and frame rate FRfps. The swing speed can be calculated, for example, by calculating Equation 2.

  Next, the swing speed Vn calculated in step S116 is stored (step S117). Further, the value of DT at the time of calculating the swing speed Vn is stored as Dn (step S118). The swing speed Vn and the head position change time Dn are stored in the storage device 14 in the format shown in FIG.

  Next, the head position change time DT is initialized (step S119).

  Next, the current end coordinate position (Xe, Ye) is substituted into the start coordinate position (Xs, Ys) (step S120). When the current end coordinate position (Xe, Ye) is substituted into the start coordinate position (Xs, Ys), the process proceeds to step S111, and the calculation of the swing speed is completed for all coordinate information (plotted head positions). Repeat until.

  When the calculation of the swing speed is completed for all coordinate information, the result is stored as shown in FIG. Since the unit of the head position change time Dn is a frame rate at the time of photographing (1/300 sec if 300 fps), it is also possible to calculate the temporal change of the swing speed from the value of Dn.

If it is determined in step S113 that the updated analysis image number SPD is larger than the end image number STOPSPD, in step S121, a graph showing the relationship between the stored swing speed Vn and head position change time Dn is displayed. It is displayed on the display device 16. The displayed graph is, for example, a graph as shown in FIG. FIG. 11 shows how the swing speed changes as the image transitions (time elapses).
When the graph is displayed, the swing speed analysis process is terminated.

As described above, in this embodiment, the amount of change in the head position in the still image taken from the front, the amount of change in the head position in the still image taken from the rear, and the inclination of the body during the swing operation ( The distance between the head positions can be calculated from the inclination of the swing plane).
Therefore, the head speed between the head positions can be automatically and accurately calculated using the coordinate information of the head positions plotted in advance. Further, since the calculated change in the head speed can be displayed in a graph, information useful for the player can be provided instantaneously.

  As mentioned above, although concretely demonstrated based on embodiment which concerns on this invention, this invention is not limited to the said embodiment, It can change in the range which does not deviate from the summary.

  For example, in the above embodiment, when a graph indicating the relationship between the stored swing speed Vn and the head position change time Dn is displayed on the display device 16, only the graph is displayed alone. Alternatively, it may be displayed together with the synchronized swing image.

In addition, the moving image handled in the present invention is not limited to a moving image obtained by shooting a golf swing, and any moving image that captures a moving locus of a moving object is applicable.
For example, baseball bat swing movement trajectory and ball movement trajectory, tennis racket swing movement trajectory and ball movement trajectory, table tennis racket swing trajectory and ball movement trajectory The present invention can be applied to an object that shoots or shoots a movement trajectory of an ice hockey racket swing and a movement trajectory of a pad (ball).

  In addition, the detailed configuration and detailed operation of each device constituting the image forming apparatus 10 can be changed as appropriate without departing from the spirit of the present invention.

It is the figure shown about the golf swing analysis system using the image processing apparatus which is one Embodiment of this invention. 1 is a block diagram illustrating a configuration of an image processing apparatus 10. It is a flowchart which shows the processing content of swing analysis. It is the figure shown about the locus | trajectory of the head position which moves for every imaging | photography. It is the figure which expanded the part of A shown in FIG. It is the flowchart shown about an example of the swing speed analysis process performed within the image processing apparatus 10 which concerns on this embodiment. It is the flowchart shown about an example of the swing speed analysis process performed within the image processing apparatus 10 which concerns on this embodiment. It is the figure shown about an example of the swing plane drawn at the time of plotting. It is the figure shown about an example of the reference position information set in order to synchronize a swing image. It is the figure shown about an example of the format when preserve | saving the calculated swing speed and head position change time. It is the figure shown about an example of the graph which shows the relationship between swing speed Vn and head position change time Dn.

Explanation of symbols

1 Golf swing analysis system 2, 3, 4 Camera 5 HUB
6 Printer 7 Discwriter 10 Image Processing Device 11 CPU
12 RAM
13 ROM
14 Storage device 15 Input device 16 Display device 17, 18, 19 Interface 20 Bus

Claims (4)

A still image generating means for generating a still image of each of the plurality of groups from a plurality of groups of asynchronous moving images obtained by photographing a subject to be swung from a plurality of photographing directions including the front and back;
Storage means for storing a still image obtained by synchronizing the motion scene of one still image among the still images generated by the still image generation means and the motion scene of another still image corresponding to the motion scene;
Operation input means for inputting a head position in the swing motion of the subject to be photographed in the still image stored in the storage means;
Calculating means for calculating a head speed based on a distance between adjacent head positions among a plurality of head positions input by the operation input means;
Display means for displaying the head speed calculated by the calculating means;
An image processing apparatus comprising: The calculating means includes
The distance between the head positions from the amount of change in the head position in the still image taken from the front, the amount of change in the head position in the still image taken from the rear, and the inclination of the body during the swing operation. The image processing apparatus according to claim 1, wherein the calculation is performed. Still image generation means for generating a still image of each of the plurality of groups from a plurality of groups of asynchronous moving images obtained by photographing a subject to be swung from a plurality of photographing directions including front and back Process,
A storage step in which a storage unit stores a still image obtained by synchronizing an operation scene of one still image and an operation scene of another still image corresponding to the operation scene among the still images generated by the still image generation unit. When,
An operation input unit for inputting a head position in the swing motion of the subject to be imaged in the still image stored in the storage unit;
A calculating step of calculating a head speed based on a distance between adjacent head positions among a plurality of head positions input by the operation input means;
A display step in which the display means displays the head speed calculated by the calculation means;
An image processing method comprising: Computer
A still image generating means for generating a still image of each of the plurality of groups from a plurality of groups of asynchronous moving images obtained by photographing a subject to be swung from a plurality of photographing directions including the front and back;
Storage means for storing a still image obtained by synchronizing the motion scene of one still image among the still images generated by the still image generation means and the motion scene of another still image corresponding to the motion scene;
Operation input means for inputting a head position in the swing motion of the subject to be photographed in the still image stored in the storage means;
Calculating means for calculating a head speed based on a distance between adjacent head positions among a plurality of head positions input by the operation input means;
Display means for displaying the head speed calculated by the calculating means;
Program to function as.

Images