JP5821236B2 - Image processing apparatus, synchronization method, and program - Google Patents

Description

The present invention relates to an image processing apparatus , a synchronization method, and a program.

  Conventionally, in order to display a plurality of moving image data obtained by imaging each of a plurality of subjects in synchronization, a predetermined timing (for example, a predetermined moving image frame) in the reproduction content of each moving image data is set as a synchronization timing, and synchronization is performed. There is a moving image reproduction method in which the reproduction of a plurality of moving image data after the synchronization timing is synchronized by simultaneously reproducing the timing (see, for example, Patent Document 1 and Patent Document 2).

JP 2006-80735 A JP 2002-344897 A

However, in the conventional moving image reproduction method, there are cases where a plurality of moving image data obtained by imaging each of a plurality of subjects cannot be sufficiently synchronized.
For example, when synchronizing a plurality of moving image data obtained by imaging each of a plurality of subjects performing a predetermined operation for a predetermined time, if the progress speed of a predetermined operation performed by each subject is different, the synchronization timing As the playback progresses, the operation of each subject in each moving image data gradually shifts, and the operation of each subject is not synchronized. On the other hand, in such a plurality of moving image data, when a plurality of moving image data is synchronized at the end timing of moving image data (for example, the completion timing of a predetermined operation), the start timing of the predetermined operation is shifted. Again, the movement of each subject is not synchronized.

An object of the present invention is to provide an image processing device , a synchronization method, and a program that can further improve the accuracy of image synchronization based on a plurality of moving image data obtained by imaging each of a plurality of subjects.

In order to solve the above problems, an image processing apparatus of the present invention is an image processing apparatus that synchronizes a plurality of image data obtained by imaging each of a plurality of subjects by an imaging device, and each of the plurality of subjects by the imaging device. Generating means for generating a plurality of still image data from each of a plurality of moving image data obtained by capturing the image, and the plurality of still image data generated by the generating means in a plurality of groups provided in time series, respectively. A dividing unit, a synchronizing unit that synchronizes the still image data of the plurality of subjects in a group unit divided by the dividing unit, and a difference in the number of still image data of each of the plurality of subjects in the group unit. If there is a plurality of subjects, the number of the still image data of each of the plurality of subjects is the same for each group. Adding means for adding the additional still image data in a number corresponding to the difference in the plurality of still image data having a small number of the still image data, and a position or method for adding the additional still image data by the adding means Selecting means for arbitrarily selecting .

  According to the present invention, the accuracy of image synchronization based on a plurality of moving image data obtained by imaging each of a plurality of subjects can be further increased.

1 is a diagram showing a golf swing analysis system including an image processing device according to an embodiment of the present invention. It is a block diagram which shows the structure of a golf swing analysis system and an image processing apparatus. It is a flowchart which shows an example of the flow of the image processing by an image processing apparatus. It is a figure which shows an example of a swing object extraction screen. FIG. 4A is a diagram illustrating an example of the initial display content of the swing target screen. FIG. 4B is a diagram illustrating an example of display contents of a swing target screen when still image data for starting swing is selected. FIG. 4C is a diagram illustrating an example of display contents on the swing target screen after selection of still image data corresponding to various timings is completed. It is a figure which shows an example of a reference | standard position information table. FIG. 5A shows an example of the reference position information table in an initialized state. FIG. 5B is a diagram illustrating an example of the reference position information table after the swing target is extracted from the front still image. FIG. 5C is a diagram illustrating an example of the reference position information table after the rear still image and the ball still image are synchronized with the front still image. It is a figure which shows an example of the correspondence of the reference | standard position information table of a some to-be-photographed object. It is a figure which shows an example of the synthetic | combination still image data which synchronized still image data of the golf swing of a several subject. It is a figure which shows an example of the number of the still image data of the 1st-3rd part corresponding to the reference | standard position information table of several subjects shown in FIG. It is a figure which shows typically an example in the case of adding additional still image data to the beginning of a part. It is a figure which shows typically an example in the case of adding additional still image data to the tail of a part. It is a figure which shows typically an example in the case of adding and adding additional still image data from the beginning to the end of a part. It is a figure which shows an example at the time of showing the flow of a process in the case of adding and adding additional still image data from the beginning to the end of a part by a script. It is a flowchart which shows an example of the flow of a swing image synchronization process of a part unit. It is a flowchart which shows an example of the flow of an opening addition process. It is a flowchart which shows an example of the flow of a tail addition process. It is a flowchart which shows an example of the flow of an equal distribution process. It is a flowchart which shows the continuation of the flow of the equal distribution process shown in FIG. It is a figure which shows an example of the screen for synchronizing a front still image, a back still image, and a ball still image manually.

  Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

  FIG. 1 is a diagram showing a golf swing analysis system 1 including an image processing apparatus 10 according to an embodiment of the present invention. The golf swing analysis system 1 includes three cameras 2, 3, 4, a HUB 5, an image processing device 10, a printer 6, and a disc writer 7.

The cameras 2, 3, and 4 capture images of a subject (α or β) performing a golf swing or a pin P on which a golf ball is placed and the vicinity thereof from different angles.
In the following description, the direction in which the golf ball flies as viewed from the subject is the front, the opposite side is the rear, and the side on which the golf ball is placed as viewed from the subject is the front.

  The camera 2 images the subject from the front side of the subject who is a person performing a golf swing, and the camera 3 images the subject from behind the subject. The camera 4 images the pin P and its vicinity from the front side of the subject, thereby imaging the golf ball and the head of the golf club W that hits the golf ball. The cameras 2, 3, and 4 output the captured image as moving image data.

  The cameras 2, 3, and 4 can set the number of frames captured per second (frames per second: fps) to a predetermined value (for example, 300 to 1200 [fps]) when capturing a moving image. In this embodiment, the cameras 2 and 3 perform imaging at 300 [fps], and the camera 4 performs imaging at 1200 [fps].

  The HUB 5 is a line concentrator interposed between the three cameras 2, 3, 4 and the image processing apparatus 10, and connects the three cameras 2, 3, 4 and the image processing apparatus 10.

  The image processing apparatus 10 is an image processing apparatus that synchronizes a plurality of image data obtained by imaging each of a plurality of subjects (for example, α and β) by an imaging apparatus (for example, three cameras 2, 3, 4, etc.). . The image processing apparatus 10 stores moving image data captured by the three cameras 2, 3, and 4, and performs various processes on a plurality of still image data based on the moving image data. Details thereof will be described later.

The printer 6 performs printing on a print medium (for example, paper). The printer 6 is configured by a printing device such as a page printer.
The disc writer 7 is a device that writes digital data to a DVD medium under the control of the image processing apparatus 10.

Next, the configuration of the image processing apparatus 10 will be described. FIG. 2 is a block diagram illustrating configurations of the golf swing analysis system 1 and the image processing device 10.
The image processing apparatus 10 includes a CPU 11, a RAM 12, a ROM 13, a storage device 14, an input device 15, a display device 16, interfaces 17, 18, and 19, and a bus 20 that interconnects these components, Have
In the present embodiment, the image processing apparatus 10 is configured by an information processing apparatus such as a personal computer or a desktop computer.

  The CPU 11 reads a program, data, and the like from the ROM 13 and the storage device 14 and executes them, and controls the operation of each unit of the image processing apparatus 10 and each component connected to the image processing apparatus 10. A program, data, and the like read by the CPU 11 and parameters temporarily generated in the processing of the CPU 11 are stored in the RAM 12.

The ROM 13 is a ROM chip, for example, and stores programs, data, and the like.
The storage device 14 is, for example, a hard disk drive or a flash memory, and can store programs, data, and the like. The storage device 14 includes a plurality of moving image data captured by the cameras 2, 3, and 4, a plurality of still image data generated based on the moving image data, a reference position information table, and a plurality of moving image data. Storage area for storing the fps and the like.
The ROM 13 and the storage device 14 store programs corresponding to various processes performed by the CPU 11.

  The input device 15 is, for example, a keyboard or a mouse, and accepts an input operation to the image processing device 10 manually by the user.

  The display device 16 is composed of, for example, a liquid crystal display, an organic electroluminescence (Electro-Luminescence: EL) display, or the like, and displays contents according to the screen output processing of the image processing device 10.

  The interfaces 17, 18, and 19 are bus interfaces such as USB (Universal Serial Bus), for example, and enable connection between the image processing apparatus 10 and an external device. The cameras 2, 3, 4 are connected to the interface 17 via the HUB 5, the printer 6 is connected to the interface 18, and the discwriter 7 is connected to the interface 19.

  Next, processing performed by the image processing apparatus 10 will be described. FIG. 3 is a flowchart showing an example of the flow of image processing by the image processing apparatus 10.

  First, the three cameras 2, 3, 4 perform photographing from three directions (step S1). Shooting is a process in which the image processing apparatus 10 operates the three cameras 2, 3, and 4 to image a subject by a predetermined input operation by a user. The moving image data captured by the three cameras 2, 3, 4 is transferred to the image processing apparatus 10. The image processing apparatus 10 stores the transferred moving image data in the storage device 14.

In the following description, “FR” is added to data related to moving image data captured by the camera 2, “BK” is added to data related to moving image data captured by the camera 3, and moving image data captured from the camera 4 is captured. The description will be made with “BL” added to the object.
In the present embodiment, the golf swings of two people (α, β) are each photographed once by the cameras 2, 3, 4. The storage device 14 of the image processing apparatus 10 stores each moving image data obtained by imaging two golf swings. In the following description, “α_” is added to the data related to the moving image data obtained by imaging the golf swing of α, and “β_” is added to the data related to the moving image data acquired of the golf swing of β.

  Next, the image processing apparatus 10 generates a still image (step S2). Still image generation is a process of generating a plurality of still image data from each of a plurality of moving image data obtained by imaging each of a plurality of subjects (α, β) captured by the cameras 2, 3, and 4. The generated still image data is stored in the storage device 14.

In each of the still image data, a code (for example, α_ or β_) indicating a person whose golf swing has been imaged and a code (for example, “FR”, “BK”, or “BL” indicating the moving image data used as a base) ”And the like, and a file name with a number. The number is, for example, a serial number with an initial value of 1, and 1 is assigned to the file name of the still image data corresponding to the first frame of the moving image data, and the number of frames that are continuously added subsequently increases sequentially. .
For example, in the case of still image data generated from moving image data FR obtained by imaging α, for example, “α_FR0000001”, “α_FR0000002”, etc., a number by a predetermined number of digits (for example, 7 digits). The file name with the suffix is given.
The same applies to the still image data generated based on each of the moving image data BK, the moving image data BL, and the β moving image data. In the following description, the number assigned to each of the still image data is described as “still image number”, the still image data generated from the moving image data FR is described as “front still image”, and the moving image data Still image data generated from BK is referred to as “rear still image”, and still image data generated from moving image data BL is referred to as “ball still image”.

The number of still image data generated depends on the fps of each moving image data. For example, when moving image data of 300 [fps] is used as still image data, 300 [images] of still image data corresponding to moving image data for one second is generated. That is, one still image data corresponds to one image frame in the moving image data.
The image processing apparatus 10 manages and stores the fps of each camera. Specifically, the fps of the camera 2 is set as the FRfps value, the fps of the camera 3 is set as the BKfps value, and the fps of the camera 4 is stored in the storage device 14 as the BLfps value.

  Next, the image processing apparatus 10 performs swing target extraction based on the input content of the user (step S3). Swing target extraction is a process of identifying a plurality of still image data obtained by imaging from the start to the end of a golf swing among a plurality of still image data of α and β. This is a process performed because a captured image that is not related to the golf swing may be included when moving image data is captured by the cameras 2, 3, and 4. As a captured image that is not related to the golf swing, for example, a captured image while the subject is performing an operation of adjusting the posture, or while the subject is performing other operations (for example, smoking a cigarette) Can be mentioned.

An example of specific contents of the swing target extraction will be described with reference to FIG.
FIG. 4A is a diagram illustrating an example of a swing target extraction screen. FIG. 4A shows an example of the initial display contents of the swing target screen. FIG. 4B shows an example of the display contents of the swing target screen when the swing start still image data is selected. FIG. 4C shows an example of display contents on the swing target screen after selection of still image data corresponding to various timings is completed.

  As shown in FIGS. 4A to 4C, the swing target extraction screen displays various timing names (for example, swing start, swing top, impact) corresponding to the boundary where a plurality of still image data is divided into groups. , Swing end, etc.), still image display unit for selecting, determining and confirming still image data corresponding to these various timings, and scroll for selecting still image data displayed on the still image display unit Bar 30 is included in the display items.

  Note that “swing start” is an operation scene in which an operation (takeback) of swinging up the golf club W via the rear is started as an operation before the subject hits the golf ball. The “top of swing (simply described as“ top ”in the following description and drawings)” is an operation scene in which an operation of swinging down the golf club W after takeback is started because the subject hits the golf ball. “Impact” is a scene at the moment when the head of the golf club W hits the golf ball (impact moment). The “swing end” is a scene where the subject swings the golf club W forward after hitting the golf ball (end of follow-through).

The scroll bar 30 includes arrow buttons 31 and 32, a scroll gauge 34, a bar 33 corresponding to the movement range of the scroll gauge 34, and the like. The scroll gauge 34 moves to the left and right in response to an operation on the arrow buttons 31 and 32, an operation on the bar 33 positioned on the left and right of the scroll gauge 34, and an operation for moving the scroll gauge 34 to the left and right. Then, according to the movement of the scroll gauge 34, the display content of the still image data displayed on the still image display unit that is in focus is changed. The example shown in FIG. 4B shows an example in which the posture of the subject during the golf swing changes and the position of the golf club W swung by the subject changes according to the movement of the scroll gauge 34.
Here, the range of the bar 33 corresponds to all the front still images of one person (for example, α or β) generated from the moving image data captured by the camera 2.

  FIG. 4B illustrates the selection operation for the still image display unit at the start of the swing, but the user selects the still image data corresponding to each timing for the top, impact, and end of the swing as well. As shown in FIG. 4C, still image data corresponding to various timings can be specified. That is, the user specifies a front still image corresponding to various timings (for example, swing start, top, impact, end of swing, etc.) by changing the focused still image display unit and performing an input operation on the scroll bar 30. can do.

In the swing target extraction, the CPU 11 generates and updates reference position information table information.
FIG. 5 is a diagram illustrating an example of the reference position information table. FIG. 5A shows an example of the reference position information table in an initialized state. FIG. 5B shows an example of the reference position information table after extraction of the swing target for the front still image. FIG. 5C shows an example of the reference position information table after the rear still image and the ball still image are synchronized with the front still image.

  The reference position information table includes a golf swing for each of various still image data (for example, a front still image, a rear still image, and a ball still image) corresponding to moving image data captured by a plurality of cameras 2, 3, and 4. It is a table which memorize | stores the file name which has the number of the still image corresponding to various inside timings (for example, swing start, top, impact, swing end, etc.). The reference position information table is stored in the storage device 14.

  At the start of the swing target extraction, the CPU 11 generates a reference position information table in an initialized state, for example. As shown in FIG. 5A, the reference position table in the initialized state associates various timings during golf swing with file names of still image data having the top numbers of various still images. ing.

  When the swing target extraction is performed on the front still image by a user input operation or the like on the swing target extraction screen, the CPU 11 performs various timings of the front still image of the reference position information table as illustrated in FIG. The file name of the associated still image data is a file name having a number corresponding to still image data at various timings specified on the swing target extraction screen.

Then, when the swing target extraction for the front still image is completed, the CPU 11 performs the rear still image and the ball still image corresponding to various timings during the golf swing based on the following equations (1) and (2). The number is calculated.
BKno = FRno × BKfps / FRfps− (BKfps / FRfps) +1 (1)
BLno = FRno × BLfps / FRfps− (BLfps / FRfps) +1 (2)
In the above equations (1) and (2), FRno indicates the still image number of the front still image, BKno indicates the still image number of the rear still image, and BLno indicates the still image number of the ball still image. Indicates the number. In this embodiment, since FRfps and BKfps are the same (300 [fps]), FRno and BKno at various timings are the same. Since BLfps (1200 [fps]) is four times FRfps (300 [fps]), BLno at various timings is a value obtained by subtracting three from four times FRno (FRno × 4- (4) +1).
As shown in FIG. 5C, the CPU 11 uses the expressions (1) and (2) for the file names of the still image data associated with various timings of the rear still image and the ball still image in the reference position information table. It is assumed that the file name has a still image number corresponding to BKno and BLno calculated by.

The swing target extraction is performed individually for each of a plurality of subjects (for example, α and β), and a file name having a still image number corresponding to various timings of the golf swing performed by each of the two persons. Is identified.
FIG. 6 is a diagram illustrating an example of a correspondence relationship between the reference position information tables of a plurality of subjects.
The CPU 11 may individually generate and update the reference position information table for a plurality of subjects (for example, α and β), or may generate one reference position information table including information on a plurality of subjects. Good.
The number of the still image corresponding to various timings (for example, swing start, top, impact, end of swing, etc.) included in the plurality of still image data determined by the swing target extraction is obtained by grouping the plurality of still image data. It becomes the standard to separate with.

  Next, the image processing apparatus 10 performs swing image synchronization (step S4). Swing image synchronization synchronizes still images of multiple synchronized subjects (α, β) at the same timing by synchronizing multiple still image data generated from each of multiple moving image data in groups. This is a process for generating a plurality of synthesized still image data. With the swing image synchronization, for example, as shown in FIG. 7, a plurality of synthesized still image data obtained by synchronizing still image data of golf swings of a plurality of subjects (for example, α and β), , “Swing start” timing) to end (for example, “swing end” timing). Details of the swing image synchronization will be described later.

After the swing image synchronization, the image processing apparatus 10 generates a synchronized moving image (step S5). Synchronized moving image generation is processing for generating one moving image data by combining still image data for which swing image synchronization has been completed. The CPU 11 generates one moving image data in which a plurality of synthesized still image data including still image data obtained by capturing golf swings of a plurality of subjects (for example, α and β) as display contents is a continuous frame. Here, one moving image data obtained by the synchronous moving image generation can be recorded on the DVD medium as data of the DVD video disk by the disc writer 7.
In addition, the image processing apparatus 10 performs synchronized moving image reproduction, which is processing for reproducing moving image data generated by the synchronized moving image generation (step S6).

Next, details of swing image synchronization will be described.
In swing image synchronization, the CPU 11 first has a plurality of groups (for example, a first part, a second part, a third part, etc.) in which a plurality of still image data of α and β are provided in time series. Divide into
Specifically, the CPU 11 divides a plurality of still image data from the start of the swing to the end of the swing into a plurality of groups based on various timings of the golf swing, and the still image data included in each divided part. Identify the number of
Here, the CPU 11 sets a group of still image data from the timing of “start of swing” to the timing of “top” as the first part from the start of swing of the golf club W to the top of the swing. Further, the CPU 11 sets a group of still image data from the “top” timing to the “impact” timing as the second part from the top of the swing to the impact on the ball. Further, the CPU 11 sets the group of still image data from the timing of “impact” to the timing of “end of swing” as the third part from the impact on the ball to the end of the swing. The CPU 11 specifies the number of still image data included in the first to third parts based on the file name number set in the reference position information table for each of the still image data of the two golf swings.

  Hereinafter, among the still image data of the golf swing of α, the number of still image data included in the first part is A1N, the number of still image data included in the second part is B1N, and the still image data included in the third part The number of image data is C1N. Moreover, among the still image data of the golf swing of β, the number of still image data included in the first part is A2N, the number of still image data included in the second part is B2N, and the still image data included in the third part The number of image data is C2N.

FIG. 8 is a diagram illustrating an example of the number of first to third part still image data corresponding to the reference position information table of the plurality of subjects illustrated in FIG. 6.
In the example shown in FIG. 8, A2N is larger than A1N, B2N is larger than B1N, and C2N is larger than C1N. In the following description, the description will be based on these magnitude relationships, but this is an example and the present invention is not limited to this. For example, for some or all of the parts, the number of still image data of α may be larger than the number of still image data of β.

  After specifying the number of still image data included in each part, the CPU 11 synchronizes still image data of a plurality of subjects (α, β) in group units (part units). Specifically, the CPU 11 uses, for example, a plurality of still image data generated from moving image data of two golf swings captured by the cameras 2, 3, and 4 as a first part, a second part, and a third part. Synchronize part by part.

When synchronizing a plurality of still image data in part units, the CPU 11 compares the number of a plurality of still image data generated from moving image data obtained by imaging each of the two people in part units.
Here, when the number of still image data is the same, the CPU 11 performs association for synchronizing the two still image data in a one-to-one correspondence from the beginning number to the end number of the part. For example, if the number of still image data included in the first part is 10 [sheets] for both α and β, the first still image data of α included in the first part and one sheet of β Synchronize the still image data of the eye, synchronize the second still image data of α and the second still image data of β, and so on, from the beginning (first image) to the end (10 images) Synchronize with the one-to-one correspondence.

On the other hand, when there is a difference in the number of still image data of the plurality of subjects (α, β) in the group unit (part unit), the CPU 11 sets the same number of still image data in the plurality of subjects in the group unit. As described above, a complementary process is performed in which additional still image data is added to a plurality of still image data having a small number of still image data of each of a plurality of subjects.
For example, the CPU 11 has the same number of still image data because A2N is larger than A1N and there is a difference in the number of still image data for A1N and A2N, which are the number of still image data of two people in the first part. As described above, additional still image data is added to the first part of α corresponding to the small number A1N.

  The CPU 11 adds additional still image data so as to distribute from the beginning or end of the part or from the beginning to the end of the part. Hereinafter, description will be made sequentially.

FIG. 9 is a diagram schematically illustrating an example in which additional still image data is added to the beginning of a part. In FIG. 9 to FIG. 11, the smaller number of α still image data is “3”, the larger number of β still image data is “10”, and the difference in the number of still image data is “10”. 7 ”is schematically shown. Further, the added still image data is shown by being masked.
When adding additional still image data to the beginning of a part, the CPU 11 divides the number of additional still image data according to the difference in the number of still image data among the plurality of still image data divided in units of parts. It is added at the beginning of a part of a plurality of still image data having a small number.
Specifically, the CPU 11 duplicates the initial still image of the first part of α corresponding to the small number A1N according to the difference in the number of still image data. Then, the CPU 11 synchronizes the replicated still image data with a plurality of still image data at the beginning of the first part of β corresponding to A2N having a large number. Thus, for example, as shown in FIG. 9, a plurality of still image data (β1 to β7) at the beginning of β corresponding to the difference in the number of still image data (“7”) Are associated with the still image data (α1).
Further, the CPU 11 synchronizes still image data having a file name having a number subsequent to the beginning portion of the part corresponding to the difference in the number of still image data in a one-to-one correspondence relationship. Accordingly, for example, as illustrated in FIG. 9, the plurality of β still image data (β8 to β10) and the plurality of α still image data (α1 to α3) are associated with each other in synchronization.

  More specifically, the CPU 11 uses the larger number of still image data (for example, the value of A2N) as a reference, and the number of still images counted from the beginning (the number of still image frames) is the larger still image. For still image data equal to or less than a value obtained by subtracting the smaller number of still image data from the number of image data (for example, the value of A2N-A1N), the number of still image numbers to be synchronized next is small. The still image number of the one is deferred, and the number of the still image with the larger number is sequentially advanced. Then, the CPU 11 uses the still image data with the larger number as a reference, and the number counted from the beginning is a value obtained by subtracting the number of still image data with the smaller number from the number of still image data with the larger number. Still image data that is equal to or larger than a value obtained by adding 1 (for example, a value of A2N-A1N + 1) and less than a value obtained by subtracting 1 from the number of still image data having a larger number (for example, a value of A2N-1) Then, the number of the still image to be synchronized next is sequentially advanced for both the still image data having the smaller number and the still image data having the larger number.

FIG. 10 is a diagram schematically illustrating an example in which additional still image data is added to the end of the part.
When adding additional still image data to the end of the part, the CPU 11 divides the number of additional still image data according to the difference in the number of still image data among the plurality of still image data divided in units of parts. It is added to the end of the parts of multiple still image data with a small number.
Specifically, the CPU 11 has a one-to-one correspondence with a plurality of still image data from the beginning of the part corresponding to the difference in the number of still image data to the still image data at the end of the smaller still image data. Synchronize in correspondence. Accordingly, for example, as illustrated in FIG. 10, the plurality of β still image data (β1 to β3) and the plurality of α still image data (α1 to α3) are associated with each other so as to be synchronized.
Further, the CPU 11 duplicates the still image at the end of the first part of α corresponding to the small number A1N according to the difference in the number of still image data. Then, the CPU 11 synchronizes the replicated still image data with a plurality of still image data at the end of the first part of β corresponding to A2N having a large number. Thus, for example, as shown in FIG. 10, a plurality of still image data (β4 to β10) at the end portion of β corresponding to the difference (“7”) in the number of still image data is stored at the end of the replicated α. Are associated with the still image data (α3).

  More specifically, the CPU 11 uses the larger number of still image data (for example, the value of A2N) as a reference, and the image counted from the beginning (the number of still images) has the smaller number. For still image data less than the number of images (for example, the value of A1N), the number of the still image to be synchronized next is sequentially advanced for both the smaller number and the larger number of still image data. Then, the CPU 11 uses the still image data with the larger number as a reference, and the number counted from the beginning is equal to or greater than the number of images with the smaller number (for example, the value of A1N) and the still image with the larger number For still image data equal to or less than the value obtained by subtracting 1 from the number of image data (for example, the value of A2N-1), the still image number with the smaller number among the still image numbers to be synchronized next is deferred, The number of the still image with the larger number is sequentially advanced.

FIG. 11 is a diagram schematically illustrating an example in which additional still image data is distributed and added from the beginning to the end of the part. FIG. 12 is a diagram illustrating an example of a case where the flow of processing when additional still image data is distributed and added from the beginning to the end of a part is illustrated by a script.
First, the CPU 11 synchronizes the still image data at the beginning of the smaller number and the still image data of the larger number of bars and the like in a one-to-one correspondence relationship. Thus, for example, as shown in FIG. 11, the initial still image data (β1) of β and the initial still image data (α1) of α are associated with each other so as to be synchronized.

  Further, the CPU 11 counts the number of still image data for which synchronization processing has been completed, based on the larger number. The counted numerical value is stored and managed in a predetermined variable (for example, “k”) set by the CPU 11.

Next, in determining the image to be synchronized with the second still image data from the beginning of the larger number, the CPU 11 sets a predetermined variable (for example, “j”) with an initial value of 1, and uses the following formula: Based on (3), the value of another variable (for example, “Sj”) is calculated.
Sj = j × (A2N / A1N) (3)

Then, the CPU 11 compares whether the value of k is equal to the value obtained by rounding up the decimal point of the value of Sj.
Here, when the value of k is equal to the value obtained by rounding up the decimal point of the value of Sj, the CPU 11 synchronizes the still image data having the smaller number and the still image data having the larger number to be synchronized immediately before. It is assumed that still image data having a file name having the next number of the still image data thus obtained is obtained. Then, the CPU 11 adds 1 to the value of j, and again calculates the value of Sj based on the above equation (3).
On the other hand, when the value of k is not equal to the value obtained by rounding up the decimal point of the value of Sj, the CPU 11 selects the still image data with the smaller number of the still image data to be synchronized with the still image data synchronized immediately before. The still image data having the same number as the file name is set as the still image data having the same number, and the still image data having the larger number is set as the still image data having the file number having the next number after the still image data synchronized immediately before. That is, in this case, the CPU 11 advances only the number of the still image having the larger number, defers the number of the still image having the smaller number, and synchronizes the still image data.

The CPU 11 sequentially determines still image data to be synchronized from the beginning, counts up the value of k, and repeats the above processing.
Further, when the value of k is equal to the value obtained by subtracting 1 from A2N (for example, the value of A2N-1), the CPU 11 has priority over the above-described processing, and the still image data and the number of the smaller still image data to be synchronized Both of the still image data with the larger number are used as still image data at the end of each part. Then, the CPU 11 completes the synchronization of the still image data at the end of the part, thereby ending the swing image synchronization of the part.

  For example, in the case of synchronizing the second still image data from the beginning, k = 1. Further, in the case of A2N = 10 and A1N = 3, the value of Sj when j = 1 is 10/3, and the value of Sj with the decimal point rounded up is 4 in comparison with the example shown in FIG. In this case, since the value of k is not the same as the value obtained by rounding up the decimal point of the value of Sj, the CPU 11 advances only the number of the still image data with the larger number, and the number of the still image with the smaller number. To synchronize still image data. Therefore, as shown in FIG. 11, β2 and α1 are associated with each other so as to be synchronized. Similar processing is repeated while k is less than 4, and β3 and β4 are also associated with α1 in synchronization. In this case, still image data of α1 is added for synchronization with β2 to β4.

  On the other hand, in the case of synchronization of the fifth still image data from the beginning, k = 4. In this case, the value of k is the same as the value obtained by rounding up the decimal point of the value of Sj. In this case, the CPU 11 combines the still image data with the smaller number and the still image data with the larger number with the still image data with the file name having the next number of the still image data synchronized immediately before. To do. Therefore, as shown in FIG. 11, β5 next to β4 and α2 next to α1 are associated with each other so as to be synchronized.

  Thereafter, similarly, the still image data of α2 is added for synchronization with β6 and β7. Also, α3 still image data is added for synchronization with β9 and β10.

9 to 11 show an example in which the ball still images are synchronized. In the swing image synchronization, the CPU 11 batches the front still image, the rear still image, and the ball still image of the two golf swings. And synchronize in parts.
In the synchronization of still image data, the size of the number of the still image to be advanced is based on fps of the moving image data that is the basis of the still image data. For example, since the fps (300 [fps]) of the cameras 2 and 3 that are the basis of the front still image and the rear still image of the present embodiment are the same, according to the number of one still image being advanced by 1, The number of the other still image also advances by 1. On the other hand, the fps (1200 [fps]) of the camera 4 that is the basis of the ball still image is four times that of the front still image and the rear still image. Accordingly, the ball still image number advances by four. In other words, as the number of the front still image advances by 1, the number of the rear still image advances by (1 × BKfps / FRfps), and the number of the ball still image advances by (1 × BLfps / FRfps). .

  The above description is based on the number of still image data (A1N, A2N) of two persons (α and β) as a plurality of subjects included in the first part. The same applies to B1N and B2N as the number of data and C1N and C2N as the number of still image data of the third part as in the case of A1N and A2N.

Further, the image processing apparatus 10 can set a character string to be displayed together with display contents corresponding to the added still image data.
Specifically, the image processing apparatus 10 has a function of setting a comment to be displayed together with still image data added by swing image synchronization. The comment is added via the input device 15. In the present embodiment, when adding additional still image data to the beginning or end of the part, the user can set a comment displayed together with the added still image data, for example, as shown in FIG. In the present embodiment, the set comment is set in all the still image data after synthesis including still image data added continuously at the beginning or end, but only a part of the still image data after synthesis. It is also possible to set a comment for each of the combined still image data.
By setting a comment, it is possible to add information related to image synchronization, such as information related to comparison between a plurality of synchronized still image data (for example, two golf swings).

  The image processing apparatus 10 according to the present embodiment has a function capable of arbitrarily selecting and setting a position at which additional still image data is added in the complementing process. Specifically, when adding the additional still image data, the image processing apparatus 10 adds the additional still image data to the beginning of the part, adds the additional still image data to the end of the part, or adds the additional still image data. The storage device 14 stores in advance a setting for allocating data from the beginning to the end of the part. When a setting related to a process of adding additional still image data is performed by the user via the input device 15 or the like, the image processing apparatus 10 updates and stores the setting of adding an additional image according to the content of the setting. Further, the image processing apparatus 10 according to the present embodiment can individually select a position to which additional still image data is added in units of parts.

  Next, the flow of the swing image synchronization process for each part will be described with reference to the flowcharts of FIGS. 13 to 17, description will be made using the number of still image data (A1N, A2N) of the first part as an example of the swing image synchronization processing, but the second part (B1N, B2N), the third part will be described. The same applies to (C1N, C2N).

  First, the CPU 11 of the image processing apparatus 10 reads a reference position information table (step S11), and a plurality of front still images, rear still images, and ball stills generated from each of the moving image data obtained by imaging two golf swings. The numbers at the beginning and end of the first part of the image and the number of still image data (A1N, A2N) included in the first part are acquired.

  Next, the CPU 11 reads out the front still image, the rear still image, and the ball still image having the beginning number of the first part from the still image data of the two golf swings (steps S12 to S14), and is read out. Each piece of still image data is combined to generate one piece of combined still image data (see FIG. 7) (step S15) and stored in the storage device 14 (step S16).

Next, the CPU 11 determines whether or not the generation of the composite still image data obtained by combining the still image data having the last number of the still image data having the larger number among the first parts is completed (step S11). S17).
Here, when it is determined that the generation of the combined still image data obtained by combining the still image data having the last number of the first part is not completed (step S17: NO), the CPU 11 adds the additional still image. Complement processing is performed according to the setting of the position to add data.

  Specifically, the CPU 11 first determines whether or not the first part is set to add additional still image data at the beginning of the part (step S18). If it is determined that the setting for adding additional still image data is made at the beginning of the first part (step S18: YES), the CPU 11 determines the difference in the number of still image data (A2N-A1N). To add the number of additional still image data corresponding to the first part of the plurality of still image data (α still image data) having a small number among the plurality of still image data divided in part units ( (Initial addition processing) is performed (step S19).

Here, the beginning addition process will be described with reference to the flowchart of FIG.
The CPU 11 determines whether or not the number of still image data to be processed counted from the beginning of the first part with respect to A2N (the number of still image frames) is equal to or less than the value of A2N-A1N (step S31). . If it is determined that the value is equal to or smaller than the value of A2N−A1N (step S31: YES), the CPU 11 performs a change process of the number that keeps the number of the still image of α and sequentially advances the number of the still image of β. . Specifically, 1 is added to the number of the front still image and the rear still image of β (steps S32 and S33), and 4 is added to the number of the ball still image of β (step S34). In addition, the CPU 11 reads a comment input via the input device 15 (step S35).

  On the other hand, when it is determined in step S31 that the value is not equal to or less than the value of A2N-A1N (step S31: NO), the CPU 11 performs a number changing process of sequentially advancing the numbers of the α and β still images. Specifically, 1 is added to the numbers of the front and rear still images of α and β (steps S36 and S37), and 4 is added to the numbers of the ball still images of α and β (step S38).

Then, the CPU 11 reads the front still image, the rear still image, and the ball still image having the numbers after the processing in step S34 or step S37 (step S39), and ends the opening addition process.
After completing the beginning addition process, the CPU 11 shifts the process to step S15. When the comment is being read, the CPU 11 combines the combined still image data with the comment.

  If it is determined in step S18 that the setting for adding additional still image data is not made at the beginning of the first part (step S18: NO), the CPU 11 adds the first part to the end of the part. It is determined whether or not the setting for adding still image data is made (step S20). If it is determined that the setting for adding additional still image data to the end of the first part is made (step S20: YES), the CPU 11 determines the difference in the number of still image data (A2N-A1N). To add the number of additional still image data corresponding to the end of the part of the plurality of still image data (α still image data) having a small number among the plurality of still image data divided by the part ( A tail addition process) is performed (step S21).

Here, the tail addition process will be described with reference to the flowchart of FIG.
The CPU 11 determines whether or not the number of still image data to be processed counted from the beginning of the first part based on A2N (the number of still image frames) is less than the value of A1N (step S41). If it is determined that the value is less than the value of A1N (step S41: YES), the CPU 11 performs a number changing process that sequentially advances the numbers of the still images of α and β. Specifically, 1 is added to the numbers of the front and rear still images of α and β (steps S42 and S43), and 4 is added to the numbers of the ball still images of α and β (step S44).

  On the other hand, when it is determined in step S41 that the value is not less than the value of A1N (step S41: NO), the CPU 11 performs a change process of the number in which the still image number of α is deferred and the still image number of β is sequentially advanced. Do. Specifically, 1 is added to the number of the front still image and the rear still image of β (steps S45 and S46), and 4 is added to the number of the ball still image of β (step S47). In addition, the CPU 11 reads a comment input via the input device 15 (step S48).

Then, the CPU 11 reads the front still image, the rear still image, and the ball still image having the numbers after the process in step S44 or step S48 (step S49), and ends the tail addition process.
After the end addition process ends, the CPU 11 shifts the process to step S15. When the comment is being read, the CPU 11 combines the combined still image data with the comment.

  If it is determined in step S20 that the setting for adding the final still image data to the beginning of the first part is not made (step S20: NO), the CPU 11 determines the difference in the number of still image data ( A number of additional still image data corresponding to A2N-A1N) is added to the end of the part of the plurality of still image data (α still image data) having a small number among the plurality of still image data divided in part units. In step S22, additional still image data is distributed and added (equal distribution processing).

Here, the uniform distribution process will be described with reference to the flowcharts of FIGS. 16 and 17.
First, the CPU 11 determines whether or not the number of the still image to be processed is the number of the second still image from the beginning based on A2N (step S51). Here, when it is determined that the number of the still image to be processed is the number of the second still image from the beginning (step S51: YES), the CPU 11 sets the variable k and sets the value of k to 1. (Step S52).
Further, the CPU 11 sets a variable j and sets the value of j to 1 (step S53). And CPU11 calculates the value of Sj based on said Formula (3) (step S54).

  Then, the CPU 11 determines whether or not the number of the still image to be processed is the number of the last still image on the basis of A2N. That is, the CPU 11 determines whether or not the value of k is equal to a value obtained by subtracting 1 from A2N (A2N-1) (step S55). Here, when it is determined that the value of k is equal to A2N-1 (step S55: YES), the CPU 11 assigns the numbers of the front still image, the rear still image, and the ball still image of α and β in the first part. It is set as the last number of each (steps S56 to S58).

  On the other hand, when it is determined in step S55 that the value of k is not equal to A2N-1 (step S55: NO), the CPU 11 determines whether or not the value of k is equal to the value obtained by rounding up the decimal point of the value of Sj. (Step S59). Here, when it is determined that the value of k is equal to the value obtained by rounding up the decimal point of the value of Sj (step S59: YES), the CPU 11 performs a number changing process of sequentially incrementing the numbers of the still images of α and β. Do. Specifically, 1 is added to the numbers of the front and rear still images of α and β (steps S60 and S61), and 4 is added to the numbers of the ball still images of α and β (step S62). Further, the CPU 11 adds 1 to the value of j (step S63), and again calculates the value of Sj based on the above equation (3) (step S64).

  On the other hand, when it is determined in step S57 that the value of k is not equal to the value obtained by rounding up the decimal point of the value of Sj (step S59: NO), the CPU 11 defers the number of the still image of α, and the still image of β The number change process is performed in which the numbers are sequentially advanced. Specifically, 1 is added to the numbers of the front still image and the rear still image of β (steps S65 and S66), and 4 is added to the number of the ball still image of β (step S67).

Further, the CPU 11 adds 1 to the value of k after the process of step S64 or step S67 (step S68). Then, the CPU 11 reads the front still image, the rear still image, and the ball still image having the numbers after the process in step S58 or step S68 (step S69), and ends the equal distribution process.
After completing the uniform distribution process, the CPU 11 shifts the process to step S15.

If it is determined in step S17 that the generation of the composite still image data obtained by combining the still image data having the last part number of the first part is completed (step S17: YES), the CPU 11 performs one time. The part-by-part swing image synchronization ends.
In swing image synchronization, the CPU 11 performs part-by-part swing image synchronization for all parts. When the part-by-part swing image synchronization for all parts is completed, the CPU 11 performs processing after the generation of the synchronized moving image.

  As described above, according to the golf swing analysis system 1 of the present embodiment, the image processing device 10 is generated from each of a plurality of moving image data obtained by imaging each of a plurality of subjects (for example, α, β, etc.). The multiple still image data are divided into multiple groups arranged in chronological order, and the still image data of multiple subjects are synchronized in groups, so multiple timings divided in groups are used as a reference. As described above, it is possible to synchronize a plurality of still image data generated from a plurality of moving image data obtained by imaging each of a plurality of subjects, and synchronize images based on a plurality of moving image data obtained by imaging each of the plurality of subjects. Accuracy can be further increased.

  In addition, when there is a difference in the number of still image data of each of the plurality of subjects in the group unit, the image processing apparatus 10 has a plurality of pieces so that the number of still image data of each of the plurality of subjects is the same in the group unit. Since additional still image data is added to a plurality of still image data having a small number of a plurality of still image data of each of the subjects, a plurality of moving images of each of the plurality of subjects as a basis of the plurality of still image data to be synchronized Even when the number of frames of image data, the time of image capture, etc. are different, by adding additional still image data to a plurality of still image data with a small number of frames, the number of frames and image capture of each of the plurality of moving image data Differences such as time can be compensated. In other words, even when the number of frames of each of the plurality of moving image data of each of the plurality of subjects, imaging time, and the like are different, it is possible to perform image synchronization based on the plurality of moving image data with higher accuracy. it can.

  In addition, the image processing apparatus 10 sets the number of additional still image data corresponding to the difference in the number of still image data of each of the plurality of subjects in units of groups, out of the plurality of still image data of each of the plurality of subjects. Is added to the beginning of a group of a plurality of still image data, so that the display contents after synchronizing images based on the plurality of moving image data are moving image data (for example, relatively frames A large number of moving image data, moving image data with a relatively long imaging time, etc.) change the display content first, and after the number of frames corresponding to the number of additional still image data and the imaging time have elapsed, In particular, the display content is accompanied by a change in the display content of the moving image data (for example, moving image data having a relatively small number of frames or moving image data having a relatively short imaging time). It can be clearly confirmed the difference in playback time of the plurality of moving image data a plurality of groups of still image data synchronized by the difference in the start timing of the raw.

  Further, the image processing apparatus 10 adds the number of additional still image data according to the difference in the number of still image data of each of the plurality of subjects in the group unit to the group of the plurality of still image data of each of the plurality of subjects. Since it is added at the end, the display content after synchronizing images based on a plurality of moving image data is moving image data (for example, moving image data having a relatively small number of frames or relative Moving image data with a relatively short imaging time, such as moving image data with a relatively long reproduction time (for example, moving image data with a relatively large number of frames or a relatively long imaging time). The display content waits for the end of image playback (moving image data, etc.), and the difference in the playback time of multiple moving image data based on the multiple still image data synchronized due to the difference in playback end timing is clarified It can be confirmed.

  Further, the image processing apparatus 10 adds the number of additional still image data according to the difference in the number of still image data of each of the plurality of subjects in the group unit to the group of the plurality of still image data of each of the plurality of subjects. Since it is distributed and added from the beginning to the end, the difference in the number of frames, imaging time, etc., even when the number of frames, imaging time, etc. of each of the plurality of moving image data that is the basis of the plurality of still image data to be synchronized is different Can be distributed from the start to the end of the part, and synchronization deviation due to differences in the number of frames, imaging time, etc. is not accumulated at the beginning or end of the part, and the synchronization deviation can be visually reduced. it can. That is, even when the number of frames and the imaging time of each of the plurality of moving image data that are the basis of the plurality of still image data to be synchronized are different, synchronization of images based on the plurality of moving image data is performed with higher accuracy. It can be carried out.

  In addition, since the image processing apparatus 10 sets a character string (for example, a comment or the like) to be displayed together with the display content corresponding to the additional still image data, the information corresponding to the content of the character string is shown together with the synchronized image. Can do.

  In addition, the group that becomes the unit of synchronization includes the first part from the start of the swing of the golf club W to the top of the swing, the second part from the top of the swing to the impact on the ball, and the swing from the impact on the ball. Since it is the third part until the end, in each part divided into three parts from the first part to the third part, a plurality of moving image data obtained by imaging the start to the end of the action of hitting the ball in golf The images based on each other can be synchronized with each other, and the accuracy of image synchronization based on the moving image data obtained by imaging the golf swing can be further increased.

  Further, the image processing apparatus 10 generates a plurality of combined still image data by combining still image data of a plurality of synchronized subjects at the same timing, and further generates a moving image based on the plurality of combined still image data. Since the image data is generated, the generated moving image data becomes moving image data in which a plurality of still image data generated from a plurality of moving image data is synchronized in units of groups, and is synchronized by the moving image data. In addition, an image based on a plurality of moving image data can be easily confirmed. That is, it is possible to more easily confirm the result of the synchronization processing between a plurality of still image data based on a plurality of moving image data.

  In addition, by performing synchronized moving image playback, it is possible to confirm while comparing a series of actions (for example, posture change, etc.) of two people from the start to the end of two golf swings synchronized in units of groups.

The present invention is not limited to the above-described embodiment, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, in the above embodiment, the plurality of cameras 2, 3, 4 and the image processing apparatus 10 are connected via the HUB 5, but this is an example of a connection form, and the present invention is not limited to this. As another connection mode, for example, a terminal for recording moving image data may be provided in each of a plurality of cameras, and the image processing apparatus may be connected to each terminal. Further, the number of cameras that capture the subject is not limited to three, and may be one or two or more.
Further, the camera and the image processing apparatus are not necessarily connected. For example, the image processing apparatus may acquire moving image data from a predetermined storage device or storage medium in which moving image data captured by a camera is stored.

  In addition, a plurality of moving image data (a front still image, a rear still image, and a ball still image of two golf swings) as a basis of still image data obtained by imaging a plurality of subjects synchronized in the above embodiment is an example. Yes, it is not limited to this. For example, a plurality of still image data is generated from each of a plurality of moving image data obtained by capturing motions of a plurality of subjects of three or more, and a part or all of these still image data is divided into groups and synchronized. You may do it. Further, the present invention is not limited to a front still image, a rear still image, and a ball still image, even in the synchronization of still image data based on moving image data obtained by capturing a golf swing. It is possible to synchronize still image data based on moving image data obtained by imaging a ball, a golf club W or the like.

  Further, the group serving as a synchronization unit is not limited to the first part, the second part, and the third part in the above embodiment. In the present invention, group breaks can be arbitrarily set.

  Further, the order of synchronization between still image data based on a plurality of moving image data obtained by simultaneously capturing the motion of one subject and the synchronization between motions of different subjects is not limited. For example, in the above embodiment, the front still image of α, the back still image, and the ball still image are synchronized, and the front still image of β, the back still image, and the ball still image are synchronized, and then the still images of α and β are synchronized. The data are synchronized, but after synchronizing the still image data of either α or β, the front still image, the rear still image, and the ball still image may be synchronized with each of α and β. .

  In the above embodiment, in the swing target extraction, various timings from the start to the end of the swing are manually set for the front still image, and the rear still image and the ball still image are expressed by the equations (1) and (2). ), But is only an example, and the present invention is not limited to this. For example, as shown in FIG. 18, the front still image, the rear still image, and the ball stationary are synchronized according to the user's operation content on the screen for manually synchronizing the front still image, the rear still image, and the ball still image. You may make it determine the correspondence of the number of an image.

  In the present embodiment, one piece of moving image data including all the parts from the first part to the third part is generated in the synchronous moving image generation. However, moving image data may be generated in part units. .

Although several embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalents thereof.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
An image processing device for synchronizing a plurality of image data obtained by imaging each of a plurality of subjects by an imaging device, wherein a plurality of still images are obtained from each of a plurality of moving image data obtained by imaging each of the plurality of subjects by the imaging device. A generating unit that generates data; a dividing unit that divides the plurality of still image data generated by the generating unit into a plurality of groups provided in time series; and a group unit divided by the dividing unit. An image processing apparatus comprising: synchronization means for synchronizing still image data of the plurality of subjects.
<Claim 2>
When there is a difference in the number of still image data of each of the plurality of subjects in the group unit, each of the plurality of subjects is set to have the same number of still image data of the plurality of subjects in the group unit. The image processing apparatus according to claim 1, further comprising an adding unit that adds additional still image data to a plurality of still image data having a small number of the plurality of still image data.
<Claim 3>
The adding means adds a number of additional still image data corresponding to a difference in the number of still image data of each of the plurality of subjects in the group unit, out of a plurality of still image data of each of the plurality of subjects. The image processing apparatus according to claim 2, wherein the image processing device is added to the beginning of a group of a plurality of still image data with a small amount of data.
<Claim 4>
The adding means adds a number of additional still image data corresponding to a difference in the number of still image data of each of the plurality of subjects in the group unit to a group of a plurality of still image data of each of the plurality of subjects. The image processing apparatus according to claim 2, wherein the image processing apparatus is added at the end.
<Claim 5>
The adding means adds a number of additional still image data corresponding to a difference in the number of still image data of each of the plurality of subjects in the group unit to a group of a plurality of still image data of each of the plurality of subjects. The image processing apparatus according to claim 2, wherein the image processing apparatus is distributed and added from the beginning to the end.
<Claim 6>
5. The image processing apparatus according to claim 3, further comprising setting means for setting a character string to be displayed together with display contents corresponding to the additional still image data added by the adding means.
<Claim 7>
The group includes a first part from the start of the swing of the golf club to the top of the swing, a second part from the top of the swing to the impact on the ball, and a third part from the impact to the ball to the end of the swing. The image processing apparatus according to claim 1, wherein the image processing apparatus is a part.
<Claim 8>
Synthesizing means for generating a plurality of synthesized still image data by combining still image data of the plurality of subjects at the same timing synchronized by the synchronizing means, and a moving image based on the plurality of synthesized still image data The image processing apparatus according to claim 1, further comprising a moving image generation unit that generates data.
<Claim 9>
A computer of an image processing device that synchronizes a plurality of image data obtained by imaging each of a plurality of subjects by an imaging device, and a plurality of still images from a plurality of moving image data obtained by imaging each of the plurality of subjects by the imaging device. Means for generating data, means for dividing the plurality of generated still image data into a plurality of groups provided in time series, and synchronizing still image data of each of the plurality of subjects in units of groups A program characterized by causing it to function as a means for making it happen.

DESCRIPTION OF SYMBOLS 1 Golf swing analysis system 2,3,4 Camera 10 Image processing apparatus 11 CPU
12 RAM
13 ROM
14 storage device 15 input device 16 display device

Claims (7)

An image processing device that synchronizes a plurality of image data obtained by imaging each of a plurality of subjects by an imaging device,
Generating means for generating a plurality of still image data from each of a plurality of moving image data obtained by imaging each of the plurality of subjects by the imaging device;
A dividing unit that divides the plurality of still image data generated by the generating unit into a plurality of groups provided in time series;
Synchronization means for synchronizing still image data of the plurality of subjects in units of groups divided by the dividing means;
When there is a difference in the number of still image data of each of the plurality of subjects in the group unit, each of the plurality of subjects is set to have the same number of still image data of the plurality of subjects in the group unit. Adding means for adding a number of additional still image data according to the difference in the number of still image data of a plurality of still image data of the plurality of still image data,
A selecting means for arbitrarily selecting a position or a method for adding additional still image data by the adding means;
An image processing apparatus comprising: The image processing apparatus according to claim 1 , wherein the selection unit includes a head or a tail of a group of a plurality of still image data as the selectable position. 3. The image processing apparatus according to claim 1 , wherein the selection unit includes, as the selectable method, a method of sorting and adding a plurality of still image data groups from the beginning to the end. 4. 4. The image processing apparatus according to claim 1, further comprising a setting unit configured to set a character string to be displayed together with display contents corresponding to the additional still image data added by the adding unit. 5. . The group includes a first part from the start of the swing of the golf club to the top of the swing, a second part from the top of the swing to the impact on the ball, and a third part from the impact to the ball to the end of the swing. The image processing apparatus according to claim 1 , wherein the image processing apparatus is a part. A synchronization method for synchronizing a plurality of image data obtained by imaging each of a plurality of subjects by an imaging device,
Generation processing for generating a plurality of still image data from each of a plurality of moving image data obtained by imaging each of the plurality of subjects by the imaging device;
A division process for dividing the plurality of still image data generated by the generation process into a plurality of groups provided in time series;
A synchronization process for synchronizing still image data of the plurality of subjects in units of groups divided by the division process;
When there is a difference in the number of still image data of each of the plurality of subjects in the group unit, each of the plurality of subjects is set to have the same number of still image data of the plurality of subjects in the group unit. An additional process of adding a number of additional still image data in accordance with the number difference to a plurality of still image data having a small number of the plurality of still image data,
A selection process for arbitrarily selecting a position or method for adding additional still image data by the additional process;
Including a synchronization method. A computer of an image processing device that synchronizes a plurality of image data obtained by imaging each of a plurality of subjects by an imaging device,
Generating means for generating a plurality of still image data from each of a plurality of moving image data obtained by imaging each of the plurality of subjects by the imaging device;
A dividing unit that divides the plurality of still image data generated by the generating unit into a plurality of groups provided in time series;
Synchronization means for synchronizing still image data of the plurality of subjects in groups divided by the dividing means;
When there is a difference in the number of still image data of each of the plurality of subjects in the group unit, each of the plurality of subjects is set to have the same number of still image data of the plurality of subjects in the group unit. Adding means for adding a number of additional still image data in accordance with the difference in the number of still image data having a small number of the plurality of still image data;
Selection means for arbitrarily selecting a position or method for adding additional still image data by the adding means,
A program characterized by functioning as

Images