JP2016123107A - Image processing device, image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a viewer to easily grasp a specific portion of subject movement.SOLUTION: An image pickup device 1 comprises an image acquisition unit 71, an image identification unit 72, an image selection unit 73, and a composite image generation unit 74. The image acquisition unit 71 acquires a plurality of image data showing a series of subject motions. The image identification unit 72 identifies from the plurality of images acquired by the image acquisition unit 71 a partial motion constituting the series of subject motions. On the basis of a result of identification by the image identification unit 72, the image selection unit 73 selects from among the plurality of image data a plurality of image data corresponding to a predetermined partial motion. The composite image generation unit 74 generates one composite image from the plurality of image data selected by the image selection unit 73.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program for grasping a motion of a subject.

  Conventionally, the operation of a subject reflected in a moving image captured by an imaging device such as a digital camera has been confirmed afterwards. For example, in sports such as golf, a swing operation is recorded as a moving image and a swing is confirmed.

  As a technique for confirming such a swing form, a technique described in Patent Document 1 is known. The technique described in Patent Document 1 is a technique for combining and displaying a series of swing operations of a golf head on a single still image.

JP-A-11-98450

  However, since the technique described in Patent Document 1 described above displays a series of swing operations of a golf head on a single still image, each swing operation (down swing, swing before and after impact, follow swing, etc.) There is a risk that it will be difficult to grasp which part corresponds to which swing motion.

  The present invention has been made in view of such a situation, and an object thereof is to easily grasp the motion of a subject.

In order to achieve the above object, an image processing apparatus according to an aspect of the present invention includes:
Image acquisition means for acquiring data of a plurality of images indicating a series of actions of the subject;
A specifying means for specifying a predetermined partial motion from a plurality of partial motions constituting a series of motions of the subject when an input for selecting a predetermined partial motion to the input unit is detected;
Image selecting means for selecting a plurality of image data corresponding to the predetermined partial motion specified by the specifying means from the plurality of image data acquired by the image acquiring means;
Extraction means for extracting a plurality of partial regions that are characteristic of the operation in the image of the subject from the plurality of images selected by the image selection means;
A plurality of the partial areas extracted by the extraction unit and the image data at the time of the predetermined partial operation selected by the image selection unit are combined so as to be superimposed to generate a composite image. And a synthesized image generating means.

  According to the present invention, it is possible to easily grasp the motion of the subject.

1 is a block diagram illustrating a hardware configuration of an imaging apparatus according to an embodiment of an image processing apparatus of the present invention. It is a functional block diagram which shows the functional structure for performing a synthesized image generation process among the functional structures of the imaging device of FIG. It is a schematic diagram which shows an example of all the synthesized images produced | generated by the synthesized image production | generation process. It is a schematic diagram which shows an example of the display of a partial synthesized image. It is a figure which shows an example of the selection screen of the partial composite image displayed on the display part of an imaging device. 4 is a flowchart for explaining a flow of composite image generation processing executed by the imaging apparatus of FIG. 3 having the functional configuration of FIG. 2.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram illustrating a hardware configuration of an imaging apparatus according to an embodiment of the image processing apparatus of the present invention.

  The imaging device 1 is configured as a digital camera, for example.

  The imaging device 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, an image processing unit 14, a bus 15, an input / output interface 16, and an imaging unit. 17, an input unit 18, an output unit 19, a storage unit 20, a communication unit 21, and a drive 22.

  The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 20 to the RAM 13.

  The RAM 13 appropriately stores data necessary for the CPU 11 to execute various processes.

  The CPU 11, ROM 12, RAM 13, and image processing unit 14 are connected to each other via a bus 15. An input / output interface 16 is also connected to the bus 15. An imaging unit 17, an input unit 18, an output unit 19, a storage unit 20, a communication unit 21, and a drive 22 are connected to the input / output interface 16.

  Although not shown, the imaging unit 17 includes an optical lens unit and an image sensor.

  The optical lens unit is configured with a lens that collects light, such as a focus lens and a zoom lens, in order to capture an image of the subject.

  The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length within a certain range.

  The optical lens unit is also provided with a peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance as necessary.

  The image sensor includes a photoelectric conversion element, AFE (Analog Front End), and the like.

  The photoelectric conversion element is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) the subject image, accumulates the image signal for a predetermined time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.

  The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. A digital signal is generated by various signal processing and output as an output signal of the imaging unit 17.

  Such an output signal of the imaging unit 17 is hereinafter referred to as “captured image data”. The captured image data is appropriately supplied to the CPU 11, the image processing unit 14, and the like.

  The input unit 18 is configured with various buttons and the like, and inputs various types of information according to user instruction operations.

  The output unit 19 includes a display, a speaker, and the like, and outputs images and sounds.

  The storage unit 20 is configured by a hard disk, a DRAM (Dynamic Random Access Memory), or the like, and stores various image data.

  The communication unit 21 controls communication with other devices (not shown) via a network including the Internet.

  A removable medium 31 composed of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 22. The program read from the removable medium 31 by the drive 22 is installed in the storage unit 20 as necessary. The removable medium 31 can also store various data such as image data stored in the storage unit 20 in the same manner as the storage unit 20.

  FIG. 2 is a functional block diagram illustrating a functional configuration for executing the composite image generation process among the functional configurations of the imaging apparatus in FIG. 1.

The composite image generation process is based on the acquired moving image data, analyzes the moving image, identifies the motion of the subject reflected in the moving image, and selects a still image (described later) corresponding to the identified motion. This is a series of processes for synthesizing and displaying a total synthesized image and a partially synthesized image (to be described later).
In the present embodiment, the imaging apparatus 1 will be described with respect to an example in which a subject performing a golf swing is imaged as a subject.
In the present embodiment, the motion of the imaged subject is a series of operations (hereinafter also referred to as “overall operations”) and partial operations constituting the series of operations (hereinafter “partial operations”). ).
That is, in the present embodiment in which a golf swing is imaged and a composite image is generated, the entire operation is a series of swing operations, and the partial operations are motions constituting the swing (for example, address, back swing, top, Down swing, impact, follow swing, finish).

  When the composite image generation process is executed, as illustrated in FIG. 2, the imaging control unit 51 and the output control unit 52 function in the CPU 11, and the image acquisition unit 71 and the image processing unit 14 in the image processing unit 14. The specifying unit 72, the image selecting unit 73, and the composite image generating unit 74 function.

  However, FIG. 2 is an exemplification, and at least a part of the function of the CPU 11 may be delegated to the image processing unit 14. Conversely, at least a part of the function of the image processing unit 14 may be delegated to the CPU 11. .

In this case, an acquired image storage unit 91 and a composite image storage unit 92 provided as one area of the storage unit 20 are used.
In the acquired image storage unit 91, data of a captured image output from the imaging unit 17 and acquired by the image acquisition unit 71 is stored.
In the composite image storage unit 92, the composite image data output from the composite image generation unit 74 is stored.

The imaging control unit 51 sets various imaging conditions and controls the imaging operation in the imaging unit 17.
In the present embodiment, the imaging control unit 51 causes the imaging unit 17 to capture a moving image in order to image the motion of the subject.

  The output control unit 52 controls the output unit 19 to display and output a composite image (a full composite image described later or a partial composite image described later) stored in the composite image storage unit 92.

  The image acquisition unit 71 acquires the moving image data output from the imaging unit 17 as data that can be acquired as a plurality of single images (still images) that are a plurality of image data indicating a series of operations. Thereafter, the image acquisition unit 71 stores the acquired moving image data in the acquired image storage unit 91.

  The image specifying unit 72 specifies an image that specifies the action of the subject in the single image. In addition, the image specifying unit 72 associates the specified operation with a single image. Specifically, the image specifying unit 72 acquires moving image data from the acquired image storage unit 91, and specifies the motion of the subject reflected in the single image that forms the moving image. Then, the image specifying unit 72 stores the action of the specified subject in the acquired image storage unit 91 in association with the corresponding single image. In the present embodiment, the image specifying unit 72 performs a swing operation as an overall operation and an operation (for example, (address, back swing, top, down swing, impact, follow swing, finish)) constituting the swing. And the club movement (particularly the club head movement).

The method for identifying the partial motion belonging to the motion of the subject is not particularly limited. For example, a method for estimating and identifying the partial motion based on the swing time may be used, and comparison with a reference image may be used. In this case, an image matching technique such as specifying a partial motion may be used. Alternatively, a method may be used in which a club or club head is extracted from the image, and the partial motion of the swing is specified from the positional relationship of the extracted club or club head.
As for a method for specifying the partial motion belonging to the motion of the subject, any method known or will appear in the future, for example, Japanese Patent Application Laid-Open No. 2008-278386, Japanese Patent Application Laid-Open No. 2009-53786, and Japanese Patent No. 4415198. The method etc. currently disclosed by these etc. are employable.

  The image selection unit 73 selects a plurality of specified single images based on an image synthesis instruction from the input unit 18. Specifically, the image selection unit 73 configures a moving image stored in the acquired image storage unit 91 based on a synthesis instruction of a later-described total synthesized image or a later-described partially synthesized image from the input unit 18. Single image data corresponding to the operated motion is selected.

The composite image generation unit 74 combines the single images selected by the image selection unit 73 and generates composite image data.
When the image selection unit 73 selects a single image corresponding to the entire motion that is a series of swing operations, the composite image generation unit 74 converts all the single images showing the swing into one still image. As described above, data of an image synthesized (hereinafter referred to as “total synthesized image”) is generated.
Further, when a single image corresponding to the partial motion of the swing is selected by the image selection unit 73 (for example, downswing), the composite image generation unit 74 sets all the single images showing the downswing to 1 Data of an image synthesized as a single still image (hereinafter referred to as “partial synthesized image”) is generated. In the present embodiment, the partially synthesized image is synthesized by including a single image corresponding to the partial motion and a single image positioned before and after the partial motion. That is, in the case of generating partial composite image data in the partial motion of the downswing, the operation before and after the downswing (the operation between the top and the downswing and the operation between the downswing and the impact) is performed. Synthesize a single image.
In addition, the composite image generation unit 74 can synthesize only a portion (for example, a club head or a ball) that is the main subject of the operation when generating the partial composite image. In other words, the composite image generation unit 74 can synthesize a moving part before and after the image that best represents the motion so that the trajectory of the motion can be seen in the image that best represents the selected motion.
By generating the partial composite image data in this way, it is possible to provide an image that can be easily grasped and not complicated.
That is, the composite image generation unit 74 generates data of the total composite image based on the composite instruction of the total composite image by the input unit 18, and based on the composite instruction of the partial composite image by designating a predetermined operation. Then, partial composite image data is generated.

Next, an example of the total composite image generated by the composite image generation process will be described with reference to FIG.
FIG. 3 is a schematic diagram illustrating an example of a total composite image generated by the composite image generation process.
In the example of FIG. 3, data of the entire image is generated from moving image data obtained by imaging a swinging target from behind.
Since the total composite image is composed of an image in which all the operations corresponding to a series of motions of the swing are reflected, it becomes an image in which the partial motions constituting the swing are reflected like an afterimage. In other words, in the present embodiment, the total composite image is an image in which all the moving subjects (such as the swing target person 100, the club head 101, and the club including the club shaft 102) are combined.
In the case of a golf swing, the movement (track) of the club from the address to the back swing during the movement from the address to the finish and from the top to the impact through the down swing is almost the same.
In addition, when an image of a swinging object is taken from behind, the operations from the address to the impact and from the impact to the finish follow a substantially similar trajectory.
Therefore, although the user who sees the total synthesized image can grasp the image of the entire swing motion, it is difficult to grasp which partial motion corresponds to.
Therefore, the imaging device 1 of the present embodiment generates an image that can be displayed by picking up only a partial operation as a partial composite image.

Next, an example of a partial composite image generated by the composite image generation process will be described with reference to FIG.
FIG. 4 is a schematic diagram illustrating an example of a partial composite image generated by the composite image generation process.
4A to 4C are schematic diagrams illustrating examples of partial composite images corresponding to the downswing, the impact, and the follow swing when the swing motion is imaged from the back side of the swing target person 100. FIG.
4 (a) to 4 (c), the swing operation is grasped due to the plane direction of the swing target person 100 as compared with the example of FIG. 3 in which the swing operation changes in the depth direction of the image. It is easy to do.
In the example of FIGS. 4A to 4C, synthesis is performed including the operations before and after the designated operation, and the synthesis is performed mainly including the operations of only the club head 101 and the ball 103. That is, the swing target person 100 itself synthesizes only the designated action (for example, the impact action in the case of FIG. 3B). By synthesizing in this way, it is possible to easily check the designated partial motion itself while allowing the flow in the partial motion to be grasped.
By combining only partial motions in this way, in the case of motions that draw overlapping trajectories, a complicated image is not generated.

FIGS. 4D to 4F are schematic diagrams illustrating examples of partial composite images corresponding to the downswing, the impact, and the follow swing when the swing operation is imaged from the front side of the swing target person 100. .
In the example of FIGS. 4D to 4F, the partial operations corresponding to FIGS. 4A to 4C are combined as a partially combined image.

In the example of FIG. 4, the main focus is on the movement of the club head 101 and the ball 103, and the trajectory other than the club head 101 and the ball 103 is configured so as not to be displayed as much as possible. That is, in the example of FIG. 4, the swing target person 100, the club shaft 102, and the like are configured so that only a predetermined one motion part is displayed as much as possible, and the club head 101 and the ball 103 display all the partial motions. Configured as follows. That is, when a predetermined motion is selected, the swing target person 100 and the club shaft 102 shown in one image constituting the predetermined motion are employed, and the club head 101, the ball 103, etc. Adopt an image that includes all of the actions. That is, the swing target person 100, the club shaft 102, and the background do not move, and the club head 101 and the ball 103 are combined to generate an image with movement.
As a specific method, various known methods can be adopted. For example, in the image, the swing target person 100, the club (club head 101, club shaft 102), and the ball 103 are extracted as objects, and the swing is performed. Only the subject 100, the club shaft 102, and the like can be adopted from one image, and the other club head 101, the ball 103, and the like can be adopted from an image in a predetermined operation range.
In the example of FIG. 4, a single image is synthesized at an equal interval, but the present invention is not limited to this, and the interval between images to be synthesized may be changed according to the speed of operation or a designated portion.

Next, an example of display switching from a fully synthesized image to a partially synthesized image will be described with reference to FIG.
FIG. 5 is a diagram illustrating an example of a partial composite image selection screen displayed on the display unit of the imaging apparatus.
In the imaging apparatus 1 of the present embodiment, after displaying all synthesized images, software buttons B1 to B3 capable of selecting partial images as shown in FIG. 5 appear, and when any of the software buttons B1 to B3 is selected. A partial composite image corresponding to the selected software buttons B1 to B3 can be generated and displayed.
In the example of FIG. 5, software buttons (“FS” button, “IP” button, “DS” button) are displayed on the entire composite image. When the user selects any software button by touching or operating the input unit 18, the imaging apparatus 1 generates and displays a partial composite image corresponding to the selected software button.
The “FS” button is a software button for instructing to generate and display a partial composite image corresponding to the follow operation. The “IP” button is a software button for instructing to generate and display a partial composite image corresponding to the impact operation. The “DS” button is a software button for instructing to generate and display a partial composite image corresponding to the downswing operation.
A partial image of a corresponding action may be generated by touching or selecting a target.

Next, a composite image generation process executed by the imaging apparatus 1 in FIG. 1 having the functional configuration in FIG. 2 will be described with reference to the flowchart in FIG. In this example, a description will be given of an example in which data of a fully synthesized image is generated and displayed, and then data of a partially synthesized image of a follow swing is generated and displayed.
FIG. 6 is a flowchart illustrating an example of the flow of a composite image generation process executed by the imaging apparatus 1 of FIG. 1 having the functional configuration of FIG.

  When the start of the composite image generation process is instructed by a predetermined operation on the input unit 18 by the user, the composite image generation process is started and the following process is executed.

  In step S1, the image acquisition unit 71 acquires moving image data as data of a plurality of images indicating a series of operations. Specifically, the imaging control unit 51 starts imaging in the imaging unit 17 in response to an input of imaging start from the input unit 18. Then, the image acquisition unit 71 acquires moving image data captured by the imaging unit 17. The image acquisition unit 71 stores the acquired moving image data in the captured image storage unit 62.

  In step S2, the image specifying unit 72 analyzes moving image data. That is, the image specifying unit 72 analyzes data of a single image that constitutes moving image data. The analysis of single image data is performed by specifying the motion of the subject in the single image.

  Specifically, the image specifying unit 72 specifies that the action of the subject reflected in the single image constituting the moving image belongs to, for example, a downswing.

In step S3, the image specifying unit 72 associates the specifying result with a single image.
Specifically, the image specifying unit 72 associates the data indicating the partial motion specified in step S2 with the single image data and causes the acquired image storage unit 91 to store the data.

  In step S4, the synthesized image generation unit 74 synthesizes all the single images and generates data of all synthesized images. Specifically, all single images are selected by the image selection unit 73, and the composite image generation unit 74 combines all of the selected single images as one still image, and generates data of all composite images. .

  In step S5, the output unit 19 displays the total composite image. Specifically, the output unit 19 is controlled by the output control unit 52 to display and output the total composite image. As a result, the output unit 19 displays a total synthesized image obtained by synthesizing all the single images constituting the moving image as shown in FIG.

In step S <b> 6, the image selection unit 73 selects single image data corresponding to the designated partial motion. More specifically, the image selection unit 73, when the operation of the input unit 18 is operated by the user and a partial operation is specified as shown in FIG. Single image data corresponding to the partial operation is selected from the stored acquired image storage unit 91.
In this case, in the example shown in FIG. 5, the “FS” software button B1 is touched, and a single image corresponding to the follow swing corresponding to the “FS” software button B1 is selected.

In step S7, the composite image generation unit 74 combines the selected single images and generates partial composite image data. Specifically, all single images are selected by the image selection unit 73, and the composite image generation unit 74 combines all of the selected single images as one still image, and generates data of all composite images. .
The composite image generation unit 74 acquires a single image corresponding to the selected follow swing from the acquired image storage unit 91, combines all the single images corresponding to the follow swing, and performs a partial operation of the follow swing. Corresponding partial composite image data is generated.
At this time, all of the single images corresponding to the designated follow swing are acquired, but further, a single image corresponding to the partial motion before and after the follow swing is acquired.

In step S8, the output unit 19 displays the partial composite image. Specifically, the output unit 19 is controlled by the output control unit 52 to display and output the partial composite image. As a result, the output unit 19 displays a partially synthesized image obtained by synthesizing a single image corresponding to the follow swing operation as shown in FIG.
Also, in step S6, by changing the designation of the partial action, for example, when the “IP” software button B2 is touched, the result is an impact action as shown in FIG. 4B. A partial composite image is displayed.
By performing the imaging direction from the front side of the subject, for example, a partial composite image of an operation corresponding to a downswing as shown in FIG. 4D, or a partial composite image of an operation corresponding to an impact as shown in FIG. Then, a partial composite image or the like of the operation corresponding to the follow swing as shown in FIG. 4F can be generated and displayed.
In this way, when the partial composite image is displayed in the process of step S8, the composite image generation process ends.

The imaging device 1 that executes the above-described composite image generation process includes an image acquisition unit 71, an image specification unit 72, an image selection unit 73, and a composite image generation unit 74.
The image acquisition unit 71 acquires data of a plurality of images indicating the motion of the subject.
The image specifying unit 72 specifies a partial motion that constitutes the motion of the subject from the plurality of images acquired by the image acquiring unit 71.
The image selection unit 73 selects image data corresponding to a predetermined partial operation from a plurality of image data based on the identification result by the image identification unit 72.
The composite image generation unit 74 generates one composite image from the data of the plurality of images selected by the image selection unit 73.
For this reason, in the imaging device 1, one composite image is generated from image data corresponding to a predetermined partial operation from among a plurality of image data selected based on the identification result by the image identification unit 72.
Therefore, the imaging apparatus 1 can generate an image that easily grasps the specific partial motion in the motion of the subject. Further, since the generated image includes only the specific partial operation, the image is not complicated.

In addition to the image data corresponding to the predetermined partial operation, the image selection unit 73 selects image data corresponding to at least one operation before or after the predetermined partial operation.
For this reason, in the imaging apparatus 1, in order to synthesize an image including the operation before or after the portion corresponding to the predetermined partial motion, the trajectory leading to the predetermined partial motion and the subsequent portion of the predetermined portion Since the image includes the locus, the locus of the partial motion can be easily grasped.

  In addition, this invention is not limited to the above-mentioned embodiment, The deformation | transformation in the range which can achieve the objective of this invention, improvement, etc. are included in this invention.

  In the above-described embodiment, the image acquisition unit 71 acquires a plurality of images including the motion of the subject imaged by the imaging device 1 as moving image data. However, the present invention is not limited to this. The acquired image data may be a plurality of images including a series of operations, for example, not only a moving image but also a still image, and is acquired from the outside instead of an image captured by an imaging unit. It may be an image.

  Further, in the above-described embodiment, the synthesized image (full synthesized image and partially synthesized image) is synthesized regardless of the operation speed, but is not limited thereto. For example, the synthesized image may be configured to thin out and synthesize an image for a slow motion part, or to interpolate between captured images for a fast motion part. With this configuration, it is possible to provide an image in which the trajectory of the partial motion can be easily grasped.

  In the above-described embodiment, the golf swing is described as an example of a series of operations, but the present invention is not limited to this. For example, a series of movements including a reciprocating movement is particularly preferable, and is not limited to ball sports such as baseball, tennis, and baseball, and martial arts movements such as kendo and judo. It is not limited to the performed operation. By extracting a partial motion of a series of motions, it is only necessary that the partial motion in the synthesized image can be easily grasped or the image itself does not become complicated.

In the above-described embodiment, the imaging apparatus 1 to which the present invention is applied has been described using a digital camera as an example, but is not particularly limited thereto.
For example, the present invention can be applied to general electronic devices having a composite image generation function. Specifically, for example, the present invention can be applied to a notebook personal computer, a printer, a television receiver, a video camera, a portable navigation device, a mobile phone, a portable game machine, and the like.

The series of processes described above can be executed by hardware or can be executed by software.
In other words, the functional configuration of FIG. 2 is merely an example and is not particularly limited. That is, it is sufficient that the imaging apparatus 1 has a function capable of executing the above-described series of processing as a whole, and what functional blocks are used to realize this function is not particularly limited to the example of FIG.
In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.

When a series of processing is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only constituted by the removable medium 31 of FIG. 1 distributed separately from the apparatus main body in order to provide the program to the user, but also in a state of being incorporated in the apparatus main body in advance. It is comprised with the recording medium etc. which are provided in this. The removable medium 31 is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, a magneto-optical disk, or the like. The optical disk is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disk), or the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. In addition, the recording medium provided to the user in a state of being preliminarily incorporated in the apparatus main body includes, for example, the ROM 12 in FIG. 1 in which a program is recorded, the hard disk included in the storage unit 20 in FIG.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.

  As mentioned above, although several embodiment of this invention was described, these embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalent scope thereof.

The invention described in the scope of claims at the beginning of the filing of the present application will be appended.
[Appendix 1]
Image acquisition means for acquiring data of a plurality of images indicating a series of actions of the subject;
Image specifying means for specifying partial motions constituting a series of motions of the subject from the plurality of images acquired by the image acquisition means;
Image selecting means for selecting a plurality of image data corresponding to a predetermined partial operation from among the plurality of image data based on the identification result by the image identifying means;
Combined image generating means for generating one combined image from data of a plurality of images selected by the image selecting means;
An image processing apparatus comprising:
[Appendix 2]
The image selecting means selects, in addition to image data corresponding to the predetermined partial motion, image data corresponding to at least one of the motions before or after the predetermined partial motion;
The image processing apparatus according to appendix 1, wherein:
[Appendix 3]
The image acquiring means acquires data of an image in which a golf swing is reflected as the movement of the subject;
The image processing apparatus according to appendix 1 or 2, wherein:
[Appendix 4]
The image acquisition means acquires the data of the plurality of images as moving image data;
The image processing apparatus according to any one of appendices 1 to 3, wherein:
[Appendix 5]
An image processing method executed by an image processing apparatus,
An image acquisition step of acquiring data of a plurality of images indicating a series of actions of the subject;
An image specifying step for specifying a partial motion constituting a series of motions of the subject from the plurality of images acquired by the image acquiring step;
An image selection step of selecting a plurality of image data corresponding to a predetermined partial motion from the plurality of image data based on the identification result of the image identification step;
A composite image generation step of generating one composite image from data of a plurality of images selected by the image selection step;
An image processing method comprising:
[Appendix 6]
Computer
Image acquisition means for acquiring data of a plurality of images indicating a series of movements of a subject;
Image specifying means for specifying partial motions constituting a series of motions of the subject from the plurality of images acquired by the image acquisition means;
An image selecting means for selecting a plurality of image data corresponding to a predetermined partial operation from the plurality of image data based on a result of the identification by the image specifying means;
Composite image generation means for generating one composite image from data of a plurality of images selected by the image selection means;
A program characterized by functioning as

  DESCRIPTION OF SYMBOLS 1 ... Image processing apparatus, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Image processing part, 15 ... Bus, 16 ... Input / output interface, 17 ..Imaging unit, 18 ... input unit, 19 ... output unit, 20 ... storage unit, 21 ... communication unit, 22 ... drive, 31 ... removable media, 51 ... Imaging control unit, 52 ... Output control unit, 71 ... Image acquisition unit, 72 ... Image identification unit, 73 ... Image selection unit 73 ... Composite image generation unit, 91 ... Acquisition image Storage unit, 92 ... composite image storage unit

In order to achieve the above object, an image processing apparatus according to an aspect of the present invention includes:
Image acquisition means for acquiring data of a plurality of images indicating a series of actions of the subject;
Identifying means for identifying a first partial motion from a plurality of partial motions constituting a series of motions of the subject;
Image selecting means for selecting a plurality of images corresponding to the first partial motion specified by the specifying means from the plurality of images acquired by the image acquiring means;
Composite image generation means for generating a composite image by combining an image corresponding to the first partial motion selected by the image selection means into one image;
Further, the specifying means specifies a second partial motion from a series of motions of the subject after the composite image is generated by the composite image generation means,
The image selecting means selects an image corresponding to the second partial operation from the plurality of images,
The synthesized image generating means synthesizes the images selected by the image selecting means into one image .

Claims (7)

Image acquisition means for acquiring data of a plurality of images indicating a series of actions of the subject;
A specifying means for specifying a predetermined partial motion from a plurality of partial motions constituting a series of motions of the subject when an input for selecting a predetermined partial motion to the input unit is detected;
Image selecting means for selecting a plurality of image data corresponding to the predetermined partial motion specified by the specifying means from the plurality of image data acquired by the image acquiring means;
Extraction means for extracting a partial region that is characteristic of the operation in the image of the subject from a plurality of images selected by the image selection means;
A plurality of the partial areas extracted by the extraction unit and the image data at the time of the predetermined partial operation selected by the image selection unit are combined so as to be superimposed to generate a composite image. A composite image generating means;
An image processing apparatus comprising: The image selection means selects, in addition to single image data at the time of the predetermined partial operation, image data corresponding to an operation at any time before or after the predetermined partial operation.
The image processing apparatus according to claim 1. The image acquisition means acquires data of an image of a golf swing photographed as the movement of the subject;
The image processing apparatus according to claim 1, wherein: The specifying means specifies at least one of address, back swing, top, down swing, impact, follow swing, and finish as a partial motion as a partial motion when the subject motion is a golf swing. ,
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The image acquisition means acquires the data of the plurality of images as moving image data;
The image processing apparatus according to claim 1, wherein: An image processing method executed by an image processing apparatus including an input unit,
An image acquisition step of acquiring data of a plurality of images indicating a series of actions of the subject;
A specific step of identifying a predetermined partial motion from a plurality of partial motions constituting a series of motions of the subject when an input to select a predetermined partial motion to the input unit is detected;
An image selection step of selecting a plurality of image data corresponding to the predetermined partial motion identified by the identification step from the plurality of image data obtained by the image acquisition step;
An extraction step of extracting a plurality of partial regions that are characteristic of the operation in the image of the subject from the plurality of images selected in the image selection step;
A composite image is generated by combining the plurality of partial regions extracted in the extraction step and any one of the image data at the time of the predetermined partial operation selected in the image selection step so as to overlap each other. A composite image generation step;
An image processing method comprising: Computer
Image acquisition means for acquiring data of a plurality of images indicating a series of movements of a subject;
A specifying means for specifying a predetermined partial motion from a plurality of partial motions constituting a series of motions of the subject when an input for selecting the predetermined partial motion to the input unit is detected;
Image selecting means for selecting a plurality of image data corresponding to the predetermined partial motion specified by the specifying means from the plurality of image data acquired by the image acquiring means;
Extraction means for extracting a plurality of partial regions that are characteristic of the operation in the image of the subject from the plurality of images selected by the image selection means;
A plurality of the partial areas extracted by the extraction unit and the image data at the time of the predetermined partial operation selected by the image selection unit are combined so as to be superimposed to generate a composite image. Synthetic image generating means,
A program characterized by functioning as