JP2016123637A - Image processor, image processing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce a user's burden when setting an indicator to be reference to be displayed in an image.SOLUTION: An imaging device 1 includes an auxiliary line setting processing part 51. The auxiliary line setting processing part 51 acquires a plurality of pieces of image data in which a series of movements of an object are picked up. The auxiliary line setting processing part 51 also divides each of the acquired plurality of pieces of image data into a plurality of regions. The auxiliary line setting processing part 51 specifies a region having change between a plurality of pieces of image data among the plurality of regions. The auxiliary line setting processing part 51 generates an indicator for being overlapped on any of the plurality of pieces of image data with the specified region as reference.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

  2. Description of the Related Art Conventionally, a technique for displaying a reference line for checking a swing on a recorded moving image of a golf swing is known (see Patent Document 1).

JP-A-10-201898

  However, the technique disclosed in Patent Document 1 has a problem in that it is necessary to manually adjust the reference line displayed on the moving image, which places a burden on the user who performs the adjustment.

  The present invention has been made in view of the above problems, and an object of the present invention is to reduce the burden on the user when setting a reference index to be displayed on an image.

In order to achieve the above object, an image processing apparatus according to an aspect of the present invention includes:
An acquisition means for acquiring a plurality of image data obtained by imaging a series of actions of an object;
A dividing unit for dividing each of the plurality of image data acquired by the acquiring unit into a plurality of regions;
A first specifying unit for specifying a region having a change between the plurality of image data from the plurality of regions;
Generating means for generating an index to be superimposed on any of the plurality of image data with reference to the area specified by the first specifying means;
It is provided with.

  ADVANTAGE OF THE INVENTION According to this invention, the burden of the user at the time of setting the parameter | index used as the reference | standard displayed on an image can be reduced.

It is a block diagram which shows the structure of the hardware of the imaging device which concerns on one Embodiment of this invention. It is a schematic diagram for demonstrating the setting method of the auxiliary line in this embodiment. It is a schematic diagram for demonstrating the evaluation method of the swing in this embodiment. It is a functional block diagram which shows the functional structure for performing swing evaluation result alerting | reporting process among the functional structures of the imaging device of FIG. 5 is a flowchart for explaining the flow of a swing evaluation result notification process executed by the imaging apparatus of FIG. 1 having the functional configuration of FIG. 4. It is a flowchart explaining the flow of an auxiliary line setting process among evaluation result alerting | reporting processes. It is a flowchart explaining the flow of a swing point detection process among evaluation result alerting | reporting processes.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram showing a hardware configuration of an imaging apparatus according to an embodiment of the present invention.
The imaging device 1 is configured as a digital camera, for example.

  The imaging apparatus 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an imaging unit 16, and an input unit 17. An output unit 18, a storage unit 19, a communication unit 20, and a drive 21.

  The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 19 to the RAM 13.

  The RAM 13 appropriately stores data necessary for the CPU 11 to execute various processes.

  The CPU 11, ROM 12, and RAM 13 are connected to each other via a bus 14. An input / output interface 15 is also connected to the bus 14. An imaging unit 16, an input unit 17, an output unit 18, a storage unit 19, a communication unit 20, and a drive 21 are connected to the input / output interface 15.

  Although not shown, the imaging unit 16 includes an optical lens unit and an image sensor.

The optical lens unit is configured by a lens that collects light, for example, a focus lens or a zoom lens, in order to photograph a subject.
The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length within a certain range.
The optical lens unit is also provided with a peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance as necessary.

The image sensor includes a photoelectric conversion element, AFE (Analog Front End), and the like.
The photoelectric conversion element is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) the subject image, accumulates the image signal for a predetermined time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.
The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. Through various signal processing, a digital signal is generated and output as an output signal of the imaging unit 16.
Hereinafter, the output signal of the imaging unit 16 is referred to as “captured image data”. Data of the captured image is appropriately supplied to the CPU 11 or an image processing unit (not shown).

The input unit 17 includes various buttons and the like, and inputs various types of information according to user instruction operations.
The output unit 18 includes a display, a speaker, and the like, and outputs images and sounds.
The storage unit 19 is composed of a hard disk, a DRAM (Dynamic Random Access Memory), or the like, and stores various image data.
The communication unit 20 controls communication performed with other devices (not shown) via a network including the Internet.

  A removable medium 31 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 21. The program read from the removable medium 31 by the drive 21 is installed in the storage unit 19 as necessary. The removable medium 31 can also store various data such as image data stored in the storage unit 19 in the same manner as the storage unit 19.

  The imaging apparatus 1 configured as described above has a function capable of automatically setting an auxiliary line for evaluating a swing in a moving image obtained by shooting a golf swing.

Here, the setting of the auxiliary line will be described.
The auxiliary line set in the present embodiment is a first auxiliary line that becomes a shaft line set toward the shoulder of a person who is swinging from the position of the club head at the time of addressing (hereinafter simply referred to as “subject”). The line L1 and the second auxiliary line L2 serving as a swing plane set toward the waist.

  FIG. 2 is a schematic diagram for explaining an auxiliary line setting method in the present embodiment. In the present embodiment, the subject is photographed from the rear, and an auxiliary line is set and a swing is evaluated for the swing from the rear. As shown in FIG. 2A, the moving image for setting the auxiliary line includes a humanoid grid HG displayed on the live view screen of the output unit 18 (in this embodiment, from the legs of the humanoid grid HG. The part photographed so that the subject coincides with the above part) is used.

  For the setting of the auxiliary line, first, with respect to the moving image shown in FIG. 2B, a region GR (in this embodiment, a lattice-like shape) is used to determine a change in motion as shown in FIG. Divide into grid areas GR).

  After that, as shown in FIGS. 2D to 2F, the frame of the moving image is advanced and reproduced, and the region MR that has moved is extracted from the series of swings as shown in FIG. . When swinging from the back, when swinging from the rear, the swinging action is from swinging up to swinging down. When the club head is at the lower right in the address posture, the swinging action at the upper left of the club moves upward. The extracted region MR is extracted.

  Next, as shown in FIG. 2 (h), in the extracted area MR, the point that is most distant from the subject OB in the horizontal direction at the takeback timing is set as the club head position, and the auxiliary line A region SR including the start point is determined.

  Next, as shown in FIG. 2 (i), a line passing through the shoulder of the humanoid grid HG from the region SR including the determined starting point of the auxiliary line is set as a first auxiliary line L1 serving as a shaft line. Is set as an auxiliary line of the second auxiliary line L2, which is an ideal swing plane (swing trajectory).

Finally, as shown in FIG. 2 (j), the first auxiliary line L1 that becomes the set shaft line and the second auxiliary line L2 that becomes the swing plane are drawn in a superimposed manner on the moving image, and the auxiliary line is drawn. Set.
As described above, the region SR including the starting point of the auxiliary line is determined from the subject photographed based on the humanoid grid HG, and the auxiliary line is automatically set by setting the auxiliary line based on the humanoid grid HG. The user convenience can be improved. Further, by setting an auxiliary line based on the human grid HG, an accurate auxiliary line based on the grid can be set.

  In addition, the imaging apparatus 1 has a function of specifying a swing point from a captured moving image, specifying a swing point using a set auxiliary line or the like, and automatically evaluating a swing. The evaluation of the swing is to evaluate whether the swing is in an appropriate range and to evaluate the type of the trajectory of the swing such as inside-out and outside-in.

Here, a swing evaluation method in the present embodiment will be described.
FIG. 3 is a schematic diagram for explaining a swing evaluation method in the present embodiment.

  In the evaluation of the swing, first, as shown in FIGS. 3A and 3B, in the state in which the auxiliary line is set, an area that has moved is extracted from the moving image.

  Next, as shown in FIGS. 3C and 3D, at the detected swing points such as takeback, impact, and follow, from the detection area constituted by the first auxiliary line L1 and the second auxiliary line L2. Determine the club head distance. Each swing point is specified by a positional relationship between the position of the human grid HG at which the conversion point, which is a club head, and the start point SR of the auxiliary lines L1 and L2. Specifically, as shown in FIG. 3C, when the change point (club head) is near the starting point SR of the auxiliary lines L1 and L2 with respect to the human-type grid HG, the takeback is performed, and FIG. If the change point (club head) is not close to the starting point SR of the auxiliary lines L1 and L2 with respect to the human-type grid HG as shown in FIG.

  Next, as shown in FIGS. 3E and 3F, it is determined whether or not the distance of the club head from the determined detection area is equal to or greater than a predetermined value, and the swing is evaluated. The evaluation is poor when the distance of the club head from the detection area is equal to or greater than a predetermined value, and the evaluation is good when the distance of the club head from the detection area is within the predetermined value.

  Further, in the swing evaluation of this embodiment, in addition to the evaluation of each swing, the type of the swing trajectory is also evaluated. Specifically, as shown in FIG. 3G, the trajectory of the swing such as outside-in and inside-out is evaluated from the position change of the detection area and the club head. “Outside-in” is the type of trajectory of the swing that has already crossed the flying line in the backswing or downswing and enters the inside in the follow-through after the impact. “Inside-out” When the backswing or downswing causes the club to be on the inside of the flying ball line, the impact is in contact with the flying ball line, and the follow-through after the impact is the type of the orbit of the swing that is inside the flying ball line.

  Such an imaging apparatus 1 has a function of notifying / warning the result of such evaluation via video or audio via the output unit 18. Specifically, in the imaging device 1, various evaluations are performed according to the degree of the evaluation result (for example, the quality of the entire swing or each swing point of the swing, the degree of the quality, the quality of the swing path, the degree of the quality). Alert / warn.

FIG. 4 is a functional block diagram illustrating a functional configuration for executing the swing evaluation result notification process among the functional configurations of the imaging apparatus 1 as described above.
The “swing evaluation result notifying process” refers to a series of processes for setting an auxiliary line in a moving image, evaluating a swing in the moving image based on the set auxiliary line, and notifying the evaluation result.
The “swing evaluation result notification process” includes an “auxiliary line setting process”. The “auxiliary line setting process” is a series of processes for setting an auxiliary line on a moving image subject. The “auxiliary line setting process” includes a “swing point detection process”. The “swing point detection process” is a series of processes for detecting the swing point at the timing of the takeback star and the timing of the impact.

  When executing the swing evaluation result notification process, as shown in FIG. 4, in the CPU 11, the auxiliary line setting processing unit 51, the swing point detection processing unit 52, the detection area setting unit 53, and the swing determination unit 54 The notification control unit 55 and the swing trajectory determination unit 56 function.

  An image storage unit 71 and a determination information storage unit 72 are set in one area of the storage unit 19.

  The image storage unit 71 stores moving image data to be determined. In addition, the moving image memorize | stored in the image memory | storage part 71 carries out the golf swing from back so that it may fit the guide of the human-type grid HG as shown to Fig.2 (a) superimposed on the live view image. This is a moving image obtained by photographing a subject.

  The determination information storage unit 72 stores information on the distance between the set auxiliary line and each swing point (takeback, top, impact, follow).

  The auxiliary line setting processing unit 51 executes an auxiliary line setting process. As a result of the execution of the auxiliary line setting process, an auxiliary line serving as a swing criterion is set on the moving image.

  Specifically, the auxiliary line setting processing unit 51 determines a change in movement of each frame near the frame of the detected swing point (takeback start timing and impact timing) as shown in FIG. In order to do so, it is divided into regions GR (in the present embodiment, a grid-like grid region GR). Then, the auxiliary line setting processing unit 51 extracts a region MR that has moved out of a series of swings as shown in FIG.

  Further, the auxiliary line setting processing unit 51 determines the point that is farthest from the subject in the horizontal direction at the takeback timing as the starting point of the auxiliary line. That is, as shown in FIG. 2 (h), the auxiliary line setting processing unit 51 sets the point farthest away from the subject OB in the horizontal direction at the takeback timing in the extracted area MR. As a position, a region SR including the starting point of the auxiliary line is determined.

  In addition, the auxiliary line setting processing unit 51 sets the auxiliary line so as to connect the human grid HG from the determined starting point of the auxiliary line. That is, the auxiliary line setting processing unit 51 sets a line passing through the shoulder of the human grid HG from the region SR including the determined starting point of the auxiliary line as shown in FIG. As the first auxiliary line L1, a line passing through the waist is set, and an auxiliary line of the second auxiliary line L2 that is an ideal swing plane (swing trajectory) is set. As a result, as shown in FIG. 2 (j), the first auxiliary line L1 serving as the set shaft line and the second auxiliary line L2 serving as the swing plane are drawn on the moving image in a superimposed manner, so that each auxiliary line is drawn. Set the line.

The swing point detection processing unit 52 performs a swing point detection process. As a result of the execution of the swing point detection process, a frame of a swing point (takeback start and impact timing) is detected.
Specifically, the swing point detection processing unit 52 sets a detection area in the vicinity of the impact through which the club passes from the position of the human grid HG. Then, the swing point detection processing unit 52 detects the change by sequentially comparing the moving image frames. Further, the swing point detection processing unit 52 detects a frame of a swing point (first time: start of takeback, second time: timing of impact) according to the number of times of detection.

  The detection area setting unit 53 sets a swing detection area in a region near both auxiliary lines set by the auxiliary line setting processing unit 51.

The swing determination unit 54 specifies a swing point based on the position of the club head, which is the changing point. Specifically, after the takeback start, the swing determination unit 54 determines whether or not the club head that is the change point is closer to the start point SR of the auxiliary lines L1 and L2 than the humanoid grid HG, and FIG. ) Is closer to the starting point SR of the auxiliary lines L1 and L2 than the humanoid grid HG as shown in FIG. 3), it is a takeback, and the starting point of the auxiliary line is higher than the humanoid grid HG as shown in FIG. If it is ahead of the human grid HG that is not close, it will be top.
In addition, the swing determination unit 54 determines whether or not the club head, which is the changing point, is closer to the starting point SR of the auxiliary lines L1 and L2 than the human-type grid HG when it is set to the top and not after the start of takeback. If it is closer to the starting point of the auxiliary line than the humanoid grid HG, it is an impact (in the present embodiment, just before the impact), and the humanoid grid is not closer to the starting point SR of the auxiliary lines L1 and L2 than the humanoid grid HG. If it is ahead of HG, follow it.

Further, the swing determination unit 54 determines the distance between the set auxiliary line and each swing point (take back, top, impact, follow). Specifically, the swing determination unit 54 calculates the distance from the set auxiliary line from the position of the club head in the scene of each identified swing point.
In addition, the swing determination unit 54 causes the determination information storage unit 72 to store the calculated distance from the auxiliary line at each swing point.

  Further, the swing determination unit 54 determines whether or not the distance from the auxiliary line at each swing point stored in the determination information storage unit 72 is greater than or equal to a predetermined value. As a result of the determination, if the distance from the auxiliary line at each swing point is greater than or equal to a predetermined value, it is determined that the swing is abnormal, and if it is within the predetermined value, it is determined that the swing is normal. The

The notification control unit 55 controls the output unit 18 so as to issue a warning as a notification that it is normal or a notification that it is abnormal. Specifically, the notification control unit 55 is normal when the swing determination unit 54 determines that the distance from the auxiliary line at each swing point is equal to or greater than a predetermined value and is a normal swing. A notification to that effect is given, and if the swing is abnormal, the output unit 18 is controlled to issue a warning. At this time, for example, when performing notification / warning by sound, the notification control unit 55 sounds differently in different sounds and colors at normal time and abnormal time, does not sound at normal time, and generates sound only at abnormal time or normal It is also possible to control the output unit 18 so as to give different notifications / warnings due to abnormalities.
In addition, when the degree is set in the normal / abnormality from the degree of the distance from the auxiliary line, the notification control unit 55 corresponds to the normal / abnormal degree, the frequency / size of the notification / warning, The output unit 18 is controlled to perform notification / warning by changing the sound quality.
In addition, when the notification control unit 55 determines whether each swing point is normal / abnormal individually, the notification control unit 55 notifies each swing point according to whether it is normal / abnormal or normal / abnormal. / The output unit 18 is controlled to perform notification / warning by changing the frequency, size, and sound quality of the warning.
In addition, when the evaluation at each swing point is output as a comprehensive result, the notification control unit 55 simply reports / warns according to normal / abnormal, and how much the comprehensive evaluation is. The output unit 18 is controlled so as to perform notification / warning by changing the frequency, size, and sound quality of the notification / warning according to the ratio of the above.
As a result, the output unit 18 outputs a notification or warning indicating that the output is normal.

Further, the notification control unit 55 controls the output unit 18 so as to display the swing trajectory determined by the swing trajectory determination unit 56.
As a result, as shown in FIG. 3 (h), the output unit 18 displays and outputs it as a picture inspired by the swing trajectory. At this time, the notification control unit 55 controls the output unit 18 so that the notification / warning of the evaluation result of the swing trajectory is performed using simple sounds, announcement sounds, sounds that image the swing trajectory, character information, and the like. be able to.

  The swing trajectory determination unit 56 determines the type of the swing trajectory from the amount of deviation of the position of the swing club head. Specifically, the swing trajectory determination unit 56 evaluates the trajectory of a swing such as outside-in or inside-out from the change in the position of the detection area and the club head.

FIG. 5 is a flowchart for explaining the flow of the swing evaluation result notification process executed by the imaging apparatus of FIG. 1 having the functional configuration of FIG.
The swing evaluation result notification process is started by an operation of starting a swing evaluation result notification process to the input unit 17 by the user. Further, in the present embodiment, a moving image in which a subject swinging a golf swing from the rear so as to fit a guide of a humanoid grid HG as shown in FIG. The image is stored in the image storage unit 71, and the moving image is used as a moving image to be processed.

In step S <b> 11, the auxiliary line setting processing unit 51 acquires a moving image to be determined from the image storage unit 71 and executes auxiliary line setting processing. As a result of the auxiliary line setting process, auxiliary lines are drawn and set on the moving image in a superimposed manner. Specifically, as shown in FIG. 2 (j), the first auxiliary line L1 serving as the set shaft line and the second auxiliary line L2 serving as the swing plane are drawn in a superimposed manner on the moving image to assist. Set the line.
The flow of the auxiliary line setting process will be described later.

  In step S12, the detection area setting unit 53 sets a detection area near the set auxiliary line.

In step S13, the swing determination unit 54 determines whether or not the scene (frame) in the moving image is after the start of takeback. Specifically, the swing determination unit 54 determines whether or not the frame to be determined is after the takeback start determined in the swing point detection process.
If it is not after the takeback start, NO is determined in step S13, and the process proceeds to step S17. The processing after step S17 will be described later.
If it is after the start of takeback, YES is determined in step S13, and the process proceeds to step S14.

In step S14, the swing determination unit 54 determines whether or not the changing point is closer to the starting point of the auxiliary line than the human grid HG. That is, after the takeback start, the swing determination unit 54 determines whether or not the club head that is the change point is closer to the start point SR of the auxiliary lines L1 and L2 than the human grid HG, as shown in FIG. A person who is closer to the starting point SR of the auxiliary lines L1 and L2 than the humanoid grid HG is a takeback and is not closer to the starting point of the auxiliary line than the humanoid grid HG as shown in FIG. If it is ahead of the grid HG, it is top.
If the change point is closer to the starting point of the auxiliary line than the human-type grid HG, it is determined as YES in Step S14, and the process proceeds to Step S15.
If the change point is not closer to the starting point of the auxiliary line than the humanoid grid HG, NO is determined in step S14, and the process proceeds to step S16.

  In step S <b> 15, the swing determination unit 54 determines the distance from the takeback start auxiliary line, and causes the determination information storage unit 72 to record the determination result.

  In step S <b> 16, the swing determination unit 54 determines the distance from the top auxiliary line and causes the determination information storage unit 72 to record the determination result.

In step S17, the swing determination unit 54 determines whether or not the changing point is closer to the starting point of the auxiliary line than the human grid HG.
If the change point is closer to the starting point of the auxiliary line than the humanoid grid HG, YES is determined in step S17, and the process proceeds to step S18.
If the change point is not closer to the starting point of the auxiliary line than the humanoid grid HG, NO is determined in step S17, and the process proceeds to step S19.

  In step S <b> 18, the swing determination unit 54 determines the distance from the auxiliary line immediately before the impact, and records the determination result in the determination information storage unit 72.

  In step S <b> 19, the swing determination unit 54 determines the distance from the follow auxiliary line, and records the determination result in the determination information storage unit 72.

In step S20, the swing determination unit 54 determines whether the distance from each auxiliary line is equal to or greater than a predetermined value.
If the distance from each auxiliary line is equal to or greater than the predetermined value, YES is determined in step S20, and the process proceeds to step S21.
If the distance from each auxiliary line is not equal to or greater than the predetermined value, NO is determined in step S20, and the process proceeds to step S22.

  In step S <b> 21, the notification control unit 55 controls the output unit 18 to issue a warning by notifying that there is an abnormality or notifying an abnormality that takes into account the distance (displacement amount) from the auxiliary line. . As a result, a warning sound is output from the output unit 18.

  In step S <b> 22, the notification control unit 55 controls the output unit 18 so as to notify that it is normal or perform normal notification that takes into account the distance from the auxiliary line (deviation amount). As a result, a notification sound indicating that the output unit 18 is normal is output.

  In step S23, the swing trajectory determination unit 56 determines the swing trajectory from the amount of deviation for each swing point.

In step S24, the notification control unit 55 notifies a state such as inside-out / outside-in, or notifies the degree of the state such as inside-out / outside-in, taking into account the amount of deviation for each swing point. Thus, the output unit 18 is controlled. As a result, a warning sound or the like is output from the output unit 18.
Thereafter, the swing determination process ends.

  FIG. 6 is a flowchart for explaining the flow of the auxiliary line setting process in the swing evaluation result notification process.

In step S41, the swing point detection processing unit 52 performs a swing point detection process. As a result of the swing point detection process, a swing point is detected from the moving image.
The flow of the swing point detection process will be described later.

  In step S42, the auxiliary line setting processing unit 51 divides an area near the swing point detection and extracts a club head passage point. Specifically, the auxiliary line setting processing unit 51 determines a change in motion of each frame near the frame of the detected swing point (takeback timing start and impact timing) as shown in FIG. In order to do so, it is divided into regions GR (in the present embodiment, a grid-like grid region GR). Then, the auxiliary line setting processing unit 51 extracts a region MR that has moved out of a series of swings as shown in FIG.

  In step S43, the auxiliary line setting processing unit 51 determines a point farthest from the subject in the horizontal direction at the takeback timing as the starting point of the auxiliary line. Specifically, the auxiliary line setting processing unit 51, as shown in FIG. 2 (h), in the extracted region MR that has moved, is the point that is most distant from the subject OB at the takeback timing. Is determined as the position of the club head, and the region SR including the starting point of the auxiliary line is determined.

  In step S44, the auxiliary line setting processing unit 51 sets auxiliary lines so as to connect the human grid HG from the auxiliary line start point. Specifically, the auxiliary line setting processing unit 51 sets a line passing through the shoulder of the humanoid grid HG from the region SR including the determined starting point of the auxiliary line as shown in FIG. As the first auxiliary line L1, the line passing through the waist is set, and the auxiliary line of the second auxiliary line L2 that is an ideal swing plane (swing trajectory) is set. Then, as shown in FIG. 2J, the auxiliary line setting processing unit 51 superimposes the first auxiliary line L1 serving as the set shaft line and the second auxiliary line L2 serving as the swing plane on the moving image. Draw and set auxiliary lines.

  FIG. 7 is a flowchart for explaining the flow of the swing point detection process in the swing evaluation result notification process.

  In step S61, the swing point detection processing unit 52 sets a change detection area for detecting a change in the club head in a region near the impact through which the club head passes from the position of the human grid HG.

  In step S62, the swing point detection processing unit 52 detects a change by sequentially comparing the frames constituting the moving image.

In step S63, the swing point detection processing unit 52 determines whether or not a change is detected.
If no change is detected, NO is determined in step S63, and the process returns to step S62.
When a change is detected, it determines with YES in step S63, and a process progresses to step S64.

In step S64, the swing point detection processing unit 52 determines whether or not the detected change is the first time.
In the case of the first time, YES is determined in step S64, and the process proceeds to step S65.
If it is not the first time, NO is determined in step S64, and the process proceeds to step S66.

  In step S65, the swing point detection processing unit 52 determines that the takeback start is to swing up the club because the detected change is the first time. Thereafter, the process returns to step S62 in order to detect the impact timing.

In step S66, the swing point detection processing unit 52 determines whether or not the detected change is the second time.
In the second case, YES is determined in step S66, and the process proceeds to step S67.

  In step S67, the swing point detection processing unit 52 determines the impact timing when the club is swung down because the detected change is the first time.

  On the other hand, if it is not the second time, neither takeback nor impact is made, so that it is determined NO in step S66 even in the takeback, and the swing point detection process ends.

Therefore, in the imaging device 1, auxiliary lines for the swing plane and the shaft line are set in advance. Specifically, a line from the club head to the waist and a line from the club head to the shoulder are automatically set as auxiliary lines. Then, the start time of the swing is determined, and the swing phase is determined by the switching of the operation in the screen.
Further, in the imaging apparatus 1, the swing phase (start / impact) is determined by the image difference in the specific area, and the image difference outside the area where the auxiliary line is set is detected and the extent to which the auxiliary line is separated is recorded. At this time, if the swing line is separated from the auxiliary line by more than a certain level, it is judged as a swing error and a warning is issued. It is configured to determine a side-in and issue a warning. That is, the imaging device 1 has a function of warning when the golf club deviates from an ideal swing path in golf.

The imaging device 1 configured as described above includes an auxiliary line setting processing unit 51.
The auxiliary line setting processing unit 51 acquires a plurality of pieces of image data obtained by capturing a series of actions of the object.
Further, the auxiliary line setting processing unit 51 divides each of the acquired plurality of image data into a plurality of regions.
The auxiliary line setting processing unit 51 identifies an area where there is a change between the plurality of image data from the plurality of areas.
The auxiliary line setting processing unit 51 generates an index to be superimposed on any of the plurality of image data with the specified region as a reference.
Thereby, in the imaging device 1, since an index can be automatically generated, it is possible to reduce a burden on the user when setting an index serving as a reference displayed in an image.

In addition, the auxiliary line setting processing unit 51 extracts a plurality of areas that vary between a plurality of image data.
Further, the auxiliary line setting processing unit 51 identifies an area away from the object in a predetermined direction as an area having a change among the extracted areas.
Thereby, in the imaging device 1, an index can be automatically generated more easily.

The auxiliary line setting processing unit 51 identifies a region farthest from the object in a predetermined direction among regions having a plurality of changes.
Thereby, in the imaging device 1, an index can be easily generated.

In addition, the auxiliary line setting processing unit 51 sets a detection area that is a partial area common to each of the acquired plurality of image data.
In addition, the auxiliary line setting processing unit 51 identifies a predetermined time point from a plurality of time points where there is a change between detection areas that are partial areas between the plurality of set image data.
In addition, the auxiliary line setting processing unit 51 identifies an area where there is a change based on the identified predetermined time point.
Thereby, in the imaging device 1, an index can be easily generated by specifying a region having a change based on a predetermined time point.

The index is an index serving as a reference for evaluating the motion of the object.
Thereby, in the imaging device 1, the motion of the object can be evaluated.

The auxiliary line setting processing unit 51 identifies an area where there is a change between a plurality of image data in a plurality of areas corresponding to a predetermined action among a series of actions of the object.
Thereby, in the imaging device 1, the area | region with a change between several image data can be pinpointed efficiently.

The series of movements of the object is a golf swing movement.
Thereby, in the imaging device 1, the golf swing motion index can be generated.

The auxiliary line setting processing unit 51 generates an index based on a standard simulating a predetermined state of the object.
Thereby, in the imaging device 1, since an index is generated based on a standard imitating a predetermined state of an object, an accurate index can be generated.

  In addition, this invention is not limited to the above-mentioned embodiment, The deformation | transformation in the range which can achieve the objective of this invention, improvement, etc. are included in this invention.

  In the above-described embodiment, the moving image is exemplified as the processing target image. However, for example, a continuously shot image may be used as the processing target image.

  In the above-described embodiment, the club head in a stationary state of the takeback straight line is extracted and used as the starting point of the auxiliary line. However, the present invention is not limited to this. For example, a ball may be extracted and used as the starting point of the auxiliary line.

  In the above-described embodiment, the auxiliary line is set and the swing is evaluated using the same moving image. For example, the auxiliary line is set by swinging in advance for setting the auxiliary line. The swing to be evaluated can be evaluated in real time. And when an evaluation result is good or bad, it can comprise so that it may alert | report with a sound.

In the above-described embodiment, the position of the club head may be highlighted and the error location may be displayed in the frame determined to be abnormal. In the above-described embodiment, the type and volume of the warning may be changed depending on the position or amount (distance from the auxiliary line) that protrudes from the detection area.
Further, the type and volume of the warning may be changed depending on the type of swing at the time of protruding from the detection area.

  In the above-described embodiment, the sound is notified / warned as an example. However, the present invention is not limited to this, and it is sufficient that the sound / warning is performed by means that can be perceived by humans. Notification / warning can be performed by light caused by vibration, vibration caused by vibration, or the like.

In the above-described embodiment, the imaging apparatus 1 to which the present invention is applied has been described using a digital camera as an example, but is not particularly limited thereto.
For example, the present invention can be applied to general electronic devices having a swing evaluation result notification processing function. Specifically, for example, the present invention can be applied to a notebook personal computer, a printer, a television receiver, a video camera, a portable navigation device, a mobile phone, a smartphone, a portable game machine, and the like.

The series of processes described above can be executed by hardware or can be executed by software.
In other words, the functional configuration of FIG. 4 is merely an example, and is not particularly limited. That is, it is sufficient that the imaging apparatus 1 has a function capable of executing the above-described series of processing as a whole, and what functional block is used to realize this function is not particularly limited to the example of FIG.
In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.

When a series of processing is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only constituted by the removable medium 31 of FIG. 1 distributed separately from the apparatus main body in order to provide the program to the user, but also in a state of being incorporated in the apparatus main body in advance. It is comprised with the recording medium etc. which are provided in this. The removable medium 31 is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, a magneto-optical disk, or the like. The optical disc is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disc), a Blu-ray (registered trademark) Disc (Blu-ray Disc), and the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. In addition, the recording medium provided to the user in a state of being preliminarily incorporated in the apparatus main body includes, for example, the ROM 12 in FIG. 1 in which a program is recorded, the hard disk included in the storage unit 19 in FIG.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.

  As mentioned above, although several embodiment of this invention was described, these embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalent scope thereof.

The invention described in the scope of claims at the beginning of the filing of the present application will be appended.
[Appendix 1]
An acquisition means for acquiring a plurality of image data obtained by imaging a series of actions of an object;
A dividing unit for dividing each of the plurality of image data acquired by the acquiring unit into a plurality of regions;
A first specifying unit for specifying a region having a change between the plurality of image data from the plurality of regions;
Generating means for generating an index to be superimposed on any of the plurality of image data with reference to the area specified by the first specifying means;
An image processing apparatus comprising:
[Appendix 2]
An extraction means for extracting a plurality of regions having a change between the plurality of image data from the plurality of regions;
The first specifying unit specifies a region away from the object in a predetermined direction as the region having the change among the plurality of regions extracted by the extracting unit.
The image processing apparatus according to appendix 1, wherein:
[Appendix 3]
The first specifying means specifies a region farthest from the object in a predetermined direction among regions having a plurality of changes.
The image processing apparatus according to Supplementary Note 2, wherein
[Appendix 4]
Setting means for setting a partial area common to each of the plurality of image data acquired by the acquisition means;
Second specifying means for specifying a predetermined time point from a plurality of time points that have changed between partial areas between the plurality of image data set by the setting means;
With
The first specifying unit specifies a region having the change based on a predetermined time point specified by the second specifying unit.
The image processing apparatus according to any one of supplementary notes 1 to 3, wherein
[Appendix 5]
The index is an index serving as a reference for evaluating the motion of the object.
The image processing apparatus according to any one of appendices 1 to 4, wherein
[Appendix 6]
The first specifying means specifies a region where there is a change between the plurality of image data in the plurality of regions corresponding to a predetermined operation among a series of operations of the object.
The image processing apparatus according to any one of appendices 1 to 5, wherein:
[Appendix 7]
The series of motions of the object is a golf swing motion.
The image processing apparatus according to any one of supplementary notes 1 to 6, wherein:
[Appendix 8]
The generating means generates the index based on a standard imitating a predetermined state of the object.
The image processing apparatus according to any one of appendices 1 to 7, wherein
[Appendix 9]
An acquisition step of acquiring a plurality of image data obtained by imaging a series of movements of an object;
A dividing step of dividing each of the plurality of image data acquired by the acquiring step into a plurality of regions;
A specifying step of specifying a region having a change between the plurality of image data from the plurality of regions;
A generation step of generating an index to be superimposed on any of the plurality of image data with the region specified in the specifying step as a reference;
An image processing method comprising:
[Appendix 10]
Acquisition means for acquiring a plurality of image data obtained by imaging a series of movements of an object;
A dividing means for dividing each of the plurality of image data acquired by the acquiring means into a plurality of regions;
A specifying means for specifying a region having a change between the plurality of image data from the plurality of regions;
Generating means for generating an index to be superimposed on any of the plurality of image data with reference to the area specified by the specifying means;
A program characterized by functioning as

  DESCRIPTION OF SYMBOLS 1 ... Imaging device, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Bus, 15 ... Input-output interface, 16 ... Imaging part, 17 ... Input unit 18 ... Output unit 19 ... Storage unit 20 ... Communication unit 21 ... Drive 31 ... Removable media 51 ... Auxiliary line setting processing unit 52 ... Swing point detection processing unit, 53... Area detection unit, 54... Swing determination unit, 55 .. notification control unit, 56... Swing trajectory determination unit, 71. ..Judgment information storage unit

Claims (10)

An acquisition means for acquiring a plurality of image data obtained by imaging a series of actions of an object;
A dividing unit for dividing each of the plurality of image data acquired by the acquiring unit into a plurality of regions;
A first specifying unit for specifying a region having a change between the plurality of image data from the plurality of regions;
Generating means for generating an index to be superimposed on any of the plurality of image data with reference to the area specified by the first specifying means;
An image processing apparatus comprising: An extraction means for extracting a plurality of regions having a change between the plurality of image data from the plurality of regions;
The first specifying unit specifies a region away from the object in a predetermined direction as the region having the change among the plurality of regions extracted by the extracting unit.
The image processing apparatus according to claim 1. The first specifying means specifies a region farthest from the object in a predetermined direction among regions having a plurality of changes.
The image processing apparatus according to claim 2. Setting means for setting a partial area common to each of the plurality of image data acquired by the acquisition means;
Second specifying means for specifying a predetermined time point from a plurality of time points that have changed between partial areas between the plurality of image data set by the setting means;
With
The first specifying unit specifies a region having the change based on a predetermined time point specified by the second specifying unit.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The index is an index serving as a reference for evaluating the motion of the object.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The first specifying means specifies a region where there is a change between the plurality of image data in the plurality of regions corresponding to a predetermined operation among a series of operations of the object.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The series of motions of the object is a golf swing motion.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The generating means generates the index based on a standard imitating a predetermined state of the object.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. An acquisition step of acquiring a plurality of image data obtained by imaging a series of movements of an object;
A dividing step of dividing each of the plurality of image data acquired by the acquiring step into a plurality of regions;
A specifying step of specifying a region having a change between the plurality of image data from the plurality of regions;
A generation step of generating an index to be superimposed on any of the plurality of image data with the region specified in the specifying step as a reference;
An image processing method comprising: Acquisition means for acquiring a plurality of image data obtained by imaging a series of movements of an object;
A dividing means for dividing each of the plurality of image data acquired by the acquiring means into a plurality of regions;
A specifying means for specifying a region having a change between the plurality of image data from the plurality of regions;
Generating means for generating an index to be superimposed on any of the plurality of image data with reference to the area specified by the specifying means;
A program characterized by functioning as

Images