JP5928386B2 - Display control apparatus, display control method, and program - Google Patents

Description

  The present invention relates to a display control apparatus, a display control method, and a program for displaying a plurality of images.

  As a conventional technique, there is known a technique for performing simultaneous reproduction by multiple display with matching reproduction timings for a plurality of separately recorded moving images (for example, see Patent Document 1).

Japanese Patent Publication No. 10-304299

However, since the technique described in Patent Document 1 described above is simply a technique for automatically extracting the central region of each moving image and reproducing it by multi-display, depending on the shooting angle and position of each moving image, multi-display Even if you do it, it may be difficult to compare.
Therefore, the present invention has been made in view of the above situation, and an object thereof is to facilitate comparison of a plurality of images.

In order to achieve the above object, a display control device according to one embodiment of the present invention includes:
Acquisition means for acquiring a plurality of still images in which a series of movements of a subject are imaged;
First specifying means for specifying a region of the subject in at least one image to be corrected from the plurality of still images by a user operation;
Based on the area specified by the first specifying means, and normalization means for normalizing the at least one still image of the plurality of still images acquired by the acquisition unit,
Display control means for displaying a specific state in the series of operations of the subject in the plurality of still images including the still images normalized by the normalizing means on a display means;
It is characterized by providing.

  According to the present invention, it is possible to easily compare a plurality of images.

It is a block diagram which shows the hardware constitutions of the imaging device which concerns on embodiment of the display control apparatus of this invention. It is a functional block diagram which shows the functional structure for performing such a slide show display process among the functional structures of an imaging device. It is a figure which shows the example of a display of the output part displayed by a slide show display process. It is a schematic diagram for demonstrating an example of normalization of a state image. It is a schematic diagram which shows the production | generation of a histogram. It is a figure which shows an example which displayed the histogram with the normalized image. 3 is a flowchart illustrating a flow of a slide show display process executed by the imaging apparatus of FIG. 1 having the functional configuration of FIG. 2. It is a figure which shows an example of the normalization of an image. It is a schematic diagram for demonstrating an example of the method of normalizing an image. It is a schematic diagram for demonstrating an example of the method of normalizing an image. It is a schematic diagram for demonstrating an example of the method of normalizing an image. It is a schematic diagram for demonstrating an example of the method of normalizing an image. It is a schematic diagram for demonstrating an example of the method of normalizing an image. It is a schematic diagram for demonstrating an example of the method of normalizing an image.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings as appropriate.

FIG. 1 is a block diagram illustrating a hardware configuration of an imaging apparatus 1 according to an embodiment of the display control apparatus of the present invention.
The imaging device 1 is configured as a digital camera, for example.

  The imaging device 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, an image processing unit 14, a bus 15, an input / output interface 16, and an imaging unit. 17, an input unit 18, an output unit 19, a storage unit 20, a communication unit 21, and a drive 22.

  The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 20 to the RAM 13.

  The RAM 13 appropriately stores data necessary for the CPU 11 to execute various processes.

  The image processing unit 14 is configured by a DSP (Digital Signal Processor), a VRAM (Video Random Access Memory), and the like, and performs various image processing on image data in cooperation with the CPU 11.

  The CPU 11, ROM 12 and RAM 13 are connected to each other via a bus 15. An input / output interface 16 is also connected to the bus 15. An imaging unit 17, an input unit 18, an output unit 19, a storage unit 20, a communication unit 21, and a drive 22 are connected to the input / output interface 16.

  Although not shown, the imaging unit 17 includes an optical lens unit and an image sensor.

  The optical lens unit is configured by a lens that collects light, for example, a focus lens or a zoom lens, in order to photograph a subject. The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length within a certain range. The optical lens unit is also provided with a peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance as necessary.

The image sensor includes a photoelectric conversion element, AFE (Analog Front End), and the like. The photoelectric conversion element is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) the subject image, accumulates the image signal for a predetermined time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.
The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. Through various signal processing, a digital signal is generated and output as an output signal of the imaging unit 17.
Such an output signal of the imaging unit 17 is hereinafter referred to as “captured image data”. The captured image data is appropriately supplied to the CPU 11, RAM 13, image processing unit 14, and the like.

The input unit 18 is configured by a touch panel stacked on the display screen of the output unit 19 configured by a display, and inputs various types of information according to a user's instruction operation. The input unit 18 includes various buttons and the like, and inputs various types of information according to user instruction operations.
The output unit 19 includes a display, a speaker, and the like, and outputs images and sounds.
The storage unit 20 is configured by a hard disk, a DRAM (Dynamic Random Access Memory), or the like, and stores various image data.
The communication unit 21 controls communication with other devices (not shown) via a network including the Internet.

  A removable medium 31 composed of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 22. The program read from the removable medium 31 by the drive 22 is installed in the storage unit 20 as necessary. The removable medium 31 can also store various data such as image data stored in the storage unit 20 in the same manner as the storage unit 20.

Hereinafter, the imaging apparatus 1 of the present embodiment having the above-described functions will be described.
FIG. 2 is a functional block diagram illustrating a functional configuration for executing the slide show display process among the functional configurations of the imaging apparatus 1.
The “slide show display process” is a series of processes until an image extracted from a moving image selected from a plurality of stored moving images is adjusted to a predetermined size and sequentially displayed for each swing operation. The sequential display of images for each predetermined operation is hereinafter referred to as a slide show display. In the present embodiment in which a moving image obtained by shooting a golf swing is displayed, for example, an image including a motion symbolizing a series of swing motions is displayed along the time axis to display a slide show.
Here, “a series of swing motions” are motions including swing motions such as address, takeback, top, impact, follow, and finish.

When executing the slide show display processing, the CPU 11 includes a display range designation unit 51, an image analysis unit 52, an image extraction unit 53, a normalization unit 54, a histogram generation unit 55, and a display control unit 56. .
Note that the functions of the display range designation unit 51, the image analysis unit 52, the image extraction unit 53, the normalization unit 54, the histogram generation unit 55, and the display control unit 56 need to be mounted on the CPU 11 as in this embodiment. There is no particular limitation, and at least a part of these functions can be transferred to the image processing unit 14.

  As one area of the storage unit 20, a moving image storage unit 71, a normalized image storage unit 72, and a histogram storage unit 73 are provided.

  The moving image storage unit 71 stores moving image data such as a moving image captured by the imaging unit 17 and a moving image acquired from the outside via the communication unit 21 or the like. In the present embodiment, the moving image storage unit 71 stores moving image data obtained by shooting a golf swing from the front direction. Specifically, the moving image storage unit 71 stores a plurality of pieces of moving image data obtained by shooting a golf swing from the front direction, and having different shooting times, shooting locations, and swing subjects. .

  The normalized image storage unit 72 stores data of an image (hereinafter referred to as “normalized image”) obtained by correcting a state image extracted from a moving image according to a predetermined rule. Specifically, the normalized image storage unit 72 stores normalized image data corrected so that subjects such as a swing target person have the same size. In the normalized image storage unit 72, normalized image data in which a plurality of swing motions extracted from the moving image is specified is managed and stored for each moving image. Various information regarding the swing is added to the header of the data of the normalized image. As the swing information, the header information includes, for example, information such as the moving image shooting date and time, the name of the person to be swung, the type of club, the average head speed of the club, the ball speed, and the swing action. Such information is automatically input by image analysis or added by the user. In the present embodiment, the added swing information is an item for searching for a normalized image.

  The histogram storage unit 73 stores swing information obtained as a result of analyzing a moving image and histogram data generated based on swing information input by the user. The histogram is stored in association with the normalized image stored in the normalized image storage unit 72.

  The display range designation unit 51 designates a moving image (hereinafter referred to as “target moving image”) to be displayed as a slide show from all moving images stored in the moving image storage unit 71. The display range designating unit 51 designates a target moving image for each shooting time, name of a swing target person, and type of club, for example. The user designates the range condition of the target moving image via the input unit 18. Based on the result, the display range designation unit 51 designates the target moving image.

FIG. 3 is a diagram illustrating a display example of the output unit 19 displayed in the slide show display process.
In the display screen, a “comparison video range designation” column 100 and a “list display” column 101 are provided.
In the “comparison video range specification” column 100, items as search keys for images displayed in the “list display” column 101 are displayed, and items of each item can be selected as a pull-down menu.
In the “shooting date / time” item, the shooting date / time can be selected. In this display example, for example, a moving image having a generation time of a moving image from six months ago to the present is selected as “six months ago”.
In the “person selection” item, a person who is a storage target of a moving image can be selected from a person name. In this display example, “Taro Yamada” is selected.
In the “club designation” item, the club being used can be selected. In this display example, “driver” is selected.
In the “state” item, a swing state can be selected. In this display example, “impact” is selected. A frame of a moving image to be displayed in the “list display” column 101 is designated.
In the “parameter” item, moving image selection items other than those described above can be selected. In this display example, a “head speed” capable of selecting a moving image with a high club head speed can be selected. The item “parameter” is an item used for generating a histogram.
In the “comparison video range designation” column 100, a “display” button for instructing to search for a moving image with the above-described items is displayed. In the present embodiment, when the “display” button is selected, the target moving image is designated under the conditions of “shooting date / time”, “person selection”, “club designation”, and “state”.
Here, in the present embodiment, it is assumed that the target moving image is automatically specified by selecting the conditions of these items, but the user may arbitrarily specify the target moving image.

In the “list display” column 101, a plurality of moving images searched under the conditions specified in the “comparison video range specification” column 100 are displayed.
In this display example, nine 3 × 3 results of the search for the above-described items are displayed. Further, in this display example, since “impact” is specified in the “state” item, a frame image including “impact” is displayed among the searched moving images.
Further, the display order is displayed in the order of the shooting date and time of the moving image. The display can be performed by various methods. For example, the display can be configured in the order of “head speed” selected in the item.
That is, in the “list display” column 101, moving images that are the search results based on the items specified in the “comparison video range specification” column 100 are displayed in order of shooting date and time, and specified among the moving images. A frame corresponding to the selected state is displayed.

Returning to FIG. 2, the image analysis unit 52 performs image analysis on the target moving image, specifies a frame image including a predetermined swing motion in the moving image, and subjects (moving subjects such as balls and swing subjects) in the moving image. ).
Various methods are used for image analysis. For example, the swing can be identified from changes in the position of the person to be swung, the ball position, and the club position. That is, for swing, the address / takeback / top can be specified by the position of the swing target person, the ball position, and the transition of the club. The finish can be specified. Further, the position of the head of the swing target person can be specified by using a known face recognition technique or the like.
Further, the ball position may be limited by displaying a mark in the live view display at the time of shooting and matching the ball to the mark.
Further, the head and the ball position of the person to be swung can be specified by the user specifying the position without being automatically performed by image analysis.

  The image extraction unit 53 extracts an image of a predetermined swing operation state (hereinafter referred to as “state image”) from the moving image specified by the display range specifying unit 51. That is, the image extraction unit 53 extracts a plurality of state images including a predetermined operation from one moving image.

The normalization unit 54 generates a normalized image by performing correction (hereinafter referred to as “normalization”) that changes the state image extracted by the image extraction unit 53 according to a predetermined rule. In this embodiment, the normalization unit 54 uses all the state images so that the distance between the ball position and the position of the head of the swing target person is a predetermined distance with reference to the state image of the impact action. Perform size normalization. Thereby, it is possible to suppress difficulty in comparison between images to be compared due to variations in shooting conditions such as the distance from the camera to the subject and the physique of the swing target person. For this reason, differences other than the points to be corrected for proper comparison between images become more conspicuous, and such differences are easily recognized by the user.
In addition to the correction for changing the size according to a predetermined rule, the normalization unit 54 performs, for example, correction for changing an image according to a predetermined rule and correction for changing the position of a subject in the image according to a predetermined rule. Can do.
As described above, the normalization unit 54 can normalize the elements that can be compared with the state images extracted from the respective moving images in the swing motion of the swing target person.

FIG. 4 is a schematic diagram for explaining an example of normalization of the state image.
As shown in FIG. 4, normalization of the state image is performed, for example, because the position of the swing target person differs between the state images p <b> 1 and p <b> 2 due to the difference in the shooting position. This is done by displaying the size and angle.
In the example of FIG. 4, as indicated by the alternate long and short dash line, the position of the swing target person is different between the state images p <b> 1 and p <b> 2. Specifically, the normalization unit 54 generates a normalized image by cutting out an image with a size where the subject is located in the center and the ball can be accommodated.
The normalization in FIG. 4 can be said to correct the image based on an absolute standard.

  Returning to FIG. 2, the histogram generation unit 55 generates a histogram from swing information based on the result of image analysis by the image analysis unit 52 and information input by the user. In the present embodiment, the histogram generation unit 55 generates a histogram from the average value of the club head speeds obtained as a result of image analysis, as specified in FIG. The histogram represents an average value of club head speeds in all moving images stored in the moving image storage unit 71 as a bar graph in a predetermined speed unit, and a portion to which the normalized image belongs is visually divided by color coding or the like. It is a representation.

FIG. 5 is a schematic diagram showing generation of a histogram.
As illustrated in FIG. 5, the histogram generation unit 55 divides the target moving image for each head speed from the analysis result of the target moving image, and displays the number (frequency) of the target moving images for each head speed as a histogram. In this embodiment, the frequency at which the head speed is divided into 12 levels is represented as a histogram. Specifically, in the histogram, “35 m / s” to “50 m / s” are displayed in a bar graph format for every 1 m / s centering on a general head speed range. In the histogram for all target moving images, “frequency 1” at “38 m / s”, “frequency 2” at “39 m / s”, “frequency 4” at “40 m / s”, and “41 m / s”. “Frequency 5”, “42 m / s” “Frequency 6”, “43 m / s” “Frequency 5”, “44 m / s” “Frequency 7”, “45 m / s” “Frequency 2”, “ “Frequency 1” is displayed at “47 m / s”.

Returning to FIG. 2, the display control unit 56 controls the output unit 19 to display a list of search results searched based on the conditions specified by the display range specifying unit 51. Specifically, the display control unit 56 outputs the moving images searched under the conditions specified in the “comparison video range specification” column 100 of FIG. 3 so as to display a list in the “list display” column 101. The unit 19 is controlled.
Further, the display control unit 56 controls the output unit 19 so as to sequentially display the normalized images in the designated state stored in the normalized image storage unit 72 at a predetermined timing to display a slide show. At this time, the display control unit 56 controls the output unit 19 to display a histogram corresponding to the normalized images displayed in a list among the histograms stored in the histogram storage unit 73 together with the normalized images.

FIG. 6 is a diagram illustrating an example in which a histogram is displayed together with the normalized image.
In the example of FIG. 6, a histogram is displayed in the lower right corner of the normalized image. Further, the displayed histogram is displayed with different colors in the range to which the normalized image belongs. As a result, the user can visually determine how much the displayed normalized image is in the target moving image, that is, how much the evaluation of the swing displayed by the normalized image is in the whole. Can be recognized.

Next, a slide show display process executed by the imaging apparatus 1 having the functional configuration shown in FIG. 2 will be described with reference to FIG.
FIG. 7 is a flowchart illustrating the flow of a slide show display process executed by the imaging apparatus 1 of FIG. 1 having the functional configuration of FIG.

  The slide show display process is started when the user performs an operation to start the slide show display process on the input unit 18.

  In step S <b> 1, a target moving image is designated from all moving images stored in the moving image storage unit 71. For example, as shown in FIG. 3, the display range designation unit 51 designates a target moving image for each shooting time, the name of a swing target person, and the type of club. The display range designation unit 51 designates a range to be extracted as a normalized image.

  In step S2, the image analysis unit 52 analyzes the target moving image. That is, the image analysis unit 52 analyzes the target moving image specified by the display range specifying unit 51. In the present embodiment, the moving image is analyzed to identify the club head speed of the target moving image, the ball position of the target moving image, the head position of the target moving image in the swing target person, and the state image in the target moving image. To do.

  In step S <b> 3, the image extraction unit 53 extracts a state image from the analysis result of the image analysis unit 52. In other words, the image extraction unit 53 extracts a state image in which the motion of the swing target person is a motion such as address, top, impact, and finish from the target moving image.

In step S4, the normalization unit 54 normalizes the extracted state image. That is, the normalization unit 54 performs correction for matching the size, angle, and position for each state image so that the images can be easily compared.
For example, as illustrated in FIG. 4, the normalization unit 54 corrects the position of the swing target person in each state image to be the center of the image so that the position of the swing target person in each state image matches. I do.

  In step S <b> 5, the histogram generation unit 55 generates a histogram schematically showing the variance of the predetermined parameter. The histogram generation unit 55 calculates the variance of all moving images from predetermined parameters obtained by analyzing each moving image, and thus belongs to which class of variance the parameters of the state image of each moving image to be displayed belong to. Generate a histogram that displays.

In step S6, the display control unit 56 performs a slide show display. That is, the display control unit 56 performs a slide show display by sequentially switching the normalized image for each moving image. Thereby, in the output part 19, each image is sequentially displayed at a predetermined timing. In addition, since the output unit 19 displays a normalized image in which the position and size of the swing target person, which is the subject, are unified, the difference in operation becomes clear and it differs from other moving images with different shooting conditions. Comparison is easy.
In addition, when displaying a slide show, a histogram corresponding to the displayed normalized image may be displayed so as to be superimposed on the corner of the normalized image. In this case, specifically, an image in which histograms are arranged at the corners of the image as in the example of FIG. 6 is displayed.
In this embodiment, as shown in FIG. 6, a histogram corresponding to the displayed normalized image is displayed in a superimposed manner at the corner of the normalized image while the slide show is being displayed.

  Therefore, in the imaging apparatus 1, by reducing the difference in the shooting conditions, only the difference due to the swing operation can be clearly displayed, and the comparison of the state images can be facilitated.

Next, another example of image normalization will be described.
FIG. 8 is a diagram illustrating an example of image normalization.
In the embodiment described above, the normalization of the image is configured so that, for example, the position of the swing subject is centered. In this example, image normalization from a viewpoint different from the above-described embodiment will be described.

In the example of FIG. 8A, by correcting the distance between the head position of the swing target person and the ball position to a predetermined distance, both the shooting conditions and the physique of the swing target person are different. It is possible to perform a display in which differences in shoulder inclination, wrist position, stance center position, stance width, and the like become clearer.
Further, when performing display, it is possible to make the user recognize by displaying a histogram generated by factors such as the inclination of both shoulders, the position of the wrist, the center position of the stance, and the width of the stance.
Further, when it is desired to emphasize the difference, correction for actively cutting out the portion to be emphasized is performed. For example, when it is desired to emphasize the posture, a portion not including the club head is cut out. In addition, when it is desired to emphasize the difference of the entire swing, the part of the club transition range, that is, the position of the club head in the address state and the highest position of the club head when the club is swung up is cut out. Done.

Further, FIG. 8B is an example of normalization of an image in the case where the swing target person is photographed from the rear surface opposite to the flying ball direction, not the moving image photographed from the front as described above.
In the example of FIG. 8B, correction is performed with the ball position and the distance between the toe of the right foot in the swing target person (hereinafter referred to as “stance distance”) as a predetermined distance. Thereby, on the display screen, for example, it is possible to represent that the difference between the forward tilt angle that is the tilt of the upper body and the lie angle that is the angle created by the center line of the club shaft and the ground is more prominent.
Further, when displaying, a histogram generated with elements such as a forward tilt angle and a lie angle can be displayed to make the user more strongly aware of the difference.

Further, as shown in FIG. 8 (c), by cutting out the vicinity of the right foot of the swing target person so as to include the highest club position and the ball position, a display in which the swing plane angle that is the swing angle between the ground and the club stands out is displayed. It can be carried out.
When the display is performed, a difference generated by an element such as a swing plane angle can be displayed so that the user can recognize the difference.

Next, a method for normalizing an image by a user operation will be described. In this example, an example in which two normalized images are displayed side by side will be described.
9 to 14 are schematic diagrams for explaining an example of a method for normalizing an image.
In FIG. 4, the two state images are corrected based on the absolute reference, but FIGS. 9 to 14 are corrected so that one image corresponds to the other image. That is, normalization in FIGS. 9 to 14 can be said to correct the image based on relative criteria.
In the example shown in FIGS. 9 to 14, two normalized images are displayed side by side. The image A displayed on the left side is an image of a professional photographed image, and the image B displayed on the right side is an image B. An image of an amateur is used. The user normalizes the amateur image based on the professional image. That is, the image B is corrected based on the image A.
The user can arbitrarily designate the reference image, but it can also be automatically designated by analyzing the image by the image analysis unit 52 in FIG. For example, an image having a superior measurement result can be designated as an image based on the head speed measured by analyzing the image. The name of the person to be swung described in the header information may be determined and designated based on the image of a specific person.

FIG. 9 is a diagram illustrating an image normalization method for changing the inclination of the swing target person.
As a method for normalizing an image, first, the user designates a line through which the toe of the image A passes through the input unit 18. By specifying in this way, a broken line is formed as shown in FIG. When this broken line is confirmed in the image B, it can be seen that the broken line and the toe of the swing target person are shifted.
Since the broken line and the toe of the swing target person are shifted, the user designates both the toes of the swing target person. As a result, a thick line is formed as shown in FIG. Next, the user designates the end portion of the thick line (in this embodiment, the end portion on the left toe side on the broken line). Thereby, the rotation center at the time of rotating a swing subject for normalization is determined. Finally, the user performs an operation for executing image normalization processing, thereby generating a normalized image in which the toe of the swing target person in the image B matches the broken line as shown in the lower part.
Note that when the normalized image is generated, as shown in the lower image B, the numerical value of the change in angle may be shown. Further, when the numerical value of the angle change is displayed, the auxiliary line such as a broken line may be deleted after a predetermined time, and the numerical value of the angle change may be displayed as it is.

FIG. 10 is a diagram illustrating another method for normalizing an image that changes the inclination of the swing target person.
The example of FIG. 10 is the same in that the inclination of the swing target person is changed, but unlike the example of FIG. 9, the image normalization process is executed by performing an operation of dragging and dropping the image. Thus, the imaging device 1 is configured.
That is, in the example of FIG. 10, by specifying both toes serving as the reference for changing the angle and correcting the angle of the image of the swing target person in the image B to the reference image A, the swing of the image A A normalized image that matches the angle of the subject is generated. When the normalized image is generated, the changed angle value is displayed for a certain period on the image B side where the angle has been changed.

FIG. 11 is a diagram illustrating another method of normalizing an image for changing the inclination of the swing target person.
In the example of FIGS. 9 and 10, the angle is changed based on the specified swing target person's tilt location and the reference image. However, in the example of FIG. 11, the degree of change in angle is handwritten by the user. Change the angle specified by.
Specifically, after designating the inclination location of the person to be swung, the degree of change in angle is input by handwriting, and the angle is changed by recognizing the handwriting as text. Recognizing handwritten text is indicated by displaying the handwritten text in a predetermined font.

FIG. 12 is a diagram illustrating an image normalization method for changing the position of the swing target person.
In the example of FIG. 12, the position of the swing target person in the image B is changed to the same coordinates as the position of the swing target person based on the ball in the image A.
Specifically, when it is desired to move the swing target person to the same position as the image A around the ball position, the ball position is specified for each of the image A and the image B, and the swing target person of the image B By moving the image to the image A, the position of the person to be swung in the image B becomes the same position as the coordinates of the image A. At this time, the value of the movement amount is displayed on the image B for a certain period.

FIG. 13 is a diagram illustrating an image normalization method for changing the scale of the swing target person in the height direction.
In FIG. 13, the length from the toe to the head of the person to be swung is different between the image A and the image B, as indicated by the broken line in the upper part. Therefore, as shown in the middle row, by designating the part (head and toe) whose length is to be matched and moving the image of the swing target person of the image B to the reference image A, as shown in the lower row, It is possible to generate a normalized image in which the lengths from the toe to the head of the swing target person match. At this time, the scale ratio of the image B is displayed on the image B for a certain period.

FIG. 14 is a diagram showing another image normalization method for changing the scale of the swing target person in the height direction.
FIG. 14 is the same as the method of FIG. 11. After the portion to be scaled is designated, the scale ratio is input by handwriting, and the handwriting is recognized as text, whereby the scale ratio is changed. That the handwritten input is recognized as text is identified and shown by displaying the handwritten input in a predetermined font of the text.

The imaging device 1 configured as described above includes a normalization unit 54 and a display control unit 56.
The normalizing unit 54 normalizes at least one image area in the plurality of images.
The display control unit 56 causes the output unit 19 to display a plurality of images including the images normalized by the normalization unit 54.
Thereby, in the imaging device 1, since the image which normalized the area | region of the at least 1 image in a some image is displayed, a several image can be compared easily.

In addition, the normalization unit 54 corrects each image so that any one of the position, size, and angle of the region of each image in the plurality of images is a predetermined position, size, and angle. Normalize.
Thereby, in the imaging device 1, the output unit 19 can display each image corrected so that any one of the position, size, and angle of the region of each image becomes a predetermined position, size, and angle. Comparison of a plurality of images can be facilitated.

In addition, the imaging apparatus 1 includes an image analysis unit 52.
The image analysis unit 52 specifies a region of each image to be corrected.
The normalization unit 54 corrects each image so that any one of the position, size, and angle of the region specified by the image analysis unit 52 is a predetermined position, size, and angle.
Thereby, in the imaging device 1, the output unit 19 can display each image corrected so that any one of the position, size, and angle of the region of each image becomes a predetermined position, size, and angle. Comparison of a plurality of images can be facilitated.

In addition, the imaging apparatus 1 includes an input unit 18.
The input unit 18 specifies a region of each image to be corrected by a user operation detected from the input unit.
The normalization unit 54 corrects each image so that any one of the position, size, and angle of the area specified by the input unit 18 is a predetermined position, size, and angle.
Thereby, in the imaging device 1, the output unit 19 can display each image corrected so that any one of the position, size, and angle of the region of each image becomes a predetermined position, size, and angle. Comparison of a plurality of images can be facilitated.

In addition, the imaging apparatus 1 includes an image analysis unit 52.
The image analysis unit 52 selects an image to be a correction reference from a plurality of images.
The normalization unit 54 corrects another image so that the image selected by the image analysis unit 52 has any one of a predetermined position, size, and angle.

Moreover, in the imaging device 1, the plurality of images are configured by using specific images extracted from a plurality of moving images.
In the imaging apparatus 1, it is possible to easily compare a plurality of moving images.

In addition, the imaging apparatus 1 includes a histogram generation unit 55.
The histogram generation unit 55 generates a histogram that serves as an index for evaluating a moving image.
The display control unit 56 causes the output unit 19 to display the histogram generated by the histogram generation unit 55 together with a plurality of images.
Thereby, in the imaging device 1, the image which recognizes the feature of an image can be provided.

The display control unit 56 causes the output unit 19 to display each image in a slide show display in which the display image is switched at a predetermined timing.
Thereby, in the imaging device 1, the comparison of a some moving image can be made easy.

The display control unit 56 displays each image on the output unit 19 in a list display.
Thereby, in the imaging device 1, the comparison of a some moving image can be made easy.

In addition, the CPU 11 acquires a plurality of moving images from another device or the like via the imaging unit 17, the storage unit 20 (moving image storage unit 71 in the present embodiment), or the communication unit 21.
The normalizing unit 54 normalizes each image in the plurality of moving images acquired by the CPU 11.
The display control unit 56 displays each image normalized by the normalization unit 54.
Thereby, in the imaging device 1, it is possible to easily compare a plurality of moving images in the acquired moving images.

  In addition, this invention is not limited to the above-mentioned embodiment, The deformation | transformation in the range which can achieve the objective of this invention, improvement, etc. are included in this invention.

  In the above-described embodiment, the generation of the histogram and the generation of the normalized image are performed at the same time, but the present invention is not limited to this. Although it can be performed sequentially as soon as the moving image is stored, the generation of the histogram and the generation of the normalized image can be performed at different timings in consideration of the processing load etc., for example, normalization when acquiring the moving image Various changes such as generation of an image and generation of a histogram during slide show display are possible.

  In the above-described embodiment, the normalization is performed after extracting the state image from the moving image, and the normalized image is generated. However, the present invention is not limited to this. For example, first, normalization may be performed, and then a state image may be extracted from the normalized moving image to generate a normalized image.

In the above-described embodiment, the normalized image extracted from each moving image is displayed as a slide show. However, the present invention is not limited to this. Each moving image may be normalized so that the corresponding frame images are sequentially displayed.
In the above-described embodiment, the case where the normalization is performed by correcting the image B on the basis of the image A has been described as an example, but the present invention is not limited thereto. That is, normalization may be performed by correcting a plurality of images on the basis of the image A, and the image A and the plurality of normalized images may be displayed side by side (list display). Thereby, the comparison of the some image normalized on the basis of one image can be performed easily.

In the above-described embodiment, the histogram using the swing speed analyzed from the moving image as a parameter is used, but the present invention is not limited to this. The histogram can use information obtained from the swing as parameters, for example, ball speed, head speed, smash factor that is the ratio of ball speed to head speed, left and right foot width, ball position in left and right foot, ball foot tip Various stances such as distance, dynamic lie angle, foreground angle, swing rhythm, horizontal distance between ball and wrist, horizontal distance between ball and head, swing plane angle, shoulder tilt angle at address, swing rhythm, etc. can be used as parameters it can.
In the above-described embodiment, the histogram is displayed together with the slide image. However, the present invention is not limited to this. For example, the quality of shots in all stored moving images is indicated by an icon or the like, or advice on swing is given. It can be configured to be indicated by text or the like.

In the above-described embodiment, as the slide show display, the normalized image generated from the frame image including the predetermined operation in the searched moving image is sequentially displayed along the time axis. However, the present invention is not limited to this. . The normalized image is not limited to a frame image including a predetermined operation, and may be configured to be generated from a frame image constituting a moving image. In this case, in the display, a moving image in which all frame images are normalized is displayed.
In addition, for example, it is conceivable to display the normalized frame images of the moving images in a display area such as the “list display” column 101 in FIG. Further, as a normalization technique, the techniques corresponding to FIGS. 9 to 14 can be applied.
Moreover, the display form should just be able to display so that an image can be compared, for example, switching the selected one image, displaying a plurality of images in a list, or displaying two images in parallel. Or a plurality of images may be displayed in an overlapping manner. In addition, when displaying a plurality of images, each image may be configured to be displayed in the same size, or each image may have a “main” and “subordinate” relationship, for example, superior An image having a result may be displayed as a “main” in a large size, and another image may be displayed as a “subordinate” in a smaller size than an image that is “main”. .
The display timing is configured to be displayed at a predetermined timing, but is not limited thereto. For example, the display of the part corresponding to the place where the comparison is desired is configured to be delayed with emphasis, or when the comparison is displayed, the part with a large difference is displayed with the emphasis delayed. May be. In addition, regarding the emphasis display, not only the difference in display speed is provided, but also an emphasis display such as changing the color around the image may be performed. It should be noted that when performing an emphasized display, a display target is determined using an image analysis result, information registered in advance, or the like.

  In the above-described embodiment, the generation of the normalized image is performed after the display target is determined. However, the present invention is not limited to this. The generation of the normalized image may be configured to be performed in advance, for example, before determining a display target such as after acquiring a moving image. With this configuration, it is possible to disperse the processing by display and the processing by image generation, so that the response in display can be made faster. On the other hand, by generating an image after determining a display target, it is not necessary to process an image that is not a display target, and it is not necessary to hold the generated image. Can be reduced.

The series of processes described above can be executed by hardware or can be executed by software.
In other words, the functional configuration of FIG. 2 is merely an example and is not particularly limited. That is, it is sufficient that the imaging apparatus 1 has a function capable of executing the above-described series of processing as a whole, and what functional blocks are used to realize this function is not particularly limited to the example of FIG.
In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.

When a series of processing is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only constituted by the removable medium 31 of FIG. 1 distributed separately from the apparatus main body in order to provide the program to the user, but also in a state of being incorporated in the apparatus main body in advance. It is comprised with the recording medium etc. which are provided in this. The removable medium 31 is composed of, for example, a magnetic disk (including a floppy disk), a Blu-ray Disc (Blu-ray disk), an optical disk, a magneto-optical disk, or the like. The optical disc is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disc), a Blu-ray Disc (Blu-ray Disc), and the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. In addition, the recording medium provided to the user in a state of being preliminarily incorporated in the apparatus main body includes, for example, the ROM 12 in FIG. 1 in which a program is recorded, the hard disk included in the storage unit 20 in FIG.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.

  As mentioned above, although several embodiment of this invention was described, these embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalent scope thereof.

The invention described in the scope of claims at the beginning of the filing of the present application will be appended.
[Appendix 1]
Normalizing means for normalizing a region of at least one image in the plurality of images;
Display control means for causing the display means to display the plurality of images including images normalized by the normalization means;
A display control apparatus comprising:
[Appendix 2]
The normalization means normalizes by correcting so that any one of the position, size, and angle of each image region in the plurality of images is a predetermined position, size, and angle.
The display control apparatus according to Supplementary Note 1, wherein
[Appendix 3]
Comprising an area specifying means for specifying the area of each image to be corrected;
The normalization unit corrects each image so that any one of the position, size, and angle of the region specified by the region specifying unit is a predetermined position, size, and angle.
The display control apparatus according to Supplementary Note 2, wherein
[Appendix 4]
User operation specifying means for specifying the region of each image to be corrected by user operation detected from the input means;
The normalization unit corrects each image so that any one of the position, size, and angle of the area specified by the user operation specifying unit is a predetermined position, size, and angle.
The display control apparatus according to Supplementary Note 2, wherein
[Appendix 5]
Image selection means for selecting an image to be a correction reference from a plurality of images,
The normalization means corrects another image so that the image selected by the image selection means has any one of a predetermined position, size, and angle;
The display control apparatus according to Supplementary Note 2, wherein
[Appendix 6]
The plurality of images are configured by using specific images extracted from a plurality of moving images,
The display control device according to any one of appendices 1 to 5, characterized in that:
[Appendix 7]
Provided with an index generating means for generating an index for evaluating an image;
The display control unit causes the display unit to display the index generated by the index generation unit together with the plurality of images.
The display control apparatus according to any one of supplementary notes 1 to 6, wherein:
[Appendix 8]
The index generation means generates the index as a histogram by analyzing a specific region of each image,
The display control means causes the display means to display the histogram together with the plurality of images.
The display control apparatus according to appendix 7, characterized by:
[Appendix 9]
The display control means displays each image on the display means in a slide show display in which display images are switched at a predetermined timing.
The display control apparatus according to any one of appendices 1 to 8, characterized in that:
[Appendix 10]
The display control means displays each image on the display means in a list display.
The display control apparatus according to any one of appendices 1 to 8, characterized in that:
[Appendix 11]
It further comprises an acquisition means for acquiring a plurality of moving images,
The normalization means normalizes each image in the plurality of moving images acquired by the acquisition means,
11. The display control apparatus according to any one of appendices 1 to 10, wherein the display control unit displays each image normalized by the normalization unit.
[Appendix 12]
A display control method executed by a display control device,
A normalizing step of normalizing at least one image region in the plurality of images;
A display control step of causing the display means to display the plurality of images including the image normalized by the normalization step;
A display control method comprising:
[Appendix 13]
Computer
Normalization means for normalizing a region of at least one image in the plurality of images;
Display control means for displaying the plurality of images including the image normalized by the normalization means on a display means;
A program characterized by functioning as

  DESCRIPTION OF SYMBOLS 1 ... Imaging device, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Image processing part, 15 ... Bus, 16 ... Input / output interface, 17 ... Image pickup unit, 18 ... input unit, 19 ... output unit, 20 ... storage unit, 21 ... communication unit, 22 ... drive, 31 ... removable media, 51 ... display Range designation unit, 52... Image analysis unit, 53... Image extraction unit, 54... Normalization unit, 55 ... Histogram generation unit, 56 ... Display control unit, 71. Storage unit 72 ... Normalized image storage unit 73 ... Histogram storage unit

Claims (14)

Acquisition means for acquiring a plurality of still images in which a series of movements of a subject are imaged;
First specifying means for specifying a region of the subject in at least one image to be corrected from the plurality of still images by a user operation;
Based on the area specified by the first specifying means, and normalization means for normalizing the at least one still image of the plurality of still images acquired by the acquisition unit,
Display control means for displaying a specific state in the series of operations of the subject in the plurality of still images including the still images normalized by the normalizing means on a display means;
A display control apparatus comprising: The normalization means corrects any of the position, size, and angle of each image in the plurality of still images so as to match a predetermined position, size, and angle.
The display control apparatus according to claim 1. Second specifying means for specifying at least one still image to be corrected from the plurality of still images;
The normalization means may be configured to select the at least one position so that any one of the position, size, and angle of at least one still image specified by the second specifying means matches any one of the predetermined position, size, and angle. Correct one image,
The display control apparatus according to claim 2. Image selection means for selecting one still image to be a predetermined reference from the plurality of still images,
The normalization means normalizes the other images of the plurality of still images the still image selected by the image selection unit as the predetermined criterion,
The display control device according to any one of claims 1 to 3, characterized in that. The normalization means, the predetermined position of the still image selected by the image selecting unit, the size, the to fit any angle multiple of the other, except for the selected still image among the still images Correct the image,
The display control apparatus according to claim 4. The plurality of still images are obtained by extracting specific images from a plurality of moving images, respectively.
The display control apparatus according to claim 1, wherein the display control apparatus is a display control apparatus. An evaluation means for evaluating the image;
Comprising index generating means for generating an index corresponding to the evaluation result by the evaluation means;
The display control means causes the display means to display the index generated by the index generation means together with at least one image of the plurality of still images.
The display control device according to claim 1, wherein the display control device is a display control device. The index generating means generates a histogram information by analyzing a specific area of each still image as the index,
The display control means displays the histogram information on the display means together with at least one still image of the plurality of still images,
The display control apparatus according to claim 7. The display control means causes the display means to display the plurality of still images in a slide show display in which display images are switched at a predetermined timing.
The display control apparatus according to claim 1, wherein the display control apparatus is a display control apparatus. The display control means causes the display means to display the plurality of still images in a list display.
The display control apparatus according to claim 1, wherein the display control apparatus is a display control apparatus. Generating means for generating auxiliary position information for comparison with another image from at least one of the plurality of still images acquired by the acquiring means;
Further comprising
The normalization means normalizes the still image based on the auxiliary position information generated by the generation means;
The display control apparatus according to claim 1. The generating means generates auxiliary position information for comparison with other still images from each of the plurality of still images acquired by the acquiring means.
The display control apparatus according to claim 11. A display control method executed by a display control device,
An acquisition step of acquiring a plurality of still images in which a series of movements of a subject are captured;
A specifying step of specifying a region of the subject in at least one image to be corrected from the plurality of still images by a user operation;
Based on the area specified by the specifying step, a normalization step of normalizing at least one still image in the obtained plurality of still images by the acquisition step,
A display control step for displaying a specific state in the series of movements of the subject in the plurality of still images including the still images normalized by the normalization step;
A display control method comprising: Computer
Acquisition means for acquiring a plurality of still images in which a series of movements of a subject are imaged;
A specifying means for specifying a region of the subject in at least one image to be corrected from the plurality of still images by a user operation;
Wherein based on the area specified by the specifying means, normalization means for normalizing the at least one still image of the plurality of still images acquired by the acquisition unit,
Display control means for causing the display means to display a specific state in the series of operations of the subject in the plurality of still images including the image normalized by the normalization means;
A program characterized by functioning as.

Images