JP5884755B2 - Image processing apparatus, image processing method, and program - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

  2. Description of the Related Art Conventionally, there has been disclosed a technique capable of displaying a user's own form image in sports such as golf or tennis swing or baseball batting form side by side with a sample image such as a professional form image ( For example, see Patent Document 1).

JP 2007-313362 A

However, for example, in a golf swing, the orientation differs between a right-handed form image and a left-handed form image. For this reason, when a dominant hand such as a professional appearing in an image to be compared is different from the user, images with different orientations are displayed side by side, so that the user cannot easily compare the images.
Here, although it is desirable that the images to be compared face in the same direction, it is not easy for a left-handed user to obtain an image showing a left-handed professional form as a sample image.
Such a situation is the same not only in a golf swing image but also in a comparison with images in which different subjects with different directions may be shown.

  The present invention has been made in view of such circumstances, and it is an object of the present invention to allow a user to easily compare subjects in an image regardless of the orientation of the subject. To do.

In order to achieve the above object, an image processing apparatus according to an aspect of the present invention includes:
As a trigger instruction to register an image in a predetermined folder, and orientation determining means for determining the orientation of a specific subject that is part within the image,
Orientation adjusting means for adjusting the orientation of the image based on the determination result of the orientation determining means;
Control means for performing control to register the image whose orientation has been adjusted by the orientation adjustment means in the predetermined folder;
It is characterized by providing.

  According to the present invention, it is possible for the user to easily compare the subjects in the image regardless of the orientation of the subject.

1 is a block diagram illustrating a hardware configuration of an image processing apparatus according to an embodiment of the present invention. It is a functional block diagram which shows an example of the functional structure for performing an image orientation alignment process among the functional structures of the image processing apparatus of FIG. It is a figure which shows an example of two moving images which are the two moving images of the processing target of the image processing apparatus of FIG. It is a figure which shows an example of two moving images after the direction of a to-be-photographed object was equalized by the image processing apparatus of FIG. It is a schematic diagram which shows a mode that two moving images by which direction was arrange | positioned were arranged in parallel on the display of the image processing apparatus of FIG. 2, and 2 screen simultaneous reproduction | regeneration is performed. FIG. 4 is a schematic diagram illustrating a state in which two moving images having the same orientation are sequentially reproduced on one screen of a display of the output unit 18. 3 is a flowchart illustrating a flow of image orientation alignment processing executed by an image processing apparatus having the functional configuration of FIG. 2. FIG. 3 is a functional block diagram illustrating an example of a functional configuration for executing an image orientation alignment process out of the functional configuration of the image processing apparatus of FIG. 1, which is an example different from FIG. 2. It is a schematic diagram which shows the specific result of the image orientation alignment process which the image processing apparatus which has a functional structure of FIG. 8 performs. It is a flowchart explaining the flow of the image orientation alignment process which the image processing apparatus which has a functional structure of FIG. 8 performs.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a block diagram showing a hardware configuration of the image processing apparatus 1 according to the first embodiment of the present invention.
The image processing apparatus 1 is configured as a digital camera, for example.

  The image processing apparatus 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an imaging unit 16, and an input unit. 17, an output unit 18, a storage unit 19, a communication unit 20, and a drive 21.

  The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 19 to the RAM 13.

  The RAM 13 appropriately stores data necessary for the CPU 11 to execute various processes.

  The CPU 11, ROM 12, and RAM 13 are connected to each other via a bus 14. An input / output interface 15 is also connected to the bus 14. An imaging unit 16, an input unit 17, an output unit 18, a storage unit 19, a communication unit 20, and a drive 21 are connected to the input / output interface 15.

  The imaging unit 16 images a subject and supplies a digital signal (image signal) of an image including the image of the subject (hereinafter referred to as “captured image”) to the CPU 11. Here, the digital signal (image signal) of the captured image is appropriately referred to as “captured image data”.

The input unit 17 includes various buttons and the like, and inputs various types of information according to user instruction operations.
The output unit 18 includes a display, a speaker, and the like, and outputs images and sounds.

The storage unit 19 is composed of a hard disk, a DRAM (Dynamic Random Access Memory), or the like, and stores various image data.
The communication unit 20 controls communication performed with other devices (not shown) via a network including the Internet.

  A removable medium 31 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 21. The program read from the removable medium 31 by the drive 21 is installed in the storage unit 19 as necessary. The removable medium 31 can also store various data such as image data stored in the storage unit 19 in the same manner as the storage unit 19.

FIG. 2 is a functional block diagram showing a functional configuration for executing the image orientation alignment processing according to the first embodiment among the functional configurations of such an image processing apparatus 1.
Here, the image orientation alignment processing according to the first embodiment refers to the following series of processing.
In other words, in the present embodiment, a moving image in which a predetermined person (a user of the image processing apparatus 1 for simplicity of explanation here) is performing a golf swing motion is a reproduction target. Hereinafter, such a moving image is referred to as a “reproduction target moving image”.
In addition, in this embodiment, not only a moving image to be reproduced, but also a moving image that shows a person who is a model such as a professional golfer is performing a golf swing motion as a moving image to be compared with the moving image. It becomes a target. Hereinafter, such a moving image is referred to as a “model moving image”.
In other words, in this embodiment, the playback target video and the model video are arranged in parallel on the display of the output unit 18 to perform two-screen simultaneous playback, or after either one of the moving images is played, Sequential reproduction is performed such that a moving image is reproduced.
In general, a user compares a moving image (reproduction target video) that shows the user's own form with a moving image (example video) that shows the form of a good person such as a professional. Check. Thereby, a user's golf swing improves.
Here, in a sport involving a swing such as golf, the direction of the swing varies depending on the dominant hand of the player. For this reason, when a right-handed person takes a golf swing from the front, a golf club (part of the subject) rotates from left to right (hereinafter referred to as “right-facing video”). Is called). On the other hand, when a left-handed person is taking a golf swing from the front, a movie in which the golf club rotates and moves from right to left (hereinafter referred to as a “left-facing movie”). ) Is obtained.
In general, the ratio of right-handed is overwhelmingly high and the ratio of left-handed is small. For this reason, when the user is left-handed, it is preferable that both the reproduction target video shown by the user and the model video showing professionals are left-facing videos. It is very difficult.
Therefore, in the present embodiment, the image processing apparatus 1 determines the orientation of a subject such as a person included in a plurality of images (for example, a moving image of a golf form), that is, if the moving image is a golf form, for example, it is directed leftward. It is discriminated whether it is a moving image or a right-facing moving image. Then, the image processing apparatus 1 causes the output unit 18 to display and output a plurality of images that are uniformly aligned in a predetermined direction and whose orientations are uniformly aligned based on the determination results.

In the CPU 11, when the execution of the image orientation processing according to the first embodiment is controlled, the main control unit 41, the user operation reception unit 42, the image selection unit 43, the orientation determination unit 44, and the orientation adjustment unit 45 and the display control unit 46 function.
As one area of the storage unit 19, an image storage unit 51 is provided. The image storage unit 51 stores data of a plurality of moving images that are candidates for a model moving image and data of a plurality of moving images that are candidates for reproduction. The image storage unit 51 may store data of captured images captured in the past by a predetermined imaging device including devices other than the image processing device 1, or the imaging unit 16 of the image processing device 1. In some cases, data of a captured image captured immediately before may be stored.
Further, the model moving image or the candidate data to be reproduced is not particularly limited to moving image data, and may be an aggregate of a plurality of still image data by so-called continuous shooting, or a golf form moment. It may be still image data that shows a typical state. However, for convenience of description, in the following description, it is assumed that the model moving image or the data to be played back is moving image data.

  The main control unit 41 performs overall control of the image processing apparatus 1, particularly various control associated with image orientation alignment processing in FIG. 5 described later. Details of the control of the main control unit 41 will be described later with reference to FIG.

The user operation accepting unit 42 accepts the content of an operation on the input unit 17 by the user.
For example, the user operates the input unit 17 to select at least two or more moving images to be compared from a plurality of moving images stored in the image storage unit 51. Specifically, for example, the user operates the input unit 17 to select a playback target moving image and a model moving image that are targets of simultaneous playback of two screens. In this case, the user operation reception unit 42 receives the selection result.
Further, for example, the user operation accepting unit 42 accepts a user operation on the input unit 17 for instructing whether or not to align the direction of the moving image in a predetermined direction and in which direction to align.

  The image selection unit 43 selects two or more moving images to be compared from among a plurality of moving image data stored in the image storage unit 51 based on the user operation content received by the user operation receiving unit 42. Select the data. Specifically, for example, when two-screen simultaneous playback is performed, each data of a playback target moving image and a model moving image is selected.

The orientation determination unit 44 is a specific subject included in each of the two or more moving images selected by the image selection unit 43, specifically, for example, when a two-screen simultaneous reproduction is performed, each of a reproduction target moving image and a model moving image. Determine the direction of.
As a method for discriminating the orientation, the following method is adopted in the present embodiment. In other words, in the present embodiment, each of the plurality of moving image data stored in the image storage unit 51 includes information that can specify the orientation of a specific subject, for example, information that indicates the dominant hand of a specific subject (hereinafter, “ Assume that “handedness information” is associated in advance. The association method is not particularly limited, but in the present embodiment, the dominant hand information is assumed to be associated with the data of each moving image as metadata. That is, when a moving image is captured, a dominant hand of a specific subject is input by an operation of a photographer or the like, so that dominant hand information is generated as metadata and stored in association with the data of the moving image. . In this embodiment, the handed hand information includes information indicating that the specific subject is right-handed (hereinafter referred to as “right-handed information”) and information indicating that the specific subject is left-handed (hereinafter referred to as “right-handed information”). There are two types of "left-handed information".
Therefore, the orientation determination unit 44 determines the orientation of a specific subject by referring to the dominant hand information associated with each of the two or more moving images selected by the image selection unit 43.
Specifically, for example, when two-screen simultaneous playback is performed, it is assumed that left-handed information is associated with a reproduction target moving image, while right-handed information is associated with a model moving image. In this case, the orientation determination unit 44 determines that the playback target video is a left-facing video, while determining that the model video is a right-facing video.
Further, the orientation determination unit 44 determines the orientation of a specific subject in the image with priority over the orientation of other subjects in the image.

Note that the direction determination method by the direction determination unit 44 is not particularly limited to the method of the present embodiment, and various methods such as the following methods may be employed.
For example, the orientation determination unit 44 may automatically determine the dominant hand of a specific subject included in each moving image by analyzing each data of two or more moving images selected by the image selection unit 43.
As a method for automatically determining the dominant hand, for example, when adopting a device that can automatically analyze the swing, a method of automatically determining the dominant hand by automatically detecting the movement of the shaft of a specific subject. Can be adopted. In this case, the orientation determination unit 44 can easily determine the orientation of the specific subject in both the rear shooting and the front shooting of the specific subject.
In addition, for example, when an apparatus capable of automatically detecting a ball is employed, a method of automatically determining a dominant hand such as performing rearward shooting and determining the direction of a specific subject based on the position of the ball can be employed. .
Similarly, when adopting a device that can automatically detect the ball, a method that automatically detects the dominant hand, such as taking a front shot and determining the direction of a specific subject by detecting the direction of the ball flying. can do.
Even when such a direction determination method is employed, the dominant hand information is associated with the data of each moving image in the same manner as the determination method of the present embodiment.

  The direction adjustment unit 45 performs adjustment to align two or more moving images selected by the image selection unit 43 in a predetermined direction based on the determination result of the direction determination unit 44.

Here, referring to FIG. 3 and FIG. 4, when two-screen simultaneous playback is performed, right-handed information is associated with the playback target video, while left-handed information is associated with the model video. A specific example of the processing of the orientation adjustment unit 45 will be described using the above-described example.
FIG. 3 shows an example of two moving images in a state where the orientation of a specific subject is different.
FIG. 4 shows an example of two moving images after the orientation of a specific subject is aligned.

As shown in FIG. 3, the moving image Ma is composed of a plurality of frames including frames Fa1, Fa2, and Fa3 in which each moment of a right-handed professional golf form is shown. It is assumed that the moving image Ma is a model moving image and is determined as a right-facing moving image by the direction determination unit 44.
On the other hand, the moving image Mb is composed of a plurality of frames including frames Fb1, Fb2, and Fb3 in which each moment of the left-handed user's golf form is shown. It is assumed that the moving image Mb is a moving image to be reproduced and has been determined to be a left-facing moving image by the direction determination unit 44.
As described above, in the example of FIG. 3, the orientation of the specific subject of each of the reproduction target moving image (moving image Mb) and the sample moving image (moving image Ma) is different. According to the ranking, it is determined whether to align leftward or rightward. Here, as a priority order of the alignment direction, a fixed order by default may be adopted, a priority that can be freely set by the user may be adopted, or an order that is automatically set. It may be adopted. As the automatically set order, for example, the order set based on the position of the screen at the time of display, specifically, for example, the order set according to the right or left side of the screen can be adopted. In addition, for example, it is possible to determine whether a specific subject is the user himself or another person (such as a professional) based on face recognition or a file name, and adopt an order set according to the determination result. Here, for convenience of explanation, it is assumed that the right direction is the first place and the left direction is the second place as the priority order. Assume that it has been determined that it is aligned to the right.
In this case, the direction adjustment unit 45 determines to align the right direction with the first priority. Then, the direction adjustment unit 45 performs adjustment to align the direction of the moving image whose priority is set low, that is, the direction of the moving image Mb that is the moving image to be reproduced in the left direction, to the right.
Specifically, the orientation adjustment unit 45 performs image inversion processing on the data of the left moving image Mb to generate data of the right moving image Mbr as shown in FIG. Adjustment is performed so that (moving image Ma in FIG. 4) and moving image to be reproduced (moving image Mbr in FIG. 4) are aligned to the right.
Here, as the image reversal processing, it is preferable to employ image processing for reversing the left and right images around a line passing through the midpoint in the left-right direction of the image to be processed, that is, so-called left-right reversal processing.

In order to align two or more images (here, moving images) in a predetermined direction, the image inversion processing is performed on the image data in the above examples of FIGS. 3 and 4. There is no particular limitation. That is, aligning two or more images in a predetermined direction means that if two or more images are displayed, the images are aligned in a predetermined direction. Accordingly, the timing of processing for aligning the orientation of data of two or more images (image inversion processing in the examples of FIGS. 3 and 4 described above) may be arbitrary as long as it is up to the reproduction time point. 4 may be the execution time of the process of the orientation adjustment unit 45 as in the example of FIG. 4 or may be the time when two or more images are actually displayed.
When processing for aligning the orientation is performed when two or more images selected by the image selection unit 43 are actually displayed, for example, the orientation adjustment unit 45 is identified by the orientation discrimination unit 44. Based on the orientation of the subject, identification information for identifying whether or not the processing of aligning in a predetermined direction is performed on each of the data of the two or more images. As a result, when two or more images are actually displayed, the identification information is referred to, and only the data specified by the identification information is processed among the data of the two or more images. As a result, two or more images with the same orientation can be reproduced.
Further, the processing method for aligning the orientation is not particularly limited to the image inversion processing. For example, the orientation is aligned according to whether the image is vertically or horizontally when displaying two or more images. Such a method can also be adopted.

The display control unit 46 performs control to cause the output unit 18 to display and output two or more moving images whose directions are aligned by the direction adjustment unit 45.
Note that the display control unit 46 also adds an identification display indicating that the orientation is aligned (processing has been performed) for the image to which the identification information indicating that the processing is performed by the direction adjustment unit 45 is provided. You may go. In addition, the form of the identification display is sufficient if the user can visually recognize that the directions are aligned (processed). For example, various forms such as a form for displaying a message to that effect and a form for displaying a predetermined symbol can be adopted as the form of identification display.
Here, with reference to FIG. 5 and FIG. 6, an example of two moving images with the same orientation that are reproduced on the display of the output unit 18 under the control of the display control unit 46 will be described.

FIG. 5 is a schematic diagram showing a state in which two moving images having the same orientation are arranged in parallel on the display of the output unit 18 and two-screen simultaneous reproduction is performed.
As shown in FIG. 5, in the case of two-screen simultaneous playback, a moving image Ma that is a right-handed example moving image and a moving image Mbr that is a moving image that is right-oriented (reversed horizontally) and that is a reproduction target moving image are They are arranged in parallel and played simultaneously.
As a result, the user can easily view the reproduction target moving image (moving image Mbr) and the model moving image (moving image Ma) aligned rightward while simultaneously comparing them.
Further, as shown in FIG. 5, the display control unit 46 may play back the golf swing in synchronization with each other so that the user can easily compare.

FIG. 6 is a schematic diagram illustrating a state in which two moving images having the same orientation are sequentially reproduced on one screen of the display of the output unit 18.
In the case of sequential playback, as shown in FIG. 6A, after moving image Ma that is a right-handed example moving image, moving image Mbr that is a moving-target moving image that is aligned rightward (reversed horizontally) is played back. Is done.
Accordingly, the user can easily visually recognize the model moving image (moving image Ma) aligned in the right direction and the moving image to be reproduced (moving image Mbr) in order.
Further, as shown in FIG. 6B, the display control unit 46, for each timing of a golf swing, makes a model moving image (moving image Ma) and a reproduction target moving image (moving image) so that the user can easily compare. The image Mbr) may be reproduced while being sequentially switched.

Next, an image orientation alignment process according to the first embodiment executed by the image processing apparatus 1 having the functional configuration shown in FIG. 2 will be described with reference to FIG.
FIG. 7 is a flowchart for explaining the flow of image orientation alignment processing according to the first embodiment, which is executed by the image processing apparatus 1 having the functional configuration of FIG.

  The image orientation alignment processing according to the first embodiment is started when a predetermined operation is performed on the input unit 17 by the user, and the following processing is executed.

In step S <b> 11, the image selection unit 43 selects data of the comparison image group based on the user operation content received by the user operation reception unit 42.
The comparison image group data refers to data of two or more images to be reproduced because they are compared with each other by the user among the plurality of image data stored in the image storage unit 51. In the above example, A set of data of a reproduction target moving image and a model moving image is applicable.

  In step S12, the orientation determination unit 44 determines whether or not to align the orientation of the comparison image group selected in step S11. For example, the orientation determination unit 44 determines whether or not an instruction for aligning the orientation of the image has been received based on the user operation content received by the user operation reception unit 42.

If the user has not performed an instruction to align the orientation of the images, it is determined as NO in step S12, and the process proceeds to step S17.
In step S17, the display control unit 46 causes the output unit 18 to display the comparison image group selected in step S11. In this case, the comparison image group is displayed as the original whose orientation is not aligned.
As a result, the image orientation aligning process ends.

  On the other hand, if the user has performed an instruction to align the image orientation, it is determined as YES in step S12, and the process proceeds to step S13, in which the following series of processes is performed. Is executed.

  In step S13, the orientation determination unit 44 executes a process of determining the orientation of a specific subject for each image belonging to the comparison image group selected in step S11 (hereinafter referred to as “direction determination process”). For example, the orientation determination unit 44 determines the orientation of a specific subject in each image based on dominant hand information associated with each image belonging to the comparison image group selected in step S11.

  In step S14, the orientation determination unit 44 determines whether or not the orientation of the specific subject for each image belonging to the comparison image group has been determined as a result of the orientation determination processing in step S13.

If even one of the images belonging to the comparison image group cannot be discriminated, the determination in step S14 is NO, and the process proceeds to step S16.
In step S <b> 16, the display control unit 46 displays a predetermined error message from the output unit 18.
In step S17, the display control unit 46 causes the output unit 18 to display the comparison image group selected in step S11. In this case, the comparison image group is displayed as the original whose orientation is not aligned.
As a result, the image orientation aligning process ends.

On the other hand, if the orientation of any of the images belonging to the comparison image group can be determined, it is determined as YES in Step S14, and the process proceeds to Step S15.
In step S <b> 15, the orientation adjustment unit 45 performs adjustment to align the orientations of the images belonging to the comparison image group by executing image inversion processing according to the priority order.
In step S <b> 17, the display control unit 46 causes the output unit 18 to display the comparison image group selected in step S <b> 11 and whose orientation is aligned by the image inversion processing in step S <b> 15.
As a result, the image orientation aligning process ends.

  The first embodiment has been described above. Next, a second embodiment will be described.

[Second Embodiment]
The image processing apparatus 1 according to the second embodiment can have basically the same hardware configuration as that according to the first embodiment. Therefore, FIG. 1 is also a block diagram showing a hardware configuration of the image processing apparatus 1 according to the second embodiment.

FIG. 8 is a functional block diagram showing a functional configuration for executing the image orientation alignment processing according to the second embodiment among the functional configurations of the image processing apparatus 1.
Here, the image orientation alignment processing according to the second embodiment refers to the following series of processing.
In other words, in the image orientation alignment processing according to the first embodiment, the processing for aligning the orientations of the data of the plurality of images to be compared is performed at the display timing, but the image orientation alignment according to the second embodiment. The processing is executed when data of a plurality of images to be compared is stored in a predetermined folder in the storage unit 19. Other processes are the same as those in the second embodiment and the first embodiment.
Therefore, in the CPU 11, when the execution of the image orientation alignment process according to the second embodiment is controlled, the main control unit 41, the orientation determination unit 44, and the orientation adjustment unit 45 are similar to the first embodiment. In addition to functioning, the image receiving unit 71 and the image storage control unit 72 also function.
As one area of the storage unit 19, an image storage unit 51 is provided as in the first embodiment.
Hereinafter, the functional configuration of the image processing apparatus 1 according to the second embodiment will be described only with respect to differences from the first embodiment with reference to FIG.

The image receiving unit 71 is data of a captured image (for example, a candidate for a comparison target movie) captured by the imaging unit 16 or an image (for example, a sample movie) transmitted from another device (not shown) and received by the communication unit 20. Data) is received as new registration image data.
For the new registration image data, the orientation discriminating unit 44 discriminates the orientation of a specific subject and the orientation adjusting unit 45 aligns the orientation, as in the first embodiment. Here, the direction of alignment is determined according to the priority order as in the first embodiment. As this priority order, a fixed order by default may be employed, an order that can be variably set by the user, or an order that is automatically set may be employed. The point is the same as in the first embodiment. However, in the second embodiment, as an automatic priority setting method, for example, a method of setting the one with the largest number of files, the top data, specified specific data, or the like to the first position is used. Can be adopted.
The image storage control unit 72 executes control for storing in the image storage unit 51 data of a new registration image whose orientation is aligned by the orientation adjustment unit 45.

Here, with reference to FIG. 9, an outline of the image orientation alignment processing according to the second embodiment will be described.
FIG. 9 is a schematic diagram illustrating a specific result of the image orientation alignment processing according to the second embodiment.
As illustrated in FIG. 9, it is assumed that a moving image Mc and a moving image Md are received by the image receiving unit 71 as new registration image data.
The moving image Mc is transmitted from another device (not shown) and received by the communication unit 20, for example, and includes frames Fc1, Fc2, and Fc3 in which each moment of a right-handed professional golf form is shown. Are comprised of a plurality of frames. This moving image Mc is a candidate for a model moving image, and is determined as a right-facing moving image by the direction determination unit 44.
On the other hand, the moving image Md is captured by, for example, the imaging unit 16 and includes a plurality of frames including frames Fd1 and Fd2 in which each moment of the left-handed user's golf form is captured. This moving image Md is a candidate moving image to be reproduced, and is determined as a left-facing moving image by the direction determining unit 44.
As described above, in the example of FIG. 9, the directions of the specific subjects of the moving image Mc and the moving image Md are different from each other. Decide whether to align. Here, for convenience of explanation, it is assumed that the right direction is the first place and the left direction is the second place as the priority. Assume that it has been determined that it is aligned to the right.
In this case, the direction adjustment unit 45 determines to align the right direction with the first priority. Then, the direction adjustment unit 45 performs adjustment to align the direction of the moving image set with a low priority, that is, the direction of the left moving image Md in this case, to the right.
Specifically, the orientation adjustment unit 45 performs image inversion processing (horizontal inversion processing) on the data of the left moving image Md to generate data of the right moving image Mdr as shown in FIG. Thus, an adjustment for aligning a new registration image (moving image Mc moving image Mdr) to the right is performed.

In the second embodiment as well, as in the first embodiment, the timing of processing (image inversion processing in the example of FIG. 9) for aligning the orientation of two or more image data is up to the playback time point. 9 may be arbitrary, and may be the execution time of the process of the direction adjustment unit 45 (the time stored in the folder) as in the example of FIG. 9, or the time when two or more images are actually displayed. Also good.
When processing for aligning the orientation is performed at the time when two or more images selected by the image selection unit 43 are actually displayed, for example, the orientation adjustment unit 45 is similar to the first embodiment. Identification information may be attached to each of two or more pieces of image data. That is, in this case, the identification information associated with each of the original moving images Mc and Md is stored in the folder. As a result, when two or more images are actually displayed, the identification information is referred to, and only the data specified by the identification information is processed among the data of the two or more images. As a result, two or more images with the same orientation can be reproduced.

Next, an image orientation alignment process according to the second embodiment executed by the image processing apparatus 1 having the functional configuration shown in FIG. 8 will be described with reference to FIG.
FIG. 10 is a flowchart for explaining the flow of image orientation alignment processing according to the second embodiment, which is executed by the image processing apparatus 1 having the functional configuration of FIG.

  The image orientation alignment process according to the second embodiment is started when a predetermined operation is performed on the input unit 17 by the user, and the following process is executed.

In step S <b> 31, the image receiving unit 71 determines whether or not a registration instruction for registering an image in a predetermined folder has been given by a user operation on the input unit 17.
If such a registration instruction has not been made, it is determined as NO in Step S31, and the process returns to Step S31 again. That is, until the registration instruction is given, the determination process in step S31 is repeatedly executed, and the image orientation alignment process is in a standby state.
When a new registration instruction is given, it is determined to be YES in step S31, and when the image data for which the registration instruction is given is received as new registration image data by the image receiving unit 71, the process proceeds to step S31. Proceed to S32.

In step S32, the orientation determination unit 44 determines the orientation of a specific subject with respect to a new registration image by executing orientation determination processing.
In step S33, the orientation determination unit 44 determines whether or not the orientation of the specific subject for the new registration image has been determined as a result of the orientation determination processing in step S32.

If even one of the new registration images cannot be discriminated, the determination is NO in step S33, and the process proceeds to step S36.
In step S <b> 36, the display control unit 46 displays a predetermined error message from the output unit 18.
As a result, the image orientation aligning process ends. In this case, new registration image data is not stored in the predetermined folder.

On the other hand, if the orientation of any of the new registration images can be determined, it is determined as YES in Step S33, and the process proceeds to Step S34.
In step S <b> 34, the orientation adjustment unit 45 performs adjustment to align the orientation of the new registration image by executing the image inversion processing according to the priority order.
In step S <b> 35, the image storage control unit 72 registers (stores) the new registration image data whose orientation is aligned by the orientation adjustment unit 45 in a predetermined folder in the image storage unit 51.
As a result, the image orientation aligning process ends.

As described above, the image processing apparatus 1 according to the first or second embodiment performs the adjustment including the orientation determination unit 44 and the orientation adjustment unit 45.
The orientation determination unit 44 determines the orientation of a specific subject included in the image. The direction adjustment unit 45 performs adjustment to align the image in a predetermined direction based on the direction of the specific subject determined by the direction determination unit 44.
Here, the predetermined orientation and the orientation of the specific subject determined by the orientation determination unit 44 are not directly related. In other words, any one of the orientations of the specific subject of the image may be adopted as the predetermined orientation, but it is not essential to adopt the orientation, and a direction different from the orientation of the specific subject of the image is adopted. Also good.
Thereby, for example, when a user compares himself / herself with another person (such as a professional) about a sports form, regardless of the orientation of a specific subject (self or another person) included in the image of the person or another person's sports form. Can be easily compared.

Further, a plurality of images can be determined by the determination unit 44 of the image processing apparatus 1 of the first or second embodiment.
Thereby, for example, when a user compares himself / herself with another person (such as a professional) with respect to a sports form, the subject-specific subject (self or another person) included in a plurality of images including the self and other person's sports form Regardless of the orientation, it can be easily compared.

In addition, the orientation adjustment unit 45 of the image processing apparatus 1 according to the first or second embodiment aligns the orientation of a specific subject in a plurality of images with one of the orientations determined by the orientation determination unit 44. The orientation of a plurality of images can be adjusted.
Thus, for example, when a user compares himself / herself with another person (such as a professional) with respect to a sports form, the direction of a specific subject (self or another person) included in each image is either one of himself or another person. Therefore, the comparison can be made more easily.

In addition, the orientation adjustment unit 45 of the image processing apparatus 1 according to the first or second embodiment adjusts the orientation of a specific subject in a plurality of images to either the left or right by image reversal processing. The orientation of the plurality of images can be adjusted.
This allows the user to unify the orientation of either left-handed or right-handed images, even when comparing multiple images that include a specific left-handed subject and a specific right-handed subject. In addition, since the images can be visually recognized in the aligned state, the comparison can be made more easily.

In addition, the orientation adjustment unit 45 of the image processing apparatus 1 of the first embodiment selects a plurality of images and displays them in the plurality of images when they are displayed side by side or sequentially switched on the display unit (output unit 18). It is possible to determine whether the orientations of the specific subjects are aligned and to adjust the orientations of the plurality of images so that the orientations are aligned.
Thereby, since the image processing apparatus 1 can perform processing only when display is necessary, generation of unnecessary processing can be suppressed.

  In addition, the orientation determination unit 44 of the image processing apparatus 1 according to the second embodiment can determine the orientation of the specific subject in a plurality of images stored in the storage unit 19. As a result, the image processing apparatus 1 can align the orientation in advance, so that it is possible to cope with real time when the user desires to display an image.

The image processing apparatus 1 according to the second embodiment can store the determination result determined by the orientation determination unit 44 in association with the image.
Thereby, the image processing apparatus 1 can easily determine the orientation of the subject included in the image when displaying the image.

  In addition, the orientation determination unit 44 of the image processing apparatus 1 according to the first or second embodiment determines the orientation of a specific subject based on orientation information (for example, dominant hand information) of a specific subject that is associated in advance with a plurality of images. Can be determined. As a result, the image processing apparatus 1 can reliably determine the orientation of the specific subject and does not require a separate process for determining the orientation of the specific subject, thereby reducing the processing load on the CPU and the like. Can be planned.

  In addition, the orientation adjustment unit 45 of the image processing apparatus 1 according to the first or second embodiment can determine the orientation to be aligned according to the priority order. In this way, for example, when a user compares a sports form with himself / herself and another person (such as a professional), the user compares it with his / her own form, or compares with another person (such as a professional) (example) It is possible to freely and easily select whether to do.

The image processing apparatus 1 according to the first or second embodiment further includes a display control unit 46.
The display control unit 46 can execute control for displaying an image whose orientation is adjusted by the orientation adjustment unit 45.
Thereby, the user can visually recognize the image whose direction has been changed.

In addition, the orientation adjustment unit 45 of the image processing apparatus 1 according to the first or second embodiment can give identification information to an image whose orientation has been adjusted.
Thereby, the user can easily visually recognize that the image is changed in direction.

In addition, the image processing apparatus 1 according to the first or second embodiment can execute control for identifying and displaying an image to which identification information is given by the orientation adjustment unit 45.
Thereby, the user can easily visually recognize that the image is changed in direction.

  In addition, this invention is not limited to the above-mentioned embodiment, The deformation | transformation in the range which can achieve the objective of this invention, improvement, etc. are included in this invention.

In the above-described embodiment, the orientation determination unit 44 determines the orientation of a specific subject based on dominant hand information previously associated with a plurality of images, but is not limited thereto. For example, the image is a moving image, and the direction determination unit 44 can determine the direction of the specific subject based on the direction of movement of the specific subject included in the plurality of moving images. Here, the specific subject need not be a person, and may be an object such as a golf club or a ball. As a result, the orientation determination unit 44 can determine the orientation of a specific subject based on the moving direction of the moving object, and thus can perform determination with high accuracy.
In addition, the orientation determination unit 44 can determine the orientation of a specific subject based on the positional relationship between a plurality of specific subjects and other subjects in a plurality of images. Thereby, since the direction discrimination | determination part 44 does not require the discrimination | determination process of a moving body, it can aim at reduction of the burden of processing, such as CPU.
In addition, the orientation determination unit 44 can detect a specific subject portion in the image and determine the orientation of the subject portion by image recognition processing according to the type of the subject. Thereby, since the image processing apparatus 1 can perform processing only on a specific subject portion, generation of unnecessary processing can be suppressed.
Further, the specific subject is a person, and the direction determination unit 44 can determine the direction of the specific subject based on the movement of the person in the plurality of images. Thereby, the direction discrimination | determination part 44 can discriminate | determine a person's direction easily.
Further, the orientation determination unit 44 can determine the orientation of a specific subject based on the dominant hand of the specific subject in the plurality of images. Thereby, the direction discrimination | determination part 44 can obtain a discrimination | determination result easily.

  In the above-described embodiment, the number of images whose orientations are aligned is two images selected by the user, but is not limited to this. For example, when three or more images are selected based on a user operation, the image selection unit 43 can naturally align the orientations of the three or more images.

Further, in the above-described embodiment, the image whose orientation is aligned is an image of a golf swing, but is not limited thereto, and may be an image that can change the orientation of a specific subject. For example, an image of a baseball batter's swing and an image of a boat (regatta) whose traveling direction can be varied can be adopted as images whose directions are aligned. Furthermore, the present invention is not limited to sports images, and images that can be reversed and displayed by right-handed and left-handed, such as playing a guitar, can be employed as images whose directions are aligned. Furthermore, the specific subject is not limited to a person, and may be any object that can determine the moving direction, such as a railway or a car.
In the above-described embodiment, the image whose orientation is aligned is a moving image, but is not limited thereto, and may be a still image.

In the above-described embodiment, the image processing apparatus 1 to which the present invention is applied has been described using a digital camera as an example, but is not particularly limited thereto.
For example, the present invention can be applied to general electronic devices having a display function. Specifically, for example, the present invention can be applied to a notebook personal computer, a television receiver, a video camera, a portable navigation device, a mobile phone, a smartphone, a portable game machine, and the like.

The series of processes described above can be executed by hardware or can be executed by software.
In other words, the functional configurations of FIGS. 2 and 8 are merely examples, and are not particularly limited. In other words, it is sufficient that the image processing apparatus 1 has a function capable of executing the above-described series of processes as a whole, and what functional blocks are used to realize this function is particularly the example shown in FIGS. It is not limited to.
In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.

When a series of processing is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only constituted by the removable medium 31 of FIG. 1 distributed separately from the apparatus main body in order to provide the program to the user, but also in a state of being incorporated in the apparatus main body in advance. It is comprised with the recording medium etc. which are provided in this. The removable medium 31 is composed of, for example, a magnetic disk (including a floppy disk), a Blu-ray Disc (Blu-ray disk), an optical disk, a magneto-optical disk, or the like. The optical disk is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disk), or the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. In addition, the recording medium provided to the user in a state of being preliminarily incorporated in the apparatus main body includes, for example, the ROM 12 in FIG. 1 in which a program is recorded, the hard disk included in the storage unit 19 in FIG.

In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.
Further, in the present specification, the term “system” means an overall apparatus configured by a plurality of devices, a plurality of means, and the like.

  As mentioned above, although several embodiment of this invention was described, these embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalent scope thereof.

The invention described in the scope of claims at the beginning of the filing of the present application will be appended.
[Appendix 1]
Orientation discriminating means for discriminating the orientation of a specific subject included in the image;
Orientation adjusting means for adjusting the orientation of the image based on the determination result of the orientation determining means;
An image processing apparatus comprising:
[Appendix 2]
The image processing apparatus according to appendix 1, wherein a plurality of images are discriminated by the discriminating means.
[Appendix 3]
The orientation adjusting means adjusts the orientation of the plurality of images so that the orientation of the specific subject in the plurality of images is aligned with any of the orientations determined by the orientation determining means. The image processing apparatus according to Supplementary Note 2, which is a feature.
[Appendix 4]
The orientation adjusting means adjusts the orientation of the plurality of images so that the orientation of the specific subject in the plurality of images is aligned with either the left or the right by image inversion processing. The image processing apparatus according to Supplementary Note 2 or 3.
[Appendix 5]
The orientation adjustment unit determines whether the orientation of the specific subject in the plurality of images is aligned when the plurality of images are selected and displayed side by side or sequentially switched on the display unit, The image processing apparatus according to any one of appendices 2 to 4, wherein the orientations of the plurality of images are adjusted so as to align the orientations.
[Appendix 6]
The image processing apparatus according to any one of appendices 2 to 4, wherein the orientation discriminating unit discriminates an orientation of the specific subject in a plurality of images stored in a storage unit.
[Appendix 7]
The orientation determination unit detects the specific subject portion in the image, and determines the orientation of the subject portion by image recognition processing according to the type of the subject. The image processing apparatus according to claim 1.
[Appendix 8]
The image processing apparatus according to appendix 7, wherein the discrimination result discriminated by the orientation discrimination means is stored in association with an image.
[Appendix 9]
The orientation determination unit determines the orientation of the subject based on orientation information of the specific subject that is associated in advance with the plurality of images. Image processing apparatus.
[Appendix 10]
The image is a moving image,
The orientation determination unit determines the orientation of the subject based on a direction of movement of the specific subject included in the plurality of moving images. Any one of Supplementary notes 2 to 6, Image processing apparatus.
[Appendix 11]
The orientation determination means determines the orientation of the subject based on a positional relationship between the specific subject and another subject in the plurality of images. Any one of Supplementary Notes 2 to 6 An image processing apparatus according to 1.
[Appendix 12]
The specific subject is a person,
The image processing apparatus according to any one of appendices 2 to 6, wherein the orientation determination unit determines the orientation of the specific subject based on a motion of a person in the plurality of images.
[Appendix 13]
The image processing apparatus according to appendix 12, wherein the orientation determination unit determines the orientation of the subject based on a dominant hand of a specific subject in the plurality of images.
[Appendix 14]
The image processing apparatus according to any one of appendices 1 to 10, wherein the orientation adjustment unit determines an orientation to be arranged according to priority.
[Appendix 15]
The image processing apparatus according to any one of appendices 1 to 14, further comprising display control means for executing control to display an image whose orientation is adjusted by the orientation adjustment means.
[Appendix 16]
The image processing apparatus according to any one of appendices 1 to 15, wherein the orientation adjustment unit adds identification information to an image whose orientation has been adjusted.
[Appendix 17]
The image processing apparatus according to appendix 16, wherein the display control unit executes control to identify and display the image to which the identification information is given by the orientation adjustment unit.
[Appendix 18]
An image processing method executed by an image processing apparatus for aligning the orientation of images,
An orientation determination step for determining the orientation of a specific subject included in the image;
Based on the processing result of the orientation determination step, an orientation adjustment step for adjusting the orientation of the image;
An image processing method comprising:
[Appendix 19]
Computer
Orientation discriminating means for discriminating the orientation of a specific subject included in the image;
Orientation adjusting means for adjusting the orientation of the image based on the determination result of the orientation determining means;
A program characterized by functioning as

  11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... bus, 15 ... input / output interface, 16 ... imaging unit, 17 ... input unit, 18 ... Output unit, 19 ... storage unit, 20 ... communication unit, 21 ... drive, 31 ... removable media, 41 ... main control unit, 42 ... user operation accepting unit, 43 ... Image selection unit, 44 ... orientation discrimination unit, 45 ... orientation adjustment unit, 46 ... display control unit, 51 ... image storage unit, 71 ... image reception unit, 72 ... image Memory control unit

Claims (4)

Orientation determining means for determining the orientation of a specific subject included in the image, triggered by an instruction to register the image in a predetermined folder;
Orientation adjusting means for adjusting the orientation of the image based on the determination result of the orientation determining means;
Control means for performing control to register the image whose orientation has been adjusted by the orientation adjustment means in the predetermined folder;
An image processing apparatus comprising: If the orientation can be determined by the orientation determining means, the control means adjusts the orientation of the image by the orientation adjusting means and registers it in the predetermined folder. On the other hand, if the orientation cannot be determined. , Control not to register the image in the predetermined folder,
The image processing apparatus according to claim 1 . An image processing method executed by an image processing apparatus for aligning the orientation of images,
Orientation determination processing for determining the orientation of a specific subject included in the image, triggered by an instruction to register the image in a predetermined folder;
Orientation adjustment processing for adjusting the orientation of the image based on the processing result of the orientation determination processing;
A control process for performing control for registering the image whose orientation is adjusted in the orientation adjustment process in the predetermined folder;
An image processing method comprising: To the computer that controls the image processing device that aligns the image orientation,
An orientation determination function for determining the orientation of a specific subject included in the image, triggered by an instruction to register the image in a predetermined folder;
An orientation adjustment function for adjusting the orientation of the image based on the discrimination result by the orientation discrimination function;
A control function for performing control to register the image whose orientation is adjusted by the orientation adjustment function in the predetermined folder;
A program to realize

Images