JP7247136B2 - Image processing device, image processing method, and image processing program - Google Patents

Description

The present disclosure relates to an image processing device, an image processing method, and an image processing program.

A group photo of multiple subjects is taken continuously, a partial image (for example, a person's face) is selected from the multiple captured images that are the multiple group photos taken, the selected partial image is extracted, and the extracted part 2. Description of the Related Art A photographing device has been disclosed that combines an image with a specified portion of a reference composite image (see Patent Document 1).

A technique has been disclosed in which a subject is photographed a plurality of times, photographed images are obtained for the number of times photographed, and a moving region of the subject is detected based on a reference image set from among the photographed image group and a comparison image other than the reference image. (See Patent Document 2). In this technique, a synthetic image is generated by setting a synthetic area in a comparison image according to the detection result of the detected moving area, and synthesizing a partial image of the set synthetic area with a reference image. Japanese Patent Application Laid-Open No. 2002-200002 also exemplifies a group photograph of a plurality of people as an example of a photographed image. For example, some people's faces included in a reference image are replaced with a partial image of another photographed image. be done.

JP-A-2001-45355 JP 2014-225870 A

Japanese Patent Application Laid-Open No. 2002-200000 describes selection of partial images to be synthesized, but does not describe what kind of information the photographing device presents to the user in order for the user to select a partial image.

In the technique described in Patent Literature 2, a list of replacement candidate partial images is displayed outside a photographed image in which a plurality of subjects are captured on an operation screen for selecting a compositing area. However, in the method of displaying a list of replacement candidate partial images outside the captured image, the captured image and the replacement candidate partial images are displayed in separate display areas, making it difficult for the user to select an appropriate partial image. , there was a problem.

The present disclosure has been made in view of the circumstances described above, and aims to provide an image processing device, an image processing method, and an image processing program that allow a user to appropriately select a partial image.

An image processing apparatus of the present disclosure is an image processing apparatus including at least one processor, and the processor is a plurality of photographed images obtained by continuously photographing, each of which is a photographed image including a plurality of subjects. an operation screen for selecting an area that includes a reference captured image that is one of a plurality of captured images and that includes one of a plurality of subjects in the reference captured image; performing control to display an operation screen for performing a synthesis process of replacing the corresponding partial image with a partial image corresponding to an area of a photographed image that was photographed at a different timing than the reference photographed image among the plurality of photographed images; When one area of the reference captured image is selected on the operation screen, the partial image to be displayed in the selected area in the reference captured image is selected from among the plurality of partial images serving as replacement candidates in the plurality of captured images. Synthesis processing for selectively replacing with either is performed.

In the image processing apparatus of the present disclosure, the processor may perform control to display an operation object for selecting one partial image from a plurality of partial images as replacement candidates on the operation screen. .

Further, in the image processing device of the present disclosure, the processor may perform control to display an operation object corresponding to at least one area.

Further, in the image processing apparatus of the present disclosure, when one area is selected on the operation screen, the processor controls to display an operation object corresponding to only one selected area out of all areas of the operation screen. may be performed.

Further, in the image processing apparatus of the present disclosure, the operation object may be a seek bar for selecting one partial image from a plurality of time-series captured images.

Further, in the image processing apparatus of the present disclosure, the processor calculates an index value indicating a selection criterion for each partial image, and calculates the length of the seek bar in a direction intersecting the time-series direction as an index value indicating the selection criterion for the partial image. may be controlled to display the seek bar with a length corresponding to the size of .

Further, in the image processing apparatus of the present disclosure, the processor may calculate an index value indicating a selection criterion for each partial image, and control to further display the index value at a position corresponding to the partial image.

Further, in the image processing device of the present disclosure, the index value includes the degree of expressing any one of a plurality of emotions of the subject, the degree of focus of the subject, the blurring of the captured image, the complexion of the subject, and the like. It may be a degree, or a degree representing the posture of the subject.

Further, in the image processing device of the present disclosure, the index value is the degree of expression of any one of a plurality of emotions of the subject, and the processor selects the index value used as a selection criterion from among the plurality of emotions. A control may be performed to further display an operation object for selecting an emotion representing .

Further, the image processing method of the present disclosure obtains a plurality of photographed images obtained by continuously photographing, each of which includes a plurality of subjects, and acquires one of the plurality of photographed images. An operation screen that includes a reference shot image and allows selection of an area that includes one of a plurality of subjects in the reference shot image, wherein a partial image corresponding to the area is selected from the plurality of shot images as the reference shot. Control is performed to display an operation screen for performing a compositing process in which a partial image corresponding to an area of a captured image captured at a different timing than the image is replaced, and one area of the reference captured image is selected on the operation screen. If there is, a partial image to be displayed in the selected area in the reference captured image is selectively replaced with one of the plurality of partial images as replacement candidates in the plurality of captured images. It is executed by a processor provided in the processing device.

Further, the image processing program of the present disclosure acquires a plurality of photographed images obtained by continuously photographing, each of which includes a plurality of subjects, and acquires one of the plurality of photographed images. An operation screen that includes a reference shot image and allows selection of an area that includes one of a plurality of subjects in the reference shot image, wherein a partial image corresponding to the area is selected from the plurality of shot images as the reference shot. Control is performed to display an operation screen for performing a compositing process in which a partial image corresponding to an area of a captured image captured at a different timing than the image is replaced, and one area of the reference captured image is selected on the operation screen. If there is, a partial image to be displayed in the selected area in the reference captured image is selectively replaced with one of the plurality of partial images as replacement candidates in the plurality of captured images. It is intended to be executed by a processor provided in a processing device.

According to the present disclosure, a user can appropriately select a partial image.

1 is a block diagram showing an example of the configuration of an image processing system; FIG. It is a block diagram showing an example of hardware constitutions of an image processing device. 1 is a block diagram showing an example of a functional configuration of an image processing apparatus according to a first embodiment; FIG. FIG. 4 is a diagram showing an example of an operation screen according to the first embodiment; FIG. FIG. 4 is a diagram showing an example of an operation screen according to the first embodiment; FIG. It is a figure which shows an example of the operation screen which concerns on a modification. It is a figure which shows an example of the operation screen which concerns on a modification. 4 is a flowchart showing an example of image display processing according to the first embodiment; FIG. 11 is a block diagram showing an example of a functional configuration of an image processing apparatus according to a second embodiment; FIG. FIG. 11 is a diagram showing an example of an operation screen according to the second embodiment; FIG. 9 is a flowchart showing an example of image display processing according to the second embodiment; It is a figure which shows an example of the operation screen which concerns on a modification. It is a figure which shows an example of the operation screen which concerns on a modification.

Embodiments for implementing the technology of the present disclosure will be described in detail below with reference to the drawings.

[First Embodiment]
First, the configuration of an image processing system 10 according to this embodiment will be described with reference to FIG. As shown in FIG. 1, the image processing system 10 includes an image processing device 12 and an imaging device 14 . The image processing device 12 and the imaging device 14 can communicate with each other through at least one of wired communication and wireless communication.

The imaging device 14 includes an imaging device such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor. The photographing device 14 is capable of continuously photographing a subject. The term "continuously photographing" as used herein means photographing a subject a plurality of times at predetermined time intervals, and includes, for example, moving image photographing. Further, continuous shooting of still images may be performed instead of moving image shooting. The time intervals may be constant time intervals or different time intervals. An image obtained by photographing a subject by the photographing device 14 is hereinafter referred to as a "photographed image". Examples of the photographing device 14 include a digital camera, a smartphone with a camera function, and the like.

Next, the hardware configuration of the image processing apparatus 12 according to this embodiment will be described with reference to FIG. Examples of the image processing device 12 include smartphones, tablet terminals, personal computers, and the like.

As shown in FIG. 2 , the image processing device 12 includes a CPU (Central Processing Unit) 20 , a memory 21 as a temporary storage area, and a non-volatile storage section 22 . The image processing device 12 also includes a display 23 such as a liquid crystal display, an input unit 24 for user input, and a communication I/F (InterFace) 25 used for communication with the imaging device 14 . CPU 20 , memory 21 , storage unit 22 , display 23 , input unit 24 and communication I/F 25 are connected to bus 26 .

The storage unit 22 is realized by a HDD (Hard Disk Drive), SSD (Solid State Drive), flash memory, or the like. An image processing program 30 is stored in the storage unit 22 as a storage medium. The CPU 20 reads out the image processing program 30 from the storage unit 22 , expands it in the memory 21 , and executes the expanded image processing program 30 .

Next, a functional configuration of the image processing apparatus 12 according to this embodiment will be described with reference to FIG. As shown in FIG. 3 , the image processing device 12 includes an acquisition section 40 , a detection section 42 , a division section 44 and a display control section 46 . The CPU 20 executes the image processing program 30 to function as an acquisition unit 40 , a detection unit 42 , a division unit 44 and a display control unit 46 .

Acquisition unit 40 acquires, via communication I/F 25 , a plurality of photographed images obtained by continuously photographing a plurality of subjects by photographing device 14 , and each photographed image includes a plurality of subjects. In this embodiment, an example in which a person is applied as a subject will be described.

The detection unit 42 performs a known face detection process on the reference captured image KG (see FIG. 4), which is one of the multiple captured images acquired by the acquisition unit 40, to detect each of the plurality of subjects. face region. In this embodiment, as the reference captured image KG, the first captured image of the plurality of captured images acquired by the acquisition unit 40, that is, the first captured image in chronological order is applied. By way of example, but not by way of limitation. As the reference captured image KG, the last captured image of the plurality of captured images acquired by the acquisition unit 40 may be applied, or one captured image other than the first and last captured images may be applied. good.

The dividing unit 44 divides the reference photographed image KG into a plurality of non-overlapping areas each including a plurality of face areas detected by the detecting unit 42 . Each area divided by the dividing unit 44 is hereinafter referred to as a divided area. In this embodiment, since the plurality of captured images have the same resolution, the captured images other than the reference captured image KG can be divided into a plurality of divided areas in the same manner as the plurality of divided areas obtained from the reference captured image KG. . Also, hereinafter, a portion corresponding to the divided area of each captured image is referred to as a “partial image”.

The display control unit 46 performs control to display an operation screen SG (see FIG. 4) that includes the reference shot image KG and allows selection of a divided area that includes one of a plurality of subjects in the reference shot image KG. conduct. This operation screen SG displays a partial image BG (see FIG. 4) corresponding to the divided area, which is a partial image corresponding to the divided area of the photographed image taken at a different timing from the reference photographed image KG among the plurality of photographed images. This is an operation screen for performing composition processing for replacing with BG.

Further, when one divided area of the reference captured image KG is selected on the operation screen SG, the display control unit 46 selects a plurality of partial images BG to be displayed in the selected divided area within the reference captured image KG. Synthesis processing is performed to selectively replace any one of a plurality of partial images BG serving as replacement candidates in the captured image.

FIG. 4 shows an example of the operation screen SG. The operation screen SG is a screen including a reference photographed image KG and a seek bar SB described later superimposed on the reference photographed image KG. FIG. 4 shows an example in which four subjects are shown in each photographed image. Also, dashed lines in FIG. 4 indicate boundaries of the divided areas.

As shown in FIG. 4, the display control unit 46 displays a seek bar SB as an example of an operation object for selecting one partial image BG from a plurality of partial images BG serving as replacement candidates on the operation screen SG. to control the display. In this embodiment, the display control unit 46 performs control to display the seek bar SB corresponding to each divided area in each divided area. The example of FIG. 4 shows an example in which the seek bar SB is displayed at the bottom of each divided area. The display position of the seek bar SB may be a position other than the lower part in each divided area, a different position for each divided area, or a position outside the divided area. When the seek bar SB is displayed outside the divided area, it is preferable to display a mark, number, or the like indicating the correspondence between the seek bar SB and the divided area.

The seek bar SB is an operation object for selecting one partial image BG from a plurality of time-series captured images. In this embodiment, the time-series direction of the seek bar SB is the horizontal direction of the operation screen SG. The user selects the partial image BG of the divided area to be replaced by moving the slider SD of any one of the seek bars SB in the time-series direction, and selects one of the plurality of partial images BG as replacement candidates. do. The plurality of partial images BG as replacement candidates here means the same division of each of the plurality of captured images captured at different timings than the partial image BG being displayed on the operation screen SG (that is, selected by the slider SD). A partial image BG corresponding to the area. That is, the position of the slider SD on the seek bar SB indicates the shooting timing of the shot image including the selected partial image BG among the plurality of time-series shot images.

The display control unit 46 performs synthesis processing to replace the partial image BG being displayed on the operation screen SG with the partial image BG selected by the slider SD of the seek bar SB. Note that the display control unit 46 may perform image processing for smoothing the boundary portions of the divided images on the operation screen SG so as to make them inconspicuous after the synthesizing processing.

The selected partial image BG is switched in conjunction with the operation of the slider SD. As a result, as shown in FIG. 5, the user can select, for example, the partial image BG in which all the subjects are smiling the most by moving the slider SD of the seek bar SB in the horizontal direction. In FIG. 5, the position of the slider SD is different from that in FIG. 4, and the partial image BG in FIG. 4 is replaced. In this embodiment, while moving the slider SD of the seek bar SB in the left-right direction, the user displays a synthesized image in which the partial image BG is replaced in accordance with the position of the slider SD within the operation screen SG by the synthesizing process by the display control unit 46. can be visually recognized. As a result, the user can appropriately select the partial image BG.

Note that, as shown in FIG. 6, the display control unit 46 does not have to display the seek bar SB when none of the divided areas is selected on the operation screen SG. In this case, as shown in FIG. 7, when one divided area is selected on the operation screen SG, the display control unit 46 displays only one divided area selected among all the divided areas of the operation screen SG. Control is performed to display the corresponding seek bar SB. FIG. 7 shows an example in which the upper left divided area is selected. Examples of operations for the user to select a divided area in this embodiment include an operation of tapping any position within the divided area, an operation of moving the cursor to any position within the divided area, and an operation previously assigned to a divided area. For example, an operation of inputting the assigned number from the keyboard.

Next, the operation of the image processing device 12 according to this embodiment will be described with reference to FIG. The image display processing shown in FIG. 8 is executed by the CPU 20 executing the image processing program 30 . The image display process is executed, for example, when the user inputs an execution instruction via the input unit 24 .

In step S10 of FIG. 8, the acquiring unit 40 acquires a plurality of photographed images obtained by continuously photographing a plurality of subjects with the photographing device 14, each of which includes a plurality of subjects. Obtained via F25. In step S12, as described above, the detection unit 42 performs known face detection processing on the reference captured image KG, which is one of the plurality of captured images acquired in step S10, to obtain a plurality of images. Detect each face region of the subject.

In step S14, the dividing unit 44 divides the reference photographed image KG into a plurality of non-overlapping divided areas each including the plurality of face areas detected in step S12, as described above. In step S16, as described above, the display control unit 46 displays the operation screen SG that includes the reference shot image KG and allows selection of a divided area that includes one of the plurality of subjects in the reference shot image KG. Control the display.

In step S18, the display control unit 46 waits until the user's operation on the operation screen SG displayed in step S16 is accepted. When the user performs an operation on the operation screen SG via the input unit 24, the determination in step S18 becomes a positive determination, and the process proceeds to step S20.

In step S20, the display control unit 46 determines whether or not the operation received in step S18 is the operation of the slider SD on the seek bar SB. If this determination is affirmative, the process proceeds to step S22.

In step S22, the display control unit 46 performs the synthesizing process of replacing the partial image BG of the divided area corresponding to the seek bar SB operated by the user with the partial image BG corresponding to the position of the slider SD, as described above. When the process of step S22 ends, the process returns to step S18.

On the other hand, if the operation accepted in step S18 is an operation to end the display of the operation screen SG, the determination in step S20 becomes a negative determination, and the image display process ends. Note that the display control unit 46 may perform control to store the composite image being displayed on the operation screen SG in the storage unit 22 at the timing of receiving the display end operation. Further, for example, the display control unit 46 may perform control to display a save button for the user to instruct saving of the composite image being displayed in the operation screen SG.

As described above, according to the present embodiment, the partial image BG to be displayed in the divided area within the reference captured image KG is selected from among the plurality of partial images BG as replacement candidates among the plurality of captured images. Synthesis processing is performed to replace the Therefore, the user can appropriately select a partial image.

[Second embodiment]
A second embodiment of the disclosed technology will be described. Note that the configuration of the image processing system 10 and the hardware configuration of the image processing apparatus 12 according to the present embodiment are the same as those of the first embodiment, so descriptions thereof will be omitted.

A functional configuration of the image processing apparatus 12 according to the present embodiment will be described with reference to FIG. Note that functional units having the same functions as the functional units of the image processing apparatus 12 according to the first embodiment are denoted by the same reference numerals, and descriptions thereof are omitted. As shown in FIG. 9, the image processing device 12 includes an acquisition unit 40, a detection unit 42, a division unit 44, a display control unit 46A, and a calculation unit 48. The CPU 20 executes the image processing program 30 to function as an acquisition unit 40 , a detection unit 42 , a division unit 44 , a display control unit 46A, and a calculation unit 48 .

The calculator 48 calculates an index value indicating a selection criterion for each partial image BG. In the present embodiment, the degree of enjoyment of the subject (hereinafter referred to as "enjoyment level") is used as the index value as the degree of expression of any one of a plurality of emotions (e.g., emotions) of the subject. An applied example will be described. Specifically, the image processing device 12 uses a face region of each subject in each captured image and a trained model obtained by AI (Artificial Intelligence) technology such as deep learning to perform The degree of enjoyment of each subject is calculated. As this trained model, for example, there is a deep neural network that takes an image of a person's face region as input and outputs the degree of enjoyment of the subject. Note that the index value indicating the selection criteria for each partial image BG may be the degree of expression of the subject's emotion other than the degree of enjoyment, or may be the degree of focus of the subject. The index value indicating the selection criteria for each partial image BG may be a value representing blurring of the captured image, a degree of complexion of the subject, or a degree representing the posture of the subject (for example, when the subject is facing forward). degree of presence) may be used.

The display control unit 46A has the following functions in addition to the functions of the display control unit 46 according to the first embodiment. As shown in FIG. 10, the display control unit 46A calculates the length of each partial image BG in a direction (vertical direction in the example of FIG. 10) that intersects (perpendicularly in this embodiment) the time series direction of the seek bar SB. Control is performed to display the seek bar SB with a length corresponding to the size of the index value calculated by the unit 48 . FIG. 10 shows an example in which the higher the degree of enjoyment calculated for each partial image BG of each captured image, the longer the length of the seek bar SB at the position corresponding to the capturing timing of that captured image. As a result, the user can easily grasp the magnitude of the index value, and as a result, can easily select, for example, the partial image BG with the highest degree of enjoyment.

Next, the operation of the image processing device 12 according to this embodiment will be described with reference to FIG. The image display processing shown in FIG. 11 is executed by the CPU 20 executing the image processing program 30 . The image display process is executed, for example, when the user inputs an execution instruction via the input unit 24 . Steps in FIG. 11 that execute the same processing as in FIG. 8 are given the same step numbers and descriptions thereof are omitted.

In FIG. 11, step S16A is executed instead of step S16 of FIG. 8, and step S15 is executed between step S14 and step S16A.

In step S15 of FIG. 11, the calculator 48 calculates an index value indicating a selection criterion for each partial image BG, as described above. In step S16A, as described above, the display control unit 46A displays the operation screen SG that includes the reference shot image KG and allows selection of a divided area that includes one of the plurality of subjects in the reference shot image KG. Control the display. At this time, the display control unit 46A sets the length of the seek bar SB in the direction intersecting the time-series direction to a length corresponding to the size of the index value calculated in step S15 for each partial image BG, and displays the seek bar SB. Control the display.

As described above, according to this embodiment, the same effects as those of the first embodiment can be obtained.

In the above-described second embodiment, the display control unit 46A further displays an operation object for selecting an emotion representing an index value used as a selection criterion for each partial image BG from among a plurality of emotions of the subject. may be controlled. In this case, the display control unit 46A displays buttons BT for selecting emotions shown in FIG. 12 as an example of an operation object. By designating the button BT, the user can switch the emotion representing the index value used as the selection criterion for each partial image BG. In this form example, the calculator 48 calculates, as the index value, the degree of expression of the emotion of the subject designated by the operation of the button BT. Also, in this embodiment, the length of the seek bar SB in the direction intersecting with the time-series direction may be a constant length as in the first embodiment.

Further, in the second embodiment, as shown in FIG. 13, the display control unit 46A sets the index value calculated by the calculation unit 48 for the partial image BG corresponding to each divided area to the position corresponding to the partial image BG. may be controlled to display further. FIG. 13 shows an example in which numbers representing index values are displayed on the upper right of the divided areas corresponding to the partial images BG. Further, in the example of FIG. 13, the display control unit 46A normalizes the index value to a value between 0 and 100, and performs control to display the pie chart together with the numbers representing the index value. Also, in this embodiment, the length of the seek bar SB in the direction intersecting with the time-series direction may be a constant length as in the first embodiment.

Also, in each of the above-described embodiments, the case of replacing the partial image BG corresponding to each divided area has been described, but the present invention is not limited to this. Alternatively, only the face area of the partial image BG containing each subject may be replaced.

Further, in each of the above-described embodiments, for example, hardware of a processing unit (processing unit) that executes various processes such as the acquisition unit 40, the detection unit 42, the division unit 44, the display control units 46 and 46A, and the calculation unit 48 As a suitable structure, the following various processors can be used. As described above, the various processors include, in addition to the CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units, circuits such as FPGA (Field Programmable Gate Array) are manufactured. Programmable Logic Device (PLD), which is a processor whose configuration can be changed, ASIC (Application Specific Integrated Circuit), etc. Circuits, etc. are included.

One processing unit may be composed of one of these various processors, or a combination of two or more processors of the same type or different types (for example, a combination of multiple FPGAs, a combination of a CPU and an FPGA). combination). Also, a plurality of processing units may be configured by one processor.

As an example of configuring a plurality of processing units with a single processor, first, as represented by computers such as clients and servers, a single processor is configured by combining one or more CPUs and software. There is a form in which a processor functions as multiple processing units. Secondly, as typified by System On Chip (SoC), etc., there is a form of using a processor that realizes the functions of the entire system including multiple processing units with a single IC (Integrated Circuit) chip. be. In this way, the various processing units are configured using one or more of the above various processors as a hardware structure.

Furthermore, as the hardware structure of these various processors, more specifically, an electric circuit (circuitry) in which circuit elements such as semiconductor elements are combined can be used.

Further, in each of the above-described embodiments, the image processing program 30 has been pre-stored (installed) in the storage unit 22, but the present invention is not limited to this. The image processing program 30 is provided in a form recorded in a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), and a USB (Universal Serial Bus) memory. good too. Also, the image processing program 30 may be downloaded from an external device via a network.

10 image processing system 12 image processing device 14 photographing device 20 CPU
21 memory 22 storage unit 23 display 24 input unit 25 communication I/F
26 bus 30 image processing program 40 acquisition unit 42 detection unit 44 division unit 46, 46A display control unit 48 calculation unit BG partial image BT button KG reference captured image SB seek bar SD slider SG operation screen

Claims (8)

An image processing device comprising at least one processor,
The processor
Obtaining a plurality of photographed images obtained by continuously photographing, each of which includes a plurality of subjects,
An operation screen that includes a reference captured image that is one of the plurality of captured images and is capable of selecting an area that includes one of the plurality of subjects in the reference captured image, wherein the area display an operation screen for performing a synthesizing process of replacing a partial image corresponding to the area with a partial image corresponding to the area of a photographed image taken at a timing different from the reference photographed image among the plurality of photographed images. take control,
On the operation screen, one partial image is selected from the plurality of time-series captured images as an operation object for selecting one partial image from among the plurality of partial images that are candidates for replacement. control to display the seek bar for
In controlling the display of the seek bar, an index value indicating a selection criterion for each partial image is calculated, and the length of the seek bar in a direction intersecting the time-series direction is set to the magnitude of the index value indicating the selection criterion for the partial image. Control to display the seek bar with a length according to
When one area of the reference captured image is selected on the operation screen, the partial image displayed in the selected area within the reference captured image is a candidate for replacement among a plurality of captured images. 1. An image processing device that performs composition processing for selectively replacing any one of a plurality of partial images. The image processing apparatus according to claim 1 , wherein the processor controls display of the operation object corresponding to at least one of the areas. The processor, when one of the areas is selected on the operation screen, controls to display the operation object corresponding to only one of the areas selected from among all areas of the operation screen. 3. The image processing apparatus according to 2 . 4. The image processing apparatus according to any one of claims 1 to 3, wherein the processor performs control to further display the index value at a position corresponding to the partial image. The index value is a degree of expression of any one of a plurality of emotions of the subject, a degree of focus of the subject, a value indicating blurring of a captured image, a degree of complexion of the subject, or 5. The image processing apparatus according to any one of claims 1 to 4, wherein the degree is one of degrees representing posture. the index value is a degree of expression of any one of a plurality of emotions of the subject;
6. The processor according to any one of claims 1 to 5 , wherein the processor performs control to further display an operation object for selecting an emotion representing the index value used as a selection criterion from among the plurality of emotions. The described image processing device. Obtaining a plurality of photographed images obtained by continuously photographing, each of which includes a plurality of subjects,
An operation screen that includes a reference captured image that is one of the plurality of captured images and is capable of selecting an area that includes one of the plurality of subjects in the reference captured image, wherein the area display an operation screen for performing a synthesizing process of replacing a partial image corresponding to the area with a partial image corresponding to the area of a photographed image taken at a timing different from the reference photographed image among the plurality of photographed images. take control,
On the operation screen, one partial image is selected from the plurality of time-series captured images as an operation object for selecting one partial image from among the plurality of partial images that are candidates for replacement. control to display the seek bar for
In controlling the display of the seek bar, an index value indicating a selection criterion for each partial image is calculated, and the length of the seek bar in a direction intersecting the time-series direction is set to the magnitude of the index value indicating the selection criterion for the partial image. Control to display the seek bar with a length according to
When one area of the reference captured image is selected on the operation screen, the partial image displayed in the selected area within the reference captured image is a candidate for replacement among a plurality of captured images. An image processing method in which a processor included in an image processing apparatus executes a synthesis process for selectively replacing any one of a plurality of partial images. Obtaining a plurality of photographed images obtained by continuously photographing, each of which includes a plurality of subjects,
An operation screen that includes a reference captured image that is one of the plurality of captured images and is capable of selecting an area that includes one of the plurality of subjects in the reference captured image, wherein the area display an operation screen for performing a synthesizing process of replacing a partial image corresponding to the area with a partial image corresponding to the area of a photographed image taken at a timing different from the reference photographed image among the plurality of photographed images. take control,
On the operation screen, one partial image is selected from the plurality of time-series captured images as an operation object for selecting one partial image from among the plurality of partial images that are candidates for replacement. control to display the seek bar for
In controlling the display of the seek bar, an index value indicating a selection criterion for each partial image is calculated, and the length of the seek bar in a direction intersecting the time-series direction is set to the magnitude of the index value indicating the selection criterion for the partial image. Control to display the seek bar with a length according to
When one area of the reference captured image is selected on the operation screen, the partial image displayed in the selected area within the reference captured image is a candidate for replacement among a plurality of captured images. An image processing program for causing a processor included in an image processing apparatus to perform a synthesis process for selectively replacing any of a plurality of partial images.

Images