WO2012147772A1 - Image processing device, image display device, imaging device and program - Google Patents

Abstract

An image processing device is provided with: a calculation unit for calculating, on the basis of an image, an evaluation value pertaining to an attribute of a color in the image; and a generation unit for generating an insertion color, which is a switching image color inserted during the switching period when switching from display of a first image to display of a second image, on the basis of at least one of either a first color evaluation value, which is an evaluation value calculated by the calculation unit on the basis of the first image, or a second color evaluation value, which is an evaluation value calculated by the calculation unit on the basis of the second image; and a switching process unit for performing a process for inserting the switching image of the insertion color during the switching period, and switching from the first image to the second image.

Description

Image processing apparatus, image display apparatus, imaging apparatus, and program

Aspects of the present invention relate to an image processing device, an image display device, an imaging device, and a program.
This application claims priority based on Japanese Patent Application No. 2011-098188 filed on April 26, 2011, the contents of which are incorporated herein by reference.

A technique is known in which a transition process such as a fade-in process or a fade-out process is inserted when a plurality of images are switched and displayed.
For example, when two different moving images are displayed by switching, as an editing technique for inserting and connecting transition processing, a frame having the same color or its neighboring color is included in each of the two moving images. There is an editing technique that inserts and connects them (for example, see Patent Document 1).

JP 2007-184869 A

By the way, the color of the captured image varies depending on the shooting location and the type of subject. On the other hand, the color used for the fade-in process and the fade-out process when switching and displaying an image is generally black or white and other colors are rarely used. For example, when a fade-in process or fade-out process using black is inserted between a plurality of images having a reddish tint and sequentially switched and displayed, the color of the displayed image is alternately switched between red and black. As a result, the flickering of the screen increases and the user may feel uncomfortable. On the other hand, when a plurality of moving images obtained by capturing a subject that moves rapidly, such as sports and rock concerts, are sequentially switched and displayed, if black or white processing is inserted between the plurality of moving images, The feeling of dynamism that should be felt may be cut off and may be uncomfortable for the user.

Further, in the image processing apparatus disclosed in Patent Document 1, it is possible to switch between two moving images by inserting a transition process into a frame having the same color or a color near the same among the frames of the two moving images. However, this may not be applicable when the two moving images do not include the same color or its neighboring colors.

An aspect of the present invention provides an image processing device, an image display device, an imaging device, and a program that can switch images so as to reduce discomfort for the user.

An aspect of the present invention is a calculation unit that calculates an evaluation value related to a color attribute of the image based on the image, and a switching image that is inserted in a switching period when switching from the first image to the second image for display. The first color evaluation value, which is the evaluation value calculated by the calculation unit based on the first image, and the evaluation value calculated by the calculation unit based on the second image are inserted colors that are colors. A generation unit configured to generate based on at least one of the second color evaluation values, and the switching image of the insertion color is inserted during the switching period to switch from the first image to the second image. An image processing apparatus comprising: a switching processing unit that performs processing.

According to another aspect of the present invention, the image processing apparatus described above, a display unit that displays the first image and the second image, and the first image to the second image are displayed. In this case, the image display device includes a display control unit that inserts the switching image of the insertion color during the switching period and displays the inserted image on the display unit.

Also, an aspect of the present invention is an imaging device including the above-described image processing device.

According to another aspect of the present invention, a computer as an image processing apparatus displays a calculation procedure for calculating an evaluation value related to a color attribute of the image based on the image, and switches from the first image to the second image. The inserted color, which is the color of the switching image inserted in the switching period in the case of the first image, is based on the first color evaluation value, which is the evaluation value calculated based on the first image, and the second image. A generation procedure that is generated based on the calculated second color evaluation value that is the evaluation value, and the switching image of the insertion color is inserted in the switching period, and the second image is converted into the second color from the first image. A switching processing procedure for performing processing for switching to an image.

According to this aspect of the present invention, it is possible to switch images so as to reduce discomfort for the user.

It is a schematic block diagram which shows the structure of the image display apparatus by one Embodiment of this invention. It is a figure which shows an example of the process which switches a still image by a transition process. It is a figure which shows an example of the process which switches a moving image by a transition process. It is a figure which shows an example in case an intermediate color is made into an insertion color when switching an image. It is a flowchart which shows an example of the switching process which used the intermediate color as the insertion color. It is a figure which shows an example in the case of using the complementary color of an intermediate color as an insertion color when switching an image. It is a flowchart which shows an example of the switching process by the insertion color according to the magnitude | size of the motion vector of an image. It is a flowchart which shows an example of the switching process by the insertion color according to the change rate of the color of an image. It is a flowchart which shows an example of the switching process by the insertion color according to the volume of an image. It is a flowchart which shows an example of the switching process in case there is no image before or after a display image. It is a flowchart which shows an example of the switching process in the case of starting display of only one moving image. It is a flowchart which shows an example of the switching process in the case of ending display of only one moving image. It is a schematic block diagram which shows the structure of the imaging device by one Embodiment of this invention. It is a flowchart which shows an example of the process which records and switches the picked-up moving image by the insertion color. It is a figure which shows an example of the process which switches an image by a transition process. It is a figure which shows an example of the process which switches an image by a transition process. It is a figure which shows an example of the process which switches an image by a transition process. It is a figure which shows an example of the process which switches an image by a transition process.

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a schematic block diagram showing a configuration of an image display device 100 according to an embodiment of the present invention.
An image display device 100 illustrated in FIG. 1 includes an image processing device 1, a display control unit 110, a display unit 120, an external output unit 130, and a bus 10A.

The display control unit 110 causes the display unit 120 to display an image processed by the image processing apparatus 1. For example, when slide show reproduction is performed and images are sequentially switched and displayed on the image display device 100, the display control unit 110 causes the display unit 120 to display images that have undergone transition processing in the image processing device 1.
The display unit 120 is, for example, a liquid crystal display, and displays an image processed in the image processing apparatus 1 or a menu screen under the control of the display control unit 110. For example, the display unit 120 displays images by slide show reproduction. Here, the slide show reproduction means that after displaying a preset display time per image, images are sequentially switched and displayed (reproduced) by the operator or according to the recorded moving image time. Such a playback operation.
The image described in the embodiment of the present invention is a still image or a moving image.

The external output unit 130 has, for example, a pin terminal or an HDMI (High-Definition Multimedia Interface) terminal. The external output unit 130 outputs an image processed by the image processing device 1 or an image signal such as a menu screen to an external display device.
The bus 10A is connected to each unit included in the image processing apparatus 1, the display control unit 110, and the external output unit 130, and transfers image data, control signals, and the like output from each unit.

The image processing apparatus 1 includes an image processing unit 2, a storage unit 4, a buffer memory unit 5, a storage device 6, and an operation unit 7.
The image processing unit 2 reads an image stored in the storage device 6 and causes the display unit 120 to display the image via the display control unit 110. For example, the image processing unit 2 reads compressed image data (for example, image data compressed by the JPEG method) stored in the storage device 6 and generates an image that is decompressed to the image data. It is displayed on the display unit 120. Further, the image processing unit 2 reads out image data stored in the storage device 6 and converts the image (image signal) converted into an output format suitable for an external display device connected via the external output unit 130. Output.

Further, the image processing unit 2 executes slide show reproduction of the images read from the storage device 6 in response to the operation unit 7 being operated by the operator. For example, when sequentially switching a plurality of images, the image processing unit 2 calculates a color of a switching image to be inserted between images (hereinafter referred to as an insertion color) based on an evaluation value relating to a color attribute of the image before and after switching. Then, a transition process using the calculated insertion color is added to sequentially switch images. Details of the image switching processing by the image processing unit 2 will be described later.

The storage unit 4 stores predetermined image processing conditions, reproduction control conditions, display control conditions, output control conditions, and the like for controlling the image display device 100. For example, the storage unit 4 is a ROM (Read Only Memory).

The buffer memory unit 5 is used as a work area when the image processing unit 2 controls the image display device 100. The image data read from the storage device 6 is temporarily stored in the buffer memory unit 5 in the course of image processing by the image processing unit 2. The buffer memory unit 5 is, for example, a RAM (Random Access Memory).

In the storage device 6, a removable storage medium 300 such as a memory card is inserted. Image data is recorded in the storage medium 300, and the image data is read by the image processing unit 2. The storage device 6 may be configured by a hard disk device, a magneto-optical disk device, a nonvolatile memory such as a flash memory, or a combination thereof. The storage device 6 may be provided inside the image display device 100, or may be connected to the image display device 100 as an external device.

The operation unit 7 has an operation switch for an operator to input an operation to the image display device 100. For example, the operation unit 7 includes a power switch, a mode switch, a menu switch, an up / down / left / right selection switch, a confirmation switch, a cancel switch, and other operation switches. The operation unit 7 may be an input device such as a touch panel, a keyboard, or a mouse.

For example, when the operator operates the operation unit 7, a screen for selecting whether or not to execute a slide show reproduction, a screen for setting a display time per image during slide show reproduction, or a transition when switching images are displayed. A menu screen such as a screen for selecting the type of processing is displayed on the display unit 120, and a signal indicating the content selected or set is output from the operation unit 7 to the image processing unit 2.

Next, the configuration of the image processing unit 2 will be described in detail.
The image processing unit 2 includes an evaluation value calculation unit (calculation unit) 21, an insertion color generation unit (generation unit) 22, a motion vector detection unit 23, a motion vector determination unit 24, a change rate calculation unit 25, a color change determination unit 26, A volume determination unit 27 and a switching processing unit 28 are provided.

The evaluation value calculation unit 21 calculates an evaluation value related to the color attribute of the image based on the image. Here, the color attribute is a hue, brightness, saturation, or the like. For example, the evaluation value calculation unit 21 calculates the addition average value of the color data of the pixels in the image (in the frame of the image) as the evaluation value. Specifically, the evaluation value calculation unit 21 calculates an addition average value of R (red), G (green), and B (blue) data of all pixels in the image as an evaluation value. The evaluation value calculation unit 21 replaces R (red), G (green), and B (blue) data with, for example, Y, Cr, and Cb data (Y is a luminance signal, Cr and Cb are color difference signals), etc. Other data related to color attributes may be used. In addition, the evaluation value calculation unit 21 calculates the addition average value of the pixel data in a predetermined range in the image as the evaluation value instead of calculating the addition average value of the data of all the pixels in the image as the evaluation value. May be calculated as

In addition, when the image is a moving image, the evaluation value calculation unit 21 calculates the addition average value of the color data of the pixels in the frame of the moving image as an evaluation value by adding and averaging the predetermined plurality of frames.
When the image is a moving image, the evaluation value calculation unit 21 may calculate an average value of the color data of pixels in one predetermined frame of the moving image as the evaluation value. For example, when the image is a moving image, the evaluation value calculation unit 21 may calculate the addition average value of the color data of the pixels in the last frame of the moving image as the evaluation value, or the first frame of the moving image An average value of the color data of the pixels in the image may be calculated as the evaluation value.

When the images are sequentially switched and displayed on the image display device 100, the insertion color generation unit 22 performs switching when switching and displaying the image before switching (first image) and the image after switching (second image). An insertion color that is the color of the switching image inserted in the period is generated. For example, the insertion color generation unit 22 calculates the evaluation value (first color evaluation) of the image before switching (first image) calculated by the evaluation value calculation unit 21 based on the image before switching (first image). Value) and the evaluation value (second color evaluation value) of the image after switching (second image) calculated by the evaluation value calculation unit 21 based on the image after switching (second image). To generate an insertion color.

Here, in the present embodiment, for the images before and after switching, the image before switching is also described as a first image and the image after switching is described as a second image. The evaluation value of the image before switching (first image) calculated by the evaluation value calculation unit 21 is used as the first color evaluation value, and the image after switching calculated by the evaluation value calculation unit 21 (second image). ) Is also referred to as a second color evaluation value.

For example, the insertion color generation unit 22 generates a color between the first color evaluation value and the second color evaluation value (a color that is an intermediate value, a color near the intermediate value, and an intermediate color) as an insertion color. Further, the insertion color generation unit 22 calculates a complementary color (opposite color) of a color between the first color evaluation value and the second color evaluation value (a color that is an intermediate value, a color near the intermediate value, and an intermediate color). Generate as insert color.
Note that the color between the first color evaluation value and the second color evaluation value generated as the insertion color is not limited to only an intermediate value between the first color evaluation value and the second color evaluation value. The color may be in the vicinity of the intermediate value or in a wider range. The intermediate color may include a color similar to the intermediate color.
The intermediate color and the complementary color of the intermediate color are, for example, colors that are located between red and blue in the hue circle when the first color evaluation value is red and the second color evaluation value is blue. A certain purple color is an intermediate color, and a yellow-green color, which is a color opposite to the intermediate color, is a complementary color. Also, the insertion color generation unit 22 determines whether the intermediate color is used as the insertion color or the intermediate color as the insertion color depending on conditions such as an image motion vector, an image sound volume, or an image color change rate, which will be described later. Select.

The motion vector detection unit 23 detects a motion vector of the image. That is, the motion vector detection unit 23 detects the intensity of the motion of the image by detecting the motion vector. When the image is a moving image, the motion vector detection unit 23 detects a motion vector in a predetermined plurality of frames of the image. The motion vectors in the predetermined plurality of frames are motion vectors in a predetermined period of the moving image, for example, a predetermined period including the first frame of the moving image, a predetermined period including the last frame, A predetermined period of a frame or a period of all frames.

For example, the motion vector detection unit 23 detects a motion between frames of a main subject image in a moving image as a motion vector. The motion vector detection unit 23 may be set to detect a motion between frames of a background image other than the main subject image in the moving image as a motion vector. The motion vector detection unit 23 is a still image, and associates the amount of motion of the subject (for example, an amount indicating the speed or intensity of motion of the subject) with the still image when the still image is captured. If so, the associated motion amount may be detected as a motion vector. Alternatively, the motion amount when a still image is captured may be estimated from the degree of image flow of the main subject image or the background image in the still image, and the estimated motion amount may be detected as a motion vector. The method for estimating the main subject image or the background image from the image includes a method for estimating by image pattern matching, a method for estimating by a motion vector, a method for estimating by focal length information of an imaging lens, or a feature amount (large) of a subject. Well-known techniques, such as a method of estimation based on the size, shape, color, etc., can be applied.

The motion vector determination unit 24 determines whether or not the magnitude of the motion vector detected from the image by the motion vector detection unit 23 is a predetermined value or more. This predetermined value is a predetermined value for determining the intensity of image movement, and the insertion color generation unit 22 selects whether the intermediate color is the insertion color or the intermediate color is the insertion color. This is a threshold value set as a determination condition. That is, based on the magnitude of the motion vector detected by the motion vector detection unit 23, the motion vector determination unit 24 is an image with a strong motion (large motion vector size) or no motion (motion vector). It is determined whether the image is small.

When the image is a moving image, the change rate calculating unit 25 calculates the rate of change between frames of the evaluation value related to the color attribute calculated for each frame of the moving image by the evaluation value calculating unit 21. That is, the change rate calculation unit 25 calculates the intensity of the color change of the moving image by calculating the change rate of the evaluation value between frames.

The color change determination unit 26 determines whether or not the change rate calculated by the change rate calculation unit 25 is equal to or greater than a predetermined change rate. This predetermined rate of change is a predetermined value for determining the intensity of the color change of the image, and the insertion color generation unit 22 uses the intermediate color as the insertion color or the intermediate color as the insertion color. This is a threshold value set as a determination condition for selecting. That is, based on the change rate calculated by the change rate calculation unit 25, the color change determination unit 26 is a moving image with a large color change (a large change rate) or a color change is not abrupt (change rate). It is determined whether there is a moving image.

The volume determination unit 27 determines whether or not the sound associated with the image is equal to or higher than a predetermined volume. This predetermined volume is a predetermined value for determining the noise of the sound associated with the image, and the insertion color generation unit 22 uses the intermediate color as the insertion color or the intermediate color as the insertion color. It is a threshold value set as a determination condition for selecting whether to do. For example, the volume determination unit 27 determines the noise level (volume) of the sound recorded in the moving image. The volume determination unit 27 determines the noise level (volume) of the sound recorded in the still image. The sound recorded in the still image is, for example, a sound that is detected and recorded during a preset period (for example, 10 seconds after the release is pressed) when the still image is captured. The sound recorded in the still image may be a sound recorded later in association with the recorded still image.

Specifically, the volume determination unit 27 determines the maximum volume value, the average volume value, or the maximum or average volume value during a preset period of time during which the sound associated with the image is recorded. Etc., whether or not the sound volume associated with the image is equal to or higher than a predetermined sound volume is determined. Note that the sound volume determination unit 27 determines that the sound is equal to or higher than a predetermined sound volume based on, for example, a ratio of a period during which the sound associated with the image is recorded at a sound volume that exceeds a preset threshold. It may be determined whether or not.

The switching processing unit 28 inserts the switching image of the insertion color generated by the insertion color generation unit 22 during the switching period in which the first image is switched to the second image, and the first image to the second image. Process to switch to. For example, the switching processing unit 28 performs a transition process based on the insertion color as a process of switching from the first image to the second image.

When the display control unit 110 switches from the first image to the second image for display, the display control unit 110 inserts the switching image of the insertion color in the switching period and causes the display unit 120 to display the inserted image. In other words, the switching processing unit 28 performs processing for inserting the switching image of the insertion color during the switching period to switch from the first image to the second image, and based on the switching processing, the display control unit 110 performs the first processing. The display unit 120 displays the image by switching from the image to the second image. Therefore, the display unit 120 displays the first image and the second image that are switched by inserting the switching image of the insertion color in the switching period. Thereby, the image display apparatus 100 can insert and display the switching image of the insertion color (the intermediate color or the complementary color of the intermediate color) generated based on the evaluation value of the color of the image before and after the switching, and sequentially display the images. For example, the image display apparatus 100 can execute slide show reproduction in which images are sequentially switched and displayed by a transition process based on the generated insertion color (intermediate color or complementary color of the intermediate color).

In the following embodiments, a case where the transition process when switching from the first image to the second image is a fade-in process or a fade-out process will be described as an example.
FIG. 2 is a diagram illustrating an example of processing for switching still images by transition processing. FIG. 2 shows the process of fading out from the first image to the insertion color and fading in from the insertion color to the second image to switch the image, with the horizontal axis as the time axis.

In the period from time t1 to time t4 (period ST1), the switching processing unit 28 switches from the first image to the second image by the transition process. That is, the period ST1 is a transition processing period (switching period). Then, in the period from the time t1 to the time t2 (period ST2) in the period ST1, the switching processing unit 28 performs a process of fading out from the first image to the insertion color. That is, the image in the period ST2 is a composite image that is generated by the switching processing unit 28 and gradually changes from the first image to the insertion color. Next, in the period from time t2 to time t3 (period ST3), the switching processing unit 28 inserts a switching image of the insertion color. Subsequently, in a period from time t3 to time t4 (period ST4), the switching processing unit 28 executes a process of fading in the inserted color to the second image. That is, the image in the period ST4 is a composite image that is generated by the switching processing unit 28 and gradually changes from the insertion color to the second image. In this way, the switching processing unit 28 performs a process of switching from the first image to the second image, for example, by a transition process of fading out to the insertion color and fading in from the insertion color.

FIG. 3 is a diagram illustrating an example of processing for switching moving images by transition processing. FIG. 3 shows the processing for fading out from the first image to the insertion color and fading in from the insertion color to the second image to switch the image, with the horizontal axis as the time axis, as in FIG.
The difference from the still image in FIG. 2 is that, in the case of a moving image, the first image and the second image are each composed of a plurality of frame images.

For example, the evaluation value calculation unit 21 calculates the addition average value of the color data of the pixels in the last frame of the first image as the first color evaluation value, and calculates the pixel values in the first frame of the second image. The addition average value of the color data is calculated as the second color evaluation value. The last frame of the first image when calculating the first color evaluation value is the frame (n) immediately before the time t2, and is the frame before the fade-out process. Further, the first frame of the second image when calculating the second color evaluation value is the frame (1) immediately after the time t3, and is the frame before the fade-in process is performed. The insertion color generation unit 22 generates an insertion color based on the first color evaluation value and the second color evaluation value. Based on the generated insertion color, the switching processing unit 28 performs a transition process in the period ST1 as in the period ST1 of FIG.
In the fade-out process in the period ST2, the switching processing unit 28 generates a composite image that gradually changes from the first image to the insertion color for each frame. Further, in the fade-in process in the period ST4, the switching processing unit 28 generates a composite image that gradually changes from the inserted color to the second image for each frame. Thus, even when moving images are switched, the switching processing unit 28 performs a process of switching from the first image to the second image by, for example, a transition process of fading out to the insertion color and fading in from the insertion color. To do.

Hereinafter, a process in which the image display apparatus 100 including the image processing apparatus 1 generates an insertion color based on the evaluation value of the color of the image before and after switching and switches the image will be described in order by example.
<Example of setting the intermediate color as the insertion color>
FIG. 4 is a diagram illustrating an example in which an intermediate color is used as an insertion color when switching images.
The first image 30 shown in FIG. 4 is an image having a composition in which the blue sky occupies most of the area of the image.
The second image 50 is an image having a composition in which a yellow flower field occupies most of the area of the image. In the example of this image, the evaluation value calculated by the evaluation value calculation unit 21 is such that the first color evaluation value is blue (more precisely, a color close to blue) and the second color evaluation value is yellow ( More precisely, it is a color close to yellow). Then, the insertion color generation unit 22 generates green 40 (more accurately, a color close to green), which is an intermediate color between the first color evaluation value and the second color evaluation value, as the insertion color. As a result, the switching processing unit 28 fades in from the blue sky image (first image 30) to the image of green 40 (more precisely, a color close to green), and green 40 (more precisely, green). A switching process of fading out from an image of a color close to (2) to a yellow flower field image (second image 50) is performed. Here, the close color is, in other words, a similar color or a similar color.

FIG. 5 is a flowchart illustrating an example of a switching process in which the intermediate color is an insertion color. With reference to FIG. 5, the operation of the switching process by the transition process using the intermediate color as an insertion color, taking the image shown in FIG. 4 as an example, will be described.
First, the evaluation value calculation unit 21 calculates the color evaluation value of the first image and the color evaluation value of the second image before and after switching. For example, the evaluation value calculation unit 21 calculates an evaluation value indicating blue (more precisely, a color close to blue) as the first color evaluation value based on the first image 30. Further, the evaluation value calculation unit 21 calculates an evaluation value indicating yellow (more accurately, a color close to yellow) as the second color evaluation value based on the second image 50 (step S11).

Next, the insertion color generation unit 22 performs the first color evaluation based on the first color evaluation value that is the color evaluation value of the first image and the second color evaluation value that is the color evaluation value of the second image. An intermediate color that is an intermediate value between the color evaluation value and the second color evaluation value is calculated as an insertion color. For example, the insertion color generation unit 22 calculates an evaluation value indicating blue (more precisely, a color close to blue) calculated as the first color evaluation value, and yellow (more according to the color evaluation value). Precisely, green 40 (more precisely, a color close to green) that is an intermediate color with the evaluation value indicating a color close to yellow) is generated as an insertion color (step S12).

Then, the switching processing unit 28 fades out from the first image to the insertion color and fades in from the insertion color to the second image to switch the image. For example, the switching processing unit 28 fades out from a blue sky image (first image 30) to an image of green 40 (more accurately, a color close to green), and green 40 (more accurately, close to green) The image is switched by fading in from the color image to the yellow flower field image (second image 50) (step S13). Then, the display control unit 110 switches from the first image to the second image by the switching process and causes the display unit 120 to display the image.

As described above, the image processing apparatus 1 switches the image based on the color evaluation value of the image before and after switching by the transition process using the intermediate color of the color evaluation value of the image before and after switching as the insertion color. Therefore, the image display apparatus 100 can switch and display images by a transition process in which a color having a small color difference with respect to the color of the image before and after switching is used as an insertion color. Thereby, the image processing apparatus 1 can switch an image so that there is little discomfort for the user.
That is, the image display device 100 can switch and display images so that the user has less discomfort.

<Example of setting the complementary color of the intermediate color as the insertion color when the image is intensely moving>
FIG. 6 is a diagram illustrating an example in which an intermediate color is used as an insertion color when switching images.
In this figure, when the magnitude of the motion vector of the image is equal to or larger than a predetermined value (that is, when the image is intensely moving), the image processing apparatus 1 uses the first color evaluation value of the image before and after switching and the second color value. An example is shown in which switching processing is performed using a complementary color of the intermediate color with the color evaluation value as an insertion color.

A first image 60 and a second image 80 shown in FIG. 6 are moving images in which a state of a rock concert in which a subject moves strongly is captured. The first image 60 is an image that is illuminated with red illumination in the indoor space and contains a large amount of red color components in the entire image. Further, the second image 80 is an image that is illuminated with yellow illumination in the indoor space and contains a large amount of yellow color components in the entire image. In this case, the evaluation value calculated by the evaluation value calculator 21 is such that the first color evaluation value is red (more precisely, a color close to red) and the second color evaluation value is yellow (more accurately). Is a color close to yellow). Then, the inserted color generation unit 22 generates an orange color (more precisely, a color close to orange) that is an intermediate color between the first color evaluation value and the second color evaluation value.

Next, the motion vector detection unit 23 detects the motion vectors of the first image 60 and the second image 80. Then, the motion vector determination unit 24 determines that the magnitude of the motion vector detected by the motion vector detection unit 23 is equal to or greater than a predetermined value (the motion is intense). Since the inserted color generation unit 22 determines that the magnitude of the motion vector detected by the motion vector determination unit 24 is greater than or equal to a predetermined value (severe motion), the first color evaluation value and the second color evaluation value Blue 70 (more precisely, a color close to blue), which is a complementary color of orange (more precisely, a color close to orange), which is an intermediate color between and, is generated as an insertion color. As a result, the switching processing unit 28 fades in from the reddish image (first image 60) to the image of blue 70 (more precisely, a color close to blue), and blue 70 (more precisely, blue A switching process for fading out from an image of a color close to (2) to a yellowish image (second image 80) is performed.

FIG. 7 is a flowchart illustrating an example of a switching process using an insertion color according to the size of a motion vector of an image. The operation of the switching process by the transition process using the complementary color of the intermediate color as an example of the image shown in FIG. 6 as an example will be described with reference to FIG.
First, the evaluation value calculation unit 21 calculates the color evaluation value of the first image and the color evaluation value of the second image before and after switching. For example, the evaluation value calculation unit 21 calculates an evaluation value indicating red (more accurately, a color close to red) as the first color evaluation value based on the first image 60. Further, the evaluation value calculation unit 21 calculates an evaluation value indicating yellow (more precisely, a color close to yellow) as the second color evaluation value based on the second image 80 (step S21).

Next, the insertion color generation unit 22 performs the first color evaluation based on the first color evaluation value that is the color evaluation value of the first image and the second color evaluation value that is the color evaluation value of the second image. An intermediate color that is an intermediate value between the color evaluation value and the second color evaluation value is calculated. For example, the insertion color generation unit 22 calculates an evaluation value indicating red (more precisely, a color close to red) calculated as the first color evaluation value, and yellow (more according to the second color evaluation value). To be precise, an orange color (more precisely, a color close to orange) that is an intermediate color with the evaluation value indicating a color close to yellow) is calculated (step S22).

Subsequently, the motion vector detection unit 23 detects the motion vector of the first image and the motion vector of the second image (step S23). Next, the motion vector determination unit 24 determines whether the motion vector detected by the motion vector detection unit 23 from the first image or the magnitude of the motion vector detected by the motion vector detection unit 23 from the second image has a predetermined value. It is determined whether or not this is the case (whether or not the movement is intense) (step S24).

In step S24, when the motion vector determination unit 24 determines that the motion vector detected from the first image or the magnitude of the motion vector detected from the second image is greater than or equal to a predetermined value (the motion is If it is determined that the color is intense, a complementary color of an intermediate color between the first color evaluation value and the second color evaluation value is generated as an insertion color. For example, the insertion color generation unit 22 uses, as an insertion color, blue 70 (more precisely, a color close to blue) that is a complementary color of orange (more precisely, a color close to orange) that is the intermediate color calculated in step S22. Generate (step S25). That is, this is the case of the example of the insertion color shown in FIG.

On the other hand, when the motion vector determination unit 24 determines in step S24 that the motion vector detected from the first image or the motion vector detected from the second image is less than a predetermined value ( When it is determined that the movement is not intense), the intermediate color calculated in step S22 is set as the insertion color (step S26).

Then, based on the insertion color generated in step S25 or step S26, the switching processing unit 28 fades out from the first image to the insertion color, and fades in from the insertion color to the second image to switch the image ( Step S27). For example, when the magnitude of the detected motion vector is greater than or equal to a predetermined value, the switching processing unit 28 selects an image from a reddish image (first image 60) to blue 70 (more precisely, a color close to blue). And fade out from the image of blue 70 (more precisely, the color close to blue) to the yellowish image (second image 80). If the detected motion vector is smaller than the predetermined value, the switching processing unit 28 changes the reddish image (first image 60) to an orange image (more accurately, a color close to orange). Fade in, and fade out from the orange image (more precisely, the color close to orange) to the yellow image (second image 80) and switch. Then, the display control unit 110 switches from the first image to the second image by the switching process and causes the display unit 120 to display the image.

As described above, the image processing apparatus 1 switches the image by the transition process using the intermediate color of the color evaluation value of the image before and after the switching as the insertion color based on the magnitude of the motion vector of the image before and after the switching, or the intermediate color. Change whether the image is switched by the transition processing using the complementary color as the insertion color. For example, when switching and displaying an image with intense movement, the image processing apparatus 1 switches the image by a transition process using an intermediate color complementary color as an insertion color. Therefore, when switching and displaying an image with high motion (for example, an image with high motion in a rock concert or sports), the image display device 100 inserts a color having a large color difference with respect to the color of the image before and after the switching. The images can be switched and displayed by the transition process using colors. Thereby, the image display apparatus 100 can switch and display an image so that a user's feeling of dynamism is not interrupted when switching and displaying an image with intense movement.
On the other hand, when switching and displaying an image that does not move strongly, the image display apparatus 100 switches and displays the image by a transition process in which a color having a small color difference with respect to the color of the image before and after the switching is an insertion color. Can do.

<Example of setting the complementary color of the intermediate color as the insertion color when the image undergoes drastic color change>
Next, another example when the complementary color of the intermediate color is set as the insertion color when the image is switched will be described. Here, when the rate of change between frames of the evaluation value calculated for each frame of the image is equal to or higher than a predetermined rate of change (that is, when the image has a significant color change), the image processing apparatus 1 is A description will be given of an example of performing a switching process by a transition process using a complementary color of an intermediate color between the first color evaluation value of the image and the second color evaluation value as an insertion color.

For example, even in the case of a moving image in which a rock concert such as that described with reference to FIG. 6 is captured, when a subject with intense motion is captured with a small angle with respect to the angle of view, the detected motion vector The size may be smaller than a predetermined value. Even in such a case, for example, when the color of the captured moving image is drastically changed (for example, when the color of the lighting of the rock concert is changing drastically), the user is required to change the image. Therefore, it is desirable that the switching process is performed so that the dynamic feeling is not blocked. Therefore, when the rate of change between frames of the evaluation values calculated for each frame of the image is equal to or higher than a predetermined rate of change (that is, when the color changes drastically), the image processing apparatus 1 The switching process is performed with an intermediate color between the first color evaluation value of the image and the second color evaluation value as an insertion color.

FIG. 8 is a flowchart showing an example of the switching process using the insertion color in accordance with the change rate of the color of the image. The operation of the switching process using the inserted color according to the color change rate of the image will be described with reference to FIG. Steps S31, S32, and S37 in FIG. 8 are the same processes as steps S21, S22, and S27 in FIG. 7, and detailed descriptions thereof are omitted.

First, the evaluation value calculation unit 21 calculates the color evaluation value of the first image and the color evaluation value of the second image before and after the switching (step S31). Next, the insertion color generation unit 22 is an intermediate color that is an intermediate value between the color evaluation value of the first image (first color evaluation value) and the color evaluation value of the second image (second color evaluation value). Is calculated (step S32).

The change rate calculation unit 25 calculates the rate of change between frames of the color evaluation value calculated by the evaluation value calculation unit 21 for each frame of the image. For example, the rate-of-change calculator 25 calculates the color evaluation value (first color evaluation value) of the first image and the color evaluation value (second color evaluation value) of the second image between the frames. The rate of change is calculated (step S33).

Next, the color change determination unit 26 determines whether or not the change rate calculated by the change rate calculation unit 25 is equal to or greater than a predetermined change rate. For example, the color change determination unit 26 determines that the change rate calculated from the first image by the change rate calculation unit 25 or the change rate calculated from the second image by the change rate calculation unit 25 is greater than or equal to a predetermined change rate. It is determined whether or not there is (step S34).

In step S34, when the color change determination unit 26 determines that the rate of change calculated from the first image or the rate of change calculated from the second image is equal to or greater than a predetermined rate of change (color change When the color is determined to be intense), the insertion color generation unit 22 generates a complementary color of an intermediate color between the first color evaluation value and the second color evaluation value (the intermediate color calculated in step S32) as the insertion color ( Step S35).

On the other hand, when the color change determination unit 26 determines in step S34 that the change rate calculated from the first image or the change rate calculated from the second image is less than the predetermined change rate (color When it is determined that the change in color is not severe), the insertion color generation unit 22 generates an intermediate color between the first color evaluation value and the second color evaluation value (the intermediate color calculated in step S32) as the insertion color. (Step S36).

Then, based on the insertion color generated in step S35 or step S36, the switching processing unit 28 fades out from the first image to the insertion color and fades in from the insertion color to the second image to switch the image ( Step S37).

As described above, the image processing apparatus 1 switches the image by the transition process using the intermediate color of the color evaluation value of the image before and after the switching as the insertion color based on the change rate of the color of the image before and after the switching, or the intermediate color Change whether the image is switched by transition processing using the complementary color as the insertion color. For example, when switching and displaying an image with a drastic color change, the image processing apparatus 1 switches the image by a transition process using an intermediate color complementary color as an insertion color. Therefore, when switching and displaying an image with a drastic change in color (for example, an image with a drastic change in illumination color in a rock concert), the image display device 100 has a large color difference with respect to the color of the image before and after switching. Images can be switched and displayed by transition processing using the color as the insertion color. Thereby, the image display apparatus 100 can switch and display an image so that a user's feeling of dynamism is not interrupted when switching and displaying an image with a large color change.
On the other hand, when switching and displaying an image whose color change is not severe, the image display device 100 switches and displays the image by a transition process using a color having a small color difference as compared with the color of the image before and after the switching. can do.

<Example of setting the complementary color of the intermediate color as the insertion color when the sound is noisy>
Next, another example in the case where the complementary color of the intermediate color is used as the insertion color when switching images will be described. Here, when the sound associated with the image is equal to or higher than a predetermined volume (that is, when the sound is a noisy image), the image processing apparatus 1 uses the first color evaluation value of the image before and after switching and the second color. An example of performing a switching process by a transition process using a complementary color of an intermediate color with the color evaluation value as an insertion color will be described.

For example, even in the case of a moving image in which a rock concert such as that described with reference to FIG. 6 is captured, when a subject with intense motion is captured with a small angle with respect to the angle of view, the detected motion vector The size may be smaller than a predetermined value. Even in such a case, for example, when the sound of the captured moving image is noisy (for example, when the volume of the captured rock concert is high), the feeling of dynamism is interrupted for the user when switching the image. It is desirable that the switching process is performed so as not to be performed. Therefore, when the sound associated with the image is equal to or higher than the predetermined volume (that is, when the sound is a noisy image), the image processing apparatus 1 and the first color evaluation value of the image before and after switching and the second color Switching processing is performed with an intermediate color complementary to the color evaluation value as an insertion color.

FIG. 9 is a flowchart showing an example of the switching process using the insertion color according to the volume of the image. With reference to FIG. 9, the operation of the switching process using the insertion color corresponding to the volume of the image will be described. Steps S41, S42, and S47 in FIG. 9 are the same processes as steps S21, S22, and S27 in FIG. 7, and detailed descriptions thereof are omitted.

First, the evaluation value calculation unit 21 calculates the color evaluation value of the first image and the color evaluation value of the second image before and after switching (step S41). Next, the insertion color generation unit 22 is an intermediate color that is an intermediate value between the color evaluation value of the first image (first color evaluation value) and the color evaluation value of the second image (second color evaluation value). Is calculated (step S42).

The volume determination unit 27 reads out the volume of the sound associated with the first image and the volume of the sound associated with the second image from the sound data associated with each image (step S43). . Next, the volume determination unit 27 determines whether the sound associated with the first image or the sound associated with the second image is equal to or higher than a predetermined volume (step S44).

In step S44, when the sound volume determination unit 27 determines that the sound associated with the first image or the sound associated with the second image is equal to or higher than the predetermined sound volume (determined that the sound is noisy). If so, the insertion color generation unit 22 generates a complementary color of the intermediate color (intermediate color calculated in step S42) between the first color evaluation value and the second color evaluation value as the insertion color (step S45).

On the other hand, when the sound volume determination unit 27 determines in step S44 that the sound associated with the first image or the sound associated with the second image is less than the predetermined sound volume (sound is noisy). If it is determined that there is not, the insertion color generation unit 22 generates an intermediate color between the first color evaluation value and the second color evaluation value (the intermediate color calculated in step S42) as the insertion color (step S46). .

Then, based on the insertion color generated in step S45 or step S46, the switching processing unit 28 fades out from the first image to the insertion color, and fades in from the insertion color to the second image to switch the image ( Step S47).

As described above, the image processing apparatus 1 switches the image by the transition process using the intermediate color of the color evaluation value of the image before and after the switching as the insertion color based on the sound volume associated with the image before and after the switching, or Then, it is changed whether the image is switched by the transition process using the complementary color of the intermediate color as the insertion color. For example, when switching and displaying an image with a large volume of the associated sound, the image processing apparatus 1 switches the image by a transition process using an intermediate color complementary color as an insertion color. Therefore, when switching and displaying an image with a large associated sound volume (for example, a noisy sound such as a rock concert), the image display device 100 has a color that is different from the color of the image before and after the switching. Images can be switched and displayed by transition processing using a color having a large difference as an insertion color. Thereby, the image display apparatus 100 can switch and display an image so that a user's feeling of dynamism is not interrupted when switching and displaying an image with a large color change.
On the other hand, when switching and displaying an image with a low volume of the associated sound, the image display apparatus 100 displays the image by a transition process using a color having a small color difference as compared with the color of the image before and after the switching. It can be switched and displayed.

<Example when there is no image before or after the display image>
Next, an example of transition processing when there is no image before or after the display image will be described. The case where there is no image before or after the display image is as follows.
(1) A case where only one image is displayed or displayed.
(2) When starting to display the first image in the slide show reproduction.
(3) When the display of the last image in the slide show reproduction ends.
In such a case, the image display apparatus 100 inserts a color having the same value as the color evaluation value of the image or a complementary color having the same value as the color evaluation value of the image when the display of the image starts or ends. Process transition as color.

For example, when display of only one image is started or when display of the first image in slide show playback is started, there is no image before switching (first image). In this case, the image display apparatus 100 performs processing assuming that the image after switching (second image) to be displayed from now on and the first image are the same image. As a result, the first color evaluation value becomes the same as the second color evaluation value, and an intermediate color between the first color evaluation value and the second color evaluation value is a color having the same value as the second color evaluation value. become. In other words, the image display apparatus 100 can perform transition processing using a color having the same value as the color evaluation value of the image after switching (second image) to be displayed (second image) or a complementary color of the color as an insertion color.

On the other hand, when the display of only one image is finished or when the display of the last image in the slide show reproduction is finished, there is no image after switching (second image). In this case, the image display apparatus 100 performs processing on the assumption that the image before switching (first image) and the second image that are to end display are the same image. As a result, the second color evaluation value becomes the same as the first color evaluation value, and an intermediate color between the first color evaluation value and the second color evaluation value is a color having the same value as the first color evaluation value. become. In other words, the image display apparatus 100 can perform transition processing using the color having the same value as the color evaluation value of the pre-switching image (second image) from which display is to be finished, or a complementary color of the color as an insertion color.

FIG. 10 is a flowchart showing an example of the switching process when there is no image before or after the display image. With reference to FIG. 10, the operation of the switching process using the insertion color generated according to the determination result of whether or not there are images before and after the display image will be described. In this figure, an example is shown in which the insertion color generation unit 22 generates an intermediate color as the insertion color.

First, the image processing unit 2 determines whether the display image without the image before switching, the display image without the image after switching, or the display image with the image before and after switching to determine whether the display image is before or after switching. To detect (step S51). The image processing unit 2 determines whether there is an image before switching (first image) (step S52). In step S52, when it is determined that there is no image (first image) before switching (for example, when displaying the first display image or only one display image), the evaluation value calculation unit 21 The first color evaluation value and the second color evaluation value are calculated by using one image as the second image (the image after switching to be displayed from now on) (step S53).

On the other hand, if it is determined in step S52 that there is an image before switching (first image), the image processing unit 2 determines whether there is an image after switching (second image) (step S52). S54). When it is determined in step S54 that there is no image after switching (second image) (for example, when the last display image or only one display image is displayed), the evaluation value calculation unit 21 The first image evaluation value and the second color evaluation value are calculated with the second image as the same image as the first image (displayed image before switching) (step S55).

On the other hand, when it is determined in step S54 that there is an image after switching (second image) (for example, an image displayed (played back) during slide show playback, that is, an image with images before and after switching is switched. ), The first color evaluation value and the second color evaluation value are calculated from the first image (the displayed image before switching) and the second image (step S56).

Next, the insertion color generation unit 22 performs the first color evaluation value based on the first color evaluation value and the second color evaluation value calculated in step S53, step S55, or step S56 according to the determined conditions. An intermediate color between the color evaluation value and the second color evaluation value is generated as an insertion color (step S57).

Then, the switching processing unit 28 performs a process of switching images based on the insertion color generated in step S57 (step S58).
For example, when the switching processing unit 28 starts to display the first image (second image), the second image starts from the insertion color having the same value as the color evaluation value of the first image (second image). When the last image (first image) is displayed after the process of fading in, the inserted color having the same value as the color evaluation value of the last image (first image) from the first image Process to fade out. Further, in the case of image switching in the middle of slide show reproduction, the switching processing unit 28 uses the intermediate color between the first color evaluation value and the second color evaluation value as an insertion color, and uses the first image and the second image. The image is switched by performing fade-out processing and fade-in processing through the insertion color.

Note that FIG. 10 shows an example in which the insertion color generation unit 22 generates an intermediate color between the first color evaluation value and the second color evaluation value as an insertion color. However, as described above, Depending on the motion vector, the rate of change of the color of the image, or the volume of the sound associated with the image, a complementary color of the intermediate color may be generated as the insertion color.

As described above, the image display apparatus 100 has no image before or after the display image (when only one image starts to be displayed or ends, when the first image starts to be displayed, or when the last image is displayed. Even when the display is terminated, the images can be switched and displayed by a transition process using colors based on the image to be displayed.

<When displaying only one moving image after transition processing>
FIG. 11 is a flowchart illustrating an example of a switching process in the case where display of only one moving image is started (reproduction is started). FIG. 12 is a flowchart illustrating an example of a switching process when display of only one moving image is ended (reproduction is ended). 11 and 12 exemplify a case where the evaluation value calculation unit 21 calculates the color evaluation value of a moving image from the first frame or the last frame. Further, the case where the insertion color generation unit 22 generates an intermediate color as an insertion color is taken as an example.

First, the operation of the switching process in the case where display of only one moving image is started (reproduction start) will be described using FIG.
The evaluation value calculation unit 21 calculates the color evaluation value of the first frame of the moving image (step S61). Further, since there is no image before switching (first image), the evaluation value calculation unit 21 displays the color evaluation value of the first image in the first frame (moving to be displayed from now on) of the moving image (second image). It is calculated as the same color evaluation value as the first frame of the subsequent image (step S62).

Next, the insertion color generation unit 22 inserts a color when starting to display (start reproduction) an intermediate color between the color evaluation value of the first image and the color evaluation value of the first frame of the moving image (second image). (Step S63). That is, the insertion color generation unit 22 generates a color having the same value as the color evaluation value of the first frame of the moving image (second image) as an insertion color when starting display (reproduction start).

The switching processing unit 28 fades in from the insertion color generated in step S63 and starts displaying (reproducing) the moving image (step S64).

Next, the operation of the switching process in the case where display of only one moving image ends (reproduction ends) will be described using FIG.
The evaluation value calculation unit 21 calculates the color evaluation value of the last frame of the moving image (step S71). In addition, since there is no image after switching (second image), the evaluation value calculation unit 21 displays the color evaluation value of the second image in the last frame (moving image (first image)). It is calculated as the same color evaluation value as the last frame of the image before switching) (step S72).

Next, the insertion color generation unit 22 inserts the color when the intermediate color between the color evaluation value of the last frame of the moving image (first image) and the color evaluation value of the second image ends (reproduction ends). (Step S73). In other words, the insertion color generation unit 22 generates a color having the same value as the color evaluation value of the last frame of the moving image (first image) as an insertion color when the display ends (reproduction ends).

Then, the switching processing unit 28 fades out to the insertion color generated in step S73 and ends the display (playback) of the moving image (step S74).

11 and 12 show an example in which the insertion color generation unit 22 generates an intermediate color between the first color evaluation value and the second color evaluation value as the insertion color, but as described above. Depending on the motion vector of the image, the rate of change of the color of the image, or the volume of the sound associated with the image, an intermediate complementary color may be generated as the insertion color.

In this way, the image display device 100 performs a transition process using colors based on the moving image to be displayed when starting to display (start reproduction) or ending (reproduction end) display of only one moving image. Can be displayed (played back).

As described above, the image display apparatus 100 performs transition processing (for example, fade-in) using an intermediate color of the color evaluation value of the image before and after switching or a complementary color of the intermediate color based on the color evaluation value of the image before and after switching. The images can be switched and displayed by processing or fade-out processing. For example, the image display apparatus 100 can switch and display images by transition processing using a color (intermediate color) having a small color difference with respect to the colors of the images before and after switching as an insertion color. Accordingly, it is possible to reduce screen flicker that may be caused by a large color change of the screen in the case of a transition process using black or white that is generally used.

For example, according to the example described with reference to FIG. 4, in the case of the black transition process, “blue (blue sky) → black → yellow (yellow flower field)” is switched, and the color difference between the switched images is large. This causes screen flickering. On the other hand, in the case of transition processing with green color generated as an intermediate color, the color is switched from “blue (blue sky) → green → yellow (yellow flower garden)”, and the flickering of the screen is reduced because the color difference between the images to be switched is small. The In addition, for example, when switching a red image with a large evaluation value (reddish image) continuously by a black transition process, “red (reddish image) → black → red (reddish image)” is cut off. Instead, the flickering of the screen occurs due to a large difference in the colors of the images to be switched. However, when switching is performed by a transition process using red, the flickering of the screen is reduced because the difference in the colors of the images to be switched is small. As a result, the image display apparatus 100 can switch and display images (for example, slide show playback) so that the user has less discomfort.

Further, the image display device 100 selects a color (intermediate color complementary color) having a large color difference with respect to the color of the image before and after the switching in the case of an image with intense movement, an image with a large color change, or an image with noisy sound. The images can be switched and displayed by the transition process using the insertion color. For example, black or white, which is commonly used when switching and displaying images with intense movement, images with significant color changes, or images with noisy sounds, such as sports and rock concerts When the transition process by is inserted, the dynamic feeling of the image may be cut off and the user may feel uncomfortable. In such a case, the image display apparatus 100 switches and displays the image by a transition process in which a color having a large color difference (a complementary color of the intermediate color) with respect to the color of the image before and after the switching is used as an insertion color. Images can be switched and displayed so that the feeling of dynamism is not blocked.
As a result, the imaging apparatus 200 can switch and display images (for example, slide show playback) so as to reduce discomfort for the user.

Next, an example in which the imaging apparatus 200 including the image processing apparatus 1 starts or ends recording of a moving image by a transition process will be described.
<Example of recording a moving image in the imaging apparatus>
FIG. 13 is a schematic block diagram illustrating a configuration of the imaging apparatus 200 according to an embodiment of the present invention. First, the configuration of the imaging apparatus 200 will be described with reference to FIG. In FIG. 13, parts corresponding to those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted.

An imaging apparatus 200 illustrated in FIG. 13 includes an image processing apparatus 1, a display control unit 110, a display unit 120, an external output unit 130, an imaging unit 210, an imaging control unit 220, a sound input unit 230, a recording control unit 240, and a bus 10B. It has.

The imaging unit 210 includes a lens unit 211, an imaging element 212, and an A / D conversion unit 213, and captures an image of a subject and generates image data. The imaging unit 210 is controlled by the imaging control unit 220 based on the set imaging conditions (for example, aperture value, exposure value, etc.), and the subject luminous flux incident through the lens unit 211 is photographed on the imaging surface of the image sensor 212. Form an image. In addition, the imaging unit 210 converts the analog signal output from the imaging device 212 into a digital signal in the A / D conversion unit 213, generates image data, and outputs the image data.
The lens unit 211 described above may be attached to and integrated with the imaging device 200, or may be detachably attached to the imaging device 200.

For example, the imaging unit 210 outputs captured moving image data in response to a moving image imaging operation by the operation unit 7. Further, the imaging unit 210 outputs captured still image data in response to a still image imaging operation by the operation unit 7. The moving image data and still image data captured by the imaging unit 210 are input to the image processing device 1 via the bus 10B under the control of the imaging control unit 220, processed by the image processing device 1, and then a storage medium. 300. The imaging unit 210 outputs image data of a live camera during a standby state for capturing a still image.
The imaging control unit 220 controls the imaging operation of the imaging unit 210, and inputs moving image data, still image data, and the like captured by the imaging unit 210 to the image processing apparatus 1 via the bus 10B.

The sound input unit 230 has a microphone that detects sound, generates a sound signal based on the detected sound, and inputs the sound signal to the image processing apparatus 1 via the bus 10B. For example, the sound input unit 230 inputs a sound signal based on the detected sound to the image processing apparatus 1 during a period in which a moving image is captured by the imaging unit 210. Then, the image processing apparatus 1 records the sound signal in the storage device (recording unit) 6 via the recording control unit 240 in association with the captured moving image. The sound input unit 230 performs image processing on a sound signal based on the detected sound for a preset time (for example, 10 seconds after the release is pressed) when a still image is captured by the imaging unit 210. You may input into the apparatus 1. FIG. In addition, the sound input unit 230 inputs a sound signal based on a sound detected during a later recording period in association with the recorded still image to the image processing apparatus 1 according to the operation of the operation unit 7. Also good.

The recording control unit 240 stores image data (moving image, still image) captured by the imaging unit 210 and sound data (sound signal) associated with the image data input by the sound input unit 230 in a storage device ( (Recording unit) 6 is controlled to record. For example, the recording control unit 240 records in a removable storage medium 300 such as a card memory connected to the storage device (recording unit) 6. In addition, the recording control unit 240 inserts an insertion color switching image (by performing a transition process) in a predetermined frame period immediately after the start of recording of a moving image or a predetermined frame period immediately before the stop of recording. (Recording section) Record in 6.

The bus 10B is connected to each unit included in the image processing apparatus 1, the display control unit 110, and the external output unit 130, and transfers image data, control signals, and the like output from each unit.

FIG. 14 is a flowchart illustrating an example of a process of recording a captured moving image by performing a switching process using an insertion color. With reference to FIG. 14, an operation in which the imaging apparatus 200 performs switching processing (transition processing) on a moving image using an insertion color and records it will be described.

First, the imaging control unit 220 executes imaging of a moving image and inputs the captured moving image to the image processing apparatus 1 in accordance with a moving image imaging operation by the operation unit 7 of the user. The image processing apparatus 1 holds the input moving image in the buffer memory unit 5 (step S81). Next, the evaluation value calculation unit 21 reads the first frame and the last frame of the moving image from the buffer memory unit 5 and calculates the respective color evaluation values (step S82).

Subsequently, based on the color evaluation values of the first frame and the last frame of the moving image calculated by the evaluation value calculation unit 21, the insertion color generation unit 22 sets the insertion color at the start of moving image recording to the first frame. And the color inserted at the end of moving image recording is generated as the color evaluation value color of the last frame (step S83).

Then, the switching processing unit 28 executes image processing (transition processing) for fading in the moving image from the color of the color evaluation value of the first frame and fading out to the color of the color evaluation value of the last frame ( Step S84). The recording control unit 240 records the image-processed moving image (step S85).

Note that the processing for generating an insertion color for one moving image in step S83 generates an insertion color when only one moving image starts or ends as described with reference to FIGS. It can be executed in the same manner as the processing to be performed.

In addition, the image capturing apparatus 200 stores the captured moving image in the buffer memory unit 5 and then reads and processes a frame used for the transition process. At this time, the image capturing apparatus 200 stores all the moving images captured by one image capturing operation in the buffer memory unit 5 and then selects a frame (for example, the first frame or the last frame) to be used for the transition process. Although the calculation processing and transition processing of the evaluation value may be performed after reading, the memory capacity of the buffer memory unit 5 is generally small with respect to the moving image recording capacity. Therefore, the imaging apparatus 200 performs the first frame (or the frame of a predetermined period including the first frame) held in the buffer memory unit 5 by the imaging process and the parallel process when starting the imaging of the moving image. By performing real-time processing such as executing and recording transition processing, processing may be performed so that the moving image held in the buffer memory unit 5 has a minimum capacity.

Note that the imaging apparatus 200 inserts a complementary color having the same value as the color evaluation value of the moving image according to the motion vector of the image, the rate of change of the color of the image, or the volume of the sound associated with the image. It may be generated as a color. In this case, the imaging apparatus 200 calculates the motion vector of the image, the rate of change of the color of the image, or the volume of the sound associated with the image from the live image (live 開始 camera) image before starting to capture the moving image. It may be detected to determine whether a color having the same value as the color evaluation value of the moving image is generated as an insertion color or whether a complementary color of the color is generated as an insertion color.

As described above, when capturing and recording a moving image, the imaging apparatus 200 generates an insertion color based on the evaluation value of the color of the moving image to be captured at the start or end of recording, and performs transition processing ( For example, a fade-in process or a fade-out process) can be executed and recorded. For example, by using a color having the same value as the evaluation value of the color of the first frame of the moving image to be captured, or a complementary color of the color as an insertion color, the transition at the time of the image switching display in the image display device 100 described above. Similar to the processing, the transition processing based on the insertion color suitable for the moving image to be captured can be executed and recorded.

That is, when capturing and recording a moving image, the imaging apparatus 200 starts recording the moving image by a transition process using a color having a small color difference with respect to the color of the frame at the start or end of recording. Or the recording can be terminated. In addition, when capturing and recording a moving image with a large amount of motion, a moving image with a large change in color, or a moving image with a noisy sound, the imaging apparatus 200 performs the recording with respect to the color of the frame at the start or end of recording. Recording of a moving image can be started or ended by a transition process using a color having a large color difference as an insertion color. As a result, the imaging apparatus 200 can perform recording by performing a transition process that causes less discomfort to the user, instead of switching the image at the start or end of recording of a moving image.

Note that the imaging apparatus 200 has the same configuration as the configuration of the image processing apparatus 1, the display control unit 110, the display unit 120, and the external output unit 130 included in the image display apparatus 100. In addition to the above, it is also possible to execute switching display of images in the image display device 100 described above. Thereby, the imaging apparatus 200 can switch and display images so that the user has less discomfort.

The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes design and the like within a scope not departing from the gist of the present invention.
For example, when calculating the evaluation value related to the color attribute of the image, the evaluation value calculation unit 21 calculates the evaluation value related to the lightness evaluation value, the saturation evaluation value, or a combination thereof, without being limited to the hue evaluation value. May be.

In the above-described embodiment, the evaluation value calculation unit 21 calculates the evaluation value related to the color attribute of the image. However, the present invention is not limited to this example. It is not a thing. For example, the evaluation value calculation unit 21 may calculate, as the evaluation value, a weighted average value obtained by weighting a color that occupies a large area or a color in the center area among the entire area of the image.
Further, for example, for the colors in the respective regions of the preceding and following images, close colors (similar colors and similar colors) may be grouped, and a color evaluation value may be calculated from the group. For example, grouping may be performed with colors such as warm colors and cold colors in the preceding and following image regions, and color evaluation values may be calculated from these groups.
For example, the average color of the previous image may be A1, and the average color of the subsequent image may be B1, and the color evaluation value may be calculated from these A1 and B1.
Further, for example, the color having the largest area in the area of the previous image is A1, and the color having the largest area in the area of the subsequent image is B1, and the colors A1 and B1 occupying these maximum areas are used. A color evaluation value may be calculated.
Further, for example, A1, A2,... In order from the color having the largest area in the area of the previous image, and B1, B2,... In order from the color having the largest area in the area of the subsequent image. Color evaluation values may be calculated from the colors A1, A2,... And B1, B2,.
In addition, for example, a color map in which colors included in the preceding and following images are classified is created, and all colors in the display image area are classified according to the classification of the color maps. First, let A1 be a single color, or A1, A2,... Next, according to the color classification divided into the color map of the subsequent image, a single color is set to B1, or a plurality of colors are set to B1, B2,. Then, the color evaluation value may be calculated from these single color A1 or multiple colors A1, A2,... And single color B1 or multiple colors B1, B2,. The color map may be created by an evaluation value calculation unit, or the image processing unit may include a color map creation unit (not shown).
Here, an example of a method for calculating an evaluation value related to a color attribute of an image when there are images before and after has been described. However, the color evaluation value calculation method as described above is such that only one of the front and rear images is displayed even when there is no image before or after the display image (when the display image is the first image or the last image). You may use it. That is, for example, when there is only the previous image, the colors in the region of the previous image may be grouped and the color evaluation value may be calculated from the group. Similarly, other color evaluation value calculation methods may be performed using only one of the front and rear images.

Note that the image processing apparatus 1 in the embodiment described above determines an intermediate color of the color evaluation values of the image before and after switching based on a combination of the conditions of the motion vector, the color change rate, or the sound volume before and after the switching. It may be determined whether to use an insertion color or a complementary color of an intermediate color. For example, each condition may be determined in the order based on the preset priority of each condition, or the determination threshold value for each condition may be changed based on the priority.

Further, the image processing apparatus 1 in the above embodiment, for example, when the color of the previous image is A1 and the color of the subsequent image is B1 as the insertion colors to be inserted between the images before and after switching, these A1 Only C1, which is an intermediate color between B1 and B1, may be used.
Further, for example, only D1 which is a complementary color of the intermediate color C1 of the color A1 of the previous image and the color B1 of the subsequent image may be used as the insertion color inserted between the images before and after switching.
Further, as an insertion color to be inserted between the images before and after switching, for example, one color or a plurality of colors are used from among the color A1 of the previous image, the color B1 of the subsequent image, the intermediate color C1, and the complementary color D1 of the intermediate color C1. May be.
Further, as an insertion color to be inserted between the images before and after the switching, for example, a single color or a plurality of colors selected from among the color A1 of the previous image, the color B1 of the subsequent image, the intermediate color C1, and the complementary color D1 of the intermediate color C1, etc. A monochrome color having the same brightness as the color may be used.
In addition, as an insertion color to be inserted between images before and after switching, for example, the color map of the previous image and the color map of the subsequent image are combined, and E1 which is the single color of the maximum area obtained therefrom, or the maximum area E1, E2,..., Which are a plurality of colors, may be used.
The insertion color inserted between the images before and after switching is, for example, F1 that is a common color obtained from the color map of the previous image and the color map of the subsequent image, or a plurality of common colors F1 and F2. , ... may be used.
Here, an example of a method of determining an insertion color to be inserted between images before and after switching when there are images before and after switching has been described. However, the insertion color determination method as described above uses only one of the front and rear images even when there is no image before or after the display image (when the display image is the first image or the last image). You may do it. That is, when there is only a previous image, at least one color evaluation value obtained from the previous image may be used to determine a single color or a plurality of inserted colors. For example, A1 and B1 may be selected in the area of the previous image, and C1 that is an intermediate color between them may be used as the insertion color. Similarly, other insertion color determination methods may be performed using only one of the front and rear images.

Further, another example of the display image transition process in the following case of the image processing apparatus 1 in the above embodiment will be described.
(1) When starting to display the first image in the slide show reproduction.
(2) When there are images before and after the display image in the slide show reproduction.
(3) When the display of the last image in the slide show reproduction ends.
In such a case, the image display apparatus may perform the following transition processing, for example. Note that the insertion color used in the following transition processing example is determined using the determination method described above, and may be a single color or a plurality of insertion colors. Hereinafter, in the description in FIG. 15, FIG. 16A, FIG. 16B, and FIG. 17, an example in which a plurality of insertion colors are used is shown.

For example, when the display of the first image in the slide show reproduction is started, there is no image before switching (first image). In this case, the image display device calculates a color evaluation value from the image after switching (second image) to be displayed, and performs a transition process using the insertion color obtained based on the color evaluation value. Also good. Specifically, as shown in FIG. 15, for example, after the plurality of insertion colors 40A obtained based on the color evaluation value is displayed in the entire screen area, the second image 50A is displayed on the right side of the screen from the left side of the screen. The transition processing may be performed so that the image is displayed while expanding toward (slide in). The arrow r1 in FIG. 15 expresses the state of the transition process in which the second image 50A is displayed while spreading from the left end of the screen toward the right side of the screen on the screen on which the plurality of insertion colors 40A are displayed first. Yes. Further, the first image 30A is indicated by a square with a dotted line, and expresses a state where there is no image.
Here, the color evaluation value based on the second image 50A may be calculated by the various calculation methods described above. Also, the insertion color 40A may be various insertion colors determined by the method described above.

Next, for example, when there are images before and after the display image in the slide show reproduction, the image display device determines the color evaluation value from the image before switching (first image) and the image after switching (second image). And the transition processing may be performed using the insertion color obtained based on the color evaluation value. Specifically, for example, as shown in FIG. 16A, the display of a plurality of insertion colors 40B obtained based on the color evaluation values of the preceding and following images is started from the right side of the screen. The transition process may be performed so that the second image 50B is continuously displayed (slide in) while spreading toward the left side of the screen. At this time, as the display of the plurality of insertion colors 40B and the second image 50B flowing from the right side of the screen spreads, the display of the first image 30B that has been displayed earlier is gradually as shown in FIG. 16A. Will be displayed compressed in the left direction of the screen. Thereafter, in place of the first image, a plurality of insertion colors 40B and the second image 50B are displayed in the entire screen area. Subsequently, a plurality of insertion colors 40B are also compressed and displayed in the left direction of the screen. Eventually, the entire screen area is switched to the second image 50B. An arrow r2 in FIG. 16A represents a state of transition processing that is displayed while spreading from the right end of the screen toward the left end of the screen in a state where the plurality of insertion colors 40B and the second image 50B are continuous.

As another specific example, for example, as shown in FIG. 16B, display of a plurality of insertion colors 40B obtained based on the color evaluation values of the preceding and following images is started from the right side of the screen, After only the insertion color 40B is displayed on the entire screen area, a transition process in which the second image 50B is displayed from the right side of the screen may be performed. At this time, as the display of the plurality of insertion colors 40B flowing from the right side of the screen spreads, the display of the first image 30B displayed previously is gradually compressed in the left direction of the screen as shown in FIG. 16B. Will be displayed. Thereafter, a plurality of insertion colors 40B are displayed in the entire screen area instead of the first image. Subsequently, the display of the second image 50B starts from the right side of the screen toward the left side of the screen. As the display of the second image 50B spreads, the display of the plurality of insertion colors 40B displayed previously is gradually compressed and displayed in the left direction of the screen as shown in FIG. 16B. Eventually, the entire screen area is switched to the second image 50B. An arrow r3 in FIG. 16B represents a state of transition processing in which a plurality of insertion colors 40B are displayed while spreading from the right end of the screen toward the left side of the screen. In addition, an arrow r4 in FIG. 16B shows the state of the transition process in which the second image 50B is displayed spreading from the right end of the screen toward the left side of the screen after the plurality of insertion colors 40B are displayed in the entire screen area. expressing. Eventually, the entire screen area is switched to the second image 50B.
Here, the color evaluation values based on the first image 30B and the second image 50B may be calculated by the various calculation methods described above. Also, the insertion color 40B displayed based on the first image 30B and the second image 50B may be various insertion colors determined by the method described above.

Next, for example, when the display of the last image in the slide show reproduction is ended, there is no image after switching (second image). In this case, the image display device calculates a color evaluation value from the image before switching (first image) from which display is to be finished, and performs transition processing using the insertion color obtained based on the color evaluation value. You may go. Specifically, for example, as shown in FIG. 17, in the state where the first image 30C is displayed, a plurality of insertion colors 40C obtained on the basis of the color evaluation value is shifted from the left side of the screen toward the right side of the screen. Transition processing may be performed so that the image is displayed while spreading. An arrow r5 in FIG. 17 represents a state of transition processing in which a plurality of insertion colors 40C are displayed while spreading from the right end of the screen toward the left side of the screen on the screen on which the first image 30C is displayed. The second image 50C is indicated by a dotted-line square and represents a state where there is no image.
Here, the color evaluation value based on the first image 30C may be calculated by the various calculation methods described above. Also, the insertion color 40C may be various insertion colors determined by the method described above.

Note that the image processing apparatus 1 in the above embodiment may perform processing for changing the length of the switching period in addition to generating the insertion color of the switching period based on the images before and after the switching. For example, the image processing apparatus 1 may perform a process of shortening the length of the switching period when switching an image with a strong motion, and conversely increasing the length of the switching period when switching an image with a low motion. . In addition, the image processing apparatus 1 may change the length of the switching period according to the magnitude of the motion vector of the image, or the length of the switching period according to the change rate or volume of the color evaluation value of the image. You may change the size. Furthermore, the image processing apparatus 1 may change the ratio of the length of the period ST2, the period ST3, or the period ST4 to the period ST1 (switching period) shown in FIG.

In addition, although the transition process in the said embodiment was made into the fade-in process or the fade-out process, it is not restricted to this. For example, the transition process may be a wipe process, or may be a process for scrolling images, a process for overlapping images, or a transition process using various shape patterns (mosaic, box, circle, etc.). . In addition, the image processing apparatus 1 is a composite image of the images before and after the switching and the switching image of the insertion color (for example, an image that gradually changes from the image before the switching to the insertion color, or an image that gradually changes from the insertion color to the image after the switching. (Image) may not be generated, and a process of switching by inserting only the switching image of the insertion color between the images before and after switching may be performed.

Each unit included in the image processing apparatus 1 may be realized by dedicated hardware, and is configured by a memory and a CPU (central processing unit), and a program for realizing the functions of the above-described units. The function may be realized by loading the program into a memory and executing it.

Further, the program for realizing the function of each unit included in the image processing apparatus 1 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into the computer system and executed, thereby executing the above-described process. You may perform the process of each part. Here, the “computer system” includes an OS and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM or a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

DESCRIPTION OF SYMBOLS 1 Image processing apparatus, 6 Storage device (recording part), 21 Evaluation value calculation part (calculation part), 22 Insertion color generation part (generation part), 23 Motion vector detection part, 24 Motion vector determination part, 25 Change rate calculation part 25 color change determination unit, 27 volume determination unit, 28 switching processing unit, 100 image display device, 110 display control unit, 120 display unit, 200 imaging device, 240 recording control unit

Claims (26)

1. A calculation unit that calculates an evaluation value related to the color attribute of the image based on the image;
   The insertion color, which is the color of the switching image inserted in the switching period when switching from the first image to the second image for display, is the evaluation value calculated by the calculation unit based on the first image. A generation unit that generates based on at least one of a first color evaluation value and a second color evaluation value that is an evaluation value calculated by the calculation unit based on the second image;
   A switching processing unit that inserts the switching image of the insertion color in the switching period and performs a process of switching from the first image to the second image;
   An image processing apparatus comprising:
2. The generator is
   The image processing apparatus according to claim 1, wherein a color between the first color evaluation value and the second color evaluation value is generated as the insertion color.
3. The generator is
   The image processing apparatus according to claim 1, wherein a complementary color of a color between the first color evaluation value and the second color evaluation value is generated as the insertion color.
4. The generator is
   The first color evaluation value, the second color evaluation value, a color between the first color evaluation value and the second color evaluation value, and the first color evaluation value and the second color The image processing apparatus according to claim 1, wherein among the complementary colors of colors between the evaluation values, a plurality of colors are generated as the insertion colors.
5. The generator is
   The first color evaluation value, the second color evaluation value, a color between the first color evaluation value and the second color evaluation value, and the first color evaluation value and the second color The image processing apparatus according to claim 1, wherein a monochrome color having the same luminance as at least one of complementary colors between evaluation values is generated as the insertion color.
6. The generator is
   A color map obtained by dividing the colors included in the frame of the first image based on a predetermined criterion and a color map obtained by dividing the colors included in the frame of the second image based on the predetermined criterion are combined. The image processing apparatus according to claim 1, wherein at least one color having the maximum area obtained is generated as the insertion color.
7. The generator is
   It is obtained from a color map in which the colors included in the frame of the first image are segmented based on a predetermined criterion and a color map in which the colors included in the frame of the second image are segmented based on a predetermined criterion. The image processing apparatus according to claim 1, wherein at least one common color is generated as the insertion color.
8. A motion vector detector for detecting a motion vector of the image;
   A motion vector determination unit that determines whether the magnitude of the motion vector detected by the motion vector detection unit from the image is a predetermined value or more;
   Further comprising
   The generator is
   When the motion vector detected by the motion vector detection unit from the first image or the magnitude of the motion vector detected by the motion vector detection unit from the second image is determined to be greater than or equal to a predetermined value 8. The complementary color of the color between the first color evaluation value and the second color evaluation value is generated as the insertion color. 8. Image processing apparatus.
9. The motion vector detection unit
   The image processing apparatus according to claim 8, wherein when the image is a moving image, motion vectors in a predetermined plurality of frames of the image are detected.
10. A volume determination unit for determining whether or not the sound associated with the image is equal to or higher than a predetermined volume;
    Further comprising
    The generator is
    If the sound volume determination unit determines that the sound associated with the first image or the sound associated with the second image is equal to or higher than a predetermined sound volume, the first color evaluation value The image processing apparatus according to claim 1, wherein a complementary color of a color between the second color evaluation value is generated as the insertion color.
11. When the image is a moving image, a change rate calculation unit that calculates a change rate between the frames of the evaluation value calculated for each frame of the image by the calculation unit;
    A color change determination unit that determines whether or not the change rate calculated by the change rate calculation unit is equal to or greater than a predetermined change rate;
    Further comprising
    The generator is
    The color change determination unit determines that the change rate calculated by the change rate calculation unit from the first image or the change rate calculated by the change rate calculation unit from the second image is equal to or greater than a predetermined change rate. When it is, the complementary color of the color between the first color evaluation value and the second color evaluation value is generated as the insertion color. 11. The image processing apparatus according to item.
12. The calculation unit includes:
    The image processing apparatus according to any one of claims 1 to 11, wherein an average value of color data of pixels in the frame of the image is calculated as the evaluation value.
13. The calculation unit includes:
    The said image is a moving image, The addition average value of the color data of the pixel in the frame of the said image is calculated and calculated as said evaluation value by carrying out the addition average of predetermined several frames. The image processing apparatus according to any one of 11.
14. The calculation unit includes:
    When the image is a moving image, an average value of color data of pixels in the last frame of the first image is calculated as the first color evaluation value, and the first frame of the second image is calculated. The image processing apparatus according to any one of claims 1 to 11, wherein an average addition value of color data of pixels in the pixel is calculated as the second color evaluation value.
15. The calculation unit includes:
    For color data of pixels in at least one frame of the first image and the second image, color data of pixels of similar colors are grouped, and the evaluation value is calculated from the group. The image processing apparatus according to any one of claims 1 to 11.
16. The calculation unit includes:
    12. The evaluation value is calculated using a color based on an average of color data of pixels in at least one frame of the first image and the second image. The image processing apparatus according to any one of the above.
17. The calculation unit includes:
    12. The evaluation value is calculated using a maximum area of color data of pixels in at least one frame of the first image and the second image. The image processing apparatus according to item 1.
18. The calculation unit includes:
    12. The evaluation value is calculated by arranging the areas occupied by color data of pixels in at least one frame of the first image and the second image in descending order. The image processing apparatus according to claim 1.
19. The calculation unit includes:
    A color map divided based on a predetermined standard from color data of pixels in at least one frame of the first image and the second image is created, and the evaluation value is calculated by the color map. The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.
20. The switching processing unit
    As a process for switching one of the first image and the second image, a process for switching the first image and the second image to the other of the one of the images is used as the insertion color. The image processing apparatus according to any one of claims 1 to 19, wherein a transition process is performed.
21. The switching processing unit
    As a process of switching from the first image to the second image, a process of switching from the first image to the second image is a fade-in process or a fade-out process based on the insertion color. The image processing apparatus according to any one of claims 1 to 19.
22. The image processing apparatus according to any one of claims 1 to 21,
    A display unit for displaying the first image and the second image;
    A display control unit that inserts the switching image of the insertion color during the switching period and displays it on the display unit when the first image is switched to the second image for display.
    An image display device comprising:
23. An imaging apparatus comprising: the image processing apparatus according to any one of claims 1 to 21.
24. A recording unit for recording the image;
    When recording a moving image, recording is performed in which the switching image of the insertion color is inserted and recorded in the recording unit during a predetermined frame period immediately after the start of recording of the moving image or a predetermined frame period immediately before the stop of recording. A control unit;
    The imaging apparatus according to claim 23, comprising:
25. In a computer as an image processing device,
    A calculation procedure for calculating an evaluation value related to a color attribute of the image based on the image;
    The insertion color, which is the color of the switching image inserted during the switching period when switching from the first image to the second image and being displayed, is the evaluation value calculated based on the first image. A generation procedure for generating based on a first color evaluation value and a second color evaluation value that is the evaluation value calculated based on the second image;
    A switching process procedure for inserting the switching image of the insertion color in the switching period and performing a process of switching from the first image to the second image;
    A program for running
26. The color between the first color evaluation value and the second color evaluation value is a color that is an intermediate value between the first color evaluation value and the second color evaluation value. The image processing apparatus according to any one of claims 3 to 5 and 8 to 24.

Images