JP6779138B2 - Image processing device, image processing method - Google Patents

Description

The present invention relates to an image processing apparatus and an image processing method for generating thumbnail images of composite image data obtained by synthesizing a plurality of image data.

Images (still images or moving images) taken by various imaging devices such as digital cameras, endoscopes, and microscopes are listed as thumbnail images.

The thumbnail image is generated by resizing and compressing the image data obtained by shooting, and is smaller in size and smaller than the original image data. Then, the thumbnail image is recorded in a header or the like in the image file as shooting information (metadata) of the image data.

Since the thumbnail image is displayed as a small image, it is preferable to improve the visibility so that the viewer can determine what the captured image file (still image file, moving image file, etc.) is.

For example, Japanese Patent Application Laid-Open No. 2012-99906 determines whether an image is a normal image or a panoramic image, generates a 3D thumbnail image if it is a panoramic image, and generates a 3D thumbnail image if it is not a panoramic image. Describes a technique for generating a normal thumbnail image so that the 3D thumbnail image can be displayed while being rotated when the thumbnail list is displayed.

Japanese Unexamined Patent Publication No. 2012-99906

However, Japanese Patent Application Laid-Open No. 2012-99906 does not describe that a thumbnail image with high visibility is generated and displayed for a composite image synthesized by an image synthesis method other than panoramic composition. Further, it cannot be said that the 3D thumbnail image is suitable for the composite image data other than the panorama, and the reproduction of the 3D thumbnail image may be slow because the display processing load is heavy.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an image processing apparatus and an image processing method capable of improving the visibility of thumbnail images related to composite image data.

In the image processing apparatus according to an aspect of the present invention, a composite determination unit that determines whether or not the image data is a composite image data obtained by synthesizing a plurality of image data, and a determination result of the composite determination unit are composite image data. In some cases, the image data before and the image after the composition of the composite image data are determined according to the composition method determination unit that determines the composition method of the composite image data and the composition method determined by the composition method determination unit. It includes a thumbnail image generation unit that generates a plurality of thumbnail images based on at least one of the data.

In the image processing method according to an aspect of the present invention, a composite determination step for determining whether or not the image data is a composite image data obtained by synthesizing a plurality of image data, and a determination result of the composite determination step are composite image data. In some cases, the image data before and the image after the composition of the composite image data are determined according to the composition method determination step for determining the composition method of the composite image data and the composition method determined by the composition method determination step. It includes a thumbnail image generation step of generating a plurality of thumbnail images based on at least one of the data.

According to the image processing apparatus and image processing method of the present invention, it is possible to improve the visibility of thumbnail images related to composite image data.

The block diagram which shows the structure of the image pickup apparatus to which the image processing apparatus according to Embodiment 1 of this invention was applied. The flowchart which shows the processing of reproduction and photography in the image pickup apparatus of Embodiment 1. The flowchart which shows the process of still image shooting in the image pickup apparatus of Embodiment 1. The flowchart which shows the processing of moving image shooting in the image pickup apparatus of Embodiment 1. The flowchart which shows the process of the synthesis process determination in the image pickup apparatus of Embodiment 1. The flowchart which shows the processing of the external memory recording in the image pickup apparatus of Embodiment 1. The flowchart which shows the process of the still image thumbnail generation in the image pickup apparatus of Embodiment 1. The flowchart which shows the process of the moving image thumbnail generation in the image pickup apparatus of Embodiment 1. The flowchart which shows the reproduction processing in the image pickup apparatus of Embodiment 1. The flowchart which shows the processing of the thumbnail display control in the image pickup apparatus of Embodiment 1. The flowchart which shows the thumbnail display processing in the image pickup apparatus of Embodiment 1. The block diagram which shows the structure of the image data in the image pickup apparatus of Embodiment 1.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[Embodiment 1]

1 to 12 show the first embodiment of the present invention, and FIG. 1 is a block diagram showing a configuration of an image pickup apparatus 1 to which an image processing apparatus is applied.

The image pickup device 1 includes an image pickup unit 2, a display unit 3, a thumbnail processing unit 5, a synthesis control unit 6, a shooting information acquisition unit 7, an input unit 8, a development processing unit 9, and an internal memory 10. , An external memory 11, an image processing unit 12, and a system control unit 13.

The image pickup unit 2 includes a drive control unit 21, a lens 22, an aperture 23, a shutter 24, and an image sensor 25.

The lens 22 forms an optical image of the subject on the image sensor 25. The lens 22 is configured to include a focus lens, a zoom lens, and the like, and the focus position and the zoom state can be adjusted.

The aperture 23 has a variable aperture diameter, and adjusts the amount of light reaching the image sensor 25 by controlling the passing range of the light flux emitted from the lens 22 to the image sensor 25.

The shutter 24 controls the incident / shading of light on the image sensor 25 by opening and closing the light-shielding curtain, and adjusts the shutter speed, which is the exposure time.

The image sensor 25 is composed of, for example, a CMOS image sensor, a CCD image sensor, or the like, and includes a plurality of pixels arranged in a two-dimensional manner. Each pixel photoelectrically converts the incident light to accumulate a pixel signal, and outputs the accumulated pixel signal as analog value pixel data or A / D conversion and then digital value pixel data. In this way, the image data is composed of pixel data of a plurality of pixels.

The drive control unit 21 controls the entire image pickup unit 2 in response to a command from the system control unit 13. For example, the drive control unit 21 drives and controls the lens 22 to control the focus position and the zoom state. Further, the drive control unit 21 drives and controls the diaphragm 23 to change the diaphragm diameter, and drives and controls the shutter 24 to open and close the light-shielding curtain. Further, the drive control unit 21 controls the operation from the accumulation of the pixel signal by the image sensor 25 to the output of the image data.

The input unit 8 includes various operation input devices such as an operation button, an operation switch, and a touch panel, and is an operation unit for inputting to the image pickup apparatus 1 by the user's operation.

The development processing unit 9 performs demoizing processing, noise reduction processing, WB (white balance) adjustment processing , and the like, for the image data read from the image sensor 25, the composite image data generated by the composite control unit 6 , and the like. Various processes such as resizing process and compression process for adjusting the number of pixels according to the number of display pixels of the display unit 3 are performed.

The internal memory 10 is configured to include a volatile DRAM, a non-volatile flash memory, and the like, and records and holds a control program that controls the entire image pickup apparatus 1, and temporarily stores various data such as image data. Record (or continuously) and retain. The memory area in the internal memory 10 can be freely rearranged.

The external memory 11 is configured as a portable recording medium such as a memory card, and is so-called RAW image data before being processed by the developing processing unit 9, or image data developed by the developing processing unit 9, or After the development processing, the image data further processed by the image processing unit 12 as necessary is recorded in, for example, an image file format. Since the external memory 11 is portable as described above, it may be taken out from the image pickup device 1 and connected to another device such as a computer to read image data and perform image processing or image reproduction. You can do it.

The image processing unit 12 performs image processing such as color adjustment and contrast adjustment on the image processed by the development processing unit 9.

The shooting information acquisition unit 7 collects shooting information (metadata) attached to the image data to be recorded in the external memory 11. Further, the shooting information acquisition unit 7 collects shooting information (metadata) attached to the image data recorded in the external memory 11.

The thumbnail processing unit 5 includes a thumbnail generation unit 51 and a thumbnail enhancement processing unit 52.

The thumbnail generation unit 51 is a thumbnail image generation unit, and depending on the synthesis method determined by the synthesis method determination unit 62 described later, at least one of the image data before synthesis and the image data after synthesis of the composite image data can be used. Generate multiple thumbnail images based on this. Specifically, in the present embodiment, the thumbnail generation unit 51 generates one of the plurality of thumbnail images based on the image data after synthesis. Here, the image from which the thumbnail generation unit 51 generates a thumbnail image is, for example, an image that has been photographed and input from the image pickup unit 2, an image input from the external memory 11, a communication line, or the like. It is an input image or the like.

Here, the thumbnail image is an image having a smaller amount of data and a smaller image size than the original image data (image data corresponding to the main image data 113 shown in FIG. 12 to be described later). However, the magnitude of the amount of data shall be compared under the same conditions (for example, with or without compression, with the same conditions such as the compression method).

Therefore, the thumbnail image is not limited to an image size such as 120 × 160 pixels, and for example, when the image data obtained by shooting is 3600 × 5400 pixels, it is 1800 × 2700 pixels. It may be the image size.

Then, the thumbnail generation unit 51 generates a plurality of thumbnail images for the composite image data obtained by synthesizing the plurality of image data. Here, the plurality of thumbnail images include one main thumbnail image and one sub-thumbnail image, as will be described later. Further, the thumbnail generation unit 51 generates a thumbnail image based on the morphing data and the display time input from the thumbnail display control unit 33, which will be described later.

The thumbnail enhancement processing unit 52 performs image enhancement processing on at least one of the plurality of thumbnail images generated by the thumbnail generation unit 51 to emphasize the image processing effect obtained by the composition method determined by the composition method determination unit 62. It is an image enhancement part. Here, some specific examples of the image enhancement process include brightness adjustment, contrast adjustment, and contour enhancement. Further, the thumbnail enhancement processing unit 52 determines whether or not the image enhancement processing of the thumbnail image is necessary based on the input information.

The display unit 3 displays image data, and includes a display member 31, a reproduction information acquisition unit 32, a thumbnail display control unit 33, and a display memory 37.

The display member 31 is a monitor that includes a display device such as a liquid crystal display element and displays an image or various information related to the image pickup device 1.

The reproduction information acquisition unit 32 acquires the shooting information (metadata) of the image to be displayed on the display member 31 from, for example, the shooting information acquisition unit 7.

The thumbnail display control unit 33 is a display control unit that controls a plurality of thumbnail images generated by the thumbnail generation unit 51 to be displayed on the display unit 3. Specifically, the main thumbnail image is displayed on the display unit 3. Animated display that changes from to to the sub-thumbnail image. Therefore, the main thumbnail image is the initial thumbnail image in the animation display, and the sub-thumbnail image is the final thumbnail image in the animation display (or, when there are a plurality of sub-thumbnail images, the thumbnail image and the final thumbnail image of the change process in the animation display). It has become.

The thumbnail display control unit 33 includes a frame switching animation unit 34, a transparency changing animation unit 35, and a morphing animation unit 36, and also generates morphing data.

The frame switching animation unit 34 performs a process of switching to the other one of the plurality of thumbnail images when a predetermined time has elapsed when one of the plurality of thumbnail images is displayed. Specifically, the frame switching animation unit 34 performs the animation display by the image switching process from the main thumbnail image to the sub thumbnail image.

The transparency changing animation unit 35 performs a process of changing the transparency of thumbnail images other than the bottom thumbnail image as time elapses when a plurality of thumbnail images are superimposed and displayed. Specifically, the transparency of the top thumbnail image is gradually changed from the minimum (0%) to the maximum (100%) as time passes, and then the transparency of the second thumbnail image from the top is changed. Gradually change from the minimum (0%) to the maximum (100%) as time elapses, and so on.

Taking the case where a plurality of thumbnail images are two, a main thumbnail image and a sub-thumbnail image, the transparency changing animation unit 35 superimposes an animation display on the sub-thumbnail image. This is performed by a transparency changing process that changes the transparency of the image from the minimum (0%) to the maximum (100%).

The morphing animation unit 36 uses the morphing data generated by the thumbnail display control unit 33 to perform a process of changing the form of the displayed image as time passes. Here, the morphing process for changing the shape from a certain thumbnail image to another thumbnail image is a process with a lighter load than the process for generating a 3D thumbnail image. In cooperation with the morphing animation unit 36, the thumbnail display control unit 33 performs animation display by, for example, a morphing process that changes the shape from a main thumbnail image to a sub-thumbnail image.

The display memory 37 includes a display image expansion memory 38, a main thumbnail expansion memory 39, a sub-thumbnail expansion memory 40, and a morphing data expansion memory 41.

The display image expansion memory 38 stores an image to be displayed on the display member 31 (an image corresponding to the main image data 113 shown in FIG. 12 to be described later).

The main thumbnail expansion memory 39 stores the main thumbnail image of the image stored in the display image expansion memory 38.

The sub-thumbnail expansion memory 40 stores the sub-thumbnail image of the image stored in the display image expansion memory 38.

The morphing data expansion memory 41 stores the morphing data generated by the thumbnail display control unit 33.

The synthesis control unit 6 includes a synthesis determination unit 61, a synthesis method determination unit 62, and a synthesis processing unit 63.

The composition determination unit 61 determines whether or not the image data (still image data or image data of at least one frame constituting the moving image data) is composite image data obtained by combining a plurality of image data. The determination by the synthesis determination unit 61 is performed based on, for example, the shooting information (metadata) input to the composition determination unit 61. That is, when the composition determination unit 61 tries to capture an image and record it in the external memory 11, the composition processing unit 63 synthesizes the image based on the shooting information (metadata) before recording in the external memory 11. By determining whether or not to perform, it is determined whether or not the image data is composite image data. Further, when the compositing determination unit 61 reproduces an image already recorded in the external memory 11, it is based on whether or not the compositing method is recorded as shooting information (metadata) of the image data in the external memory 11. It is determined whether or not the image data is composite image data.

When the determination result of the composition determination unit 61 is the composition image data, the composition method determination unit 62 determines the composition method of the composition image data. Here, the compositing method determination unit 62 makes a determination based on the input shooting information (metadata), and if the image data is to be recorded in the external memory 11 from now on, the compositing processing unit 63 determines the composite image data. The composition method to be performed at the time of generation is determined, and if the image data is already recorded in the external memory 11, the composition method recorded as shooting information (metadata) of the composition image data is determined.

The compositing processing unit 63 synthesizes a plurality of image data to generate a composite image data. In the present embodiment, additive synthesis, comparative bright synthesis, and comparative dark synthesis are given as examples of synthesis methods by the synthesis processing unit 63. However, the synthesis method performed by the synthesis processing unit 63 is not limited to these, and other synthesis methods may be added or replaced with other synthesis methods.

The system control unit 13 has a processor (for example, a CPU) configured as hardware, and controls the entire image pickup apparatus 1 including each of the above-mentioned units. The system control unit 13 also serves as a recording control unit that controls a plurality of thumbnail images generated by the thumbnail generation unit 51 so as to be associated with the composite image data and recorded in the external memory 11 which is a recording medium. It has become.

Next, FIG. 2 is a flowchart showing a reproduction and photographing process in the image pickup apparatus 1.

For example, when the power of the image pickup apparatus 1 is turned on, this process is started.

Then, the system control unit 13 determines whether or not the image pickup apparatus 1 is set to the reproduction mode based on the output of the input unit 8 (step S1).

If it is determined that the playback mode is set here, a playback process as described later with reference to FIG. 9 is performed (step S2).

Then, the system control unit 13 determines whether or not there is a new input of the "reproduction end operation" from the input unit 8 (step S3). Here, if it is determined that there is no input, the reproduction process of step S2 is continuously performed until it is determined that there is an input.

If it is determined in step S3 that the "playback end operation" has been input, or if it is determined in step S1 that the playback mode has not been set, the system control unit 13 performs the "shooting start operation" from the input unit 8. It is determined whether or not there is an input (step S4), and the shooting is not started until the input is input, and the current state is maintained and the standby is performed.

Then, when it is determined that the "shooting start operation" has been input, the mode shifts to the shooting mode, and the shooting information acquisition unit 7 sets various settings (for example, by the user) based on the command of the system control unit 13. Shooting information (metadata) is collected based on the setting, the setting by the automatic exposure control, the setting by the automatic focus adjustment control, etc., and the collected shooting information is stored in the specified area of the internal memory 10 (step S5).

Subsequently, as will be described later with reference to FIG. 5, based on the collected shooting information (metadata), the image data to be obtained by the shooting process to be performed from now on is synthesized by synthesizing a plurality of image data. The composition determination unit 61 determines whether or not the data is image data, and when the determination result of the composition determination unit 61 is the composition image data, the composition method determination unit 62 determines the composition method of the composition image data (step S6). ).

The system control unit 13 determines whether or not the input of the "shooting start operation" from the input unit 8 is still image shooting (and by extension, whether it is still image shooting or moving image shooting) (step S7). ).

Here, when it is determined that the still image shooting is performed, the still image shooting process as described later with reference to FIG. 3 is performed (step S8).

If it is determined in step S7 that the shooting is not a still image, a moving image shooting process as described later with reference to FIG. 4 is performed (step S9).

In this way, when step S8 is performed, the still image data captured and recorded in the recorded image securing area of the internal memory 10 is captured, and when step S9 is performed, the captured image is captured and the recorded image is secured in the internal memory 10. The moving image data recorded in the area is recorded in the external memory 11 (step S10), as will be described later with reference to FIGS. 6 to 8.

Further, after performing a recview display for displaying the images recorded in the series of shooting processes on the display unit 3 (step S11), the shooting process is terminated.

Next, FIG. 3 is a flowchart showing a still image shooting process in the image pickup apparatus 1.

If it is determined in step S7 of FIG. 2 that the still image shooting is performed, the still image shooting process as shown in FIG. 3 is performed in step S8.

First, it is determined whether or not the "synthesis flag", which is the result of the synthesis processing determination in step S6, is on (step S21).

This "composite flag" is image data obtained (or obtained) by synthesizing a plurality of image data with image data (still image data or image data of at least one frame constituting moving image data). It is a flag that indicates whether or not it is on / off.

Therefore, if it is determined that the "composite flag" is off here, it means that the shooting (composite shooting) is not performed.

Therefore, it is determined whether or not the "shooting end operation" has been input from the input unit 8 (step S22). Here, if it is determined that there is no input, the shooting state is continued until it is determined that there is an input.

When it is determined in step S22 that the "shooting end operation" has been input, the system control unit 13 causes the image sensor 25 to output image data, and secures the read data of the output image data in the internal memory 10. Record in the area (step S23).

Then, the system control unit 13 records the image data recorded in the read data reservation area of the internal memory 10 in the recorded image reservation area of the internal memory 10 (step S24).

On the other hand, if it is determined in step S21 that the "composite flag" is on, the shooting (composite shooting) is performed. In this case, the system control unit 13 causes the image sensor 25 to output image data, and records the output image data in the read data reservation area of the internal memory 10 (step S25).

The system control unit 13 determines whether or not the image data obtained in step S25 is the image data of the first frame after starting the composite shooting (step S26).

Here, when it is determined that the image data is the first frame, the system control unit 13 converts the image data recorded in the read data reservation area of the internal memory 10 into the first frame reservation area of the internal memory 10. (Step S27).

If it is determined in step S26 that the data is not the image data of the first frame, the system control unit 13 controls and the composition processing unit 63 of the composition control unit 6 is newly obtained from the image sensor 25 and internally. The image data recorded in the read data reservation area of the memory 10 and the composite image data up to that point recorded in the recorded image reservation area of the internal memory 10 are combined (step S28). When the newly obtained image data is the image data of the second frame, the image data recorded in the read data reservation area is recorded in the first frame reservation area in step S27. It will be combined with the image data.

Then, the composite image data generated by the composite processing unit 63 is recorded in the recorded image reservation area of the internal memory 10 (step S29). Since the process shown in FIG. 3 is still image shooting, in this step S29, a newly generated composite is obtained with respect to the previous composite image data already recorded in the recorded image reservation area. The image data may be overwritten.

After performing the process of step S27 or S29 in this way, it is determined whether or not the "shooting end operation" has been input from the input unit 8 (step S30). Here, if it is determined that there is no input, the shooting state is continued until it is determined that there is an input.

When it is determined in step S30 that the "shooting end operation" has been input, or when the process of step S24 is performed, it is recorded in the recorded image reservation area of the internal memory 10 under the control of the system control unit 13. The development processing unit 9 develops the image data, and the image processing unit 12 performs image processing (step S31) as necessary, and returns from this processing.

Subsequently, FIG. 4 is a flowchart showing a moving image shooting process in the image pickup apparatus 1.

If it is determined in step S7 of FIG. 2 that the shooting is not a still image, the moving image shooting process as shown in FIG. 4 is performed in step S9.

First, it is determined whether or not the "synthesis flag", which is the result of the synthesis processing determination in step S6, is on (step S41).

Here, when it is determined that the "composite flag" is off, the system control unit 13 causes the image sensor 25 to output image data, and the output image data is read data reserved area of the internal memory 10. (Step S42).

Based on the control of the system control unit 13, the development processing unit 9 develops the image data recorded in the read data reservation area of the internal memory 10, and the image processing unit 12 performs image processing as necessary (step S43). ).

Then, the processed image data is recorded in the recorded image securing area of the internal memory 10 in units of one frame (step S44). Here, the internal memory 10 assumes a memory capable of recording moving image data for all frames, but if the memory capacity is not sufficient, recording to the external memory 11 may be performed in parallel with the moving image shooting. Needless to say.

After that, it is determined whether or not the "shooting end operation" has been input from the input unit 8 (step S45). Here, if it is determined that there is no input, the process returns to step S42 to continue the shooting state until it is determined that there is an input.

On the other hand, when it is determined in step S41 that the "composite flag" is on, the system control unit 13 causes the image sensor 25 to output image data, and reads the output image data into the internal memory 10. Recording is performed in the data reservation area (step S46).

The system control unit 13 determines whether or not the image data obtained in step S46 is the image data of the first frame after starting the composite shooting (step S47).

Here, when it is determined that the image data is the first frame, the system control unit 13 converts the image data recorded in the read data reservation area of the internal memory 10 into the first frame reservation area of the internal memory 10. And the composite frame reservation area of the internal memory 10 (step S48).

Based on the control of the system control unit 13, the development processing unit 9 develops the image data recorded in the first frame reserved area of the internal memory 10, and the image processing unit 12 processes the image as necessary (step). S49).

Then, the processed image data is recorded in the recorded image securing area of the internal memory 10 (step S50).

If it is determined in step S47 that the data is not the image data of the first frame, the system control unit 13 controls the composition processing unit 63 of the composition control unit 6, and is newly obtained from the image sensor 25 and the internal memory 10 The image data recorded in the read data reservation area of the above and the composite image data up to that point recorded in the composite frame reservation area of the internal memory 10 are combined (step S51).

Then, the composite image data generated by the composite processing unit 63 is recorded in the composite frame reservation area of the internal memory 10 (step S52).

Under the control of the system control unit 13, the development processing unit 9 develops the image data recorded in the composite frame securing area of the internal memory 10, and the image processing unit 12 performs image processing as necessary (step S53). ).

Then, the processed image data is recorded in the recorded image securing area of the internal memory 10 in units of one frame (step S54).

After performing the process of step S54 or the process of step S50 described above, it is determined whether or not the "shooting end operation" has been input from the input unit 8 (step S55). Here, if it is determined that there is no input, the process returns to step S46 to continue the shooting state until it is determined that there is an input.

In this way, when it is determined in step S45 or S55 that the "shooting end operation" has been input, the process returns from this process.

Next, FIG. 5 is a flowchart showing a process of determining the synthesis process in the image pickup apparatus 1.

When the step S6 of FIG. 2 is entered (or the step S103 of FIG. 9 to be described later is entered), the synthesis processing determination process as shown in FIG. 5 is performed.

First, the composition determination unit 61 determines whether or not "composite photography is on" based on the photographing information (metadata) (step S61).

Here, when it is determined that "composite shooting is not on", all the composite shooting flags (additive synthesis flag, comparative bright synthesis flag, and comparative dark synthesis flag in the example of the present embodiment) (FIG. 12 described later). (Refer to the composite shooting flag 118) of the above (step S62).

If it is determined in step S61 that "composite shooting is on", the composite shooting method determination unit 62 determines the composite shooting method based on the shooting information (metadata) (step S63). Specifically, the synthesis method determination unit 62 determines whether the synthesis method of the composite image data is comparative bright synthesis, additive synthesis, or comparative dark synthesis.

Here, when it is determined that the composite shooting method is "addition", the [additive synthesis flag] is turned on, and all other flags (comparative bright synthesis flag and comparative dark synthesis flag) are turned off. (Step S64).

If it is determined in step S63 that the composite shooting method is "comparative bright", the [comparative bright composite flag] is turned on and all other flags (additive synthesis flag and comparative dark composite flag) are turned on. ) Is turned off (step S65).

Further, in step S63, when it is determined that the composite shooting method is "comparative dark", the [comparative dark composite flag] is turned on and all other flags (additive synthesis flag and comparative bright composite flag) are turned on. ) Is turned off (step S66).

In this way, when all the flags are set to either on or off in steps S62, S64, S65, or S66, the system control unit 13 sets the imaging device 1 to the playback mode based on the output of the input unit 8. It is determined whether or not the system is used (step S67).

Here, when it is determined that the playback mode is not set (and by extension, the shooting mode is set), the compositing processing unit 63 sets the state of the compositing flag to the shooting information (metadata). (Step S68).

If the process of step S68 is performed, or if it is determined in step S67 that the playback mode is set, the process returns from this process.

Subsequently, FIG. 6 is a flowchart showing the processing of external memory recording in the image pickup apparatus 1.

When step S10 of FIG. 2 is entered, the processing of external memory recording as shown in FIG. 6 is performed.

First, the system control unit 13 determines whether or not the image data recorded in the recorded image securing area of the internal memory 10 is still image data (step S71).

Here, when it is determined that the data is still image data, the thumbnail generation unit 51 performs a still image thumbnail generation process as described later with reference to FIG. 7 (step S72).

If it is determined in step S71 that the data is not still image data, the thumbnail generation unit 51 performs a moving image thumbnail generation process as described later with reference to FIG. 8 (step S73).

After performing the process of step S72 or S73, the thumbnail enhancement processing unit 52 enhances the image of the thumbnail image based on the setting information of the image pickup device 1 (for example, the information set by the user in the image pickup device 1 via the input unit 8). It is determined whether or not processing is necessary (step S74).

Here, when it is determined that the image enhancement processing of the thumbnail image is necessary, the thumbnail enhancement processing unit 52 performs the image enhancement processing on the thumbnail image generated by the thumbnail generation unit 51 (step S75). .. When there are a plurality of thumbnail images generated in steps S72 or S73, it is assumed that image enhancement processing is performed on all the thumbnail images. However, it does not prevent the image enhancement processing from being performed only on a part of the thumbnail images among the generated plurality of thumbnail images, and is generated from, for example, the image of the first frame (or the first frame). Image enhancement processing may be performed on the thumbnail image, and image enhancement processing may be performed on the thumbnail image generated from the composite image that is the shooting result.

Then, the thumbnail enhancement processing unit 52 adds that "the thumbnail image itself has undergone image enhancement processing" to the shooting information (metadata) generated in step S5 of FIG. 2 (step S76) (FIG. See image enhancement flag 117 of 12.).

When the process of step S76 is performed, when it is determined in step S74 that the image enhancement process of the thumbnail image is not necessary, or when the process of step S82 of FIG. 7 to be described later is performed, the recorded image securing area Shooting information (metadata) is attached to the image (step S77). At this time, for example, when two thumbnail images are generated, the storage location is set as follows.

Here, FIG. 12 is a block diagram showing the structure of image data in the image pickup apparatus 1.

The image data 111 includes a header 112, a main image data 113, and a footer 114.

The header 112 includes a shooting information (meta data) storage area 115 and a first thumbnail storage area 116, and although not shown, stores other information necessary for configuring an image format.

The shooting information storage area 115 includes an image enhancement flag 117, a composite shooting flag 118, and thumbnail storage position information 119, and although not shown, other information related to the image, for example, a shooting date / time and a white balance setting value. Etc. are also stored.

The image enhancement flag 117 stores information on whether or not the thumbnail image included in the image data 111 is image-enhanced. In the present embodiment, when there are a plurality of thumbnail images, information on whether the image enhancement is performed on all the thumbnail images at once, or whether the image enhancement is performed on any of the thumbnail images. Is expected to be stored. However, the present invention is not limited to this, and information on the presence / absence of image enhancement or the degree of image enhancement may be stored for each thumbnail image.

The composite shooting flag 118 stores information on whether or not the image data 111 has been recorded by the composite shooting. Specifically, the composite shooting flag 118 of the present embodiment stores on or off information for each of the additive synthesis flag, the comparative bright synthesis flag, and the comparative dark synthesis flag. Therefore, if all the flags are off, it can be determined that the image data 111 is not the image data recorded by the composite shooting. On the other hand, if any of the flags is on, it is possible to determine whether the image data 111 is additive synthesis, comparative bright synthesis, or comparative dark synthesis, depending on the type of flag that is on. it can.

The thumbnail storage position information 119 stores information on whether the first thumbnail image stored in the first thumbnail storage area 116 is a main thumbnail image or a sub-thumbnail image. Here, when there are two generated thumbnail images, if there is information that the first thumbnail image is one of the main thumbnail image and the sub thumbnail image, the second thumbnail image is the main thumbnail image. It can be seen that it is the other of the sub-thumbnail images.

Further, when there are three or more generated thumbnail images, information on which thumbnail image is the main thumbnail image and which thumbnail image is the secondary thumbnail image is stored as the thumbnail storage position information 119. (Or, if only the information on which thumbnail image is the main thumbnail image is stored, it may be possible to determine that all the other thumbnail images are the secondary thumbnail images. ).

As described above, the number of thumbnail images to be generated is not limited to two, and may be three or more. For example, in the case of a moving image, thumbnail images may be created for all frames.

The first thumbnail storage area 116 stores a thumbnail image for the shooting result when the main image data 113 is a still image as a thumbnail image generated based on the combined image data, and the main image data 113 is a moving image. If this is the case, the thumbnail image of the first frame is stored (recording in the first thumbnail storage area 116 is performed by the system control unit 13 which is a recording control unit). Here, the first thumbnail storage area 116 is a recording position (storage area) in the external memory 11 that is compatible with the thumbnail image of normal image data other than the composite image data. Then, storing the thumbnail image for the shooting result of the still image in the first thumbnail storage area 116 and storing the thumbnail image of the first frame of the moving image in the first thumbnail storage area 116 is a recording method compatible with the conventional method. Is. As a result, compatibility with conventional devices and conventional software that does not assume the second thumbnail storage area 120 is maintained.

The main image data 113 stores a still image or a moving image as a recorded image as a main image.

The footer 114 includes a second thumbnail storage area 120.

The second thumbnail storage area 120 is all except the thumbnail image for the shooting result (or the first frame) stored in the first thumbnail storage area 116 when there are a plurality of thumbnail images generated for the main image. Store thumbnail images of.

Returning to the description of FIG. 6, a thumbnail image is attached to the image in the recorded image securing area (step S78).

Then, a header 112 including a shooting information storage area 115 and a first thumbnail storage area 116 is attached to the main image data 113, and a footer 114 further including a second thumbnail storage area 120 is attached as needed. After recording the image of the reserved area as image data 111 in the external memory 11 (step S79), the process returns.

FIG. 7 is a flowchart showing a process of generating a still image thumbnail in the image pickup apparatus 1.

If it is determined in step S71 of FIG. 6 that the data is still image data, the process of generating a still image thumbnail as shown in FIG. 7 is performed in step S72.

Then, first, the composition determination unit 61 determines whether or not the composition flag is on based on the shooting information (metadata) of the image (step S81).

If it is determined that the composite flag is not turned on, the image is not a still image obtained by the composite shooting. Therefore, the thumbnail generation unit 51 of the thumbnail processing unit 5 is based on the image of the shooting result. A normal thumbnail image is generated (step S82). After performing the process of step S82, the process proceeds to step S77 of FIG. 6 as described above.

If it is determined in step S81 that the composition flag is on, the composition method determination unit 62 determines the "synthesis method" based on the shooting information (metadata) generated by the process of step S5 described above. (Step S83). Specifically, the synthesis method determination unit 62 determines whether the synthesis method corresponds to addition, comparative light, or comparative dark.

When it is determined in step S83 that the compositing method is addition, the thumbnail generation unit 51 of the thumbnail processing unit 5 generates a thumbnail image based on the image of the shooting result which is the image data after compositing, and generates the main thumbnail image. Then, a thumbnail image is generated based on the image of the first frame which is the image data before composition and used as a sub-thumbnail image. In this way, the thumbnail generation unit 51 generates two (two types) thumbnail images (step S84).

If it is determined in step S83 that the compositing method is comparatively clear, the thumbnail generation unit 51 of the thumbnail processing unit 5 generates a thumbnail image based on the image of the shooting result and uses it as the main thumbnail image for one frame. A thumbnail image is generated based on the eye image and used as a sub-thumbnail image. In this way, the thumbnail generation unit 51 generates two (two types) thumbnail images (step S85).

Further, when it is determined in step S83 that the compositing method is comparatively dark, the thumbnail generation unit 51 of the thumbnail processing unit 5 generates a thumbnail image based on the image of the first frame and uses it as the main thumbnail image for shooting. A thumbnail image is generated based on the resulting image and used as a sub-thumbnail image. In this way, the thumbnail generation unit 51 generates two (two types) thumbnail images (step S86).

When any of the processes of steps S84, S85, or S86 is performed, the process returns from this process.

FIG. 8 is a flowchart showing a moving image thumbnail generation process in the imaging device 1.

If it is determined in step S71 of FIG. 6 that the data is not still image data, the moving image thumbnail generation process as shown in FIG. 8 is performed in step S73.

Then, first, the composition determination unit 61 determines whether or not the composition flag is on based on the shooting information (metadata) of the image (step S91).

If it is determined that the compositing flag is not turned on here, it means that the moving image is not obtained by compositing shooting (it is a moving image in which the compositing process is not performed for any frame constituting the moving image data). In addition, the thumbnail generation unit 51 of the thumbnail processing unit 5 generates a normal thumbnail image based on the image of the first frame (step S92).

On the other hand, when it is determined in step S91 that the compositing flag is on, the compositing method determination unit 62 "combines method" based on the shooting information (metadata) generated by the process of step S5 described above. Is determined (step S93). Specifically, the synthesis method determination unit 62 determines whether the synthesis method corresponds to addition, comparative light, or comparative dark.

When it is determined in step S93 that the composition method is addition, the thumbnail generation unit 51 of the thumbnail processing unit 5 generates a thumbnail image based on the image of the final frame which is the image data after composition to generate the main thumbnail image. Then, a thumbnail image is generated based on the image of the first frame, which is the image data before composition, and used as a sub-thumbnail image. In this way, the thumbnail generation unit 51 generates two (two types) thumbnail images (step S94).

If it is determined in step S93 that the compositing method is comparatively clear, the thumbnail generation unit 51 of the thumbnail processing unit 5 generates a thumbnail image based on the image of the final frame and uses it as the main thumbnail image for one frame. A thumbnail image is generated based on the eye image and used as a sub-thumbnail image. In this way, the thumbnail generation unit 51 generates two (two types) thumbnail images (step S95).

Further, when it is determined in step S93 that the compositing method is comparatively dark, the thumbnail generation unit 51 of the thumbnail processing unit 5 generates a thumbnail image based on the image of the first frame and uses it as the main thumbnail image, and finally. A thumbnail image is generated based on the frame image and used as a sub-thumbnail image. In this way, the thumbnail generation unit 51 generates two (two types) thumbnail images (step S96).

In this way, when the composition method determination unit 62 determines that the comparative bright composition or the addition composition is performed, the thumbnail generation unit 51 generates a main thumbnail image based on the image data after the composition, and uses the image data before the composition as the image data. Based on this, a sub-thumbnail image is generated (see steps S84, S85, S94, and S95). On the other hand, when the composition method determination unit 62 determines that the comparative dark composition is performed, the thumbnail generation unit 51 generates a main thumbnail image based on the image data before composition and generates a sub-thumbnail image based on the image data after composition. Generate (see steps S86 and S96).

In this step S96 (similarly, step S86 described above), the first frame is used as the main thumbnail image and the final frame is used as the sub-thumbnail image for the following reasons. That is, in the case of comparative darkness, the image becomes darker as the number of composites increases. Therefore, if the final frame is the main thumbnail image and the first frame is the sub-thumbnail image, the main thumbnail image, which is a dark image, is specified and played. When this is performed, playback starts suddenly from the bright image of the first frame. Therefore, this is because the sudden change in brightness from darkness to light is avoided.

When any of the processes of steps S92, S94, S95, or S96 is performed, the process returns from this process.

FIG. 9 is a flowchart showing the reproduction process in the image pickup apparatus 1.

When step S2 of FIG. 2 is entered, the reproduction process as shown in FIG. 9 is performed.

Then, first, the image data 111 to be reproduced is read from the external memory 11, and the read image data 111 is stored in the display image expansion memory 38 in the display memory 37 of the display unit 3 (step S101).

Next, the reproduction information acquisition unit 32 of the display unit 3 acquires shooting information (metadata) from the image data 111 stored in the display image expansion memory 38 (step S102).

Subsequently, it is determined by the above-described processing of FIG. 5 based on the composite shooting flag 118 of the shooting information (metadata) whether or not the image to be reproduced from now on is an image generated by the composite processing. (Step S103).

Then, the thumbnail display control of the image to be reproduced is performed as described later with reference to FIG. 10 (step S104), and returns from this process.

FIG. 10 is a flowchart showing a thumbnail display control process in the image pickup apparatus 1.

Entering step S104 of FIG. 9, the thumbnail display control process as shown in FIG. 10 is performed.

Then, first, a thumbnail image is acquired from the image data 111 stored in the display image expansion memory 38 (step S111). At this time, referring to the thumbnail storage position information 119, which of the thumbnail image stored in the first thumbnail storage area 116 and the thumbnail image stored in the second thumbnail storage area 120 is the main thumbnail image. There, one can determine whether the sub-thumbnail image, and stores the determined thumbnail image to be the main thumbnail image in the main thumbnail development memory 39, the determined thumbnail image and Ru sub thumbnail images der sub It is stored in the thumbnail expansion memory 40. However, when there is only one thumbnail image included in the image data 111, the thumbnail image is stored in the main thumbnail expansion memory 39.

The thumbnail enhancement processing unit 52 determines whether or not the thumbnail image has been image-enhanced based on the image enhancement flag 117 of the shooting information (metadata) (step S112).

Here, when it is determined that the image enhancement processing is not performed, the thumbnail enhancement processing unit 52 determines whether or not the image enhancement processing of the thumbnail image is necessary based on the setting information of the image pickup apparatus 1. (Step S113). By performing such processing, even if the thumbnail image in the image data 111 is not image-enhanced, the image can be emphasized and displayed at the time of reproduction.

When it is determined in step S113 that image enhancement processing is necessary, the thumbnail enhancement processing unit 52 performs image enhancement processing of the thumbnail image on the thumbnail display control unit 33 of the display unit 3. Emphasis on] is notified (step S114).

When the process of step S114 is performed, if it is determined that the image enhancement process is performed in step S112, or if it is determined that the image enhancement process is not necessary in step S113, the determination result of step S103 described above is used. It is determined whether or not the obtained synthesis flag is on (step S115).

Here, when it is determined that the composition flag is on, it is determined whether or not the number of thumbnail images acquired in step S111 described above is two or more (step S116).

When it is determined that the number of images is two or more, the thumbnail image display method is further determined based on the setting information of the image pickup apparatus 1 (step S117). Here, it is assumed that any of frame switching, transparency change, and morphing is set as the display method of the thumbnail image, but of course, other display methods may be used.

If it is determined in step S115 that the composition flag is not on, and if it is determined in step S116 that the number of thumbnail images is only one instead of two or more, for example, the system control unit 13 , Notifies the thumbnail display control unit 33 that [normal display] is to be performed (step S118).

If it is determined in step S117 that the display method is frame switching, for example, the system control unit 13 notifies the thumbnail display control unit 33 that [frame switching] is to be performed (step S119).

If it is determined in step S117 that the display method is to change the transparency, for example, the system control unit 13 notifies the thumbnail display control unit 33 that the [transparency change] is to be performed (step S120).

If it is determined in step S117 that the display method is morphing, for example, the system control unit 13 notifies the thumbnail display control unit 33 that [morphing] is to be performed (step S121).

When the notification is received by any of the processes of steps S118 to S121 described above, the thumbnail display control unit 33 performs a thumbnail display process as described later with reference to FIG. 11 (step S122), and from this process. Return.

FIG. 11 is a flowchart showing thumbnail display processing in the image pickup apparatus 1.

Entering step S122 of FIG. 10, thumbnail display processing as shown in FIG. 11 is performed.

First, the thumbnail display control unit 33 determines whether or not the notification of [normal display] has been received (step S131).

Here, when it is determined that the notification of [normal display] has been received, the thumbnail display control unit 33 displays the thumbnail image of the main thumbnail expansion memory 39 on the display member 31 (step S132). The thumbnail image displayed at this time is a normal display without image enhancement.

If it is determined in step S131 that the notification of [normal display] has not been received, the thumbnail display control unit 33 determines whether or not the notification of [emphasis on] has been received (step S133). ..

Here, when it is determined that the notification of [Emphasis on] has been received, the thumbnail enhancement processing unit 52 of the thumbnail processing unit 5 enhances the image of the thumbnail image (step S134). Therefore, when displaying the step S136, S138, S139, S141, S147 thumbnail display control unit 33 the thumbnail image of the image to be reproduced in, which will be described later, thumbnail images image enhancement processing has been performed is displayed Will be.

When the process of step S134 is performed or it is determined in step S133 that the notification of [emphasis on] has not been received, the thumbnail display control unit 33 determines the display method indicated by the received notification (step S135). ).

Here, when it is determined that the notification of [frame switching] has been received, the frame switching animation unit 34 displays the thumbnail image of the main thumbnail expansion memory 39 on the display member 31 (step S136).

Then, the frame switching animation unit 34 determines whether or not a certain time has elapsed since the thumbnail image was displayed on the display member 31 (step S137). Here, if it is determined that the elapse has not occurred, the current display state is continued until it is determined that the elapse has occurred.

When it is determined that the fixed time has elapsed in this way, the frame switching animation unit 34 displays the thumbnail image of the sub-thumbnail expansion memory 40 on the display member 31 (step S138). That is, the thumbnail display control unit 33, which is a display control unit, displays thumbnail images based on a plurality of thumbnail images by frame switching animation.

If it is determined in step S135 that the notification of [transparency change] has been received, the transparency change animation unit 35 displays the thumbnail image of the sub-thumbnail expansion memory 40 on the display member 31 (step S139). ).

Further, the transparency changing animation unit 35 sets the transparency of the main thumbnail image to the minimum (specifically, the transmittance is 0%) (step S140), and then displays the sub-thumbnail image in the process of step S139. The thumbnail image of the main thumbnail expansion memory 39 is displayed on the display member 31 in a form of being superimposed on the display member 31 (step S141). As a result, only the main thumbnail image is observed on the display member 31.

After that, the transparency change animation unit 35 determines whether or not a certain time has elapsed (step S142). Here, if it is determined that the elapse has not occurred, the current display state is continued until it is determined that the elapse has occurred.

In this way, when it is determined that a certain time has passed, the transparency changing animation unit 35 increases the transparency of the main thumbnail image by a certain amount (step S143). As a result, not only the main thumbnail image but also the lower sub-thumbnail image is superimposed and observed on the display member 31.

The transparency changing animation unit 35 determines whether or not the transparency has reached a specified maximum value (specifically, the transmittance is 100%) (step S144). Here, when it is determined that the maximum value has not been reached, the process returns to step S142, and the process of increasing the transmittance at regular time intervals as described above is repeated. That is, the thumbnail display control unit 33, which is a display control unit, displays thumbnail images based on a plurality of thumbnail images by a transparency change animation.

In steps S139 to S144, the main thumbnail image was superimposed on the sub-thumbnail image, and the transparency of the main thumbnail image was changed from the minimum (0%) to the maximum (100%). Of course, the sub-thumbnail image may be superimposed on the main thumbnail image to change the transparency of the sub-thumbnail image from the maximum (100%) to the minimum (0%).

On the other hand, when it is determined in step S135 that the notification of [morphing] has been received, the thumbnail display control unit 33 is based on the thumbnail image of the main thumbnail expansion memory 39 and the thumbnail image of the sub thumbnail expansion memory 40. Morphing data is generated, and the generated morphing data is stored in the morphing data expansion memory 41 (step S145).

Then, the thumbnail generation unit 51 of the thumbnail processing unit 5 generates a thumbnail image based on the morphing data stored in the morphing data expansion memory 41 (step S146).

Then, the morphing animation unit 36 displays the thumbnail image generated in step S146 on the display member 31 (step S147).

After that, the morphing animation unit 36 determines whether or not a certain time has elapsed (step S148). Here, if it is determined that the elapse has not occurred, the current display state is continued until it is determined that the elapse has occurred.

In this way, when it is determined that a certain time has elapsed, the morphing animation unit 36 determines whether or not the maximum time for reproducing the morphing data has been reached (step S149). Here, if it is determined that the value has not been reached, the process returns to step S146 and the above-mentioned process is repeated until it is determined that the value has not been reached. That is, the thumbnail display control unit 33, which is a display control unit, displays thumbnail images based on a plurality of thumbnail images by morphing animation.

According to the first embodiment, when the image data is a composite image data obtained by synthesizing a plurality of image data, the thumbnail generation unit 51 sets the image data before synthesis and the image data after synthesis at least one of them. Since a plurality of thumbnail images are generated based on the above, it is possible to improve the visibility of the thumbnail images related to the composite image data.

Further, since the generated plurality of thumbnail images are recorded in the external memory 11 which is a recording medium, it is not necessary to regenerate the plurality of thumbnail images each time the thumbnail image is displayed, which is convenient. Thumbnail image display is possible.

Since the thumbnail images based on the plurality of thumbnail images are displayed on the display unit 3, it is possible to display the composite image data in an easy-to-understand manner.

With respect to the captured image, the composite image is stored in the external memory 11 because the composite processing unit 63 performs the composite determination and the composite method determination based on whether or not the composite is performed and the composite method when the composite is performed. Thumbnail images can be properly generated before recording in.

For the image recorded in the external memory 11, since the shooting information of the recorded image data is referred to, it is possible to immediately perform the composition determination and the composition method determination.

In the case of comparative bright composition or additive composition, the main thumbnail image is generated based on the image data after composition, and the sub thumbnail image is generated based on the image data before composition, so that natural thumbnails in chronological order are generated. By displaying the image, it can be confirmed that the image data is the composite image data.

On the other hand, in the case of comparative dark composition, the main thumbnail image is generated based on the image data before composition, and the sub-thumbnail image is generated based on the image data after composition, so that the brightness suddenly changes from dark to light. Can be avoided.

Then, since the animation display that changes from the main thumbnail image to the sub-thumbnail image is performed, it is possible to display in an easy-to-understand manner what kind of composition method the composite image data is, and also to display 3D. The load of display processing can be reduced as compared with the thumbnail image of.

Here, when the animation display is performed by the image switching process from the main thumbnail image to the sub thumbnail image, the processing load can be extremely lightened.

Further, when the animation display is performed by the transparency change processing that changes the transparency of the main thumbnail image superimposed on the sub-thumbnail image from the minimum to the maximum, the image change becomes slow, so that it is more visual. You can get a natural display.

Further, when the animation display is performed by the morphing process of changing the shape from the main thumbnail image to the sub thumbnail image, it is possible to obtain a display that changes even more smoothly.

When at least one of a plurality of thumbnail images is subjected to image enhancement processing that emphasizes the image processing effect obtained by the image composition method, even a thumbnail image having a small display size is generated by any composition method. It is possible to easily confirm whether or not the composite image is created.

Then, the thumbnail image generated based on the composite image data is recorded in the external memory 11 at a recording position compatible with the thumbnail image of the normal image data other than the composite image data. Even in a conventional device, processing program, or the like that does not support the display of the thumbnail image of the above, the same display as in the conventional one can be performed, and a highly compatible system can be constructed.

In addition, each part described above may be configured as a circuit. Then, any circuit may be implemented as a single circuit or may be implemented as a combination of a plurality of circuits as long as they can fulfill the same function. Further, the arbitrary circuit is not limited to being configured as a dedicated circuit for fulfilling the desired function, and may be configured to fulfill the desired function by causing a general-purpose circuit to execute a processing program. .. Alternatively, a processor configured as hardware may perform processing of each part.

Further, although the image processing apparatus has been mainly described above, an image processing method may be used, a processing program for causing the computer to perform the same processing as the image processing apparatus, and a computer that records the processing program can read the processing program. It may be a non-temporary recording medium, etc.

Furthermore, the present invention is not limited to the above-described embodiment as it is, and at the implementation stage, the components can be modified and embodied within a range that does not deviate from the gist thereof. In addition, various aspects of the invention can be formed by an appropriate combination of the plurality of components disclosed in the above-described embodiment. For example, some components may be removed from all the components shown in the embodiments. In addition, components across different embodiments may be combined as appropriate. As described above, it goes without saying that various modifications and applications are possible within a range that does not deviate from the gist of the invention.

1 ... Imaging device 2 ... Imaging unit 3 ... Display unit 5 ... Thumbnail processing unit 6 ... Synthesis control unit 7 ... Shooting information acquisition unit 8 ... Input unit 9 ... Development processing unit 10 ... Internal memory 11 ... External memory 12 ... Image processing unit 13 ... System control unit 21 ... Drive control unit 22 ... Lens 23 ... Aperture 24 ... Shutter 25 ... Image sensor 31 ... Display member 32 ... Playback information acquisition unit 33 ... Thumbnail display control unit 34 ... Frame switching animation unit 35 ... Transparency change Animation unit 36 ... Morphing animation unit 37 ... Display memory 38 ... Display image expansion memory 39 ... Main thumbnail expansion memory 40 ... Secondary thumbnail expansion memory 41 ... Morphing data expansion memory 51 ... Thumbnail generation unit 52 ... Thumbnail enhancement processing unit 61 ... Composite Judgment unit 62 ... Synthesis method Judgment unit 63 ... Synthesis processing unit 111 ... Image data 112 ... Header 113 ... Main image data 114 ... Footer 115 ... Shooting information storage area 116 ... First thumbnail storage area 117 ... Image enhancement flag 118 ... Composite shooting Flag 119 ... Thumbnail storage position information 120 ... Second thumbnail storage area

Claims (12)

A compositing determination unit that determines whether or not the image data is a composite image data obtained by compositing a plurality of image data,
When the determination result of the composition determination unit is the composition image data, the composition method determination unit that determines the composition method of the composition image data, and the composition method determination unit.
A thumbnail image generation unit that generates a plurality of thumbnail images based on at least one of the image data before synthesis and the image data after synthesis of the composite image data according to the synthesis method determined by the synthesis method determination unit.
An image processing device characterized by comprising. The image processing apparatus according to claim 1, further comprising a recording control unit that controls the plurality of thumbnail images generated by the thumbnail image generation unit to be recorded on a recording medium. A display unit that displays image data and
A display control unit that controls a thumbnail image based on the plurality of thumbnail images generated by the thumbnail image generation unit to be displayed on the display unit.
The image processing apparatus according to claim 1, further comprising. A compositing processing unit that synthesizes the plurality of image data to generate the composite image data is further provided.
The composition determination unit determines whether or not the image data is the composition image data based on whether or not the composition processing unit performs composition.
The claim is characterized in that the synthesis method determination unit determines a synthesis method to be performed when the synthesis processing unit generates the composite image data when the determination result of the synthesis determination unit is composite image data. the image processing apparatus according to 1. The composition determination unit determines whether or not the image data is the composition image data based on whether or not the composition method is recorded as the shooting information of the image data.
The composition method determination unit according to claim 2 , wherein when the determination result of the composition determination unit is the composition image data, the composition method determination unit determines the composition method recorded as the shooting information of the composition image data. Image processing device. The plurality of thumbnail images include one main thumbnail image and one sub-thumbnail image.
The synthesis method determination unit further determines whether or not the synthesis method of the composite image data is comparative bright synthesis or additive synthesis.
When the composition method determination unit determines that the comparative bright composition or the addition composition is performed, the thumbnail image generation unit generates the main thumbnail image based on the image data after the composition, and the image before the composition. The image processing apparatus according to claim 1, wherein the sub-thumbnail image is generated based on the data. The plurality of thumbnail images include one main thumbnail image and one sub-thumbnail image.
The synthesis method determination unit further determines whether or not the synthesis method of the composite image data is comparative dark synthesis.
When the composition method determination unit determines that the comparative dark composition is performed, the thumbnail image generation unit generates the main thumbnail image based on the image data before composition, and the thumbnail image generation unit generates the main thumbnail image based on the image data after composition. The image processing apparatus according to claim 1, wherein a sub-thumbnail image is generated. A display unit that displays image data and
A display control unit that controls a thumbnail image based on the plurality of thumbnail images generated by the thumbnail image generation unit to be displayed on the display unit.
With more
The image processing device according to claim 6 or 7, wherein the display control unit causes the display unit to display an animation that changes from the main thumbnail image to the sub-thumbnail image. The display control unit changes the image switching process from the main thumbnail image to the sub-thumbnail image, and changes the transparency of the main thumbnail image superimposed on the sub-thumbnail image from the minimum to the maximum in the animation display. The image processing apparatus according to claim 8, wherein the image processing apparatus is performed by a transparency changing process or a morphing process of changing the shape from the main thumbnail image to the sub thumbnail image. At least one of the plurality of thumbnail images generated by the thumbnail image generation unit is further provided with an image enhancement unit that performs image enhancement processing that emphasizes the image processing effect obtained by the composition method determined by the composition method determination unit. The image processing apparatus according to claim 1, further comprising. The thumbnail image generation unit generates one of the plurality of thumbnail images based on the combined image data.
The recording control unit records the thumbnail image generated based on the composited image data at a recording position on the recording medium compatible with the thumbnail image of normal image data other than the composite image data. The image processing apparatus according to claim 2, wherein the image processing apparatus is characterized by the above. A composite determination step for determining whether or not the image data is composite image data obtained by synthesizing a plurality of image data,
When the determination result of the composition determination step is the composition image data, the composition method determination step for determining the composition method of the composition image data and the composition method determination step.
A thumbnail image generation step of generating a plurality of thumbnail images based on at least one of the image data before synthesis and the image data after synthesis of the composite image data according to the synthesis method determined by the synthesis method determination step.
An image processing method characterized by comprising.

Images