JP2007221723A - Image processing apparatus and control method thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing apparatus and a control method thereof for providing information associated with an edit history of image data to a user. <P>SOLUTION: An image edit history tag is recorded to an image file together with the image data. Further, at reproduction, the information associated with the edit history with respect to the image data during display is provided to the user on the basis of contents of the edit history tag recorded together with the image data. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image processing apparatus and a control method therefor, and more particularly, to an image processing apparatus related to image data editing and a control method therefor.

  Conventionally, various information other than image data is recorded in a file (image file) for storing image data and used for processing image data. For example, in an image file compliant with Exif (Exchangable Image Format), various information such as a shooting model, shooting date and time, thumbnail information, and the like can be recorded.

  Techniques for providing services to users using such information have been proposed. For example, Patent Document 1 discloses that a user operation history such as printing or transfer to an external device is recorded as additional information in an image file, and an image search is performed with reference to the additional information during reproduction. . Also, in Patent Document 2, information indicating the relationship with the original image is recorded as additional information in the image file of the editing result at the time of image editing, and the relationship between the original image and the image before and after editing is based on the additional information. It has been proposed to display a tree.

  Image editing includes various editing such as color conversion processing, color balance adjustment, contrast adjustment, edge enhancement, trimming, and red-eye correction.

Japanese Patent Laid-Open No. 11-234604 Japanese Patent Laid-Open No. 2004-064297

  When such image editing processing is applied to image data that has been compression-encoded by an irreversible method typified by the JPEG method, first, decoding, editing processing is applied, and then encoding is performed again. , Image quality deteriorates. Image quality degradation at the time of re-encoding can be suppressed by increasing the compression rate, but degradation cannot be eliminated.

  For example, when a color conversion process that converts red to green is repeatedly applied to the same image, the second and subsequent color conversion processes are not effective and only the image quality deteriorates. For this reason, it has been necessary to prevent image degradation due to repeated editing operations, such as limiting editing operations or limiting the number of image editing operations.

  Even if lossy encoding is not performed, it does not make sense to perform ineffective image editing. From this point of view, it is necessary to provide information for allowing the user to determine whether or not to edit, such as making it possible to easily check the editing history applied to the image before editing the image.

  Further, when the image editing processing function as described above is provided in an image processing apparatus having a function of generating image data, such as an imaging apparatus, another problem occurs. In this case, there is a possibility that the image capturing apparatus will try to apply the editing process to an image captured by another image capturing apparatus that does not have an image editing processing function or an image generated or edited by a personal computer (PC). There is. Therefore, it is necessary to determine whether or not the recording operation has been recorded by an imaging apparatus that does not have an image editing processing function, and to limit the editing operation.

  In addition, when an image processing apparatus having an image editing processing function is applied to an image photographed by another imaging apparatus, there is a problem related to color space compatibility. For example, an image recorded in a color space that is not supported by the image editing processing apparatus cannot be edited (there is a problem that colors cannot be reproduced correctly), but an image recorded in a corresponding color space can be edited. . For this reason, it is necessary to determine whether or not to restrict the editing operation based on image information or the like, and to prevent the editing operation from being erroneously performed only when the image is an uneditable image.

  An object of the present invention is to solve at least one of the problems of the prior art.

  The object described above is an image processing apparatus having image data generating means for generating image data, encoding means for encoding image data, and recording means for recording the encoded image data on a recording medium. The recording means records the encoded image data by providing an area for recording the auxiliary information related to the image data, and information related to the image editing process applied to the image data is recorded in the area for recording the auxiliary information. This is achieved by an image processing apparatus including an area for recording the image.

  Further, the above-mentioned object is applied to image data by acquiring acquisition means for acquiring image data, display control means for displaying image data on a display device, and analyzing additional information of image data recorded together with the image data. And an analysis means for acquiring information relating to the image editing process, wherein the display control means displays information relating to the image editing process acquired by the analysis means together with the image data. The

  Further, the above-mentioned object is applied to image data by acquiring acquisition means for acquiring image data, display control means for displaying image data on a display device, and analyzing additional information of image data recorded together with the image data. Analysis means for acquiring information relating to the image editing processing performed, and image editing processing means applicable to the image data being displayed by the user-specified image editing processing. It is also achieved by an image processing apparatus characterized by determining whether or not to execute an image editing process designated by the user based on the acquired information relating to the image editing process.

  In addition, the above-described object is an image processing apparatus having an image data generation step for generating image data, an encoding step for encoding the image data, and a recording step for recording the encoded image data on a recording medium. In the recording method, the recording step includes a control step for controlling the recording of the encoded image data by providing an area for recording the auxiliary information regarding the image data, and the area for recording the auxiliary information includes: It is also achieved by a control method for an image processing apparatus including an area for recording information relating to image editing processing applied to image data.

  In addition, the above-described object is applied to image data by acquiring an image data acquisition step, a display control step for displaying the image data on a display device, and reading out additional information of the image data recorded together with the image data. An analysis step for obtaining information relating to the image editing process, and in the display control step, the information relating to the image editing process obtained in the analysis step is displayed together with the image data. Is also achieved.

  In addition, the above-described object is applied to image data by acquiring an image data acquisition step, a display control step for displaying the image data on a display device, and analyzing the attached information of the image data recorded together with the image data. An analysis step for acquiring information related to the image editing process, and an image editing process step applicable to the image data being displayed by the user-specified image editing process, the image editing process acquired by the analysis step It is also achieved by a control method for an image processing apparatus, comprising an image editing process step for determining whether or not to execute an image editing process designated by a user based on information.

  With such a configuration, according to the present invention, the image editing history tag is inserted into the file header, and the editing history is recorded, so that the information for determining whether to perform image editing for the user can be obtained. Can be given. In addition, it is possible to set a limit on the number of times image editing is applied. For example, it is possible to prevent image quality deterioration more than necessary due to execution of an ineffective editing process.

  Further, by controlling image editing based on the presence / absence of an image editing calendar tag and the color space, it is possible to prevent the user from accidentally editing a non-corresponding image. Furthermore, even if an image is captured by another imaging device, an edit processing function can be provided for an editable image.

(First embodiment)
Hereinafter, the present invention will be described in detail using preferred embodiments with reference to the drawings.
FIG. 1 is a block diagram illustrating a configuration example of a digital still camera (DSC) as an example of an image processing apparatus according to an embodiment of the present invention.

(Configuration of image processing apparatus)
Hereinafter, the configuration of the DSC 100 will be described.
10 is a photographing lens, 12 is a mechanical shutter having an aperture function, 14 is an image sensor such as a CCD or CMOS sensor that converts an optical image into an electrical signal, and 16 is an analog signal output from the image sensor 14 that is converted into a digital signal. / D converter.

The timing generation circuit 18 supplies a clock signal and a control signal to the image sensor 14, the A / D converter 16, and the D / A converter 26, and is controlled by the memory control circuit 22 and the system control circuit 50.
The image processing circuit 20 performs predetermined pixel interpolation processing and color conversion processing on the data from the A / D converter 16 or the data from the memory control circuit 22.

  Further, the image processing circuit 20 performs predetermined arithmetic processing using the captured image data. Then, the system control circuit 50 controls the exposure control unit 40 and the distance measurement control unit 42 based on the obtained calculation result, and TTL (through the lens) AF (auto focus), AE (automatic exposure). , EF (flash pre-emission) function is realized.

  Further, the image processing circuit 20 performs predetermined arithmetic processing using captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained arithmetic result.

The memory control circuit 22 controls the A / D converter 16, the timing generation circuit 18, the image processing circuit 20, the image display memory 24, the D / A converter 26, the memory 30, and the compression / decompression circuit 32.
The output data of the A / D converter 16 is sent to the image display memory 24 or the memory 30 via the image processing circuit 20 and the memory control circuit 22 or the output data of the A / D converter 16 is sent directly to the memory control circuit 22. Is written to.

  Display image data written in the image display memory 24 is displayed by an image display unit 28 such as an LCD or an organic EL display via a D / A converter 26. An electronic viewfinder function can be realized by sequentially displaying the captured image data on the image display unit 28.

  The image display unit 28 can arbitrarily turn on / off the display according to an instruction from the system control circuit 50. When the display is turned off, the power consumption of the DSC 100 can be greatly reduced.

  Further, the image display unit 28 is coupled to the DSC 100 main body by a rotatable hinge unit, and an electronic finder function, a reproduction display function, and various display functions can be used by setting a free orientation and angle. .

  Further, it is possible to store the display portion of the image display unit 28 toward the DSC 100. In this case, the image display unit open / close detection means 106 detects the storage state and stops the display operation of the image display unit 28. I can do it.

The memory 30 is a storage device for storing captured still images and moving images, and has a storage capacity sufficient to store a predetermined number of still images and a predetermined time of moving images. Therefore, even in continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images to the memory 30 at high speed.
The memory 30 can also be used as a work area for the system control circuit 50.

The compression / decompression circuit 32 reads an image stored in the memory 30, performs well-known data compression processing or decompression processing using adaptive discrete cosine transform (ADCT), wavelet transform, etc., and stores the processed data in the memory 30. Write to.
The exposure control unit 40 controls the shutter 12 having a diaphragm function, and also has a flash light control function in cooperation with the flash 404.

The distance measurement control unit 42 controls focusing of the photographing lens 10, and the zoom control unit 44 controls zooming of the photographing lens 10. The barrier control unit 46 controls the operation of the protection unit 102 that is a lens barrier for protecting the photographing lens 10.
The flash 404 functions as an auxiliary light source at the time of shooting and also has a light control function. It also has a function of projecting AF auxiliary light.

The exposure control unit 40 and the distance measurement control unit 42 are controlled using the TTL method. Based on the calculation result obtained by calculating the captured image data by the image processing circuit 20, the system control circuit 50 performs the exposure control unit 40 and the distance measurement. The controller 42 is controlled.
The connector 48 is also called an accessory shoe, and is provided with an electrical contact with the flash device 400 and a mechanical fixing means.

  The system control circuit 50 is a CPU, for example, and controls the entire DSC 100 by executing a program stored in the memory 52. The memory 52 stores constants, variables, programs, etc. for operating the system control circuit 50.

  The display unit 54 is configured by a combination of output devices such as an LCD, an LED, a speaker, and the like, and outputs an operation state, a message, and the like using characters, images, sounds, and the like according to execution of a program by the system control circuit 50. . One or a plurality of display units 54 are installed at a position in the vicinity of the operation unit 70 of the DSC 100 that is easily visible. A part of the display unit 54 is installed in the optical viewfinder 104.

  The display content of the display unit 54 includes, for example, single shot / continuous shooting display, self-timer display, compression rate display, recording pixel number display, recording number display, remaining image number display, shutter speed display, aperture value display, There are exposure compensation display, flash display and red-eye reduction display. In addition, macro shooting display, buzzer setting display, clock battery remaining amount display, battery remaining amount display, error display, information display with multiple digits, recording medium 200 and 210 attachment / detachment status display, communication I / F operation display, There is also a date / time display and a display showing the connection status with an external computer. Further, there may be a focus display, a shooting preparation completion display, a camera shake warning display, a flash charge display, a recording medium writing operation display, and the like. Some of these are displayed in the optical viewfinder 104.

  Further, among the display contents of the display unit 54, what is displayed by an LED or the like includes, for example, in-focus display, shooting preparation completion display, camera shake warning display, camera shake warning display, flash charge display, flash charge completion display, recording medium There are a writing operation display, a macro shooting setting notification display, a secondary battery charge state display, and the like.

Of the display contents of the display unit 54, what is displayed by a lamp or the like includes, for example, a self-timer notification lamp. This self-timer notification lamp may be used in common with AF auxiliary light.
The nonvolatile memory 56 is an electrically erasable / recordable memory, and for example, an EEPROM or the like is used.

  A mode dial 60, shutter switches 62 and 64, an image display ON / OFF (DISP) switch 66, a single / continuous shooting switch 68 and an operation unit 70 are operating means for inputting various operation instructions to the system control circuit 50. And a single button or a combination of a plurality of buttons, switches, dials, touch panels, pointing by line-of-sight detection, voice recognition devices, and the like.

Here, a specific description of these operating means will be given.
The mode dial switch 60 is a switch for switching and setting each function mode such as power-off, automatic shooting mode, program shooting mode, panoramic shooting mode, playback mode, multi-screen playback / erase mode, PC connection mode, and the like.

  The first shutter switch SW1 (62) is turned on during halfway operation of a shutter button (not shown) provided in the DSC 100, and AF (autofocus) processing, AE (automatic exposure) processing, AWB (automatic) Instructs the start of operations such as white balance processing and EF (flash pre-emission) processing.

  The second shutter switch SW2 (64) is turned on when the operation of a shutter button (not shown) is completed (fully pressed), and the signal read from the image sensor 12 is stored in the memory 30 via the A / D converter 16 and the memory control circuit 22. Exposure processing to be written as image data, development processing using calculation in the image processing circuit 20 or memory control circuit 22, image data is read from the memory 30, compressed by the compression / decompression circuit 32, and recorded on the recording medium 200 or 210. It instructs the start of a series of processes called recording processes for writing data.

  The image display ON / OFF switch 66 is a display ON / OFF setting switch of the image display unit 28. When shooting using the optical viewfinder 104, it is possible to save power by turning off the display of the image display unit 28 such as an LCD to cut off the current supply. The present embodiment has a function as a switch for switching display modes such as simple information display / detailed information display as well as simple image display ON / OFF.

  The single-shot / continuous-shot switch 68 is continuously in a single-shot mode in which one frame is shot and put into a standby state when the shutter switch SW2 (64) is turned on and while the shutter switch SW2 (64) is turned on. This is a switch for setting one of the continuous shooting modes in which shooting is performed.

The recording destination selection switch 115 is a switch for selecting a recording destination of a captured image. In this embodiment, for example, “external storage device”, “recording medium”, and “external storage device and recording medium” can be selected.
The connection / disconnection switch 116 is a switch for instructing establishment / disconnection of communication with an external device.

  The operation unit 70 includes various buttons, a touch panel, and the like. A menu button, a set button, a macro button, a multi-screen playback page break button, a single shooting / continuous shooting / self-timer switching button, a menu movement + (plus) button, a menu movement− There are a (minus) button, a playback image shift + (plus) button, a playback image shift- (minus) button, a shooting image quality selection button, an exposure correction button, a date / time setting button, a compression mode switch, and the like. In addition to this, a playback mode switch that can set each function mode such as a playback mode, a multi-screen playback / erase mode, a PC connection mode, and the like. Alternatively, there is a playback switch for instructing the start of a playback operation that is read from 210 and displayed by the image display unit 28.

  The compression mode switch is a switch for selecting a compression rate for JPEG (Joint Photographic Expert Group) compression, or for selecting a RAW mode in which a signal from an image sensor is directly digitized and recorded on a recording medium.

In the present embodiment, for example, a normal mode and a fine mode are prepared as JPEG compression modes. The user of the DSC 100 can shoot by selecting the normal mode when importance is attached to the data size of the photographed image and the fine mode when importance is attached to the image quality of the photographed image.
In the JPEG compression mode, the compression / decompression circuit 32 reads out the image data written in the memory 30, compresses it to the set compression rate, and then records it on the recording medium 200, for example.

  In the RAW mode, image data is read as it is for each line according to the pixel arrangement of the color filter of the image sensor 14, and the image data written in the memory 30 is read via the A / D converter 16 and the memory control circuit 22. Read and record on the recording medium 200.

  The power control unit 80 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like, detects whether or not a battery is installed, the type of battery, and the remaining battery level. The DC-DC converter is controlled based on an instruction from the system control circuit 50, and a necessary voltage is supplied to each part including the recording medium for a necessary period.

  The power source 86 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, or an AC adapter, and is attached to the DSC 100 by connectors 82 and 84.

  The recording media 200 and 210 such as a memory card and a hard disk have recording units 202 and 212 constituted by a semiconductor memory and a magnetic disk, interfaces 204 and 214 and connectors 206 and 216 with the DSC 100. The recording media 200 and 210 are attached to the DSC 100 via media-side connectors 206 and 216 and DSC 100-side connectors 92 and 96. Interfaces 90 and 94 are connected to the connectors 92 and 96. Whether or not the recording media 202 and 212 are attached is detected by the recording medium attachment / detachment detection unit 98.

In the present embodiment, the DSC 100 is described as having two systems of interfaces and connectors for attaching a recording medium. However, any number of interfaces and connectors for attaching a recording medium can be provided. Different standard interfaces and connectors may be used for each system.
As the interface and connector, for example, a PCMCIA card, a CF (Compact Flash (registered trademark)) card, or the like conforming to a standard can be used.

Furthermore, when the interfaces 90 and 94 and the connectors 92 and 96 are configured using various standards, LAN cards, modem cards, USB cards, IEEE 1394 cards, P1284 cards, SCSI cards, PHS and other communication cards, By connecting various communication cards such as the above, image data and management information attached to the image data can be transferred to and from peripheral devices such as other computers and printers.
The barrier 102 covers the imaging unit including the lens 10 of the DSC 100, thereby preventing the imaging unit from being dirty or damaged.

  The optical finder 104 is, for example, a TTL finder, and forms an image of a light beam that has passed through the lens 10 using a prism or a mirror. By using the optical viewfinder 104, it is possible to take a picture without using the electronic viewfinder function of the image display unit 28. Further, as described above, some functions of the display unit 54 such as an in-focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display, an exposure correction display, etc. are provided in the optical viewfinder 104. Information is displayed.

The image display unit open / close detection unit 106 detects whether or not the display part of the image display unit 28 is in the stored state stored toward the DSC 100. When the storage state is detected, display processing on the image display unit 28 is stopped, and unnecessary power consumption is prevented.
The communication controllers 111 and 113 perform various communication processes such as RS232C, USB, IEEE1394, P1284, SCSI, modem, LAN, and wireless communication.

  The connector 112 is a connector for connecting the DSC 100 to other devices by a wired line such as USB or IEEE1394 by the communication control unit 111. The antenna 114 is an antenna for wireless connection by the communication control unit 113 by wireless LAN communication such as IEEE802.11b and IEEE802.11g, spread spectrum communication such as Bluetooth, infrared communication such as IrDA, and the like.

Here, although the case where the DSC of the present embodiment has both a wired connector and a wireless connection antenna will be described, a configuration having only a wired connection or a wireless connection may be adopted.
The flash device 400 is a so-called external flash, and includes a flash 404 and a connector 402. The flash 404 also has an AF auxiliary light projecting function and a flash light control function. By attaching / detaching the connector 402 to / from the accessory shoe 48 of the DSC 100, the DSC 100 can be connected and disconnected.

FIG. 12 is a diagram schematically illustrating an example of an appearance when the DSC described in FIG. 1 is viewed from the back side.
On the back side of the apparatus, an image display unit 28 and various keys and buttons constituting the operation unit 70 are provided. Here, an up / down / left / right button 1002, an image display ON / OFF switch 66, a SET button 1004, and a menu button 1005 are illustrated.

  The user can perform well-known GUI operations such as moving the cursor in the GUI displayed on the image display unit 28 using the up / down / left / right buttons 1002 and instructing to scroll the screen. The screen display ON / OFF switch 66 is used to switch display modes such as display ON / OFF of the image display unit 28 and simple information display / detailed information display. The SET button 1004 is a so-called determination button, and is used to specify an item in a selected state with the up / down / left / right buttons 1002 or to instruct an operation. The menu button 1005 is used for GUI operation, such as an instruction to turn on / off a menu screen which is a GUI screen for various settings.

(Description of overall operation)
2 to 4 are flowcharts for explaining the overall operation flow of the DSC 100 according to the present embodiment.
Upon power-on such as battery replacement, the system control circuit 50 initializes flags, control variables, and the like, and initializes each component of the DSC 100 (S101). Further, the display of the image display unit 28 is initially set to an OFF state (S102).

  The system control circuit 50 determines the setting position of the mode dial 60 (S103). If the mode dial 60 is set to power OFF, the process proceeds to S105. The imaging unit is protected by changing the display of each display means to the end state and closing the barrier 102. Then, necessary parameters, setting values, and setting modes including flags and control variables are recorded in the nonvolatile memory 56. Thereafter, the power supply control unit 80 performs predetermined end processing such as shutting off unnecessary power of each unit of the digital camera 100 including the image display unit 28. When the end process is finished, the process returns to S103.

On the other hand, if the mode dial 60 is set to the playback mode in S103, the process proceeds to S601 (FIG. 9). If the shooting mode is set, the process proceeds to S106.
In S <b> 106, the system control circuit 50 uses the power supply control unit 80 to determine whether there is a problem in the operation of the DSC 100 with respect to the remaining capacity and operation status of the power supply 86 configured by a battery or the like.

  For example, when it is determined that the remaining capacity of the power supply 86 has a problem in continuing the operation of the DSC 100 (S106, NO), the system control circuit 50 uses the display unit 54 and the image display unit 28 to generate images and sounds. A predetermined warning is given (S108). Then, the process returns to S103.

  When it is determined that the power supply 86 has no problem in the operation of the DSC 100 (S106, YES), the system control circuit 50 checks the state of the recording medium 200 or 210. Specifically, it is determined whether there is a problem in the operation of the DSC 100, particularly the recording / reproducing operation of the recording medium 200 or 210 (S107).

If it is determined that there is a problem (S107, NO), a predetermined warning display according to the problem is performed by an image or sound using the display unit 54 or the image display unit 28 (S108), and the process returns to S103.
If there is no problem in the operation state of the recording medium 200 or 210 (S107, YES), the process proceeds to S109.

  The system control circuit 50 checks the setting state of the single / continuous shooting switch 68 for setting the single shooting mode or the continuous shooting mode (S109). If the single shooting mode is selected, the single shooting / continuous shooting flag is set to “single shooting” (S110). If the continuous shooting mode is selected, the single shooting / continuous shooting flag is set to “continuous shooting”. Both are set (S111) and the process proceeds to S112. The state of the single / continuous shooting flag is stored in the internal memory of the system control circuit 50 or the memory 52.

In step S <b> 112, the system control circuit 50 displays various setting states of the DSC 100 using images and sounds using the display unit 54. In addition, when the display of the image display unit 28 is set to ON, the image display unit 28 is also used for status display in addition to the display unit 54.
Subsequently, the system control circuit 50 checks the setting state of the image display ON / OFF switch 66 (S113). If the image display ON is set, the process proceeds to S114.

  Then, the system control circuit 50 determines whether the image display unit 28 is in the storage state or the display state by the image display unit open / close detection unit 106 (S114). If it is determined that it is in the display state, the image display flag is set (S115), and the image display of the image display unit 28 is set to the ON state (S116). Then, the captured image data is set to a through display state in which the image display unit 28 is sequentially displayed (S117), and the process proceeds to S131 (FIG. 3).

  In the through display state, the data sequentially written in the image display memory 24 via the image sensor 12, the A / D converter 16, the image processing circuit 20, and the memory control circuit 22 are converted into the memory control circuit 22 and the D The images are sequentially displayed by the image display unit 28 via the / A converter 26. Through such sequential display processing, the image display unit 28 is caused to function as an electronic viewfinder (EVF).

  On the other hand, if the image display ON / OFF switch 66 is set to image display OFF in S113, or if the image display unit 28 is determined to be in the storage state by the image display unit open / close detection means 106 in S114. The process proceeds to S118. Then, the image display flag is canceled (S118), the image display of the image display unit 28 is set to the OFF state (S119), and the process proceeds to S131 (FIG. 3).

When the image display is OFF, shooting is performed using the optical viewfinder 104 without using the electronic viewfinder function of the image display unit 28. In this case, it is possible to reduce power consumption of the image display unit 28, the D / A converter 26, and the like that consume a large amount of power.
The state of the image display flag is stored in the internal memory of the system control circuit 50 or the memory 52.

  Referring to FIG. 3, first, in S113, the state of first shutter switch (SW1) 62 is examined. If SW1 that is turned on by half-pressing is OFF, the process returns to S103 (FIG. 2). If the first shutter switch (SW1) 62 is ON, the system control circuit 50 determines the state of the image display flag stored in the internal memory of the system control circuit 50 or the memory 52 (S132). Then, the system control circuit 50 checks the image display flag of the image display unit 28 (S132). If the image display flag is set, the display state of the image display unit 28 is set to the freeze display state (update is stopped) (S133), and the process proceeds to S134.

  In the freeze display state, rewriting of image data in the image display memory 24 via the image sensor 12, A / D converter 16, image processing unit 20, and memory control unit 22 is prohibited. Then, the image data written last is displayed on the image display unit 28 via the memory control unit 22 and the D / A converter 26, thereby displaying the frozen video.

On the other hand, if the image display flag has been canceled in S132, the process proceeds to S134.
In S134, the system control circuit 50 performs a distance measurement process to focus the photographing lens 10 on the subject, performs a photometry process, and determines an aperture value and a shutter time. In the photometric process, the flash is set if necessary. Details of the distance measurement / photometry processing S134 will be described later with reference to FIG.

After completing the distance measurement / photometry process S134, the system control circuit 50 determines that the shutter speed to be set is higher than the maximum speed of the mechanical shutter based on the set photographing operation mode and the exposure result determined in the distance measurement / photometry process. It is determined whether the time is shorter (S135). If the shutter speed is not shorter than the maximum speed of the mechanical shutter (if the shutter speed is compatible with the mechanical shutter), the shutter time is set for the mechanical shutter (S136), and the process proceeds to S138.
If the shutter speed is too high to be handled by the mechanical shutter, the shutter time setting using both the mechanical shutter and the electronic shutter is set (S137), and the process proceeds to S138.

  In S138, the system control circuit 50 determines the state of the image display flag stored in the internal memory of the system control circuit 50 or the memory 52 (S138). If the image display flag has been set, the display state of the image display unit 28 is set to the through display state as in S117 (S139), and the process proceeds to S140. If the image display flag is cancelled, the process proceeds to S140 without doing anything.

  Thus, when the shutter speed to be set is shorter than the fastest shutter time that can be handled by the mechanical shutter, the electronic shutter is set to be used together. As a result, it is possible to prevent smear due to the mechanical shutter and to enable a high shutter speed with the electronic shutter.

  In S140, the state of the second shutter switch (SW2) 64 that is turned on when fully pressed is checked. When SW2 is OFF, the state of the first shutter switch (SW1) 62 is further checked (S141). If SW1 is kept ON, the process returns to S141, and if SW1 is OFF, the process returns to S103 (FIG. 2). .

  On the other hand, if the second shutter switch (SW2) 64 is ON, the system control circuit 50 determines the state of the image display flag stored in the internal memory of the system control circuit 50 or the memory 52 (S142). If the image display flag is set, the display state of the image display unit 28 is set to the fixed color display state (S143), and the process proceeds to S161 (FIG. 4).

In the fixed color display state, the captured image data written in the image display memory 24 via the image sensor 12, the A / D converter 16, the image processing unit 20, and the memory control unit 22 is not displayed. Instead, the fixed color image data is displayed on the image display unit 28 via the memory control unit 22 and the D / A converter 26, thereby displaying the fixed color image on the EVF.
On the other hand, if the image display flag has been canceled in S142, the process directly proceeds to S161 (FIG. 4).

  Referring to FIG. 4, in S <b> 161, the system control circuit 50 determines the state of the single / continuous shooting flag stored in the internal memory of the system control circuit 50 or the memory 52. If “Single Shot” is set, the process proceeds to S162. If “Continuous Shot” is set, the process proceeds to S181.

(Operation in single-shot mode)
In S162, shooting processing is performed. The system control unit 50 captures an image in the memory 30 via the imaging device 12, the A / D converter 16, the image processing unit 20, the memory control unit 22, or directly from the A / D converter via the memory control unit 22. Write the processed image data. This series of processing is called exposure processing. Further, using the memory control unit 22 (also the image processing unit 20 as necessary), the image data written in the memory 30 is read and various image processing (development processing) is performed. Details of the photographing process performed in S162 will be described later with reference to FIG.

  When the photographing process is completed, the system control circuit 50 determines the state of the image display flag stored in the internal memory of the system control circuit 50 or the memory 52 (S163). If the image display flag is set, the quick review 1 display for displaying the captured image data on the image display unit 28 for a short time is performed (S164). Specifically, the image data processed in accordance with the display format of the image display unit 28 is read from the memory 30, and the display image data is transferred to the image display memory 24 via the memory control circuit 22. Then, the display image data read from the image display memory 24 is displayed on the image display unit 28.

  When this quick review 1 display process is executed, the dark capture process S165 is not performed. Therefore, display image data is created using the image data before dark correction calculation, and quick review 1 display is performed. In addition, characters such as “busy” are displayed on the quick review image display on the image display unit 28 so as to overlap the image.

  As described above, in the single shooting mode, the photographing process is performed before the dark capturing process, and the image data before dark correction is used for the quick review display. As a result, the shutter release time lag can be shortened, and quick review display can be performed immediately after shooting.

  On the other hand, if the image display flag is canceled in S163, the process proceeds to S165 as it is. In this case, the display of the image display unit 28 remains OFF even after shooting, and no quick review display is performed. Therefore, when it is not necessary to check the photographed image immediately after photographing as in the case of continuing photographing using the optical viewfinder 104, the power consumption is suppressed by setting the image display unit 28 not to display. Is possible.

  In S165, the system control circuit 50 accumulates noise components such as dark current of the image sensor 14 for the same time as the main photographing with the shutter 12 closed, and performs a dark capturing process for reading out the noise image signal after the accumulation ( The process proceeds to S165) and S166.

By performing the correction calculation process using the dark image data captured in the dark capturing process, the captured image data is related to image quality degradation such as dark current noise generated by the image sensor 14 and pixel defects due to scratches unique to the image sensor 14. Can be corrected.
Details of the dark capturing process S165 will be described later with reference to FIG.

  The system control circuit 50 reads out part of the image data written in the predetermined area of the memory 30 via the memory control circuit 22. Then, WB (white balance) integration calculation processing and OB (optical black) integration calculation processing necessary for performing the development processing are performed, and the calculation result is stored in the internal memory or the memory 52 of the system control circuit 50.

  Next, the system control circuit 50 reads out the photographed image data written in a predetermined area of the memory 30 using the memory control circuit 22 and, if necessary, the image processing circuit 20. Then, using the WB and OB calculation results stored in the internal memory of the system control circuit 50 or the memory 52, various development processes including AWB (auto white balance) processing, gamma conversion processing, and color conversion processing are performed (S166). .

Further, in the development processing, dark correction calculation processing for canceling dark current noise and the like of the image sensor 14 is also performed by subtracting the dark image data captured in the dark capturing processing in step S165. The image data after development processing is written in the memory 30.
Details of the development processing S166 will be described later with reference to FIG.

  Next, the system control circuit 50 reads the developed image data written in the predetermined area of the memory 30 and performs the image compression / encoding process according to the set mode by the compression / decompression circuit 32 (S167). .

  In the present embodiment, the captured image data is recorded in a file format compliant with Exif. The system control circuit 50 records additional information such as the shooting date and time, the model ID of the camera, and the color effect mode at the time of shooting in a tag defined by Exif. Further, an image editing history tag is inserted into the Exif attached information (S174), and image data that has been photographed and finished a series of processing is written into an empty image portion of the image storage buffer area of the memory 30. FIG. 19 shows an example of the structure of the image editing history tag.

  As shown in FIG. 19, the image editing history tag in the present embodiment describes the total editing count, color editing count, and red-eye correction count at the top. Then, after specifying the number of editing history areas (N in this case) included in the tag and the data length of the editing history area, details of individual editing histories are sequentially added.

  In this example, it is assumed that a history relating to color editing and red-eye correction is recorded in the image editing history tag. However, it is also possible to record three or more types or only one type of image editing. .

  The system control circuit 50 reads the image data stored in the image storage buffer area of the memory 30, and the recording medium 200 such as a memory card or a compact flash (registered trademark) card via the interface 90 or 94 and the connector 92 or 96. Alternatively, a recording process for writing to 210 is performed (S168).

  The system control circuit 50 displays a recording medium writing operation display such as blinking an LED on the display unit 54 in order to clearly indicate that the writing operation is in progress while the image data is being written to the recording medium 200 or 210. I do.

  The system control circuit 50 determines the state of the image display flag stored in the internal memory or the memory 52 (S169). If the image display flag is set, the image data processed in accordance with the display format of the image display unit 28 is read from the memory 30 and the display image data is transferred to the image display memory 24 via the memory control circuit 22. I do. Then, by displaying the display image data read from the image display memory 24 on the image display unit 28, quick review 2 display is performed (S170).

  Unlike the quick review 1 display process in S164, the dark capture process is completed when the quick review 2 display process is performed. Therefore, in the quick review 2 display process, display image data is created using the image data after the dark correction calculation is performed in the development process, and the quick review display is performed.

  As described above, in the single shooting mode, first, the photographing process is performed before the dark capturing process, and the quick review 1 display is performed using the image data before dark correction. Further, after the dark capturing process, the quick review 2 display is performed using the image data after dark correction. With such a configuration, it is possible to shorten the shutter release time lag and perform quick review display immediately after shooting.

  Note that since the dark capture processing has been completed at the time of the quick review 2 display in S170, characters such as “busy” displayed over the quick review image in the quick review 1 display are deleted.

  On the other hand, if the image display flag has been canceled in S169, the process proceeds to S171 while the image display unit 28 remains OFF. In this case, the image display unit 28 remains off even after shooting, and no quick review display is performed. In this case, power consumption can be suppressed as described above.

  Thereafter, the system control circuit 50 stands by until the shutter switch SW1 (62) is turned OFF (S171), and when the shutter switch SW1 (62) is turned OFF, the system control circuit 50 proceeds to S172.

  The system control circuit 50 determines the state of the image display flag stored in the internal memory or the memory 52 (S172). If the image display flag has been set, the display state of the image display unit 28 is set to the through display state (S173), and if it has been canceled, nothing is done and the process returns to S103 (FIG. 2).

(Operation in continuous shooting mode)
Next, the operation in the continuous shooting mode will be described. If it is determined in S161 that the state of the single / continuous shooting flag is set, if the continuous shooting is set, the process proceeds to S181.
In S181, the system control circuit 50 performs a dark capturing process in the same manner as in S165, and proceeds to S182. Details of the dark capturing process will be described later with reference to FIG.

  In S182 and S183, the system control circuit 50 performs the photographing process and the developing process in the same manner as S162 and S163. Details of the photographing process and the developing process will be described later with reference to FIGS.

  The system control circuit 50 determines the state of the image display flag stored in the internal memory or the memory 52 (S184). If the image display flag has been set, the image data processed in accordance with the display format of the image display unit 28 is read from the memory 30, and the display image data is transferred to the image display memory 24 via the memory control circuit 22. I do. Then, a quick review 3 display process for displaying the display image data read from the image display memory 24 on the image display unit 28 is performed (S185).

  In this quick review 3 display process, the dark capture process has already been completed, as in the quick review 2 display process in the single-shot mode. Therefore, display image data is created using the image data after the dark correction calculation in the development processing of S183, and quick review display is performed.

  As described above, in the continuous shooting mode, by performing the quick review 3 display using the image data after dark correction, the interval between the continuous shooting frames of the first image and the second image and the subsequent images is substantially uniform, and after shooting. Quick review display can be performed immediately.

If the image display flag has been canceled (S184), the process proceeds to S186 while the image display unit 28 remains OFF. In this case, the image display unit 28 remains off even after shooting, and no quick review display is performed.
Then, the system control circuit 50 reads out the image data written in the predetermined area of the memory 30, and starts the image compression processing according to the set mode by the compression / decompression circuit 32 (S186).

  The system control circuit 50 performs compression encoding processing and image editing tag insertion processing (S186, S192) in the same manner as S167 and S174 in the single shooting mode. An example of the structure of the image editing history tag is shown in FIG. Then, it is checked whether or not there is an empty image storage buffer area in the memory 30 (S187). If there is an empty space, the image data after the compression processing is sequentially written, and the process proceeds to S189.

  On the other hand, if there is no space in the image storage buffer area of the memory 30 (S187), the system control circuit 50 performs a recording process. That is, the image data stored in the image storage buffer area of the memory 30 is read and written to the recording medium 200 or 210 such as a memory card or a compact flash (registered trademark) card via the interface 90 or 94 and the connector 92 or 96. . Then, the process proceeds to S189.

As a result, when the continuous shooting is performed for a predetermined number or more and the image recording buffer area is insufficient, a recording process is performed to make a space in the image recording buffer area, and the continuous shooting can be resumed. .
Note that when performing the recording process in S188, there is no problem even if a predetermined warning is displayed by an image or sound using the image display unit 28 or the display unit 54.

The system control circuit 50 checks the state of the shutter switch SW2 (64) in S189. If it is still ON, the process returns to S182, and a series of continuous shooting processes are repeated.
If the shutter switch SW2 (64) is OFF, the system control circuit 50 further determines the state of the shutter switch SW1 (62) (S190).
If the shutter switch SW1 (62) is ON, the process returns to S189. If it is OFF, the process proceeds to S191, and the system control circuit 50 performs the recording process similar to S188.

During the writing of image data to the recording medium 200 or 210, a recording medium writing operation display such as blinking an LED is performed on the display unit 54 in order to clearly indicate that the writing operation is in progress.
If the recording process of S191 is completed, the process proceeds to S172.

  The system control circuit 50 determines the state of the image display flag stored in the internal memory or the memory 52 (S172). If the image display flag has been set, the display state of the image display unit 28 is set to the through display state (S173), and if it has been canceled, nothing is done and the process returns to S103 (FIG. 2).

  As described above, in the present embodiment, after confirming the captured image by the quick review display on the image display unit 28, it is possible to enter a through display state in which image data captured for the next capturing is sequentially displayed.

(Details of distance measurement and photometry processing)
FIG. 5 shows a detailed flowchart of the distance measurement / photometry process in S134 of FIG.
The system control circuit 50 reads the charge signal from the image sensor 14 and sequentially reads the captured image data into the image processing circuit 20 via the A / D converter 16 (S201). Using the sequentially read image data, the image processing circuit 20 is a predetermined used for TTL (through-the-lens) AE (automatic exposure) processing, EF (flash pre-flash) processing, and AF (autofocus) processing. The operation is performed.

  In each processing here, a specific portion of the total number of photographed pixels is extracted by extracting a necessary portion according to necessity and used for calculation. This makes it possible to perform optimum calculations for different modes such as the center-weighted mode, the average mode, and the evaluation mode in each of the TTL method AE, EF, AWB, and AF processes.

Using the calculation result in the image processing circuit 20, the system control circuit 50 performs AE control using the exposure control unit 40 (S203) until it is determined that the exposure (AE) is appropriate (S202).
Using the measurement data obtained by the AE control, the system control circuit 50 determines whether or not the flash is necessary (S204), sets the flash flag if the flash is necessary, and charges the flash 404 (S205).

If it is determined that the exposure (AE) is appropriate (S202), the measurement data and / or the setting parameters are stored in the internal memory or the memory 52 of the system control circuit 50.
Using the calculation result in the image processing circuit 20 and the measurement data obtained by the AE control, the system control circuit 50 uses the image processing circuit 20 to determine the color until the white balance (AWB) is determined to be appropriate (S206). The AWB control is performed by adjusting the processing parameters (S207).

  If it is determined that the white balance (AWB) is appropriate (S206), the measurement data and / or setting parameters are stored in the internal memory or the memory 52 of the system control circuit 50.

  Using the measurement data obtained by the AE control and the AWB control, the system control circuit 50 performs the AF control using the distance measurement control unit 42 until the distance measurement (AF) is determined to be in focus (S208) (S208). S209).

  If the distance measurement (AF) is determined to be in focus (S208), the measurement data and / or the setting parameters are stored in the internal memory or the memory 52 of the system control circuit 50, and the distance measurement / photometry processing routine S134 is terminated.

(Details of shooting process)
FIG. 6 shows a detailed flowchart of the photographing process in S162 and S182 of FIG.
The system control circuit 50 performs the charge clear operation of the image sensor 14 (S301), starts the charge accumulation of the image sensor 14 (S302), opens the shutter 12 by the shutter control unit 40 (S303), and performs imaging. The exposure of the element 14 is started (S304).

Here, it is determined whether or not the flash 404 is necessary based on the flash flag (S305), and if necessary, the flash is emitted (S306).
If the flash 404 cannot be used, the process proceeds to S307.

  The system control circuit 50 waits for the end of exposure of the image sensor 14 according to the photometric data (S307), closes the shutter 12 by the exposure control unit 40 (S308), and ends the exposure of the image sensor 14.

If the set charge accumulation time has elapsed (S309), the system control circuit 50 reads the charge signal from the image sensor 14 after completing the charge accumulation of the image sensor 14 (S310). Then, the captured image data to a predetermined area of the memory 30 is sent via the A / D converter 16, the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter 16 via the memory control circuit 22. Write (S311).
When the series of processing is finished, the photographing processing routines S162 and S182 are finished.

(Details of dark capture processing)
FIG. 7 shows a detailed flowchart of the dark capturing process in S165 and S181 of FIG.
After performing the charge clear operation of the image sensor 14 (S401), the system control circuit 50 starts charge accumulation of the image sensor 14 with the shutter 12 closed (S402).

  If the set predetermined charge accumulation time has elapsed (S403), the system control circuit 50 reads the charge signal from the image sensor 14 after completing the charge accumulation of the image sensor 14 (S404). Then, the image data (dark image) is transferred to a predetermined area of the memory 30 via the A / D converter 16, the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter 16 via the memory control circuit 22. Data) is written (S405).

By performing development processing using the dark image data, the captured image data can be corrected with respect to image quality degradation such as dark current noise generated by the image sensor 14 and pixel defects due to scratches inherent to the image sensor 14.
The dark image data is held in a predetermined area of the memory 30 until a new dark capturing process is performed or the DSC 100 is turned off.

Alternatively, a part or all of the memory 30 may be configured by a nonvolatile memory such as an EEPROM or a hard disk, and the dark image data may be written in the nonvolatile memory. In this case, the dark image data is held in a predetermined area of the nonvolatile memory until a new dark capturing process is performed.
The dark image data is used for developing the captured image data.
When the series of processing is finished, the dark capturing processing routines S165 and S181 are finished.

(Details of development processing)
FIG. 8 shows a detailed flowchart of the development processing in S166 and S183 in FIG.
The system control circuit 50 reads captured image data and dark image data written in the memory 30. Then, luminance signal processing (S501), color processing according to the set color effect mode (S502), red-eye detection / correction processing (S503), and thumbnail image processing (S504) are sequentially performed. The image data that has undergone these processes is written into the memory 30 as image data that has been developed.
When the series of processing is finished, the development processing routines S166 and S183 are finished.

(Processing in playback mode)
Next, processing in the playback mode of the DSC of this embodiment will be described using the flowchart shown in FIG.
In S103 of FIG. 2, the system control circuit 50 checks the state of the mode dial 60. If the playback mode is set, the process proceeds to S601.

  The system control circuit 50 determines the setting position of the mode dial 60, and if the mode dial 60 is set to power OFF, the process proceeds to S602. Then, the same end process as S105 is performed, and the process returns to S103. If the mode dial 60 is set to the shooting mode in S601, the process returns to S103.

  When the mode dial 60 is set to the reproduction mode, the system control circuit 50 checks the power supply 86 and the recording media 200 and 210 in S603 to S605 as in S106 to S108, and gives a warning if there is a problem. To return to S103. If there is no problem with the power source 86 and the recording media 200 and 210, the process proceeds to S606.

  In step S606, the system control circuit 50 searches the recording media 200 and 210 for an image file recorded with a file structure in accordance with the DCF standard. If no image file is found, a warning message (for example, “no image”) is displayed on the image display unit 28, and the process proceeds to S601.

  On the other hand, if an image file is found in the recording medium 200 or 210, the process proceeds to S608, and the last recorded image file is searched. In DCF, the image file with the largest file number is the last recorded image file. The system control circuit 50 reads the image file with the largest file number from the recording medium and displays it on the image display unit 28 (S609). Details of the image display processing will be described later.

  After displaying the image (S609), the system control circuit 50 waits for a user operation input (S610). If the mode dial 60 is operated, the process proceeds to S601. When the left / right button of the up / down / left / right button 1002 (FIG. 12) is operated, the process proceeds to S611. If there are a plurality of image files in the recording medium (S611, Y), the image file with the file number before or after is searched according to the left and right operation directions (S612), and display processing is performed (S609). If there is only one image file, the process returns to S610.

  When the MENU button 1005 is operated in S610, the system control circuit 50 performs image editing processing (S613). Details of the image editing process will be described later.

(Details of image display processing)
FIG. 10 shows a detailed flowchart of the image display process in S609 of FIG.
The system control circuit 50 analyzes the header of the encoded image file to be reproduced and displayed (S650). Then, basic attached information such as the shooting mode, shooting time, image size, camera MoodelID, and color effect mode is acquired from the attached information including the Exif information.

  Next, the system control circuit 50 checks whether an edit history tag exists in the header (S651). If no editing history tag is found, an image is displayed together with the contents of other attached information. Here, information about the color effect mode, red-eye correction presence / absence, shooting mode, shooting date / time, and image size is displayed together with the image. The color effect mode and red-eye correction presence / absence are displayed using icons corresponding to the information.

  Therefore, the system control circuit 50 determines the type of the icon (S653) indicating the color effect mode applied at the time of shooting and the icon (S654) indicating whether the red-eye correction has been performed at the time of shooting from the contents of the attached information. Further, for the shooting mode, shooting date and time, and image size, bitmap data is generated from a character string corresponding to each information (S661). Next, the system control circuit 50 decodes the encoded image file by the compression / decompression circuit 32 (S662). Then, the image data is resized according to the size of the image display memory 24 corresponding to the display size of the image display unit 28 (S663).

  The system control circuit 50 reads bitmap data corresponding to the icon type determined in S653 and S654 from, for example, the nonvolatile memory 56, and combines it with the resized image data together with the bitmap data of the character information generated in S661. . Then, the composite image data is written into the image display memory 24 and displayed on the image display unit 28 (S664).

If the display plane for the attached information and the display plane for the captured image data can be controlled independently in the image display memory 24, the attached information may be displayed before image synthesis.
On the other hand, in S651, when an edit history tag is found in the header, the system control circuit 50 performs the following processing according to the content of the edit history tag.

  First, in S652, the system control circuit 50 checks whether the total number of edits is zero. If the total number of edits is 0, the process proceeds to S653, and the same processing as when there is no edit history tag is performed.

A detailed information display example of an unedited image is shown in FIG.
An icon 1201 indicates a shooting mode at the time of shooting. Here, the icon indicates that shooting was performed in a switch color mode in which a specific color is converted and recorded. Reference numeral 1202 denotes a folder number and an image file number. Reference numeral 1203 indicates the total number of images in the same recording medium (two) and the number of images being displayed (first). Reference numerals 1204 and 1209 denote shooting dates and times. Reference numeral 1205 denotes an icon indicating a color effect mode applied at the time of shooting. Here, the switch color mode, which is a color effect mode for converting a specific color into another color, is applied. Reference numeral 1206 denotes an image file size, and 1207 denotes the number of pixels (image size). An icon 1210 indicates that red-eye correction has been performed at the time of shooting, and is not displayed when red-eye correction has not been performed.

  Further, the detailed information display and the simple information display can be switched by operating the image display ON / OFF button 66 during the detailed information display. FIG. 13 shows an example of simple information display, and as is clear from comparison with FIG. 14, only a part of the detailed information display information is displayed.

  Returning to FIG. 10, when the total number of edits is not 0 in S652 (S652), the system control circuit 50 determines the display of the icon indicating the edited and total number of edits (S655). Next, it is checked whether or not color editing as an example of specific image editing has been performed once or more (S657). If the number of color edits is not 0, the display of the color effect mode applied at the time of final edit and the icon indicating the number of color edits is determined (S658), and the process proceeds to S659. If the number of color edits is 0, the process proceeds directly to S659.

  In step S659, the system control circuit 50 checks whether red-eye correction as another example of specific image editing has been performed once or more. If the red-eye correction count is not 0, display of an icon indicating that red-eye correction has been completed and the red-eye correction count is determined (S660), and the process proceeds to S661. If the red-eye correction count is 0, the process proceeds directly to S661.

  In S661 and thereafter, similarly to the display processing of the unedited image, the display processing using the icon data determined to be displayed, the bitmap of the character information, and the decoded image data is performed. Here, the case has been described where the image editing history tag has a format for recording color editing processing and red-eye correction processing as shown in FIG. However, what kind of image editing processing is performed, whether or not the processing is performed, the number of times of processing, and detailed contents are recorded in the image editing history tag, and which information in the image editing history tag is used for notification is appropriately determined. It is possible.

A detailed information display example of the edited image is shown in FIG.
FIG. 15 is an example of detailed information display display for an image that has undergone two color editing operations.
15, the same display as in FIG. 14 is given the same reference numeral, and the description is omitted. The example of FIG. 15 is different in that an icon 1303 indicating the image edited and the total number of edits and an icon 1304 indicating the color effect mode and the number of color edits at the time of final editing are displayed. The icon 1303 indicates that the currently displayed image data has been edited twice. Further, the icon 1304 indicates that the color editing operation has been performed twice in the reproduction mode, and that the color editing performed last is the color effect mode “monochrome” for converting only the luminance signal.

Another detailed information display example of the edited image is shown in FIG.
FIG. 22 is a detailed information display example of an image that has been subjected to the color editing operation twice as in FIG.
The example of FIG. 22 is different from the example of FIG. 15 in that icons 1807 indicating the red-eye corrected and red-eye corrected edit count are displayed.

  The icon 1303 indicates that the currently displayed image data has been edited twice. Further, the icon 1304 indicates that the color editing operation is performed once in the reproduction mode, and that the color editing performed last is the color effect mode “monochrome” in which only the luminance signal is converted. An icon 1807 indicates that the red-eye correction operation has been performed once.

  In this way, by using the color effect mode / red-eye correction display area applied at the time of shooting and displaying the color effect mode / red-eye correction display during editing, the limited area can be used efficiently. be able to. Further, by displaying the edited icon 1303 together, it is possible to easily determine whether or not the edited icon has been edited. Further, by displaying the number of edits, it is possible to notify the user which edit has been performed and how many times.

  In this way, by switching the information display according to the content of the editing history recorded in the image file, the user can easily grasp the editing history that has been applied to the displayed image. For this reason, the user can determine whether or not to perform further editing operations on the displayed image using, for example, the total number of editing operations and the number of color editing operations.

(Image editing process)
FIG. 11 shows a detailed flowchart of the image editing process in S613 of FIG.
First, the system control circuit 50 displays an image editing menu on the image display unit 28 (S701).

FIG. 20 is a diagram illustrating an example of the image editing menu.
The user can select an arbitrary menu item by operating the up / down buttons of the up / down / left / right button 1002. Further, when the SET button 1004 is pressed, an instruction to execute the menu item in the selected state can be issued. Further, by pressing the MENU button 1005, the image editing process can be canceled.

In step S <b> 702, the system control circuit 50 moves the cursor in the menu screen according to the input of the up / down button and waits for the SET button 1004 or the MENU button 1005 to be pressed.
If the MENU button 1005 is pressed, the image editing process is canceled and the process returns to S610 (FIG. 9).

  When the SET button 1004 is pressed, processing corresponding to the currently selected menu item is performed. Here, for the sake of convenience, description of processing when “Protect” for protecting an image from deletion or editing and “Rotation” for rotating the image 90 ° clockwise, for example, are omitted.

  When color editing is selected and executed, the system control circuit 50 displays a color editing screen on the image display unit 28 (S703) and waits for a user operation input (S704).

FIG. 16 shows an example of the color editing screen.
In the color editing screen, the SET button function display 1401 and the MENU button function display 1402 are displayed instead of the shooting date / time information 1204 and 1209, and information 1403 indicating that the color editing screen is displayed (“color effect” in the upper left) ) Except for the detailed information display screen (FIG. 14). Needless to say, when an image that has already been edited is re-edited, icon display as shown in FIGS. 15 and 22 is performed according to the editing history.

  If the MENU button 1005 is pressed on the color editing screen (S704), the color editing screen is exited and the process returns to S701. When the SET button 1004 is pressed (S704), the system control circuit 50 displays a color effect mode selection screen (S705) and waits for a user operation (S706).

FIG. 24 shows an example of the color effect mode selection screen.
On the color effect mode selection screen, a plurality of icons 1410 corresponding to selectable color effect modes are displayed at the bottom of the screen. Further, the icon 1405 corresponding to the currently selected color effect mode is enlarged and displayed with a specific name 1404 of the color effect mode. The user operates the left / right buttons of the up / down / left / right buttons 1002 to select a corresponding icon corresponding to the color effect mode desired to be applied to the displayed image from the plurality of icons 1410 and presses the SET button 1004 to determine the application. .

  If MENU is pressed (S706), the color editing mode is exited and the process returns to S701. When the SET button 1004 is pressed (S706), the system control circuit 50 displays a saved image confirmation screen (S707) and waits for a user operation (S708).

FIG. 23 shows an example of a saved image confirmation screen.
The user operates the left and right buttons, selects either “Cancel” 1901 or “OK” 1902, presses the SET button 1004, and instructs whether to cancel or OK. When the cancellation is instructed (S708), the system control circuit 50 returns to the color effect mode selection screen (S705).

  When OK is instructed (S708), the system control circuit 50 analyzes the header of the image file storing the image data being displayed, and checks whether there is an image editing history tag (S709). If there is an image edit history tag, the process proceeds to S710, and the system control circuit 50 checks whether the total number of edits in the image edit history tag is equal to or less than a predetermined value X.

  If the total number of edits exceeds the specified value X, the system control circuit 50 displays an edit number over warning screen (S716) and ends the image editing process. FIG. 18 is a diagram showing an example of the editing frequency over warning screen, and includes a message display 1601 indicating that editing cannot be performed.

  On the other hand, if the total number of edits in the image edit history tag is equal to or less than the default value X in S710, the process proceeds to S711. The system control circuit 50 then selects the color effect mode selected on the color effect mode selection screen (FIG. 24), the color effect mode in the past color editing process recorded in the image editing history tag, and the color applied at the time of shooting. Compare effect mode.

  When the color effect mode selected on the color effect mode selection screen (FIG. 24) has already been applied at the time of shooting or by past editing, the system control circuit 50 can obtain an editing effect even if the same processing is applied. Judge that it is not possible. Then, an invalid operation warning screen is displayed (S718), and the image editing process is interrupted. FIG. 21 is a diagram showing an example of the invalid operation warning screen, and includes a message display 1701 indicating that the editing operation has already been applied and cannot be applied.

  On the other hand, if the color effect mode selected on the color effect mode selection screen (FIG. 24) has not yet been applied in S711, the process proceeds to S712. Then, the system control circuit 50 records the execution of the color effect mode designated by the user in the image editing history tag in the header of the image file, and records the total number of editing times and the number of color editing times by one. Further, the system control circuit 50 decodes the main image data (not the display image but the high-resolution original image data) by the compression / decompression circuit 32 as necessary, and then uses the color effect mode selection screen (FIG. 24). Apply color processing according to the selected color effect mode. Thereafter, the compression / decompression circuit 32 performs the encoding process again (here, JPEG encoding process), and records it on the recording medium together with the header (S717).

  If there is no image editing history tag in the header of the image file in S709, the system control circuit 50 refers to the color space recorded at the time of shooting in the header (S713). If it is sRGB, an image editing history tag is inserted (S714), the process proceeds to S710, and the editing process is continued. On the other hand, if the color space is not sRGB, an unsupported image warning screen is displayed (S715), and the image editing process is interrupted. FIG. 17 is a diagram illustrating an example of an unsupported image warning screen, which includes a message display 1501 indicating that editing processing cannot be performed.

As described above, according to the present embodiment, whether or not the camera is an incompatible image even when an image in which an edit history tag is not embedded, such as an image recorded by another image processing apparatus, is to be edited. And appropriate processing can be performed.
If an instruction to execute red-eye correction processing is input from the menu screen in S702, the process proceeds to S720, and the system control circuit 50 displays a red-eye correction screen and waits for a user operation (S721).

FIG. 25 shows an example of the red-eye correction screen.
Except for the information 2001 indicating the red-eye correction screen (“red-eye correction” in the upper left), this is the same as the detailed information display screen (FIG. 14) and the color editing screen (FIG. 16).

  When the MENU button 1005 is pressed (S721), the red eye correction screen is exited and the process returns to S701. When the SET button 1004 is pressed (S721), the screen changes to a saved image confirmation screen (S722), and a user operation waiting state is entered (S723). FIG. 26 shows an example of a saved image confirmation screen.

  If cancellation is instructed (S723), the process returns to S701. When OK is instructed (S723), the system control circuit 50 analyzes the header of the image file storing the image data being displayed, and checks whether there is an image editing history tag (S724). If there is an image edit history tag, the process proceeds to S728, and the system control circuit 50 checks whether the total number of edits in the image edit history tag is equal to or less than a predetermined value X.

  If the total number of edits exceeds the specified value X, the system control circuit 50 displays the edit count over warning screen shown in FIG. 18 (S716), and ends the image editing process.

  On the other hand, if the total number of edits in the image edit history tag is equal to or smaller than the default value X in S728, the process proceeds to S729. Then, the system control circuit 50 records the execution of red-eye correction in the image editing history tag in the header of the image file, and records the total number of edits and the number of red-eye corrections by one. Further, the system control circuit 50 applies the red-eye detection / correction process after the main image data (not the display image but the high-resolution original image data) is decoded by the compression / decompression circuit 32 as necessary. After that, the compression / decompression circuit 32 performs encoding processing again (here, JPEG encoding processing), and records it on the recording medium together with the header (S730).

  If there is no image editing history tag in the header of the image file in S724, the system control circuit 50 refers to the color space recorded at the time of shooting in the header (S725). If it is sRGB, an image editing history tag is inserted (S726), and the process proceeds to S728 to continue the editing process. On the other hand, if the color space is not sRGB, the unsupported image warning screen shown in FIG. 17 is displayed (S727), and the image editing process is interrupted.

  As described above, according to the present embodiment, whether or not the camera is an incompatible image even when an image in which an edit history tag is not embedded, such as an image recorded by another image processing apparatus, is to be edited. And appropriate processing can be performed.

(Other embodiments)
In the above-described embodiment, the same color editing process is permitted only once. However, the same color editing process may be permitted two or more times. In the red-eye correction process, the past application is not taken into consideration. However, from the viewpoint of suppressing the image quality deterioration due to the repetition of lossy compression encoding, the number of applications may be limited as in the color editing process.

  In the above-described embodiment, if there is no image editing history tag in the image file to be edited, whether or not editing is possible is determined after checking the color space. However, an image file that does not have an image editing history tag can be configured to simply not permit editing.

  Alternatively, as a condition for determining whether or not an image file without an image editing history tag can be edited, for example, information on an image other than the color space, such as the data format of the image file and the image size, may be used.

The above-described embodiment can also be realized in software by a computer of a system or apparatus (or CPU, MPU, etc.).
Therefore, the computer program itself supplied to the computer in order to implement the above-described embodiment by the computer also realizes the present invention. That is, the computer program itself for realizing the functions of the above-described embodiments is also one aspect of the present invention.

  The computer program for realizing the above-described embodiment may be in any form as long as it can be read by a computer. For example, it can be composed of object code, a program executed by an interpreter, script data supplied to the OS, but is not limited thereto.

  A computer program for realizing the above-described embodiment is supplied to a computer via a storage medium or wired / wireless communication. Examples of the storage medium for supplying the program include a magnetic storage medium such as a flexible disk, a hard disk, and a magnetic tape, an optical / magneto-optical storage medium such as an MO, CD, and DVD, and a nonvolatile semiconductor memory.

  As a computer program supply method using wired / wireless communication, there is a method of using a server on a computer network. In this case, a data file (program file) that can be a computer program forming the present invention is stored in the server. The program file may be an executable format or a source code.

  Then, the program file is supplied by downloading to a client computer that has accessed the server. In this case, the program file can be divided into a plurality of segment files, and the segment files can be distributed and arranged on different servers.

  That is, a server apparatus that provides a client computer with a program file for realizing the above-described embodiment is also one aspect of the present invention.

  In addition, a storage medium in which a computer program for realizing the above-described embodiment is encrypted and stored is distributed to the user, and key information for decrypting is supplied to the user who satisfies a predetermined condition, and the user's computer It is also possible to enable installation on Windows. The key information can be supplied by being downloaded from a homepage via the Internet, for example.

  Further, the computer program for realizing the above-described embodiment may use an OS function already running on the computer.

  Further, a part of the computer program for realizing the above-described embodiment may be configured by firmware such as an expansion board attached to the computer, or may be executed by a CPU provided in the expansion board. Good.

1 is a block diagram illustrating a configuration example of a digital still camera (DSC) as an example of an image processing apparatus according to an embodiment of the present invention. , , It is a flowchart explaining the flow of the whole operation | movement of DSC100 of this embodiment. It is a detailed flowchart of the distance measurement and photometry process in S134 of FIG. 5 is a detailed flowchart of imaging processing in S162 and S182 of FIG. 5 is a detailed flowchart of dark capturing processing in S165 and S181 of FIG. 5 is a detailed flowchart of development processing in S166 and S183 in FIG. 4. It is a flowchart explaining the process in the reproduction | regeneration mode of DSC which concerns on embodiment of this invention. 10 is a detailed flowchart of an image display process in S609 of FIG. 10 is a detailed flowchart of an image editing process in S613 of FIG. It is a figure which shows typically the example of an external appearance at the time of seeing DSC which concerns on embodiment of this invention from the back side. It is a figure which shows the example of a simple display screen of the edited image which DSC which concerns on embodiment of this invention displays. It is a figure which shows the example of a detailed display screen of the unedited image which DSC which concerns on embodiment of this invention displays. It is a figure which shows the example of a detailed display screen of the edited image which DSC which concerns on embodiment of this invention displays. It is a figure which shows the example of a color edit screen which DSC which concerns on embodiment of this invention displays. It is a figure which shows the example of an unsupported image warning screen which DSC which concerns on embodiment of this invention displays. It is a figure which shows the example of an edit frequency over warning screen which DSC which concerns on embodiment of this invention displays. It is a figure which shows the structural example of the image edit log | history tag used in embodiment of this invention. It is a figure which shows the example of an edit menu screen which DSC which concerns on embodiment of this invention displays. It is a figure which shows the example of an invalid operation warning screen which DSC which concerns on embodiment of this invention displays. It is a figure which shows another example of a detailed display screen of the edited image which DSC which concerns on embodiment of this invention displays. It is a figure which shows the example of an image edit confirmation screen in the color edit process which DSC which concerns on embodiment of this invention displays. It is a figure which shows the example of a color effect mode selection screen which DSC which concerns on embodiment of this invention displays. It is a figure which shows the example of a red-eye correction | amendment screen which DSC which concerns on embodiment of this invention displays. It is a figure which shows the example of an image edit confirmation screen in the red eye correction process which DSC which concerns on embodiment of this invention displays.

Claims (13)

Image data generating means for generating image data;
Encoding means for encoding the image data;
An image processing apparatus having recording means for recording the encoded image data on a recording medium,
The recording means provides an area for recording auxiliary information related to the image data to record the encoded image data, and an image applied to the image data is recorded in the area for recording the auxiliary information. An image processing apparatus comprising an area for recording information relating to editing processing. Acquisition means for acquiring image data;
Display control means for displaying the image data on a display device;
Analyzing the attached information of the image data recorded together with the image data, and obtaining information relating to the image editing process applied to the image data,
The image processing apparatus, wherein the display control means displays information on the image editing process acquired by the analysis means together with the image data. The information relating to the image editing process includes information relating to the type and number of times of the image editing process applied to the image data,
The image processing apparatus according to claim 2, wherein the display control unit displays the type and number of times of image editing processing applied to the image data together with the image data. Acquisition means for acquiring image data;
Display control means for displaying the image data on a display device;
Analyzing ancillary information of the image data recorded together with the image data, and obtaining information relating to an image editing process applied to the image data;
Image editing processing means capable of applying image editing processing designated by the user to the image data being displayed;
An image processing apparatus, wherein the image editing processing unit determines whether or not to execute an image editing process designated by a user based on information about the image editing process acquired by the analyzing unit.   5. The image processing apparatus according to claim 4, wherein the image editing processing unit does not permit execution of an image editing process designated by a user when the image data does not have information regarding the image editing process.   When the image data does not have information related to the image editing process, the image editing processing means refers to additional information other than the information related to the image editing process, and determines whether or not the image editing process specified by the user can be executed. The image processing apparatus according to claim 4, wherein:   When the image editing process specified by the user is performed on image data that does not have information on the image editing process, the image editing processing means includes information on the executed image editing process as attached information of the image data. The image processing apparatus according to claim 6, wherein the image processing apparatus records the image. The information on the image editing process includes information on the number of times of image editing process applied to the image data,
The image editing processing unit does not permit execution of an image editing process designated by the user when the image editing process is applied to the image data for a predetermined number of times. The image processing apparatus according to any one of claims 4 to 7. The information on the image editing process includes information on the type of image editing process applied to the image data,
The image editing processing unit does not permit execution of the image editing process specified by the user when the image editing process specified by the user has already been applied to the image data. The image processing apparatus according to any one of claims 4 to 7.   The image processing apparatus according to claim 2, wherein the acquisition unit includes an image sensor and an optical system that forms an object image on the image sensor. An image data generation step for generating image data;
An encoding step of encoding the image data;
A recording step of recording the encoded image data on a recording medium, comprising:
In the recording step, a control step is provided for controlling to record the encoded image data by providing an area for recording auxiliary information related to the image data, and the area for recording the auxiliary information includes the image A control method for an image processing apparatus, comprising an area for recording information relating to image editing processing applied to data. An acquisition step of acquiring image data;
A display control step of displaying the image data on a display device;
Reading the attached information of the image data recorded together with the image data, and obtaining information relating to the image editing process applied to the image data,
In the display control step, information relating to the image editing process acquired in the analysis step is displayed together with the image data. An acquisition step of acquiring image data;
A display control step of displaying the image data on a display device;
Analyzing the attached information of the image data recorded together with the image data, and obtaining information related to the image editing process applied to the image data;
An image editing process step that can apply the image editing process specified by the user to the image data being displayed, and the image editing process specified by the user based on the information related to the image editing process acquired by the analysis step And an image editing process step for determining whether or not the process can be executed.

Images