JP2004304833A - Image processing apparatus, control method thereof, and memory medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing apparatus capable of detecting the information related to pixel defects and shading for correcting a photographed image at a proper timing. <P>SOLUTION: The image processing apparatus detects the information related to the pixel defects and shading for the correction of the photographed image at a prescribed timing before the start of photographing. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an image processing apparatus, an imaging apparatus, a control method thereof, and a medium such as a memory medium. For example, the present invention relates to an image processing apparatus and an imaging apparatus that capture and process a still image or a moving image, a control method thereof, and a control method thereof. The present invention relates to a medium such as a memory medium used for control.

  There is an image processing device such as an electronic camera that records and reproduces a still image or a moving image captured by a solid-state imaging device such as a CMOS or a CCD using a memory card having a solid-state memory device as a recording medium.

  According to these electronic cameras, captured image data can be recorded on a recording medium such as a flash memory or a hard disk.

  When an image is captured using a solid-state image sensor such as a CMOS or a CCD, dark image data read out after charge storage is performed in the same manner as in actual shooting without exposing the image sensor, and charge storage is performed when the image sensor is exposed. It is possible to perform dark noise correction processing by performing arithmetic processing using the actual captured image data read after the processing.

  In addition, when imaging is performed using a solid-state imaging device such as a CMOS or a CCD, white spots are always generated due to minute pixel defects of the imaging device, and black data is always output. A point flaw correction process can be performed by performing interpolation calculation processing on data of a defective pixel using data of an adjacent pixel using position information of a pixel related to the black spot flaw (see Patent Document 1).

  With these correction processes, the captured image data is corrected with respect to dark current noise generated by an image sensor such as a CMOS or a CCD or image quality deterioration such as pixel loss due to minute scratches inherent to the image sensor, thereby obtaining a high-quality image. I can do it.

In addition, some of these electronic cameras can take a picture by changing taking lenses having different focal lengths and open aperture values according to the purpose.
JP-A-8-18873

  In such a conventional image processing apparatus such as an electronic camera, it is necessary to know in advance the position information of a defective pixel when performing photographing. There was a problem that correction could not be made.

  On the other hand, in the method of detecting the position of a defective pixel when the shutter switch is pressed, correction can be performed even when the number of defective pixels increases with time, but the shutter release time lag is determined by the position information of the defective pixel. However, there is a problem that the time required for detecting the pixel becomes longer, or the interval between successive photographing becomes longer by the time required for detecting the position information of the defective pixel.

  In addition, when photographing is performed by arbitrarily mounting a photographing lens having a different focal length and an open aperture value, an image sensor is used in accordance with an exit pupil distance of a photographing lens to be used, an aperture value at the time of photographing, and a focal length at the time of photographing. Since the angle of the luminous flux incident on the image sensor differs between the central pixel of the image sensor and the surrounding pixels, vignetting occurs in the light incident on the light detection unit of each pixel of the image sensor, and brightness shading or the like occurs in the image signal output of the image sensor. There is a problem that color shading may occur.

  The present invention has been made in view of the above background, and one aspect of the present invention is to correct, for example, a newly generated pixel defect and to speed up a shooting operation.

  Another object of the present invention is to obtain an image in which the shading of the lens unit is corrected irrespective of a change in the state of the lens unit.

  An imaging apparatus according to a first aspect of the present invention includes an imaging sensor, a detection unit that detects a pixel defect position of the imaging sensor each time a predetermined time elapses, and a storage unit that updates and stores a detection result of the detection unit. , Is characterized by having.

  An imaging device according to a second aspect of the present invention includes: an imaging sensor; a detection unit that detects a pixel defect position of the imaging sensor every predetermined number of times of imaging; a storage unit that updates and stores a detection result of the detection unit; It is characterized by having.

  An imaging device according to a third aspect of the present invention includes an imaging sensor, detection means for detecting a pixel defect position of the imaging sensor, and a detection result of the detection means recorded on a recording medium together with an image captured by the imaging sensor. Recording means for performing the operation.

  An imaging apparatus according to a fourth aspect of the present invention is an imaging apparatus in which an imaging optical system can be exchangeably mounted. And a specific information acquisition unit for acquiring information for specifying the mounted imaging optical system before the operation unit is operated.

  An imaging apparatus according to a fifth aspect of the present invention is an imaging apparatus in which an imaging optical system can be exchangeably mounted, wherein the mounted imaging optical system is used for shading correction of a captured image related to the mounted imaging optical system. There is provided a specific information acquisition unit for acquiring information to be specified, and a recording unit for recording data for shading correction based on the information for specifying the imaging optical system acquired by the specific information acquisition unit on a recording medium together with a captured image. It is characterized by the following.

  An imaging apparatus according to a sixth aspect of the present invention includes an information acquisition unit that acquires information for shading correction of a captured image, and a recording medium that stores the information for shading correction acquired by the information acquisition unit together with the captured image. And recording means for recording the information in the recording medium.

  A control method of an imaging device according to a seventh aspect of the present invention is characterized in that a pixel defect position of an imaging sensor is detected each time a predetermined time elapses, and the detection result is updated and stored.

  A control method of an imaging device according to an eighth aspect of the present invention is characterized in that a pixel defect position of an imaging sensor is detected every predetermined number of times of imaging, and the detection result is updated and stored.

  A control method of an imaging device according to a ninth aspect of the present invention is characterized in that a pixel defect position of an imaging sensor is detected, and the detection result is recorded on a recording medium together with an image captured by the imaging sensor.

  A method for controlling an imaging apparatus according to a tenth aspect of the present invention is the control method for an imaging apparatus in which an imaging optical system can be exchangeably mounted. The information for specifying the imaging optical system to be performed is obtained before the operation means for instructing the start of imaging is operated.

  An image pickup apparatus control method according to an eleventh aspect of the present invention is a control method of an image pickup apparatus in which an image pickup optical system can be exchangeably mounted. The information for specifying the imaging optical system to be obtained is obtained, and data for shading correction based on the obtained information for specifying the imaging optical system is recorded together with a captured image on a recording medium.

  A method for controlling an imaging device according to a twelfth aspect of the present invention includes acquiring information for shading correction of a captured image and recording the acquired information for shading correction on a recording medium together with the captured image. Features.

  A medium for providing a control program for an imaging device according to a thirteenth aspect of the present invention has contents for detecting a pixel defect position of an imaging sensor every time a predetermined time elapses and contents for updating and storing the detection result. It is characterized.

  A medium for providing a control program for an imaging device according to a thirteenth aspect of the present invention has a content for detecting a pixel defect position of an imaging sensor every predetermined number of times of photography and a content for updating and storing the detection result. Features.

  A medium for providing a control program for an imaging device according to a fourteenth aspect of the present invention has a content of detecting a pixel defect position of an imaging sensor and recording the detection result on a recording medium together with an image captured by the imaging sensor. It is characterized by the following.

  A medium for providing a control program for an imaging apparatus according to a fifteenth aspect of the present invention is a medium for providing a control program for an imaging apparatus in which an imaging optical system can be exchangeably mounted. In order to perform shading correction, the image capturing apparatus has a feature of acquiring information for specifying the mounted imaging optical system before an operation unit for instructing a start of imaging is operated.

  A medium for providing a control program for an imaging device according to a sixteenth aspect of the present invention is a medium for providing a control program for an imaging device in which an imaging optical system can be exchangeably mounted. Contents for acquiring information for specifying the mounted imaging optical system for shading correction, and recording data for shading correction based on the obtained information for specifying the imaging optical system together with a captured image on a recording medium. It is characterized by having.

  A medium for providing a control program for an imaging device according to a seventeenth aspect of the present invention acquires information for shading correction of a captured image, and stores the acquired information for shading correction together with a captured image in a recording medium. Characterized in that it has contents to be recorded in

  According to one aspect of the present invention, for example, it is possible to correct a newly generated pixel defect and to speed up a shooting operation.

  Further, according to another aspect of the present invention, it is possible to obtain an image in which the shading of the lens unit is corrected irrespective of a change in the state of the lens unit.

[First Embodiment]
Hereinafter, a first embodiment of the present invention will be described.

  FIG. 1 is a diagram illustrating a configuration of an image processing apparatus according to a first embodiment of the present invention. In FIG. 1, reference numeral 100 denotes an image processing device (imaging device). Reference numeral 12 denotes a shutter for controlling the amount of exposure to the image sensor 14, and reference numeral 14 denotes an image sensor that converts an optical image into an electric signal. As an example of the imaging device, a CCD sensor, a CMOS sensor, and the like are known.

  The light beam incident on the lens 310 can be formed as an optical image on the image sensor 14 via the stop 312, the lens mounts 306 and 106, the mirror 130, and the shutter 12 by a single-lens reflex method.

  Reference numeral 16 denotes an A / D converter for converting an analog signal output of the image sensor 14 into a digital signal. Reference numeral 18 denotes a timing generation circuit that supplies a clock signal and a control signal to the image sensor 14, the A / D converter 16, and the D / A converter 26, and is controlled by the memory control circuit 22 and the system control circuit 50.

  Reference numeral 20 denotes an image processing circuit which performs predetermined pixel interpolation processing and color conversion processing on data from the A / D converter 16 or data from the memory control circuit 22. In addition, the image processing circuit 20 performs a predetermined calculation process using the captured image data as needed. The system control circuit 50 can control the shutter control unit 40, the aperture control unit 340, the distance measurement control unit 342, and the like based on the calculation result. Thus, AF (auto focus) processing, AE (auto exposure) processing, and EF (flash light control) processing of the TTL (through the lens) method are performed.

  Further, the image processing circuit 20 performs predetermined arithmetic processing using the captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained arithmetic result.

  In this embodiment, since the distance measuring section 42 and the light measuring section 46 are provided exclusively, the AF (auto focus) processing, the AE (auto exposure) processing, A configuration may be adopted in which each processing of EF (flash light control) processing is performed and each processing of AF (auto focus) processing, AE (auto exposure) processing, and EF (flash light control) processing using the image processing circuit 20 is not performed. good.

  Alternatively, a configuration may be adopted in which each of AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash light control) processing using the distance measuring unit 42 and the light measuring unit 46 and the image processing circuit 20 is performed.

  A memory control circuit 22 controls the A / D converter 16, the timing generation circuit 18, the image processing circuit 20, the image display memory 24, the D / A converter 26, the memory 30, and the compression / decompression circuit 32.

  The output data of the A / D converter 16 is sent to the image display memory 24 or the memory 30 via the image processing circuit 20 and the memory control circuit 22 or the data of the A / D converter 16 is sent directly to the image display memory 24 or the memory 30 via the memory control circuit 22. Written.

  Reference numeral 24 denotes an image display memory, 26 denotes a D / A converter, and 28 denotes an image display unit composed of a TFT-LCD or the like. Image data for display written in the image display memory 24 passes through the D / A converter 26. The image is provided to the image display unit 28, whereby the image is displayed.

  The electronic viewfinder function can be realized by sequentially displaying captured image data using the image display unit 28.

  Further, the image display unit 28 can arbitrarily turn on / off the display according to an instruction from the system control circuit 50. When the display is turned off, the power consumption of the image processing apparatus 100 is significantly reduced. You can do it.

  Reference numeral 30 denotes a memory for storing captured still images and moving images, and has a sufficient storage capacity for storing a predetermined number of still images and moving images for a predetermined time. Accordingly, even in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images to the memory 30 at high speed. The memory 30 can also be used as a work area of the system control circuit 50.

  A compression / decompression circuit 32 compresses and decompresses image data by adaptive discrete cosine transform (ADCT) or the like. The compression / decompression circuit 32 reads an image stored in the memory 30, performs compression processing or decompression processing, and stores the processed data in the memory. Write 30.

  Reference numeral 40 denotes a shutter control unit that controls the shutter 12 in cooperation with an aperture control unit 340 that controls the aperture 312 based on photometric information provided from the photometric unit 46.

  Reference numeral 42 denotes a distance measuring unit for performing AF (auto focus) processing. The light beam incident on the lens 310 is incident on the distance measuring unit 42 via the diaphragm 312, the lens mounts 306 and 106, the mirror 130, and the distance measuring sub-mirror (not shown) by a single-lens reflex method, thereby forming an optical image. The focus state of the formed image can be measured.

  Reference numeral 46 denotes a photometric unit for performing AE (automatic exposure) processing. The photometric unit 46 converts a light beam incident on the lens 310 into a stop 312, lens mounts 306 and 106, mirrors 130 and 132, and a photometric lens (not shown) by a single-lens reflex method. The light is incident on the light metering unit 46 through the, so that the exposure state of the image formed as an optical image can be measured. The photometric unit 46 also has an EF (flash light control) processing function in cooperation with the flash 48.

  Reference numeral 48 denotes a flash having an AF auxiliary light projecting function and a flash dimming function.

  The system control circuit 50 controls the shutter control unit 40, the aperture control unit 340, and the distance measurement control unit 342 based on a calculation result obtained by calculating the image data captured by the image sensor 14 by the image processing circuit 20. Exposure control and AF (autofocus) control can also be performed using the video TTL method.

  Further, AF (autofocus) control may be performed using both the measurement result by the distance measuring unit 42 and the calculation result obtained by calculating the image data captured by the image sensor 14 by the image processing circuit 20.

  Further, the exposure control may be performed by using both the measurement result by the photometry unit 46 and the calculation result obtained by calculating the image data captured by the image sensor 14 by the image processing circuit 20.

  A system control circuit 50 controls the entire image processing apparatus 100, and a memory 52 stores constants, variables, programs, and the like for operation of the system control circuit 50.

  Reference numeral 54 denotes an output unit such as a liquid crystal display device or a speaker that emits an operation state, a message, or the like in accordance with the execution of a program by the system control circuit 50, using characters, images, sounds, or the like. The output unit 54 is provided singly or at a plurality of positions at an easily visible position near the operation unit of the image processing apparatus 100, and is configured by a combination of, for example, an LCD, an LED, and a sound emitting element.

  The display unit forming a part of the output unit 54 has a part of its function installed in the optical viewfinder 104. Of the contents displayed by the output unit 54, those displayed on the LCD or the like include, for example, a single shot / continuous shooting display, a self-timer display, a compression ratio display, a recording pixel number display, a recording number display, and a remaining number of images displayable. , Shutter speed display, Aperture value display, Exposure compensation display, Flash display, Red-eye reduction display, Macro shooting display, Buzzer setting display, Clock battery remaining display, Battery remaining display, Error display, Multi-digit information display Display of the attachment / detachment state of the recording media 200 and 210, attachment / detachment state display of the lens unit 300, operation display of the communication I / F, date / time display, display indicating the connection state with the external computer, and the like.

  Further, among the display contents of the display unit 54, those displayed in the optical viewfinder 104 include, for example, an in-focus display, a shooting ready display, a camera shake warning display, a flash charging display, a flash charging completed display, a shutter speed display, There are an aperture value display, an exposure correction display, a recording medium writing operation display, and the like.

  Further, among the display contents of the display unit 54, those displayed on the LED or the like include, for example, an in-focus display, a shooting ready display, a camera shake warning display, a camera shake warning display, a flash charge display, a flash charge completion display, and a recording medium. There are a writing operation display, a macro shooting setting notification display, a secondary battery charge state display, and the like.

  Then, among the display contents of the display unit 54, those displayed on a lamp or the like include, for example, a self-timer notification lamp. This self-timer notification lamp may be shared with the AF auxiliary light.

  Reference numeral 56 denotes an electrically erasable / recordable nonvolatile memory, for example, an EEPROM or the like.

  Reference numerals 60, 62, 64, 66, 68, and 70 denote operating means for inputting various operation instructions of the system control circuit 50. For example, switches, dials, touch panels, pointing by gaze detection, voice recognition devices, and the like. It is composed of one or a plurality of combinations. Here, these operation means will be specifically described.

  Reference numeral 60 denotes a mode dial switch, which is used for automatic shooting mode, program shooting mode, shutter speed priority shooting mode, aperture priority shooting mode, manual shooting mode, depth of focus priority (depth) shooting mode, portrait shooting mode, landscape shooting. A photographing mode such as a mode, a close-up photographing mode, a sports photographing mode, a night scene photographing mode, and a panoramic photographing mode can be selected.

  Reference numeral 62 denotes a shutter switch SW1, which is turned on during operation of a shutter button (not shown). At this time, AF (auto focus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, EF (flash light control) ) Instruct operation start such as processing.

  Reference numeral 64 denotes a shutter switch SW2, which is turned on when the operation of the shutter button is completed, and performs an exposure process of writing a signal read from the image sensor 12 to the memory 30 via the A / D converter 16 and the memory control circuit 22 as image data. A development process using an operation in the image processing circuit 20 or the memory control circuit 22, a recording process in which image data is read from the memory 30, compressed by the compression / decompression circuit 32, and the image data is written to the recording medium 200 or 210. Instructs the start of a series of processing operations.

  Reference numeral 68 denotes an AF mode setting switch. The AF mode setting switch starts an autofocus operation when the shutter switch SW1 is turned on and keeps the in-focus state after focusing, and the shutter switch SW1 is turned on. During this time, it is possible to select the servo AF mode in which the autofocus operation is continuously performed.

  An operation unit 70 includes various buttons, a touch panel, and the like, and relates to a menu button, a set button, a macro button, a page break button for multi-screen playback, a flash setting button, a single-shot / continuous-shot / self-timer switching button, and menu movement. + (Plus) button,-(minus) button for menu movement, + (plus) button for movement of playback image,-(minus) button for movement of playback image, shooting quality selection button, exposure compensation button, date / time setting Button, selection / switching button for setting selection and switching of various functions when performing shooting and playback of panorama mode, etc., determination for setting and execution of various functions when performing shooting and playback of panorama mode and the like / Execute button, image display O for setting ON / OFF of image display unit 28 / OFF switch, a quick review ON / OFF switch for setting a quick review function for automatically playing back the image data taken immediately after shooting, selecting the compression rate of JPEG compression, or digitizing the signal of the image sensor directly to the recording medium A compression mode switch which is a switch for selecting a CCD RAW mode for recording, a reproduction mode switch for selecting a mode such as a reproduction mode, a multi-screen reproduction / deletion mode, and a PC connection mode, and one frame when the shutter switch SW2 is turned on. A single / continuous shooting switch for selecting between a single shooting mode in which shooting is performed and a standby state is set and a continuous shooting mode in which shooting is continuously performed while the shutter switch SW2 is ON. The obtained image is stored in the memory 30 or the recording medium 200 or 21. A reproduction switch for instructing the start of reproducing operation of displaying the image display unit 28 reads from.

  The functions of the plus button and the minus button are provided with a rotary dial switch, so that it is possible to more easily select a numerical value and a function.

  Reference numeral 72 denotes a power switch, by which the power of the image processing apparatus 100 can be turned on and off. The power switch 72 can also be used to switch on / off the power of various attached devices such as the lens unit 300, the external strobe, and the recording media 200 and 210 connected to the image processing apparatus 100.

  Reference numeral 80 denotes a power control unit, which includes a battery detection circuit, a DC-DC converter, a switch circuit for switching a block to be energized, and the like. The DC-DC converter is controlled based on the result and the instruction of the system control circuit 50, and a necessary voltage is supplied to each unit including a recording medium for a necessary period.

  Reference numeral 82 denotes a connector, 84 denotes a connector, and 86 denotes a power supply unit including a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, and an AC adapter.

  Reference numerals 90 and 94 denote an interface with a recording medium such as a memory card or a hard disk, reference numerals 92 and 96 denote connectors for connecting to a recording medium such as a memory card or a hard disk, and reference numeral 98 denotes a connector 92 or 96 to which a recording medium 200 or 210 is mounted. It is a unit for detecting whether or not a recording medium is attached or detached.

  In this embodiment, the description has been made assuming that there are two interfaces and connectors for attaching a recording medium. Of course, the interface and the connector for attaching the recording medium may be singular or plural. Further, a configuration may be adopted in which interfaces and connectors of different standards are combined.

  As the interface and the connector, for example, a structure conforming to a standard such as a PCMCIA card or a CF (Compact Flash (registered trademark)) card can be adopted.

  Further, when the interfaces 90 and 94 and the connectors 92 and 96 are configured to conform to standards such as a PCMCIA card and a CF (Compact Flash (registered trademark)) card, a LAN card, a modem card, a USB card, an IEEE 1394 card, a P1284 Transfer of image data and management information attached to the image data between other computers and peripheral devices such as printers by connecting various communication cards such as a communication card such as a card, SCSI card, and PHS. Can be done.

  104 is an optical finder. The light beam that has entered the lens 310 is guided to the optical finder via the stop 312, the lens mounts 306 and 106, and the mirrors 130 and 132 by the single-lens reflex method. Thus, it is possible to perform photographing using only the optical viewfinder 104 without using the electronic viewfinder function of the image display unit 28. In the optical viewfinder 104, some functions of the display unit 54, for example, an in-focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display, an exposure correction display, and the like can be provided.

  Reference numeral 106 denotes a lens mount that mechanically couples the image processing apparatus 100 to the lens unit 300. Various functions for electrically connecting the image processing apparatus 100 to the lens unit 300 are included in the lens mount 106.

  Reference numeral 108 denotes an illuminating unit which performs a point flaw position detection process for detecting a pixel related to a white point flaw that always outputs white data and / or a black point flaw that always outputs black data among the pixels of the image sensor 14. In addition, by performing predetermined light projection on the image sensor 14 so that the output of the image sensor 14 becomes a value other than black, it is possible to detect a pixel related to a black spot flaw that always outputs black data. To do.

  A communication unit 110 has all or some of various communication functions such as RS232C, USB, IEEE1394, P1284, SCSI, modem, LAN, and wireless communication.

  Reference numeral 112 denotes a connector (an antenna in the case of wireless communication) for connecting the image processing apparatus 100 to another device by the communication unit 110.

  Reference numeral 120 denotes an interface for connecting the image processing apparatus 100 to the lens unit 300 in the lens mount 106, 122 denotes a connector for electrically connecting the image processing apparatus 100 to the lens unit 300, and 124 denotes the lens mount 106 and / or the connector. A lens attachment / detachment detection unit that detects whether or not the lens unit 300 is attached to 122.

  The connector 122 has a function of mutually transmitting a control signal, a state signal, a data signal, and the like between the image processing apparatus 100 and the lens unit 300, and has a function of supplying currents of various voltages. Here, as the connector 122, a configuration for performing not only electrical communication but also optical communication, voice communication, and the like can be adopted.

  Reference numerals 130 and 132 denote mirrors, which guide light rays incident on the lens 310 to the optical finder 104 by a single-lens reflex method. In addition, the mirror 132 may be configured as a quick return mirror, or may be configured horizontally as a half mirror.

  Reference numeral 200 denotes a recording medium such as a memory card or a hard disk. The recording medium 200 includes a recording unit 202 composed of, for example, a semiconductor memory or a magnetic disk, an interface 204 with the image processing apparatus 100, and a connector 206 for connecting to the image processing apparatus 100.

  210 is a recording medium such as a memory card or a hard disk. The recording medium 210 includes a recording unit 212 including, for example, a semiconductor memory or a magnetic disk, an interface 214 with the image processing apparatus 100, and a connector 216 for connecting to the image processing apparatus 100.

  Reference numeral 300 denotes an interchangeable lens type lens unit. Reference numeral 306 denotes a lens mount for mechanically coupling the lens unit 300 to the image processing apparatus 100. The lens mount 306 includes various functions for electrically connecting the lens unit 300 to the image processing apparatus 100. Reference numeral 310 denotes a photographing lens, and 312 denotes an aperture.

  Reference numeral 320 denotes an interface in the lens mount 306 for connecting the lens unit 300 to the image processing apparatus 100. Reference numeral 322 denotes a connector for electrically connecting the lens unit 300 to the image processing apparatus 100.

  The connector 322 has a function of transmitting a control signal, a state signal, a data signal, and the like between the image processing apparatus 100 and the lens unit 300, and a function of supplying or supplying a current of various voltages. Further, as the connector 322, a configuration for performing not only electrical communication but also optical communication, voice communication, and the like can be employed.

  Reference numeral 340 denotes an aperture control unit that controls the aperture 312 in cooperation with the shutter control unit 40 that controls the shutter 12 based on photometric information provided from the photometric unit 46.

  Reference numeral 342 denotes a distance measurement control unit that controls focusing of the imaging lens 310, and 344 denotes a zoom control unit that controls zooming of the imaging lens 310.

  Reference numeral 350 denotes a lens system control circuit that controls the entire lens unit 300. The lens system control circuit 350 includes a memory for storing operation constants, variables, programs, and the like, identification information such as a number unique to the lens unit 300, management information, function information such as an open aperture value and a minimum aperture value, and a focal length. It also has a function of a non-volatile memory for storing current and past set values.

  The operation of the first embodiment of the present invention will be described with reference to FIGS.

  FIGS. 2 to 4 show flowcharts of the main routine of the image processing apparatus 100 according to the first embodiment of the present invention.

  Next, the operation of the image processing apparatus 100 will be described with reference to FIGS.

  For example, when the power is turned on upon completion of battery replacement, the system control circuit 50 initializes flags, control variables, and the like, and performs necessary predetermined initialization in each unit of the image processing apparatus 100 (S101).

  The system control circuit 50 detects a pixel related to a white spot flaw that always outputs white data and / or a pixel flaw that always outputs black data among the pixels of the image sensor 14, and specifies the pixel address of the pixel. A point flaw position detection process for storing the defect position address is performed (S102), and the process proceeds to S103.

  By using the pixel defect position address of the image sensor 14 detected in the point flaw position detection processing to perform interpolation calculation processing based on captured image data of adjacent pixels, point flaw correction processing can be performed on the captured image data. . The details of the point flaw position detection processing (S102) will be described later with reference to FIG.

  In this way, by performing the point flaw position detection processing in response to power-on or the like accompanying the completion of battery replacement, the point flaw position detection processing is completed before the user of the image processing apparatus 100 starts a shooting operation. It is possible to prevent a problem of an increase in shutter release time lag caused by performing a point flaw position detection process during photographing.

  In addition, by performing the point flaw position detection processing in response to power-on or the like upon completion of battery replacement or the like, it becomes possible to perform point flaw correction processing using point flaw position detection processing corresponding to aging. .

  The system control circuit 50 determines the setting position of the power switch 66, and if the power switch 66 is set to the power OFF state (S103), changes the display of each display unit to an end state, and sets a flag, a control variable, and the like. Are recorded in the non-volatile memory 56, and the power supply control unit 80 controls the image processing unit 100, including the image display unit 28, to shut down unnecessary power supplies. After performing the end processing (S104), the process returns to S103.

  If the power switch 66 has been set to power ON (S103), the system control circuit 50 causes the power control unit 80 to determine whether the remaining capacity or the operating state of the power source 86 including a battery or the like is in effect for the operation of the image processing apparatus 100. It is determined whether or not there is a problem (S105). If there is a problem, a predetermined warning is given by image or sound using the output unit 54 (S106), and the process returns to S103.

  If there is no problem in the power supply 86 ("yes" in S105), the system control circuit 50 determines the setting position of the mode dial 60, and if the mode dial 60 is set to the photographing mode (S107), the process proceeds to S109. move on.

  If the mode dial 60 has been set to another mode (S107), the system control circuit 50 executes a process according to the selected mode (S108), and returns to S103 when the process is completed.

  The system control circuit 50 determines whether the recording medium 200 or 210 is mounted, obtains management information of image data recorded on the recording medium 200 or 210, and determines whether the operation state of the recording medium 200 or 210 is image processing. It is determined whether or not there is a problem in the operation of the apparatus 100, particularly in the operation of recording and reproducing image data on the recording medium (S109). If there is a problem, a predetermined warning is issued by the image or sound using the output unit 54. After that (S106), the process returns to S103.

  It is determined whether or not the recording medium 200 or 210 is mounted, the management information of the image data recorded on the recording medium 200 or 210 is obtained, and the operation state of the recording medium 200 or 210 indicates the operation of the image processing apparatus 100, particularly As a result of determining whether there is a problem in the operation of recording and reproducing image data on the recording medium (S109), if there is no problem, the process proceeds to S110.

  The system control circuit 50 checks the state of the AF mode setting switch 68, and if the one-shot AF mode is selected, sets the AF mode flag to one-shot AF (S111), and if the servo AF mode is selected. For example, the AF mode flag is set to servo AF (S112), and when the setting of the flag is completed, the process proceeds to S113.

  The system control circuit 50 uses the display unit 54 to display various setting states of the image processing apparatus 100 using images and sounds (S113), and proceeds to S114. If the image display of the image display unit 28 is ON, the various display states of the image processing apparatus 100 are displayed by the image display unit 28 using images and sounds.

  The system control circuit 50 determines whether or not the lens unit 300 is attached to the image processing apparatus 100 via the lens mount 306 and the lens mount 106 and / or via the connector 322 and the connector 122 by the lens attachment / detachment detection unit 124. Inspection (S114), if the lens unit 300 is not mounted, the flow proceeds to S131.

  If the lens unit 300 is mounted (S114), the system control circuit 50 controls the brightness shading and / or the color generated in the process of forming the subject image on the image sensor 14 of the image processing apparatus 100 via the lens unit 300. When shading correction data including a shading correction coefficient or a shading correction function corresponding to the mounted lens unit 300 is used to compensate for shading, a part or all of the nonvolatile memory 56 or the memory 30 is configured as a nonvolatile memory. Determines whether the data exists in the non-volatile memory area of the memory 30 (S115). If there is no shading correction coefficient or shading correction data corresponding to the mounted lens unit 300, the output unit 54 is output. Painting with And after performing a predetermined warning by voice (S116), the flow returns to S103.

  If there is shading correction data including a shading correction coefficient or a shading correction function corresponding to the mounted lens unit 300 (S115), the system control circuit 50 stores a part or all of the nonvolatile memory 56 or the memory 30 in a nonvolatile manner. When configured as a memory, shading correction for reading shading correction data corresponding to the mounted lens unit 300 from the non-volatile memory area of the memory 30 and storing the data in a predetermined area of the memory 30 which is a work area of the system control circuit 50 The data is set (S117), and the process proceeds to S131.

  As described above, by setting the shading correction coefficient or the shading correction data including the shading correction function according to the mounted lens unit 300, the subject image is connected to the image sensor 14 of the image processing apparatus 100 via the lens unit 300. Shading correction for performing multiplication processing on photographed image data using a predetermined shading correction coefficient or shading correction function according to a mounted lens unit in order to compensate for luminance shading and / or color shading generated in an image forming process. Processing can be performed.

  Also, using the shading correction data set according to the mounted lens unit 300, the aperture value of the aperture 312 of the lens unit 300 when photographing the subject and / or the focal length of the lens unit 300 when photographing the subject. It is possible to select a predetermined shading correction coefficient or shading correction function according to the value, and perform shading correction processing with an optimum correction amount.

  Thereafter, if the shutter switch SW1 is OFF (S131), the process returns to S103.

  If the shutter switch SW1 is ON (S131), the system control circuit 50 performs a distance measurement process to focus the photographing lens 10 on the subject, and performs a photometry process to determine an aperture value and a shutter time. I do. The result of the distance measurement / photometry processing is stored as photometry data and / or setting parameters in the internal memory of the system control circuit 50 or the memory 52 (S132). In the photometry processing, the flash setting is also performed if necessary. Details of the distance measurement / photometry processing S132 will be described later with reference to FIG.

  Then, an aperture value (Av value) and a shutter speed (Tv value) are determined according to the stored photometric data and / or setting parameters and the shooting mode set by the mode dial 60, and further, the determined shutter speed (Tv value) is determined. The charge accumulation time is determined according to (value), and is stored in the internal memory of the system control circuit 50 or the memory 52 (S133).

  The system control circuit 50 determines whether the dark capture processing has not been performed yet after the shutter switch SW1 has been turned ON, or according to the measurement result of the distance measurement / photometry processing that has already been performed but has been performed again thereafter. If the charge accumulation time has been changed (S134), the process proceeds to S135. On the other hand, if the dark capture processing has already been performed, and the charge accumulation time has not been changed by the measurement result of the distance measurement / photometry processing performed again thereafter (S134), the process proceeds to S136.

  With the shutter 12 closed, the system control circuit 50 accumulates noise components such as dark current of the image sensor 14 for the same time as the actual photographing, and performs dark capture processing for reading out the noise image signal after accumulation (S135). , S136.

  By performing a correction calculation process using the dark image data captured in the dark capture process, the captured image data is obtained with respect to image quality deterioration such as dark current noise generated by the image sensor 14 and pixel defects due to scratches inherent to the image sensor 14. Can be corrected. The details of the dark capture processing S135 will be described later with reference to FIG.

  The system control circuit 50 determines the aperture value A of the aperture 312 of the lens unit 300 based on photometric data and / or setting parameters stored in the internal memory of the system control circuit 50 or the memory 52 (S136).

  Further, the system control circuit 50 acquires the focal length information of the lens unit 300 from the zoom control unit 344 via the lens control circuit 350, the interface 320, the connector 322, the connector 122, and the interface 120, and based on the acquired focal length information. Then, the focal length L of the lens unit 300 at the time of shooting is determined (S137).

  Then, the system control circuit 50 determines a shading correction value based on the aperture value A determined in S136 and / or the focal length value L determined in S137 (S138).

  As described above, in this embodiment, the image sensor is mounted to compensate for luminance shading and / or color shading generated in the process of forming the subject image on the image sensor 14 of the image processing apparatus 100 via the lens unit 300. The shading correction data set in S117 according to the lens unit 300 used is used. Then, a predetermined shading correction coefficient or a predetermined shading correction function is selected according to the aperture value A of the aperture 312 of the lens unit 300 when photographing the subject and / or the focal length L of the lens unit 300 when photographing the subject. Then, by performing the multiplication process on the photographed image data using this, it is possible to perform the shading correction process with the optimum correction amount.

  Thereafter, if the shutter switch SW2 is OFF (S139), the system control circuit 50 determines the state of the shutter switch SW1. If the shutter switch SW1 is OFF (S140), the process returns to S103.

  If the shutter switch SW1 is ON (S140), the system control circuit 50 determines the state of the AF mode flag stored in the internal memory of the system control circuit 50 or the memory 52 (S141), and one-shot AF is set. If so, the process returns to S139. If the servo AF has been set (S141), the process returns to S132. If the shutter switch SW2 is ON (S139), the process proceeds to S161.

  The system control circuit 50 determines whether or not an image storage buffer area capable of storing captured image data is present in the memory 30 (S161), and an area capable of storing new image data in the image storage buffer area of the memory 30. If there is no warning, a predetermined warning is given by image or sound using the output unit 54 (S162), and the process returns to S103. The case where there is no area capable of storing new image data in the image storage buffer area of the memory 30 is, for example, immediately after performing the maximum number of continuous shootings that can be stored in the image storage buffer area of the memory 30. The first image to be read from the memory 30 and written to the storage medium 200 or 210 is not yet recorded on the recording medium 200 or 210, and one free area is still secured in the image storage buffer area of the memory 30. For example, the state cannot be performed.

  When the captured image data is stored in the image storage buffer area of the memory 30 after being subjected to the compression process, the image data can be stored in consideration of the fact that the amount of compressed image data differs according to the setting of the compression mode. In S161, it is determined whether or not the area is on the image storage buffer area of the memory 30.

  If there is an image storage buffer area capable of storing the captured image data in the memory 30 (S161), the system control circuit 50 reads out the image pickup signal that has been imaged and accumulated for a predetermined time from the image sensor 12, and performs A / D conversion. A photographing process for writing photographed image data in a predetermined area of the memory 30 is executed via the device 16, the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter via the memory control circuit 22 ( S163). Details of the photographing process S163 will be described later with reference to FIG.

  After the photographing process S163 is completed, the system control circuit 50 performs a subtraction process on the photographed image data using the dark image data captured in the dark capturing process (S135) in advance, so that the dark current of the image sensor 14 is reduced. A dark correction calculation process for canceling noise or the like is performed (S164).

  Then, the system control circuit 50 determines in S138 in order to compensate for luminance shading and / or color shading generated in the process of forming the subject image on the image sensor 14 of the image processing apparatus 100 via the lens unit 300. A shading correction process is performed by performing a multiplication process on the captured image data using a predetermined shading correction coefficient or shading correction function (S165).

  Further, the system control circuit 50 performs a point flaw position detection process in order to compensate for a pixel related to a white point flaw that always outputs white data and / or a black point flaw that always outputs black data among the pixels of the image sensor 14. The defective pixel is specified by referring to the pixel defect position address of the image sensor 14 detected in (S102), and the pixel value of the defective pixel is determined by performing an interpolation calculation process using photographed image data of a pixel adjacent thereto. A point flaw correction process is performed (S166).

  As described above, prior to the photographing, the image data for dark correction is taken in, the shading correction coefficient or the shading correction function is determined according to the aperture value and / or the focal length of the lens to be used, and the imaging device 14 is used to correct point flaws. By performing detection of pixel defect position addresses, dark correction processing for subtracting a dark captured image from captured image data, shading correction processing for multiplying a shading correction coefficient or a shading correction function, and defective pixels It is possible to simultaneously or continuously perform the point flaw correction processing for performing the interpolation calculation processing using the photographed image data of the pixel adjacent to.

  As a result, it is possible to obtain good photographed image data having a small shutter release time lag and having been subjected to dark correction, shading correction, and point flaw correction.

  The system control circuit 50 reads out a part of the image data written in a predetermined area of the memory 30 through the memory control circuit 22 and performs a WB (white balance) integration operation process, OB ( (Optical black) Integral calculation processing is performed, and the calculation result is stored in the internal memory of the system control circuit 50 or the memory 52.

  Then, the system control circuit 50 reads out the captured image data written in a predetermined area of the memory 30 using the memory control circuit 22 and, if necessary, the image processing circuit 20, and reads out the internal memory of the system control circuit 50 or Using the calculation results stored in the memory 52, various development processes including AWB (auto white balance) process, gamma conversion process, and color conversion process are performed (S167).

  Then, the system control circuit 50 reads out the image data written in a predetermined area of the memory 30, and performs an image compression process according to the set mode by the compression / decompression circuit 32 (S 168). Image data that has been photographed and has undergone a series of processing is written in the free image portion of the area.

  With the execution of a series of photographing operations, the system control circuit 50 reads out the image data stored in the image storage buffer area of the memory 30 and sends the image data to a memory card or a compact flash (registered) via the interface 90 or 94 and the connector 92 or 96. A recording process for writing data on the recording medium 200 or 210 such as a trademark) card is started (S169).

  The start of the recording process is performed on the image data each time a series of processing-completed image data is newly written into the empty image portion of the image storage buffer area of the memory 30 after shooting.

  Note that, while the image data is being written to the recording medium 200 or 210, a recording medium writing operation display such as blinking an LED is performed on the output unit 54 in order to clearly indicate that the writing operation is being performed.

  Thereafter, the system control circuit 50 determines whether or not the shutter switch SW1 is ON (S170). If the shutter switch SW1 is off (S170), the process returns to S103. On the other hand, if the shutter switch SW1 is ON (S170), the system control circuit 50 determines the state of the AF mode flag stored in the internal memory of the system control circuit 50 or the memory 52 (S171).

  If the one-shot AF has been set (S171), the process returns to S139 to perform shooting continuously without performing new AF and AE, and performs the next shooting. On the other hand, if the servo AF has been set (S171), the process returns to S132 to perform shooting while performing AF and AE continuously, and performs the next shooting.

  FIG. 5 shows a detailed flowchart of the distance measurement / photometry processing in S132 of FIG. In the distance measurement / photometry processing, various signals are exchanged between the system control circuit 50 and the aperture control unit 340 or the distance measurement control unit 342 through the interface 120, the connector 122, the connector 322, the interface 320, the lens control unit, and the like. This is done via 350.

  The system control circuit 50 starts an AF (autofocus) process using the image sensor 14, the distance measurement unit 42, and the distance measurement control unit 342 (S201).

  The system control circuit 50 causes the light beam incident on the lens 310 to be incident on the distance measuring unit 42 via the stop 312, the lens mounts 306 and 106, the mirror 130, and a distance measuring sub-mirror (not shown), thereby forming an optical image. The focusing state of the formed image is determined, and the distance measuring unit 42 is driven while driving the lens 310 using the distance measuring control unit 342 until the distance measurement (AF) is determined to be in focus (S203). Then, the AF control for detecting the in-focus state is performed using the AF control (S202).

  If it is determined that the ranging (AF) is in focus (S203), the system control circuit 50 determines the focused ranging point from the plurality of ranging points in the shooting screen, and determines the determined ranging point. The distance measurement data and / or the setting parameters are stored together with the data in the internal memory or the memory 52 of the system control circuit 50, and the process proceeds to S205.

  Subsequently, the system control circuit 50 starts AE (automatic exposure) processing using the photometric unit 46 (S205).

  The system control circuit 50 causes the light beam incident on the lens 310 to enter the photometric unit 46 via the stop 312, the lens mounts 306 and 106, the mirrors 130 and 132, and a photometric lens (not shown), thereby forming an optical image. The exposure state of the formed image is measured, and photometric processing is performed using the exposure control means 40 (S206) until the exposure (AE) is determined to be appropriate (S206).

  If it is determined that the exposure (AE) is appropriate (S207), the system control circuit 50 stores the photometric data and / or setting parameters in the internal memory or the memory 52 of the system control circuit 50, and proceeds to S208.

  The system control circuit 50 determines the aperture value (Av value) and the shutter speed (Tv value) according to the exposure (AE) result detected in the photometry processing S206 and the shooting mode set by the mode dial 60. . Then, in accordance with the determined shutter speed (Tv value), the system control circuit 50 determines the charge accumulation time of the image pickup device 14 and performs the photographing process and the dark capture process with the same charge accumulation time, thereby performing the development process. In the above, dark correction calculation processing can be performed using the obtained captured image data and dark image data. Here, it is also possible to obtain the corrected dark image data using the dark image data obtained in advance and the dark correction coefficient obtained from the determined charge accumulation time, and perform the dark correction calculation process using the corrected dark image data. No problem.

  Based on the measurement data obtained in the photometric processing S206, the system control circuit 50 determines whether or not a flash is necessary (S208). If a flash is required, the system control circuit 50 sets a flash flag, and until the charging of the flash 48 is completed (S210). ), And charge the flash 48 (S209).

  When the charging of the flash 48 is completed (S210), the distance measurement / photometry processing routine S132 is ended.

  FIG. 6 shows a detailed flowchart of the photographing process in S163 of FIG. In the photographing process, various signals are exchanged between the system control circuit 50 and the aperture control unit 340 or the distance measurement control unit 342 via the interface 120, the connector 122, the connector 322, the interface 320, and the lens control unit 350. Done.

  The system control circuit 50 moves the mirror 130 to the mirror-up position by a mirror driving unit (not shown) (S301), and controls the aperture control unit 340 according to the photometric data stored in the internal memory or the memory 52 of the system control circuit 50. The aperture 312 is driven to a predetermined aperture value (S302).

  After performing the charge clearing operation of the image pickup device 14 (S303), the system control circuit 50 starts the charge accumulation of the image pickup device 14 (S304), and then opens the shutter 12 by the shutter control unit 40 (S305). The exposure of the element 14 is started (S306).

  Here, it is determined whether or not the flash 48 needs to emit light based on the flash flag (S307), and if necessary, the flash is emitted (S308).

  The system control circuit 50 waits for the end of the exposure of the image sensor 14 in accordance with the photometric data (S309), closes the shutter 12 by the shutter controller 40 (S310), and ends the exposure of the image sensor 14.

  The system control circuit 50 drives the diaphragm 312 to the open aperture value by the diaphragm control unit 340 (S311), and moves the mirror 130 to the mirror down position by the mirror driving unit (not shown) (S312).

  If the set charge accumulation time has elapsed (S313), the system control circuit 50 reads the charge signal from the image sensor 14 after terminating the charge accumulation in the image sensor 14 (S314), and outputs the signal to the A / D converter 16, The captured image data is written to a predetermined area of the memory 30 via the image processing circuit 20 and the memory control circuit 22 or directly from the A / D converter 16 via the memory control circuit 22 (S315). Then, when a series of processing is completed, the photographing processing routine S163 ends.

  FIG. 7 shows a detailed flowchart of the dark capture process in S135 of FIG.

  After performing the charge clearing operation of the image sensor 14 (S401), the system control circuit 50 starts the charge accumulation of the image sensor 14 with the shutter 12 closed (S402).

  If the set predetermined charge accumulation time has elapsed (S403), the system control circuit 50 reads the charge signal from the image sensor 14 after terminating the charge accumulation of the image sensor 14 (S404), and executes the A / D converter. 16. The image data (dark image data) is written to a predetermined area of the memory 30 via the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter 16 via the memory control circuit 22 (S405). ).

  By performing development processing using the dark capture data, captured image data can be corrected with respect to image quality deterioration such as dark current noise generated by the image sensor 14 and pixel defects due to scratches inherent to the image sensor 14.

  The dark image data is held in a predetermined area of the memory 30 until a new dark capture process is performed or the power of the image processing apparatus 100 is turned off.

  Here, if a part or the whole of the memory 30 is constituted by a nonvolatile memory such as an EEPROM or a hard disk and the dark image data is written in the nonvolatile memory, the dark image data is stored until a new dark capture process is performed. Data is held in a predetermined area of the nonvolatile memory. The dark image data is used when a photographing process is executed, the photographed image data is read out from the image pickup device 14, and a developing process is performed thereon. When a series of processing is completed, the dark capture processing routine S135 ends.

  FIG. 8 shows a detailed flowchart of the point flaw position detection processing in S102 of FIG. The system control circuit 50 sets a detection threshold value for detecting whether each pixel is a defective pixel based on each pixel value of the image output from the image sensor 14 to a value for white defect detection. (S501) Dark capture processing is performed in a state where the shutter 12 is closed, that is, in a state where light is not applied to the image sensor 14 and image output corresponding to a black level is sequentially performed from each pixel of the image sensor 14 (S502). . This dark capture processing is as described above with reference to FIG.

  The system control circuit 50 reads out the image data read from the image sensor 14 and stored in a predetermined area of the memory 30, and compares the read pixel data value with the detection threshold set in S501 to determine a point flaw. (S503). If the result of the determination is that there is a white flaw in the determined pixel (S503), the flawed pixel address for specifying the detected flawed pixel is stored in the non-volatile memory area of the memory 30 or the non-volatile memory 56 ( S505).

  The system control circuit 50 repeatedly performs the point flaw determination on all the pixels of the image sensor 14 or all the pixels in the set range (S503 to S506). When the determination is completed (“no” in S506), the process proceeds to S507. Proceed to.

  Next, the system control circuit 50 sets a detection threshold value for detecting whether each pixel is a defective pixel based on each pixel value of the image output from the image sensor 14 to a value for black defect detection. After that (S507), the illumination unit 108 starts projecting light on the image sensor 14 (S508). In this state, that is, since light is applied to the image sensor 14, each pixel of the image sensor 14 outputs an image output corresponding to a white level. The shooting process is performed in a state where the processes are sequentially performed (S509). This photographing process is as described above with reference to FIG. After finishing the photographing process S509, the system control circuit 50 ends the light projection to the image sensor (S510).

  Note that if a sufficient amount of light is exposed to each pixel of the imaging device 14 via the lens unit 300, steps S508 and S510 for performing light projection using the illumination unit 108 are omitted. Is also good.

  The system control circuit 50 reads out the image data read from the image sensor 14 and stored in a predetermined area of the memory 30, and compares the read pixel data value with the detection threshold set in S507 to determine a point flaw. If the determined pixel has a black defect (S512), the defective pixel address for specifying the detected defective pixel is stored in the non-volatile memory area of the memory 30 or the non-volatile memory 56 (S511). S513).

  The system control circuit 50 repeatedly performs the point flaw determination on all the pixels of the image sensor 14 or all the pixels in the set range (S511 to S514), and when a series of determination processes is completed (“no” in S514). ), The point flaw position detection processing routine S102 ends.

[Second embodiment]
The operation of the second embodiment of the present invention will be described with reference to FIGS. The operations shown in FIGS. 5 to 8 follow the operations of the first embodiment. FIGS. 9 to 11 show flowcharts of main routines of the image processing apparatus 100 according to the second embodiment of the present invention.

  The first embodiment is an example of the operation of the image processing apparatus 100 that performs the point defect position detection processing in advance in response to the power-on or the like accompanying the completion of the battery replacement. An operation example of the image processing apparatus 100 that performs a point defect position detection process in advance when the switch 66 is set to the ON state is provided.

  The first embodiment is an example of the operation of the image processing apparatus 100 in which the shading correction value is determined using the result of performing distance measurement and photometry processing when the switch SW1 is turned on. The embodiment provides an operation example of the image processing apparatus 100 that determines the shading correction value after the SW2 is turned on using the result of performing the distance measurement and photometry processing.

  The operation of the image processing apparatus 100 according to the second embodiment of the present invention will be described with reference to FIGS.

  First, the system control circuit 50 initializes flags, control variables, and the like when the power is turned on upon completion of battery replacement, and performs predetermined initial settings necessary for each unit of the image processing apparatus 100 (S601).

  Next, the system control circuit 50 determines the setting position of the power switch 66, and if the power switch 66 is set to the power-off state (S602), changes the display of each display unit to the end state, and sets the flag. The necessary parameters including parameters and control variables, setting values, and setting modes are recorded in the non-volatile memory 56, and unnecessary power of each part of the image processing apparatus 100 including the image display unit 28 is cut off by the power control unit 80. After performing a predetermined end process such as (S603), the process returns to S602.

  On the other hand, if the power switch 66 is set to power ON (S602), the system control circuit 50 causes the power control unit 80 to change the remaining capacity of the power source 86 composed of a battery or the like and the operating condition of the image processing apparatus 100. It is determined whether or not there is a problem in the operation (S604). If there is a problem, a predetermined warning is given by image or sound using the output unit 54 (S606), and the process returns to S602.

  If there is no problem with the power supply 86 (S604), the system control circuit 50 relates to a white spot flaw that always outputs white data and / or a black spot flaw that always outputs black data among the pixels of the image sensor 14. A pixel is detected, and a point defect position detection process for storing a pixel defect position address for specifying the pixel is performed (S605), and the process proceeds to S607.

  By using the pixel defect position address of the image sensor 14 detected in the point flaw position detection processing and performing interpolation calculation processing based on captured image data of adjacent pixels, point flaw correction processing of captured image data can be performed. . The details of the point flaw position detection processing S605 are as described above with reference to FIG.

  As described above, when the power switch 66 is set to ON, the point flaw position detection processing is performed, and the point flaw position detection processing is completed before the user of the image processing apparatus 100 starts the photographing operation. It is possible to prevent the problem that the shutter release time lag increases due to the occasional point flaw position detection processing.

  In addition, if the power switch 66 is set to ON, by performing the point flaw position detection processing, it becomes possible to perform the point flaw correction processing using the point flaw position detection processing corresponding to the temporal change.

  The system control circuit 50 determines the setting position of the mode dial 60. If the mode dial 60 has been set to the photographing mode (S607), the process proceeds to S609. On the other hand, if the mode dial 60 has been set to another mode (S607), the system control circuit 50 executes a process according to the selected mode (S608), and if the process is completed, returns to S602.

  The system control circuit 50 determines whether the recording medium 200 or 210 is mounted, obtains management information of image data recorded on the recording medium 200 or 210, and determines whether the operation state of the recording medium 200 or 210 is image processing. It is determined whether or not there is a problem in the operation of the apparatus 100, particularly, in the operation of recording and reproducing image data on the recording medium (S609). If there is a problem, a predetermined warning is issued by the image or sound using the output unit 54. After that (S606), the process returns to S602.

  Then, it is determined whether or not the recording medium 200 or 210 is mounted, management information of the image data recorded on the recording medium 200 or 210 is obtained, and the operation state of the recording medium 200 or 210 is determined by the operation of the image processing apparatus 100. In particular, as a result of determining whether or not there is a problem in the recording / reproducing operation of the image data with respect to the recording medium (S609), if there is no problem, the process proceeds to S610.

  The system control circuit 50 checks the state of the AF mode setting switch 68, and if the one-shot AF mode is selected, sets the AF mode flag to one-shot AF (S611), and if the servo AF mode is selected. For example, the AF mode flag is set to servo AF (S612), and when the setting of the flag is completed, the process proceeds to S613.

  The system control circuit 50 uses the output unit 54 to display various setting states of the image processing apparatus 100 using images and sounds (S613), and proceeds to S614. If the image display of the image display unit 28 is ON, the various setting states of the image processing apparatus 100 are displayed by the image using the image display unit 28 as well.

  Next, the system control circuit 50 attaches the lens unit 300 to the image processing apparatus 100 by the lens attachment / detachment detection unit 124 via the lens mount 306 and the lens mount 106 and / or via the connector 322 and the connector 122. It is determined whether or not the lens unit 300 is mounted (S614). If the lens unit 300 is not mounted, the process proceeds to S631.

  If the lens unit 300 is attached (“yes” in S614), the system control circuit 50 causes the luminance generated in the process of forming the subject image on the image sensor 14 of the image processing apparatus 100 via the lens unit 300. In order to compensate for shading and / or color shading, shading correction data including a shading correction coefficient or a shading correction function corresponding to the mounted lens unit 300 may be used to make a part or all of the nonvolatile memory 56 or 30 non-volatile. In the case where the memory unit is configured, it is determined whether or not it is in the non-volatile memory area of the memory 30 (S615), and if there is no shading correction data including the shading correction coefficient or the shading correction function corresponding to the mounted lens unit 300, Out By an image or sound using the parts 54 after performing a predetermined warning (S616), the flow returns to S602.

  If there is shading correction data including a shading correction coefficient or a shading correction function corresponding to the mounted lens unit 300 (S615), the system control circuit 50 stores the nonvolatile memory 56 (or part or all of the memory 30 in nonvolatile). In the case of using a nonvolatile memory, the shading correction data corresponding to the mounted lens unit 300 is read out from the nonvolatile memory area of the memory 30 and stored in a predetermined area of the memory 30 which is a working area of the system control circuit 50. The shading correction data is set (S617), and the process proceeds to S631.

  As described above, by setting the shading correction coefficient or the shading correction data including the shading correction function according to the mounted lens unit 300, the subject image is connected to the image sensor 14 of the image processing apparatus 100 via the lens unit 300. Shading for performing multiplication processing on captured image data using a predetermined shading correction coefficient or shading correction function according to a mounted lens unit in order to compensate for luminance shading and / or color shading generated in an image forming process. Correction processing can be performed.

  Further, by using the shading correction data set according to the mounted lens unit 300, the aperture value of the aperture 312 of the lens unit 300 when photographing the subject and / or the focus of the lens unit 300 when photographing the subject. It is possible to select a predetermined shading correction coefficient or shading correction function according to the distance value, and to perform shading correction processing with an optimum correction amount.

  Next, if the shutter switch SW1 is OFF (S631), the process returns to S602, and if the shutter switch SW1 is ON (S631), the system control circuit 50 performs a distance measurement process to focus the photographing lens 10 on the focus. In accordance with the subject, photometric processing is performed to determine an aperture value and a shutter time, distance measurement and photometric processing are performed, and photometric data and / or setting parameters are stored in the internal memory or the memory 52 of the system control circuit 50 (S632). . In the photometry processing, the flash setting is also performed if necessary. The details of the distance measurement / photometry processing S632 are as described above with reference to FIG.

  Next, an aperture value (Av value) and a shutter speed (Tv value) are determined according to the stored photometric data and / or a setting mode and a shooting mode set by the mode dial 60, and further, the determined shutter speed (Tv value) is determined. ), The charge accumulation time is determined and stored in the internal memory of the system control circuit 50 or the memory 52 (S633).

  The system control circuit 50 stores the electric charge according to the measurement result of the distance acquisition / photometry processing if the dark acquisition processing has not been performed yet since the shutter switch SW1 was turned ON, or the dark acquisition processing has already been performed but has been further performed thereafter. If the time has been changed (S634), the process proceeds to S635.

  If the dark capture processing has already been performed, and the charge accumulation time has not been changed by the measurement result of the distance measurement / photometry processing further performed thereafter (S634), the process proceeds to S636.

  The system control circuit 50 performs a dark capture process for accumulating noise components such as dark current of the image sensor 14 for the same time as the main photographing with the shutter 12 closed, and reading out the accumulated noise image signal (S635). , S636.

  By performing a correction calculation process using the dark image data captured in the dark capture process, a captured image is obtained with respect to dark current noise generated by the image sensor 14 and deterioration in image quality such as pixel defects due to scratches inherent to the image sensor 14. Data can be corrected. The details of the dark capture processing S635 are as described above with reference to FIG.

  Next, if the shutter switch SW2 is OFF (S636), the system control circuit 50 determines the state of the shutter switch SW1, and if the shutter switch SW1 is OFF (S637), the process returns to S602.

  On the other hand, if the shutter switch SW1 is ON (S637), the system control circuit 50 determines the state of the AF mode flag stored in the internal memory of the system control circuit 50 or the memory 52 (S638), and the one-shot AF is started. If it has been set, the process returns to S636. If the servo AF has been set (S638), the process returns to S632. If the shutter switch SW2 is ON (S636), the process proceeds to S639.

  The system control circuit 50 determines the aperture value A of the aperture 312 of the lens unit 300 based on photometric data and / or setting parameters stored in the internal memory of the system control circuit 50 or the memory 52 (S639).

  Further, the system control circuit 50 acquires the focal length information of the lens unit 300 from the zoom control unit 344 via the lens control circuit 350, the interface 320, the connector 322, the connector 122, and the interface 120, and adds the focal length information to the acquired focal length information. Based on this, the focal length L of the lens unit 300 at the time of shooting is determined (S640).

  Then, the system control circuit 50 determines a shading correction value from the aperture value A determined in S639 and / or the focal length value L determined in S640 (S641).

  As described above, in this embodiment, the image sensor is mounted to compensate for luminance shading and / or color shading generated in the process of forming the subject image on the image sensor 14 of the image processing apparatus 100 via the lens unit 300. The shading correction data set in S617 according to the lens unit 300 used is used. Then, a predetermined shading correction coefficient or a predetermined shading correction function is selected according to the aperture value A of the aperture 312 of the lens unit 300 when photographing the subject and / or the focal length L of the lens unit 300 when photographing the subject. By performing the multiplication process on the picked-up image data, the shading correction process with the optimum correction amount can be performed.

  The system control circuit 50 determines whether an image storage buffer area capable of storing captured image data is present in the memory 30 (S661), and an area capable of storing new image data in the image storage buffer area of the memory 30. If there is no warning, a predetermined warning is given by image or sound using the output unit 54 (S662), and the process returns to S605. The case where there is no area capable of storing new image data in the image storage buffer area of the memory 30 is, for example, immediately after performing the maximum number of continuous shootings that can be stored in the image storage buffer area of the memory 30, The first image to be read from the memory 30 and written to the storage medium 200 or 210 is not yet recorded on the recording medium 200 or 210, and one free area cannot be secured in the image storage buffer area of the memory 30 yet. And the like.

  When the captured image data is stored in the image storage buffer area of the memory 30 after being subjected to the compression process, the image data can be stored in consideration of the fact that the amount of compressed image data differs according to the setting of the compression mode. In S661, it is determined whether or not the area is on the image storage buffer area of the memory 30.

  If there is an image storage buffer area capable of storing the captured image data in the memory 30 (S661), the system control circuit 50 reads out the image pickup signal that has been imaged and accumulated for a predetermined time from the image sensor 12, and performs A / D conversion. A photographing process for writing photographed image data in a predetermined area of the memory 30 is executed via the device 16, the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter via the memory control circuit 22 ( S663). Details of the photographing process S663 are as described above with reference to FIG.

  After the photographing process S663 is completed, the system control circuit 50 performs a subtraction process on the photographed image data using the dark image data previously captured in the dark capture process S635, thereby obtaining dark current noise and the like of the image sensor 14. Is performed (S664).

  Then, the system control circuit 50 determines the predetermined shading determined in S641 in order to compensate for the brightness shading and / or the color shading generated in the process of forming the subject image on the image sensor 14 of the image processing apparatus 100 via the lens unit 300. The shading correction process is performed by performing a multiplication process on the captured image data by using the shading correction coefficient or the shading correction function (S665).

  Further, the system control circuit 50 performs a point flaw position detection process in order to compensate for a pixel related to a white point flaw that always outputs white data and / or a black point flaw that always outputs black data among the pixels of the image sensor 14. The point flaw correction processing is performed by performing interpolation calculation processing using the photographed image data of the pixel adjacent to the flaw pixel while referring to the pixel defect position address of the image sensor 14 detected in S605 (S666).

  As described above, prior to the photographing, the image data for dark correction is taken in, the shading correction coefficient or the shading correction function is determined according to the aperture value and / or the focal length of the lens to be used, and the imaging device 14 is used to correct point flaws. Each pixel defect position address is detected, and the captured image data is subjected to dark correction processing for subtracting a dark captured image, shading correction processing for multiplying a shading correction coefficient or a shading correction function, and adjacent to a flaw pixel. It is possible to simultaneously or continuously perform the point flaw correction processing for performing the interpolation calculation processing using the photographed image data of the pixel to be processed.

  As a result, it is possible to obtain good photographed image data that has a small shutter release time lag and that has been subjected to dark correction, shading correction, and point flaw correction.

  The system control circuit 50 reads out a part of the image data written in a predetermined area of the memory 30 through the memory control circuit 22 and performs a WB (white balance) integration operation process, OB ( (Optical black) Integral calculation processing is performed, and the calculation result is stored in the internal memory of the system control circuit 50 or the memory 52.

  Then, the system control circuit 50 reads out the captured image data written in a predetermined area of the memory 30 using the memory control circuit 22 and, if necessary, the image processing circuit 20, and reads out the internal memory of the system control circuit 50 or Using the calculation results stored in the memory 52, various development processes including AWB (auto white balance) process, gamma conversion process, and color conversion process are performed (S667).

  Then, the system control circuit 50 reads out the image data written in the predetermined area of the memory 30 and performs the image compression processing according to the set mode by the compression / decompression circuit 32 (S668). Image data that has been photographed and has undergone a series of processing is written in the free image portion of the area.

  With the execution of a series of photographing operations, the system control circuit 50 reads out the image data stored in the image storage buffer area of the memory 30 and sends the image data to a memory card or a compact flash (registered) via the interface 90 or 94 and the connector 92 or 96. A recording process for writing data on the recording medium 200 or 210 such as a trademark card is started (S669).

  The start of the recording process is performed on the image data each time a series of processing-completed image data is newly written into the empty image portion of the image storage buffer area of the memory 30 after shooting.

  In addition, while the image data is being written to the recording medium 200 or 210, a recording medium writing operation display such as blinking of an LED is performed on the output unit 54 in order to clearly indicate that the writing operation is being performed.

  Next, the system control circuit 50 determines whether or not the shutter switch SW1 is ON (S670). If the shutter switch SW1 is OFF (S670), the process returns to S605.

  On the other hand, if the shutter switch SW1 is ON (S670), the system control circuit 50 determines the state of the AF mode flag stored in the internal memory of the system control circuit 50 or the memory 52 (S671).

  Then, if the one-shot AF has been set (S671), the process returns to S636 to continuously perform shooting without performing new AF and AE, and performs the next shooting. On the other hand, if the servo AF has been set (S671), the process returns to S632 to perform shooting while performing AF and AE continuously, and performs the next shooting.

[Third Embodiment]
The operation of the third embodiment of the present invention will be described with reference to FIGS. 1, 5 to 8 and 12 to 14. The operations shown in FIGS. 5 to 8 follow the operations of the first embodiment. 12 to 14 show a flowchart of a main routine of the image processing apparatus 100 according to the third embodiment of the present invention.

  The second embodiment is an example of the operation of the image processing apparatus 100 which performs the point defect position detection processing in advance when the power switch 66 is set to the power ON. However, the third embodiment has a predetermined period. An operation example of the image processing apparatus 100 that performs the point defect position detection processing in advance when the time has elapsed is provided.

  In the first embodiment and the second embodiment, when the lens unit 300 is mounted, of the shading correction coefficients or shading correction functions stored in the image processing apparatus 100, the mounted lens unit is used. The example of the operation of the image processing apparatus 100 for setting the shading data using the shading correction coefficient or the shading correction function corresponding to 300 is described. In the third embodiment, when the lens unit 300 is mounted, An example of the operation of the image processing apparatus 100 that reads a shading correction coefficient or a shading correction function stored in the lens unit 300 into the image processing apparatus 100 and sets shading data is provided.

  The operation of the image processing apparatus 100 according to the third embodiment of the present invention will be described with reference to FIGS.

  First, the system control circuit 50 initializes flags, control variables, and the like when the power is turned on upon completion of battery replacement, and performs predetermined initial settings necessary for each unit of the image processing apparatus 100 (S701).

  Next, the system control circuit 50 determines the setting position of the power switch 66, and if the power switch 66 is set to power OFF (S702), changes the display of each display unit to the end state, and sets the flag and control. Necessary parameters including variables and the like, setting values, and setting modes are recorded in the non-volatile memory 56, and unnecessary power supplies of the respective parts of the image processing apparatus 100 including the image display unit 28 are cut off by the power supply control unit 80. After performing a predetermined end process (S703), the process returns to S702.

  If the power switch 66 has been set to power ON (S702), the system control circuit 50 causes the power control unit 80 to change the remaining capacity of the power source 86 composed of a battery or the like and the operating condition to the operation of the image processing apparatus 100. It is determined whether or not there is a problem (S704). If there is a problem, a predetermined warning display is performed using an image or a sound using the output unit 54 (S705), and the process returns to S702.

  If there is no problem in the power supply 86 (S704), the system control circuit 50 determines whether the set predetermined period has elapsed (S706). If the predetermined period has not elapsed, the process proceeds to S708.

  If the predetermined period has elapsed, a pixel related to a white point flaw that always outputs white data and / or a black point flaw that always outputs black data among the pixels of the image sensor 14 is detected and identified. A point flaw position detection process for storing a pixel defect position address is performed (S707), and the process proceeds to S708.

  By using the pixel defect position address of the image sensor 14 detected in the point flaw position detection processing and performing interpolation calculation processing based on captured image data of adjacent pixels, point flaw correction processing of captured image data can be performed. . The details of the point flaw position detection processing S707 are as described above with reference to FIG.

  As described above, the point flaw position detection process is performed after the predetermined period has elapsed, and the point flaw position detection process is completed before the user of the image processing apparatus 100 starts the shooting operation. The detection process can also be performed to prevent the problem that the shutter release time lag increases.

  Further, if the predetermined period has elapsed, by performing the point flaw position detection processing, it becomes possible to perform the point flaw correction processing using the point flaw position detection processing corresponding to the temporal change.

  As the predetermined period, any number of days, elapsed hours, the number of shots, the number of battery replacements, and the like, which are appropriate for performing point-scratch position detection in accordance with a temporal change of the image sensor 14 are used. But it doesn't matter. In addition, the predetermined period may be a fixed value, an arbitrarily set value, or a value that can be changed at any time as long as it is suitable for detecting a point flaw position according to a temporal change of the image sensor 14. Something like that is fine.

  The system control circuit 50 determines the setting position of the mode dial 60. If the mode dial 60 has been set to the photographing mode (S708), the process proceeds to S710.

  If the mode dial 60 has been set to another mode (S708), the system control circuit 50 executes a process according to the selected mode (S709), and returns to S702 when the process is completed.

  The system control circuit 50 determines whether the recording medium 200 or 210 is mounted, obtains management information of image data recorded on the recording medium 200 or 210, and determines whether the operation state of the recording medium 200 or 210 is image processing. It is determined whether or not there is a problem in the operation of the apparatus 100, particularly, in the operation of recording and reproducing image data on the recording medium (S710). If there is a problem, a predetermined warning is displayed on the display unit 54 using an image or sound. After performing (S705), the process returns to S702.

  It is determined whether or not the recording medium 200 or 210 is mounted, the management information of the image data recorded on the recording medium 200 or 210 is obtained, and the operation state of the recording medium 200 or 210 indicates the operation of the image processing apparatus 100, particularly As a result of determining whether there is a problem in the recording / reproducing operation of the image data on the recording medium (S710), if there is no problem, the process proceeds to S711.

  The system control circuit 50 checks the state of the AF mode setting switch 68, and if the one-shot AF mode is selected, sets the AF mode flag to one-shot AF (S712), and if the servo AF mode is selected. For example, the AF mode flag is set to servo AF (S713), and when the setting of the flag is completed, the process proceeds to S714.

  The system control circuit 50 outputs various setting states of the image processing apparatus 100 using images and sounds using the output unit 54 (S714), and proceeds to S715. If the image display of the image display unit 28 is ON, various setting states of the image processing apparatus 100 are displayed by the image using the image display unit 28.

  The system control circuit 50 determines whether the lens unit 300 is attached to the image processing apparatus 100 by the lens attachment / detachment detection unit 124 via the lens mount 306 and the lens mount 106 and / or via the connector 322 and the connector 122. It is checked (S715). If the lens unit 300 is not attached, the process proceeds to S731.

  If the lens unit 300 is mounted (S715), the system control circuit 50 causes the luminance shading and / or the luminance shading generated in the process of forming the subject image on the image sensor 14 of the image processing apparatus 100 via the lens unit 300. In order to compensate for color shading, shading correction data including a shading correction coefficient or a shading correction function corresponding to the mounted lens unit 300 is read out from a nonvolatile memory in the lens unit 300 via the lens control circuit 350, and the system is controlled. The shading correction data to be stored in a predetermined area of the memory 30 which is a work area of the control circuit 50 is set (S716), and the process proceeds to S731.

  It should be noted that the shading correction data including the shading correction coefficient or the shading correction function corresponding to the mounted lens unit 300 is read out from the non-volatile memory in the lens unit 300 via the lens control circuit 350, and the non-volatile memory 56 (or When part or all of the memory 30 is configured as a non-volatile memory, it may be stored in a non-volatile memory area of the memory 30).

  As described above, by reading and setting the shading correction data including the shading correction coefficient or the shading correction function from the lens unit 300 in accordance with the mounted lens unit 300, the subject image can be obtained through the lens unit 300. In order to compensate for luminance shading and / or color shading that occurs during the process of forming an image on the image sensor 14, a predetermined shading correction coefficient or a shading correction function is used for captured image data according to the attached lens unit. Thus, a shading correction process for performing a multiplication process can be performed.

  Also, using the shading correction data set according to the mounted lens unit 300, the aperture value of the aperture 312 of the lens unit 300 when photographing the subject and / or the focal length of the lens unit 300 when photographing the subject. It is possible to select a predetermined shading correction coefficient or shading correction function according to the value, and perform shading correction processing with an optimum correction amount.

  Next, if the shutter switch SW1 is OFF (S731), the process returns to S702. If the shutter switch SW1 is ON (S731), the system control circuit 50 performs a distance measurement process to focus the photographing lens 10 on the subject, and performs a photometry process to determine an aperture value and a shutter time. The distance and photometry processing is performed, and photometry data and / or setting parameters are stored in the internal memory of the system control circuit 50 or the memory 52 (S732). In the photometry processing, the flash setting is also performed if necessary. The details of the distance measurement / photometry processing S732 are as described above with reference to FIG.

  Then, an aperture value (Av value) and a shutter speed (Tv value) are determined according to the stored photometric data and / or setting parameters and the shooting mode set by the mode dial 60, and further, the determined shutter speed (Tv value) is determined. The charge accumulation time is determined according to the value (value), and is stored in the internal memory of the system control circuit 50 or the memory 52 (S733).

  The system control circuit 50 sets the charge accumulation time according to the measurement result of the distance acquisition / photometry processing when the dark acquisition processing has not yet been performed since the shutter switch SW1 was turned on, or when the dark acquisition processing has already been performed but is further performed thereafter. If it has been changed (S734), the flow proceeds to S735.

  If the dark capture processing has already been performed, and the charge accumulation time has not been changed by the measurement result of the distance measurement / photometry processing further performed thereafter (S734), the process proceeds to S736.

  With the shutter 12 closed, the system control circuit 50 accumulates noise components such as dark current of the image sensor 14 for the same time as the actual photographing, and performs dark capture processing for reading out the noise image signal that has been accumulated (S735). , S736.

  By performing a correction calculation process using the dark image data captured in the dark capture process, the captured image data is obtained with respect to image quality deterioration such as dark current noise generated by the image sensor 14 and pixel defects due to scratches inherent to the image sensor 14. Can be corrected. The details of the dark capture processing S735 are as described above with reference to FIG.

  The system control circuit 50 determines the aperture value A of the aperture 312 of the lens unit 300 from the photometric data and / or the setting parameters stored in the internal memory of the system control circuit 50 or the memory 52 (S736).

  Further, the system control circuit 50 acquires the focal length information of the lens unit 300 from the zoom control unit 344 via the lens control circuit 350, the interface 320, the connector 322, the connector 122, and the interface 120, and based on the acquired focal length information. Then, the focal length L of the lens unit 300 at the time of shooting is determined (S737).

  Then, the system control circuit 50 determines a shading correction value from the aperture value A determined in S736 and / or the focal length value L determined in S737 (S738).

  As described above, in order to compensate for the brightness shading and / or the color shading generated in the process of forming the subject image on the image sensor 14 of the image processing apparatus 100 via the lens unit 300, the image processing apparatus 100 may be controlled depending on the mounted lens unit 300. Using the shading correction data set in S717, predetermined shading is performed in accordance with the aperture value A of the aperture 312 of the lens unit 300 when photographing the subject and the focal length value L of the lens unit 300 when photographing the subject. By selecting and using a correction coefficient or a shading correction function and performing multiplication processing on captured image data, it is possible to perform shading correction processing with an optimum correction amount.

  If the shutter switch SW2 is OFF (S739), the system control circuit 50 determines the state of the shutter switch SW1. If the shutter switch SW1 is OFF (S740), the process returns to S702. If the shutter switch SW1 is ON (S740), the system control circuit 50 determines the state of the AF mode flag stored in the internal memory of the system control circuit 50 or the memory 52 (S741), and one-shot AF is set. If yes, the process returns to S739. On the other hand, if the servo AF has been set (S741), the process returns to S732. If the shutter switch SW2 is ON (S739), the process proceeds to S761.

  Next, the system control circuit 50 determines whether there is an image storage buffer area capable of storing the captured image data in the memory 30 (S761), and can store new image data in the image storage buffer area of the memory 30. If there is no such area, a predetermined warning is given by image or sound using the output unit 54 (S762), and the process returns to S702. Here, when there is no area capable of storing new image data in the image storage buffer area of the memory 30, for example, the maximum number of continuous shots that can be stored in the image storage buffer area of the memory 30 is performed. Immediately after, the first image to be read from the memory 30 and written to the storage medium 200 or 210 is not yet recorded on the recording medium 200 or 210, and one empty area still remains on the image storage buffer area of the memory 30. For example, there is a case where it cannot be secured.

  When the captured image data is stored in the image storage buffer area of the memory 30 after being subjected to the compression process, the image data can be stored in consideration of the fact that the amount of compressed image data differs according to the setting of the compression mode. In step S761, it is determined whether the area is on the image storage buffer area of the memory 30.

  If there is an image storage buffer area capable of storing the captured image data in the memory 30 (S761), the system control circuit 50 reads out the image pickup signal that has been imaged and accumulated for a predetermined time from the image sensor 12, and performs A / D conversion. A photographing process for writing photographed image data in a predetermined chain area of the memory 30 is executed via the device 16, the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter via the memory control circuit 22. (S763). Details of the photographing processing S763 are as described above with reference to FIG.

  After the photographing process S763 is completed, the system control circuit 50 performs a subtraction process on the photographed image data by using the dark image data previously captured in the dark capturing process S735, so that the dark current noise or the like of the image sensor 14 is obtained. Is performed (S764).

  Then, the system control circuit 50 determines in S741 in order to compensate for luminance shading and / or color shading generated in the process of forming the subject image on the image sensor 14 of the image processing apparatus 100 via the lens unit 300. A shading correction process is performed by performing a multiplication process on the photographed image deleter using a predetermined shading correction coefficient or shading correction function (S765).

  Further, the system control circuit 50 performs a point flaw position detection process S709 in order to compensate for a pixel related to a white point flaw that always outputs white data and / or a black point flaw that always outputs black data among the pixels of the image sensor 14. The point flaw correction process is performed by performing an interpolation calculation process using the photographed image data of the pixel adjacent to the flaw pixel while referring to the pixel defect position address of the image sensor 14 detected in step (S766).

  As described above, prior to the photographing, the image data for dark correction is taken in, the shading correction coefficient or the shading correction function is determined according to the aperture value and / or the focal length of the lens to be used, and the imaging device 14 is used to correct point flaws. Each pixel defect position address is detected, and the captured image data is subjected to dark correction processing for subtracting a dark captured image, shading correction processing for multiplying a shading correction coefficient or a shading correction function, and adjacent to a flaw pixel. It is possible to simultaneously or continuously perform the point flaw correction processing for performing the interpolation calculation processing using the photographed image data of the pixel to be processed.

  As a result, it is possible to obtain good photographed image data that has a small shutter release time lag and that has been subjected to dark correction, shading correction, and point flaw correction.

  The system control circuit 50 reads out a part of the image data written in a predetermined area of the memory 30 through the memory control circuit 22 and performs a WB (white balance) integration operation process, OB ( (Optical black) Integral calculation processing is performed, and the calculation result is stored in the internal memory of the system control circuit 50 or the memory 52.

  Then, the system control circuit 50 reads out the captured image data written in a predetermined area of the memory 30 using the memory control circuit 22 and, if necessary, the image processing circuit 20, and reads out the internal memory of the system control circuit 50 or Using the calculation results stored in the memory 52, various development processes including AWB (auto white balance) process, gamma conversion process, and color conversion process are performed (S767).

  Then, the system control circuit 50 reads out the image data written in a predetermined area of the memory 30, and performs image compression processing according to the set mode by the compression / decompression circuit 32 (S 768). Image data that has been photographed and has undergone a series of processing is written in the free image portion of the area.

  With the execution of a series of photographing operations, the system control circuit 50 reads out the image data stored in the image storage buffer area of the memory 30 and transmits the image data to the memory card or the compact flash (registered) via the interface 90 or 94 and the connector 92 or 96. A recording process for writing data to the recording medium 200 or 210 such as a trademark card is started (S769).

  The start of the recording process is performed on the image data each time a series of processing-completed image data is newly written into the empty image portion of the image storage buffer area of the memory 30 after shooting.

  In addition, while the image data is being written to the recording medium 200 or 210, a recording medium writing operation display such as blinking of an LED is performed on the output unit 54 in order to clearly indicate that the writing operation is being performed.

  Next, the system control circuit 50 determines whether or not the shutter switch SW1 is ON (S770). If the shutter switch SW1 is OFF (S770), the process returns to S702. On the other hand, if the shutter switch SW1 is ON (S770), the system control circuit 50 determines the state of the AF mode flag stored in the internal memory of the system control circuit 50 or the memory 52 (S771).

  If the one-shot AF has been set (S771), the process returns to S739 to continuously perform shooting without performing AF and AE, and performs the next shooting. On the other hand, if the servo AF has been set (S771), the process returns to S732 to perform shooting while performing AF and AE continuously, and performs the next shooting.

[Fourth Embodiment]
The operation of the fourth embodiment of the present invention will be described with reference to FIGS. 1, 5 to 8 and FIGS. The operations shown in FIGS. 5 to 8 follow the operations of the first embodiment. FIGS. 15 to 17 show a flowchart of a main routine of the image processing apparatus 100 according to the fourth embodiment of the present invention.

  The third embodiment is an example of the operation of the image processing apparatus 100 that performs the point defect position detection processing in advance after a predetermined period has elapsed. However, the fourth embodiment is different from the operation example of selecting the predetermined point defect position detection mode. An example of the operation of the image processing apparatus 100 that performs the point defect position detection processing in advance is provided.

  Further, in the third embodiment, when the lens unit 300 is mounted, an image in which the shading correction coefficient or the shading correction function stored in the lens unit 300 is read into the image processing apparatus 100 and shading data is set. The fourth embodiment provides an operation example of the image processing apparatus 100 which performs shading data setting processing in advance when a predetermined shading data setting mode is selected.

  The operation of the image processing apparatus 100 will be described with reference to FIGS. First, the system control circuit 50 initializes flags, control variables, and the like when the power is turned on upon completion of battery replacement, and performs predetermined initial settings necessary for each unit of the image processing apparatus 100 (S801).

  Next, the system control circuit 50 determines the setting position of the power switch 66, and if the power switch 66 is set to the power OFF state (S802), changes the display of each display unit to the end state, and sets the flag and control. Necessary parameters including variables and the like, setting values, and setting modes are recorded in the non-volatile memory 56, and a predetermined control such as shutting off unnecessary power of each unit of the image processing apparatus 100 including the image display unit 28 by the power control unit 80. (S803), and returns to S802.

  If the power switch 66 has been set to power ON (S802), the system control circuit 50 causes the power control means 80 to change the remaining capacity of the power source 86 composed of a battery or the like and the operating condition to the operation of the image processing apparatus 100. It is determined whether or not there is a problem (S804). If there is a problem, a predetermined warning is given by image or sound using the output unit 54 (S805), and the process returns to S802.

  If there is no problem with the power supply 86 (S804), the system control circuit 50 determines the setting position of the mode dial 60, and if the mode dial 60 is set to the photographing mode (S806), the process proceeds to S811.

  If the mode dial 60 has been set to the point flaw position detection mode (S806, S807), the system control circuit 50 outputs a white point flaw that constantly outputs white data among pixels of the image sensor 14 and / or a constantly black flaw. A pixel corresponding to a black spot defect for outputting data is detected, and a point defect position detecting process for storing a pixel defect position address for specifying the pixel is performed (S808). When the process is completed, the process returns to S802. By using the pixel defect position address of the image sensor 14 detected in the point flaw position detection processing and performing interpolation calculation processing based on captured image data of adjacent pixels, point flaw correction processing of captured image data can be performed. . The details of the point flaw position detection processing S808 are as described above with reference to FIG.

  As described above, the point flaw position detection process is performed in the point flaw position detection mode which is a mode different from the shooting mode, and the point flaw position detection process is completed before the user of the image processing apparatus 100 starts the shooting operation. Thereby, it is possible to prevent the problem that the shutter release time lag is increased by performing the point flaw position detection process at the time of photographing.

  If the mode dial 60 has been set to the shading data setting mode (S806, S807), the system control circuit 50 sets the nonvolatile memory 56 (or the memory if a part or all of the memory 30 is configured as a nonvolatile memory). The shading correction data corresponding to the mounted lens unit 300 is read out from the non-volatile memory area 30 and the shading correction data to be stored in a predetermined area of the memory 30 which is a working area of the system control circuit 50 is set ( S809) When the process is completed, the process returns to S802.

  As described above, the shading correction data setting process is performed in the shading data setting mode which is a mode different from the shooting mode, and the shading correction data setting is completed before the user of the image processing apparatus 100 starts the shooting operation. Shading correction data is also set at the time of photographing, so that a problem that the shutter release time lag becomes large can be prevented.

  Then, by setting the shading correction data or the shading correction data including the shading correction function according to the mounted lens unit 300, the subject image is formed on the image sensor 14 of the image processing apparatus 100 via the lens unit 300. In order to compensate for the brightness shading and / or color shading generated in the process, a shading correction process of performing a multiplication process on the captured image data using a predetermined shading correction coefficient or a shading correction function according to the attached lens unit. It is possible to do.

  Also, using the shading correction data set according to the mounted lens unit 300, the aperture value of the aperture 312 of the lens unit 300 when photographing the subject and / or the focal length of the lens unit 300 when photographing the subject. It is possible to select a predetermined shading correction coefficient or shading correction function according to the value, and perform shading correction processing with an optimum correction amount.

  If the mode dial 60 has been set to another mode (S806, S807), the system control circuit 50 executes a process according to the selected mode (S810), and returns to S802 when the process is completed.

  The system control circuit 50 determines whether the recording medium 200 or 210 is mounted, obtains management information of image data recorded on the recording medium 200 or 210, and determines whether the operation state of the recording medium 200 or 210 is image processing. It is determined whether there is a problem in the operation of the apparatus 100, particularly, in the operation of recording and reproducing image data on the recording medium (S811). If there is a problem, a predetermined warning is given by an image or sound using the output unit 54. After that (S805), the process returns to S802.

  Then, it is determined whether or not the recording medium 200 or 210 is mounted, management information of the image data recorded on the recording medium 200 or 210 is obtained, and the operation state of the recording medium 200 or 210 is determined by the operation of the image processing apparatus 100. In particular, as a result of determining whether or not there is a problem in the recording / reproducing operation of the image data with respect to the recording medium (S811), if there is no problem, the process proceeds to S812.

  The system control circuit 50 checks the state of the AF mode setting switch 68, and if the one-shot AF mode is selected, sets the AF mode flag to one-shot AF (S813), and if the servo AF mode is selected. For example, the AF mode flag is set to servo AF (S814), and when the setting of the flag is completed, the process proceeds to S815.

  The system control circuit 50 uses the output unit 54 to display various setting states of the image processing apparatus 100 using images and sounds (S815), and proceeds to S831.

  If the image display of the image display unit 28 is ON, the various setting states of the image processing apparatus 100 are displayed by the image using the image display unit 28 as well.

  If the shutter switch SW1 is OFF (S831), the process returns to S802. On the other hand, if the shutter switch SW1 is ON (S831), the system control circuit 50 performs a distance measurement process to focus the photographing lens 10 on the subject, and performs a photometry process to determine an aperture value and a shutter time. Then, the distance measurement / photometry processing is performed, and the photometry data and / or setting parameters are stored in the internal memory of the system control circuit 50 or the memory 52 (S832). In the photometry processing, the flash setting is also performed if necessary. The details of the distance measurement / photometry processing S832 are as described above with reference to FIG.

  Then, an aperture value (Av value) and a shutter speed (Tv value) are determined according to the stored photometric data and / or setting parameters and the shooting mode set by the mode dial 60, and further, the determined shutter speed (Tv value) is determined. The charge accumulation time is determined according to the value (value), and is stored in the internal memory of the system control circuit 50 or the memory 52 (S833).

  The system control circuit 50 determines whether or not the dark capture processing has been performed since the shutter switch SW1 was turned on, or the charge storage time according to the measurement result of the distance measurement / photometry processing that has been performed but has been performed. Is changed (S834), the process proceeds to S835.

  If the dark capture processing has already been performed and the charge accumulation time has not been changed by the measurement result of the distance measurement / photometry processing further performed thereafter (S834), the process proceeds to S836.

  With the shutter 12 closed, the system control circuit 50 accumulates noise components such as dark current of the image sensor 14 for the same time as the actual photographing, and performs dark capture processing for reading out the accumulated noise image signal (S835). , S836.

  By performing a correction calculation process using the dark image data captured in the dark capture process, the captured image data is obtained with respect to image quality deterioration such as dark current noise generated by the image sensor 14 and pixel defects due to scratches inherent to the image sensor 14. Can be corrected. The details of this dark capture processing S835 are as described above with reference to FIG.

  The system control circuit 50 determines the aperture value A of the aperture 312 of the lens unit 300 from the photometric data and / or the setting parameters stored in the internal memory of the system control circuit 50 or the memory 52 (S836).

  Further, the system control circuit 50 acquires the focal length information of the lens unit 300 from the zoom control unit 344 via the lens control circuit 350, the interface 320, the connector 322, the connector 122, and the interface 120, and performs photographing from the acquired focal length information. Then, the focal length L of the lens unit 300 at the time of performing is determined (S837).

  Then, the system control circuit 50 determines a shading correction value from the aperture value A determined in S836 and / or the focal length value L determined in S837 (S838).

  As described above, in order to compensate for the brightness shading and / or the color shading generated in the process of forming the subject image on the image sensor 14 of the image processing apparatus 100 via the lens unit 300, the image processing apparatus 100 may be controlled depending on the mounted lens unit 300. Using the shading correction data set in S817, a predetermined value is set according to the aperture value A of the aperture 312 of the lens unit 300 when photographing the subject and / or the focal length L of the lens unit 300 when photographing the subject. By selecting and using a shading correction coefficient or a shading correction function and performing multiplication processing on the captured image data, it is possible to perform shading correction processing with an optimum correction amount.

  Next, if the shutter switch SW2 is OFF (S839), the system control circuit 50 determines the state of the shutter switch SW1. If the shutter switch SW1 has been released (S840), the process returns to S802.

  If the shutter switch SW1 is ON (S840), the system control circuit 50 determines the state of the AF mode flag stored in the internal memory of the system control circuit 50 or the memory 52 (S841), and one-shot AF is set. If so, the process returns to S839. On the other hand, if the servo AF has been set (S841), the process returns to S832. If the shutter switch SW2 is ON (S839), the process proceeds to S861.

  The system control circuit 50 determines whether or not the image storage buffer area capable of storing the captured image data is in the memory 30 (S861), and the area capable of storing new image data in the image storage buffer area of the memory 30. If there is no warning, a predetermined warning is issued by image or sound using the output unit 54 (S862), and the process returns to S802. Here, when there is no area capable of storing new image data in the image storage buffer area of the memory 30, for example, the maximum number of continuous shots that can be stored in the image storage buffer area of the memory 30 is performed. Immediately after, the first image to be read from the memory 30 and written to the storage medium 200 or 210 is not yet recorded on the recording medium 200 or 210, and one empty area still remains on the image storage buffer area of the memory 30. For example, there is a case where it cannot be secured.

  When the captured image data is stored in the image storage buffer area of the memory 30 after being subjected to the compression process, the image data can be stored in consideration of the fact that the amount of compressed image data differs according to the setting of the compression mode. In step S861, it is determined whether the area is on the image storage buffer area of the memory 30.

  If there is an image storage buffer area capable of storing the captured image data in the memory 30 (S861), the system control circuit 50 reads out the image pickup signal that has been imaged and accumulated for a predetermined time from the image sensor 12, and performs A / D conversion. A photographing process for writing photographed image data in a predetermined area of the memory 30 is executed via the device 16, the image processing circuit 20, the memory control circuit 22, or directly from the A / D converter via the memory control circuit 22 ( S863). The details of the photographing process S863 are as described above with reference to FIG.

  After the photographing process S863 is completed, the system control circuit 50 performs a subtraction process on the photographed image data by using the dark image data previously captured in the dark capturing process S835, thereby obtaining dark current noise or the like of the image sensor 14. Is performed (S864).

  Then, the system control circuit 50 determines in S841 in order to compensate for luminance shading and / or color shading generated in the process of forming the subject image on the image sensor 14 of the image processing device 100 via the lens unit 300. A shading correction process is performed by performing a multiplication process on the captured image data using a predetermined shading correction coefficient or shading correction function (S865).

  Further, the system control circuit 50 performs a point flaw position detection process S810 to compensate for a pixel related to a white point flaw that always outputs white data and / or a black point flaw that always outputs black data among the pixels of the image sensor 14. The point flaw correction process is performed by performing an interpolation calculation process using the photographed image data of the pixel adjacent to the flaw pixel while referring to the pixel defect position address of the image sensor 14 detected in step (S866).

  As described above, prior to photographing, the image data for dark correction is captured, the shading correction coefficient or the shading correction function is determined according to the aperture value and / or the focal length of the lens to be used, and the pixels of the image sensor 14 for correcting point flaws. Detects a defect position address, performs dark correction processing for subtraction processing of a dark captured image on captured image data, shading correction processing for multiplying a shading correction coefficient or a shading correction function, and adjacent to a flaw pixel. It is possible to simultaneously or continuously perform the point flaw correction processing for performing the interpolation calculation processing using the photographed image data of the pixel to be processed.

  As a result, it is possible to obtain good photographed image data that has a small shutter release time lag and that has been subjected to dark correction, shading correction, and point flaw correction.

  The system control circuit 50 reads out a part of the image data written in a predetermined area of the memory 30 through the memory control circuit 22 and performs a WB (white balance) integration operation process, OB ( (Optical black) Integral calculation processing is performed, and the calculation result is stored in the internal memory of the system control circuit 50 or the memory 52.

  Then, the system control circuit 50 reads out the captured image data written in a predetermined area of the memory 30 using the memory control circuit 22 and, if necessary, the image processing circuit 20, and reads out the internal memory of the system control circuit 50 or Using the calculation results stored in the memory 52, various development processes including AWB (auto white balance) process, gamma conversion process, and color conversion process are performed (S867).

  Then, the system control circuit 50 reads out the image data written in the predetermined area of the memory 30 and performs the image compression processing according to the set mode by the compression / decompression circuit 32 (S868). Image data that has been photographed and has undergone a series of processing is written in the free image portion of the area.

  With the execution of a series of photographing operations, the system control circuit 50 reads out the image data stored in the image storage buffer area of the memory 30 and sends the image data to a memory card or a compact flash (registered) via the interface 90 or 94 and the connector 92 or 96. The recording process for writing to the recording medium 200 or 210 such as a trademark card is started (S869).

  The start of the recording process is performed on the image data each time a series of processing-completed image data is newly written into the empty image portion of the image storage buffer area of the memory 30 after shooting.

  In addition, while the image data is being written to the recording medium 200 or 210, a recording medium writing operation display such as blinking of an LED is performed on the output unit 54 in order to clearly indicate that the writing operation is being performed.

  Next, the system control circuit 50 determines whether or not the shutter switch SW1 is ON (S870). If the shutter switch SW1 is OFF (S870), the process returns to S802. On the other hand, if the shutter switch SW1 is ON (S870), the system control circuit 50 determines the state of the AF mode flag stored in the internal memory of the system control circuit 50 or the memory 52 (S871).

  If the one-shot AF has been set (S871), the process returns to S839 to perform shooting continuously without performing new AF and AE, and performs the next shooting. On the other hand, if the servo AF has been set (S871), the process returns to S832 to perform shooting while performing AF and AE continuously, and performs the next shooting.

  In this embodiment, it has been described that the point flaw detection processing routine or the shading data setting processing routine is executed in accordance with the setting of the mode dial 60. There is no problem in the configuration for executing the scratch position detection processing routine and / or the shading data setting processing routine.

  In the first embodiment, a point flaw position detection process is performed in advance when power is turned on upon completion of battery replacement, and shading stored in the image processing apparatus 100 when the lens unit 300 is mounted. The operation example of the image processing apparatus 100 for setting the shading data using the shading correction coefficient or the shading correction function corresponding to the mounted lens unit 300 among the correction coefficients or the shading correction functions has been described.

  Further, in the second embodiment, when the power switch 66 is set to power ON, the point defect position detection processing is performed in advance, and when the lens unit 300 is mounted, the shading stored in the image processing apparatus 100 is performed. The operation example of the image processing apparatus 100 for setting the shading data using the shading correction coefficient or the shading correction function corresponding to the mounted lens unit 300 among the correction coefficients or the shading correction functions has been described.

  In the third embodiment, when a predetermined period has elapsed, the point defect position detection processing is performed in advance, and the shading correction coefficient or the shading correction stored in the lens unit 300 when the lens unit 300 is mounted. The operation example of the image processing apparatus 100 in which the function is read into the image processing apparatus 100 and the shading data is set has been described.

  In the fourth embodiment, the image processing apparatus 100 performs the point flaw position detection processing in advance when the predetermined point flaw position detection mode is selected, and performs the shading data setting processing in advance when the predetermined shading data setting mode is selected. An operation example was shown.

  However, the above is only a part of the application example of the present invention, and the start condition of the point flaw position detection process described in one embodiment and the start of the shading data setting process described in another embodiment are described. An embodiment in which conditions are combined may be adopted.

  From another viewpoint, in the first embodiment, an operation example of the image processing apparatus 100 that determines a shading correction value using a result of performing distance measurement and photometry processing when SW1 is turned on has been described. .

  In the second embodiment, the operation example of the image processing apparatus 100 that determines the shading correction value after the SW2 is turned on using the result of the distance measurement and the photometry processing has been described.

  However, the above is only a part of the application example of the present invention. For example, according to the setting of the AF mode, when the one-shot AF mode is set, SW1 is turned on and the result of the distance measurement and photometry processing is performed. The shading correction value may be determined using the result, and when the servo AF mode is set, the result of the distance measurement and photometry processing may be used to determine the shading correction value after the SW2 is turned on.

  Further, from another viewpoint, in the first embodiment and the second embodiment, it has been described that the shading correction data is set when the lens unit 300 is mounted on the image processing apparatus 100. Further, in the third embodiment, it has been described that the shading correction data is read when the lens unit 300 is mounted on the image processing apparatus 100.

  However, the above is only a part of the application example of the present invention. For example, when the battery is replaced and / or the power switch is set to the ON state, the shading correction data is set or read. Is also good.

  Further, from another viewpoint, in the third embodiment, it has been described that when the lens unit 300 is mounted on the image processing apparatus 100, the shading correction data is read and stored in the nonvolatile memory. However, this is only a part of the application example of the present invention. For example, there is no problem even if the shading correction data is read and stored in the volatile memory every time the lens 300 is mounted.

  Here, in each of the above-described embodiments, the description has been made assuming that the shading correction processing is performed by performing the multiplication processing on the captured image data using the shading correction coefficient or the shading correction function. As a more specific example of this processing, a shading correction coefficient or a shading correction function for one line is prepared for each of the horizontal line direction and the vertical line direction of the captured image data, and the captured image data is In contrast, by performing the multiplication process in the horizontal line direction and the multiplication process in the vertical line direction, the shading correction process can be performed.

  Further, in each of the above embodiments, in the shading data setting processing step or the shading data reading processing step, the shading correction data including the shading correction coefficient or the shading correction function is set or read from the lens 300. explained. However, this is only a part of an application example of the present invention, and for example, shading correction image data that has been image-compressed by JPEG compression or the like may be set by expanding the image. In this case, the image may be expanded after the shading correction image data obtained by compressing the image is read from the lens 300.

  Assuming that the shading correction image data has the same data amount as the pixel size of the image sensor 14, if the time required for data transfer is longer than the time required for image expansion, the shading correction image data is compressed. By performing the transfer, the processing time can be significantly reduced.

  In another aspect, in each of the above embodiments, a subject is photographed using shading correction data that is set or read according to the mounted lens unit 300 or shading correction data including a shading correction function. A predetermined shading correction coefficient or a shading correction function is selected according to the aperture value A of the aperture 312 of the lens unit 300 and / or the focal length value L of the lens unit 300 at the time of photographing a subject. It has been described that the shading correction processing of the optimum correction amount is performed by performing the multiplication processing on the captured image data.

  However, this is only a part of an application example of the present invention. For example, shading data set or read when the lens unit 300 is mounted is used as basic shading correction data, and a subject is photographed with respect to the basic shading correction data. A predetermined correction coefficient is added and / or multiplied according to the aperture value A of the aperture 312 of the lens unit 300 at the time and / or the focal length value L of the lens unit 300 at the time of photographing a subject, and photographing is performed using this. By performing a multiplication process on the image data, a shading correction process with an optimum correction amount may be performed. Alternatively, instead of using a predetermined correction coefficient by adding and / or multiplying it, a predetermined shading correction coefficient or a shading correction function may be selected and used by adding and / or multiplying a predetermined correction coefficient. Further, from another viewpoint, in the description of each of the above-described embodiments, it has been described that dark correction, shading correction, and point flaw correction are performed when the shooting processing is performed. There is no problem even if you attach. Here, if the shading correction coefficient or the shading correction function is attached to the photographed image data and / or the pixel defect position address of the image sensor 14 is attached for performing the point flaw correction, the attached information is used. It is possible to reduce the degree to which the size of the captured image file increases. When the captured image fill is reproduced using a reproducing device such as a computer, shading correction processing is performed using the attached shading correction coefficient or shading correction function, and a point defect is performed using the attached pixel defect address. By performing the correction processing, it is possible to reproduce and display good image data.

  Further, from another viewpoint, in the above-described first and second embodiments, it has been described that the shading correction data is set when the lens unit 300 is mounted on the image processing apparatus 100. Further, in the above-described third embodiment, it has been described that the shading correction data is read when the lens unit 300 is mounted on the image processing apparatus 100. However, the above is only a part of the application example of the present invention. When the lens unit 300 is mounted on the image processing apparatus 100, the image processing apparatus 100 is connected to a wired communication unit such as USB or IEEE1394, a wireless communication unit, or a LAN. The shading correction data may be transferred from an external device such as a computer connected by a network means such as.

  Further, from another viewpoint, in each of the above embodiments, the description has been made assuming that the mirror 130 is moved to the mirror-up position and the mirror-down position to perform the photographing operation. The photographing operation may be performed without performing the operation.

  The recording media 200 and 210 include not only memory cards such as PCMCIA cards and CompactFlash (registered trademark), hard disks, but also micro DATs, magneto-optical disks, optical disks such as CD-R and CD-WR, and DVDs. It may be constituted by a changeable optical disk or the like. Further, the recording media 200 and 210 may be a composite medium in which a memory card and a hard disk are integrated, or may have a configuration in which a part of the composite medium is detachable.

  In the above embodiment, the recording media 200 and 210 are described as being separated from the image processing apparatus 100 and can be arbitrarily connected. However, any or all of the recording media are fixed to the image processing apparatus 100. May be.

  Further, the recording medium 200 or 210 may be connected to the image processing apparatus 100 singly or in an arbitrary number.

  In the above-described embodiment, the configuration in which the recording media 200 and 210 are mounted on the image processing apparatus 100 has been described. However, the recording media may have a single configuration or a combination of a plurality of recording media.

  The present invention may be applied to a system including a plurality of devices or to an apparatus including a single device.

  Further, an object of the present invention is to supply a storage medium (or a recording medium) in which a program code of software for realizing the functions of the above-described embodiments is recorded to a system or an apparatus, and a computer (or a CPU or a CPU) of the system or the apparatus. Needless to say, the present invention can also be achieved by an MPU) reading and executing a program code stored in a storage medium. In this case, the program code itself read from the storage medium realizes the function of the above-described embodiment, and the storage medium storing the program code constitutes the present invention. When the computer executes the readout program code, not only the functions of the above-described embodiments are realized, but also an operating system (OS) running on the computer based on the instruction of the program code. It goes without saying that a part or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing.

  Further, after the program code read from the storage medium is written into a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer, the function is executed based on the instruction of the program code. It goes without saying that the CPU included in the expansion card or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

  In addition, the present invention may combine each of the above-described embodiments or their technical elements as needed.

  In addition, the present invention may be applied to a case where all or a part of the configuration of the claims or the embodiment forms one device or is combined with another device. , Which may be a constituent element of the device.

  In addition, the present invention is an electronic camera that captures moving images or still images, a camera using a silver halide film, a single-lens reflex camera, a lens shutter camera, a surveillance camera, and various other types of cameras. Imaging devices, image reading devices, optical devices, other devices, and further, cameras, imaging devices, image reading devices, optical devices, devices applied to other devices, and elements constituting these devices, The present invention is also applicable to a control method of the apparatus and a medium such as a storage medium that provides the control method.

FIG. 1 is a block diagram illustrating a configuration of an image processing device (imaging device) according to a preferred embodiment of the present invention. FIG. 4 is a diagram illustrating a part of a flowchart of a main routine of the image processing apparatus according to the first embodiment of the present invention. FIG. 4 is a diagram illustrating a part of a flowchart of a main routine of the image processing apparatus according to the first embodiment of the present invention. FIG. 4 is a diagram illustrating a part of a flowchart of a main routine of the image processing apparatus according to the first embodiment of the present invention. 5 is a flowchart of a ranging / photometry processing routine common to each embodiment of the present invention. 9 is a flowchart of a shooting processing routine common to each embodiment of the present invention. 7 is a flowchart of a dark capture processing routine common to each embodiment of the present invention. 9 is a flowchart of a point flaw position detection processing routine common to each embodiment of the present invention. FIG. 13 is a diagram illustrating a part of a flowchart of a main routine of the image processing apparatus according to the second embodiment of the present invention. FIG. 13 is a diagram illustrating a part of a flowchart of a main routine of the image processing apparatus according to the second embodiment of the present invention. FIG. 13 is a diagram illustrating a part of a flowchart of a main routine of the image processing apparatus according to the second embodiment of the present invention. FIG. 14 is a diagram illustrating a part of a flowchart of a main routine of the image processing apparatus according to the third embodiment of the present invention. FIG. 14 is a diagram illustrating a part of a flowchart of a main routine of the image processing apparatus according to the third embodiment of the present invention. FIG. 14 is a diagram illustrating a part of a flowchart of a main routine of the image processing apparatus according to the third embodiment of the present invention. FIG. 14 is a diagram illustrating a part of a flowchart of a main routine of the image processing apparatus according to the fourth embodiment of the present invention. FIG. 14 is a diagram illustrating a part of a flowchart of a main routine of the image processing apparatus according to the fourth embodiment of the present invention. FIG. 14 is a diagram illustrating a part of a flowchart of a main routine of the image processing apparatus according to the fourth embodiment of the present invention.

Explanation of reference numerals

DESCRIPTION OF SYMBOLS 12 Shutter 14 Image sensor 16 A / D converter 18 Timing generation circuit 20 Image processing circuit 22 Memory control circuit 24 Image display memory 26 D / A converter 28 Image display unit 30 Memory 32 Image compression / expansion circuit 40 Shutter control unit 42 Distance measuring unit 46 Photometric unit 48 Flash 50 System control circuit 52 Memory 54 Output unit (display unit, speaker)
56 Non-volatile memory 60 Mode dial switch 62 Shutter switch SW1
64 Shutter switch SW2
68 AF mode switch 70 Operation unit 72 Power switch 80 Power control unit 82 Connector 84 Connector 86 Power supply unit 90 Interface 92 Connector 94 Interface 96 Connector 98 Recording medium attachment / detachment detection unit 100 Image processing device 104 Optical finder 106 Lens mount 108 Illumination unit 110 Communication Part 112 Connector (or antenna)
Reference Signs List 120 interface 122 connector 124 lens attachment / detachment detection unit 130 mirror 132 mirror 140 photoelectric conversion unit 142 photoelectric conversion element 144 charge readout unit 146 electrode 148 temperature measurement unit 200 recording medium 202 recording unit 204 interface 206 connector 210 recording medium 212 recording unit 214 interface 216 Connector 300 Lens unit 306 Lens mount 310 Photo lens 312 Aperture 320 Interface 322 Connector 340 Exposure control unit 342 Distance measurement control unit 344 Zoom control unit 350 Lens system control circuit

Claims (27)

An imaging sensor;
Detecting means for detecting a pixel defect position of the image sensor each time a predetermined time elapses;
Storage means for updating and storing the detection result of the detection means,
An imaging device comprising:   2. The imaging apparatus according to claim 1, further comprising a correction unit configured to correct an image captured by the imaging sensor based on a detection result of the detection unit.   The imaging apparatus according to claim 1, further comprising a recording unit configured to record a detection result of the detection unit together with an image captured by the imaging sensor on a recording medium. An imaging sensor;
Detecting means for detecting a pixel defect position of the image sensor every predetermined number of times of imaging,
Storage means for updating and storing the detection result of the detection means,
An imaging device comprising:   The imaging apparatus according to claim 4, further comprising a correction unit configured to correct an image captured by the imaging sensor based on a detection result of the detection unit.   The imaging apparatus according to claim 4, further comprising a recording unit configured to record a detection result of the detection unit together with an image captured by the imaging sensor on a recording medium. An imaging sensor;
An imaging apparatus, comprising: a detection unit that detects a pixel defect position of the imaging sensor; and a recording unit that records a detection result of the detection unit together with an image captured by the imaging sensor on a recording medium.   In an imaging device in which an imaging optical system can be exchangeably mounted, an operation unit for instructing start of imaging, and information for specifying the mounted imaging optical system for shading correction of a captured image related to the mounted imaging optical system. An imaging apparatus comprising: a specific information acquisition unit that acquires before the operation unit is operated.   The operation unit is configured to instruct shooting preparation by a first-stage operation, and to start shooting by a second-stage operation, and the specific information acquisition unit is configured to operate the first-stage operation of the operation unit. 9. The image pickup apparatus according to claim 8, wherein information for specifying the image pickup optical system is acquired before the image pickup is performed.   The imaging apparatus according to claim 8, wherein the identification information acquisition unit acquires information for identifying the imaging optical system from the imaging optical system to be mounted.   Detecting means for detecting that the imaging optical system is mounted, wherein the specific information acquisition means detects the mounting of the imaging optical system in response to the detection means detecting that the imaging optical system is mounted. The imaging device according to claim 8, wherein information to be specified is acquired.   12. The image processing apparatus according to claim 8, further comprising a correction unit configured to correct a captured image using data for shading correction based on the information specifying the imaging optical system acquired by the specific information acquisition unit. Imaging device.   12. A recording unit according to claim 8, further comprising a recording unit that records data for shading correction based on the information specifying the imaging optical system acquired by the specific information acquiring unit together with a captured image on a recording medium. An imaging device according to item 1.   In an imaging device capable of replacing the imaging optical system, in order to perform shading correction of a captured image related to the mounted imaging optical system, specific information acquisition means for acquiring information for specifying the mounted imaging optical system, An image capturing apparatus comprising: a recording unit configured to record data for shading correction based on information specifying the imaging optical system acquired by the specific information acquiring unit on a recording medium together with a captured image.   An information acquisition unit for acquiring information for shading correction of a photographed image, and a recording unit for recording the information for shading correction acquired by the information acquisition unit on a recording medium together with the photographed image. Imaging device.   A method for controlling an imaging apparatus, comprising: detecting a pixel defect position of an imaging sensor every time a predetermined time elapses; and updating and storing the detection result.   A method for controlling an image pickup apparatus, comprising: detecting a pixel defect position of an image sensor every predetermined number of times of photographing; and updating and storing the detection result.   A method for controlling an imaging device, comprising: detecting a pixel defect position of an imaging sensor; and recording the detection result together with an image captured by the imaging sensor on a recording medium.   In a control method of an imaging apparatus in which an imaging optical system can be exchangeably mounted, an operation of instructing to start capturing information for specifying the mounted imaging optical system for shading correction of a captured image related to the mounted imaging optical system. A method for controlling an imaging device, wherein the method is obtained before a unit is operated.   In the control method of the imaging device capable of replacing the imaging optical system, in order to perform shading correction of a captured image relating to the mounted imaging optical system, information for identifying the mounted imaging optical system is acquired, and the acquired A method for controlling an imaging apparatus, comprising: recording data for shading correction based on information for specifying the imaging optical system in a recording medium together with a captured image.   A method for controlling an imaging apparatus, comprising: acquiring information for shading correction of a captured image, and recording the acquired information for shading correction on a recording medium together with the captured image.   A medium for providing a control program for an imaging device, comprising: a content for detecting a pixel defect position of an imaging sensor every time a predetermined time elapses; and a content for updating and storing the detection result. Contents for detecting a pixel defect position of the image sensor every predetermined number of times of imaging,
A medium for providing a control program for an imaging apparatus, comprising: contents for updating and storing the detection result.   A medium for providing a control program for an imaging device, characterized by detecting a pixel defect position of an imaging sensor and recording the detection result together with an image captured by the imaging sensor on a recording medium.   In a medium that provides a control program for an imaging device capable of replacing and mounting an imaging optical system, information for specifying the mounted imaging optical system is started for shading correction of a captured image related to the mounted imaging optical system. A medium for providing a control program for an imaging apparatus, characterized in that the medium has content to be acquired before an operation means for instructing is performed.   In a medium that provides a control program of an imaging device capable of replacing and mounting an imaging optical system, information for specifying the mounted imaging optical system is acquired for shading correction of a captured image related to the mounted imaging optical system. A medium for providing a control program for an imaging apparatus, characterized in that data for shading correction based on the acquired information specifying the imaging optical system is recorded together with a captured image on a recording medium. A medium for providing a control program for an imaging apparatus, characterized by acquiring information for shading correction of a captured image, and recording the acquired information for shading correction on a recording medium together with the captured image.

Images