JP2005318465A - Imaging apparatus and method for processing image data thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus and a method for processing an image data thereof, using a simple structure and processing method, capable of suppressing deterioration of object image data due to dust attached to an optical filter on an optical axis. <P>SOLUTION: An imaging apparatus 100 includes an imaging function 10 for photographing an object by means of an imaging device, so as to obtain as image data (object image data); a display function 20 for displaying the photographed object image data and a variety of menus; an image memory 30 for storing and preserving (memorizing) the object image data; an interpolation data memory 40 for storing an image data for interpolation; a control unit 60 for controlling the operation state in each function, based on a control program stored in a system memory 50; and an interpolation function section 70 for performing correction processing of the object image data obtained by the imaging function 10. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an imaging apparatus and an image data processing method thereof, and more particularly to an imaging apparatus that acquires an arbitrary subject image projected on an imaging device such as a charge coupled device via an optical system as image data including a digital signal, and The present invention relates to the image data processing method.

In recent years, imaging devices such as a digital still camera and a digital video camera, and portable devices such as a mobile phone and a personal digital assistant having a photographing function have been widely used. Hereinafter, for convenience of explanation, these devices are collectively referred to as “imaging device”.
Such an imaging device captures and stores a large amount of subject images (image data) by using a built-in memory or simply mounting a small memory card, as compared with a camera using a conventional silver salt film. This reduces the time required for loading and replacing the film, and is equipped with a display panel (liquid crystal display panel, etc.), so you can immediately check the shot subject image and suppress shooting errors. And has various advantageous functions such as the ability to organize (delete) unnecessary images.

  Furthermore, in recent years, a photographing function is mounted as a standard or additional function in portable devices originally developed for other functional uses such as a mobile phone, a portable information terminal, a USB flash memory, and the like. Since various objects can be easily photographed and stored, it is widely used as an alternative to silver salt film cameras and as a simple imaging device in Japan and overseas. .

Here, a schematic configuration of the imaging apparatus according to the related art will be briefly described.
FIG. 7 is a schematic cross-sectional view showing an example of an optical mechanism of an imaging apparatus (digital still camera; hereinafter referred to as “digital camera”) in the prior art, and FIG. 8 is a conceptual diagram illustrating the imaging principle of the imaging apparatus. It is. FIG. 9 is a conceptual diagram for explaining the problems of the imaging device in the prior art.

  As shown in FIG. 7, the imaging apparatus according to the related art generally includes an optical system including a lens barrel 11 p, an optical lens 12 p, and the like disposed on the subject side of the housing CASE, and the inside of the housing CASE. And an imaging device 14p composed of a charge coupled device (CCD), a CMOS sensor, or the like arranged perpendicular to the optical axis in the system, as shown in FIG. 8A, through an optical lens 12p. As shown in FIG. 8 (b), the amount of light corresponding to the image light of the subject SUB projected on the light receiving surface of the imaging device 14p is detected for each imaging pixel and converted into an electrical signal. Image data (subject image data) IMGp is generated.

Here, generally, various optical filters 13p such as a low-pass filter and an infrared absorption filter are provided between the optical lens 12p and the imaging device 14p of the imaging apparatus, as shown in FIGS. It has a configuration.
Specifically, since the imaging device 14p has a configuration in which a plurality of imaging pixels are regularly arranged on the light receiving surface, an object having a spatial frequency component approximate to the sampling spatial frequency determined by the pixel interval. It is known that so-called moire appears in the subject image data IMGp when the SUB is imaged.

Therefore, by arranging a low-pass filter on the optical path of the image light of the subject SUB and transmitting the image light, the spatial frequency component near the sampling spatial frequency component can be reduced from the spatial frequency of the subject image.
The infrared absorption filter removes the infrared wavelength component from the image light of the subject SUB projected onto the imaging device 14p via the optical system, and the light receiving sensitivity peculiar to the imaging device SUB is changed to the light receiving sensitivity by human vision. It is for approximation.

  By the way, in the imaging apparatus having such a known configuration, a space exists between the optical system (optical lens 12p) and the imaging device 14p. In particular, in an interchangeable lens type imaging device and an imaging device having a retractable structure in which an optical system protrudes from a housing CASE, dust and dust are likely to enter the space, and a low-pass filter applied as the optical filter 13p. Is made of a highly chargeable material such as quartz or lithium niobate, and as shown in FIG. 9A, dust, dirt, dirt, etc. (hereinafter abbreviated as “dust”) entering the space. ) DST tends to adhere to the surface of the optical filter (low-pass filter) 13p, and the image light of the subject SUB is blocked at the time of photographing, so that the amount of received light (charge accumulation amount) in the corresponding imaging pixel is reduced and defective pixels are obtained. As shown in FIG. 9B, there is a problem in that the subject image data IMGx is deteriorated.

  As a configuration for suppressing the deterioration of the subject image due to dust adhering to the filter of such an image pickup apparatus, for example, Patent Document 1 discloses an optical filter (low-pass filter) to which dust adheres at the time of photographing a subject. By moving parallel to the (CCD area sensor), the imaging pixels that are affected by dust (the amount of received light decreases) are dispersed and the amount of decrease in the amount of received light (the amount of shadow) in each imaging pixel is relatively suppressed. The structure to be described is described.

JP 2002-10137 A (Pages 5 to 6, FIGS. 1 and 6)

  However, in the imaging apparatus (digital camera) described in Patent Document 1 and the like described above, a filter is applied to the imaging device in order to suppress deterioration of subject image data due to dust attached to the optical filter (low-pass filter). Since it has a drive mechanism that moves in parallel and it is necessary to control the drive mechanism so that the optical filter is moved each time a subject is photographed, the configuration and drive control of the imaging device are complicated, and power consumption is increased. Had the problem of inviting.

  Therefore, in view of the above problems, the present invention provides an imaging apparatus capable of suppressing deterioration of subject image data due to dust attached to an optical filter on the optical axis and a method for processing the image data, with a simple configuration and processing method. The purpose is to provide.

  According to a first aspect of the present invention, there is provided an imaging apparatus that captures an image of a subject and obtains it as image data, an imaging unit that detects image light projected on a light receiving surface and converts the image light into an electrical signal, and the subject of the imaging unit And an optical filter that changes a specific wavelength component included in the image light of the subject, and projects the subject onto the light receiving surface of the imaging means via the optical filter, thereby image of the subject An object image data acquisition unit that acquires first image data based on light, and an interpolation image that acquires second image data by irradiating only the detection light to the imaging unit via the optical filter. Data acquisition means; pixel data interpolation means for interpolating specific pixel data included in the first image data; and image data storage for storing the interpolated first image data. Characterized in that it comprises a means.

According to a second aspect of the present invention, in the imaging apparatus according to the first aspect, the pixel data interpolating unit specifies a specific pixel based on the second image data, and the specific pixel in the first image data. Interpolation processing is performed based on pixel data of a plurality of pixels located in the periphery.
According to a third aspect of the present invention, in the imaging apparatus according to the second aspect, the pixel data is chromaticity data, and the pixel data interpolating means includes chromaticities in a plurality of pixels located around the specific pixel. The average value of the data is pixel data of the specific pixel.

According to a fourth aspect of the present invention, in the imaging apparatus according to the first aspect, the interpolation image data acquisition means includes a light source that is provided in a casing of the imaging apparatus and that emits the detection light. Features.
According to a fifth aspect of the present invention, in the imaging device according to the fourth aspect, the light source is provided on a side end surface of the optical filter, and is configured to make the detection light incident from the side end surface. It is characterized by.
According to a sixth aspect of the present invention, in the imaging apparatus according to the first aspect, the optical filter has a configuration in which at least a low-pass filter and an infrared absorption filter are stacked.

  According to a seventh aspect of the present invention, there is provided an image data processing method of an image pickup apparatus that detects image light of a subject projected on a light receiving surface of an image pickup unit via an optical filter, and acquires the image light as image data. A process of irradiating only the detection light to the imaging means to acquire image data for interpolation; a process of acquiring the subject image data by projecting the subject onto the light receiving surface of the imaging means via the optical filter; And a process of specifying a specific pixel included in the subject image data based on the interpolation image data and interpolating the pixel data of the specific pixel.

  According to an eighth aspect of the present invention, in the image data processing method of the imaging device according to the seventh aspect, the pixel data is chromaticity data, and the process of interpolating the pixel data is located around the specific pixel. The average value of the chromaticity data in the plurality of pixels is the pixel data of the specific pixel.

  In other words, the imaging apparatus and the image data processing method thereof according to the present invention have an optical lens and an optical filter (low-pass filter, infrared absorption) for an imaging device (imaging means) such as a CCD disposed on the optical axis of the optical lens. A subject image is projected through a filter or the like, and a charge accumulation amount (light reception amount) based on the image light is detected and converted into an electrical signal, thereby obtaining subject image data (photographing the subject). In the imaging apparatus, at least the interpolation image data acquisition unit irradiates the optical filter and the imaging unit with detection light directly without capturing external light (image light) through the optical lens prior to photographing the subject. The image data for interpolation (second image data) is acquired, and the imaging device is acquired by the subject image data acquisition means via the optical lens and the optical filter. The subject image data (first image data) is acquired based on the subject image (image light) projected on the light receiving surface of the sensor, and is attached to the optical filter by the pixel data interpolation unit based on the interpolation image data. The position of an image pickup pixel (specific pixel) whose received light amount has been reduced by the dust and the defective pixel (specific pixel) of the image pickup device is specified, and normal pixel data around the specific pixel in the subject image data (for example, chromaticity data, etc.) ) To generate and set pixel data of the specific pixel.

According to this, the optical filter has a simple configuration in which a light source that emits detection light is provided inside the housing of the imaging device, and the image data for interpolation is acquired at an arbitrary timing prior to photographing the subject. An imaging pixel and a defective pixel (specific pixel) affected by attached dust can be specified, and the pixel data of the specific pixel is interpolated based on surrounding pixel data with respect to the subject image data acquired thereafter. By simple data processing operation, the pixel data of the specific pixel can be restored, and subject image data that approximates the original subject image can be obtained.
Further, according to such a configuration and data processing method, it is not necessary to drive the mechanism unit, and it is possible to suppress deterioration of subject image data due to the specific pixel only by program control. Can be suppressed.

Hereinafter, an imaging device and an image data processing method thereof according to the present invention will be described in detail with reference to embodiments.
First, the system configuration of the imaging apparatus according to the present invention will be described.
FIG. 1 is a block diagram showing a system configuration of an imaging apparatus according to the present invention.

  As shown in FIG. 1, the imaging apparatus 100 according to the present embodiment roughly captures a subject with an imaging device (imaging means) such as a CCD and acquires it as image data (subject image data) (subject image). Data acquisition means) 10, a display function unit 20 for displaying image data of a photographed subject and various menus, an image memory (image data storage means) 30 for storing and saving (storing) subject image data, and for interpolation Based on an interpolation data memory 40 that stores image data, a system memory 50 that stores control programs and control data that are executed in a control unit (CPU) 70 that will be described later, and a control program that is stored in the system memory 50. The control unit 60 that controls the operation state in the function unit and the subject image data acquired by the imaging function unit 10 are corrected. An interpolation function section (interpolation image data acquisition means, pixel data interpolation means) 70 and an operation function section 80 for operating various functional operations in the imaging apparatus 100. It has the structure mutually connected via the bus | bath. Each of these functional units is supplied with predetermined operating power from a power supply (not shown).

Next, a specific configuration example when the imaging apparatus according to the present invention is applied to a digital camera is shown, and will be described in association with each of the above functional units.
FIG. 2 is a schematic configuration diagram showing a specific example of a digital camera applied to the imaging apparatus according to the present invention. Here, FIGS. 2A and 2B show the appearance of the digital camera according to this example, and FIG. 2C shows the schematic cross-sectional structure of the digital camera. Moreover, about the structure equivalent to the prior art mentioned above, the same or equivalent code | symbol is attached | subjected and demonstrated.

  2A to 2C, a digital camera (imaging device) 100A according to the present embodiment includes, for example, a lens barrel 11 and an optical lens provided on one surface side (subject side) of a case CASE. 12, a flash 15, a finder 16, a distance measuring sensor 17 for autofocus, a display panel 21 provided on the other side (user side or eyepiece side) of the case CASE, and on / off switching of the display panel 21 A button 22, a selection / determination button 81 for menu selection / determination, a menu display button 82, a zoom lever 83, a shutter button 84, a power on / off button 85 provided on the other side and the upper side of the housing CASE; An optical filter 13 including a low-pass filter and an infrared absorption filter disposed inside the housing CASE and on the optical axis of the optical lens 12, CCD, C An imaging device 14 including an OS sensor, and a light source 71 such as a light emitting diode (LED) provided in a position within the housing CASE at a position where the optical filter 13 and the imaging device 14 can be directly irradiated with detection light. ing.

Hereinafter, each functional unit illustrated in FIG. 1 will be described with reference to each specific configuration illustrated in FIG. 2. Here, a configuration well known in an imaging apparatus such as a digital camera will be briefly described.
The imaging function unit 10 includes a lens barrel 11, an optical filter 13, an imaging device 14, a flash 15, a finder 16, a distance measuring sensor 17, a lens driving unit (not shown), and the like, which are provided with an optical lens 12. The subject displayed on the display panel 21 is photographed through the viewfinder 13 or read (read by the imaging device) under the control of the operation buttons of the operation function unit 90 or the control program of the control unit (CPU) 70. , And has a function of acquiring as subject image data.
Here, the subject image data acquired by the imaging function unit 10 is temporarily stored in the image memory 30.

  The display function unit 20 controls the display panel 21 such as a liquid crystal display panel, a driver circuit (not shown) for displaying desired image information on the display panel 21, and switching between display and non-display of the display panel 21. On / off switching button 22 and the like, and when the subject is photographed by the imaging function unit 10, the subject is displayed, and the menu and setting screen are displayed when various settings and conditions in the digital camera 100A are input and changed. It has a function of displaying or displaying image data stored in the image memory 30. In addition, by operating the on / off switching button 22 or each operation button provided in the operation function unit 80, the display of the image information on the display panel 21 is turned on or off, and the content of the image information is selected and determined. , Change, check, etc.

The image memory 30 stores and stores subject image data acquired by photographing the subject by the imaging function unit 10 and subject image data subjected to interpolation processing described later.
In addition, the interpolation data memory 40 does not project the image light of the subject via the optical lens 12 in the imaging function unit 10, and the optical filter 13 and the optical filter 13 from the light source 71 provided inside the housing of the digital camera 100 </ b> A. Interpolation image data acquired by directly irradiating the imaging device 14 with detection light is stored and saved.
Furthermore, the system memory 50 stores control programs and control data executed by the control unit 70 that controls various operations of the digital camera 100A.

  Each of the memories 30 to 50 described above may have an individual memory LSI configuration, or may apply an individual storage area set in a single memory LSI. . Since most digital cameras have a removable memory card in recent years, for example, a memory card is applied as the image memory 30 and the interpolation data memory 40 and the system memory 50 are built in the digital camera 100A. Internal memory can be applied.

  The interpolation function unit 70 includes a light source 71 provided inside the housing CASE at a position at which the imaging device 14 can be irradiated with detection light via at least the optical filter 13. Imaging pixels (specific pixels) in which the amount of received light is reduced by dust adhering to the optical filter 13 by irradiating the optical filter 13 with detection light at an arbitrary timing prior to the reading and reading the projection light by the imaging device 14; Alternatively, a function of acquiring information (interpolation image data) regarding the position of a defective pixel (specific pixel) of the imaging device 14 and storing it in the interpolation data memory 40, and subject image data and interpolation data memory stored in the image memory 30 Based on the correction image data stored in 40, the pixel data of the specific pixel included in the subject image data is interpolated. Management (details, which will be described later) has a function to perform.

  The operation function unit 80 includes a power on / off button 85 that controls turning on / off the operation power to the digital camera 100A, a zoom lever 83 for zooming in / out the subject, and focusing on the subject. A shutter button 84 for acquiring clear image data of a subject, a menu display button 82 for displaying a menu screen on the display panel 21, and an arbitrary menu is selected from the menu items displayed on the display panel 21 and determined. In addition, a selection / determination button 81 or the like for inputting arbitrary information is provided, and it has a function of photographing a subject by the imaging function unit 10 and inputting and changing various settings and conditions in the digital camera 100A. .

  The control unit (CPU) 60 has at least a function of controlling the operation state of each functional unit by a control program stored in the system memory 50. The interpolation function unit 70 may be provided integrally with the control unit 60, and the control unit 60 may be configured to have the operation function of the interpolation function unit 70. 70 and the control part 60 may be provided separately.

Next, a control operation (image data processing method) in the digital camera having the above-described configuration will be specifically described with reference to the drawings.
FIG. 3 is a flowchart illustrating an example of a control operation of the digital camera according to the present embodiment.
As shown in FIG. 3, the control operation of the digital camera according to the present embodiment is performed, for example, when the user of the digital camera 100A operates the power on / off button 85 to activate the digital camera 100A (S101). In the interpolation function unit 70, an operation for acquiring the image data for interpolation is executed.

  That is, the light source 71 provided inside the housing CASE in a state where the image light of the subject is not projected onto the imaging device 14 via the optical lens 12 of the digital camera 100A (the state where the incidence of external light is blocked). Is turned on and the optical filter 13 is irradiated with detection light (S102). As a result, the detection light that has passed through the optical filter 13 is irradiated onto the imaging device 14. At this time, dust attached to the surface of the optical filter is projected onto the light receiving surface of the imaging device 14.

  Then, by driving and controlling the imaging device 14 in synchronization with the lighting operation of the light source 71 and detecting the detection light projected on the light receiving surface (S103), the position corresponding to the dust attached to the optical filter 13 is detected. The amount of received light (charge accumulation amount) of the imaging pixel is detected to be smaller than that of other imaging pixels. The received light amount in each imaging pixel is converted into an electrical signal and stored in the interpolation data memory 40 as image data for interpolation (S104, S105).

Note that the interpolation image data acquisition operation in the interpolation function unit 70 is not limited to the time when the digital camera 100A is activated by operating the power on / off button 85 described above. Thus, it may be executed by operating the selection / decision button 81 for menu selection / determination, the menu display button 82, or the like.
Further, the state where the external light is blocked at this time is, for example, on the optical axis of the optical lens 12 and a shutter (not shown) is provided between the optical lens and the optical filter, and the shutter is closed. Or by providing a lens cover (not shown) on the lens barrel 11 or the optical lens 12.

  Next, the user operates the shutter button 84 (S106), and detects the image light of the subject projected on the light receiving surface of the imaging device 14 via the optical lens 12 and the optical filter 13, thereby obtaining the subject image. Read (shoot the subject) (S107). As a result, the subject image is converted into an electrical signal to generate subject image data (S108), and is temporarily stored (temporarily stored) in the image memory 30 (S109).

  Next, in response to a command from the control unit 60, the interpolation function unit 70 performs interpolation processing of the subject image data stored in the image memory 30 based on the interpolation image data stored in the interpolation data memory 40 in processing step S105. Then, the subject image data subjected to the interpolation processing (processed image data) is stored (stored) in a predetermined storage area of the image memory 30 (S111).

Here, the subject image data interpolation processing (image data processing method) will be described in detail with reference to the drawings.
FIG. 4 is a conceptual diagram for explaining the image data processing method of the digital camera according to the present embodiment. FIG. 5 is a conceptual diagram for explaining subject image data interpolation processing according to the present embodiment. is there.

  As shown in FIG. 4 (a), the subject image data IMGx acquired in the processing steps S106 to S109 captures the subject SUB with dust DST attached to the optical filter 13. Similarly to the case shown, the dust DST is imprinted together with the subject SUB, so that the subject image data IMGx includes pixel data (dark spots) in which the received light amount (charge accumulation amount) is reduced. Further, even when a defective pixel exists in the imaging device 14, the image light is not properly detected, so that it is read as a dark spot.

  On the other hand, the image data for interpolation acquired in the processing steps S102 to S105 is read by the imaging device 14 in a state where the incident of external light (image light of the subject) is blocked and only the detection light is emitted from the light source 71. As a result, only the imaging pixel at the position corresponding to the dust DST attached to the optical filter 13 and the defective pixel of the imaging device 14 are read as dark spots.

  As a result, as shown in FIG. 4B, the positions of the imaging pixels and defective pixels affected by the dust DST included in the subject image data IMGx are specified by the interpolation image data IMGy. Therefore, subject image data IMGz approximating the original subject image, in which the influence of dust DST and defective pixels is suppressed by performing processing to repair (interpolate) pixel data of the identified imaging pixel (specific pixel). Can be acquired.

  As the subject image data interpolation processing according to the present embodiment, for example, as shown in FIG. 5A, first, for the imaging pixel P (x, y) specified by the interpolation image data IMGy, The upper and lower imaging pixels P (x, y + 1) and P (x, y-1) and the left and right imaging pixels P (x-1, y) and P (x + 1, y) Pixel data of the subject image data IMGx corresponding to the four imaging pixels is extracted. Here, as the pixel data, chromaticity data, brightness data, or the like generated based on the amount of received light of the image light of the subject detected by each imaging pixel can be applied. Hereinafter, a case where chromaticity data (chromaticity data on a chromaticity diagram) is applied as pixel data will be described.

  Then, for the extracted pixel data (chromaticity data), as shown in FIG. 5C, the coordinate position on the chromaticity diagram is specified, and the chromaticity data of the center of gravity position based on these coordinate positions (that is, the chromaticity data) , The average value of each chromaticity data) is set as the pixel data of the imaging pixel P (x, y). Interpolation processing of such specific pixels (imaging pixels affected by dust DST and defective pixels) is included in the subject image data IMGx (that is, specified by the interpolation image data IMGy). By executing the above, it is possible to obtain subject image data IMGz that approximates the original subject image while suppressing the influence of the dust DST and defective pixels.

Note that subject image data interpolation processing using pixel data of imaging pixels that are vertically and horizontally adjacent to the specific pixel described above is only an imaging pixel affected by dust DST and a single pixel in which defective pixels are independent. It is effective when
On the other hand, when the specific pixel extends over a plurality of pixels (successively), for example, a predetermined number of image pickup pixel groups including only one image pickup pixel specified by the interpolation image data IMGy. A method of extracting corresponding pixel data (chromaticity data) of the subject image data IMGx and setting the average value thereof as the pixel data of the imaging pixel P (x, y) can be applied.

Specifically, as shown in FIG. 5B, first, four image pickup pixels P (x, y) including 2 pixels in the vertical direction and 2 pixels in the horizontal direction including the specific image pickup pixel P (x, y). ), P (x, y + 1), P (x + 1, y), and P (x + 1, y + 1) pixel data are extracted.
For the extracted pixel data (chromaticity data), the coordinate positions on the chromaticity diagram shown in FIG. 5C are specified and based on these coordinate positions, as in the interpolation processing method described above. Chromaticity data at the center of gravity (average value of each chromaticity data) is set as pixel data of the imaging pixel P (x, y). Such interpolation processing is executed from the outer edge of the continuous imaging pixel group affected by the dust DST, and the same processing is sequentially performed in the internal direction of the imaging pixel group using the pixel data set by the interpolation processing. By executing the interpolation process, it is possible to obtain subject image data IMGz that approximates the original subject image while suppressing the influence of relatively large dust DST and defective pixels.

  Therefore, according to the imaging apparatus and the image data processing method thereof according to the present embodiment, an arbitrary prior to shooting of a subject can be achieved with a simple configuration in which a light source that emits detection light is provided inside the housing of the imaging apparatus (digital camera). By irradiating the detection light at the timing and performing a reading operation by the imaging device, it is possible to identify the imaging pixel affected by the dust attached to the optical filter, and for the subject image data acquired thereafter, The simple data processing operation that interpolates the pixel data of the identified imaging pixel can suppress the degradation of the pixel data due to dust, and can obtain subject image data that approximates the original subject image, The power consumption in the apparatus can be reduced.

FIG. 6 is a schematic diagram illustrating a configuration of an optical filter applicable to the imaging apparatus according to the present embodiment and a relationship between the optical filter and a light source.
In the embodiment described above, the configuration of the optical filter 13 is not particularly mentioned. For example, as shown in FIG. 6A, the phase difference plate 13b is sandwiched between the crystal plates 13a and 13c. Applying a configuration including a (laminated) low-pass filter and an infrared absorbing glass (infrared absorbing filter) 13d that is in close contact with and laminated (laminated) on the imaging device 14 side (not shown) of the crystal plate 13c. Can do.

  In the above-described embodiment, the configuration in which the light source is provided so as to be separated from the optical filter 13 in FIG. 2C is shown, but the present invention is not limited to this, for example, As shown in FIG. 6B, the light source may be provided so as to be in close contact with the side end face of the optical filter 13 shown in FIG. According to this, it is possible to reduce the restriction on the design of the arrangement position when the light source is provided.

  Furthermore, in the above-described embodiment, subject image data that approximates the original subject image even when the number of imaging pixels affected by dust or defective pixels is relatively large and the above-described interpolation processing is executed. May be displayed on the display panel 21 to notify the user without executing the interpolation process.

  Specifically, in the flowchart shown in FIG. 3, for example, the number of dark spots or the number of continuous pixels included in the image data for interpolation is detected at a timing prior to processing step S105, and the number of detections is set in advance. When the predetermined number (for example, 10 pixels) is exceeded, the display panel 21 displays that the optical filter 13 and the imaging device 14 are contaminated, and the user can disassemble the imaging device. In cases (for example, interchangeable-lens digital cameras), a message to prompt the dust removal work is displayed, and in the case where the imaging device cannot be disassembled (sealed digital cameras, etc.) You may make it display the prompt to receive maintenance by a contractor.

1 is a block diagram illustrating a system configuration of an imaging apparatus according to the present invention. It is a schematic block diagram which shows one specific example of the digital camera applied to the imaging device which concerns on this invention. It is a flowchart which shows an example of the control operation of the digital camera which concerns on this embodiment. It is a conceptual diagram for demonstrating the processing method of the image data of the digital camera which concerns on this embodiment. It is a conceptual diagram for demonstrating the object image data interpolation process which concerns on this embodiment. It is the schematic which shows the structure of the optical filter applicable to the imaging device which concerns on this embodiment, and the relationship between this optical filter and a light source. It is a schematic sectional drawing which shows an example of the optical mechanism of the imaging device (digital still camera; hereafter, described as "digital camera") in a prior art. It is a conceptual diagram explaining the imaging | photography principle of an imaging device. It is a conceptual diagram for demonstrating the problem of the imaging device in a prior art.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Imaging function part 13 Optical filter 14 Imaging device 20 Display function part 30 Image memory 40 Interpolation data memory 50 System memory 60 Control part (CPU)
70 Interpolation Function Unit 71 Light Source 80 Operation Function Unit 100 Electronic Device 100A Digital Camera

Claims (8)

In an imaging device that captures a subject and acquires it as image data,
Imaging means for detecting image light projected on the light receiving surface and converting it into an electrical signal;
An optical filter that is provided on the subject side of the imaging means and changes a specific wavelength component included in the image light of the subject;
Subject image data acquisition means for projecting the subject onto a light receiving surface of the imaging means via the optical filter and acquiring first image data based on image light of the subject;
Interpolation image data acquisition means for acquiring second image data by irradiating only the detection light to the imaging means through the optical filter;
Pixel data interpolating means for interpolating specific pixel data included in the first image data;
Image data storage means for storing the interpolated first image data;
An imaging apparatus comprising: The pixel data interpolation means specifies a specific pixel based on the second image data, and performs an interpolation process based on pixel data of a plurality of pixels located around the specific pixel in the first image data. The imaging device according to claim 1, wherein the imaging device is performed. The pixel data is chromaticity data,
3. The imaging apparatus according to claim 2, wherein the pixel data interpolation unit uses an average value of chromaticity data in a plurality of pixels located around the specific pixel as pixel data of the specific pixel. The imaging apparatus according to claim 1, wherein the interpolation image data acquisition unit includes a light source that is provided in a housing of the imaging apparatus and that emits the detection light. The imaging device according to claim 4, wherein the light source is provided on a side end surface of the optical filter, and is configured to make the detection light incident from the side end surface. The imaging apparatus according to claim 1, wherein the optical filter has a configuration in which at least a low-pass filter and an infrared absorption filter are stacked. In an image data processing method of an imaging apparatus that detects image light of a subject projected on a light receiving surface of an imaging unit via an optical filter and acquires the image light as image data.
A process of irradiating only the detection light to the optical filter and the imaging means to obtain image data for interpolation;
A process of projecting the subject onto a light receiving surface of the imaging means via the optical filter to obtain subject image data;
A process of identifying a specific pixel included in the subject image data based on the interpolation image data, and interpolating the pixel data of the specific pixel;
An image data processing method for an imaging apparatus, comprising: The pixel data is chromaticity data,
8. The imaging apparatus according to claim 7, wherein the process of interpolating the pixel data uses an average value of chromaticity data in a plurality of pixels located around the specific pixel as pixel data of the specific pixel. Image data processing method.

Images