JP4374726B2 - Imaging device and storage medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a photographing apparatus that synthesizes and outputs a plurality of imaging data when photographing the same subject, and a storage medium.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, digital cameras that combine and output a plurality of captured images having different color components using a pixel shifting technique have been used. The pixel shifting technique is to vibrate imaging means such as a single CCD or an optical lens with a piezo element, and at one point of the subject, red light (R), green light (G), and blue light (B). This is a technique for outputting a variety of images by superimposing a plurality of pixels incorporating any single color light. As a result, the digital camera acquires the captured image with full color and high resolution, and improves the reproducibility of the subject.
[0003]
[Problems to be solved by the invention]
However, conventional digital cameras are subject to blurring of the subject because of the long shooting time associated with image synthesis, and image quality such as blurring and blurring of the displayed image is often reduced. In particular, in a high-resolution digital camera having more than 1 million pixels, since the light receiving portion per pixel is very small, there is a problem that slight blurring at the imaging position due to vibration deteriorates the image quality. In order to solve such a problem, it is necessary to superimpose each color light for each pixel when capturing any single color light of RGB, but these cannot be completely matched.
[0004]
An object of the present invention is to provide an imaging device and a storage medium that synthesize a plurality of imaging data having different color components at an optimal position.
[0005]
[Means for Solving the Problems]
In order to solve the above problems, the present invention has the following features. In the following description of the means, the configuration corresponding to the embodiment is illustrated in parentheses. Reference numerals and the like correspond to reference numerals of drawings described later.
[0006]
The invention described in claim 1
In a photographing apparatus (for example, the digital camera 1 in FIG. 1) that combines a plurality of photographed images with different color components that are photographed by shifting pixels of the same subject,
A total for calculating, for each color component of the photographic image, a total value of edge amounts indicating the amount of displacement between adjacent pixels of the same color from among a plurality of vertical and horizontal pixel columns constituting the first photographic image. Calculation means (for example, CPU 2 in FIG. 1; steps S701 to S705 in FIG. 4);
Total calculation means (for example, CPU 2 in FIG. 1; steps S706 to S708 in FIG. 4) for calculating the total sum of the edge amounts of the respective color components calculated by the total calculation means for each pixel column;
Maximum column selection means (for example, for selecting separately the pixel columns in which the total amount of edges calculated by the total calculation means is the maximum for the vertical and horizontal pixel columns of the first photographed image) CPU 2 in FIG. 1; step S709 in FIG.
Evaluation position for detecting the pixel at the intersection of the vertical and horizontal pixel columns of the first captured image selected by the maximum column selection means as an evaluation position pixel that is the center of the synthesis of the plurality of captured images Pixel detection means (for example, CPU 2 in FIG. 1; step S718 in FIG. 5);
The plurality of captured images , Evaluation position pixel of the first photographed image detected by the evaluation position pixel detection means In addition, the edge amount of the same color pixel in the pixel at the same position as the evaluation position pixel of the first photographed image and the peripheral pixels of each photographed image other than the first photographed image is evaluated in the first photographed image. The position pixel and the pixel of the closest size Image synthesizing means (e.g., CPU 2 in FIG. 1; step S11 in FIG. 3),
It is characterized by providing.
[0008]
DETAILED DESCRIPTION OF THE INVENTION
The digital camera 1 according to the embodiment of the present invention will be described below with reference to FIGS.
[0009]
First, the configuration will be described.
FIG. 1 is a block diagram showing a functional configuration of the digital camera 1. As shown in FIG. 1, the digital camera 1 includes a CPU 2, an input unit 3, a storage unit 4 having a storage medium 4a, a display unit 5, a RAM 6, a communication unit 7, an imaging unit 8, a drive control unit 9, a VRAM 10, and image processing. Each unit is configured by the unit 11 and is connected by a bus 12 except for the storage medium 4a.
[0010]
A CPU (Central Processing Unit) 2 stores a program designated from various programs corresponding to the digital camera 1 stored in the storage unit 4, various instructions input from the input unit 3, or data in a work in the RAM 6. The data is expanded in the memory 6a, and various processes are executed in accordance with the program according to the input instruction and input data. The processing results are stored in a predetermined area in the RAM 6 and displayed on the display unit 5.
[0011]
Further, the CPU 2 controls the operation of each block uniformly based on the operation signal input from the input unit 3 and optimizes the composite position of the captured image, so that an imaging process described later (see FIG. 3). Various execution programs such as a composite position determination process (see FIGS. 4 to 6) are executed and controlled.
[0012]
Further, the CPU 2 captures captured images of each color component of RGB in an imaging process to be described later, selects an evaluation position pixel that is a combination reference position of each captured image, and selects each captured image data ( Hereinafter, the image data is referred to as “imaging data”) to generate composite image data C1, and the composite image data C1 is trimmed within the effective pixel range and output.
[0013]
Further, the CPU 2 selects a pixel row in the horizontal direction from the first imaging data P1 in a composition position determination process, which will be described later, calculates an edge amount, which will be described later, of adjacent pixels of the same color in the pixel row, and all the same colors The pixel edge amount is summed to calculate the total edge amount of each horizontal pixel row, the horizontal pixel row having the maximum total edge amount is selected and stored, and the above processing is performed on the vertical pixel row. The intersection of the horizontal pixel column and the vertical pixel column with the maximum total edge amount is calculated as the first evaluation position pixel D1, and the evaluation position pixel D1 is set as the n-th imaging data Pn. The evaluation position pixel Dn is changed to the pixel closest to the edge amount of the evaluation position pixel D1 among the eight surrounding pixels, and the evaluation position pixels D1 to D4 of the imaging data P1 to P4 are selected. To do.
[0014]
The input unit 3 includes a power button, a mode switching key, a shutter button, a cursor key, and the like, and outputs various operation signals to the CPU 2 in accordance with the pressing operation or sliding operation of each key.
[0015]
The storage unit 4 is composed of a nonvolatile semiconductor memory such as an EEPROM (Electrical Erasable Programmable ROM) so that the stored contents can be retained even when the power is turned off. The storage unit 4 stores in advance various control programs and processing programs for controlling each unit of the digital camera 1 and various data necessary for the execution of the programs, as well as imaging data and composite image data generated by various processes. Etc. are stored in a predetermined area.
[0016]
The processing program includes, for example, an imaging process (see FIG. 3), which will be described later, and a composite position determination process (see FIGS. 4 to 6). Each of these processing programs is stored in the form of a program code that can be read by the CPU 2.
[0017]
The storage medium 4a is composed of a magnetic or optical recording medium or the like, and is fixedly provided in the storage unit 4 or detachably mounted. The storage medium 4a can store the above-described various programs, imaging data, composite image data, and the like. Some or all of these programs, data, and the like can be transmitted from an external device such as a server or client to a network line or the like. It may be configured to receive and store from the communication unit 7 via a transmission medium, and the storage medium 4a may be a storage medium of a server built on a network. Further, the program may be transmitted to a server or a client via a transmission medium such as a network line and installed in these devices.
[0018]
The display unit 5 is configured by an LCD (Liquid Crystal Display) or the like, and displays a color image on the display screen based on the video signal of the composite image data input from the image processing unit 11. Further, the display unit 5 displays, as a finder, an image of the subject A captured through the imaging lens at the time of shooting, and reproduces and displays the composite image data stored in the storage unit 4 after shooting.
[0019]
A RAM (Random Access Memory) 6 has a work memory 6a that expands a program that controls the control process when the CPU 2 executes various control processes, and temporarily stores various data and parameters to be processed. Form. Further, in imaging processing (see FIG. 3) and composite position determination processing (see FIGS. 4 to 6), which will be described later, for example, a counter memory 6b for counting the number of acquisitions of imaging data P1 to Pn and evaluation position pixels D1 to Dn. Form.
[0020]
The communication unit 7 is an infrared interface for performing IrDA (Infrared Data Association) infrared communication between the digital camera 1 and an external device, and performs transmission / reception control of image data, control data, and the like exchanged by infrared communication. Do. That is, the communication unit 7 includes a transmission data memory that temporarily stores transmission data to be transmitted to an external device having an infrared communication function, a modulation unit that modulates the data stored in the transmission data memory into an infrared signal, LED for transmitting the infrared signal transmitted by infrared pulse to the external device through the infrared communication window, and a photo for receiving the infrared signal transmitted from the external device by infrared pulse through the infrared communication window. It comprises a diode, a demodulator that demodulates the received infrared signal as reception data, and a reception data memory that temporarily stores the demodulated reception data.
[0021]
The imaging unit 8 includes a CCD 8a, an image signal processing unit 8b, and an A / D conversion unit 8c.
A CCD (Charge Coupled Device) 8a converts a pixel surface in which a large number of elements (pixels) in which a transfer electrode is superimposed on a light receiving unit such as a photodiode, and a charge accumulated in each pixel into a voltage. And an output unit for outputting. Light incident through an imaging lens (not shown) is received by the pixel surface, and charges proportional to the amount of received light are accumulated in each pixel. The accumulated charge of each pixel is sequentially read out for each pixel as an imaging signal (analog signal) by the output unit in accordance with the drive signal supplied from the drive control unit 9, and is supplied to the A / V via the image signal processing unit 8b. The data is output to the D converter 8c.
[0022]
A large number of pixels are arranged in the light receiving portion of the CCD 8a, and each pixel captures only one single color light of the three primary colors (RGB) of light at the time of imaging, so the CCD 8a is changed in position and is imaged a plurality of times. By doing so, a full color image in the same pixel is taken. However, the green light sensitive pixels with high human visual sensitivity require two times of image data per pixel. For this reason, in order to generate one composite image data, a total of four types of image data P1 to P4 for R (red), G (green), B (blue), and G photosensitive are required.
[0023]
Based on the control signal input from the CPU 2, the image signal processing unit 8b amplifies an electric signal (analog signal) accumulated in each transfer electrode of the light receiving unit of the CCD 8a, and sequentially sequentially picks up one electrode at a time as an imaging signal. The data is output to the A / D converter 8c.
[0024]
The A / D (Analog to Digital) conversion unit 8c converts the imaging signal input from the CCD 8a via the image signal processing unit 8b from an analog signal to a digital signal, and supplies it to the VRAM 10 as imaging data.
[0025]
The drive control unit 9 performs drive control for shifting the imaging position of the CCD 8a by one pixel in the horizontal or vertical direction. As shown in FIGS. 2A to 2D, the drive control is executed a total of four times, with the standard position shifted by one pixel in the horizontal direction, shifted by one pixel in the vertical and horizontal directions, and shifted by one pixel in the vertical direction. That is, each pixel of the CCD 8a can obtain only one single color information of RGB, but it is possible to align all the color information of RGB in the same pixel by photographing four times while changing the imaging position. In the same figure, as shown by the positions of circles in each of the imaging data P1 to P4, when attention is paid to a specific pixel, the CPU 2 acquires each color information in the order of RGBG by capturing the imaging data four times.
[0026]
A video random access memory (VRAM) 10 is a video memory that temporarily stores image data input from the A / D converter 8c, and stores four image data P1 to P4 or composite image data C1 thereof. It has a possible memory capacity.
[0027]
The image processing unit 11 generates a video signal (digital signal) by adding a synchronization signal to the image data output from the VRAM 10 by the CPU 2, and outputs the video signal to the display unit 5. If an external device is connected to the video output terminal via a video cable, the video signal is also output to the external device.
[0028]
In addition, the image processing unit 11 performs display control processing of composite image data C1 generated by combining a plurality of imaging data in imaging processing (see FIG. 3) and composite position determination processing (see FIGS. 4 to 6) described later. To do. That is, the image processing unit 11 synthesizes and trims the four pieces of imaging data P1 to P4 stored in the VRAM 11 at the optimized evaluation position based on the control signal of the CPU 2 to obtain the final synthesized image data C1. Are stored in the storage unit 4 or the storage medium 4a, and a video signal (digital signal) is generated by adding a synchronization signal to the composite image data C1, and a video signal for one screen is read out from the generated video signal. 5 is displayed. In addition, when a plurality of imaging data to be combined includes the same color component (for example, a green component), the color components are averaged, and when not included, the components are simply added to obtain a clear full color image. Generate.
[0029]
Next, the operation will be described.
First, an imaging process executed when the user of the digital camera 1 presses the shutter button and a specific display example based on the imaging process will be described in detail with reference to FIGS.
[0030]
FIG. 3 is a flowchart showing the imaging process.
When the shutter button of the digital camera 1 is pressed, a program for executing an imaging process described below is read from the storage unit 4 and expanded in the RAM 6, and various operations according to the flowchart of FIG. 3 are executed.
[0031]
In FIG. 3, first, the CPU 2 sets “n = 1” as an initial value in the counter memory 6b in the RAM 6 (step S1). Next, the CPU 2 captures the subject A by the CCD 8a (step S2), takes the captured image into a predetermined area of the VRAM 10, and temporarily stores it as the first imaging data P1 (step S3). Next, the drive control unit 9 shifts the position of the CCD 8a from the standard position toward the subject A by one pixel in the right direction in accordance with a command from the CPU 2 (step S4).
[0032]
Next, the CPU 2 determines whether or not the set value of the counter memory 6b is “n = 4” (step S5). If the set value is not “n = 4” (step S5; No), the CPU 2 sets “n = n + 1” (step S6), returns to step S2, and executes the subsequent processing.
[0033]
As shown in FIG. 3, the processes of steps S2 to S5 are repeated a total of four times. The first time, the subject A is photographed at the standard position of the CCD 8a and stored in the VRAM 10 as the imaging data P1. Similarly, in the second time, the CCD 8a is photographed while being shifted by one pixel in the right direction from the standard position, and stored as imaging data P2. In the third time, the CCD 8a is photographed while being shifted by one pixel from the standard position in the right and downward directions, and stored as the third image data P3. Further, in the fourth time, the CCD 8a is photographed by shifting one pixel downward from the standard position, and stored as fourth image data P4.
[0034]
Next, the CPU 2 performs execution control of a combination position determination process (to be described later) in order to determine the optimal combination position of the four imaging data (step S7). Hereinafter, the composite position determination process will be described in detail with reference to FIGS.
[0035]
In FIG. 4, first, the CPU 2 reads the imaging data P1 from the VRAM 10 (step S701). Next, as shown in FIG. 7B, the CPU 2 selects the first horizontal pixel column H1 (step S702), selects the same color pixel in the horizontal pixel column H1, and selects a specific same color. The edge amount of the pixel in the pixel (for example, white area) is calculated (step S703).
[0036]
Here, the edge amount is a value indicating the displacement amount (difference) of a specific pixel within a predetermined imaging region, and the larger the edge amount, the larger the pixel shift between the respective imaging data. For this reason, by combining a plurality of different imaging data using the pixel having the maximum edge amount as the evaluation position pixel (superimposition reference point), it is possible to perform more accurate image synthesis with less overlay error.
[0037]
Next, the CPU 2 adds up the edge amounts of the pixels in the same color pixel calculated in step S703 (step S704). Next, the CPU 2 determines whether or not the sum of the edge amounts in all the same color pixels in the horizontal pixel row H1 has been calculated (step S705), and if not calculated (step S705; No), the next Of the same color pixel (for example, black region). Then, the processes in steps S703 to S704 are repeatedly executed until the sum of the edge amounts in all the same color pixels in the horizontal pixel row H1 is calculated.
[0038]
Next, the CPU 2 calculates the total edge amount in the horizontal pixel row H1 by summing up the edge amounts of the same color pixels calculated in steps S703 to S704 (step S706). Next, the CPU 2 determines whether or not the total edge amount of all the horizontal pixel columns H1 to H5 of the imaging data P1 has been calculated (step S707), and if not calculated (step S707; No), The next horizontal pixel column is designated (step S708).
[0039]
Then, the processes in steps S703 to S706 are repeatedly executed until the total edge amount in all the horizontal pixel rows is calculated. Next, the CPU 2 selects the horizontal pixel row that maximizes the total edge amount (step S709). In this case, the horizontal pixel column H3 is selected as shown in FIG.
[0040]
Next, the CPU 2 executes processing similar to steps S702 to S709 on the vertical pixel columns. That is, the CPU 2 selects the first vertical pixel column V3 (step S710), selects the same color pixel for the pixel column V3, and calculates the edge amount of the pixel in the specific same color pixel (for example, white area). (Step S711).
[0041]
Next, the CPU 2 sums up the edge amounts of the pixels in the same color pixel calculated in step S711 (step S712). Next, the CPU 2 determines whether or not the sum of the edge amounts in all the same color pixels in the pixel row V3 has been calculated (step S713), and if not calculated (step S713; No), the next same color pixel (For example, a blue region) is specified. Then, the processes in steps S711 to S712 are repeatedly executed until the sum of the edge amounts in all the same color pixels in the vertical pixel row V3 is calculated.
[0042]
Next, the CPU 2 calculates the total edge amount in the vertical pixel row V3 by summing up the edge amounts of the same color pixels calculated in steps S711 to S712 (step S714). Next, the CPU 2 determines whether or not the total edge amount of all the vertical pixel columns of the imaging data P1 has been calculated (step S715), and if not calculated (step S715; No), the next vertical A pixel column in the direction is designated (step S716).
[0043]
Then, the processes in steps S711 to S714 are repeatedly executed until the total edge amount in all the vertical pixel rows is calculated. Next, the CPU 2 selects the vertical pixel row V3 having the maximum total edge amount (step S717 in FIG. 5). In this case, the vertical pixel column V3 is selected as shown in FIG.
[0044]
Next, the CPU 2 calculates a pixel that is an intersection of the horizontal pixel row H3 selected in step S709 and the vertical pixel row V3 selected in step S717, and sets it as the evaluation position pixel D1 of the imaging data P1. (Step S718).
[0045]
Here, a series of evaluation position pixel D1 determination processes shown in steps S701 to S718 will be described with reference to specific configuration examples of the imaging data in FIGS. First, FIG. 7A shows an example of the original image data P0. The original image data P0 has, for example, pixel columns H1 to H5 as horizontal pixel columns and pixel columns V1 to V5 as vertical pixel columns.
[0046]
FIGS. 7B to 7D are diagrams showing imaging data P1 to P3 of each color component level based on the original image data P0 corresponding to the three primary colors (RGB) of light. The CPU 2 calculates the edge amounts of the pixel columns H1 to H5 for each imaging data corresponding to each color component. Then, a pixel row in which the sum of the edge amounts of the respective color components is maximized is detected. In this case, as shown in FIGS. 5E to 5G, the total of the edge amounts of the pixel column H3 takes the maximum value.
[0047]
Similarly, when the edge amount of the pixel column in the vertical direction is calculated for each color component, the sum of the edge amounts of the pixel column V3 becomes the maximum value as shown in FIG. Accordingly, as shown in FIG. 5I, the intersection of the pixel column H3 and the pixel column V3 is stored in the work memory 6a as the evaluation position pixel D1 of the imaging data P1.
[0048]
Next, the CPU 2 sets “n = 2” in the memory counter 6b (step S719), and simultaneously reads out the imaging data P2, which is the second captured image data, from the VRAM 10 (step S720). Next, as shown in FIG. 8A, the CPU 2 temporarily sets the evaluation position pixel D1 as the nth evaluation position pixel Dn (step S721), and the evaluation position pixel Dn and its surrounding eight pixels (FIG. 8). 8b), the edge amount is calculated (step S722). Next, as shown in FIG. 8C, the CPU 2 compares the size of the evaluation position pixel D1 with the size of the evaluation position pixel Dn and the surrounding 8 pixels (step S723), and the size of the evaluation position pixel D1. And the pixel having the closest size is selected (step S724).
[0049]
Next, the CPU 2 determines whether or not an evaluation position pixel is selected in step S724 (step S725), and stores the determined nth evaluation position pixel in the work memory 6a as the evaluation position pixel Dn (step S726). Next, the CPU 2 determines whether or not the setting value of the counter memory 6b is “n = 4” (step S727). If n = 4, the process returns to step S8 in FIG. Execute the process.
[0050]
If the evaluation position pixel is not selected in step S725 (step S725; No), the CPU 2 determines whether or not there are a plurality of pixels whose edge amounts are closest to the evaluation position pixel D1 (step S725). S728). If there are not a plurality of pixels (step S728; No), the pixel whose edge amount is the closest to the evaluation position pixel D1 is set to the nth evaluation position pixel Dn (step S729), and the process returns to step S722 again. The subsequent processing is executed repeatedly.
[0051]
In step S728, when there are a plurality of pixels whose edge amounts are the closest to the evaluation position pixel D1 (step S728; Yes), the process proceeds to step S730 and subsequent steps. That is, the CPU 2 selects an arbitrary pixel from the plurality of pixels, and calculates an edge amount for the surrounding 8 pixels around the pixel (step S730).
[0052]
Next, the CPU 2 determines whether or not there is a pixel having the closest size other than the pixel selected in step S730 (step S731). Here, when there is no other pixel having the closest approximate edge amount (step S731; No), the CPU 2 selects a pixel having the closest approximate edge size to the evaluation position pixel D1 (step S732). ).
[0053]
Next, the CPU 2 determines whether or not there are a plurality of pixels having a size closest to the edge amount of the evaluation position pixel D1 (step S733). Here, when there are not a plurality of pixels with the closest edge amount (step S733; No), the evaluation position pixel D1 and the pixel with the closest edge amount are set to the nth evaluation position pixel Dn (step S734), and the step is performed again. Returning to S726, the subsequent processing is repeatedly executed.
[0054]
In addition, in step S731, when there is another pixel with the closest edge amount (step S731; Yes), or in step S733, there are a plurality of pixels with the edge amount closest to the evaluation position pixel D1. In the case (step S733; Yes), the process returns to step S730 again, and the CPU 2 selects one arbitrary pixel from the plurality of pixels, and calculates the edge amount for the surrounding eight pixels around the pixel.
[0055]
In step S727, if the set value of the counter memory 6b is not “n = 4” (step S727; No), the CPU 2 sets the counter memory 6b to “n = n + 1” (step S728) and again step S719. Return to, and repeat the subsequent processing. That is, the CPU 2 calculates the evaluation position pixels D1 to D4 corresponding to the imaging data P1 to P4 and stores them in the work memory 6a.
[0056]
When the composite position determination process described above is completed, the CPU 2 reads the imaging data P1 from the VRAM 10, and reads the corresponding evaluation position pixel D1 from the work memory 6a (step S8). Next, the CPU 2 sets “n = 2” in the counter memory 6b (step S9), reads the nth captured image data Pn from the VRAM 10, and reads the corresponding evaluation position pixel Dn from the work memory 6a (step S9). S10).
[0057]
Next, the CPU 2 synthesizes the imaging data P1 and the imaging data Pn with the respective evaluation position pixels D1 and Dn as the center (step S11). Next, the CPU 2 determines whether or not the set value of the counter memory 6b is “n = 4” (step S12). If n = 4 is not satisfied (step S12; No), the CPU 2 sets the setting value of the counter memory 6b to “n = n + 1” (step S13), returns to step S10 again, and stores the nth imaging data Pn in the VRAM 10 And the corresponding evaluation position pixel Dn is read from the work memory 6a.
[0058]
That is, the CPU 2 combines all the imaging data P1 to P4 shown in FIGS. 9A to 9D with the evaluation position pixels D1 to D4 as the center pixel. Then, as shown in FIG. 9E, the synthesized image data C1 is cut out and trimmed in the effective pixel range E of the final image (step S13), and the above-described imaging process is ended. Note that the effective pixel range E is the maximum range in which all of the imaging data P1 to P4 overlap.
[0059]
As described above, in the digital camera 1 according to the present invention, as shown in FIGS. 10 (a) to 10 (f), for one subject A, four images having different color components by changing the imaging position of the CCD 8a. Image data P1 to P4 are acquired, a pixel row in the horizontal direction and the vertical direction in which the sum of the edge amounts of the RGB color components is maximized is selected from the image data P1, and the intersection is stored as the evaluation position pixel D1.
[0060]
Next, the peripheral pixel closest to the total edge amount of the evaluation position pixel D1 in the imaging data P2 is stored as the evaluation position pixel D2. Similarly, evaluation position pixels D3 and D4 of the imaging data P3 and P4 are calculated and stored. Next, the four pieces of image data P1 to P4 are superimposed and synthesized with the respective evaluation position pixels D1 to D4 as the centers, and trimmed in the effective pixel range. Then, the trimmed image data is displayed by assigning each pixel of the light receiving unit of the CCD 8a to one pixel data (RGB) of the display unit 5 and also stored in the storage unit 4 as the composite image data C1.
[0061]
Therefore, it is possible to detect an optimum evaluation position when combining a plurality of imaging data having different color components, and the plurality of imaging data can be superimposed with high accuracy. For this reason, it is possible to acquire high-quality and clear imaging data that suppresses the influence of blurring such as blurring and blurring of the image while maintaining high resolution. In addition, for example, if the image data of the green component with high human visual sensitivity is averaged and the image data of the red component and the blue component are simply added and synthesized, a homogeneous image that is not biased to the color component of the specific image data Data can be output. Furthermore, if four pieces of image data are superimposed and trimmed within the effective pixel range, a variety of image data can be output efficiently.
[0062]
In addition, the description content in the said embodiment is a suitable example of the digital camera 1 which concerns on this invention, and is not limited to this.
For example, in the present embodiment, the present invention is applied to a digital camera that captures images by moving the imaging position of the CCD 8a a plurality of times, but may be applied to a scanner that scans and combines a plurality of times by changing the light source position. In this case, not only physical blur but also color misregistration caused by the optical path difference can be suppressed.
[0063]
In addition, the detailed configuration and detailed operation of the digital camera 1 can be changed as appropriate without departing from the spirit of the present invention.
[0064]
【The invention's effect】
According to invention of Claim 1, Combining multiple shot images with different color components taken by shifting pixels of the same subject In the photographing apparatus, a total calculation unit, a total calculation unit, a maximum column selection unit, an evaluation position pixel detection unit, Image synthesis means; So that the first Taken image The best evaluation position when synthesizing It is possible to synthesize a plurality of captured images with different color components around the evaluation position. it can. Therefore, each captured image Based on the evaluation position, it is possible to perform highly accurate synthesis with little overlay error.
[0065]
According to the invention of claim 2, in addition to the effect of the invention of claim 1, Color component Multiple of different Taken image It is possible to detect the optimal synthesis position of Different color components plural Taken image Can be superimposed with higher accuracy. For this reason, it is possible to acquire high-quality and clear imaging data in which the influence of blur such as blurring and blurring of the image is suppressed.
[0066]
According to the invention of claim 3, the claim of claim 2 In addition to the effects of the described invention, Different color components plural Taken image When synthesizing Taken image Homogeneous image data that is not biased to color components can be output.
[0067]
According to the invention of claim 4, the claim of claim 2 In addition to the effects of the described invention, a plurality of Image obtained by combining the shot images From the desired synthesis part image Can be selectively extracted as an efficient and versatile image Statue Can output.
[0068]
According to the invention of claim 5, the first Taken image The best evaluation position when synthesizing Then, combine multiple shot images with different color components around this evaluation position. Program to be executed on the computer. Therefore, each captured image Based on the evaluation position, a highly accurate composition is possible.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a functional configuration of a digital camera 1 according to the present invention.
FIG. 2 is a diagram showing a positional relationship of imaging data P1 to P4 in a light receiving unit of a CCD 8a.
FIG. 3 is a flowchart showing an imaging process executed by a CPU 2 in FIG. 1;
4 is a flowchart showing a composite position determination process executed by CPU 2 of FIG.
FIG. 5 is a flowchart showing a composite position determination process executed by the CPU 2 of FIG.
6 is a flowchart showing a composite position determination process executed by the CPU 2 of FIG.
7 is a diagram illustrating imaging data P1 to P3 of each color component of the original image data P0, an edge amount of each imaging data, and an evaluation position pixel D1 of the imaging data P1. FIG.
8 is a diagram illustrating a method for selecting another evaluation position pixel with reference to the evaluation position pixel D1 in FIG. 7;
FIG. 9 is a diagram illustrating a trimming position in an effective pixel range E of imaging data P1 to P4.
FIG. 10 is a diagram illustrating composite image data C0 obtained by a normal method of imaging data P1 to P4 and composite image data C1 obtained by optimization.
[Explanation of symbols]
1 Digital camera
2 CPU
3 Input section
4 storage
4a storage media
5 display section
6 RAM
6a Work memory
6b Counter memory
7 Communication Department
8a CCD
8b Image signal processor
8c A / D converter
9 Drive controller
10 VRAM
11 Image processing unit
12 Bus
A Subject
P0 original image data
P1, P2, P3, P4, Pn Imaging data
D1, D2, D3, D4, Dn Evaluation position pixel
H1, H2, H3, H4, H5 Horizontal pixel rows
V3 Vertical pixel row
C0, C1 composite image data

Claims (5)

In a shooting device that combines a plurality of shot images with different color components shot by shifting pixels of the same subject,
A total for calculating, for each color component of the photographic image, a total value of edge amounts indicating the amount of displacement between adjacent pixels of the same color from among a plurality of vertical and horizontal pixel columns constituting the first photographic image. A calculation means;
Total calculation means for calculating the total of the total amount of edge amounts of each color component calculated by the total calculation means for each pixel column;
A maximum column selecting unit that individually selects a pixel column having a maximum sum of edge amounts calculated by the total calculating unit with respect to the vertical and horizontal pixel columns of the first captured image;
Evaluation position for detecting the pixel at the intersection of the vertical and horizontal pixel columns of the first captured image selected by the maximum column selection means as an evaluation position pixel that is the center of the synthesis of the plurality of captured images Pixel detection means;
Evaluation of the first photographed image of the plurality of photographed images, the evaluation position pixel of the first photographed image detected by the evaluation position pixel detection means, and each photographed image other than the first photographed image. An image compositing means for compositing the pixel at the same position as the position pixel and the peripheral pixel around the evaluation position pixel of the first photographed image and the pixel of the closest size, with the edge amount of the same color pixel ;
An imaging apparatus comprising: Anticipation detection means for anticipating and detecting the evaluation position pixel of the first captured image as the evaluation position pixel of the second captured image captured by shifting the pixel with respect to the first captured image;
Edge amount calculation means for calculating the edge amount of the same color pixel for the pixel detected by the prediction detection means and its surrounding pixels,
Edge amount comparison means for comparing the edge amount of the same color pixel calculated by the edge amount calculation means with the edge amount of the evaluation position pixel of the first photographed image;
Based on the comparison result by the edge amount comparing means, to the edge amount evaluation position pixel in the second captured image is the size of the pixels of similar evaluation position pixel and recent first captured image, the first An execution unit that selects a pixel whose edge amount is the closest to the evaluation position pixel of the first photographed image as the evaluation position pixel in the two photographed images, and repeatedly executes the calculation of the edge amount and the comparison ; Further comprising
The image synthesizing unit converts the first photographed image and the second photographed image into an evaluation position pixel of the first photographed image and an evaluation position pixel of the second photographed image selected by the execution unit. The photographing apparatus according to claim 1, wherein the image is synthesized with respect to the center. The image composition means includes
3. The composite of the plurality of photographed images by adding a pixel obtained by averaging the pixels of the photographed image including the same color component and each pixel of the photographed image not including the same color component. Shooting device. Output means for trimming and outputting an image obtained by combining a plurality of photographed images by the image combining means within a predetermined effective pixel range;
The imaging apparatus according to claim 2, further comprising: A storage medium storing a computer-executable program for controlling a photographing device that synthesizes a plurality of photographed images with different color components photographed by shifting pixels of the same subject,
In order to calculate the total value of edge amounts indicating the amount of displacement between adjacent pixels of the same color from among a plurality of vertical and horizontal pixel columns constituting the first captured image for each color component of the captured image. Program code,
A program code for calculating the total sum of the calculated edge amounts of each color component for each pixel column;
A program code for individually selecting a pixel column having a maximum sum of the calculated edge amounts with respect to the vertical and horizontal pixel columns of the first captured image;
A program code for detecting the pixel at the intersection of the vertical and horizontal pixel columns of the selected first captured image as an evaluation position pixel that is the center of the synthesis of the plurality of captured images;
The plurality of captured images, and the evaluation position pixels of the first photographed image is detected the first captured image than each of the captured image, pixels at the same position as the evaluation position pixels of the first captured image And a program code for synthesizing the edge amount of the same color pixel around the evaluation position pixel of the first photographed image and the pixel of the most approximate size in the surrounding pixels, and
A storage medium characterized by storing a program including:

Images