CN101621623B - Imaging apparatus - Google Patents
Imaging apparatus Download PDFInfo
- Publication number
- CN101621623B CN101621623B CN2009101498761A CN200910149876A CN101621623B CN 101621623 B CN101621623 B CN 101621623B CN 2009101498761 A CN2009101498761 A CN 2009101498761A CN 200910149876 A CN200910149876 A CN 200910149876A CN 101621623 B CN101621623 B CN 101621623B
- Authority
- CN
- China
- Prior art keywords
- coordinate
- color
- pixel
- coordinate transform
- pixel value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/44—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
- H04N25/445—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array by skipping some contiguous pixels within the read portion of the array
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
- Image Processing (AREA)
Abstract
An imaging device (110) includes a color filter having a predetermined color array and converts an optical image obtained through an optical system (10) into image data of an electrical signal. A coordinate transforming unit (130) transforms a first coordinate value of the imaging device (110) into a second coordinate value in a state of the color array considering a color of the color filter corresponding to the first coordinate value. The imaging device (110) reads out a pixel value of a pixel at the second coordinate value as a pixel value of a pixel at the first coordinate value taking the first coordinate value as a coordinate transform destination and the second coordinate value as a coordinate transform source.
Description
The cross reference of related application
The application advocates the priority at the Japanese priority file 2008-176193 of Japan's submission on July 4th, 2008, and its whole content is hereby expressly incorporated by reference.
Technical field
The present invention relates to a kind of imaging device, be used for obtaining, relate in particular to a kind of be used for proofreading and correct the multiplying power chromatic aberation of the image that is obtained and the technology of distortion by having wide-angle and big multiplying power chromatic aberation and the image that optical system captured of distortion.
Background technology
Recently, miniature wide-angle imaging device has been applied in the middle of Monitor for reverse device (back monitor) such as vehicle etc. more and more.Yet, but be difficult to design and a kind ofly have the little multiplying power chromatic aberation and the micro-optics system of distortion, and combine with image processing and to need to improve performance.In this case, the follow-up phase after obtaining view data such as charge-coupled device (CCD) and CMOS (Complementary Metal Oxide Semiconductor) image devices such as (CMOS) is carried out coordinate transform traditionally, so that proofread and correct multiplying power chromatic aberation and distortion.
Figure 17 is the configuration schematic diagram of the existing imaging device of the above-mentioned type.In Figure 17, image device 1 is CCD or cmos sensor, is used for being converted to the signal of telecommunication (view data) by having wide-angle and big multiplying power chromatic aberation and the optical imagery (not shown) that optical system captured of distortion.Clock that counter (counter) 2 provides based on the outside and horizontal/vertical synchronization signals (not shown) generate coordinate figure as frame address (x, y).(x y) sequentially reads view data from image device 1, and it is sequentially write in the middle of the frame memory 3 based on the coordinate figure of counter 2.Frame memory 3 can be the line buffer with circuit of predetermined quantity.Simultaneously, coordinate figure (the x of coordinate transformation unit 4 enter counters 2, y) proofread and correct coordinate after the conversion of multiplying power chromatic aberation and distortion to calculate, and (x y) sequentially reads view data from frame memory 3 to use coordinate figure after the conversion according to the predetermined formula of coordinate transform.So, reading the multiplying power chromatic aberation from frame memory 3 proofreaies and correct afterwards and the view data after the distortion correction.
For example, in disclosed Japanese patent application No.2006-345054, described a kind of by in follow-up phase to carrying out coordinate transform individually by the various RGB color components in the R that obtains such as image devices such as CCD or cmos sensors (redness), G (green) and B (blueness) signal, proofread and correct the method for multiplying power chromatic aberation and distortion simultaneously, and a kind ofly various RGB color components are carried out coordinate transform simultaneously come only correcting distortion, and ignore the method for multiplying power chromatic aberation.
In the prior art, carry out coordinate transform, need jumbo frame memory or line buffer in order to proofread and correct multiplying power chromatic aberation and distortion individually.Particularly when proofreading and correct multiplying power chromatic aberation and distortion simultaneously by various RGB color components are carried out coordinate transform individually, needs are a kind of can be to the memory of the independent addressing of various RGB color component, and need to use expensive three port random asccess memory (RAM) with 3-chip configuration (for example, static RAM (SRAM) (SRAM)) or with time sharing mode driving RAM.And then, when the RGB color component jointly being carried out coordinate transform and only come correcting distortion,, still need memory individually although can use low-cost dynamic ram (DRAM) with 1-chip configuration etc.
Usually, in image device, be provided with such as chromatic filter with Bayer array (Bayer array).In the prior art, in interpolation because after the defect pixel that causes such as the chromatic filter array of Bayer array, therefore signal correction multiplying power chromatic aberation and distortion about image device obtains need jumbo frame memory or line buffer individually.
Summary of the invention
The objective of the invention is to solve at least in part the problems of the prior art.
According to an aspect of the present invention, provide a kind of imaging device, having comprised: image device, comprise chromatic filter with predetermined color array, described image device will convert the view data of the signal of telecommunication by the optical imagery that optical system obtains to; And coordinate transformation unit, according to color, convert first coordinate figure of described image device to second coordinate figure with the state of color array corresponding to the color array of first coordinate figure.By with first coordinate figure as the coordinate transform target and with second coordinate figure as the coordinate transform source, described image device reads the pixel value of pixel at the described second coordinate figure place as the pixel value of the pixel at the described first coordinate figure place.
When the described accompanying drawing of contact is considered together, by reading following detailed description, can obtain better understanding to above and other objects of the present invention, feature, advantage and technical and industrial importance about currently preferred embodiments of the present invention.
Description of drawings
Fig. 1 is the basic block diagram of image-forming apparatus according to the present invention;
Fig. 2 is the complete block diagram according to the imaging device of the embodiment of the invention;
Fig. 3 A to Fig. 3 C has described to have the chromatic filter of Bayer array;
Fig. 4 is the allocation plan of the example of mtf correction unit;
Fig. 5 is the example of FIR filter;
Fig. 6 A and Fig. 6 B are the schematic diagrames that is used for illustrating the correction principle of multiplying power chromatic aberation of the present invention;
Fig. 7 is the configured in one piece figure according to the coordinate transformation unit shown in Figure 2 of first example of the present invention;
Coordinate figure that Fig. 8 described the coordinate figure in source, obtain by (round off) coordinate figure that rounds up and the relation between their deviation;
Fig. 9 is used for the schematic diagram of the operation that the array determining unit shown in key diagram 6A and Fig. 6 B carries out;
Figure 10 A to Figure 10 E has described the content of the computing of the coordinates correction unit execution shown in Fig. 6 A and Fig. 6 B;
Figure 11 has described the operation by the execution of array determining unit;
Figure 12 is the configured in one piece figure according to the coordinate transformation unit shown in Figure 2 of second example of the present invention;
Figure 13 A to Figure 13 E has described the content by the computing of A execution in coordinates correction unit shown in Figure 12;
Figure 14 A to Figure 14 E has described the content by the computing of coordinates correction unit B execution shown in Figure 12;
Figure 15 A to Figure 15 E has described the content according to the computing of the coordinate transformation unit A execution of the 3rd example of the present invention;
Figure 16 A to Figure 16 E has described in the content according to the computing among the coordinate transformation unit B of the multiplying power chromatic aberation correcting unit of the 3rd example; And
Figure 17 is the allocation plan of traditional imaging device.
Embodiment
Will make more detailed explanation to exemplary embodiment of the present invention with reference to appended accompanying drawing below.
Fig. 1 is the basic block diagram of image-forming apparatus according to the present invention.In Fig. 1, image device 110 comprises can random-access CMOS color sensor etc., is used for that use is had the optical imagery that the optical system 10 of wide-angle and big multiplying power chromatic aberation and distortion captures and converts the signal of telecommunication (view data) to.Image device 110 comprises the chromatic filter that has such as predetermined color arrays such as Bayer arrays.Based on clock and the horizontal/vertical synchronization signals (not shown) that the outside provides, and the original coordinates value of counter 120 generation image devices 110 (x, y).Consideration is corresponding to coordinate figure (x, the color of chromatic filter y), under the state of predetermined color array, coordinate figure (the x of coordinate transformation unit 130 count pick up devices 120, y) come sequentially the coordinate figure in calculating coordinate change source (X, Y), to proofread and correct at least one in multiplying power chromatic aberation and the distortion according to the predetermined formula of coordinate transform, and (X Y) offers image device 110 with coordinate figure.(X, Y), image device 110 sequentially reads coordinate, and (X, the pixel value of the pixel of Y) locating is as coordinate (x, the pixel value of the pixel of y) locating as the coordinate figure of reading the address in utilization.
When with the center of screen during as initial point, for example, the formula of coordinate transform can be expressed as:
X＝x+[a(1)+a(2)*abs(x)+a(3)*abs(y)+a(4)*y
2]*x
Y＝y+[b(1)+b(2)*abs(y)+b(3)*abs(x)+b(4)*x
2]*y (1)
Wherein, abs () represents absolute value, a (1) to a (4) and b (1) to b (4) expression can be in table etc. the coordinate transform coefficient of storage in advance.
Utilize configuration shown in Figure 1, can from image device 110, directly read with one in predetermined color array status correction multiplying power chromatic aberation and the distortion or the view data after both, need to be used for the frame memory or the line buffer of coordinate transform no longer individually.
In Fig. 1, counter 120 and coordinate transformation unit 130 can be built in the middle of the image device 110.
Below, will explain an embodiment of imaging device of the present invention.In this embodiment, suppose that image device comprises the chromatic filter with Bayer array; Yet the present invention also may be used on comprising in the image device such as the another kind of chromatic filter of CMYG array or RGB+Ir (infrared) array.The color component of image not only can be the redness (R) in the additive primaries, green (G) and blue (B), and they can also be yellow (Y), reddish violet (M) and blue-green (C) in the subtractive process primary colors.
In the prior art, in interpolation after the defect pixel that causes such as the predetermined color array of Bayer array, the signal that is obtained by image device is carried out the correction of multiplying power chromatic aberation.Yet, for corresponding to optical system, need very large memory capacity, and this makes device become very expensive about multiplying power chromatic aberation (about coordinate transform) with big multiplying power chromatic aberation.And then, because the multiplying power chromatic aberation of every kind of color component is all different, the memory that needs to tackle every kind of color component addressing is independently proofreaied and correct the multiplying power chromatic aberation, and need (for example to use expensive three port random asccess memory (RAM) with 3-chip configuration, static RAM (SRAM) (SRAM)) or with time sharing mode driving RAM, this all makes device become expensive more.
Among the described below embodiment, can from image device, directly read the view data of having proofreaied and correct the multiplying power chromatic aberation with the Bayer array way, and image data interpolation after the multiplying power chromatic aberation proofreaied and correct, that have the Bayer array is because the defect pixel that the Bayer array causes.Afterwards, carry out mtf correction, distortion correction and gamma correction.
Fig. 2 is the functional block diagram according to the imaging device of the embodiment of the invention.Except the parts shown in Fig. 2, also comprise operating unit, image storage unit and the image-display units that does not illustrate among Fig. 2 according to the imaging device of embodiment.For example, imaging device can be used as in-vehicle camera, but not limiting the present invention only is applied to this.
As shown in Figure 2, control unit 100 provides required control signal (clock, horizontal/vertical synchronization signals etc.) so that control the operation of each unit according to pipeline system to each unit.
For example, image device 110 comprises cmos sensor, is used for that use is had the optical imagery that the optical system (not shown) of wide-angle and big multiplying power chromatic aberation and distortion captures and converts the signal of telecommunication (picture signal) to, and have random access capabilities.In image device 110, be provided with Bayer color filter arrays.
In the coordinate transform of simplifying, before coordinate transform and afterwards, the Bayer array all changes, and can not correctly carry out the Bayer interpolation by Bayer compensating unit 150 in follow-up phase.That is, before coordinate transform and afterwards, need to keep the Bayer array constant.Therefore, when the color of the color of the Bayer array in source and the Bayer array of coordinate transform target was identical, coordinate transformation unit 130 will keep the coordinate in coordinate transform source constant; And for example when the color of the Bayer array of the color of the Bayer array in source and target not simultaneously, coordinate transformation unit 130 coordinate in source will be changed into the most close this source, have a coordinate with the color same color of target.Correspondingly, even in having the RGB image of Bayer array, proofread and correct the multiplying power chromatic aberation, also can keep the Bayer array constant.Will explain coordinate transformation unit 130 subsequently.
As mentioned above, counter 120 and coordinate transformation unit 130 can be built in the middle of the image device 110 such as cmos sensor.
After modulus (A/D) transducer 140 will be proofreaied and correct as the multiplying power chromatic aberation of the analog signal of exporting from image device 110 and RGB picture signal that have the Bayer array converts digital signal (view data) to, and sends digital signal.For example, view data all comprises 8 among the RGB each.Can be in the middle of counter 120 and coordinate transformation unit 130 be built in image device 110 with A/D converter 140.
Rgb image data after Bayer compensating unit 150 reception multiplying power chromatic aberations are proofreaied and correct, that have the Bayer array, generation is carried out the view data (pixel data) at all the coordinate position places after linear interpolation to each color among the RGB, and pixel data is outputed to mtf correction unit 160.
Fig. 3 A to Fig. 3 C is the example with chromatic filter of Bayer array.Purpose for convenience illustrates R, G, B respectively in Fig. 3 A to Fig. 3 C; Yet RGB mixes (the Bayer array) arranged, wherein obtains G by equation (2) to equation (7) in fact,
0
G
0＝(G
2+G
4+G
6+G
8)/4 (2)
R
2＝(R
1+R
3)/2 (3)
R
4＝(R
3+R
5)/2 (4)
R
6＝(R
5+R
7)/2 (5)
R
8＝(R
1+R
7)/2 (6)
R
0＝(R
1+R
3+R
5+R
7)/4 (7)
B2, B4, B6, B8 and B0 are identical with the situation of R2, R4, R6, R8 and R0.
Fig. 4 is the block diagram of mtf correction unit 160.Converter unit 162 is transformed into the YCbCr view data based on equation (8) to equation (10) with rgb image data.
Y＝0.299R+0.587G+0.114B (8)
Cr＝0.500R-0.419G-0.081B (9)
Cb＝-0.169R-0.332G+0.500B (10)
FIR filter (5 * 5 filter) 164 only receives the brightness signal Y of YCbCr, and carries out predetermined mtf correction.By only Y-signal filtering (execution mtf correction) being obtained the repressed high quality graphic of amplification of color noise.Fig. 5 is the schematic diagram that is used for illustrating the example of FIR filter.Owing to Y-signal has been carried out filtering, therefore after the multiplying power chromatic aberation is proofreaied and correct, has needed to carry out mtf correction.Yet when carrying out mtf correction after the distortion correction, as following will the explanation, the transformed distances of coordinate transform can be very big and be very easy to occur arithmetic error in distortion correction.In the present embodiment, preferably carry out mtf correction, thereby avoided because mtf correction causes error to be exaggerated and influences picture quality unfriendly in the follow-up phase of multiplying power chromatic aberation correction and the previous stage place of distortion correction.
R＝Y+1.402Cr (11)
G＝Y-0.714Cr-0.344Cb (12)
B＝Y+1.772Cb (13)
Utilize configuration shown in Figure 2, image device self has played the effect of frame memory or line buffer (RAM), therefore needs RAM no longer individually for coordinate transform.Therefore, cost that can be lower and littler size are made imaging device.Usually, in interpolation need to carry out coordinate transform after the defective color of chromatic filter, so image device can not use as the RAM of coordinate transform.Configuration shown in Figure 2 can realize by the embodiment that carries out coordinate transform with the state of the chromatic filter array of image device.
Below, will explain coordinate transformation unit 130 as critical piece among the embodiment.
At first, carry out the principle that coordinate transform realizes that the multiplying power chromatic aberation is proofreaied and correct with reference to figure 6A and Fig. 6 B explanation with the state of Bayer array.Fig. 6 A has described the Bayer array before the coordinate transform, and Fig. 6 B has described the Bayer array after the coordinate transform.In Fig. 6 A and Fig. 6 B, the Bayer array has simple 6 * 6 pixels.Yet resolution video graphic array (VGA) has 640 * 640 pixels, for example repeats the Bayer array shown in Fig. 6 A and Fig. 6 B therein.
The multiplying power chromatic aberation shows the difference displacement (shift) about every kind among RGB color component; Yet,, therefore can calculate the position that the shades of colour component among the RGB will move to owing to can see multiplying power colour extent based on the Design for optical system data.In Fig. 6 A, suppose that the pixel (G) that is positioned at coordinate (0,0) position moves to coordinate (1,1) position, same, the pixel (B) that is positioned at coordinate (1,0) position moves to coordinate (3,1) position.Copy to the home position of coordinate (0,0) and (1,0) by the pixel value that will be positioned at the pixel of locating in coordinate (1,1) and (3,1), that is,, realized the correction of multiplying power chromatic aberation basically by carrying out coordinate transform.Coordinate (1,1) and (3,1) be called as the source coordinate (X, Y), and coordinate (0,0) and (1,0) be called as target coordinate (x, y).When the reference coordinate value, (x, y) and (X Y) can be as coordinate figure, thereby correctly uses coordinate and coordinate figure as required.
As mentioned above, when the rgb image data with Bayer array was carried out coordinate transform simply, before coordinate transform and afterwards the Bayer array all changed, and can not correctly carry out the Bayer interpolation in follow-up phase.Therefore, when the color of the color in source and target is identical, the pixel value of the pixel in source directly can be copied to target.When the color of the color in source and target not simultaneously, can be with the coordinates correction in source to identical with color of object and the coordinate of the coordinate in close source, and the pixel value that will proofread and correct the pixel at mark place, recoil copies to target.
In Fig. 6 A, the color in the source that the color of the target that coordinate (0,0) is located and coordinate (1,1) are located all is green (G).In this case, the pixel value of the pixel of directly coordinate (1,1) in source being located (G) is set at the pixel value of the pixel that the coordinate (0,0) of target locates.On the other hand, the source that coordinate (1,0) is located is blue (B), and the target that coordinate (3,1) is located is green (G).In this case, with the source proofread and correct for the coordinate (1 of target, 0) same color of locating and the most close coordinate (3, the coordinate of the blueness of coordinate 1) (the B) (coordinate (3 in Fig. 6 A, 2)), and the pixel value of the pixel (B) that the coordinate after will proofreading and correct (3,2) is located is set at the pixel value of the pixel that the coordinate (1,0) of target locates.Correspondingly, shown in Fig. 6 B, the Bayer array in the Bayer array before the coordinate transform shown in Fig. 6 A after the maintenance coordinate transform.Three examples of the customized configuration of coordinate transformation unit 130 have been provided below.
Fig. 7 is the configured in one piece figure according to the coordinate transformation unit 130 of first example.Shown in Fig. 6 A and Fig. 6 B, when the color at the color at source coordinate place and coordinates of targets place is identical, the pixel value of the pixel at source coordinate place is set at the pixel value of the pixel at coordinates of targets place; Yet, when the color at the color at source coordinate place and coordinates of targets place not simultaneously, with the most close source coordinate, be set at the pixel value of the pixel at coordinates of targets place with the pixel value of the pixel at the coordinate place of the color same color at coordinates of targets place.
In Fig. 7, generate coordinate figure (x with target by multiplying power chromatic aberation calibration coordinate transform operation device 1301, coordinate transform coefficient table 1302, color determining unit 1303, selected cell 1304 and 1305, the unit 1306 and 1307 that rounds up, array determining unit 1308, coordinates correction unit 1309, array selected cell 1310 and selected cell 1311, y) coordinate figure in Xiang Guan source (X, Y).Based on from the coordinate figure of selected cell 1311 output (X, Y), after sequentially reading the multiplying power chromatic aberation and proofread and correct from image device 110 and rgb image data that have the Bayer array.That is (X, the pixel value of the pixel of Y) locating is as coordinate (x, the pixel value of the pixel of y) locating, to read the coordinate of image device 110.As following will the explanation, when coordinate (X, Bayer array color of Y) locating and coordinate (x, the color of y) locating not simultaneously, with coordinate (X, Y) proofread and correct for the most close coordinate (X, Y), and coordinate (x, the coordinate that the color of y) locating is identical.Therefore, can keep from the Bayer array of the rgb image data of image device 110 outputs.Below, configuration shown in Figure 7 will be described in further detail.
Coordinate figure (the x of multiplying power chromatic aberation calibration coordinate transform operation device 1301 receiving targets, y), so that calculate coordinate figure X corresponding to the source of RGB according to predetermined formula such as formula coordinate transforms such as (1), Y, and the coordinate figure that calculates sent to selected cell 1304 and 1305.In coordinate transform coefficient table 1302, can preserve the coordinate transform coefficient in advance.
Based on the color ID that is obtained by color determining unit 1303, selected cell 1304 and the 1305 coordinate figure X from the source of the RGB that calculates corresponding to multiplying power chromatic aberation calibration coordinate transform operation device 1301 select a kind of coordinate figure X of color, Y among the Y.Coordinate figure X, Y is not limited to integer.The coordinate figure X that unit 1306 and 1307 rounds up and selected by selected cell 1304 and 1305 that rounds up, Y (becoming integer), and output is corresponding to the coordinate figure rX in the source of pixel, the integer of rY.Simultaneously, round up between unit 1306 and 1307 output X and the rX and deviation (difference) dX between Y and the rY, dY, wherein dX and dY can from-0.5 to 0.5 value.Fig. 8 has described the coordinate figure X in the source that obtains by computing, Y, by the coordinate figure X that rounds up, coordinate figure rX, rY that Y obtains and the deviation dX between them, the relation of dY.In Fig. 8 with square frame around a square represent a pixel.
On the other hand, coordinates correction unit 1309 receives rX, rY, dX and dY, and proofreaies and correct rX and rY according to the value of dX and dY.That is, coordinates correction unit 1309 calculates the coordinate figure in the source after the correction.For the array pattern (array pattern) of various types of same colors that can obtain from the Bayer array, coordinates correction unit 1309 calculates the coordinate figure in the source after the correction respectively.
Figure 10 A to Figure 10 E has described the content by the performed computing in coordinates correction unit 1309.Among Figure 10 A to Figure 10 E by square frame around a square presentation graphs 8 in pixel.In the Bayer array, the array pattern of same color is classified into five kinds shown in Figure 10 A to Figure 10 E, and promptly 1 to 5.3 * 3 foursquare intermediate square are sources that will be corrected of being paid close attention to.As shown in Figure 8, coordinate rX and rY are corresponding to the center of intermediate square.Coordinates correction unit 1309 is proofreaied and correct rX and rY for each pattern 1 to 5 among Figure 10 A to Figure 10 E according to dX and dY.Concrete, (a) to (e) that coordinates correction unit 1309 is write below 5 according to the pattern 1 shown in Figure 10 A to Figure 10 E carries out computing, and exports X1 and Y1, X2 and Y2, X3 and Y3, X4 and Y4 and X5 and Y5 respectively.That is any one shaded square in each pattern shown in coordinate representation Figure 10 A to Figure 10 E after the correction.
In Figure 10 A to Figure 10 E, be to use pattern 1 under the situation of same color in target and source.On the other hand, under being the situation of different colours, target and source use pattern 2 to pattern 5.Can use pattern 1 to the random color among the RGB.Be to use pattern 2, pattern 3 and pattern 5 under the situation of R or B in the color in source, and be to use pattern 4 under the situation of G in the color in source.
Array selected cell 1310 receives X1, Y1, X2, Y2, X3, Y3, X4, Y4, X5 and Y5, and is chosen in the coordinate figure X in the source after every kind of color among R, G, the B proofreaied and correct respectively, Y based on the array of values of being obtained by array determining unit 1308.Figure 11 has described array of values and X, the corresponding relation between the Y.For example, when array of values was 0, one group of X3 in the pattern 3 and Y3 were designated as the X of R, Y, and one group of X1 in the pattern 1 and Y1 are designated as the X of G, Y, and one group of X2 in the pattern 2 and Y2 are designated as the X of B, Y.When being 1,2 or 3, array of values uses in the same way.
The concrete example of with reference to figure 6A and Fig. 6 B, managing in the open.Illustrated that (x y) is that (X Y) is the situation of (1,1) for the coordinate in (0,0) and source for the coordinate of target.In this case, color determining unit 1303 output G (1) are as color ID.Multiplying power chromatic aberation calibration coordinate transform operation device 1301 by input coordinate (0,0) calculate respectively RGB (X, Y), and selected cell 1304 and 1305 output G (X, Y).Round up unit 1306 and 1307 round up (X, Y), and output (1,1) as (rX, rY).Array determining unit 1308 exports 3 as array of values based on Fig. 9.Here omitted the single computing of carrying out by coordinates correction unit 1309.Array selected cell 1310 based on Figure 11 select (X2, Y2) as R (X, Y), select (X1, Y1) as G (X, Y), and select (X3, Y3) as B (X, Y).Because color ID is G (1), selected cell 1311 select (X1, Y1) as G (X, Y).According to Figure 10 A to Figure 10 E, (X1, Y1)=(rX, rY), and the coordinate (1,1) of opisthogenesis directly becomes the output of selected cell 1311.The pixel value of the pixel that the pixel value that image device 110 reads the pixel that coordinate (1,1) locates is located as coordinate (0,0).
Next, illustrate that (x y) is that (X Y) is the situation of (3,1) for the coordinate in (1,0) and source for the coordinate of target.In this case, color determining unit 1303 output B (2) are as color ID.Multiplying power chromatic aberation calibration coordinate transform operation 1301 by input coordinate (1,0) calculate respectively RGB (X, Y), and selected cell 1304 and 1305 output B (X, Y).Round up unit 1306 and 1307 round up (X, Y), and output (3,1) as (rX, rY).And then, supposing round up unit 1306 and 1307 output dX=0, dY=+0.2 is as deviation dX, dY.Array determining unit 1308 exports 3 as array of values based on Fig. 9.Here omitted the single computing of carrying out by coordinates correction unit 1309.Array selected cell 1310 based on Figure 11 select (X2, Y2) as R (X, Y), select (X1, Y1) as G (X, Y), and select (X3, Y3) as B (X, Y).Because color ID is B (2), selected cell 1311 select (X3, Y3) as B (X, Y).According to Figure 10 A to Figure 10 E, about (X3, Y3), under the situation of dY＞0, X3=rX, and Y3=rY+1; Under other situation, Y3=rY-1.Because dY=+0.2, (X3, Y3)=(rX, rY+1), the output of last selected cell 1311 becomes (3,2).The pixel value of the pixel that the pixel value that image device 110 reads the pixel that coordinate (3,2) locates is located as coordinate (1,0).
According to configuration shown in Figure 7, when the color of the color of the coordinate in source and the coordinate of target was identical, the coordinate in source remained unchanged; When above-mentioned color between the two not simultaneously, can be with the coordinates correction in source with the target same color and the coordinate of the coordinate in close source.As a result, even the rgb image data with Bayer array is directly carried out the correction of multiplying power chromatic aberation, still can be before coordinate transform and keep the Bayer array constant afterwards.And then, owing to the view data that directly reads from image device 110 after the multiplying power chromatic aberation is proofreaied and correct, therefore no longer need the coordinate transform memory.
Figure 12 is the configured in one piece figure according to the coordinate transformation unit 130 of second example.When the color at the color at the coordinate place in source and the coordinate place of target was identical, second example adopted the application identical with first example.Yet, when differing from one another between the color, select two coordinates near coordinate and coordinate same color target in source, come the pixel value of interpolation based on each the pixel value in two coordinates, and the pixel value after the interpolation is appointed as the pixel value of the coordinate of target corresponding to the pixel of the coordinate of target.
In Figure 12, because multiplying power chromatic aberation calibration coordinate transform operation device 1301, color determining unit 1303, selected cell 1304 and 1305, round up unit 1306 with 1307 and the processing of array determining unit 1308 all identical with these unit shown in Figure 7, so omitted explanation for these unit.
As coordinates correction unit 1309 shown in Figure 7, coordinates correction unit A 1312 and coordinates correction unit B 1315 are imported rX, rY, dx and dy respectively, thereby calculate coordinate figure for the source after the obtainable all types of the array pattern of the same color in the Bayer array (pattern 1 is to the pattern 5) correction, promptly calculate the source that the needs paid close attention to are corrected coordinate (dx, dy) such as about, up and down or the coordinate figure of different coordinates such as diagonal.Simultaneously, the coordinates correction unit B 1315 new value of calculating d also.As the back was illustrated, when carrying out interpolation for the pixel of two coordinates, d was used as weight coefficient.
Figure 13 A to Figure 13 E has described the content by the computing of coordinates correction unit A 1312 execution.Pattern 1 shown in Figure 13 A to Figure 13 E is all identical with the pattern shown in Figure 10 A to Figure 10 E to pattern 5.In second example, coordinates correction unit A 1312 receives rX, rY, dX, dY, (a) to (e) that write to pattern 5 according to the pattern 1 shown in Figure 13 A to Figure 13 E carries out computing, and exports X1 and Y1, X2 and Y2, X3 and Y3, X4 and Y4 and X5 and Y5 respectively.In pattern 1, the coordinate in source (rX, rY) (centre coordinate) be designated as (X1, Y1).In pattern 2, the coordinate in source (rX, left coordinate rY) be designated as (X2, Y2).In pattern 3, coordinate (rX, rY) coordinate of tight top be designated as (X3, Y3).In pattern 4, the same with pattern 2, coordinate (rX, left coordinate rY) be designated as (X4, Y4).Here ignored vertical direction.In pattern 5, according to dY with coordinate (rX, lower left rY) or upper left coordinate be appointed as (X5, Y5).
Figure 14 A to Figure 14 E has described the content by the computing of coordinates correction unit B 1315 execution.Coordinates correction unit B 1315 receives rX, rY, dX, dY, and (a) to (e) that write to pattern 5 according to the pattern 1 shown in Figure 14 A to Figure 14 E carries out computing, and exports X1 and Y1, X2 and Y2, X3 and Y3, X4 and Y4 and X5 and Y5 respectively.Coordinates correction unit B 1315 is while output valve d1, d2, d3, d4 and d5 also.In Figure 14 A to Figure 14 E, pattern 1 is identical with pattern 1 among Figure 13 A.Pattern 2 is different to pattern 5 with the pattern 2 among Figure 13 B to Figure 13 E to pattern 5.That is, in pattern 2, the coordinate in source (rX, rY) the right coordinate of (centre coordinate) be designated as (X2, Y2), and output d2=d * 0.5.In pattern 3, coordinate (rX, rY) coordinate of tight below be designated as (X3, Y3), and output d3=dY+0.5.In pattern 4, the same with pattern 2 (ignoring vertical direction), coordinate (rX, right coordinate rY) be designated as (X4, Y4), and output d4=dX+0.5.In pattern 5, according to dY with coordinate (rX, lower right rY) or top-right coordinate be appointed as (X5, Y5), and output d5=dX+0.5.As will illustrating subsequently,, when the pixel of two coordinates is carried out interpolation, carry out weighting operation according to the distance that is less than or equal to a pixel according to d1 to d5.
As mentioned above, be that the situation of same color is used pattern 1 for target and source, and be that the situation of different colours is used pattern 2 to pattern 5 for target and source.Can be to any color application pattern 1 among the RGB.For the color in source is that the situation of R or B can be used pattern 2, pattern 3 and pattern 5, and is that the situation of G can be used pattern 4 for the color in source.
Array selected cell A 1313 receives from X1, Y1, X2, Y2, X3, Y3, X4, Y4, X5, the Y5 of coordinates correction unit A 1312 outputs, and be chosen in the coordinate figure X in the source after every kind of color among R, G, the B proofreaied and correct respectively, Y based on the array of values of obtaining by array determining unit 1308.Selected cell A 1314 receives R, the G from array selected cell A 1313 outputs, the versicolor many group X the B, Y, and select one group of X of same color based on the color ID that obtains by color determining unit 1303, Y is as the X of target, Y, and with this group X, Y sends to line buffer 1320.Array selected cell A 1313 is identical with selected cell 1311 with array selected cell 1310 shown in Figure 7 with the processing among the selected cell A 1314.
Array selected cell B 1316 receives from X1, Y1, d1, X2, Y2, d2, X3, Y3, d3, X4, Y4, d4, X5, the Y5 of 1315 outputs of coordinates correction unit B, d5, and coordinate figure X, Y and the weight coefficient d in the source after selecting every kind of color among R, G, the B proofreaied and correct respectively based on the array of values of obtaining by array determining unit 1308.Selected cell B 1317 receives R, the G from array selected cell B 1316 outputs, the versicolor many group X the B, Y, d, and select one group of X of same color, Y based on the color ID that obtains by color determining unit 1303, d is as the X of target, Y, d, and with this group X, Y sends to line buffer 1320, and weight coefficient d is sent to subtracter 1321 and analog multiplier 1323.Array selected cell B 1316 is identical with selected cell 1311 with array selected cell 1310 shown in Figure 7 with the processing among the selected cell B 1317; Yet, on new output factor d this point, be different.
In the present embodiment, have can random-access 2 port arrangement for image device 110.(X, Y), (X, the pixel value conduct of pixel Y) is corresponding to coordinate (x, the pixel value of pixel y) to read two different coordinates from image device 110 based on the coordinate figure from selected cell A 1314 and B 1317 outputs.Be understandable that according to Fig. 9, Figure 13 and Figure 14, and two different coordinates (X, Y) and (x y) can be identical color.Under the situation of same color pattern 1, two coordinates (X, Y) become same coordinate (rX, rY).
Subtracter 1321 deducts and coordinate (X, Y) the value d that exports from selected cell B 1317 together from 1.Analog multiplier 1322 will (X, Y) (X, the pixel value of the pixel of Y) locating multiply by the output valve of subtracter 1321 to the coordinate that reads from line buffer 1320 based on the coordinate figure from selected cell A 1314.On the other hand, analog multiplier 1323 will (X, Y) (X, the pixel value of the pixel of Y) locating multiply by and coordinate figure (X, Y) the value d that exports from selected cell B 1317 together for the coordinate that reads from line buffer 1320 based on the coordinate figure from selected cell B 1317.Adder 1324 self simulation multiplier 1322 and 1323 output valve addition in the future and specify addition after value as coordinate (x, the pixel value of the pixel of y) locating.That is, will be by coordinate (rX, two coordinates rY) (X, the pixel value that the pixel value of pixel Y) and the pixel value that these pixel value additions are obtained are exported as the coordinate of target from adder 1324 according to the close source of weight coefficient d weighting operation.Because coordinate (X, Y) and coordinate (x y) be retained as same color, so the Bayer array can not change before coordinate transform and afterwards.
The specific example of with reference to figure 6A and Fig. 6 B, managing in the open.At first, illustrate that (x y) is that (rX rY) is the situation of (1,1) for the coordinate in (0,0) and source for the coordinate of target.In this case, selected cell A 1314 outputs (1,1) are as (X, Y), selected cell B 1317 also exports (1,1) as (X Y) also exports d=0 (having omitted intermediate treatment) simultaneously.Correspondingly, image device 110 reads two pixel values of the pixel of same coordinate (1,1).Because d=0, the output of subtracter 1321 is 1, so analog multiplier 1322 pixel value of the pixel located of output coordinate (1,1) directly.The output of subtracter 1321 is 0.At last, the pixel value of the pixel located as coordinate (0,0) of the pixel value of the pixel located of adder 1324 output coordinates (1,1).
Next, will illustrate that (x y) is that (rX rY) is the situation of (3,1) for the coordinate in (1,0) and source for the coordinate of target.In this case, selected cell A 1314 outputs (3,0) are as (X Y) (has omitted intermediate treatment).Selected cell B 1317 outputs (3,2) are as (X, Y), and (d3=dY+0.5 dY=0.2) (has omitted intermediate treatment) to export d=0.7 simultaneously.Correspondingly, image device 110 reads the pixel value A of the pixel that coordinate (3,0) locates and the pixel value B of the pixel that coordinate (3,2) is located respectively.Because d=0.7, the output of subtracter 1321 is 0.3, and the output of analog multiplier 1322 is 0.3 * A, and the output of analog multiplier 1323 is 0.7 * B.The value that the output of adder 1324 output by addition analog multiplier 1322 and 1323 obtains.Therefore, adder 1324 output by according to weight coefficient d to two coordinates (X, the pixel value of pixel Y) be weighted operation and with these pixel value additions as coordinate (x, the pixel value of the pixel of y) locating and the pixel value that obtains.
According to configuration shown in Figure 12, image device 110 needs can random-access 2 port arrangement.Yet, when the color of the coordinate of the color of the coordinate in source and target not simultaneously, just near the pixel value interpolation of two identical coordinates of color coordinate and coordinate target in source pixel value, thereby realized improving the picture quality at the coordinate place of target corresponding to the coordinate of target.Certainly, before coordinate transform and all keep the Bayer array constant afterwards.
By expanding configuration shown in Figure 12 (for example, the pixel value of four pixels of interpolation), near color coordinate and coordinate target in source identical more than or equal to the pixel value interpolation of three coordinates pixel value corresponding to the pixel of the coordinate of target.In this case, can further improve the picture quality of the pixel at target place.
The 3rd example is identical with second example basically, yet, when the color of the coordinate of the color of the coordinate in source and target not simultaneously, as two the identical coordinates of coordinate color coordinate and target near the source, these coordinates all are two coordinates on the direction (x) identical with the read direction of image device 110 by unification.Therefore the configured in one piece of multiplying power chromatic aberation correcting unit 130 has omitted the explanation to it with shown in Figure 12 identical.The operation content of coordinates correction unit A 1312 and coordinates correction unit B 1315 is all different with the operation content part of coordinates correction unit in second example.
Figure 15 A to Figure 15 E has described the operation content of coordinates correction unit A 1312, and Figure 16 A to Figure 16 E has described the operation content of coordinates correction unit B 1315.In Figure 15 A to Figure 15 E, only be that pattern 3 is different with Figure 13 and Figure 14.That is,, in Figure 13 and Figure 14, all selected the direction (x) identical to go up two coordinates (same coordinate in the pattern 1) of this group with the read direction of image device 110 for pattern 1, pattern 2, pattern 4 and pattern 5.For pattern 3, in Figure 13 and Figure 14, two coordinates of this group on the y direction have been selected.On the other hand, in the 3rd example, as Figure 15 and shown in Figure 16, for pattern 3, selected the source coordinate above or below same coordinate as two coordinates of this group.Weight coefficient d3 is set to 0.Correspondingly, identical with pattern 1 mode is carried out interpolation.Therefore, can all select two coordinates of this group on the direction (x) identical to pattern 1 any situation to the pattern 5 with the read direction of image device 110.
When the read direction of imaging device 110 is the y direction, can select two coordinates of this group on the y direction by the operation content that changes coordinates correction unit A 1312 and coordinates correction unit B 1315.
According to the 3rd example, (burst read) read in the burst that can easily carry out in the image device, and reduces random access.Therefore, can use the CMOS etc. of low cost and low speed.
In Fig. 2, multiplying power chromatic aberation correcting unit 130 can be proofreaied and correct multiplying power chromatic aberation and distortion simultaneously.Correspondingly, can omit distortion correction unit 170, and not need to be used for the coordinate transform memory of correcting distortion.The configuration of proofreading and correct multiplying power chromatic aberation and distortion simultaneously and Fig. 7 and configuration shown in Figure 12 are substantially the same, and multiplying power chromatic aberation calibration coordinate transform operation device 1301 can be changed over the coordinate transform arithmetic unit that is used for proofreading and correct multiplying power chromatic aberation and distortion.In this arithmetic unit, (x y), calculates by the multiplying power chromatic aberation is increased the coordinate figure that distortion obtains according to the predetermined formula of coordinate transform the coordinate figure of input target, and this coordinate figure is output as coordinate figure X corresponding to the source of RGB, Y.What illustrate in processing subsequently and first, second and the 3rd example is substantially the same.
According to an aspect of the present invention, do not need to be used for the frame memory or the line buffer of coordinate transform, can be directly read the view data of the color array after the coordinate transform from image device.
And then according to a further aspect in the invention, image device can be configured in the middle of the chip together with coordinate transformation unit, thereby has realized the reduction on microminiaturized and the cost.
And then, according to a further aspect in the invention, before coordinate transform and can keep the color array of view data constant afterwards.
And then, according to a further aspect in the invention, before coordinate transform and can keep the color array of view data constant afterwards, and improve the pixel quality at coordinate transform target place.
And then, according to a further aspect in the invention, in the imaging device of the image device that has adopted the chromatic filter that comprises color array, can carry out down view data from the state that image device directly reads in the predetermined color array such as the coordinate transforms such as correction of the correction of multiplying power chromatic aberation or distortion, and need not frame memory or line buffer to be set individually, thereby realized reducing the cost of whole device for coordinate transform.
Although the present invention clearly and intactly has been described with reference to specific embodiment, but appended claim is not limited thereto, but comprises and fall into all modifications and optional structure in the basic teaching scope given here, that it may occur to persons skilled in the art that.
Claims (9)
1. imaging device comprises:
Image device (110) comprises the chromatic filter with predetermined color array, and described image device (110) will convert the view data of the signal of telecommunication by the optical imagery that optical system (10) obtains to; With
Coordinate transformation unit (130) according to the color corresponding to the color array of first coordinate figure, is carried out with the state of color array and is converted first coordinate figure of described image device (110) Coordinate Conversion of second coordinate figure to,
Wherein, by with first coordinate figure as the coordinate transform target and with second coordinate figure as the coordinate transform source, described image device (110) reads the pixel value of pixel at the described second coordinate figure place as the pixel value of the pixel at the described first coordinate figure place,
Described coordinate transformation unit (130) is carried out coordinate transform, thereby when the color of the color of the color array in coordinate transform source and the color array of coordinate transform target is identical, the pixel value that image device (110) reads the pixel at place, coordinate transform source is the pixel value of the pixel at coordinate transform target place, and when the color of the color array of the color of the color array in coordinate transform source and coordinate transform target not simultaneously, image device (110) reads close coordinate transform source, the pixel value of pixel at a plurality of coordinate figures place that has same color with the coordinate transform target is as the pixel value of the pixel at coordinate transform target place, and
Described imaging device further comprises correcting unit, be used near the coordinate transform source, have in the middle of the pixel value of pixel at coordinate place of same color compensation corresponding to the pixel value of the pixel at described coordinate transform target place with the coordinate transform target, and the pixel value that obtains is set to the pixel value of the pixel at coordinate transform target place.
2. imaging device according to claim 1, wherein,
Described image device (110) comprises the arbitrary access configuration.
3. imaging device according to claim 1 and 2, wherein,
Described coordinate transformation unit (130) is built in the middle of the described image device (110).
4. imaging device according to claim 1 and 2, wherein,
Described coordinate transformation unit (130) carry out coordinate transform with the multiplying power chromatic aberation of image correcting data and distortion at least one of them.
5. imaging device according to claim 1 and 2, wherein,
Coordinate transformation unit (130) thus carry out each pixel in the view data that coordinate transform image device (110) reads color array, wherein said coordinate transform is:
When the color of the color of the color array in coordinate transform source and the color array of coordinate transform target is identical, the pixel value of the pixel at coordinate transform source place is set at the pixel value of the pixel at coordinate transform target place, and when the color of the color of the color array in coordinate transform source and the color array of coordinate transform target not simultaneously, with the most close coordinate transform source, and the pixel value of pixel of coordinate transform target with coordinate figure place of same color be set at the pixel value of the pixel at coordinate transform target place.
6. imaging device according to claim 1, wherein,
Near the number coordinate transform source, that have a plurality of coordinates of same color with the coordinate transform target is two.
7. imaging device according to claim 6, wherein,
Described near the coordinate transform source, are coordinates on the direction identical with two coordinates that the coordinate transform target has a same color with the read direction of described image device (110).
8. according to each described imaging device in the claim 1,2,6 and 7, further comprise compensating unit (150), be used for to the compensation of the view data after the coordinate transform of color array because the caused defect pixel of described color array.
9. imaging device according to claim 8, further comprise distortion correction unit (170), be used for follow-up phase in described compensating unit (150), proofread and correct by compensation because the distortion of the view data that the caused defect pixel of color array in the view data of multiplying power chromatic aberation after proofreading and correct obtains.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2008176193 | 2008-07-04 | ||
| JP2008176193A JP5062846B2 (en) | 2008-07-04 | 2008-07-04 | Imaging device |
| JP2008-176193 | 2008-07-04 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101621623A CN101621623A (en) | 2010-01-06 |
| CN101621623B true CN101621623B (en) | 2011-06-22 |
Family
ID=41137008
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009101498761A Expired - Fee Related CN101621623B (en) | 2008-07-04 | 2009-07-02 | Imaging apparatus |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US8189064B2 (en) |
| EP (1) | EP2141911A3 (en) |
| JP (1) | JP5062846B2 (en) |
| CN (1) | CN101621623B (en) |
| TW (1) | TWI399085B (en) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5055643B2 (en) * | 2008-07-28 | 2012-10-24 | 株式会社リコー | Image pickup device and image pickup apparatus |
| JP5273371B2 (en) | 2008-12-24 | 2013-08-28 | 株式会社リコー | Image processing apparatus and method, and in-vehicle camera apparatus |
| JP5267794B2 (en) | 2008-12-26 | 2013-08-21 | 株式会社リコー | Image processing apparatus and in-vehicle camera apparatus |
| KR20120030355A (en) * | 2009-04-13 | 2012-03-28 | 디지털옵틱스 코포레이션 유럽 리미티드 | Methods and systems for reading an image sensor based on a trajectory |
| JP5627215B2 (en) * | 2009-11-04 | 2014-11-19 | キヤノン株式会社 | Image processing apparatus and control method thereof |
| US8624999B2 (en) | 2009-12-01 | 2014-01-07 | Ricoh Company, Ltd. | Imaging apparatus |
| DE102010034319B4 (en) * | 2010-08-12 | 2012-04-19 | Jena-Optronik Gmbh | Method and device for the radiometric measurement of object points on surfaces of celestial bodies |
| DE102010034318B4 (en) * | 2010-08-12 | 2012-02-23 | Jena-Optronik Gmbh | Method and device for the corrected radiometric measurement of object points on surfaces of celestial bodies |
| JP5585885B2 (en) | 2011-03-18 | 2014-09-10 | 株式会社リコー | Image processing apparatus and image processing method |
| JP5991749B2 (en) * | 2011-09-26 | 2016-09-14 | キヤノン株式会社 | Image processing apparatus and method |
| JP6417666B2 (en) | 2013-05-15 | 2018-11-07 | 株式会社リコー | Image processing system |
| US9792879B2 (en) * | 2015-12-08 | 2017-10-17 | Himax Technologies Limited | Display system and driving method |
Family Cites Families (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS59183589A (en) * | 1983-04-04 | 1984-10-18 | Konishiroku Photo Ind Co Ltd | Method for correcting distortion of lens |
| GB2256989B (en) | 1991-06-21 | 1995-02-08 | Sony Broadcast & Communication | Video image capture apparatus |
| JPH10224695A (en) * | 1997-02-05 | 1998-08-21 | Sony Corp | Device and method for correcting aberration |
| US6603885B1 (en) * | 1998-04-30 | 2003-08-05 | Fuji Photo Film Co., Ltd. | Image processing method and apparatus |
| JP2000069343A (en) * | 1998-06-11 | 2000-03-03 | Fuji Photo Film Co Ltd | Digital image pickup device |
| US7245319B1 (en) * | 1998-06-11 | 2007-07-17 | Fujifilm Corporation | Digital image shooting device with lens characteristic correction unit |
| JP2002199410A (en) * | 2000-12-25 | 2002-07-12 | Canon Inc | Imaging device, compensating processing method for deteriorated image and storage medium |
| DE50107083D1 (en) | 2001-03-05 | 2005-09-15 | Siemens Ag | METHOD AND DEVICE FOR DETERING AN IMAGE, ESPECIALLY FOR PERSONAL PROTECTION SYSTEMS |
| US7346210B2 (en) * | 2001-12-28 | 2008-03-18 | Nikon Corporation | Image processing device and image processing program for determining similarity factors of pixels |
| JP2004241991A (en) * | 2003-02-05 | 2004-08-26 | Minolta Co Ltd | Imaging apparatus, image processor, and image processing program |
| JP4311040B2 (en) * | 2003-03-05 | 2009-08-12 | セイコーエプソン株式会社 | Chromatic aberration correction apparatus, chromatic aberration correction method, and chromatic aberration correction program |
| JP4378994B2 (en) | 2003-04-30 | 2009-12-09 | ソニー株式会社 | Image processing apparatus, image processing method, and imaging apparatus |
| EP2533192B1 (en) * | 2003-07-28 | 2017-06-28 | Olympus Corporation | Image processing apparatus, image processing method, and distortion correcting method |
| US7596286B2 (en) * | 2003-08-06 | 2009-09-29 | Sony Corporation | Image processing apparatus, image processing system, imaging apparatus and image processing method |
| JP4815807B2 (en) | 2004-05-31 | 2011-11-16 | 株式会社ニコン | Image processing apparatus, image processing program, and electronic camera for detecting chromatic aberration of magnification from RAW data |
| JP4596986B2 (en) | 2005-06-07 | 2010-12-15 | オリンパス株式会社 | Imaging device |
| JP4553798B2 (en) | 2005-06-07 | 2010-09-29 | オリンパス株式会社 | Imaging device |
| JP4596987B2 (en) | 2005-06-07 | 2010-12-15 | オリンパス株式会社 | Imaging device |
| JP4596988B2 (en) | 2005-06-07 | 2010-12-15 | オリンパス株式会社 | Imaging device |
| US7839446B2 (en) * | 2005-08-30 | 2010-11-23 | Olympus Corporation | Image capturing apparatus and image display apparatus including imparting distortion to a captured image |
| JP4754939B2 (en) * | 2005-11-01 | 2011-08-24 | オリンパス株式会社 | Image processing device |
| JP4487902B2 (en) * | 2005-11-09 | 2010-06-23 | ソニー株式会社 | Image processing apparatus and method, and program |
| US20070126892A1 (en) * | 2005-11-30 | 2007-06-07 | Haike Guan | Correcting an image captured through a lens |
| US8040412B2 (en) * | 2005-12-26 | 2011-10-18 | Panasonic Corporation | Imaging apparatus and image data correcting method |
| JP2007189361A (en) * | 2006-01-12 | 2007-07-26 | Fujitsu General Ltd | Image sensor and camera using the same |
| JP2007243343A (en) * | 2006-03-06 | 2007-09-20 | Yamaha Corp | Image pickup device |
| JP4709084B2 (en) * | 2006-07-07 | 2011-06-22 | キヤノン株式会社 | Image processing apparatus and image processing method |
| JP4979068B2 (en) | 2007-01-22 | 2012-07-18 | 日本電信電話株式会社 | Secret function calculation method and apparatus, and program |
| JP2008289090A (en) * | 2007-05-21 | 2008-11-27 | Toshiba Corp | Imaging signal processor |
-
2008
- 2008-07-04 JP JP2008176193A patent/JP5062846B2/en not_active Expired - Fee Related
-
2009
- 2009-06-10 US US12/457,417 patent/US8189064B2/en not_active Expired - Fee Related
- 2009-06-15 EP EP09251559A patent/EP2141911A3/en not_active Ceased
- 2009-07-01 TW TW098122305A patent/TWI399085B/en not_active IP Right Cessation
- 2009-07-02 CN CN2009101498761A patent/CN101621623B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| TW201004324A (en) | 2010-01-16 |
| JP2010016716A (en) | 2010-01-21 |
| CN101621623A (en) | 2010-01-06 |
| US8189064B2 (en) | 2012-05-29 |
| TWI399085B (en) | 2013-06-11 |
| EP2141911A2 (en) | 2010-01-06 |
| EP2141911A3 (en) | 2011-01-19 |
| US20100002105A1 (en) | 2010-01-07 |
| JP5062846B2 (en) | 2012-10-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101621623B (en) | Imaging apparatus | |
| CN101510944A (en) | Image processing method, image processing apparatus, and imaging apparatus | |
| CN101534384B (en) | Image processing method, image processing device, and image capturing device | |
| CN101505368B (en) | Progressive-to-interlace conversion method, image processing apparatus, and imaging apparatus | |
| CN102265600B (en) | Image processing apparatus and on-vehicle camera apparatus | |
| CN101448168B (en) | Image pickup apparatus | |
| CN101540919B (en) | Imaging apparatus | |
| CN101534385B (en) | Image pickup device | |
| CN101500088B (en) | Image processing method, image processing apparatus, and imaging apparatus | |
| JP5078147B2 (en) | Image processing apparatus and image pickup apparatus | |
| US6201530B1 (en) | Method and system of optimizing a digital imaging processing chain | |
| CN102224736A (en) | Image pick-up device | |
| CN103597821A (en) | Image pickup apparatus and signal value correction method | |
| US6967660B2 (en) | Image processing apparatus and image processing system | |
| US20110170776A1 (en) | Image distortion correcting method and image processing apparatus | |
| KR100723046B1 (en) | Display driver and image prosessing apparatus for interpolating color and control method thereof | |
| CN100378511C (en) | Image display color processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110622 Termination date: 20190702 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |