CN101188773B - Camera and image processing method - Google Patents
Camera and image processing method Download PDFInfo
- Publication number
- CN101188773B CN101188773B CN2007101675589A CN200710167558A CN101188773B CN 101188773 B CN101188773 B CN 101188773B CN 2007101675589 A CN2007101675589 A CN 2007101675589A CN 200710167558 A CN200710167558 A CN 200710167558A CN 101188773 B CN101188773 B CN 101188773B
- Authority
- CN
- China
- Prior art keywords
- pixel
- brightness
- view data
- composition
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 14
- 239000000203 mixture Substances 0.000 claims abstract description 55
- 230000004075 alteration Effects 0.000 claims abstract description 22
- 238000003384 imaging method Methods 0.000 claims description 43
- 241001269238 Data Species 0.000 claims description 36
- 230000009471 action Effects 0.000 claims description 15
- 238000010586 diagram Methods 0.000 claims description 10
- 230000001360 synchronised effect Effects 0.000 claims description 6
- 230000008859 change Effects 0.000 claims description 2
- 230000000052 comparative effect Effects 0.000 claims description 2
- 238000005286 illumination Methods 0.000 abstract 8
- 239000004615 ingredient Substances 0.000 abstract 5
- 230000004304 visual acuity Effects 0.000 abstract 4
- 230000002349 favourable effect Effects 0.000 abstract 2
- 230000000452 restraining effect Effects 0.000 abstract 1
- 230000015654 memory Effects 0.000 description 29
- 238000000034 method Methods 0.000 description 11
- 238000003860 storage Methods 0.000 description 9
- 230000007423 decrease Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 206010034972 Photosensitivity reaction Diseases 0.000 description 2
- 230000003321 amplification Effects 0.000 description 2
- 230000006866 deterioration Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000036211 photosensitivity Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 239000012467 final product Substances 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
Images
Landscapes
- Image Processing (AREA)
- Studio Devices (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The invention provides a videography device and an image processing method, thereby generating the image restraining the reduction of the resolving power and improving the illumination and color noise when in videography of high photographic sensibility. The image obtained synchronously based on all pixel read mode and the image based on the pixel tot read mode are separated into illumination ingredient and aberration ingredient, with self-adapting mixture treatment. All the pixel image data has the characteristic of high resolving power and the pixel tot image data has the characteristic of favorable illumination and color noise. In order to restrain the reduction of the resolving power and reduce the illumination noise, according to the illumination, the illumination ingredient of all pixel image data and the illumination ingredient of the pixel tot image data are weighted averaged, to generate the illumination ingredient image with favorable noise character and resolving power.
Description
Technical field
The present invention relates to a kind of camera head, particularly can reduce the camera head and the image processing method thereof of the noise in the view data.
Background technology
In all camera heads that with the digital camera are representative, adopt the ISO photography as the image capture method under the low-light (level) environment.Said herein ISO photography refers to utilize amplifier to amplify from the picture signal of photographic element output, obtains the method for the picture signal of target strength at short notice.In this ISO photography, when taking the image of identical exposure, compare with the low speed photography, has the advantage that to finish the exposure photography at short notice, have following shortcoming but then,, make signal component bury in the noise contribution that produces in the back level owing to be stored in the minimizing of the quantity of electric charge in the imaging apparatus, and because amplifier makes image quality obviously worsen to the excessive amplification of signal.
Therefore, for example patent documentation 1 proposes following method, has the add imaging apparatus of unit of pixel by use, and the useless gain of not carrying out amplifier is amplified can suppress noise.This method utilizes the pixel unit that adds adjacent a plurality of pixel values (electric charge) addition of imaging apparatus to be made it to become the pixel value of a pixel, accumulates signal component thus, does one's utmost the amplification of rejective amplifier, improves photosensitivity.
Patent documentation 1 TOHKEMY 2005-303519 communique
At this, pixel addition is owing to being 1 pixel with adjacent a plurality of pixel replacement, so picture size must reduce.Therefore, though reduced noise, also cause the decline of the resolution of image.
Promptly, has higher resolution by reading all pixel image datas that all pixels obtain, but when becoming ISO, noise level increases, on the contrary, and by reading pixel that the addition pixel the obtains view data that adds, its color noise and brightness noise all have good characteristic, but the processing because pixel adds makes image dwindle, and resolution descends.
Summary of the invention
The present invention In view of the foregoing proposes, and its purpose is, the image processing method of a kind of camera head and this camera head is provided, and when it is photographed in ISO, can generate decline that suppresses resolution and the image that has improved noise.
In order to achieve the above object, the camera head of first mode of the present invention is implemented image processing and is obtained view data image pickup signal, this camera head is characterised in that, this camera head has: imaging apparatus, and it has the electric charge addition of adjacent a plurality of pixels and with add readout mode and read all pixel readout modes of the electric charge corresponding with all pixels of the pixel that it is read; Synchronous shooting portion, it carries out following action synchronously or continuously: drive described imaging apparatus and obtain the add action of view data and drive described imaging apparatus and the action of obtaining all pixel image datas with described all pixel readout modes of pixel with the described pixel readout mode that adds; Brightness aberration separated part, its will add by the described pixel that described synchronous shooting portion obtains view data and described all pixel image datas are separated into brightness composition and aberration composition respectively; Brightness component-part diagram picture synthesizes portion, it is with the ratio of the either party in the brightness composition of the brightness composition of the view data that adds based on described pixel and described all pixel image datas, the add brightness composition of view data and the brightness composition of described all pixel image datas of described pixel is weighted on average, generates synthetic luminance picture data; And the synthetic portion of brightness aberration, the add aberration composition of view data of its synthetic described synthetic luminance picture data and described pixel, thereby synthetic coloured image.
And, in order to achieve the above object, the image processing method of second mode of the present invention, this image processing method is handled the output from imaging apparatus, wherein, this imaging apparatus has the electric charge addition of adjacent a plurality of pixels and with the pixel that it the is read readout mode that adds, with all pixel readout modes of reading the electric charge corresponding with all pixels, described image processing method is characterised in that described image processing method is carried out following processing: carry out following action synchronously or continuously: drive described imaging apparatus and obtain the add action of view data of pixel with the described pixel readout mode that adds, the action of obtaining all pixel image datas with driving described imaging apparatus with described all pixel readout modes; Add view data and described all pixel image datas of described pixel are separated into brightness composition and aberration composition respectively; Ratio with the either party in the brightness composition of the brightness composition of the view data that adds based on described pixel and described all pixel image datas, the add brightness composition of view data and the brightness composition of described all pixel image datas of described pixel is weighted on average, generates synthetic luminance picture data; And the add aberration composition of view data of synthetic described synthetic luminance picture data and described pixel, thereby synthetic coloured image.
According to these first and second modes,, when carrying out the ISO photography, can generate decline that suppresses resolution and the image that has improved noise by synthetic high-resolution all pixel image datas and the good pixel of the noise characteristic view data that adds.
According to the present invention, the image processing method in a kind of camera head and this camera head can be provided, thereby when carrying out the ISO photography, can generate decline that suppresses resolution and the image that has improved noise.
Description of drawings
Fig. 1 is the main block diagram of the camera head that relates to of the 1st execution mode of the present invention.
Fig. 2 is the basic flow sheet of the 1st execution mode of the present invention.
Fig. 3 is a flow chart of recording and narrating the synthetic concrete condition of handling of luminance picture.
Fig. 4 is the main block diagram of the camera head that relates to of the 2nd execution mode of the present invention.
Fig. 5 is the basic flow sheet of the 2nd execution mode of the present invention.
Symbol description
1 camera lens; 2,21,22 imaging apparatuss; 3,23,24 analog portions; 4,25,26 A/D converter sections; 5 CPU; 6 flash memories; 7 memories; 8 image processing parts; 9 JPEG handling parts; 10 exterior storage interfaces (I/F); 11 external memories; 12 lcd drivers; 13 LCD; 14 operating portions; 15 buses; 20 light path branch prisms.
Embodiment
Below, with reference to the description of drawings embodiments of the present invention.In addition, below Shuo Ming execution mode is the part in several execution modes, can not limit the present invention.
[the 1st execution mode]
Fig. 1 is the block diagram of the primary structure of the camera head that relates to of expression the 1st execution mode of the present invention.As shown in Figure 1, the camera head of present embodiment has camera lens 1, imaging apparatus 2, analog portion 3, A/D converter section 4, CPU5, flash memory 6, memory 7, image processing part 8, JPEG handling part 9, exterior storage interface (I/F) 10, external memory 11, lcd driver 12, LCD13, operating portion 14 and bus 15.And imaging apparatus 2, analog portion 3 and A/D converter section 4 constitute image pickup part 16.
Camera lens 1 converges the light from not shown subject.Imaging apparatus 2 receives the light that converges by camera lens 1, is converted into the electric charge corresponding to sensitive volume, and this electric charge is exported as picture signal.At this, imaging apparatus 2 then can be CCD mode or CMOS mode if having all pixel readout modes and the add imaging apparatus of readout mode of pixel.Analog portion 3 comprises correlated-double-sampling (CDS) circuit and automatic gain control (AGC) circuit, and the picture signal of being obtained by imaging apparatus 2 is implemented simulation process.The picture signal digitlization that A/D converter section 4 will obtain by analog portion 3 generates DID.
At this, drive the DID that imaging apparatus 2 obtains (below be called all pixel image datas, pixel add view data) and be stored in by bus 15 and utilize in the memory 7 that SDRAM etc. constitutes with all pixel readout modes and the pixel readout mode that adds.Image processing part 8 is read add view data and it is implemented image processing of all pixel image datas, pixel from memory 7.JPEG handling part 9 read handle by image processing part 8, be stored in all pixel image datas in the memory 7 and the pixel view data that adds, implement the JPEG compression and handle.The compressing image data that compression obtains in JPEG handling part 9 is stored in the external memory 11 through exterior storage interface (I/F) 10.And JPEG handling part 9 is also read and is stored in the compressing image data in the external memory 11 and implements the processing that jpeg decompression contracts.Lcd driver 12 is read the view data of handling by image processing part 8 from memory 7, is converted into picture signal, makes LCD13 carry out image according to this picture signal and shows.
Each several part as the CPU5 control of synchronous shooting portion camera head shown in Figure 1.Flash memory 6 storages are by camera head various programs of carrying out and the parameter of carrying out various processing usefulness.Operating portion 14 is operating portions that the operator carries out various operation inputs.
Fig. 2 is the flow chart that is illustrated in the program of CPU5 execution.In addition, the procedure stores shown in Fig. 2 is in flash memory 6.
The release-push that in operating portion 14, comprises be pressed half, when the 1st release-push is connected (step S1), CPU5 begins AE (Auto Exposure, automatic exposure) action, conditions of exposure when determining photography, and beginning AF (Auto Focus, automatically the focal position is obtained in focusing) action, drives camera lens 1 (step S2) according to the focal position of being obtained.Then, pressed fully at release-push, when the 2nd release-push is connected (step S3), CPU5 carries out the control of not shown shutter and aperture according to conditions of exposure, and drives imaging apparatus 2 with predetermined photography conditions, beginning store charge (step S4).After Charge Storage finishes, read electric charge (step S5) from imaging apparatus 2 with all pixel readout modes.The electric charge of being read is digitized through analog portion 3, A/D converter section 4.All pixel image datas that obtain thus are stored in (step S6) in the memory 7 by bus 15.
After step S6, CPU5 drives imaging apparatus 2, beginning store charge (step S7) with the imaging conditions of the photosensitivity raising having considered to add based on pixel etc.After Charge Storage finishes, read electric charge (step S8) from imaging apparatus 2 with the pixel readout mode that adds.The electric charge of being read is digitized through analog portion 3, A/D converter section 4.The pixel that obtains the thus view data that adds is stored in (step S9) in the memory 7 by bus 15.At this, as shown in Figure 1, when imaging apparatus only is provided with one,, then can not obtain all pixel images and the pixel image that adds if the certain hour of not being separated by is taken.Therefore, when take moving faster subject, both images produce spatial deviation sometimes, but owing to can reduce the quantity of imaging apparatus, the correspondingly simplification of implement device.In addition, in structure shown in Figure 1, the certain hour of need being separated by obtains all pixel images and the pixel image that adds, but it obtains order and be not limited to order shown in Figure 2, also can be opposite order.
And, when being taken into view data by step S6 and step S9, compare with the picture signal that obtains with all pixel readout modes with the pixel picture signal that readout mode obtains that adds, owing to the less less image of noise that becomes of degree is amplified in the gain of carrying out in analog portion 3.On the other hand, the pixel view data that adds is compared size decreases with all pixel image datas.
All pixel image datas that obtain respectively at step S6 and step S9 and the pixel view data that adds is the view data that each pixel has the information of any color among R, G, the B, so in order to make 1 pixel have the information of three kinds of colors, image processing part 8 carries out synchronization process to each view data.In addition, 8 pairs of image processing parts each view data of having carried out synchronization process is carried out white balance and is handled.Then, each image data storage (step S10) in memory 7.
In addition, the luminance picture of handling usefulness is synthetic to be handled image processing part 8 for the noise of implementing after carrying out reduces, and all pixel image datas that each pixel is made of R, G, three kinds of compositions of B are separated into the image of brightness (Y) and aberration (C) composition.Then, discarded aberration composition, only the brightness composition YF with all pixel image datas is stored in (step S11) in the memory 7.Then, image processing part 8 is separated into the image of brightness and aberration composition with the pixel view data that adds.Then, respectively brightness composition YM and aberration composition CrM, CbM are stored in (step S12) in the memory 7.
As previously described, the pixel view data that adds is compared with all pixel image datas, size is less, so carrying out adjusted size, image processing part 8 couples of YM, CrM, CbM handle (interpolation processing of pixel value), view data and all pixel image datas is measure-alike so that pixel adds, and then it is stored in (step S13) in the memory 7.Use later on pixel after the adjusted size view data that adds.
Then, image processing part 8 uses brightness composition YF, YM to reduce synthetic handle (the step S14) of luminance picture that brightness noise is used.In this processing of carrying out is to utilize YF and YM to obtain the pixel value of same position, the processing of the weighted average of the pixel value that is obtained as the pixel value of synthetic luminance picture data.And, when being weighted average treatment,, change the weighted average ratio of YF and YM according to the variation of brightness.Promptly, preestablish a plurality of luminance thresholds and corresponding to the weighted average ratio of this luminance threshold, either party among YF and the YM as the Benchmark brightness view data, the opposing party as reference luminance picture data, the pixel value and the luminance threshold of Benchmark brightness view data are compared, obtain and with reference to the weighted average between the pixel value of luminance picture data with weighted average ratio corresponding to comparative result.Fig. 3 has represented specifically to record and narrate the flow chart of the processing of this step S14.
Fig. 3 specifically represents the processing procedure of step S14.At first, for simplicity, luminance area is divided into low brightness area, middle luminance area, three ranks of high-brightness region, the luminance threshold of low-light level-middle brightness is made as T1, in the luminance threshold of brightness-high brightness be made as T2.And, corresponding therewith, the weighted average ratio of low brightness area, middle luminance area, high-brightness region is made as R1, R2, R3 respectively.Generally, noise is apparent in view in dark portion's (low brightness area), so the ratio R 1 corresponding to low brightness area makes the less YM of noise have bigger weight, ratio R 2 corresponding to middle luminance area makes YM and YF have roughly the same weight respectively, ratio R 3 corresponding to high-brightness region makes YF have bigger weight owing to paying attention to resolution, can suppress the brightness noise level of dark portion lower thus, and the resolution of the unconspicuous middle and high luminance area of original noise can be reduced and suppress lessly.On the basis of these processing, flow chart shown in Figure 3 is described.
Benchmark brightness view data (step S21) when image processing part 8 is at first determined to synthesize.At this, the less YM of the noise brightness composition of view data (pixel add) as the Benchmark brightness view data.Then, the YM that 8 pairs of image processing parts are defined as the Benchmark brightness view data carries out raster scan, obtains pixel value (step S22).And whether the pixel (being called concerned pixel) of pixel value has been obtained in image processing part 8 judgements by raster scan pixel value is luminance threshold T1 following (step S23).In the judgement of step S23, if that the pixel value of concerned pixel is luminance threshold T1 is following, be that the pixel value of concerned pixel belongs to low brightness area, then image processing part 8 utilizes weighted average ratio R 1, and the pixel value of the YM that obtains at step S22 and the YF pixel value that is present in the position identical with it are weighted on average (step S24).Then, export (step S25) handle the pixel value that obtains by weighted average as the brightness value of the luminance picture data Y after synthetic.Then, image processing part 8 judges that whether current concerned pixel is end pixels (for example, when the left upper end pixel begins to carry out raster scan, the pixel of bottom righthand side is an end pixels) (step S26).In the judgement of step S26, when current concerned pixel is end pixels, finish a series of processing, otherwise return step S22, begin to carry out raster scan once more.
And in the judgement of step S23, when the pixel value of concerned pixel surpassed luminance threshold T1, image processing part 8 judged whether the pixel value of concerned pixel is luminance threshold T2 following (step S27).In the judgement of step S27, if that the pixel value of concerned pixel is luminance threshold T2 is following, be that the pixel value of concerned pixel belongs to middle luminance area, then image processing part 8 utilizes weighted average ratio R 2, the pixel value of the YM that obtains at step S22 and the YF pixel value that is present in the position identical with it are weighted on average (step S28), the brightness value output of the pixel value that is obtained as the luminance picture data Y after synthetic.And, in the judgement of step S27, when the pixel value of concerned pixel surpasses luminance threshold T2, when the pixel value of concerned pixel belongs to high-brightness region, image processing part 8 utilizes weighted average ratio R 3, the pixel value of the YM that obtains at step S22 and the YF pixel value that is present in the position identical with it are weighted on average (step S29), the brightness value output of the pixel value that is obtained as the luminance picture data Y after synthetic.Handle the final luminance picture data Y of synthesizing that generates according to brightness by carrying out these.Should synthetic luminance picture data Y form and suppressed in low brightness area easily significantly brightness noise greatly, and suppressed the image that the resolution of middle and high luminance area descends.
At this, returned specification flow chart shown in Figure 2 once more.Carried out the synthetic processing of luminance picture data at step S14 after, it is synthetic that image processing part 8 will synthesize add aberration composition CrM, the CbM of view data of luminance picture data Y and pixel, and be converted to the view data of R, G, B composition, design of graphics picture and be stored in (step S15) in the memory 7 more thus.The add aberration composition of view data of pixel is compared with the aberration composition of all pixel image datas and is belonged to low noise, thus by it as the aberration composition that makes up view data again, not only can reduce brightness noise, and can significantly reduce color noise.Then, JPEG handling part 9 is read the color image data that is made of R, G, B composition that makes up again from memory 7, and compress processing (step S16), by exterior storage I/F10 compressing image data is stored in then in the external memories 11 such as storage card (step S17).
By Fig. 2 and a series of processing shown in Figure 3, can obtain the image that can significantly reduce brightness noise and color noise and suppress the resolution deterioration degree less.And, in luminance picture data synthetic, when determining the weighted average ratio and during the structure again of view data, use the less pixel of noise add the brightness composition and the aberration composition of view data respectively, can further improve noise thus and reduce effect.
[the 2nd execution mode]
Below, the 2nd execution mode of the present invention is described.Fig. 4 is the block diagram of the primary structure of the camera head that relates to of expression the 2nd execution mode of the present invention.At this, inscape and Fig. 1 of being endowed the symbol identical with Fig. 1 among Fig. 4 are identical, so omit explanation.Be provided with light path branch prism 20 at camera head shown in Figure 4.20 pairs of light that converge by camera lens 1 of light path branch prism carry out branch, make a side's of branch of institute light inject image pickup part 27, make the opposing party's light inject image pickup part 28.According to this structure, can make from the light of subject and inject two image pickup parts simultaneously.
That is, utilize light path branch prism 20 to assign in two systems, utilize imaging apparatus 21, imaging apparatus 22 to receive each light by the light that camera lens 1 converges.At this, imaging apparatus 21 has all pixel readout modes, and imaging apparatus 22 has the pixel readout mode that adds.The picture signal that obtains from imaging apparatus 21 is controlled the analog portion 23 and the A/D converter section 25 of (AGC) through the comprise correlated-double-sampling (CDS) and the automatic gain of level later, becomes DID (all pixel image datas).Equally, the picture signal that obtains from imaging apparatus 22 is through analog portion 24 and A/D converter section 26, becomes DID (pixel add view data).
DID that readout mode obtains is stored in the memory 7 by bus 15 to utilize all pixel readout modes and pixel to add.Then, all pixel image datas and the pixel of reading from memory 7 add view data after image processing part 8 carries out image processing, carry out the JPEG compression at JPEG handling part 9 and handle, and are stored in the external memory 11 through exterior storage I/F10.And the view data of having carried out image processing at image processing part 8 is converted to picture signal through lcd driver 12, according to this picture signal display image on LCD13.
Fig. 5 is the flow chart in the program of CPU5 execution.In addition, procedure stores shown in Figure 5 is in flash memory 6.
The release-push that in operating portion 14, comprises be pressed half, when the 1st release-push is connected (step S41), CPU5 begins AE action and AF and moves (step S42).Then, pressed fully at release-push, when the 2nd release-push is connected (step S43), CPU5 drives imaging apparatus 21 and imaging apparatus 22 respectively according to predetermined photography conditions, beginning store charge (step S44).Utilize all pixel readout modes to read electric charge (step S45) from imaging apparatus 21, after process analog portion 23, A/D converter section 25 are digitized, make all pixel image datas that obtain by digitlization be stored in (step S46) in the memory 7 by bus 15.
Equally, utilize the pixel readout mode that adds to read electric charge (step S47) from imaging apparatus 22, after being digitized through analog portion 24, A/D converter section 26, make the pixel that obtains by the digitlization view data that adds be stored in (step S48) in the memory 7 by bus 15.
Later step S49～S56 is identical with the step S10～S17 of the flow chart shown in Figure 2 of the 1st execution mode.And the synthetic processing of the luminance picture data of carrying out at step S53 also is the processing of the flow chart shown in Figure 3 of the 1st execution mode.Therefore, omit the later processing of explanation.
By a series of processing, can obtain the image that can significantly reduce brightness noise and color noise and suppress the resolution deterioration degree less according to Fig. 5 explanation.And, as the 2nd execution mode, prepare the light path and the imaging apparatus of two systems, though structure complicate, can all pixel images of synchronous shooting and the pixel image that adds, can obtain not exist the image of time lag.Therefore, the consistent degree of the location of pixels in the time of can improving weighted average can be obtained the higher synthetic luminance picture data Y of precision.
Abovely the present invention has been described, but has the invention is not restricted to above-mentioned execution mode, certainly in aim scope of the present invention, carried out various distortion and application according to execution mode.For example, illustrated in the above-described embodiment luminance area is divided into three other examples of level, but also can be divided into four more than the rank.During this situation, set luminance threshold and synthesis rate, comprise that the luminance area that is appended carries out processing shown in Figure 3 and gets final product according to the quantity of luminance area.
In addition, comprise the invention in various stages in the above-described embodiment, can propose various inventions according to the appropriate combination of disclosed a plurality of inscapes.For example, the several inscapes of deletion from all inscapes shown in the execution mode in the time of also can addressing the above problem and obtain above-mentioned effect, have been deleted structure after this inscape and also can be used as invention and propose.
Claims (6)
1. camera head, this camera head is implemented image processing and is obtained view data image pickup signal, and this camera head is characterised in that this camera head has:
Imaging apparatus, it has the electric charge addition of adjacent a plurality of pixels and with add readout mode and read all pixel readout modes of the electric charge corresponding with all pixels of the pixel that it is read;
Synchronous shooting portion, it carries out following action synchronously or continuously: drive described imaging apparatus and obtain the add action of view data and drive described imaging apparatus and the action of obtaining all pixel image datas with described all pixel readout modes of pixel with the described pixel readout mode that adds;
Brightness aberration separated part, its will add by the described pixel that described synchronous shooting portion obtains view data and described all pixel image datas are separated into brightness composition and aberration composition respectively;
Brightness component-part diagram picture synthesizes portion, it is with the ratio of the either party in the brightness composition of the brightness composition of the view data that adds based on described pixel and described all pixel image datas, the add brightness composition of view data and the brightness composition of described all pixel image datas of described pixel is weighted on average, generates synthetic luminance picture data; And
The brightness aberration synthesizes portion, the add aberration composition of view data of its synthetic described synthetic luminance picture data and described pixel, thereby synthetic coloured image.
2. camera head according to claim 1, it is characterized in that, the synthetic portion of described brightness component-part diagram picture generates described synthetic luminance picture data thus adding the weighted average of pixel value of the corresponding pixel of the brightness composition of the brightness composition of view data and described all pixel image datas as the pixel value of pixel corresponding in the described synthetic luminance picture data with described pixel respectively.
3. camera head according to claim 2, it is characterized in that, the synthetic portion of described brightness component-part diagram picture compares the add pixel value and the luminance threshold of each pixel of the either party in the brightness composition of the brightness composition of view data and described all pixel image datas of described pixel, according to its comparative result, according to each pixel, change the weighted average ratio when obtaining described weighted average.
4. camera head according to claim 3 is characterized in that, the synthetic portion of described brightness component-part diagram picture compares the add pixel value and the described luminance threshold of each pixel of brightness composition of view data of described pixel.
5. according to claim 3 or 4 described camera heads, it is characterized in that described luminance threshold comprises that the pixel value of the pixel that is used for discerning described comparison belongs to the luminance threshold in which zone in low brightness area, luminance area and the high-brightness region,
The synthetic portion of described brightness component-part diagram picture carries out following processing: when the result of described comparison belongs to described low brightness area for the pixel value of described pixel, use has increased the add weighted average ratio of weight of brightness composition of view data of described pixel, obtain described weighted average, the result of described comparison belong to for the pixel value of described pixel described in during luminance area, use described pixel is added weighted average ratio that the brightness composition of view data equates with the weight of the brightness composition of described all pixel image datas, obtain described weighted average, when the result of described comparison belongs to described high-brightness region for the pixel value of described pixel, use has increased the weighted average ratio of weight of the brightness composition of described all pixel image datas, obtains described weighted average.
6. image processing method, this image processing method is handled the output from imaging apparatus, wherein, this imaging apparatus has the electric charge addition of adjacent a plurality of pixels and with add readout mode and read all pixel readout modes of the electric charge corresponding with all pixels of the pixel that it is read, described image processing method is characterised in that described image processing method is carried out following processing:
Carry out following action synchronously or continuously: drive described imaging apparatus and obtain the add action of view data and drive described imaging apparatus and the action of obtaining all pixel image datas of pixel with described all pixel readout modes with the described pixel readout mode that adds;
Add view data and described all pixel image datas of described pixel are separated into brightness composition and aberration composition respectively;
Ratio with the either party in the brightness composition of the brightness composition of the view data that adds based on described pixel and described all pixel image datas, the add brightness composition of view data and the brightness composition of described all pixel image datas of described pixel is weighted on average, generates synthetic luminance picture data; And
The add aberration composition of view data of synthetic described synthetic luminance picture data and described pixel, thereby synthetic coloured image.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2006-317399 | 2006-11-24 | ||
| JP2006317399 | 2006-11-24 | ||
| JP2006317399A JP2008131580A (en) | 2006-11-24 | 2006-11-24 | Imaging apparatus, and image processing method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101188773A CN101188773A (en) | 2008-05-28 |
| CN101188773B true CN101188773B (en) | 2010-10-20 |
Family
ID=39480918
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2007101675589A Expired - Fee Related CN101188773B (en) | 2006-11-24 | 2007-10-26 | Camera and image processing method |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP2008131580A (en) |
| CN (1) | CN101188773B (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011086901A1 (en) * | 2010-01-13 | 2011-07-21 | 株式会社ニコンシステム | Image processing device, image capture device, and image processing program |
| JP5136664B2 (en) * | 2010-07-09 | 2013-02-06 | カシオ計算機株式会社 | Image processing apparatus and program |
| JP2012222742A (en) * | 2011-04-13 | 2012-11-12 | Sony Corp | Imaging element and imaging apparatus |
| US9501846B2 (en) | 2013-01-21 | 2016-11-22 | Kowa Company, Ltd. | Image processing device, image processing method, image processing program, and recording medium storing said program for producing noise-eliminated image |
| CN103986922B (en) * | 2013-02-07 | 2016-03-02 | 聚晶半导体股份有限公司 | Image processing method |
| CN105704363B (en) * | 2014-11-28 | 2020-12-29 | 广东中星微电子有限公司 | Image data processing method and device |
| CN104902143B (en) * | 2015-05-21 | 2018-01-19 | 广东欧珀移动通信有限公司 | A kind of image de-noising method and device based on resolution ratio |
| CN105007422B (en) * | 2015-07-14 | 2018-01-23 | 广东欧珀移动通信有限公司 | A kind of phase focusing method and user terminal |
| WO2017042854A1 (en) | 2015-09-07 | 2017-03-16 | オリンパス株式会社 | Image processing device and image processing method |
| EP3451651B1 (en) | 2016-04-27 | 2022-06-08 | Sony Group Corporation | Imaging control device, imaging control method, and imaging apparatus |
| CN111639588A (en) * | 2020-05-28 | 2020-09-08 | 深圳壹账通智能科技有限公司 | Image effect adjusting method, device, computer system and readable storage medium |
| CN111666409B (en) * | 2020-05-28 | 2022-02-08 | 武汉大学 | Integrated emotion intelligent classification method for complex comment text based on comprehensive deep capsule network |
| KR20220156242A (en) * | 2021-05-18 | 2022-11-25 | 에스케이하이닉스 주식회사 | Image Processing Device |
-
2006
- 2006-11-24 JP JP2006317399A patent/JP2008131580A/en active Pending
-
2007
- 2007-10-26 CN CN2007101675589A patent/CN101188773B/en not_active Expired - Fee Related
Non-Patent Citations (3)
| Title |
|---|
| JP特开2000-175046A 2000.06.23 |
| JP特开2005-303519A 2005.10.27 |
| JP特开平7-131796A 1995.05.19 |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2008131580A (en) | 2008-06-05 |
| CN101188773A (en) | 2008-05-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101188773B (en) | Camera and image processing method | |
| JP4742242B2 (en) | Imaging apparatus and program thereof | |
| US8290356B2 (en) | Imaging device with image blurring reduction function | |
| US7379094B2 (en) | Electronic still imaging apparatus and method having function for acquiring synthesis image having wide-dynamic range | |
| US8305465B2 (en) | Image pick-up apparatus with a shake reducing function | |
| US9906716B2 (en) | Image pickup apparatus, image pickup method, and recording medium for controlling pixel shifts | |
| JP4518157B2 (en) | Imaging apparatus and program thereof | |
| JP4548156B2 (en) | Camera device and automatic focus control method of camera device | |
| US7830447B2 (en) | Imaging apparatus including a plurality of image pickup elements | |
| US8040379B2 (en) | Imaging apparatus and recording medium | |
| JP2007163561A (en) | Imaging apparatus and its program | |
| US20090021590A1 (en) | Moving image playback device with camera-shake correction function | |
| JP2002152582A (en) | Electronic camera and recording medium for displaying image | |
| US8253850B2 (en) | Imaging apparatus and program thereof | |
| JP4556195B2 (en) | Imaging device, moving image playback device, and program | |
| JP4748375B2 (en) | IMAGING DEVICE, IMAGE REPRODUCING DEVICE, AND PROGRAM THEREOF | |
| JP4379921B2 (en) | Imaging apparatus and program thereof | |
| JP4534250B2 (en) | Movie imaging apparatus and program thereof | |
| JP2003189193A (en) | Image pickup device | |
| US20090225182A1 (en) | Image shooting device and image shooting method | |
| JP5126285B2 (en) | Imaging apparatus and program thereof | |
| JP4887733B2 (en) | Imaging apparatus, imaging method, and program | |
| JP2008124793A (en) | Imaging apparatus, and imaging method | |
| JP2006186796A (en) | Photographic apparatus, photographing method, and photographing program | |
| JP2010183601A (en) | Image capturing apparatus and its program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20151210 Address after: Tokyo, Japan, Japan Patentee after: Olympus Corporation Address before: Tokyo, Japan Patentee before: Olympus Imaging Corp. |
|
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20101020 Termination date: 20191026 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |