CN107197168A - The image capturing system of image-pickup method and application this method - Google Patents
The image capturing system of image-pickup method and application this method Download PDFInfo
- Publication number
- CN107197168A CN107197168A CN201710402695.XA CN201710402695A CN107197168A CN 107197168 A CN107197168 A CN 107197168A CN 201710402695 A CN201710402695 A CN 201710402695A CN 107197168 A CN107197168 A CN 107197168A
- Authority
- CN
- China
- Prior art keywords
- image
- dsp processor
- imaging sensor
- video
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 21
- 238000003384 imaging method Methods 0.000 claims abstract description 126
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 8
- 238000012545 processing Methods 0.000 claims description 60
- 230000015572 biosynthetic process Effects 0.000 claims description 39
- 238000003786 synthesis reaction Methods 0.000 claims description 39
- 230000009977 dual effect Effects 0.000 claims description 17
- 230000005540 biological transmission Effects 0.000 claims description 14
- 230000004044 response Effects 0.000 claims description 11
- 238000004088 simulation Methods 0.000 claims description 10
- 230000003321 amplification Effects 0.000 claims description 5
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 5
- 238000005314 correlation function Methods 0.000 claims description 2
- 230000036244 malformation Effects 0.000 claims 2
- 230000003287 optical effect Effects 0.000 abstract description 10
- 230000010354 integration Effects 0.000 abstract description 5
- 238000005286 illumination Methods 0.000 abstract description 3
- 235000019800 disodium phosphate Nutrition 0.000 description 111
- 230000000694 effects Effects 0.000 description 7
- 230000002159 abnormal effect Effects 0.000 description 4
- 230000009467 reduction Effects 0.000 description 4
- 239000003086 colorant Substances 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012958 reprocessing Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Cameras In General (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The present invention relates to a kind of image-pickup method and the image capturing system of application this method, it uses a camera lens to carry out IMAQ, and the image that an image is divided into two equivalent brightness is respectively transmitted to by two imaging sensors by optical prism, the image collected to two imaging sensors carries out bright dark two kinds different controls and image procossing respectively, image procossing is carried out using Video DSP processor, finally synthesizing DSP by image carries out image integration output.Solve image it is bright it is dark to it is stronger when and illumination it is not enough when image procossing problem, distance when it also avoid gathering image using two camera lenses between camera lens causes the problem of two gathered images influence each other.
Description
Technical field
It is used for video camera the present invention relates to one kind（Including monitoring camera, family expenses are hand-held and professional video recording video camera）
Light processing and quick follow shot solution, take this scheme, be addressed image it is bright it is dark to it is stronger when and illumination not
The technical task of streaking when sufficient.
Background technology
Existing video camera is when shooting, and when subject comparison of light and shade is larger, bright portion occurs in the image of shooting
Divide over-exposed, and dark part is then under-exposed, image is not seen Chu；Or during night shooting, if the lifting time for exposure
The problems such as mobile object streaking can be caused.There are two kinds to solve the technology or product of such problem in the market,
（One）Using the mobile phone productses of double sensor sensors, a sensor sensor is used to gather colour picture, another
Sensor sensors are used to improve sensitivity collection black white image, are passed through the bad image section of color effect by later stage synthesis
The highlight effect of black and white is compensated.（Two）To improve the product that image effect uses three sensor, the product uses three
Collection picture by special prismatic spectrum, is divided into three kinds of basic colors of red, green, blue, synthesized by the later stage by sensor respectively
Output image, improves the true effect of image afterwards.It is high to there is product cost in above solution, product processes require it is high with
And if one of sensor damage after if it is very big to whole image influential effect the problems such as.
The content of the invention
In the above prior art, a video camera can not take into account bright dark two kinds of simultaneous scenes, because when raising
Simultaneously, the brightness of highlights image is also enhanced dark portion brightness of image, causes highlights image exposure excessively, otherwise reduction brightness can be led
Cause dark portion image darker.In view of above-mentioned existing issue, the purpose of the present invention is to be that offer one kind can not be by scene light and shade shadow
Ring, a use of video camera is that can shoot the image capture method and device of monitored object image exactly.
Realize that the technical scheme of the object of the invention is as described below：
A kind of image-pickup method, it is characterised in that：Methods described includes：
—（1）IMAQ is carried out to reference object, and the image of the collection is divided into two is transferred to the first image biography respectively
Sensor（sensor）With the second imaging sensor（sensor）；
—（2）First imaging sensor and the second imaging sensor are obtained after picture signal respectively, by first image sensing
The long exposure image of device processing（Compared with highlights partial image in picture）, to suppressing in picture compared with bright part, reach this compared with bright part
It is high-visible and will not be over-exposed；Short exposed images are handled by second imaging sensor（Dark parts of images in picture）,
Brightness of image compared with dark-part is lifted, so that reach can also be high-visible compared with dark-part；
—（3）The image transmitting of two kinds of different exposures after above-mentioned first imaging sensor and the processing of the second imaging sensor is arrived
In image synthesis DSP Processor, DSP Processor is synthesized by the image and is synthesized two kinds of images, by the first image sensing
Expose abnormal in device or the second imaging sensor collection image（It is such as over or under）Part is replaced by two image sensings
No matter the normal parts of images of exposure collected in device, the bright dark gap of image is taken again by the image for handling output
Greatly, clearly output image can be obtained；
—（4）The signal for synthesizing DSP Processor output from above-mentioned image enters YC processor YC-MIX, by amplification,
Brightness, final output after colourity processing.
The signal of above-mentioned YC processor YC-MIX outputs, by netting twine, the transmission means such as BNC carries out image biography
It is defeated, by computer, display, television set etc. is by image restoring.
Further aspect of the present invention is：Above-mentioned steps（2）In the first imaging sensor and the second imaging sensor point
Huo get not be after picture signal, image transmitting after first imaging sensor collection to the long frame of the first Video DSP processor processing
Signal（Long exposure image）, to suppressing compared with bright part, mainly it can be seen that strong light hypograph, dark place image is almost complete
It is black；Image transmitting after second imaging sensor collection handles short frame signal to the second Video DSP processor（Short exposure figure
Picture）, to being lifted compared with dark-part, mainly it can be seen that signal is almost complete white under dark place image, strong light, then respectively by the
Picture signal after one Video DSP processor and the processing of the second Video DSP processor is transferred to described image synthesis DSP processing
Device, carries out step（3）.
Further, to obtain clearly integral image, above-mentioned steps（3）In, described image synthesis DSP Processor
The picture signal obtained from the first Video DSP processor and the output of the second Video DSP processor, by first Video DSP
Two signals of processor and the second Video DSP processor are overlapped, and carry out automatic growth control AGC, are exposed, blanking level,
Acutance, brightness response curve GAMMA, white balance, menu, after a series of processing such as aperture settings, at two brightness synthesis
Signal output after reason is good carries out step to YC processor YC-MIX（4）.
Further aspect of the present invention is also resided in：Above-mentioned steps（2）In the first imaging sensor and the second imaging sensor
Obtain respectively after picture signal, the image after image and second imaging sensor collection after first imaging sensor collection
A double-core Video DSP processor is respectively transmitted to, long frame signal is handled by the dual core video DSP Processor respectively（Long exposure diagram
Picture）With short frame signal（Short exposed images）, reach that strong light hypograph and dark place image can be clear, then by the dual core video
Two picture signals after DSP Processor processing are transferred to described image synthesis DSP Processor, carry out above-mentioned steps（3）.
Further, to obtain clearly integral image, described image synthesis DSP Processor will be regarded from the described double-core
Two picture signals superposition that the output of frequency DSP Processor is obtained, carries out automatic growth control AGC, exposes, blanking level, acutance,
Brightness response curve GAMMA, white balance, menu after a series of processing such as aperture settings, handles two brightness synthesis well it
Signal output afterwards carries out step to YC processor YC-MIX（4）.
Further aspect of the present invention is：When described first image sensor or the second imaging sensor are simulation drawings
As sensor（CCD）When, first imaging sensor or the second imaging sensor are obtained after picture signal respectively, the picture signal
For analog electrical signal, the analog electrical signal must be transferred to after video simulation FEP AFE is amplified processing and be converted to
After data signal, then the digital data transmission is above-mentioned to the first Video DSP processor or the progress of the second Video DSP processor
Step（2）Processing.
Likewise, when described first image sensor or the second imaging sensor are analog image sensors（CCD）When,
First imaging sensor or the second imaging sensor are obtained after picture signal respectively, and the picture signal is analog electrical signal, palpus
The analog electrical signal is transferred to after video simulation FEP AFE is amplified processing and is converted to after data signal, then will
The digital data transmission carries out above-mentioned steps to dual core video DSP Processor（2）Processing.
The image of the described reference object collected is divided into two as two equivalent brightness by optical spectroscopic prism
Image is transferred to the first imaging sensor sensor and the second imaging sensor sensor respectively.
The image-pickup method that the present invention is provided, IMAQ is carried out using camera lens, it is to avoid between two camera lenses
Distance can cause two gathered image shifts.Image is gathered in a camera lens without producing two images in order to realize
Skew, employ optical prism or refraction mirror carry out light splitting, an image is divided into the image of two equivalent brightness, respectively
It is transferred to two sensor and carries out IMAQ.The image collected to two sensor carries out bright dark two kinds different controls respectively
And image procossing, image procossing can be carried out respectively using two Video DSPs, or two-way image is believed using a double-nuclear DSP
Number handle respectively, finally synthesizing DSP by image carries out image integration output.In addition, to obtain clearly integral image, two figures
As the Video DSP processor of sensor can wait progress to control progress defeated respectively the AGC in collection image, time for exposure, brightness
Go out, solve two kinds of interactional problems of image of back-end processing.
Present invention simultaneously provides a kind of image capturing system, it is characterised in that：The system includes：
- image-pickup device, for IMAQ, including camera lens；
- light-dividing device, the piece image for above-mentioned image-pickup device to be gathered is divided into two identical images, and respectively
It is transferred to two imaging sensors；
- two imaging sensors, for gathering identical image respectively；
- at least one Video DSP processor, for handling the image that above-mentioned imaging sensor is gathered；
- image synthesizes DSP Processor, and two picture signals for above-mentioned Video DSP processor to be treated are synthesized simultaneously
And output, and the correlation function such as menu setting also synthesizes DSP Processor by the image and is controlled.
Image capturing system of the present invention is further characterized in that：The system has the first Video DSP processor and the
Two Video DSP processors are used to handle the image that described image sensor is gathered, and divide in described two imaging sensors
Huo get not be after picture signal, the picture transmission of one of imaging sensor collection to the long frame of the first Video DSP processor processing
Signal（Long exposure image）, to suppressing compared with bright part, mainly it can be seen that strong light hypograph, dark place image is almost complete
It is black；The image transmitting of another imaging sensor collection handles short frame signal to the second Video DSP processor（Short exposed images）,
To being lifted compared with dark-part, mainly it can be seen that signal is almost complete white under dark place image, strong light, then first is regarded respectively
Picture signal after frequency DSP Processor and the processing of the second Video DSP processor is transferred to described image synthesis DSP Processor,
DSP Processor is synthesized by the image to be synthesized two kinds of images, and one of imaging sensor is gathered in image and exposed
It is abnormal（It is such as over or under）Part is replaced by the normal parts of images of the exposure collected in another imaging sensor,
It is big again by the image bright dark gap of image that no matter is taken for handling output, clearly output image can be obtained.
It is preferable to obtain clearly integral image, described image synthesizes DSP Processor from first video
The picture signal that DSP Processor and the output of the second Video DSP processor are obtained, the first Video DSP processor and second are regarded
Two signals of frequency DSP Processor are overlapped, and carry out automatic growth control AGC, and exposure, blanking level, acutance, luminosity response is bent
Line GAMMA, white balance, menu, after a series of processing such as aperture settings, the signal after two brightness synthesis are handled well is defeated
Go out.
Image capturing system further feature of the present invention is also resided in：The system has a double-core Video DSP processor
For handling the image that described two imaging sensors are gathered, image letter is obtained in described two imaging sensors respectively
After number, the image of two imaging sensor collections is respectively transmitted to the dual core video DSP Processor, by dual core video DSP
Processor handles long frame signal respectively（Long exposure image）With short frame signal（Short exposed images）, then it is respectively outputted to image synthesis
DSP Processor, synthesizes DSP Processor by the image and is synthesized two kinds of images, one of imaging sensor is gathered
Exposed in image abnormal（It is such as over or under）Part is replaced by the exposure that another imaging sensor collects and normally should
Parts of images, it is big again by the image bright dark gap of image that no matter is taken for handling output, clearly output figure can be obtained
Picture, reaches that strong light hypograph and dark place image can be clear.
Likewise, to obtain clearly integral image, described image synthesis DSP Processor will be from the described dual core video
Two picture signals superposition that DSP Processor output is obtained, carries out automatic growth control AGC, and exposure, blanking level, acutance is bright
Spend response curve GAMMA, white balance, menu, after a series of processing such as aperture settings, after two brightness synthesis are handled well
Signal output.
Described image acquisition system also includes YC processor YC-MIX, defeated from above-mentioned image synthesis DSP Processor
The signal gone out enters YC processor YC-MIX, by amplification, brightness, final output after colourity processing.
The signal of above-mentioned YC processor YC-MIX outputs, by netting twine, the transmission means such as BNC carries out image biography
It is defeated, by computer, display, television set etc. is by image restoring.
Described light-dividing device is optical spectroscopic prism.
Described imaging sensor includes analog image sensor（CCD）Or digital image sensor（CMOS）Deng.
When described image sensor is analog image sensor（CCD）When, the imaging sensor is obtained after picture signal, should
Picture signal is analog electrical signal, and the analog electrical signal must be transferred to video simulation FEP AFE and be amplified processing
After be converted to after data signal, then by the digital data transmission give Video DSP processor carry out image signal processing.
Image capturing system of the present invention is using two imaging sensor sensor（The sensor such as CCD or CMOS）Pass through rib
The bright dark picture signal of collection is obtained after mirror light splitting, DSP Processor is synthesized by Video DSP processor and image, by two width pictures
Synthesized, final to carry out image output, night-time scene is, by sensor time for exposure increase, to improve the bright of night
Degree, another sensor reduces the time for exposure, reduces the smear of mobile object, reaches two kinds of bright dark larger IMAQ phases of gap
Mutually unaffected, by bright control, AGC, exposure etc. is controlled respectively so that picture is bright dark moderate, entirely by bat picture any
Can be clear under environment.
According to the method proposed by the present invention for gathering image respectively, handling different luminance pictures so that video camera is bright dark
Change very big occasion or environment complex light, or rapid moving object is shot can accurately catch subject.
In addition, because two sensor images are controlled respectively, when night, brightness was not high, two sensor enter respectively
The long short exposure of row and AGC lifting reductions, the long exposure-processed that one of sensor is responsible for rest image improve night brightness, separately
One sensor is responsible for the conditions of streaking of short exposure processing reduction mobile object.It is final to carry out image integration, finally solve and take the photograph
Camera is in below 0Lx environment, the problem of not seeing subject and mobile object smear.
Brief description of the drawings
Fig. 1 is IMAQ flow chart of the embodiment of the present invention；
Fig. 2 is the image capturing system structural representation in the present embodiment；
Fig. 3 a are the images exported after the first imaging sensor short exposure, and Fig. 3 b are exported after the exposure of the second imaging sensor length
Image, Fig. 3 c are the images exported after two kinds of scenes of Fig. 3 a and Fig. 3 b are integrated through the embodiment of the present invention；
Fig. 4 is image integration flow chart of the embodiment of the present invention.
Fig. 5 is invention software design flow diagram.
Wherein：1- camera lens, 2- CCTV cameras, 3- optical spectroscopic prisms, the imaging sensors of 4- first, 5- controls
Substrate, the imaging sensors of 6- second.
Embodiment
To enable your auditor and the public to further appreciate that the feature and its advantage of the present invention, spy is with embodiment to this
The embodiment of invention is described in detail as follows：
The present invention is that to shoot bright dark contrast in video camera very big, or drawing shot is very bright and wants to see clearly the one of object
Individual solution, the present embodiment is applied equally to the shooting of other forms by taking double CCD simulation monitoring video camera 2 as an example
Machine, is gathered bright dark image by the reflection of prism respectively, and can be automatically adjusted by back-end processing it is bright dark,
And manually adjust dark part and cross the over-exposed part of bright part and reduced.Reach and want observation part not by outer boundary
It is processed to be monitored and watched.By after DSP processing by it is bright it is dark it is poor be reduced to it is minimum.
As shown in figure 1, the image-pickup method that the present embodiment is provided, including：
（1）IMAQ is carried out to reference object, and the image of the collection is divided into two is transferred to the first image sensing respectively
Device and the second imaging sensor.
（2）First imaging sensor and the second imaging sensor are obtained after the picture signal of transmission respectively, by this first
The long exposure image of imaging sensor processing（I.e. compared with highlights partial image in picture）, to suppressing in picture compared with bright part, reach
This is high-visible compared with bright part and will not be over-exposed；Short exposed images are handled by second imaging sensor（I.e. in picture compared with
Dark portion partial image）, the brightness of image compared with dark-part is lifted, so that reach can also be high-visible compared with dark-part.
（3）By the image transmitting of two kinds of different exposures after above-mentioned first imaging sensor and the processing of the second imaging sensor
Into image synthesis DSP Processor, DSP Processor is synthesized by the image and is synthesized two kinds of images, the first image is passed
Expose abnormal in sensor or the second imaging sensor collection image（It is such as over or under）Part is replaced by two images and passed
No matter the normal parts of images of exposure collected in sensor, the bright dark gap of image is taken again by the image for handling output
Greatly, clearly output image can be obtained.
（4）The signal for synthesizing DSP Processor output from above-mentioned image enters YC processor YC-MIX, by putting
Greatly, brightness, final output output digit signals or vision signal after colourity processing.
The signal of above-mentioned YC processor YC-MIX outputs, by netting twine, the transmission means such as BNC carries out image biography
It is defeated, by computer, display, television set etc. is by image restoring.
It is a kind of image capturing system based on above-mentioned image-pickup method shown in Fig. 2, the system includes：
- camera lens 1, the image-pickup device of size and image-capture field adjustment as IMAQ and image；
- light-dividing device, the piece image for above-mentioned image-pickup device to be gathered is divided into two identical images, and respectively
It is transferred in two imaging sensors, the present embodiment and uses optical spectroscopic prism 3, the identical image refers to that two images are equal
Brightness；
- the first imaging sensor 4 and the second imaging sensor 6, are respectively used to after above-mentioned light-dividing device collection image, respectively
It is transmitted to the first Video DSP processor and the second Video DSP processor.
- the first Video DSP processor and the 2nd DSP video processors, are respectively used to above-mentioned first imaging sensor 4
The image gathered with the second imaging sensor 6 is handled, and is such as exposed, shutter, gain, image noise reduction, luminance compensation etc..
- image synthesizes DSP Processor, for by above-mentioned first Video DSP processor and the 2nd DSP video processors
Two picture signals managed are synthesized and exported, and the phase such as the menu setting of each function of video camera and parameter adjustment etc.
Pass function also synthesizes DSP Processor by the image and is controlled.
The object and scene that image will be shot by camera lens 1 are acquired, and collection signal is transferred into optics
Amici prism 3, the picture signal that optical spectroscopic prism 3 is collected is divided into two brightness identical images and passed respectively again
The first imaging sensor 4 and the second imaging sensor 6 are defeated by, the first imaging sensor 4 and the second imaging sensor 6 are obtained respectively
After the picture signal that optical spectroscopic prism 3 is transmitted, at the image transmitting that first imaging sensor 4 is gathered to the first Video DSP
Manage device and handle long frame signal（Long exposure image）, to suppressing compared with bright part, mainly it can be seen that strong light hypograph, dark place
Image is almost completely black；The image transmitting of second imaging sensor 6 collection handles short frame signal to the second Video DSP processor
（Short exposed images）, to being lifted compared with dark-part, mainly it can be seen that signal is almost complete white under dark place image, strong light, so
The picture signal after the first Video DSP processor and the processing of the second Video DSP processor is transferred to described image respectively afterwards
DSP Processor is synthesized, DSP Processor is synthesized by the image and is synthesized two kinds of images, the second imaging sensor 6 is gathered
Over-exposed part is replaced by normal parts of images of exposure that the first imaging sensor 4 is collected in image, likewise, will
Under-exposed part is replaced by the exposure that the second imaging sensor collects and normally should in first imaging sensor 4 collection image
Parts of images, it is big again by the image bright dark gap of image that no matter is taken for handling output, clearly output figure can be obtained
Picture.
It is preferable to obtain clearly integral image, described image synthesizes DSP Processor from first video
The picture signal that DSP Processor and the output of the second Video DSP processor are obtained, the first Video DSP processor and second are regarded
Two signals of frequency DSP Processor are overlapped, and carry out automatic growth control AGC, and exposure, blanking level, acutance, luminosity response is bent
Line GAMMA, white balance, menu, after a series of processing such as aperture settings, the signal after two brightness synthesis are handled well is defeated
Go out.
The above the first Video DSP processor and the second Video DSP processor can also use the Video DSP of a built-in double-core
Processor is replaced, and realizes that two paths of signals is inputted simultaneously using a Video DSP processor.First imaging sensor 4 and the second figure
Picture sensor 6 is obtained after the image signal transmission of optical spectroscopic prism 3 respectively, the image sensing of the first imaging sensor 4 and second
The image that device 6 is gathered is respectively transmitted to the dual core video DSP Processor, and long frame is handled respectively by the dual core video DSP Processor
Signal（Long exposure image）With short frame signal（Short exposed images）, then image synthesis DSP Processor is respectively outputted to, by the image
Synthesis DSP Processor is synthesized two kinds of images, wherein will gather over-exposed part in image by the second imaging sensor 6
Normal parts of images of exposure that the first imaging sensor 4 is collected is replaced by, likewise, the first imaging sensor 4 is adopted
Under-exposed part is replaced by normal parts of images of exposure that the second imaging sensor is collected in collection image, passes through processing
The image of the output bright dark gap of image that no matter is taken is big again, can obtain clearly output image, reach strong light hypograph
Can be clear with dark place image.
Likewise, to obtain clearly integral image, described image synthesis DSP Processor will be from the described dual core video
Two picture signals superposition that DSP Processor output is obtained, carries out automatic growth control AGC, and exposure, blanking level, acutance is bright
Spend response curve GAMMA, white balance, menu, after a series of processing such as aperture settings, after two brightness synthesis are handled well
Signal output.
The present embodiment image capturing system also includes YC processor YC-MIX, and DSP processing is synthesized from above-mentioned image
The signal of device output enters YC processor YC-MIX, by amplification, brightness, final output after colourity processing.This is bright
The signal of chroma processor YC-MIX outputs is spent, by netting twine, the transmission means such as BNC carries out image transmitting, passes through computer, display
Device, television set etc. is by image restoring.
First imaging sensor 4 and the second imaging sensor can use analog image sensor（CCD）Or digital picture is passed
Sensor（CMOS）Deng.
When the first imaging sensor 4 and the second imaging sensor 6 use analog image sensor（CCD）When, this two figures
As sensor is obtained after picture signal, the bright signal for gathering image can be converted into analog electrical signal respectively.Then need to pass through
Video simulation FEP AFE is converted to data signal after the analog electrical signal received is amplified into processing respectively,
Again the first Video DSP processor and the second Video DSP processor are given by the digital data transmission（Or dual core video DSP Processor）
Carry out image signal processing.Then the picture signal after processing is transmitted further to image synthesis DSP Processor, carries out image conjunction
Into.And automatic growth control AGC is carried out, expose, blanking level, acutance, brightness response curve GAMMA, white balance etc. is a series of
Processing after, signal output after two brightness synthesis is handled well to YC processor YC-MIX.Eventually through electricity
Depending on machine, display, and computer etc. show video image.
If the first imaging sensor 4 and the second imaging sensor 6 use digital image sensor（CMOS）When, this two
Imaging sensor obtain picture signal after, can respectively by gather image bright signal be converted to digital electric signal, then without regarding
Frequency analog front end processor AFE, is directly respectively transmitted to the first Video DSP processor and the second Video DSP by the data signal
Processor（Or dual core video DSP Processor）.Then the picture signal after handling is transmitted further at image synthesis DSP
Device is managed, image synthesis is carried out.And automatic growth control AGC is carried out, expose, blanking level, acutance, brightness response curve GAMMA,
After a series of processing such as white balance, signal output after two brightness synthesis is handled well to YC processor YC-
MIX.Eventually through television set, display, and computer etc. show video image.
Each electronic component of above-mentioned the present embodiment system, e.g., electric power loop for the power supply of each device, first are regarded
It is frequency DSP Processor, the second Video DSP processor and image synthesis DSP Processor, video simulation FEP AFE, bright
Degree chroma processor YC-MIX etc. is arranged in control base board 5, and the control base board 5 is the pcb board with loop, by controlling base
Each component is connected by the loop on plate 5.The control base board 5 and camera lens 1 etc. are fixed on the fuselage of CCTV camera 2
On.
The following is the present embodiment image acquisition and processing flow：
The image for entering the first imaging sensor 4 and the second imaging sensor 6 by the image pickup of optical spectroscopic prism 3 is adopted
Collection, analog electrical signal is converted to by the luminance signal of image by the image brightness signal respectively by ccd image sensor, and will
The analog electrical signal, which is transferred to AFE and is amplified processing, is converted to data signal.Or use cmos image sensor directly will
The image brightness signal of collection is converted to data signal.Data signal is transferred to corresponding Video DSP processor respectively.
Wherein the first Video DSP processor is the long frame signal of processing, mainly it can be seen that strong light hypograph, dark place image
Almost completely black, the second Video DSP processor is the short frame signal of processing, mainly it can be seen that signal is several under dark place image, strong light
It is complete white, by AGC, expose, blanking level, acutance, GAMMA, a series of processing such as white balance, two Video DSPs processing
Device signal is transferred to image synthesis DSP Processor, and two signals are overlapped by image synthesis DSP Processor, then by closing
Into rear AGC, expose, acutance, the signal integrated after handling well is prepared output by the reprocessing such as white balance.
The signal for synthesizing DSP Processor output from image enters YC-MIX processors, by amplification, brightness, colourity processing
Final output afterwards.
The signal of output, by netting twine, the transmission means such as BNC carries out image transmitting, passes through computer, display, television set
Deng by image restoring.
Illustrate the simulation effect of the present invention respectively with Fig. 3 a, Fig. 3 b, Fig. 3 c below：
Fig. 3 a are the images that the first imaging sensor 4 is exported by the first video processor DSP, as can be seen that room from Fig. 3 a
Between with window, due to being that people outside short exposure, window can be with high-visible, but personnel can not see clearly in room.
Fig. 3 b are the images that the second imaging sensor 6 is exported by the second video processor DSP, be can be seen that from Fig. 3 b
Due to being long exposure, within doors dark groups of people see it is clear that but be due to long exposure cause outdoor exposure excessively, it is outdoor
Image turns white, it is impossible to see clearly.
It is to be integrated two kinds of scenes of Fig. 3 a and Fig. 3 b shown in Fig. 3 c, i.e., by synthesizing DSP Processor by two images
In bright dark-part be integrated into a picture, eventually through computer, the display output such as display, whole image shows indoor and outdoors
Portrait it is clear and legible, exposure appropriateness.
The image integration flow of the present invention can be by illustrating shown in Fig. 4.The bright dark picture of two differences above and below Fig. 4 left sides
The example images that two imaging sensors are each collected are represented respectively, and an imaging sensor collects the bright place of image very
It is clear（Such as scene outdoors in Fig. 4 the picture left above）, the imaging sensor is mainly under outdoor or strong backlight state, it is impossible to see clearly
Part carries out IMAQ；Another imaging sensor collects image dark place place and is apparent from（Such as field within doors in the figure of Fig. 4 lower-lefts
Scape）, the imaging sensor is mainly for dark place, under illumination very low state, it is impossible to which the part seen clearly carries out IMAQ.Collect
Two images luminance picture calibration is carried out to clear zone in Video DSP processor respectively so that over-exposed image can be with
It is clear that or the image of dark place is subjected to luminance raising, reach the degree for the dark place image that can be seen clearly, for intermediate light and
The part of medium darkness, carries out small size lifting or suppression, then carry out two images by image synthesis DSP Processor respectively
Synthesis, the video of final output reach it is inside and outside take into account, the purpose that highlighted and dark place image can be seen, such as Fig. 4 is right
Shown in figure.
Fig. 5 designs the flow chart to image procossing for invention software, and software processing flow of the invention is prismatic decomposition
It is acquired respectively by two imaging sensors afterwards.
1）The scanner uni for carrying out entire image after collection in two Video DSP processors respectively calculates entire image
Average brightness value.
2）Entire image is averagely divided into 48 pieces with software, each piece of brightness value is calculated respectively, after calculating
Phase carries out brightness adjustment.
3）Entire image is compared with mean flow rate, filtered out brighter（Or it is dark）And it is highlighted（Dark space）Part.
4）Filter out highlighted mark coordinate i；Very dark space mark coordinate j, so that subsequent correction is distinguished.
5）Brightness response curve GAMMA amendment is carried out to intermediate light and highlight regions.
6）Length and width to image coordinate are modified, and prevent from having influence on actual effect in processing.
7）The color and weight summation that RGB (red, green, blue three primary colours) is carried out to being divided into 48 each blocks are counted.
8）The color summation counted is modified, and present intensity is calculated according to the image after adjustment.
9）For the brightness value that adjusts out whether in the range of object brightness.The carry out gain A GC for not reaching scope enters
Row brightness is adjusted again.
10）Image after adjustment carries out image output as the image of next frame.
Claims (10)
1. a kind of image-pickup method, it is characterised in that：Methods described includes：
（1）IMAQ is carried out to reference object, and the image of the collection is divided into two is transferred to the first image sensing respectively
Device and the second imaging sensor；
（2）First imaging sensor and the second imaging sensor are obtained after picture signal respectively, by first imaging sensor
Long exposure image is handled, to suppressing in picture compared with bright part, reaches that this is high-visible compared with bright part and will not be over-exposed；
Short exposed images are handled by second imaging sensor, the brightness of image compared with dark-part lifted, to reach compared with dark-part
Can also be high-visible；
（3）By the image transmitting of two kinds of different exposures after above-mentioned first imaging sensor and the processing of the second imaging sensor to figure
As in synthesis DSP Processor, synthesizing DSP Processor by the image and being synthesized two kinds of images, by the first imaging sensor
Or second imaging sensor collection image in exposure malformation be replaced by the exposure collected in two imaging sensors
The normal parts of images, it is big again by handling the image of the output bright dark gap of image that no matter is taken, it can obtain clear
Output image；
（4）The signal for synthesizing DSP Processor output from above-mentioned image enters YC processor YC-MIX, bright by amplification
Degree, final output after colourity processing.
2. image-pickup method according to claim 1, it is characterised in that：Abovementioned steps（2）In the first imaging sensor
Obtained respectively after picture signal with the second imaging sensor, the image transmitting after first imaging sensor collection to the first video
The long frame signal of DSP Processor processing, to suppressing compared with bright part, mainly it can be seen that strong light hypograph, dark place image is several
It is completely black；Image transmitting after second imaging sensor collection is to the short frame signal of the second Video DSP processor processing, to dark
Part is lifted, mainly it can be seen that signal is almost complete white under dark place image, strong light, then respectively by the first Video DSP
Picture signal after processor and the processing of the second Video DSP processor is transferred to described image synthesis DSP Processor, is walked
Suddenly（3）.
3. image-pickup method according to claim 1, it is characterised in that：To obtain clearly integral image, foregoing step
Suddenly（3）In, described image synthesizes DSP Processor and exported from the first Video DSP processor and the second Video DSP processor
Obtained picture signal, two signals of the first Video DSP processor and the second Video DSP processor are overlapped, and are carried out
Automatic growth control AGC, exposes, blanking level, acutance, brightness response curve GAMMA, white balance, menu, aperture settings etc. one
After the processing of series, the signal output after two brightness synthesis are handled well carries out step to YC processor（4）.
4. image-pickup method according to claim 1, it is characterised in that：Abovementioned steps（2）In the first imaging sensor
Obtained respectively after picture signal with the second imaging sensor, the image and second image after first imaging sensor collection are passed
Image after sensor collection is respectively transmitted to a double-core Video DSP processor, and length is handled respectively by the dual core video DSP Processor
Frame signal and short frame signal, reach that strong light hypograph and dark place image can be clear, then by the dual core video DSP Processor
Two picture signals after reason are transferred to described image synthesis DSP Processor, carry out above-mentioned steps（3）.
5. image-pickup method according to claim 4, it is characterised in that：Described image synthesis DSP Processor will be from
Two picture signals superposition that the dual core video DSP Processor output is obtained, carries out automatic growth control AGC, and exposure disappears
After aperture settings processing, two brightness synthesis are handled well for hidden level, acutance, brightness response curve GAMMA, white balance, menu
Signal output afterwards carries out step to YC processor（4）.
6. image-pickup method according to claim 1, it is characterised in that：When described first image sensor or second
When imaging sensor is analog image sensor, first imaging sensor or the second imaging sensor obtain picture signal respectively
Afterwards, the picture signal is analog electrical signal, and the analog electrical signal must be transferred to video simulation FEP and be amplified place
Be converted to after reason after data signal, then the digital data transmission is handled to the first Video DSP processor or the second Video DSP
Device carries out above-mentioned steps（2）Processing；
When described first image sensor or the second imaging sensor are analog image sensors, first imaging sensor
Or second imaging sensor obtain respectively after picture signal, the picture signal be analog electrical signal, the analog electrical signal must be passed
It is defeated by after video simulation FEP AFE is amplified processing and is converted to after data signal, then the digital data transmission is given
Dual core video DSP Processor carries out above-mentioned steps（2）Processing.
7. a kind of image capturing system, it is characterised in that：The system includes：
- image-pickup device, for IMAQ, including camera lens；
- light-dividing device, the piece image for above-mentioned image-pickup device to be gathered is divided into two identical images, and respectively
It is transferred to two imaging sensors；
- two imaging sensors, for gathering identical image respectively；
- at least one Video DSP processor, for handling the image that above-mentioned imaging sensor is gathered；
- image synthesizes DSP Processor, and two picture signals for above-mentioned Video DSP processor to be treated are synthesized simultaneously
And output, and the correlation function such as menu setting also synthesizes DSP Processor by the image and is controlled.
8. a kind of image capturing system according to claim 7, it is characterised in that：The system has the first Video DSP
Processor and the second Video DSP processor are used to handle the image that described image sensor is gathered, described two images
Obtained respectively after picture signal in sensor, the picture transmission of one of imaging sensor collection is handled to the first Video DSP
The long frame signal of device processing, to suppressing compared with bright part, mainly it can be seen that strong light hypograph, dark place image is almost completely black；
The image transmitting of another imaging sensor collection is to the short frame signal of the second Video DSP processor processing, to being carried out compared with dark-part
Lifting, mainly it can be seen that signal is almost complete white under dark place image, strong light, then respectively by the first Video DSP processor and
Picture signal after the processing of second Video DSP processor is transferred to described image synthesis DSP Processor, is synthesized by the image
DSP Processor is synthesized two kinds of images, and one of imaging sensor is gathered in image and exposes malformation more
The normal parts of images of the exposure collected in another imaging sensor is changed to, no matter is clapped by the image for handling output
Take the photograph the bright dark gap of image big again, clearly output image can be obtained.
9. a kind of image capturing system according to claim 7, it is characterised in that：The system has a dual core video
DSP Processor is used to handle the image that described two imaging sensors are gathered, in described two imaging sensors respectively
Obtain after picture signal, the image of two imaging sensor collections is respectively transmitted to the dual core video DSP Processor, by this pair
Core Video DSP processor handles long frame signal and short frame signal respectively, then is respectively outputted to image synthesis DSP Processor, by this
Image synthesis DSP Processor is synthesized two kinds of images, and one of imaging sensor is gathered and exposed not just in image
Often partly be replaced by normal parts of images of exposure that another imaging sensor collects, by handle the image of output without
It is big again by the bright dark gap of the image that is taken, clearly output image can be obtained, reaches that strong light hypograph and dark place image are equal
Can be clear.
10. a kind of image capturing system according to claim 7, it is characterised in that：Described light-dividing device is optics point
Light prism.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710402695.XA CN107197168A (en) | 2017-06-01 | 2017-06-01 | The image capturing system of image-pickup method and application this method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710402695.XA CN107197168A (en) | 2017-06-01 | 2017-06-01 | The image capturing system of image-pickup method and application this method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107197168A true CN107197168A (en) | 2017-09-22 |
Family
ID=59876888
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710402695.XA Pending CN107197168A (en) | 2017-06-01 | 2017-06-01 | The image capturing system of image-pickup method and application this method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107197168A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107613183A (en) * | 2017-11-03 | 2018-01-19 | 成都野望数码科技有限公司 | A kind of application process of camera system and camera system |
| CN109005342A (en) * | 2018-08-06 | 2018-12-14 | Oppo广东移动通信有限公司 | Panorama shooting method, device and imaging device |
| CN109688317A (en) * | 2017-10-18 | 2019-04-26 | 杭州海康威视数字技术股份有限公司 | A kind of video camera and image generating method |
| WO2021184353A1 (en) * | 2020-03-20 | 2021-09-23 | 华为技术有限公司 | Camera device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101394487A (en) * | 2008-10-27 | 2009-03-25 | 华为技术有限公司 | Image synthesizing method and system |
| CN101465966A (en) * | 2007-12-18 | 2009-06-24 | 索尼株式会社 | Imaging apparatus, imaging processing method, and imaging control program |
| CN202424857U (en) * | 2011-12-22 | 2012-09-05 | 鼎创电子股份有限公司 | Double-lens camera shooting module capable of obtaining high-resolution image |
| CN102857681A (en) * | 2012-09-13 | 2013-01-02 | 侯大威 | Image acquisition method and image quality improving method by half-reflecting mirror |
| CN103780844A (en) * | 2013-12-30 | 2014-05-07 | 华中科技大学 | Time-sharing two-path image acquiring device and calibration method thereof |
| CN207939595U (en) * | 2017-06-01 | 2018-10-02 | 松下电器（中国）有限公司苏州系统网络研究开发分公司 | Image capturing system |
-
2017
- 2017-06-01 CN CN201710402695.XA patent/CN107197168A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101465966A (en) * | 2007-12-18 | 2009-06-24 | 索尼株式会社 | Imaging apparatus, imaging processing method, and imaging control program |
| CN101394487A (en) * | 2008-10-27 | 2009-03-25 | 华为技术有限公司 | Image synthesizing method and system |
| CN202424857U (en) * | 2011-12-22 | 2012-09-05 | 鼎创电子股份有限公司 | Double-lens camera shooting module capable of obtaining high-resolution image |
| CN102857681A (en) * | 2012-09-13 | 2013-01-02 | 侯大威 | Image acquisition method and image quality improving method by half-reflecting mirror |
| CN103780844A (en) * | 2013-12-30 | 2014-05-07 | 华中科技大学 | Time-sharing two-path image acquiring device and calibration method thereof |
| CN207939595U (en) * | 2017-06-01 | 2018-10-02 | 松下电器（中国）有限公司苏州系统网络研究开发分公司 | Image capturing system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109688317A (en) * | 2017-10-18 | 2019-04-26 | 杭州海康威视数字技术股份有限公司 | A kind of video camera and image generating method |
| CN107613183A (en) * | 2017-11-03 | 2018-01-19 | 成都野望数码科技有限公司 | A kind of application process of camera system and camera system |
| CN109005342A (en) * | 2018-08-06 | 2018-12-14 | Oppo广东移动通信有限公司 | Panorama shooting method, device and imaging device |
| WO2021184353A1 (en) * | 2020-03-20 | 2021-09-23 | 华为技术有限公司 | Camera device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2471258B1 (en) | Reducing noise in a color image | |
| US8018509B2 (en) | Image input processing apparatus and method | |
| US10339638B2 (en) | Image processing device, imaging device, image processing method, and image processing program | |
| US20180338092A1 (en) | Image signal processing method and system | |
| CN106101549B (en) | Automatic switching method, apparatus and system round the clock | |
| US20070242141A1 (en) | Adjustable neutral density filter system for dynamic range compression from scene to imaging sensor | |
| CN107197168A (en) | The image capturing system of image-pickup method and application this method | |
| WO2016088293A1 (en) | Imaging device, apparatus, and imaging method | |
| CN102783135A (en) | Method and apparatus for providing a high resolution image using low resolution | |
| KR20110125173A (en) | Imaging apparatus | |
| US9787915B2 (en) | Method and apparatus for multi-spectral imaging | |
| US8149294B2 (en) | Image capturing device which sets color conversion parameters based on an image sensor and separate light sensor | |
| CN108712608A (en) | Terminal device image pickup method and device | |
| KR101169017B1 (en) | Day and night auto switching type cctv camera using for high resolution cmos | |
| CN107995396B (en) | Two camera modules and terminal | |
| CN107835351B (en) | Two camera modules and terminal | |
| JP2018023077A (en) | Video camera imaging device | |
| Kumar et al. | New digital camera sensor architecture for low light imaging | |
| JP4752381B2 (en) | Imaging device | |
| CN207939595U (en) | Image capturing system | |
| CN108353123B (en) | Image capturing apparatus and control method thereof | |
| JP2002271803A (en) | Image photographing method and device | |
| JP2002185977A (en) | Video signal processor and recording medium with video signal processing program recorded thereon | |
| JP2004064468A (en) | Image pickup device | |
| KR101589493B1 (en) | White ballance control method and apparatus using a flash and digital photographing apparatus using thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170922 |