CN102096273B - Automatic exposure method of space camera based on target characteristics - Google Patents

Automatic exposure method of space camera based on target characteristics Download PDF

Info

Publication number
CN102096273B
CN102096273B CN201010622643.1A CN201010622643A CN102096273B CN 102096273 B CN102096273 B CN 102096273B CN 201010622643 A CN201010622643 A CN 201010622643A CN 102096273 B CN102096273 B CN 102096273B
Authority
CN
China
Prior art keywords
image
node
value
camera
multistage tree
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201010622643.1A
Other languages
Chinese (zh)
Other versions
CN102096273A (en
Inventor
张宏伟
黄长宁
陈彦
胡永富
林宏宇
李晨曦
吴雁林
李天�
黄昊
孟林智
朱军
温博
郭强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Space Research Mechanical and Electricity
Original Assignee
Beijing Institute of Space Research Mechanical and Electricity
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Space Research Mechanical and Electricity filed Critical Beijing Institute of Space Research Mechanical and Electricity
Priority to CN201010622643.1A priority Critical patent/CN102096273B/en
Publication of CN102096273A publication Critical patent/CN102096273A/en
Application granted granted Critical
Publication of CN102096273B publication Critical patent/CN102096273B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Studio Devices (AREA)

Abstract

The invention relates to an automatic exposure method of a space camera based on target characteristics, belonging to the technical field of aerospace optical remote sensors, in particular to an automatic exposure method applied in aerospace optical remote sensing CMOS (complementary metal oxide semiconductor) camera. The method provided by the invention comprises the following steps: carrying out noise-removing processing on image data generated by the camera, thus obtaining an image subjected to background noise removal so as to prepare for recognizing the target characteristics; then adopting a multilevel tree method to label the brightness information of a target in the image, thus obtaining the current brightness information of the target; and finally utilizing an exposure adjusting method to determine the exposure time of an image of the next frame of the space camera. According to the automatic exposure method of the space camera based on the target characteristics is adopted to recognize and extract the target information for carrying out automatic exposure adjustment, so that the adaptive ability of the camera when imaging is carried out in the space environment is improved.

Description

A kind of space camera automatic explosion method of based target characteristic
Technical field
The present invention relates to a kind of space camera automatic explosion method of based target characteristic, belong to spacer remote sensing device person in electronics.
Background technology
Small-sized low-power consumption face battle array CMOS camera has been widely used in satellite body mechanism, survey of deep space, space station and spaceborne video remote measurement; There have been activities such as it just can be opened Satellite Orbit Maneuver, change attitude, engine operation, the sun span, antenna expansion to keep watch on and assess; Judge on ground that for researcher the satellite working condition provides the image foundation, be successfully applied to a plurality of models.
When camera is worked at rail; Whether the time shutter is suitable extremely important, and too short meeting of time shutter causes scenery very dark, and the long scenery luminance saturation that can cause; Therefore the time shutter adjusting is essential; But the time shutter is regulated very complicated, regulates badly may be absorbed in the time shutter disorder dark situation when bright when occurring.Whether what therefore the time shutter was regulated is suitable, is vital to camera imaging, is related to the success or failure of task.
Present civilian digital camera is at the technical comparative maturity of automatic exposure, can set needed different exposure modes according to night scene, daytime, portrait etc., and effect is fine, if but be applied to space flight and just its limitation arranged.When camera is taken target object in the sky; Because the application characteristic of CMOS camera; Can't accurately foresee in advance shot object position, brightness, account for information such as image area size, and the scenery of many times mutually confidential shooting all can't reappear again, for once; Open such as the sun span; If pass image back and confirm again behind the ground to select what exposure mode and time shutter, missed right moment for camera, so confirm that in real time time shutter and exposure mode are the outstanding features that camera space is distinguished civilian camera.
At present; The method of space optical remote camera adjustments exposure is also few; Large-scale remote sensing of the earth camera is because the determinacy of its terrain object; Can use spoke Luminance Analysis software, camera optics and sensor chip characteristic to draw the accurate time shutter, only need to switch according to several grades of time shutter of different set of ground scenery.The stepping exposure method can not solve the needs of CMOS camera to the real-time automatic exposure of scenery equally, can reduce the one-tenth scape rate of camera, and a few width of cloth images possibly have only one can use.
The domestic automatic explosion method that is applied to space flight CMOS camera at present can't be discerned effective target owing to camera; When in the visual field during scenery relative complex; Can't distinguish exposure; It is big disturbed by noise and non-effective target, makes that object scene brightness is difficult in the suitable scope in the image, has increased the automatic exposure difficulty.
Summary of the invention
Technology of the present invention is dealt with problems and is: overcome the deficiency of prior art, a kind of automatic explosion method of space camera of based target characteristic is provided, this method is obtained target information through recognition objective; To the target adjusting that makes public; Shielded other factors interference such as background, it is with strong points that the time shutter is regulated, thereby improved the one-tenth scape rate and the adaptive faculty of camera image; Utilize the instantaneous exposure control method at last, realized the space camera automatic exposure of based target characteristic.
Technical solution of the present invention is:
A kind of space camera automatic explosion method of based target characteristic, step is following:
(1) the present image subtracting background noise image that space camera was obtained according to the initial exposure time, the image after the noise is removed in formation, gets into step (2) afterwards;
(2) generate the multistage tree of removing the image after the noise described in the step (1), get into step (3) afterwards; The method that generates the multistage tree of removing the image after the noise described in the step (1) is following:
Corresponding four node of the number of plies n of said multistage tree >=4 and each node; The said image that removes after the noise is divided into some image blocks; The quantity of image block equals the number of multistage tree bottom node, and multistage tree bottom node is corresponding one by one with image block;
Pass through formula
Figure BSA00000412041400031
Calculate the value V of bottom node L, m is the ground unrest maximal value, is preset value;
Figure BSA00000412041400032
Pass through formula
Figure BSA00000412041400033
Calculate the value V of non-bottom node in the multistage tree i
(3) according to the value of the multistage tree bottom node that obtains in the step (2) and the value of non-bottom node, through formula
L i=V n-1×2 n-1+V n-2×2 n-2+…+V 2×2 2+V 1×2 1+V 0×2 0
Calculate the weights Li of the corresponding image block of each multistage tree bottom node; Wherein, V 0Be multistage tree bottom node, the i.e. value of first order node; V 1Be the even higher level of node of above-mentioned bottom node, i.e. the value of second level node; V 2Be the last two-stage node of above-mentioned bottom node, the i.e. value of third level node; In like manner, V N-1Be the last n-1 level node of above-mentioned bottom node, the i.e. value of n level node;
(4) according to the weights Li of each image block that obtains in the step (3), through formula:
E = Σ 1 ≤ i ≤ M C ( i ) M ,
Calculate the pixel average E of weights greater than 8 all images piece; Wherein, M is weights greater than 8 image block number;
C ( i ) = Σ x ≤ N ; y ≤ N ; v ( x , y ) N × N ,
N * N is the size of image block, and promptly the length of image block and wide is N pixel; v (x, y)Be the pixel value of weights greater than pixel in 8 the image block;
(5) weights that draw according to step (4) are greater than the pixel average E of 8 all images piece, through formula:
N _ INI = 5 &times; C _ INI , 20 < E &le; 40 ; 4 &times; C _ INI , 40 < E &le; 60 ; 3 &times; C _ INI , 60 < E &le; 80 ; 2 &times; C _ INI , 80 < E &le; 100 ; 1.25 &times; C _ INI , 100 < E < 120 ; 1.5 &times; C _ INI , 120 < E < 130 ; max _ INI E &le; 20 ; C _ INI / 2 E &GreaterEqual; 170 ; C _ INI 130 &le; E < 170 ;
Calculate the next frame time shutter N_INI of space camera, wherein, C_INI is the current time shutter of space camera, and max_INI is the maximal value of space camera time shutter.
The present invention's beneficial effect compared with prior art is:
(1) the present invention can effectively improve the automatic exposure performance under the situation of comparing the speed of not influencing with existing method, has improved the imaging capability and the picture quality of camera.The present invention mainly is used on the CMOS camera of small-sized low-power consumption space; This camera has characteristics such as small-sized low-power consumption, and to take resource few, and require to have the fast imaging ability, and this just needs the automatic exposure adjusting time short; The multistage tree method that the present invention adopts can identify object scene fast and effectively; And extract its monochrome information, and with strong points, improved the performance of automatic exposure.
(2) the present invention utilizes multistage tree construction that image-region is marked, and has reduced the complexity to image statistics, has improved the identification probability of effective target, has shielded the interference of invalid target image.More existing automatic explosion methods; Can't distinguish the effective target in the visual field; Adopt and directly all pixels in the entire image are averaged or simple threshold value screening, when the scenery difference in brightness is big in the visual field, object scene will occurs and cross bright or dark excessively situation like this; And adopted multistage tree construction; Can carry out multilevel hierarchy to the scenery of different brightness in the visual field handles; Can when taking into account other scenery, focus on effective target is carried out automatic exposure, can obtain more suitably time shutter and better pictures thereby compare additive method.
(3) the present invention adopts the monochrome information of multistage tree construction memory image, has improved automatic exposure speed to a great extent, compares existing exposure method and has significantly improved one-tenth scape rate.Existing exposure method is not preserved the monochrome information of piece image, and whether the back piece image down of exposure is compared piece image suitable, and whether effective target brightness is suitable, does not form feedback relationship, therefore also just can't form quick convergent trend; And adopt multistage tree construction only to need the little hardware resource just can preserve image luminance information; Thereby whether suitable reference is provided for what next width of cloth image exposuring time was regulated; Improved the speed of automatic exposure greatly, for assurance being provided in the real-time automatic exposure of rail.
(4) the present invention has greatly improved video remote measurement image of camera adaptive capacity to environment; Because the supervision of CMOS camera might be the satellite movable device to picture; Such as sun wing windsurfing, before the sun span is opened with launch shape, size and the brightness of back in the space camera visual field very big difference all arranged, the present invention can both can be to the sun wing blur-free imaging before having launched through multistage tree method; Can lock the sun wing after the expansion again very soon; And confirm the suitable time shutter, for space mechanisms such as satellite in orbit situation keep watch on important leverage be provided, for researcher provides visual information directly perceived clearly to the understanding and the improvement of satellite transit situation.
Description of drawings
Fig. 1 is a space camera automatic exposure schematic flow sheet of the present invention;
Fig. 2 is the multistage tree construction synoptic diagram of the present invention;
Fig. 3 divides synoptic diagram for the multistage tree of the present invention.
Embodiment
Further describe in detail below in conjunction with the accompanying drawing specific embodiments of the invention:
Small-sized low-power consumption face battle array CMOS camera has been widely used in satellite body mechanism, survey of deep space, space station and spaceborne video remote measurement; Had it just can Satellite Orbit Maneuver, change activities such as attitude, engine operation, the sun span are opened, antenna expansion and keep watch on and assess; Judge on ground that for researcher the satellite working condition provides the image foundation, be successfully applied to a plurality of models.
When camera is worked at rail; Whether the time shutter is suitable extremely important, and too short meeting of time shutter causes scenery very dark, and the long scenery luminance saturation that can cause; Therefore the time shutter adjusting is essential; But the time shutter is regulated very complicated, regulates badly may be absorbed in the time shutter disorder dark situation when bright when occurring.Whether what therefore the time shutter was regulated is suitable, is vital to camera imaging, is related to the success or failure of task.
Present civilian digital camera is technical very ripe in automatic exposure; Can set needed different exposure modes according to night scene, daytime, portrait etc.; If but when being applied to the CMOS camera; Can't accurately foresee in advance shot object position, brightness, account for information such as image area size, can not select exposure mode and time shutter in real time, cause missing right moment for camera.
The domestic automatic explosion method that is applied to space flight CMOS camera at present; Though can accomplish in real time, owing to camera can't be discerned target, when the background complicacy; When there is action in space mechanism in the visual field; Can't distinguish exposure, receive noise and background interference big, make that scenery brightness is difficult in the suitable scope in the image.
Be illustrated in figure 1 as the process flow diagram of the space camera automatic explosion method that the present invention is based on target property, said automatic exposure is meant through the methods analyst image obtains effective information, and then calculates down the time shutter of piece image automatically.Comprise noise remove, generate multistage tree, calculate each multistage tree bottom node correspondence image piece weights, computed image piece pixel average and calculate this several steps of next frame time shutter.Noise remove mainly be to the long noise that causes of the intrinsic dark current noise in the image, time shutter and dark a little less than non-imageable target remove; Obtain not having the image of noise; To reduce influence to multistage tree construction; Be about to the present image subtracting background noise image that space camera obtained according to the initial exposure time, the image after the noise is removed in formation.The initial exposure time is preset value.According to formula
DN(j,k)=p(j,k)-n(j,k)
View data behind the calculating denoising, the pixel value of space camera present image is p, and the ground unrest image pixel value is n, is the prevision value, and image pixel value is DN after the denoising;
Generate to remove the multistage tree of image behind the noise, said multistage tree construction can the statistical picture Luminance Distribution, can find the continuous scenery that occupies certain pixel number in the image easily through it, and can play the effect of isolating the invalid scenery that accounts for small number of pixels; Corresponding four node of the number of plies n of said multistage tree >=4 and each node; The said image that removes after the noise is divided into the identical image block of some sizes; The quantity of image block equals the number of multistage tree bottom node, and multistage tree bottom node is corresponding one by one with image block, the corresponding image block of the bottom node of each multistage tree construction; Get its size and be N * N, the promptly long and wide image block that is N pixel;
The size that at first accounts for image according to object scene is confirmed the image block size of multistage tree bottom node representative; Probably account for 512 * 512 pixels such as effective target; The image that its downstream site is corresponding is 256 * 256; But for fear of the effective target of failing to judge, generally down divide the bottom node of one-level as multistage tree again, the image block size of promptly multistage tree bottom node representative is 128 * 128.Multistage tree synoptic diagram is as shown in Figure 2, and division methods is as shown in Figure 3.
Accomplish multistage tree and divide the back according to formula
Figure BSA00000412041400071
Calculate the value V of bottom node L, m is the ground unrest maximal value, is preset value;
Figure BSA00000412041400072
Pass through formula Calculate the value V of non-bottom node in the multistage tree i
Value V according to bottom node LValue V with non-bottom node i, through formula
L i=V n-1×2 n-1+V n-2×2 n-2+…+V 2×2 2+V 1×2 1+V 0×2 0
Calculate the weights Li of the corresponding image block of each multistage tree bottom node; Wherein, V 0Be multistage tree bottom node, the i.e. value of first order node; V 1Be the even higher level of node of above-mentioned bottom node, i.e. the value of second level node; V 2Be the last two-stage node of above-mentioned bottom node, the i.e. value of third level node; In like manner, V N-1Be the last n-1 level node of above-mentioned bottom node, the i.e. value of the value of n level node; For example the value of a bottom node is 1, and its upper layer node value is 1, and the upper layer node value is 1 again, and the weights Li of the image block that then this multistage tree bottom node is corresponding is 7;
According to the weights Li of each image block that obtains, through formula:
E = &Sigma; 1 &le; i &le; M C ( i ) M ,
Calculate the pixel average E of weights greater than 8 all images piece; Wherein, M is weights greater than 8 image block number;
C ( i ) = &Sigma; x &le; N ; y &le; N ; v ( x , y ) N &times; N ,
N * N is the size of image block, and promptly the length of image block and wide is N pixel; v (x, y)Be the pixel value of weights greater than pixel in 8 the image block; For example weights have 4 greater than 8 branch, and its correspondence image piece average is C 1=100, C 2=120, C 3=130, C 4=150, then the average gray value E of effective target is:
E = 100 + 120 + 130 + 150 4 = 125
Get into the exposure adjusting stage at last, according to effective target average gray value E, through formula:
N _ INI = 5 &times; C _ INI , 20 < E &le; 40 ; 4 &times; C _ INI , 40 < E &le; 60 ; 3 &times; C _ INI , 60 < E &le; 80 ; 2 &times; C _ INI , 80 < E &le; 100 ; 1.25 &times; C _ INI , 100 < E < 120 ; 1.5 &times; C _ INI , 120 < E < 130 ; max _ INI E &le; 20 ; C _ INI / 2 E &GreaterEqual; 170 ; C _ INI 130 &le; E < 170 ;
Calculate the next frame time shutter N_INI of space camera, wherein, C_INI is the current time shutter of space camera, and max_INI is the maximal value of space camera time shutter, is preset value.
The present invention has been successfully applied to CMOS camera of hope, certain model lunar exploration satellite monitoring camera.Hope that the clear China's first that photographed of CMOS camera opens earth panorama photochrome; Certain model lunar exploration satellite monitoring camera has been passed a plurality of videos such as sun span open procedure, directional antenna rotation, 490N engine braking back, and has arrived the beautiful earth and the moon in the lunar trajectory photographs.Following this camera also will be widely used in satellization authority, survey of deep space, space station and extravehicular activity of astronaut are carried out to picture, obtain a large amount of valuable video telemetry intelligence (TELINT)s.
The content of not doing to describe in detail in the instructions of the present invention belongs to those skilled in the art's known technology.

Claims (1)

1. the space camera automatic explosion method of a based target characteristic is characterized in that step is following:
(1) the present image subtracting background noise image that space camera was obtained according to the initial exposure time, the image after the noise is removed in formation, gets into step (2) afterwards;
(2) generate the multistage tree of removing the image after the noise described in the step (1), get into step (3) afterwards; The method that generates the multistage tree of removing the image after the noise described in the step (1) is following:
Corresponding four node of the number of plies n of said multistage tree >=4 and each node; The said image that removes after the noise is divided into some image blocks; The quantity of image block equals the number of multistage tree bottom node, and multistage tree bottom node is corresponding one by one with image block;
Pass through formula
Figure DEST_PATH_FSB00000751112400011
Calculate the value V of bottom node 0, m is the ground unrest maximal value, is preset value;
Figure DEST_PATH_FSB00000751112400012
Pass through formula
Figure DEST_PATH_FSB00000751112400013
Calculate the value V of non-bottom node in the multistage tree i
(3) according to the value of the multistage tree bottom node that obtains in the step (2) and the value of non-bottom node, through formula
L i=V N-1* 2 N-1+ V N-2* 2 N-2++ V 2* 2 2+ V 1* 2 1+ V 0* 2 0Calculate the weights L of the corresponding image block of each multistage tree bottom node iWherein, V 0Be multistage tree bottom node, the i.e. value of first order node; V 1Be the even higher level of node of above-mentioned bottom node, i.e. the value of second level node; V 2Be the last two-stage node of above-mentioned bottom node, the i.e. value of third level node; In like manner, V N-1Be the last n-1 level node of above-mentioned bottom node, the i.e. value of n level node;
(4) according to the weights Li of each image block that obtains in the step (3), through formula:
Figure FSA00000412041300021
Calculate the pixel average E of weights greater than 8 all images piece; Wherein, M is weights greater than 8 image block number;
Figure FSA00000412041300022
N * N is the size of image block, and promptly the length of image block and wide is N pixel; v (x, y)Be the pixel value of weights greater than pixel in 8 the image block;
(5) weights that draw according to step (4) are greater than the pixel average E of 8 all images piece,
Pass through formula:
Figure FSA00000412041300023
Calculate the next frame time shutter N_INI of space camera, wherein, C_INI is the current time shutter of space camera, and max_INI is the maximal value of space camera time shutter.
CN201010622643.1A 2010-12-29 2010-12-29 Automatic exposure method of space camera based on target characteristics Expired - Fee Related CN102096273B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201010622643.1A CN102096273B (en) 2010-12-29 2010-12-29 Automatic exposure method of space camera based on target characteristics

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201010622643.1A CN102096273B (en) 2010-12-29 2010-12-29 Automatic exposure method of space camera based on target characteristics

Publications (2)

Publication Number Publication Date
CN102096273A CN102096273A (en) 2011-06-15
CN102096273B true CN102096273B (en) 2012-08-22

Family

ID=44129422

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010622643.1A Expired - Fee Related CN102096273B (en) 2010-12-29 2010-12-29 Automatic exposure method of space camera based on target characteristics

Country Status (1)

Country Link
CN (1) CN102096273B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9189451B1 (en) 2011-10-06 2015-11-17 RKF Engineering Solutions, LLC Detecting orbital debris
CN104247401B (en) * 2012-03-30 2019-07-02 株式会社尼康 Capturing element and filming apparatus
CN104184958B (en) * 2014-09-17 2017-07-11 中国科学院光电技术研究所 Automatic exposure control method and device based on FPGA (field programmable Gate array) and suitable for space detection imaging
CN104917975B (en) * 2015-06-01 2018-01-05 北京空间机电研究所 A kind of adaptive automatic explosion method based on target signature
CN105430293B (en) * 2015-12-03 2018-05-22 哈尔滨工业大学 The in-orbit dynamic scene real-time matching method of Optical remote satellite
CN109740393A (en) * 2018-12-06 2019-05-10 无锡盈达聚力科技有限公司 Bar code scanning system and method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
李威等.胶片型空间相机的快门设计和研究.《光学精密工程》.2005,第13卷9-14. *
陈荣利等.高分辨率空间相机的工程分析.《光子学报》.2005,第34卷(第2期),267-271. *

Also Published As

Publication number Publication date
CN102096273A (en) 2011-06-15

Similar Documents

Publication Publication Date Title
CN102096273B (en) Automatic exposure method of space camera based on target characteristics
CN100515042C (en) Multiple exposure image intensifying method
CN110853295A (en) High-altitude parabolic early warning method and device
CN111986084B (en) Multi-camera low-illumination image quality enhancement method based on multi-task fusion
CN107292830B (en) Low-illumination image enhancement and evaluation method
CN103077539A (en) Moving object tracking method under complicated background and sheltering condition
CN113962884B (en) HDR video acquisition method and device, electronic equipment and storage medium
CN108769550B (en) Image significance analysis system and method based on DSP
CN105913404A (en) Low-illumination imaging method based on frame accumulation
CN112632311A (en) Cloud layer change trend prediction method based on deep learning
Woodell et al. Advanced image processing of aerial imagery
Li et al. Multiframe-based high dynamic range monocular vision system for advanced driver assistance systems
CN115331141A (en) High-altitude smoke and fire detection method based on improved YOLO v5
Wiśniewski et al. Current status of Polish Fireball Network
CN115719457A (en) Method for detecting small target in unmanned aerial vehicle scene based on deep learning
CN103870847B (en) Detecting method for moving object of over-the-ground monitoring under low-luminance environment
CN111260687A (en) Aerial video target tracking method based on semantic perception network and related filtering
CN115115973A (en) Weak and small target detection method based on multiple receptive fields and depth characteristics
CN104915933A (en) Foggy day image enhancing method based on APSO-BP coupling algorithm
Jiang et al. Multiple templates auto exposure control based on luminance histogram for onboard camera
CN110827375B (en) Infrared image true color coloring method and system based on low-light-level image
Das et al. Dehazing technique based on dark channel prior model with sky masking and its quantitative analysis
CN117911885A (en) Red tide detection method, system, medium, computer equipment and terminal
CN115984672B (en) Detection method and device for small target in high-definition image based on deep learning
Penteliuc et al. Prediction of cloud movement from satellite images using neural networks

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20120822

Termination date: 20161229

CF01 Termination of patent right due to non-payment of annual fee