CN110099207A - A kind of effective image calculation method for overcoming camera unstable - Google Patents

A kind of effective image calculation method for overcoming camera unstable Download PDF

Info

Publication number
CN110099207A
CN110099207A CN201810094094.1A CN201810094094A CN110099207A CN 110099207 A CN110099207 A CN 110099207A CN 201810094094 A CN201810094094 A CN 201810094094A CN 110099207 A CN110099207 A CN 110099207A
Authority
CN
China
Prior art keywords
image
effective image
acquisition
calculation method
effective
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810094094.1A
Other languages
Chinese (zh)
Other versions
CN110099207B (en
Inventor
钟波
肖适
刘志明
杨鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Jimi Technology Co Ltd
Original Assignee
Chengdu Jimi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Jimi Technology Co Ltd filed Critical Chengdu Jimi Technology Co Ltd
Priority to CN201810094094.1A priority Critical patent/CN110099207B/en
Publication of CN110099207A publication Critical patent/CN110099207A/en
Application granted granted Critical
Publication of CN110099207B publication Critical patent/CN110099207B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof

Abstract

The invention discloses a kind of effective image calculation methods for overcoming camera unstable, method includes the following steps: camera continuous acquisition N images, it calculates the luminance parameter of each image in acquisition image sequence and takes median, the image sequence of acquisition is pre-processed, effective image P is calculated according to acquisition image Px, anchor point is identified in effective image P, and the focal position of camera lens is determined according to anchor point.Effective image calculation method provided by the invention is overlapped and is synthesized using multiple sampled images and is used further to position, it can overcome in the interference caused by image sampling of focussing process ambient light, exclude the influence of the invalid sampled images in camera image stabilization process, reduce the time for waiting camera image stabilization, improve the working efficiency of projection device, and can effectively prevent abnormal image causes positioning to fail, and improves drop shadow effect and user experience.

Description

A kind of effective image calculation method for overcoming camera unstable
Technical field
The present invention relates to stablize focusing field, especially a kind of effective image calculating side for overcoming camera unstable Method.
Background technique
With the development of shadow casting technique, make projection device constantly universal in office and domestic environments, wherein what projection focused Adjustment is the emphasis of projection device research and development.Ray machine focusing of the projection device in is the back-and-forth motion by camera lens in the prior art Realize control projected picture effect, focusing effect directly determines the user experience effect of projection device.Usually when focusing It can be positioned based on projected image, to complete to stablize focusing.But the stabilization process of camera collection image needs the several seconds, Camera also will appear apparent fluctuation when the variation of environment light, if camera acquisition image flashing, collection process In have probability appearance is completely black, Quan Bai, weak image, if this kind of image is directly used in positioning and will lead to positioning failure, belong to nothing Imitate image.The solution generallyd use in the prior art is waiting camera steady operation after setting delay a period of time Image is acquired again later for handling, but such method had both reduced the efficiency of projection device focusing task, and can not It is fully solved ambient light interference problem present in the image sampling of equipment.
Summary of the invention
The present invention is directed to above-mentioned technical problem of the existing technology, provides a kind of for overcoming camera is unstable to have Image calculation method is imitated, to overcome in the interference caused by image sampling of focussing process ambient light, using multiple sampled images It is overlapped and synthesizes and be used further to position, the time for waiting camera image stabilization can be reduced, and effectively prevent abnormal image Positioning is caused to fail.
The invention adopts the following technical scheme:
A kind of effective image calculation method for overcoming camera unstable, method includes the following steps:
Step 1, camera continuous acquisition N images, N >=1.
Step 2, calculate acquisition image sequence in each image luminance parameter Yx, x=1,2 ..., N;
By brightness parameter value Yx, x=1,2 ..., N, be ranked up according to certain sequence, take the median of the collating sequence, The median is Ymid;
Step 3 pre-processes the image sequence of acquisition, is rejected in sequence according to the value of N and the size of brightness value Yx The image of several brightness maximum and/or minimum, obtain pretreated M acquisition image Px, x=1,2 ..., M.
Step 4 sets last effective image as P, effective image P is calculated according to acquisition image Px.
Step 5 identifies anchor point in effective image P, and the focal position of camera lens is determined according to anchor point.
Further, calculating effective image P according to acquisition image Px in the step 4 is according to formula (1) in image Weighted Fusion is calculated each pixel in proportion:
Wherein,The weight ratio to pixel point value in Px image is indicated, so that each pixel proportionally be weighed New settings.
Alternatively, calculating effective image P according to acquisition image Px in the step 4 is calculated according to formula (2):
P=(P1+P2+...+PM)/M (2)
Further, described image luminance parameter Yx is calculated by formula (3):
Yx=(max (r, g, b)+min (r, g, b)/2 (3).
Alternatively, described image luminance parameter Yx is the sum of the gray value of all pixels in image.
Further, further include that verifying calculates image reliability in step 5, calculate the anchor point identification of effective image Effect verifies the reliability of effective image.
Further, in the step 3 image sequence it is pretreated reject number by N size and/or image brightness values Determine, if N value is bigger, i.e., initial samples quantity is more and/or the maxima and minima of luminance parameter between difference It is larger, multiple can be rejected.
Further, in the step 2, if amount of images is even number, median Ymid takes intermediate two brightness values Mean value.
In conclusion by adopting the above-described technical solution, the beneficial effects of the present invention are:
1, effective image calculation method provided by the invention, causes image sampling in focussing process ambient light to overcome Interference, be overlapped synthesis using multiple sampled images, exclude the invalid sampled images in camera image stabilization process Influence;
2, effective image calculation method provided by the invention can reduce the time for waiting camera image stabilization, improve The working efficiency of projection device.
3, effective image calculation method provided by the invention, can effectively prevent abnormal image causes positioning to fail, and improves and throws Shadow effect and user experience.
Detailed description of the invention
Fig. 1 is the flow chart provided in an embodiment of the present invention for calculating effective image.
Fig. 2 is effective image schematic diagram of calculation result provided in an embodiment of the present invention.
Specific embodiment
It is right below with reference to attached drawing of the invention in order to make those skilled in the art more fully understand technical solution of the present invention Technical solution of the present invention carries out clear, complete description, and based on the embodiment in the application, those of ordinary skill in the art exist Other similar embodiments obtained under the premise of creative work are not made, shall fall within the protection scope of the present application.
If Fig. 1 is the flow chart for calculating effective image.
Step 1, camera continuous acquisition N images, the value concrete condition of N is determined by camera quality, and N >=1; In one embodiment, the time for acquiring an image is 30ms, then the continuous acquisition figure within camera stable several seconds As sequence, the effective image comprising clear anchor point can be obtained, the value of usual N can be 10≤N≤30.
Step 2, calculate acquisition image sequence in each image luminance parameter Yx, x=1,2 ..., N;
By brightness parameter value Yx (x=1,2 ..., N) be ranked up according to sequence from big to small or from small to large, take Median, the median are Ymid;Further, if amount of images is even number, median Ymid takes intermediate two brightness The mean value of value, such as when amount of images is 20, then median Ymid is the luminance mean value of the 10th and 11 images.
Step 3 pre-processes the image sequence of acquisition, is rejected in sequence according to the value of N and the size of brightness value Yx The image of several brightness maximum and/or minimum, obtain pretreated M image Px (x=1,2 ..., M).
Pretreated rejecting number is determined by the size and/or image brightness values of N, if N value is bigger, i.e. initial samples Quantity is more and/or the maxima and minima of luminance parameter between difference it is larger, multiple can be rejected;If number N closes Difference between the suitable or maxima and minima of brightness is smaller, can also be with the pretreatment that it goes without doing screens, with art technology Subject to occurrence of the personnel according to sets itselfs such as data handling requirements and computing costs.
Step 4 sets the effective image for finally handling and obtaining as P, effective image P is calculated according to acquisition image Px.
Step 5 identifies anchor point in effective image P, and the focal position of camera lens is determined according to anchor point.
Effective image P is calculated according to Px in the step 4 can be there are many calculation, it is contemplated that projection device The response speed and anchor point recognition effect of focusing present embodiments provide each pixel in a kind of pair of image and add in proportion The calculation method of fusion is weighed, circular is as follows:
Every image is scaled after pixel summation average
Wherein,The weight ratio to pixel point value in Px image is indicated, so that each pixel proportionally be weighed New settings.
In another embodiment, it can be folded according to the pixel average that following formula (2) calculates all images The effective image P added
P=(P1+P2+...+PM)/M (2)
Fixation and recognition is finally carried out using P image data and calculates lens focus state.
Described image luminance parameter Yx is calculated by following formula (3) in one embodiment
Yx=(max (r, g, b)+min (r, g, b)/2 (3).
Brightness of image parameter Yx is the sum of the gray value of all pixels in image in another embodiment.
Further, it can also include the steps that verifying calculates image reliability in step 4, for calculating effectively figure The anchor point recognition effect of picture, verifies the reliability of effective image.
Fig. 2 is the experimental result calculated in method provided in an embodiment of the present invention, as shown, sharing 21 in figure Image, preceding 20 images be camera continuous acquisition image sequence, calculated according to the method in embodiment, pre-process and Fusion, obtains final superimposed image P, for shown in last block diagram in Fig. 2.As can be seen that without delay process In the case of, the target image effective for positioning and focusing can be calculated, exclude the influence of external ambient light, obtain effect more Good, more efficient focus effect.
Any feature disclosed in this specification (including any accessory claim, abstract), unless specifically stated, It is replaced by other equivalent or with similar purpose alternative features.That is, unless specifically stated, each feature is a series of An example in equivalent or similar characteristics.
The invention is not limited to specific embodiments above-mentioned.The present invention, which expands to, any in the present specification to be disclosed New feature or any new combination, and disclose any new method or process the step of or any new combination.

Claims (8)

1. a kind of effective image calculation method for overcoming camera unstable, which comprises the following steps:
Step 1, camera continuous acquisition N images, N >=1.
Step 2, calculate acquisition image sequence in each image luminance parameter Yx, x=1,2 ..., N;
By brightness parameter value Yx, x=1,2 ..., N, be ranked up according to certain sequence, take the median of the collating sequence, in this Between value be Ymid;
Step 3 pre-processes the image sequence of acquisition, is rejected according to the value of N and the size of brightness value Yx several in sequence The image of Zhang Liangdu maximum and/or minimum, obtain pretreated M acquisition image Px, x=1,2 ..., M.
Step 3 sets last effective image as P, effective image P is calculated according to acquisition image Px.
Step 4 identifies anchor point in effective image P, and the focal position of camera lens is determined according to anchor point.
2. effective image calculation method as described in claim 1, which is characterized in that according to acquisition image Px in the step 4 Calculating effective image P is that each pixel in image, Weighted Fusion is calculated in proportion according to formula (1):
Wherein,The weight ratio to pixel point value in Px image is indicated, so that each pixel proportionally be set again It is fixed.
3. effective image calculation method as described in claim 1, which is characterized in that according to acquisition image Px in the step 4 Calculating effective image P is calculated according to formula (2):
P=(P1+P2+...+PM)/M (2)。
4. effective image calculation method as described in claim 1, which is characterized in that described image luminance parameter Yx is by formula (3) it is calculated:
Yx=(max (r, g, b)+min (r, g, b)/2 (3).
5. effective image calculation method as described in claim 1, which is characterized in that described image luminance parameter Yx is in image The sum of gray value of all pixels.
6. effective image calculation method as described in claim 1, which is characterized in that further include verifying calculating figure in step 5 As reliability, the anchor point recognition effect of effective image is calculated, the reliability of effective image is verified.
7. effective image calculation method as described in claim 1, which is characterized in that image sequence pre-processes in the step 3 Rejecting number determine that if N value is bigger, i.e. initial samples quantity is more by the size and/or image brightness values of N, and/or Difference between the maxima and minima of luminance parameter is larger, can reject multiple.
8. effective image calculation method as described in claim 1, which is characterized in that in the step 2, if amount of images is Even number, then median Ymid takes the mean value of intermediate two brightness values.
CN201810094094.1A 2018-01-31 2018-01-31 Effective image calculation method for overcoming camera instability Active CN110099207B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810094094.1A CN110099207B (en) 2018-01-31 2018-01-31 Effective image calculation method for overcoming camera instability

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810094094.1A CN110099207B (en) 2018-01-31 2018-01-31 Effective image calculation method for overcoming camera instability

Publications (2)

Publication Number Publication Date
CN110099207A true CN110099207A (en) 2019-08-06
CN110099207B CN110099207B (en) 2020-12-01

Family

ID=67442593

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810094094.1A Active CN110099207B (en) 2018-01-31 2018-01-31 Effective image calculation method for overcoming camera instability

Country Status (1)

Country Link
CN (1) CN110099207B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110798627A (en) * 2019-10-12 2020-02-14 深圳酷派技术有限公司 Shooting method, shooting device, storage medium and terminal
CN111103286A (en) * 2019-12-10 2020-05-05 红云红河烟草(集团)有限责任公司 Cigarette stream extraction method under normal illumination condition of factory

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101489035A (en) * 2008-01-16 2009-07-22 三洋电机株式会社 Image shooting apparatus and blur correction method
CN102209196A (en) * 2010-03-30 2011-10-05 株式会社尼康 Image processing device and image estimating method
US20130251283A1 (en) * 2008-12-19 2013-09-26 QUALCOMM Inncorporated System and method to selectively combine images
CN103888684A (en) * 2012-12-21 2014-06-25 卡西欧计算机株式会社 Image processing apparatus that combines a plurality of images
CN106060404A (en) * 2016-07-15 2016-10-26 深圳市金立通信设备有限公司 Photographing mode selection method and terminal
CN106203428A (en) * 2016-07-05 2016-12-07 武汉大学 The image significance detection method merged based on blur estimation
CN106303235A (en) * 2016-08-11 2017-01-04 广东小天才科技有限公司 Take pictures processing method and processing device
CN106612397A (en) * 2016-11-25 2017-05-03 努比亚技术有限公司 Image processing method and terminal
CN106683064A (en) * 2016-12-13 2017-05-17 西北工业大学 Multi-focusing image fusion method based on two-dimensional coupling convolution
US20170315341A1 (en) * 2012-12-13 2017-11-02 Vala Sciences, Inc. Continuous-Scanning Image Acquisition In Automated Microscopy Using Reflective Autofocus

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101489035A (en) * 2008-01-16 2009-07-22 三洋电机株式会社 Image shooting apparatus and blur correction method
US20130251283A1 (en) * 2008-12-19 2013-09-26 QUALCOMM Inncorporated System and method to selectively combine images
CN102209196A (en) * 2010-03-30 2011-10-05 株式会社尼康 Image processing device and image estimating method
US20170315341A1 (en) * 2012-12-13 2017-11-02 Vala Sciences, Inc. Continuous-Scanning Image Acquisition In Automated Microscopy Using Reflective Autofocus
CN103888684A (en) * 2012-12-21 2014-06-25 卡西欧计算机株式会社 Image processing apparatus that combines a plurality of images
CN106203428A (en) * 2016-07-05 2016-12-07 武汉大学 The image significance detection method merged based on blur estimation
CN106060404A (en) * 2016-07-15 2016-10-26 深圳市金立通信设备有限公司 Photographing mode selection method and terminal
CN106303235A (en) * 2016-08-11 2017-01-04 广东小天才科技有限公司 Take pictures processing method and processing device
CN106612397A (en) * 2016-11-25 2017-05-03 努比亚技术有限公司 Image processing method and terminal
CN106683064A (en) * 2016-12-13 2017-05-17 西北工业大学 Multi-focusing image fusion method based on two-dimensional coupling convolution

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110798627A (en) * 2019-10-12 2020-02-14 深圳酷派技术有限公司 Shooting method, shooting device, storage medium and terminal
CN111103286A (en) * 2019-12-10 2020-05-05 红云红河烟草(集团)有限责任公司 Cigarette stream extraction method under normal illumination condition of factory
CN111103286B (en) * 2019-12-10 2022-07-01 红云红河烟草(集团)有限责任公司 Cigarette stream extraction method under normal illumination condition of factory

Also Published As

Publication number Publication date
CN110099207B (en) 2020-12-01

Similar Documents

Publication Publication Date Title
JP5843751B2 (en) Information processing apparatus, information processing system, and information processing method
CN103747179B (en) A kind of zoom tracking and system based on focusing evaluation of estimate feedback regulation
CN109218606B (en) Image pickup control apparatus, control method thereof, and computer readable medium
CN105872350A (en) Adjusting method and device for photographing parameter of camera
CN111107276B (en) Information processing apparatus, control method thereof, storage medium, and imaging system
CN104320575A (en) Image processing method and image processing apparatus for portable terminal
CN105141841B (en) Picture pick-up device and its method
JP2014160982A (en) Image processor, photography control method, and program
CN110602400B (en) Video shooting method and device and computer readable storage medium
WO2018214077A1 (en) Photographing method and apparatus, and image processing method and apparatus
CN108377398B (en) Infrared-based AR imaging method and system and electronic equipment
US9667853B2 (en) Image-capturing apparatus
CN103747183A (en) Mobile phone shooting focusing method
CN105867047A (en) Flashlight adjusting method and shooting device
CN106657801A (en) Video information acquiring method and apparatus
CN105898147B (en) Survey light processing method and apparatus applied to mobile terminal
CN110099207A (en) A kind of effective image calculation method for overcoming camera unstable
WO2018214838A1 (en) Surveillance image capture method, apparatus, and system
CN105049716B (en) A kind of preview image processing method and user terminal
CN106803920B (en) Image processing method and device and intelligent conference terminal
CN104168407A (en) Panorama photographing method
CN110365911A (en) A kind of method, mobile terminal and the server of mobile terminal shooting photo
CN106469435B (en) Image processing method, device and equipment
CN114363522A (en) Photographing method and related device
CN104767934B (en) Information processing method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant