CN106464814B - Flash of light collision detection, compensation and prevention - Google Patents

Flash of light collision detection, compensation and prevention Download PDF

Info

Publication number
CN106464814B
CN106464814B CN201580033775.1A CN201580033775A CN106464814B CN 106464814 B CN106464814 B CN 106464814B CN 201580033775 A CN201580033775 A CN 201580033775A CN 106464814 B CN106464814 B CN 106464814B
Authority
CN
China
Prior art keywords
flash
light
image capture
image
time slot
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201580033775.1A
Other languages
Chinese (zh)
Other versions
CN106464814A (en
Inventor
蒂莫西·罗伯特·波维利克
塞波·罗伯特·洪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/319,670 external-priority patent/US9363445B2/en
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN106464814A publication Critical patent/CN106464814A/en
Application granted granted Critical
Publication of CN106464814B publication Critical patent/CN106464814B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00—Special procedures for taking photographs; Apparatus therefor
    • G03B15/02—Illuminating scene
    • G03B15/03—Combinations of cameras with lighting apparatus; Flash units
    • G03B15/05—Combinations of cameras with electronic flash apparatus; Electronic flash units
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B9/00—Exposure-making shutters; Diaphragms
    • G03B9/70—Exposure-making shutters; Diaphragms with flash-synchronising contacts
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)

Abstract

Some aspects are related to system and technology for collision detection of glistening, compensation and prevention.For example, other unexpected increases in the flash of light of another camera or the ambient lighting of image scene can be introduced into undesirable degrading quality into the image captured, for example, the overexposure of some or all of captured image.Flash of light conflict in some instances can be detected by row read group total and comparison procedure.In some instances, flash of light conflict can be compensated by analyzing row summed data from multiple preview frames.In other examples, flash of light conflict can be eased or be prevented by using flash of light service controller.

Description

Flash of light collision detection, compensation and prevention
Technical field
System and method disclosed herein are related to image capture device and technology, and more precisely, are related to keeping away Exempt from the system and technology to the additional flash effect of captured image.
Background technique
Prevailing due to the personal camera such as such as portable digital camera and cell phone camera, several individuals can be about The different images of same time capture scene.For example, several individuals can mutually capture in the same time different images, be included in life Day party in when children blow out birthday cake on candle when, wedding it is commemorative at the time of or in other situations In.In such situation that multiple cameras play a role, quality that flash of light or pre-flash from camera can would not want to Degradation is introduced into the image captured by another camera.In some instances, degrading quality can be due to cmos sensor Rolling shutter, every a line of the image as obtained by rolling shutter is in slightly different ground Time Exposure.Correspondingly, if from another The flash of light of camera or pre-flash are closed during the exposure of frame, then any row with post-exposure of gained image, which may not conform to, to be needed Strategic point is over-exposed.
Summary of the invention
In general, the present invention relates to glisten to influence the system and technology of detection and compensation.In some embodiments, Row sum logic can be provided to detect influence of the additional camera flash to captured image data (herein referred to as " flash of light conflict "), the multiple frames captured including the image scene under the substantially similar sufficiently high frame per second of frame, for example, Under 30 frame (fps) about per second.For example, row sum logic can add pixel value for every a line of each frame to be formed Gained summation row value.Flash of light influence detection system can be compared the summation row value between frame on a row by row basis and captureed with determination Whether flash of light conflict has been occurred during obtaining frame.If some or all rows of frame are influenced by additional flash of light, frame that The summing value of a little rows can be higher than the summing value of the corresponding row for the former frame not influenced by additional flash of light.If do not detected Conflict to flash of light, then flash of light, which influences compensation technique, can indicate that camera captures image in user-request timing.If one Or flash of light conflict is detected in multiple frames, then flash of light, which influences compensation technique, can or indicate the new of camera capture image scene Frame, or can choose the frame not influenced by additional flash of light previously captured and export to user.
In another embodiment, Service control agreement of glistening (also referred to as " flash of light service controller ") can be based on image It captures request and whether camera is intended to distribute time slot using flash of light to the camera being connected to the network during image capture.Citing comes It says, camera can request time slot when camera user activates shutter release button, and can inform that flash of light Service control agreement whether will Image is captured using flash of light.It is used based on available time slot and flash of light, flash of light Service control agreement can distribute in an organized manner Request camera prevents the magazine flash of light conflict of network connection to time slot.
Correspondingly, it is related to the system for coordinating neighbouring multiple imaging devices to generate non-concurrent flash of light on one side, The system comprises: image capture device is configured on flash of light Service control network and communicates with multiple imaging devices；It dodges Light service controller comprising network manager, the network manager are configured to and image capture device and multiple imagings Device communicates on flash of light Service control network；Requirement analysis instrument is configured to reception and analysis from image capture device Image capture request, image capture request include flash message；And time slot controller, it is configured at least partly ground One in multiple time slots is distributed to image capture device in flash message.
On the other hand be related to it is a kind of for coordinating method of the neighbouring multiple imaging devices to generate non-concurrent flash of light, it is described Method includes: that flash of light service controller is provided on network to multiple imaging devices；It is connect from the request unit of multiple imaging devices Image capture request is received, image capture request includes flash message；Flash message is analyzed to determine whether request unit will use Flash of light executes image capture；One distributed in multiple time slots arrives request unit；And it is based at least partially on analysis flash of light letter Request unit is arrived in the result distribution flash of light setting of breath.
On the other hand it is related to the non-transitory computer-readable media of store instruction, when executing described instruction, configuration is extremely A few processor is to execute the operation including following item: is determined on image capture device using flash of light service controller；It is logical It crosses multiple imaging devices and forms flash of light Service control network；It is communicated on flash of light Service control network with flash of light service controller； The image capture request including flash message is sent to flash of light service controller；When receiving distributed from flash of light service controller Gap and the flash of light distributed are arranged；And image is captured during using distributed flash of light that distributed time slot is set.
On the other hand be related to it is a kind of for coordinating equipment of the neighbouring multiple imaging devices to generate non-concurrent flash of light, it is described Equipment includes: the device for establishing network with multiple imaging devices；For receiving image capture request from multiple imaging devices Device；And for distribute image capture time slot and distribution flash of light setting for multiple imaging devices using flash of light to alleviate or The device for avoiding flash of light from conflicting.
Detailed description of the invention
Revealed aspect is described hereinafter in conjunction with attached drawing and annex, attached drawing is provided and annex be in order to illustrate and It is not the revealed aspect of limitation, wherein the same symbol indicates similar elements.
Figure 1A and 1B illustrates image capture process and is related to one embodiment of the captured image of gained of flash of light conflict Graphical overview.
Fig. 2 illustrates the high-level graphical overview and schematic diagram of one embodiment of flash of light collision detection and compensation system.
Fig. 3 A illustrates the flow chart of the embodiment of flash of light collision detection process.
Fig. 3 B illustrates the flow chart of the embodiment of flash of light conflict compensation process.
Fig. 4 illustrates to be used by row sum logic with the reality for the pixel configuration for executing the flash of light collision detection process of Fig. 3 A Apply example.
Fig. 5 illustrates the high-level graphical overview and schematic diagram of flash of light service control system.
Fig. 6 A illustrates the flow chart of the embodiment for the flash of light Service control process implemented on the camera of network connection.
Fig. 6 B illustrates the flow chart of the embodiment of the flash of light Service control process by flash of light Service control actualizing.
Fig. 7 illustrates the high-level schematic diagram of the embodiment of the device with flash of light conflict compensation and prevention ability.
Specific embodiment
It introduces
The embodiment of the present invention is related to influencing the system and technology of detection and compensation for glistening.For compensating by another A kind of technology that the flash of light of camera is introduced into the degrading quality of captured image includes multiple figures that comparison is closely continuously captured It is influenced as frame to determine whether to detect to glisten.
For example, in one embodiment, row sum logic can be provided to detect additional camera flash to institute Capture the influence of image data.Camera can be configured to capture image scene under the substantially similar sufficiently high frame per second of frame Multiple frames, for example, at about 30 frames (fps) per second.Row sum logic can for each frame each row to pixel value into Row summation.For example, camera image signal processor (ISP) can for each frame be automatic white balance (AWB) data and Auto-exposure control (AEC) data export statistical data.In various embodiments, row sum logic can to AWB data and At least one component of AEC data is summed, for example, R/G (passing through the red of green standard), B/G (pass through green standard Blue) or Y (lightness/brightness) value.
Flash of light, which influences detection technique, can compare the summation row value between frame on a row by row basis with another camera of determination Flash of light whether influence frame.In order to illustrate if not additional flash of light influences image data, the summation row between frame Value should be substantially similar.However, for example, if last four row of the second frame is influenced by additional flash of light, second The summing value of last four row of frame can be higher than the summing value of last four row for the first frame not influenced by additional flash of light.Flash of light Influencing row can have the values of about 4 diaphragms brighter than row corresponding on unaffected frame, wherein " diaphragm " refer at The measurement of common brightness as in.For determine additional flash of light whether influence image data threshold value can be user setting or It influences the machine learning instruction in detection technique by being incorporated into flash of light dynamically to control, and in various embodiments can be with It is arranged to 1/4 diaphragm, 1/2 diaphragm or 1 diaphragm.
If not detecting that additional flash of light influences, flash of light, which influences compensation technique, can indicate camera in user- Request captures image when opportunity.If detecting that additional flash of light influences in one or more frames, flash of light influences compensation skill Art can perhaps indicate the new frame of camera capture described image scene or select that had previously captured not influenced by additional flash of light Frame export to user.Correspondingly, checked with wherein user's vision captured image and due to flash of light blackmail use and decision clap again The situation (at the time of having had been subjected to picturesque at this time) for taking the photograph image is compared, and captured image will be when generally requesting with user At the time of machine is identical.
It can reduce or eliminate due to additional flash of light by providing flash of light service control system and technology, some embodiments The degrading quality of the captured image of influence.For example, in one embodiment, user's camera can be judged by user Configuration is configured based on propinquity to form localized network, addition localized network or communicate with localized network, for example, logical Cross bluetooth or WiFi.The camera for forming localized network can be by distributing " time slot " for image capture to camera on network Glisten Service control protocol integrated test system.For example, camera can request time slot when camera user activates shutter release button, and can be with Inform whether flash of light Service control agreement will use flash of light capture image.
If not using current time slots, Service control agreement can retain this time slot for request camera.If current Time slot is occupied by another camera without using flash of light, then current time slots and capture image can also be added in request camera.Herein Under situation, image of the request camera using flash of light to avoid influence from being captured in a slot by other cameras can be prevented.Thus, If time slot request includes the instruction that is activated of flash of light, when request camera can be placed in the queue next available In gap.
If current time slots are occupied by another camera using flash of light, request camera can be placed in the queue Next available time slot in.In some embodiments, if request camera request has the current time slots that can enable flash of light And other cameras not yet start image capture, then request camera can be synchronous with the rolling shutter of other cameras and requests camera Current time slots can be added.
Example flash of light collision detection and compensation are summarized
Figure 1A and 1B illustrates image capture process 100 and is related to resulting the captured image 115,125 of flash of light conflict The graphical overview of one embodiment.Although two cameras are with a camera using flash of light explanation, this is for explanation Purpose and flash of light collision detection described herein and compensation process can be related to the situation of three or three or more cameras One of them above camera is neutralized to use in the situation during image capture using flash of light.
Figure 1A illustrates the example goal image scene 100 of plurality of camera user capture image.The use of first camera 110 Family is using 112 capture image 115 of flash of light, while the user of second camera 120 captures at least partially in the lasting period of flash of light 112 Image 125.The example that Figure 1B illustrates corresponding captured image 115,125.
The image 115 captured by camera 110 using flash of light 112 is correct exposure, this is because camera 110 (or may User in manual operation mode) it is based on being arranged using 112 calibration image captures of flash of light with irradiation image scene 100.It is taking the photograph In shadow, exposure is the amount for the light for per unit area (plane of delineation illumination is multiplied by time for exposure) reaching imaging sensor, is passed through Shutter speed, lens aperture and live brightness determine.In general, digital camera can implement automatic exposure (" AE ") control technology with Shutter speed, lens aperture are determined based on the analysis of scene brightness.For example, camera can be calculated automatically in AE mode and Adjust the setting of the exposure such as aperture and shutter speed by match (by as far as possible nearly in the form of) centre of target image scene Semi-tone of the tone to photograph.
However, due to the flash of light conflict generated during the flash of light 112 at least partially in other cameras by capture image, by it The image 125 of its camera 120 capture includes correct exposure part 126 and overexposed parts 127.This phenomenon is commonly known as As using caused by rolling shutter capture image 125 " Partial exposure " or " framing exposure ".Rolling shutter is to obtain image Method is captured wherein not recording instead of from the snapshot at single time point, actually by across frame or vertically or Person is horizontally scanned.In the illustrated example, rolling shutter scanning before the beginning of flash of light 112 corresponds in captured image The row of the sensor photodiode of pixel column in 125 correct exposure part 126, and scanned after the beginning of flash of light 112 The row of sensor photodiode corresponding to the pixel column in the overexposed parts 127 of captured image 125.Because dodging Light 112 does not have irradiation image scene 100 when (or user of the camera 120) initial calibration of camera 120 exposes and is arranged, so by dodging The increase of light caused by light causes the overexposure of part 127.In general, be commonly used in digital camera and mobile device it is magazine mutually Apotype metal-oxide semiconductor (MOS) (CMOS) sensor implements rolling shutter.
Although discribed example, which is shown, can be introduced by the camera capture of implementation rolling shutter by flash of light conflict The example of the degrading quality of image, and by the camera of implementation global shutter capture image can also due to flash of light conflict and by Degrading quality.For example, if after image capture system global shutter is determined for the exposure setting of image capture But flash of light conflict occurs before image is captured, then this can cause the overexposure of whole image or captured image Part light transmission everywhere.
In addition, though " flash of light conflict " typically refers to the flash of light of another camera on captured image as discussed herein It influences, other situations can also cause flash of light to conflict.For example, illumination, scintillation light, from weapon-shooting muzzle flash of light or The other unexpected and/or larger increase of the amount of the environment light of image scene can be in captured image by the sudden strain of a muscle of external camera Those of light generation form generates similar overexposure degrading quality.In addition, though flash of light conflict is usually discussed herein State by occur during image capture and cause some or all of capture image overexposure, but in some implementations Flash of light conflict can occur during the calibration that AE is arranged and terminate before image capture in example, cause one in captured image A little or whole under-exposures.
Fig. 2 explanation includes that camera 210, frame analyzer 222, preview capture tfi module 224 and final image capture module The high-level graphical overview and schematic diagram of one embodiment of 230 glisten collision detection and compensation system 200.
Camera 210 may include imaging sensor 214 and flash module 216.Camera 210 can be configured to capture picture field The preview frame of scape, such as being shown on the view lookup device of device for including flash of light collision detection and compensation system 200.This Class preview frame can be used for " real-time " preview image scene is presented to user in the form of 200 capture of system, and can be relative to Final capture image down size reduces resolution ratio.In some embodiments, when system 200 or device including system 200 It, can be continuously or close to continuously capturing preview frame when in image capture mode.Multiple preview frames can be by new pre- Frame of looking at is stored in buffer or other memories before replacing in predetermined amount of time.In some embodiments, including AE is arranged Image capture setting can be determined based on the analysis of one or more preview frames.Camera 210 also can be configured to use really The final image of fixed image capture setting capture full resolution.
Preview frame 220 can be sent to frame analyzer 222 with determine whether to have occurred flash of light conflict and cause capture figure As the degrading quality in data.For example, when user activates shutter release button or provides image capture order, camera 210 Captured preview frame 220 can be started to provide to frame analyzer 222.Although not illustrating, in some embodiments one or Multiple stored preview frames can be retrieved from buffer or memory.
Frame analyzer 222 can analyze each of multiple preview frames 225,226,227 and 228 to determine whether to have sent out Raw flash of light conflict.For example, as follows to will be discussed in more detail, the row summed data that frame analyzer 222 can execute compare with Detection flash of light conflict.Analyzer 222 can calculate present analysis frame and former frame row summed data (for example, being based on white balance With one or two in exposure control data), and the difference between present analysis frame and the correspondence row summation of former frame is calculated, And more each difference and threshold value.If flash of light conflict does not occur, corresponding row summing value should be roughly the same. However, flash of light conflict may occur to cause currently to divide if the difference between corresponding row summing value has been more than threshold value Analyse at least part of overexposure of frame.
For example, for preview frame 225, row summed data, which compares, to be able to detect appropriate exposure with frame analyzer 222 Light area 221 and overexposure area 223, and indicate that flash of light conflict captures preview frame 225 by using rolling shutter and midway is sent out It is raw.For preview frame 226, row summed data can relatively make frame analyzer 222 be able to detect by 223 groups of overexposure area At whole frame 226, and indicate flash of light conflict during capture preview frame 226 persistently.For preview frame 227, row is asked It relatively can permit frame analyzer 222 with data and detect over-exposure region 223 and correct exposure area 221, and indicate flash of light punching It is prominent that preview frame 225 is captured by using rolling shutter and is terminated halfway.For each of these preview frames, frame analyzer 222, which can export flash of light, influences the instruction 229 detected to preview capture tfi module 224.Tfi module 224 is captured in preview can With based on receive flash of light influence the preview frame capture instruction 231 outside 229 amount of exports of instruction that detects with configure camera 210 with after Continuous capture preview frame.
For preview frame 228, row summed data relatively can permit the detection of frame analyzer 222 by correct exposure area 221 The whole frame 228 of composition, and indicate not detecting present analysis preview frame 228 flash of light conflict.Correspondingly, frame is analyzed Instrument 222, which can export, does not detect that the instruction 234 that flash of light influences captures module 230 to final image.For example, it does not examine Measuring the instruction 234 that flash of light influences can be received at the capture setup module 236 that final image captures module 230.One In a little embodiments, capture setup module 236 can analyze preview frame 228 to determine the image capture setting of such as AE setting etc. And, for example, any desired post-processing setting of white balance, color balance, lens correction etc..
Capture setup module 236 can export final image capture instruction 232 and be set determined by 210 use of camera with configuring It sets to capture final image.Camera 210 can export image data 233 to final image capture module 230 for generating most Whole image 235, for example, by the post-processing setting using any determination to image data 233, final image 235 does not glisten Conflict artifact.
Fig. 3 A illustrates the flow chart of the embodiment of flash of light collision detection process 300A.In some embodiments, process 300A Can be implemented by flash of light collision detection and compensation system 200, or by it is any have flash of light collision detection ability image capture and/ Or processing system is implemented.
At block 305, system 200 can receive the image data including multiple frames.For example, as discussed above, Multiple previews or viewfinder frame be can produce to show " real-time " preview for the image data captured by system 200 to user.It can Directly to receive such frame from camera or storage device at frame analyzer 222.
At block 310, frame analyzer 222 can generate automatic white balance data for the frame each received.In some realities It applies in example, special image signal processor or another processor can substitute or generate white balance together with frame analyzer 222 (" AWB ") data.AWB data can be used for adjusting the colour cast of captured image data, such as since ambient lighting penetrates image scene The color temperature characteristic in source, to accurately match the color in captured image to the color perceived by the human viewer of image scene It is color.In some embodiments, AWB data may include the B/G for pixel or pixel region (by the standardized indigo plant of green channel Color channel) and/or R/G (by the standardized red channel of green channel) ratio.In some embodiments, such as more detailed about Fig. 4 It carefully explains, each frame can be divided into multiple regions, and AWB statistical data can automatically generate each region.
At block 315, frame analyzer 222 and/or special image signal processor or other processors can be each to connect The frame received automatically generates spectrum assignment (" AEC ") data.AEC data can be used for the analysis estimated exposure based on preview frame and set It sets, such as aperture and shutter speed.In some embodiments, AEC data may include (bright for the Y of pixel or pixel region Degree) value.In some embodiments, it is such as explained in greater detail about Fig. 4, each frame can be divided into multiple regions, and AEC unites Each region can be automatically generated by counting.
At block 320, frame analyzer 222 can calculate that (or row is predetermined for every a line in present frame and former frame Subset) pixel at least a line summing value to compare for executing row summation to detect potential flash of light and conflict.In some embodiments In can calculate the summation of individual AWB and AEC row, and individual R/G and B/G AWB row can be calculated in some embodiments Summation.Row summation can be summed by the pixel value (for example, R/G, B/G or Y) to each pixel in row to calculate.
At block 325, frame analyzer 222 can calculate in the summation of AWB row and the summation of AEC row for a pair of corresponding row Difference between each.As an example, frame analyzer 222 can calculate the AWB row for the first row of present frame and ask And the AWB row summation difference between the AWB row summation of the first row for former frame, and can calculate for present frame The AEC row of the first row sums and for the AEC row summation difference between the AEC row summation of the first row of former frame.
In some embodiments, AWB row summation difference AWBΔAWB number can be used as defined by following equation (1) According to calculating:
AWBΔ=∑ abs | VAWB(t)-VAWB(t-1)| (1)
Wherein VAWB(t) indicate for M × n-quadrant (R/G, B/G) of the pixel in present frame the vector of M × 2 and VAWB(t-1) vector of corresponding M × n-quadrant for the pixel in former frame is indicated.R/G and B/G rate value can be individually For generating the summation of R/G AWB row and the summation of B/G row, and AWB row summation in some embodiments and the summation of B/G row can In the hope of with or be in other ways combined into single value.In some embodiments, equation (2) can be used and use AEC data meter Calculate AEC row summation difference AECΔ:
AECΔ=∑ abs | VAEC(t)-VAEC(t-1)| (2)
Wherein VAEC(t) M × n-quadrant vector of M × 2 Y and V for the pixel in present frame are indicatedAEC(t-1) it indicates For the vector of corresponding M × n-quadrant of the pixel in former frame.
At decision block 330, frame analyzer 222 can compare row summing value and threshold value.In some embodiments, AWB row Sum difference AWBΔCan compared with first threshold and AEC row sum difference AECΔIt can be compared with second threshold.First He Second threshold can be the tunable parameter for correspondingly controlling the stability criterion of AWB and AEC, that is to say, that control is due to dodging How many degrading qualities caused by light conflict or other reasons are acceptable.In some embodiments, the row in former frame is total The threshold difference of 4 diaphragms of row summing value or more can indicate flash of light conflict.In other embodiments, 1 diaphragm or even 1/2 The difference of diaphragm may be used as threshold value.As used herein, " diaphragm " refers to the unit for quantifying light or exposure rate, wherein often The diaphragm that the diaphragm of a addition means two factor, and each subtracts means the factor of half.One diaphragm unit Also routinely it is referred to as EV (exposure value) unit.In some embodiments, threshold value can be adjusted between frame comparison to reflect The row summing value in the overexposure region of the determination of picture frame.
If for capable or row group's AWB row summation difference AWBΔLess than or equal to first threshold and AEC row is summed Difference AECΔLess than or equal to second threshold, then present frame may be stable and there is no flash of light conflicts.Correspondingly, mistake Journey 300A, which can be transitioned into block 345 and export, is not detected the instruction that flash of light influences.Process 300A can terminate and finally Image capture can continue.
If for capable or row group's AWB row summation difference AWBΔGreater than first threshold and AEC row summation difference AECΔGreater than second threshold, then since flash of light conflict present frame may be unstable.For example, target image field is matched The flash of light conflict of the colour temperature of environmental lighting conditions in scape can be captured since flash of light conflict causes bright band to appear in In image.Due to matching colour temperature AWB row summation difference AWBΔIt may be not higher than threshold value, however since the increase AEC row of brightness is asked With difference AECΔIt could possibly be higher than threshold value.Correspondingly, process 300A can be transitioned into block 335 and export what flash of light collision detection was arrived Instruction.In some embodiments, process 300A can also export the instruction of the group of overexposure row or row for analyzing then Frame.It for example, can be to the row summed data for the known overexposure row in present frame and in subsequent frame Corresponding row row summed data comparison threshold value be adjusted with more accurately determine flash of light conflict whether continue, or Whether the corresponding row of person has been returned to desired exposure levels.
At block 340, system 200 can execute flash of light conflict compensation process based on the instruction of flash of light conflict is detected.It lifts For example, system can be transitioned into flash of light conflict compensation process 300B described below in some embodiments.In other implementations In example, flash of light conflict instruction can be as follows to be discussed about Fig. 5-6B with the implementation of trigger flashing service conflict agreement.
Fig. 3 B illustrates the flow chart of the embodiment of flash of light conflict compensation process 300B.In some embodiments, process 300A Can be implemented by flash of light collision detection and compensation system 200, or by it is any have flash of light conflict compensation ability image capture and/ Or processing system is implemented.
At block 350, system 200 can receive the image data including multiple frames.For example, as discussed above, Multiple previews or viewfinder frame be can produce to show " real-time " preview for the image data captured by system 200 to user.It can Directly to receive such frame from camera or storage device at frame analyzer 222.
At block 355, frame analyzer 222, which can produce, indicates whether flash of light conflict is likely to be present in the preview of present analysis Flash of light in frame influences the instruction detected.The instruction that flash of light influences to detect in some embodiments can be according to described above Flash of light collision detection process 300A generate.In other embodiments, the instruction that flash of light influences to detect can produce in other ways It is raw, for example, based on flash of light nearby is detected optically by, or be based on network communicating with other cameras nearby.
At decision block 360, frame analyzer 222 can analyze the instruction glistened and influence to detect to determine whether to detect Flash of light conflict.If detect flash of light conflict, process 300B can be transitioned into block 365 with continue the capture of preview frame and/ Or it analyzes, be circulated back to block 355.Process 300B, which can be recycled between block 360,365 and 355 until generating, does not have flash of light punching Prominent preview frame, for example, the control based on preview capture tfi module 224.In order to compensate for the process of the flash of light conflict detected This circulation of 300B can introduce a small amount of delay between when the capture of user's start image and when capturing final image.However, Due to the relatively short duration of the flash lamp with human perception and compared with the reaction time, delay may be not notable and It will not be noticed by the user of camera.It for example, can be short for enough flash durations of typical flashlight module To 30 microseconds or 0.00003 second.Flash duration even can be shorter in the camera equipped with specialized flash module, example Such as, for high-speed photography, in some situations, continue 20 microseconds or 0.00002 second.
If flash of light conflict is not detected, process 300B can be transitioned into block 370 to retrieve or generate image capture Setting, for example, the analysis based on the current preview frame for not having the flash of light conflict detected.Image capture setting may include AE It is arranged and the possible post-processing for raw image data to be converted into final image is arranged.
At block 375, system 200 can capture final image.In some embodiments, final image captures module 230 Camera 210 can be configured to analyze determining setting capture most according to based on the preview frame for not having the flash of light conflict detected Whole image.
Fig. 4 illustrates that the pixel configuration 400 to execute the flash of light collision detection process of Fig. 3 A can be used by row sum logic Embodiment.Pixel configuration 400 includes being divided into M × N number of region 410 multiple pixels 405.AWB and AEC in some embodiments Statistical data can be provided for each region in each frame during camera preview mode, or be used in other embodiments The region of predetermined representative number in each frame.For each region, AWB statistical data may include in region R/G the and B/G value of each pixel, and AEC statistical data may include the Y value for each pixel in region.It is expert at and asks And period, row sum logic can be used some or all of R/G, B/G or Y value of the pixel in row 415 with generate one or Multiple row summing values.Pixel sense architecture for the imaging sensor in collision detection system of glistening can be with structuring to include Row sum logic is for generating row summing value as described above in some embodiments.
The general introduction of example flash of light conflict prevention
Fig. 5 illustrates the high-level graphical overview and schematic diagram of flash of light service control system 500.System 500 includes multiple nets User apparatus 505, network 510 and the flash of light message control module 520 of network connection, the user apparatus includes camera.
User apparatus 505 can be any one of multiple devices equipped with image capture ability.For example, exist Device 505 can be mobile communications device in various embodiments, for example, smart phone, tablet computer or digital camera.Equipped with Other computing devices of image capture ability can be configured for use in network connection to flash of light Service control agreement.
Network 510 can be local area network or wide area network, for example, internet or satellite network, for example, mobile communications network, Or provide another network that device is communicated to device.Correspondingly, the camera of network connection can equipped with suitable device with In access network, for example, WiFi, bluetooth, 3G, 4G or other are wirelessly or non-wirelessly connected to the network and communication device.
Flash of light message control module 520 can be used for executing flash of light Service control agreement in the use by network connection Organize or sort during the image capture of family device 505 (also referred to as " camera of network connection ") flash of light use to prevent Flash of light conflict between the camera of network connection.In some embodiments, flash of light message control module 520 can be one or more Remote server, the remote server, which is configured for use in, stores and executes instruction to execute flash of light business described herein Control protocol.It can be by the independent of the user apparatus 505 that network accesses although flash of light message control module 520 is depicted off Module, but in some embodiments flash of light message control module 520 can be on one in the device 505 of network connection Implement.In some embodiments, flash of light message control module 520 can be available as one group of software instruction or application , and user can be provided together with device or be downloaded on device for user.In some embodiments, it is connected to the network Device 505 in two or be greater than two can equipped with flash of light message control module 520.Correspondingly, logical on network 510 The synchronous behaviour for the flash of light Service control agreement that letter can be used for that thread guide devices is assigned to implement flash of light Service control agreement or crossover device Make.
As described, flash of light message control module 520 may include camera network manager 522,524 and of requirement analysis instrument Time slot controller 530.These components can be operated together to execute Service control agreement of glistening.For example, camera network pipe Reason device 522 can be configured to allocation identification name and/or label to the camera that network is added.In flash of light message control module 520 are incorporated into some embodiments in user apparatus 505, and camera network manager 522 can be configured to scan peripheral region And identify the other cameras for establishing flash of light Service control protocol network therewith.In various embodiments, glisten Service control mould Block 520 can be configured with after device is powered, image capture starting when or during the operation of the device continuously intermittently sweep Retouch peripheral region.
Requirement analysis instrument 524 can receive incoming image capture request, the flash of light letter including the camera from network connection Breath.Flash message may include whether the camera (" request camera ") of request execution image capture is configured to execute using flash of light The instruction of image capture, and if it is, include the instruction of the duration of flash of light.Flash message can also comprise request Camera is configured to make to be configured for one or more numbers glistened in advance of image capture and duration.Requirement analysis instrument can With send include with request the request data of camera and the associated mark of flash message to time slot controller 530.
Received request data can be used to be used for time slot allocation to request camera, herein in time slot controller 530 Period request camera can execute image capture.As described, time slot controller 530 can store data storage bank, including with In some or all of time slot 531, camera ID 532, flash of light instruction 533 and the camera ID 534 being added.For these fields 531,532,533,534 multiple and different data correlations are for purposes of example and explanation without restriction.In some realities The time that can be regular length in example by the time slot that time slot controller 530 is distributed and maintained is applied, and in other embodiments The duration of middle time slot can dynamically determine, for example, the image capture time frame based on the camera for being assigned to each time slot.
For example, current time slots, time slot 1 are illustrated as being occupied by the camera for the unlatching flash of light for being identified as " CAM3 ", And time slot 1 is added in " CAM4 ".Because " CAM3 " occupies time slot 1 and flash of light will be used to be used for image capture, " CAM4 " It can be prevented from also will cause the sudden strain of a muscle with the image by " CAM3 " capture using flash of light by service conflict agreement of glistening Light conflict.For example, when " CAM4 " requests distribution time slot to be used for image capture, flash of light Service control agreement, which can determine, to be worked as Preceding time slot (time slot 1) is occupied by " CAM3 " and can determine whether " CAM4 " (" request camera ") is intended to using flash of light.If It is not, then " CAM4 " can be allowed to that current time slots are added.In some embodiments, time slot controller 530 can produce finger It enables and being arranged with the rolling shutter of synchronization request camera " CAM4 " and exposure to the other cameras for having occupied time slot " CAM3 ".One In a little embodiments, synchronizing for rolling shutter may include providing the common rolling shutter time started to request camera and other phases Machine.In other embodiments, synchronizing for rolling shutter may include that the time frame of the flash duration for providing other cameras arrives Camera is requested, indicates the time frame that the operation of rolling shutter during this period should be completed.Using instruction, request camera " CAM4 " can To use the flash of light of other cameras " CAM3 " with correct exposure to capture image.
Time slot 2 is illustrated as also being occupied by " CAM3 " that opens flash of light without camera is added.Time slot 3 is illustrated as not accounting for According to.Time slot 4 is illustrated as being occupied by " CAM1 " that closes flash of light without camera is added.
Time slot 5 is illustrated as being occupied by " CAM1 " that closes flash of light, and time slot 5 is added in " CAM2 " and " CAM4 ".Because " CAM1 " is assigned to " CAM1 " for closing flash of light, can prevent that camera " CAM2 " and " CAM4 " is added using flash of light so as not to meeting Flash of light is caused to conflict with the image captured by " CAM1 ".
As it is possible that be nearby there may be configured without network-connectivity can be used flash of light without Other cameras of flash of light Service control agreement are limited by, so can be beneficial to user apparatus 505 in some embodiments is Equipped with flash of light collision detection described above and compensation ability.
Fig. 6 A illustrates the flow chart of the embodiment of the flash of light Service control process 600A implemented on the camera of network connection. In some embodiments, process 600A can be implemented by flash of light service control system 500 described above, or by having Any other system for executing the ability of flash of light Service control agreement is implemented.Process 600A is provided from the user apparatus including camera Angle execute flash of light Service control agreement an example.
At block 605, user apparatus can determine the needs of flash of light conflict Service control.For example, in some implementations Flash of light collision detection process 300A can export the instruction that flash of light instruction is detected in preview frame in example.In other embodiments In, flash of light can be detected optically by.In some embodiments, when the camera with network function detects its in preset range Process 600A can be initial when it has the camera of network function.
At block 610, user apparatus can be added flash of light Service control network and open and flash of light Service control agreement Communication.As described above, in some embodiments, flash of light Service control agreement can be long-range with user apparatus, for example, another On the camera of one network connection or on one or more servers.In some embodiments, user apparatus can be equipped with flash of light Service control agreement.
At block 615, user apparatus receives image capture order from user, for example, such as by pressing mechanical shutter button Or touching is provided indicated by the touch-sensitive shutter release button region on the touch panel of device.
At block 620, user apparatus sends the capture request including flash message to flash of light Service control agreement.Flash of light letter Breath includes whether the camera of user apparatus is configured to not capture by flash of light or by flash of light the instruction of requested image, and And if camera will use flash of light, including the instruction for the duration glistened.Flash message can also include camera will be The number glistened in advance used during image capture and duration.
At block 625, user apparatus receives the time slot for carrying out autoflash Service control agreement and flash of light distribution.For example, User apparatus can be based on the request distribution current time slots of the camera from other network connections previously submitted or subsequent time slot. Flash of light distribution may include flash of light whether can be avoided by the duration for the limitation and/or flash of light that user apparatus uses with The flash of light conflict of the camera of other network connections.As described above, in some embodiments, in addition user apparatus can receive and refer to It enables fast with the rolling shutter of synchronizing device and the flash of light or rolling of another camera for being assigned to the time slot that the user apparatus is added Door so as to using another camera flash of light.
At block 630, user apparatus can be according to the time slot and flash of light distribution capture final image distributed.Although not saying It is bright, but in some embodiments if the time slot of distribution is greater than the predetermined time length apart from current time slots, the use Family device can continue image capture without the use of Service control agreement of glistening, for example, according to process described above 300A and 300B.In some embodiments predetermined time length can starting and final image based on image capture capture it Between the tolerance of time delay that is perceived of user determine.
Fig. 6 B illustrates the process of the embodiment of the flash of light Service control process 600B by flash of light Service control actualizing Figure.In some embodiments, process 600B can be implemented by flash of light service control system 500 described above, or be passed through Any other system with the ability for executing flash of light Service control agreement is implemented.Process 600B is provided from execution flash of light business control One example of the flash of light Service control agreement that the angle of the module of agreement processed executes.
At block 635, flash of light message control module can provide flash of light Service control agreement to the phase of multiple network connections Machine.Camera can be digital camera or the personal computing device including image capture technology.In various embodiments, flash of light business Control module can remotely be implemented on one or more servers, is remotely real on magazine one of network connection It applies, or synchronous across the camera of multiple network connections.
At block 640, flash of light message control module can receive image capture request from the camera of request network connection.Figure As capture request may include user's initial pictures capture and the flash message of the camera from request network connection Instruction.
At decision block 645, flash of light message control module can determine whether current time slots are occupied.If current time slots It is unoccupied, then process 600B can be transitioned into block 650, when the message control module that glistens at block 650 can distribute current Camera of the gap to request network connection.For example, flash of light message control module can store associated with same current time slots Request network connection the associated ID of camera, by request network connection camera provide flash message and it is any plus The camera entered also executes image capture using current time slots according to the flash message of the camera of request network connection.
At block 655, flash of light message control module can discharge current time slots.Current time slots can be in various embodiments From request network connection camera receive image capture complete instruction after, predetermined time cycle (for example, by request net The camera of network connection provides the image capture duration) after the past, or in the camera and request network connection being all added Camera is completed to discharge after image capture.
If current time slots are occupied by another camera, process 600B is transitioned into decision block 660, in decision block 660 The flash message of the camera of analysis request network connection.If the camera of request network connection is configured to using flash of light, Process 600B is transitioned into block 665, and camera is assigned to next available time slot in block 665.Although it is not illustrated, still in some realities Apply in example glisten message control module can also determine occupy current time slots (or the time slot then occupied) another camera whether Also request the camera of network connection to hold in this time slot using the flash of light of another camera using glistening and can send instructions to Row image capture.
If the camera of request network connection is not set to using flash of light, process 600B is transitioned into decision block 670, The message control module that glistens in decision block 670 determines whether another camera for being assigned to current time slots is configured to using sudden strain of a muscle Light.If another camera is configured to using flash of light, process 600B is transitioned into block 665, and camera is assigned in block 665 Next available time slot.Flash of light message control module can store with next available time slot it is associated request be connected to the network phase The camera of the associated ID of machine, the camera flash message provided being connected to the network by request and any addition also ask by basis The flash message of the camera of network connection is asked to execute image capture using current time slots.In some embodiments, flash of light business control Molding block can be occupied to by being arranged to carry out image capture without another camera of flash of light with the camera that distribution request is connected to the network Next time slot.
If another camera for occupying current time slots is not set to using flash of light as requested the camera of network connection not It is configured to using flash of light, then process 600B is transitioned into block 675, the camera of network connection is requested to be assigned in block 675 Current time slots are added.In some embodiments, requesting the camera of network connection can be prohibited by the message control module that glistens Change image capture setting to use flash of light (or flash of light in advance) during current time slots.
At block 680, in the camera of request network connection, another camera and any additional of image capture has been completed Current time slots can be discharged after the camera of addition.
Time slot allocation discussed herein above can be operated to prevent the magazine flash of light conflict of network connection.However, such as It is discussed, in some embodiments if the time slot of distribution is outside predetermined time frame, the camera being connected to the network can be inclined From the distribution for carrying out autoflash Service control agreement, and in some embodiments, there may be the phases of additional non-network connection Machine.Correspondingly, can be beneficial to the camera of network connection is equally equipped with flash of light collision detection and compensation described above Technology.
Example glisten collision detection, compensation and preventing mean general introduction
Fig. 7 illustrates the high-level schematic diagram of the embodiment of the device 700 with flash of light conflict compensation and prevention ability, device 700 have one group of component of the image processor 720 including being linked to camera 701.Image processor 720 is gone back and working storage 765, memory 730 and de-vice processor 755 communicate, the working storage 765, memory 730 and de-vice processor 755 after And it is communicated with storage device 770 and optional electronic console 760.
Device 700 can be Portable, personal computing device, for example, mobile phone, digital camera, tablet computer, a Personal digital assistant or the like.In the presence of being permitted for wherein use flash of light collision detection as described herein, compensation and/or prevention technique More portable computings will provide advantage.Device 700 is also possible to static computing device or in which flash of light collision detection, compensation And/or prevention technique will be advantageous any device.Multiple application programs can be used for user on device 700.These applications Program may include traditional photograph and video application and flash of light Service control protocol application.
Image capture device 700 includes the camera 701 for capturing external image.Camera 701 can in some embodiments To include imaging sensor 715 and flash module 710.Camera 701 can be configured for use in and continuously or intermittently capture preview Frame and capture full resolution final image.
Image processor 720 can be configured to execute various processing operations in the preview frame received, to execute sudden strain of a muscle Light collision detection, compensation and/or prevention technique.Processor 720 for General Porcess Unit or can be specially designed for imaging applications Processor.The example of image processing operations includes that AWB and AEC data generate, row is summed compared with, cut, bi-directional scaling (for example, being scaled to different resolution), image mosaic, image format conversion, color interpolation, colors countenance, image filter Wave (for example, spatial image filtering), lens artifact or defect correction etc..In some embodiments, processor 720 may include multiple Processor.Processor 720 can be the Software implementations of one or more special image signal processors (ISP) or processor.
As shown, image processor 720 is connected to memory 730 and working storage 765.In embodiment described In, the storage capture of memory 730 control module 735, flash compensation module 740, flash of light message control module 780 and operating system 750.The module of memory 730 includes the image processor 720 of configuration device processor 755 to execute various image procossings and dress Set the instruction of management role.Working storage 765 can be used to store the module for being contained in memory 730 by image processor 720 In processor instruction working set.Alternatively, working storage 255 can also be by image processor 720 using come storage device The dynamic data created during 200 operation.
As mentioned above, image processor 720 is configured by several modules stored in memory.Capture control module 735 may include the instruction for configuring image processor 720 to adjust the focal position of camera 701.Capturing control module 735 can be into One step includes the instruction of the overview image capture function of control device 700.For example, capture control module 735 may include Subroutine is called to configure image processor 720 to capture one or more frames including target image scene using camera 701 The instruction of preview image data.In one embodiment, capture control module 735 then can call flash compensation module 740 or Flash of light message control module 780 is to eliminate or reduce by degrading quality caused by the flash of light conflict in the frame captured.
Flash compensation module 740 includes submodule: preview frame analyzer 742, capture tfi module 744 and final image prisoner Obtain module 746.Together, these modules may include configuration image processor 720 to execute above for sudden strain of a muscle discussed in Fig. 2-4 The instruction of light collision detection and compensation technique.In some embodiments, preview frame analyzer 742, capture tfi module 744 and most Whole image capturing module 746 can respectively storage configuration image processor 720 to execute above in relation to preview frame analyzer 222, the instruction of various tasks described in tfi module 224 and final image capture module 230 is captured.
The message control module 780 that glistens includes submodule: camera network manager 782, requirement analysis instrument 784 and time slot control Device 786 processed.Together, these modules may include configuration image processor 720 to execute above for sudden strain of a muscle discussed in Fig. 5-6B The instruction of light conflict prevention or mitigation technique.In some embodiments, camera network manager 782, requirement analysis instrument 784 and when Gap controller 786 can respectively storage configuration image processor 720 to execute above for camera network manager 522, request The instruction of various tasks described in analyzer 524 and time slot controller 530.
Operating system module 750 configures image processor 720 with the working storage 765 of managing device 700 and processing money Source.For example, operating system module 750 may include device driver to manage the hardware resource such as camera 701.Cause This, in some embodiments, the instruction for including in image processing module discussed herein above can not be direct with these hardware resources Interaction, but via standard subroutine or the API interaction being located in operating system component 750.Instruction in operating system 750 can Then directly interacted with these hardware components.Operating system module 750 can be further configured image processor 720 with at device Manage 755 shared information of device.
De-vice processor 755 may be configured to control display 760 to show captured image or institute's capture figure to user The preview of picture.Display 760 can the outside of imaging device 200 or can be imaging device 200 a part.Display 760 may be used also It is configured to provide the view lookup device for showing preview image for using before capturing image, such as presents and glisten to user The visual representation of conflict.Display 760 may include LCD or LED screen, and implementable Touch technologies.
De-vice processor 755 can write data into memory module 770, for example, indicating captured image and row summation The data for being worth and comparing.Although memory module 770 represents graphically as traditional magnetic disk device, the technology of fields Personnel will be understood that memory module 770 is configured as any storage medium device.For example, memory module 770 may include disk Driver, for example, floppy disk drive, hard disk drive, CD drive or magneto optical driver or solid-state memory, for example, Flash memory, RAM, ROM and/or EEPROM.Memory module 770 also may include multiple memory cells, and the memory Any one of unit can be configured to be in image capture device 700, or can be in the outside of image capture device 700.It lifts For example, memory module 770 may include the ROM memory containing the system program directive being stored in image capture device 700. Memory module 770 also may include the storage card or high-speed memory for being configured to store captured image, can remove from camera. Memory module 770 can also be outside device 700, and in an example, and data can be wirelessly transmitted to memory module by device 700 770, for example, via network connection.
Have independent assembly to include processor, imaging sensor and the device of memory, affiliated neck although Fig. 7 describes Domain it will be recognized that these independent assemblies can with various ways combine to realize specific design object.Citing comes It says, in alternative embodiments, the memory assembly can be combined with processor module, such as with save the cost and/or the property improved Energy.
In addition, though Fig. 7 illustrates two memory assemblies, include several modules memory assembly 720 and Single memory 765 including working storage, but those skilled in the art will realize that utilize different memory frame Several embodiments of structure.For example, a kind of design can using ROM or Static RAM memories come storage implementation in memory 730 In include module processor instruction.Processor instruction can be loaded into RAM to promote to be executed by image processor 720.It lifts For example, working storage 765 may include RAM memory, has and is loaded into work before being executed by image processor 720 Make the instruction in memory 765.
Implementation system and term
Embodiment disclosed herein is provided for the system of collision detection of glistening, compensation and prevention, method and is set It is standby.Those skilled in the art will realize that these embodiments may be implemented in hardware, software, firmware, or any combination thereof.
In some embodiments, circuit discussed herein above, process and system can be utilized in a wireless communication device.Wirelessly Communication device can be a kind of electronic device for wirelessly communicating with other electronic devices.The example of wireless communication device includes bee It is cellular telephone, smart phone, personal digital assistant (PDA), electronic reader, game system, music player, net book, wireless Modem, laptop computer, tablet computer device etc..
Wireless communication device may include one or more imaging sensors, one or more image-signal processors including use In the memory for executing flash of light collision detection discussed herein above, compensation and the instruction or module that prevent process.Device can also have There are data, load processor, one or more communication interfaces, one or more input units, one of instruction and/or data from memory Or multiple output devices (for example, display device) and power source/interface.Wireless communication device can also comprise transmitter and reception Device.Transmitter and receiver can be collectively referred to transceiver.Transceiver can be coupled to one or more antenna for transmission and/or reception Wireless signal.
Wireless communication device can be connected wirelessly to another electronic device (for example, executing flash of light Service control agreement Device).Wireless communication device is alternatively referred to as mobile device, mobile station, subscriber stations, user equipment (UE), distant station, connects Enter terminal, mobile terminal, terminal, user terminal, subscriber unit etc..The example of wireless communication device include laptop computer or Desktop computer, cellular phone, smart phone, radio modem, electronic reader, tablet computer device, game system System etc..Wireless communication device can be operated according to one or more industrywide standards such as such as third generation partner programs (3GPP).Cause This, generic term " wireless communication device " may include the wireless communication device described according to the different nomenclatures of industrywide standard (for example, access terminal, user equipment (UE), remote terminal etc.).
It can be stored in that processor is readable or computer-readable matchmaker using function described herein as one or more instructions On body.Term " computer-readable media " refers to any available media accessible by computer or processor.By It in example rather than limits, such media may include RAM, ROM, EEPROM, flash memory, CD-ROM or other optical disc storages dress It sets, the phase of disk storage device or other magnetic storage devices or any other form that can be used to store instruction or data structure Hope program code and media accessible by a computer.As used herein, disk and CD include compact disk (CD), Laser-optical disk, optical compact disks, digital versatile disc (DVD), floppy disk and Blu-ray Disc, wherein disk is usually magnetically again Existing data, and CD with laser reproduce data optically.It should be noted that computer-readable media can be tangible and non-transitory 's.Term " computer program product " refers to computing device or processor, with can be executed by computing device or processor, processing Or the code calculated or instruction (for example, " program ") combine.As used herein, term " code " can refer to can by computing device or Software, instruction, code or the data that processor executes.
It can also come transmitting software or instruction via transmission media.For example, if software be from website, server or its Its remote source is transmitted using coaxial cable, fiber optic cables, twisted pair, Digital Subscriber Line (DSL), then for example infrared, wireless The wireless technologys such as electricity and microwave are also contained in the definition of transmission media.
The method disclosed herein includes for realizing one or more steps of described method or movement.It is not departing from In the case where the range of claims, method and step and/or movement can be interchangeable with one another.In other words, unless describing The appropriate operation of method need the particular order of step or movement, otherwise in the case where not departing from the range of claims The sequence and/or use of particular step and/or movement can be modified.
It should be noted that as used herein, term " coupling (couple, coupling, coupled) " or word coupling Other variants can indicate to be indirectly connected with or be directly connected to.For example, if first assembly is " coupled " to the second component, First assembly may be connected indirectly to the second component or be directly connected to the second component.As used herein, term " multiple " Indicate two or greater than two.For example, multiple components indicate two or are greater than two components.
Term " determination " covers diversified movement, and therefore " determination " may include calculating, operation, processing, export, tune Look into, search (for example, searching in table, database or another data structure), check and verify etc..Also, " determination ", which may include, to be connect Receive (for example, receiving information), access (for example, accessing data in memory) etc..Also, " determination " may include parsing, selection, Choice, foundation etc..
Unless otherwise expressly provided, otherwise phrase " being based on " is not meant to " being based only upon ".In other words, phrase " being based on " Both " being based only upon " and " being at least based on " is described.
In the above description, detail is provided to provide the thorough understanding to example.However, the general skill of fields Art personnel will be understood that, can practice the example without these specific details.For example, it can show in block diagrams Electric component/device, in order to avoid the example is obscured with unnecessary details.In other cases, can be shown specifically this class component, Other structures and technology are to be explained further the example.
Herein include several titles, is for reference and auxiliary positioning various pieces.These titles are not limiting as The range of concept about its description.This genus can be applicable in through the whole instruction.
It shall yet further be noted that the example can be described as process, this process is depicted as flow chart, flow graph, finite state Figure, structure chart or block diagram.Although flow chart can describe the operations as into sequential process, many operations can parallel or together Shi Zhihang, and the process can repeat.Furthermore it is possible to rearrange the sequence of operation.Process is whole when its operation is completed Only.Process can correspond to method, function, program, subroutine, subprogram etc..When process corresponds to software function, terminate It is returned to corresponding to the function and calls function or principal function.
Foregoing description to revealed embodiment is provided, is in order to enable those skilled in the art can make Or use the present invention.Those skilled in the art becomes readily apparent that the various modifications to these embodiments, and institute herein The general principle of definition can be applied to other embodiments without departing from the spirit or scope of the present invention.Therefore, originally Invention be not intended to be limited to herein shown in embodiment, but should be endowed and principle disclosed herein and novelty are special Levy consistent widest scope.

Claims (30)

1. it is a kind of for coordinating neighbouring multiple images trap setting to generate the flash of light service controller of non-concurrent flash of light, packet It includes:
Network manager is configured on flash of light Service control network and capturees with the request image in multiple images trap setting Device communication is obtained, the request image capture device includes the first imaging sensor and the first flash module；
Requirement analysis instrument is configured to image capture request of the reception and analysis from the request image capture device, institute Stating image capture request includes flash message；And
Time slot controller is configured to
Determine in multiple time slots at least one other device for whether having been dispensed into described multiple images trap setting, At least one other device includes the second imaging sensor and the second flash module, and
Be based at least partially in the flash message and the multiple time slot it is one whether it is the allocated it is described really It is fixed that one in the multiple time slot is assigned to the request image capture device, so that being configured to hold by flash of light Most one in the described multiple images trap setting of row image capture be assigned to it is one in the multiple time slot.
2. flash of light service controller according to claim 1, wherein the flash of light Service control network includes satellite communication Network.
3. flash of light service controller according to claim 1, wherein the request image capture device includes smart phone Or digital camera.
4. flash of light service controller according to claim 1, wherein the flash of light Service control network include local area network, it is wide Domain net, bluetooth or device are to device communication network.
5. flash of light service controller according to claim 4, wherein first flash module is configured to and the sudden strain of a muscle The communication of light service controller, the flash of light service controller are further configured to dodge based on described in distributed gap activation first Optical module.
6. flash of light service controller according to claim 1, wherein the time slot controller includes memory, the storage Device, which is configured to storage, to be indicated time slot, camera identification and arrives described at least one image for requesting image capture device with providing Capture distributes associated flash of light open instruction.
7. flash of light service controller according to claim 6, wherein the memory of the time slot controller is further Being configured to storage indicates to distribute associated described multiple images trap setting at least at least one described image capture The data of the device of one addition.
8. flash of light service controller according to claim 1 further comprises the request image capture device, wherein The flash of light service controller is implemented on the request image capture device.
9. flash of light service controller according to claim 1 further comprises in addition to the request image capture device At least one of outer described multiple images trap setting, and wherein in described multiple images trap setting it is described at least One includes the flash of light service controller.
10. flash of light service controller according to claim 1, further comprises remote server, the remote service Device includes the network manager, requirement analysis instrument and time slot controller.
11. a kind of for coordinating method of the neighbouring multiple images trap setting to generate non-concurrent flash of light comprising:
Image capture request is received from the request unit in multiple images trap setting by flash of light service controller via network, The request unit includes the first imaging sensor and the first flash module, and described image capture request includes flash message；
Whether analyze the flash message will use flash of light to execute image capture with the determination request unit；
Determine in multiple time slots at least one other device for whether having been dispensed into described multiple images trap setting, At least one other device includes the second imaging sensor and the second flash module；
That distributes in the multiple time slot one to be configured to execute image prisoner by flash of light to the request unit Most one in the described multiple images trap setting obtained be assigned to it is one in the multiple time slot；And
The result distribution flash of light setting for analyzing the flash message is based at least partially on to the request unit.
12. according to the method for claim 11, whether to further comprise determining the current time slots of the multiple time slot The allocated at least one other device to described multiple images trap setting.
13. according to the method for claim 12, further comprising not yet being assigned in response to the determination current time slots The current time slots are distributed to the request unit at least one other device.
14. further comprising according to the method for claim 12, assigned in response to the determination current time slots It is based at least partially on at least one other device and analyzes the result of the flash message and determine that the request unit is It is no to be configured to execute image capture using flash of light.
15. further comprising according to the method for claim 14, being configured to make in response to the determination request unit Image capture is executed with flash of light:
Determine next available time slot；And
Next available time slot is distributed to the request unit.
16. further comprising according to the method for claim 14, being configured to make in response to the determination request unit Image capture is executed with flash of light, determines whether at least one other device is configured to execute image capture using flash of light.
17. further comprising according to the method for claim 16, in response to determination at least one other device quilt It is arranged to execute image capture using flash of light:
Rolling shutter synchronic command is generated for the request unit to use through at least one other device output Flash of light executes image capture；
The rolling shutter synchronic command is provided to the request unit；
The request unit is provided instructions to prevent the request unit during image capture using the request unit Flash module；And
The current time slots are distributed to the request unit.
18. further comprising according to the method for claim 14, being not set in response to the determination request unit Image capture is executed using flash of light, determines whether at least one other device is configured to execute image prisoner using flash of light It obtains.
19. according to the method for claim 18, further comprise in response to determination at least one other device not It is configured to that the current time slots are assigned to the request unit using flash of light execution image capture.
20. further comprising according to the method for claim 18, in response to determination at least one other device quilt It is arranged to execute image capture using flash of light:
Determine next available time slot；And
Next available time slot is distributed to the request unit.
21. according to the method for claim 11, further comprising providing the flash of light service controller and being used as can be used for Download to the application program of at least one of described multiple images trap setting.
22. further comprising according to the method for claim 11, at least one in described multiple images trap setting A upper offer flash of light service controller.
23. a kind of non-transitory computer-readable media for storing instruction configures at least one processing when executing described instruction Device is to execute the operation of the following terms:
Flash of light Service control network is formed via flash of light service controller and multiple images trap setting；
Image prisoner is received from the first image capture device of described multiple images trap setting via the flash of light service controller Request is obtained, the first image trap setting includes the first imaging sensor and the first flash module, described image capture request Including flash message；
Determine in multiple time slots at least one other device for whether having been dispensed into described multiple images trap setting, At least one other device includes the second imaging sensor and the second flash module；And
Distribute it is one to the first image trap setting in the multiple time slot so that the institute in the multiple time slot Stating one includes most one be configured in the described multiple images trap setting by flash of light execution image capture.
24. non-transitory computer-readable media according to claim 23, wherein the flash of light service controller is in institute It states and implements in the second image capture device of multiple images trap setting.
25. non-transitory computer-readable media according to claim 24, the operation further comprises via described Second image capture device scans the preset range of other image capture devices.
26. non-transitory computer-readable media according to claim 25, the operation further comprises via described Second image capture device is based at least partially on detection of the first image trap setting in the preset range and determines Use the flash of light service controller.
27. non-transitory computer-readable media according to claim 24, the operation further comprises via described Second image capture device detects the flash of light conflict in preview image frame, and forms institute in response to detecting the flash of light conflict State flash of light Service control network.
28. a kind of for coordinating equipment of the neighbouring multiple images trap setting to generate non-concurrent flash of light, the equipment includes:
For establishing the device of network with multiple images trap setting, described multiple images trap setting respectively has image sensing Device and flash emitting device；
For receiving the device that image capture is requested from described multiple images trap setting；And
It is arranged for distributing image capture time slot and distributing flash of light for described multiple images trap setting using flash of light to alleviate Or the device for avoiding flash of light from conflicting, it is described to be configured to for assigned unit
Determine one whether had been dispensed into described multiple images trap setting in described image capture time slot, with And
One in distribution described image capture time slot to be configured to execute the described more of image capture by flash of light Most one in a image capture device be assigned to described image capture time slot in it is one.
29. equipment according to claim 28, further comprise for store include time slot time slot data, camera mark Know and distribute at least one image capture the device of associated flash of light open instruction.
It further comprise for providing flash of light service controller to the multiple 30. equipment according to claim 28 The device of at least one of image capture device.
CN201580033775.1A 2014-06-30 2015-06-11 Flash of light collision detection, compensation and prevention Active CN106464814B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/319,670 US9363445B2 (en) 2014-06-30 2014-06-30 Flash collision detection, compensation, and prevention
US14/319,670 2014-06-30
PCT/US2015/035382 WO2016003623A1 (en) 2014-06-30 2015-06-11 Flash collision detection, compensation, and prevention

Publications (2)

Publication Number Publication Date
CN106464814A CN106464814A (en) 2017-02-22
CN106464814B true CN106464814B (en) 2019-04-05

Family

ID=53488467

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580033775.1A Active CN106464814B (en) 2014-06-30 2015-06-11 Flash of light collision detection, compensation and prevention

Country Status (3)

Country Link
EP (1) EP3162046A1 (en)
CN (1) CN106464814B (en)
WO (1) WO2016003623A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113994660B (en) * 2019-07-17 2024-01-09 Oppo广东移动通信有限公司 Intelligent flash intensity control system and method
CN114638831B (en) * 2022-05-18 2022-10-21 合肥宏晶半导体科技有限公司 Image analysis method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200302664A (en) * 2002-01-16 2003-08-01 Hewlett Packard Co System for near-simultaneous capture of multiple camera images
CN202736035U (en) * 2011-10-12 2013-02-13 陈伟坤 Device for wireless control of camera and flashlight working state parameters
CN103491291A (en) * 2013-09-23 2014-01-01 深圳市欧珀通信软件有限公司 Operation reminding method and device for photographing

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4731229B2 (en) * 2005-07-14 2011-07-20 イーストマン コダック カンパニー Digital camera
WO2008150904A1 (en) * 2007-05-29 2008-12-11 Lab Partners Associates, Inc. Power management system and method for photographic wireless communication
US8953094B2 (en) * 2011-11-10 2015-02-10 Apple Inc. Illumination system
US9036016B2 (en) * 2012-07-25 2015-05-19 Gopro, Inc. Initial camera mode management system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200302664A (en) * 2002-01-16 2003-08-01 Hewlett Packard Co System for near-simultaneous capture of multiple camera images
CN202736035U (en) * 2011-10-12 2013-02-13 陈伟坤 Device for wireless control of camera and flashlight working state parameters
CN103491291A (en) * 2013-09-23 2014-01-01 深圳市欧珀通信软件有限公司 Operation reminding method and device for photographing

Also Published As

Publication number Publication date
EP3162046A1 (en) 2017-05-03
CN106464814A (en) 2017-02-22
WO2016003623A1 (en) 2016-01-07

Similar Documents

Publication Publication Date Title
CN106664363B (en) Glisten collision detection and compensation system, method, equipment and computer-readable media
US10931897B2 (en) Systems and methods for a digital image sensor
US9451173B2 (en) Electronic device and control method of the same
CN106797453B (en) Image processing apparatus, photographic device, image processing method and image processing program
CN111064899B (en) Exposure parameter adjusting method and device
CN106716243A (en) Multi-LED camera flash for color temperature matching
CN109547701A (en) Image capturing method, device, storage medium and electronic equipment
CN106134189B (en) Image processing apparatus, photographic device, image processing method and program
CN110213502A (en) Image processing method, device, storage medium and electronic equipment
CN110958401A (en) Super night scene image color correction method and device and electronic equipment
CN107710755A (en) Dynamic frame for AWB is skipped
CN110290325A (en) Image processing method, device, storage medium and electronic equipment
CN109547699A (en) A kind of method and device taken pictures
CN107040697A (en) Use the method for imaging and relevant camera system of gaze detection
CN106464814B (en) Flash of light collision detection, compensation and prevention
US9485420B2 (en) Video imaging using plural virtual image capture devices
WO2015128897A1 (en) Digital cameras having reduced startup time, and related devices, methods, and computer program products
CN109845241A (en) Photographic device, image capture method and program
CN110266965A (en) Image processing method, device, storage medium and electronic equipment
JPWO2019187648A1 (en) Imaging equipment, imaging methods, programs and recording media
WO2020255715A1 (en) Image processing device, imaging device, image processing method, and image processing program
CN109391804A (en) Photographic device, image processing apparatus and system, control method and storage medium
WO2018170727A1 (en) Method and apparatus for determining pickup parameters and electronic equipment
CN106454089A (en) Photographing reminding method and device for camera

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant