WO2015107253A1 - Method and apparatus for pulsed flashlight - Google Patents
Method and apparatus for pulsed flashlight Download PDFInfo
- Publication number
- WO2015107253A1 WO2015107253A1 PCT/FI2014/050027 FI2014050027W WO2015107253A1 WO 2015107253 A1 WO2015107253 A1 WO 2015107253A1 FI 2014050027 W FI2014050027 W FI 2014050027W WO 2015107253 A1 WO2015107253 A1 WO 2015107253A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- pulses
- read
- flash
- pulse
- flash unit
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 238000004590 computer program Methods 0.000 claims abstract description 11
- 238000005286 illumination Methods 0.000 claims description 14
- 230000001960 triggered effect Effects 0.000 claims description 14
- 239000003990 capacitor Substances 0.000 description 13
- 229910052724 xenon Inorganic materials 0.000 description 7
- FHNFHKCVQCLJFQ-UHFFFAOYSA-N xenon atom Chemical compound [Xe] FHNFHKCVQCLJFQ-UHFFFAOYSA-N 0.000 description 7
- 230000000694 effects Effects 0.000 description 6
- 238000003860 storage Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 239000007789 gas Substances 0.000 description 4
- 238000005096 rolling process Methods 0.000 description 4
- 238000003384 imaging method Methods 0.000 description 3
- XKRFYHLGVUSROY-UHFFFAOYSA-N Argon Chemical compound [Ar] XKRFYHLGVUSROY-UHFFFAOYSA-N 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000977 initiatory effect Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002085 persistent effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 206010021033 Hypomenorrhoea Diseases 0.000 description 1
- 241000593989 Scardinius erythrophthalmus Species 0.000 description 1
- 229910052786 argon Inorganic materials 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000779 depleting effect Effects 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 229910052743 krypton Inorganic materials 0.000 description 1
- DNNSSWSSYDEUBZ-UHFFFAOYSA-N krypton atom Chemical compound [Kr] DNNSSWSSYDEUBZ-UHFFFAOYSA-N 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 201000005111 ocular hyperemia Diseases 0.000 description 1
- 229920000642 polymer Polymers 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000011514 reflex Effects 0.000 description 1
- 239000007784 solid electrolyte Substances 0.000 description 1
- 230000002459 sustained effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B41/00—Circuit arrangements or apparatus for igniting or operating discharge lamps
- H05B41/14—Circuit arrangements
- H05B41/30—Circuit arrangements in which the lamp is fed by pulses, e.g. flash lamp
- H05B41/34—Circuit arrangements in which the lamp is fed by pulses, e.g. flash lamp to provide a sequence of flashes
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
- G03B15/02—Illuminating scene
- G03B15/03—Combinations of cameras with lighting apparatus; Flash units
- G03B15/05—Combinations of cameras with electronic flash apparatus; Electronic flash units
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
Definitions
- the present application generally relates to pulsed flashlight. BACKGROUND This section illustrates useful information for understanding the present application without admission of any technique described herein representative of the state of the art.
- CMOS complementary metal-oxide semiconductor
- Flashlight is often used in photography to assist exposing images. For instance, flashlight is used when more light is needed or when shorter exposure time is desired for stopping high-speed motion. Sometimes flash is also used for fill-in light to avoid undesired shadows when photographing an object against bright light. The amount of additional flashlight illumination must be balanced with backlight illumination of the object.
- Flashlights of portable electronic devices are usually xenon flash lights or light emitting diode (LED) based flash lights.
- a typical xenon flash light produces pulses of some microseconds using external triggering up to few milliseconds based on energy stored in a high power capacitor.
- a LED flash typically operates directly using the battery of the portable electronic device and can produce illumination over longer periods.
- a flashgun of an SLR has its own power supply, e.g. an array of batteries and a rather efficient capacitor.
- the xenon flash lights are normally found in dedicated cameras or high end camera phones, whereas the LED flash light is typical in entry-level devices thanks to its low production cost.
- a LED flash light needs no capacitor, either.
- the inventors have studied the use of flashlights and made a number of findings.
- a high-power and high-speed flash gun of a digital SLR camera can sustain desired intensity of illumination over the entire exposure time (up to e.g. 1/200 s i.e. 5 ms) by producing an uninterrupted train of externally triggered high-power pulses that maintain constant flashlight illumination the intensity of which fluctuates by an amount that enables digital correction (e.g. 50 % of the maximum illumination power). That the SLR camera's flash gun can sustain a train of externally triggered flash pulses is enabled by a dedicated powerful capacitor and power source that may not fit in typical mobile phones, for example.
- the sustained train of pulses may be long enough for fast SLR sensor read-out circuitries, but too short for some high resolution image sensor equipped portable devices such as camera phones with 40 million camera pixels in which radio interference compliance and / or cost factors may limit the speed of the read-out circuitries.
- the external triggering is the most common one of the many ways to trigger a flashtube.
- Simmer voltage triggering is one of the other alternatives.
- the electrodes are electrified by a high voltage spark streamer that is maintained between the electrodes of the flashtube.
- Such triggering is mainly used in very fast rise time systems that discharge normally in about 1 ⁇ (e.g. for stop-motion photography).
- multi-frame imaging can be used to capture images with different flash timing and combine a single frame using the illuminated parts of two or more images, provided that the imaging object and camera are stable over extended time needed for taking plural images by the image sensor.
- an apparatus comprising:
- the flash pulse control information may comprise an indication of a time at which each of the pulses should be produced.
- the flash pulse control information may comprise an indication of an amount of illumination energy with which each of the pulses should be produced.
- the flash pulse control information may comprise separate control information parts for different pulses to be produced.
- the time of receipt of each of the control information parts may be indicative of the time at which the pulse in question should be produced.
- the controller may be configured to cause producing each of the flash pulses immediately in response to receiving respective control information parts.
- the apparatus may comprise an image sensor configured to take a digital image during the exposure time using flashlight produced by the flash unit.
- the apparatus may comprise an image sensor control circuitry configured to reset the image sensor for beginning exposing a digital image.
- the image sensor control circuitry configured to read lines of pixels of the image sensor by read-out of pixel lines. The resetting may be performed sequentially by lines of pixels, line by line. The read-out of the lines of pixels may be performed sequentially by lines of pixels, line by line.
- the image sensor control circuitry may be configured to provide each line of pixels of the image sensor an equal exposure time by scanning the lines of pixels with same rate on resetting and reading the lines of pixels.
- the lines of pixels of the image sensor may be referred to as read-out lines.
- the apparatus may comprise the flash unit.
- the apparatus may be a battery operated apparatus.
- the apparatus may comprise a battery as a power supply.
- the flash unit may be configured to produce the plurality of pulses by simmer voltage triggering.
- the controller may be a processor.
- the controller may be a transistor such as an insulated gate bipolar transistor.
- the flash unit may be a gas discharge flash unit.
- the flash unit may be a high power light emitting diode flash equipped with a super capacitor energy supply.
- the flash unit may be controlled to emit light at least 500 or 1000 times brighter at the peak of the pulses than at the lowest light emission between the pulses.
- the controller may be configured to identify from the flash pulse control information pulse beginning moments and to cause the flash unit to begin each pulse on a pulse beginning moment.
- the flash pulse control information may comprise an indication of plural read-out events comprising for each band of read-out lines: a beginning time of resetting read-out lines; an end time of resetting read-out lines; a beginning time of reading read-out lines; and an end time of reading read-out lines.
- the read-out of one band may begin as the reset of that band ends.
- the readout may begin after a common exposure period in which all the lines of pixels of the band are reset but not yet read-out.
- the common exposure period may be at most 1 to 10 % of the period of time taken from a read-out duration that is the duration from the start of the read-out of the first line of the band to the end of the read-out of the last line of the band.
- the pulses may be timed to occur at least partly during the common exposure period.
- the time taken from the beginning of resetting a first line of a band to the beginning of the read-out of the first line of the band may be referred to as exposure time.
- the exposure time may be substantially constant for all read-out lines.
- the exposure time may exceed 5 ms.
- the exposure time may exceed 10 ms.
- the exposure time may exceed 20 ms.
- the exposure time may exceed 25 ms.
- the exposure time may be less or equal to 100 ms.
- the exposure time may be less or equal to 50 ms.
- Each of pulses may be configured to produce identical or corresponding energy.
- the plurality of pulses may comprise two pulses that last for identical durations. Alternatively, the different pulses may last for different times. Shorter pulses may be compensated by higher power so that the light energy from one pulse to next pulse or the end of the exposure time remains constant or substantially constant.
- the pulses may be configured to cause identical or corresponding exposure for all or most of the lines of pixels of the image sensor.
- the flash unit may comprise the gas discharge flash tube.
- the flash unit may comprise a xenon flash light.
- the flash unit may comprise a thyristor for initiating simmering in the flash unit.
- the flash unit may be further configured for external triggering for producing a single flash pulse that is stronger than those that can be produced by the simmering.
- the apparatus may be further configured to use the externally triggered single flash pulse when such a pulse is better suited for the photographing than one or more pulses produced by simmering.
- the controller may be configured to control the flash unit according to the flash pulse control information to produce N pulses, wherein N is 2, 3, 4, 5, 6 or greater than 6.
- the apparatus may be configured to adapt N depending on at least one of: ambient light level; desired exposure extent; image sensor sensitivity or ISO value; duration of readout of read-out lines needed for taking the digital image; battery level of the apparatus; charging level of a capacitor that supplies power to the flash unit; and capacitance of a capacitor that supplies power to the flash unit.
- a flash unit controlling according to the flash pulse control information a flash unit to produce a plurality of pulses interspersed at desired times during exposure of a digital image.
- a method comprising: providing separate flash light pulses for separately illuminating two or more bands of read-out lines of an image sensor during common exposure period of all read- out lines of each band.
- the method may further comprise receiving flash pulse control information and controlling the providing of the separate flash light pulses according to the flash pulse control information.
- the method may further comprise producing or causing of the producing the pulses using a gas discharge flash unit using simmering triggering.
- a computer program comprising computer executable program code configured to cause an apparatus perform, when executing the program code, the method of the second or third example aspect.
- a memory medium comprising the computer program of the fourth example aspect.
- an apparatus comprising means for executing the method of the second or third example aspect.
- an apparatus comprising a memory storing the computer program of the fourth example aspect and a processor configured to execute the computer program.
- Any foregoing memory medium may comprise a digital data storage such as a data disc or diskette, optical storage, magnetic storage, holographic storage, opto-magnetic storage, phase-change memory, resistive random access memory, magnetic random access memory, solid-electrolyte memory, ferroelectric random access memory, organic memory or polymer memory.
- the memory medium may be formed into a device without other substantial functions than storing memory or it may be formed as part of a device with other functions, including but not limited to a memory of a computer, a chip set, and a sub assembly of an electronic device.
- Fig. 1 shows an architectural overview of a system of an example embodiment of the invention
- Fig. 2 shows a block diagram of an apparatus that could be used as the camera device in an example embodiment
- Fig. 3 shows an exemplary timing chart illustrating various events and intensities of pulses formed according to an example embodiment
- Fig. 4 shows an exemplary timing chart illustrating various events and intensities of pulses formed according to an example embodiment
- Fig. 5 shows an exemplary timing chart illustrating various events and intensities of pulses formed according to an example embodiment
- Fig. 6 shows a process according to an example embodiment.
- Fig. 1 shows an architectural overview of a system of an example embodiment of the invention.
- the system comprises a camera device 100 (such as a portable device e.g. a mobile phone), an image object 1 10 and a backlight 120 such as the sun.
- a camera device 100 such as a portable device e.g. a mobile phone
- an image object 1 10 such as a portable device e.g. a mobile phone
- a backlight 120 such as the sun.
- Fig. 2 shows a block diagram of an apparatus 200 that could be used as the camera device 100 in an example embodiment.
- the apparatus 200 comprises:
- a flash unit 210 e.g. e.g. a gas discharge flash unit comprising a xenon, krypton or argon flash tube and a thyristor for initiating simmering in the flash tube;
- an input 220 configured to obtain flash pulse control information (the input being e.g. a dedicated data port or a logical input provided by a general data port such an internal data bus of a device or at simplest e.g. a pair of electric connections);
- controller 230 configured to receive the flash pulse control information and to accordingly control the flash unit 210 to produce a plurality of pulses interspersed at desired times during exposure of a digital image (the controller being formed using one or more dedicated or general processors such as central processing units and digital signal processors on in some embodiments of one or more components such as insulated gate bipolar transistors);
- an image sensor 240 e.g. a CMOS sensor
- a battery 250 for providing operating voltage
- the image sensor control circuitry can be configured to reset and subsequently read the read-out lines 242. The resetting can be performed sequentially by lines of pixels, line by line as well as the read-out of the read-out lines 242.
- the image sensor control circuitry is configured to provide each read-out line 242 an equal exposure time by scanning the lines of pixels with same rate on resetting and reading the lines of pixels.
- the apparatus 200 further comprises a memory 280.
- the memory 280 comprises, for example, any of: work memory 282 such as random access memory or flash random access memory; and persistent memory 284 such as flash random access memory, magnetic memory such as hard disc storage, optical memory such as cd-rom, and / or memory stick such as a universal serial bus memory stick.
- the memory 280 in Fig. 2 also comprises software 286.
- the controller 230 is a processor
- the software 286 is executed by the processor so that the processor can control operations of the apparatus 200 accordingly. It should be understood, though, that some operations can still be hardwired e.g. for simplicity and / speed.
- a flash light discharging can be triggered by a semiconductor such as a thyristor or transistor in response to receiving a suitable trigger signal.
- the controller 230 can also understandably be formed as a combination of software based operations (using a processor and software) and hardwired circuitry.
- the flash unit is configured to produce the plurality of pulses by simmer voltage triggering.
- the apparatus may relate to a decision making unit that controls other parts without comprising the image sensor 240 or other parts of cameras (optics, the flash unit etc.) or to a larger entirety comprising one or more further details described herein or known from digital imaging technology in general.
- the flash unit 210 is configured to emit light at least 500 or 1000 times brighter at the peak of the pulses than at the lowest light emission between the pulses. This is in contrast with e.g. the known DSLR flash guns that may produce a train of pulses within some 50 % fluctuation of intensity when measured over 5 % of the pulse duration i.e. among 20 samples.
- the controller 230 is configured to identify from the flash pulse control information pulse beginning moments and to cause the flash unit 210 to begin each pulse on a pulse beginning moment. These moments can be expressed e.g. as microseconds from the pulse beginning or some other time reference or by reference to some predetermined scheme such as a table in which a number of predetermined pulse beginning moments are defined.
- the flash pulse control information is received in two or more parts. For example, each pulse beginning moment can be separately indicated. Such separate indications can be interpreted by the controller 230 as an indication of a new pulse beginning moment.
- the controller 230 is configured to begin the first of the plurality of pulses as of the beginning of the exposure time.
- there can be a short delay after the beginning of the exposure time e.g. some hundreds of microseconds, provided that the first pulse has sufficient time to expose image pixels in the first read-out line before that line will be read.
- the sufficient time depends on the desired homogeneity of the exposure, the algorithms used for leveling brightness over the exposed image frame and on the shape of the pulse when considered in a time - intensity graph i.e. on the intensity distribution.
- the controller 230 is configured to end the last of the plurality of pulses before the end of the exposure time.
- the controller 230 can be configured to cause timing the pulses such that they end on beginning of the read-out of first read-out lines of a band of read-out lines.
- the exposure time can be varied based on the implementation.
- the exposure time can be greater or equal to any of 5 ms, 10 ms, 20 ms or 25 ms.
- the exposure time can be less or equal to 100 ms or 50 ms.
- the plurality of pulses comprises two pulses that last for identical durations.
- the image sensor is configured to expose each of the bands by the corresponding pulse before read-out of the lines in the band in question. To this end, the image sensor can be used in phases so that each band is reset, exposed using flash light and read one by one. In an example embodiment, additional illumination need is evaluated separately for each band and the energy of each pulse is correspondingly adjusted. For example, some of the bands may be correspond to objects too far to benefit from flash light illumination. The controller 230 can be configured not to produce any pulse at all for such a band to save power. Conversely, some bands may correspond to light and proximate objects that would easily be overexposed for which case the controller can be configured to reduce the energy of the corresponding pulse or omit altogether the corresponding pulse.
- the apparatus is a battery operated apparatus e.g. using a battery as a power supply.
- the capacitor 260 can be let to recharge after each pulse. However, it can be expected that with the battery power, the capacitor may lose charging from one pulse to the next so that each pulse begins with lower intensity than the one before.
- each of the pulses can be configured to produce identical or corresponding energy.
- the different pulses can last for different times and correspondingly. Lower flash intensity and power (e.g. on following pulses when the capacitor is depleting) can be compensated by greater pulse duration so that the light energy from one pulse to next pulse or the end of the exposure time remains constant or substantially constant.
- the pulses can be configured to cause identical or corresponding exposure for each read-out line of the image sensor.
- the flash unit 210 is further configured for external triggering for producing a single flash pulse that is stronger than those that can be produced by the simmering.
- the apparatus is configured to enable reading out only a selected portion of the read-out lines of the image sensor so that the read-out time of the selected portion of the read-out lines is not greater than the pulse time of the externally triggered single flash pulse.
- apparatus can be configured to use the externally triggered single flash pulse when such a pulse is better suited for the photographing than one or more pulses produced by simmering.
- the controller is further configured to determine operation characteristics of the flash unit 210.
- the controller 230 or another part such as a processor in the apparatus 200 can be configured to determine the pulse beginning moments taking into account of the determined operation characteristics.
- information received from the image sensor can be used as such to detect evenness of brightness in entire image frames and that evenness information can be used in addition or instead of the operation characteristics to adapt the operation of the apparatus.
- Fig. 3 shows an exemplary timing chart illustrating various events and intensities of pulses formed according to an example embodiment. The timing chart is greatly simplified so that there are only some tens of read-out lines to be reset and read in three different bands, each with about 20 read-out lines for illustrational reasons. In Fig.
- a digital image is taken in three bands using three respective pulses in order to illustrate some example embodiments better than two bands or with more bands.
- the number of pulses and bands can be adopted according to circumstances including, for example, the hardware configuration of the camera or image sensor and its read-out circuitry, the ambient light, and desired exposure.
- the flash pulses drawn and explained with reference to Fig. 3 relate to taking a digital image and there may be other flash pulses before Fig. 3 process e.g. for any of focusing; red-eye reduction; and / or automatic exposure adjustment.
- the flash pulse control information is obtained in step 310. Then, the pulse periods are determined 320.
- resetting 330 of the read-out lines of the first band is carried out.
- This first band of read-out lines comprises e.g. one third of the read-out lines 242.
- a pulse is caused 340 using the flash unit 210 for exposing the first band or the portion of it that has been reset but not yet read-out.
- the pulse is produced after the resetting 330 of the read-out lines of the first band is completed.
- the read-out of the first band is then started and carried out, 350. If Fig. 3, each pulse is produced to end just before read-out 350.
- the pulse can be let end after the read-out of first read-out lines and / or to start before the resetting of the last read-out lines of the band.
- Fig. 3 makes clear an interesting aspect of some example embodiments.
- the exposure time of each read-out line equals to the time as of resetting to read-out. For example, after resetting the first read-out line, some 19 other read-out lines are reset and then all the read-out lines have common exposure period that lasts for about 4 scan periods (time taken to read-out or reset one read-out line). Hence, the total exposure period is about 23 scan periods or line scan units as in the legend of the time axis of Fig. 3 out of which the common exposure period lasts about 17 %. If all the read-out lines of Fig. 3 were to be exposed by one pulse, then the exposure time would have to be at least 60 scan periods plus the pulse duration.
- the total read-out duration would be e.g. 20 ms, as the case could be with a high resolution image sensor of e.g. 40 Mpixels to 100 Mpixels.
- the exposure period should then be no shorter than 1/50 s, which would be too long for typical outdoors photographing with even little sunshine and usual optics.
- Fig. 4 illustrates an example embodiment in which resetting of the next band's read-out lines is started immediately after each pulse used to expose the preceding band's read-out lines. In that example embodiment, all the desired read-out lines 242 can be read with little additional delay.
- Fig. 5 illustrates another example embodiment in which the pulses are produced a little before completion of resetting of a band of read-out lines.
- the process exemplified by Fig. 3 can be carried such that all the read-out lines (from which image information is needed) are read in succession line by line without pause and possibly with constant speed so that two or more pulses are formed with a timing that enables all the read-out lines to be exposed by at least one of the pulses.
- Figs. 3 and 4 the resetting of the read-out lines 242 of the image sensor 240 pauses for the pulse and read operations time or at least for the time of each pulse. However, in an example embodiment, the resetting of the read-out lines 242 proceeds continuously without pausing from the first to last read-out line that is desired to be read.
- Fig. 5 shows a modification of Figs. 3 and 4 according to such an example embodiment. In sake of clarity of the drawing, some of the texts are now omitted. In this example embodiment, some read-out lines 242 are illuminated partly by two different pulses. This effect can be at least partly compensated by software. In one example embodiment, the sensitivity (ISO value) of these pixels on these read-out lines is reduced e.g. by reducing their biasing so as to reduce risk of over-exposure.
- Fig. 6 shows a process according to an example embodiment.
- the process comprises: obtaining 610 flash pulse control information; and controlling 620 according to the pulse control information a flash unit to produce a plurality of pulses interspersed at desired times during exposure of a digital image.
- a technical effect of one or more of the example embodiments disclosed herein is that an entire digital image can be sufficiently flash-light illuminated even if the read-out time of the image sensor takes most of the exposure period.
- Another technical effect of one or more of the example embodiments disclosed herein is that flash light can be used with exposure periods shorter than the read-out time of all read-out lines.
- Another technical effect of one or more of the example embodiments disclosed herein is that motion can be better stopped in pictures taken with flash on an image sensor with relatively long read-out time.
- Yet another technical effect of one or more of the example embodiments disclosed herein is that it may be possible to avoid containing an automatic neutral density filter that might be needed to enable long enough exposure when shooting against strong backlight that could otherwise be needed in advanced camera phones, for example.
- Embodiments of the present invention may be implemented in software, hardware, application logic or a combination of software, hardware and application logic.
- the software, application logic and/or hardware may reside on the work memory or persistent memory of the apparatus 200.
- the application logic, software or an instruction set is maintained on any one of various conventional computer-readable media.
- a "computer-readable medium" may be any non-transitory media or means that can contain, store, communicate, propagate or transport the instructions for use by or in connection with an instruction execution system, apparatus, or device, such as a computer, with one example of a computer described and depicted in Fig. 2 (in the embodiment that the controller comprises a computer program code execution capable element).
- a computer-readable medium may comprise a computer-readable storage medium that may be any media or means that can contain or store the instructions for use by or in connection with an instruction execution system, apparatus, or device, such as a computer. If desired, the different functions discussed herein may be performed in a different order and/or concurrently with each other. Furthermore, if desired, one or more of the before- described functions may be optional or may be combined.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Studio Devices (AREA)
Abstract
An apparatus, method and computer program are disclosed that in an example embodiment provide separate flash light pulses (340, 340', 340") for separately illuminating two or more bands of read-out lines of an image sensor during common exposure period of all read-out lines of each band. The flash light can be produced using a gas discharge flash using simmering triggering.
Description
METHOD AND APPARATUS FOR PULSED FLASHLIGHT
TECHNICAL FIELD
The present application generally relates to pulsed flashlight. BACKGROUND This section illustrates useful information for understanding the present application without admission of any technique described herein representative of the state of the art.
Digital cameras typically have a mechanical shutter or an electronic rolling shutter. In the latter case, whole picture is not exposing exactly simultaneously. This is caused by the operation of the most common image sensor, complementary metal-oxide semiconductor (CMOS) sensor. With CMOS sensor, lines of pixels are first initialized and after the exposure period read-out in the same order, e.g. top down. Therefore, vertical lines of objects that move sideways with relation to the image sensor became skewed.
While the rolling shutter effect is most notable with digital cameras without any mechanical shutter, typically the mechanical shutters move vertically (over the shorter side of the image area). At very high change of illumination e.g. caused by a lightning, different parts of the image area can be exposed very differently. Moreover, the speed of a mechanical shutter is finite, often in the range of 1/200 s. For higher speed, entry level single-lens reflex (SLR) cameras typically employ digital shutter only.
Flashlight is often used in photography to assist exposing images. For instance, flashlight is used when more light is needed or when shorter exposure time is desired for stopping high-speed motion. Sometimes flash is also used for fill-in light to avoid undesired shadows when photographing an object against bright light. The amount of additional flashlight illumination must be balanced with backlight illumination of the object.
Flashlights of portable electronic devices are usually xenon flash lights or light emitting diode (LED) based flash lights. A typical xenon flash light produces pulses of some microseconds using external triggering up to few milliseconds based on energy stored in a high power capacitor. A LED flash typically operates directly using the battery of the
portable electronic device and can produce illumination over longer periods. A flashgun of an SLR has its own power supply, e.g. an array of batteries and a rather efficient capacitor. The xenon flash lights are normally found in dedicated cameras or high end camera phones, whereas the LED flash light is typical in entry-level devices thanks to its low production cost. A LED flash light needs no capacitor, either.
SUMMARY
The inventors have studied the use of flashlights and made a number of findings.
With very high resolution image sensors, a relatively long time may be needed for reading the whole image sensor from a first line of an image to a last line. This time may be up to tens of milliseconds. In consequence, to illuminate the whole camera field of view by exposing entire image sensor same time with a flash, the flash should be triggered on such a moment, when whole sensor exposure is happening simultaneously. This may yet be impossible with some high-resolution portable camera devices.
Let us consider a scenario of a rolling shutter camera and a fast pulse high power flash. When flash is triggered, the flashlight illumination should last longer than the read-out- time. In return, fill-in-flash could be used in limited cases as otherwise either the flash cannot be triggered with short exposure times or the object close to the camera is under-exposed, or the exposure time needs to be too long so that the background easily becomes over-exposed. On the other hand, if the exposure time of the image sensor is shorter than its read-out-time and a fast flash pulse is triggered, only part of the image is illuminated by the flash. For example, top part of the image may remain dark, when lower part is properly illuminated with the flash.
While it is not known that these issues would have been identified in the prior art, there are different solutions that may coincidentally avoid them. For example, using a mechanical shutter and a xenon flash, all the pixels can be exposed using the flash light during a small proportion of the exposure time. By blocking light by the mechanical shutter for the exposure time that exceeds the flash light period, each scan line of the image sensor can be exposed during exactly same period even if their reading subsequently takes place line by line. In result, the entire image area is homogenously exposed. On the other hand, some LED flashes produce flash pulses that last long enough to illuminate the image object over the entire exposure time thereby also
averting partial illumination of images. Also a high-power and high-speed flash gun of a digital SLR camera can sustain desired intensity of illumination over the entire exposure time (up to e.g. 1/200 s i.e. 5 ms) by producing an uninterrupted train of externally triggered high-power pulses that maintain constant flashlight illumination the intensity of which fluctuates by an amount that enables digital correction (e.g. 50 % of the maximum illumination power). That the SLR camera's flash gun can sustain a train of externally triggered flash pulses is enabled by a dedicated powerful capacitor and power source that may not fit in typical mobile phones, for example. Moreover, the sustained train of pulses may be long enough for fast SLR sensor read-out circuitries, but too short for some high resolution image sensor equipped portable devices such as camera phones with 40 million camera pixels in which radio interference compliance and / or cost factors may limit the speed of the read-out circuitries.
The external triggering is the most common one of the many ways to trigger a flashtube. Simmer voltage triggering (simmering in short) is one of the other alternatives. In simmering, the electrodes are electrified by a high voltage spark streamer that is maintained between the electrodes of the flashtube. Such triggering is mainly used in very fast rise time systems that discharge normally in about 1 με (e.g. for stop-motion photography).
It is also known that high current draw tends to create electric interference that may be damaging for reading and interpreting low voltage analog signals from the image sensor. It remains impossible or impractical with the known technical solutions to produce plural xenon flash light pulses in a portable device that has limited space for housing high capacity capacitor and limited battery power that is needed also for image processing. As such, fill-in flash with slow rolling shutter may be impossible to produce as such in good quality. Instead, multi-frame imaging can be used to capture images with different flash timing and combine a single frame using the illuminated parts of two or more images, provided that the imaging object and camera are stable over extended time needed for taking plural images by the image sensor.
Various aspects of examples of the invention are set out in the claims.
According to a first example aspect of the present invention, there is provided an apparatus, comprising:
an input configured to obtain flash pulse control information; and
a controller configured to receive the flash pulse control information and to accordingly control a flash unit to produce a plurality of pulses interspersed at desired times during exposure of a digital image.
The flash pulse control information may comprise an indication of a time at which each of the pulses should be produced. The flash pulse control information may comprise an indication of an amount of illumination energy with which each of the pulses should be produced.
The flash pulse control information may comprise separate control information parts for different pulses to be produced. The time of receipt of each of the control information parts may be indicative of the time at which the pulse in question should be produced. The controller may be configured to cause producing each of the flash pulses immediately in response to receiving respective control information parts.
The apparatus may comprise an image sensor configured to take a digital image during the exposure time using flashlight produced by the flash unit.
The apparatus may comprise an image sensor control circuitry configured to reset the image sensor for beginning exposing a digital image. The image sensor control circuitry configured to read lines of pixels of the image sensor by read-out of pixel lines. The resetting may be performed sequentially by lines of pixels, line by line. The read-out of the lines of pixels may be performed sequentially by lines of pixels, line by line. The image sensor control circuitry may be configured to provide each line of pixels of the image sensor an equal exposure time by scanning the lines of pixels with same rate on resetting and reading the lines of pixels. The lines of pixels of the image sensor may be referred to as read-out lines.
The apparatus may comprise the flash unit.
The apparatus may be a battery operated apparatus. The apparatus may comprise a battery as a power supply.
The flash unit may be configured to produce the plurality of pulses by simmer voltage triggering. The controller may be a processor. Alternatively, the controller may be a transistor such as an insulated gate bipolar transistor.
The flash unit may be a gas discharge flash unit. Alternatively, the flash unit may be a high power light emitting diode flash equipped with a super capacitor energy supply.
The flash unit may be controlled to emit light at least 500 or 1000 times brighter at the peak of the pulses than at the lowest light emission between the pulses. The controller may be configured to identify from the flash pulse control information pulse beginning moments and to cause the flash unit to begin each pulse on a pulse beginning moment.
The flash pulse control information may comprise an indication of plural read-out events comprising for each band of read-out lines: a beginning time of resetting read-out lines; an end time of resetting read-out lines; a beginning time of reading read-out lines; and an end time of reading read-out lines.
The read-out of one band may begin as the reset of that band ends. Alternatively, the readout may begin after a common exposure period in which all the lines of pixels of the band are reset but not yet read-out. The common exposure period may be at most 1 to 10 % of the period of time taken from a read-out duration that is the duration from the start of the read-out of the first line of the band to the end of the read-out of the last line of the band. The pulses may be timed to occur at least partly during the common exposure period. The time taken from the beginning of resetting a first line of a band to the beginning of the read-out of the first line of the band may be referred to as exposure time. The exposure time may be substantially constant for all read-out lines.
The exposure time may exceed 5 ms. The exposure time may exceed 10 ms. The exposure time may exceed 20 ms. The exposure time may exceed 25 ms.
The exposure time may be less or equal to 100 ms. The exposure time may be less or equal to 50 ms. Each of pulses may be configured to produce identical or corresponding energy. The plurality of pulses may comprise two pulses that last for identical durations. Alternatively, the different pulses may last for different times. Shorter pulses may be compensated by higher power so that the light energy from one pulse to next pulse or the end of the exposure time remains constant or substantially constant.
The pulses may be configured to cause identical or corresponding exposure for all or most of the lines of pixels of the image sensor.
The flash unit may comprise the gas discharge flash tube. The flash unit may comprise a xenon flash light. The flash unit may comprise a thyristor for initiating simmering in the flash unit. The flash unit may be further configured for external triggering for producing a single flash pulse that is stronger than those that can be produced by the simmering.
The apparatus may be further configured to use the externally triggered single flash pulse when such a pulse is better suited for the photographing than one or more pulses produced by simmering.
The controller may be configured to control the flash unit according to the flash pulse control information to produce N pulses, wherein N is 2, 3, 4, 5, 6 or greater than 6. The apparatus may be configured to adapt N depending on at least one of: ambient light level; desired exposure extent; image sensor sensitivity or ISO value; duration of readout of read-out lines needed for taking the digital image; battery level of the apparatus; charging level of a capacitor that supplies power to the flash unit; and capacitance of a capacitor that supplies power to the flash unit.
According to a second example aspect of the present invention, there is provided a method comprising:
obtaining flash pulse control information; and
controlling according to the flash pulse control information a flash unit to produce a plurality of pulses interspersed at desired times during exposure of a digital image.
According to a third example aspect of the present invention, there is provided a method comprising: providing separate flash light pulses for separately illuminating two or more bands of read-out lines of an image sensor during common exposure period of all read- out lines of each band. The method may further comprise receiving flash pulse control information and controlling the providing of the separate flash light pulses according to the flash pulse control information. The method may further comprise producing or causing of the producing the pulses using a gas discharge flash unit using simmering triggering.
According to a fourth example aspect of the present invention, there is provided a computer program comprising computer executable program code configured to cause an apparatus perform, when executing the program code, the method of the second or third example aspect.
According to a fifth example aspect of the present invention, there is provided a memory medium comprising the computer program of the fourth example aspect. According to a sixth example aspect of the present invention, there is provided an apparatus comprising means for executing the method of the second or third example aspect.
According to a seventh example aspect of the present invention, there is provided an apparatus comprising a memory storing the computer program of the fourth example aspect and a processor configured to execute the computer program.
Any foregoing memory medium may comprise a digital data storage such as a data disc or diskette, optical storage, magnetic storage, holographic storage, opto-magnetic storage, phase-change memory, resistive random access memory, magnetic random access memory, solid-electrolyte memory, ferroelectric random access memory, organic memory or polymer memory. The memory medium may be formed into a device without other substantial functions than storing memory or it may be formed as part of a device with other functions, including but not limited to a memory of a computer, a chip set, and a sub assembly of an electronic device.
Different non-binding example aspects and embodiments of the present invention have been illustrated in the foregoing. The embodiments in the foregoing are used merely to explain selected aspects or steps that may be utilized in implementations of the present invention. Some embodiments may be presented only with reference to certain example aspects of the invention. It should be appreciated that corresponding embodiments may apply to other example aspects as well.
BRIEF DESCRIPTION OF THE DRAWINGS
For a more complete understanding of example embodiments of the present invention, reference is now made to the following descriptions taken in connection with the accompanying drawings in which:
Fig. 1 shows an architectural overview of a system of an example embodiment of the invention;
Fig. 2 shows a block diagram of an apparatus that could be used as the camera device in an example embodiment;
Fig. 3 shows an exemplary timing chart illustrating various events and intensities of pulses formed according to an example embodiment;
Fig. 4 shows an exemplary timing chart illustrating various events and intensities of pulses formed according to an example embodiment;
Fig. 5 shows an exemplary timing chart illustrating various events and intensities of pulses formed according to an example embodiment; and
Fig. 6 shows a process according to an example embodiment.
DETAILED DESCRIPTION OF THE DRAWINGS
An example embodiment of the present invention and its potential advantages are understood by referring to Figs. 1 through 3 of the drawings. In this document, like reference signs denote like parts or steps.
Fig. 1 shows an architectural overview of a system of an example embodiment of the invention. The system comprises a camera device 100 (such as a portable device e.g. a mobile phone), an image object 1 10 and a backlight 120 such as the sun.
Fig. 2 shows a block diagram of an apparatus 200 that could be used as the camera device 100 in an example embodiment. The apparatus 200 comprises:
a flash unit 210 (e.g. e.g. a gas discharge flash unit comprising a xenon, krypton or argon flash tube and a thyristor for initiating simmering in the flash tube);
an input 220 configured to obtain flash pulse control information (the input being e.g. a dedicated data port or a logical input provided by a general data port such an internal data bus of a device or at simplest e.g. a pair of electric connections);
a controller 230 configured to receive the flash pulse control information and to accordingly control the flash unit 210 to produce a plurality of pulses interspersed at desired times during exposure of a digital image (the controller being formed using one or more dedicated or general processors such as central processing units and digital signal processors on in some embodiments of one or more components such as insulated gate bipolar transistors);
an image sensor 240 (e.g. a CMOS sensor) comprising a plurality of read-out lines 242 that each comprise a number of image sensor pixels that can be reset and read-out; a battery 250 for providing operating voltage; and
a capacitor 260 for enabling high instantaneous power draw by the unit 210; and an image sensor control circuitry 270 for controlling operations of the image sensor 240. For example, the image sensor control circuitry can be configured to reset and subsequently read the read-out lines 242. The resetting can be performed sequentially by lines of pixels, line by line as well as the read-out of the read-out lines 242. In an example embodiment, the image sensor control circuitry is configured to provide each
read-out line 242 an equal exposure time by scanning the lines of pixels with same rate on resetting and reading the lines of pixels.
In an example embodiment, the apparatus 200 further comprises a memory 280. The memory 280 comprises, for example, any of: work memory 282 such as random access memory or flash random access memory; and persistent memory 284 such as flash random access memory, magnetic memory such as hard disc storage, optical memory such as cd-rom, and / or memory stick such as a universal serial bus memory stick. The memory 280 in Fig. 2 also comprises software 286. In case the controller 230 is a processor, the software 286 is executed by the processor so that the processor can control operations of the apparatus 200 accordingly. It should be understood, though, that some operations can still be hardwired e.g. for simplicity and / speed. For example, a flash light discharging can be triggered by a semiconductor such as a thyristor or transistor in response to receiving a suitable trigger signal. Hence, the controller 230 can also understandably be formed as a combination of software based operations (using a processor and software) and hardwired circuitry.
In an example embodiment, the flash unit is configured to produce the plurality of pulses by simmer voltage triggering.
It should be understood that in some other examples and especially in some of the appended claims, the apparatus may relate to a decision making unit that controls other parts without comprising the image sensor 240 or other parts of cameras (optics, the flash unit etc.) or to a larger entirety comprising one or more further details described herein or known from digital imaging technology in general.
In an example embodiment, the flash unit 210 is configured to emit light at least 500 or 1000 times brighter at the peak of the pulses than at the lowest light emission between the pulses. This is in contrast with e.g. the known DSLR flash guns that may produce a train of pulses within some 50 % fluctuation of intensity when measured over 5 % of the pulse duration i.e. among 20 samples.
In an example embodiment, the controller 230 is configured to identify from the flash pulse control information pulse beginning moments and to cause the flash unit 210 to begin each pulse on a pulse beginning moment. These moments can be expressed e.g. as microseconds from the pulse beginning or some other time reference or by reference to some predetermined scheme such as a table in which a number of predetermined pulse beginning moments are defined. In another example embodiment, the flash pulse control information is received in two or more parts. For example, each pulse beginning
moment can be separately indicated. Such separate indications can be interpreted by the controller 230 as an indication of a new pulse beginning moment.
In an example embodiment, the controller 230 is configured to begin the first of the plurality of pulses as of the beginning of the exposure time. In practice, there can be a short delay after the beginning of the exposure time, e.g. some hundreds of microseconds, provided that the first pulse has sufficient time to expose image pixels in the first read-out line before that line will be read. With this regard, the sufficient time depends on the desired homogeneity of the exposure, the algorithms used for leveling brightness over the exposed image frame and on the shape of the pulse when considered in a time - intensity graph i.e. on the intensity distribution.
In an example embodiment, the controller 230 is configured to end the last of the plurality of pulses before the end of the exposure time. For example, the controller 230 can be configured to cause timing the pulses such that they end on beginning of the read-out of first read-out lines of a band of read-out lines.
The exposure time can be varied based on the implementation. For example, the exposure time can be greater or equal to any of 5 ms, 10 ms, 20 ms or 25 ms. On the other hand, the exposure time can be less or equal to 100 ms or 50 ms.
In an example embodiment, the plurality of pulses comprises two pulses that last for identical durations. In an example embodiment, the image sensor is configured to expose each of the bands by the corresponding pulse before read-out of the lines in the band in question. To this end, the image sensor can be used in phases so that each band is reset, exposed using flash light and read one by one. In an example embodiment, additional illumination need is evaluated separately for each band and the energy of each pulse is correspondingly adjusted. For example, some of the bands may be correspond to objects too far to benefit from flash light illumination. The controller 230 can be configured not to produce any pulse at all for such a band to save power. Conversely, some bands may correspond to light and proximate objects that would easily be overexposed for which case the controller can be configured to reduce the energy of the corresponding pulse or omit altogether the corresponding pulse.
In an example embodiment, the apparatus is a battery operated apparatus e.g. using a battery as a power supply. The capacitor 260 can be let to recharge after each pulse. However, it can be expected that with the battery power, the capacitor may lose
charging from one pulse to the next so that each pulse begins with lower intensity than the one before. To this end, each of the pulses can be configured to produce identical or corresponding energy. The different pulses can last for different times and correspondingly. Lower flash intensity and power (e.g. on following pulses when the capacitor is depleting) can be compensated by greater pulse duration so that the light energy from one pulse to next pulse or the end of the exposure time remains constant or substantially constant. The pulses can be configured to cause identical or corresponding exposure for each read-out line of the image sensor. In an example embodiment, the flash unit 210 is further configured for external triggering for producing a single flash pulse that is stronger than those that can be produced by the simmering.
In an example embodiment, the apparatus is configured to enable reading out only a selected portion of the read-out lines of the image sensor so that the read-out time of the selected portion of the read-out lines is not greater than the pulse time of the externally triggered single flash pulse. For instance, apparatus can be configured to use the externally triggered single flash pulse when such a pulse is better suited for the photographing than one or more pulses produced by simmering.
In an example embodiment, the controller is further configured to determine operation characteristics of the flash unit 210. The controller 230 or another part such as a processor in the apparatus 200 can be configured to determine the pulse beginning moments taking into account of the determined operation characteristics. Moreover, information received from the image sensor can be used as such to detect evenness of brightness in entire image frames and that evenness information can be used in addition or instead of the operation characteristics to adapt the operation of the apparatus. Fig. 3 shows an exemplary timing chart illustrating various events and intensities of pulses formed according to an example embodiment. The timing chart is greatly simplified so that there are only some tens of read-out lines to be reset and read in three different bands, each with about 20 read-out lines for illustrational reasons. In Fig. 3, a digital image is taken in three bands using three respective pulses in order to illustrate some example embodiments better than two bands or with more bands. It should be borne in mind that the number of pulses and bands can be adopted according to circumstances including, for example, the hardware configuration of the camera or image sensor and its read-out circuitry, the ambient light, and desired exposure. It should also be understood that the flash pulses drawn and explained with reference to
Fig. 3 relate to taking a digital image and there may be other flash pulses before Fig. 3 process e.g. for any of focusing; red-eye reduction; and / or automatic exposure adjustment. The flash pulse control information is obtained in step 310. Then, the pulse periods are determined 320. In order to start exposing the image sensor in a first band, resetting 330 of the read-out lines of the first band is carried out. This first band of read-out lines comprises e.g. one third of the read-out lines 242. A pulse is caused 340 using the flash unit 210 for exposing the first band or the portion of it that has been reset but not yet read-out. In Fig. 3, the pulse is produced after the resetting 330 of the read-out lines of the first band is completed. The read-out of the first band is then started and carried out, 350. If Fig. 3, each pulse is produced to end just before read-out 350. If the common exposure time of all read-out lines 242 of one band of read-out lines 242 is not long enough for a pulse duration (e.g. capacitor depleted that far that a longer pulse would be needed), the pulse can be let end after the read-out of first read-out lines and / or to start before the resetting of the last read-out lines of the band.
Fig. 3 makes clear an interesting aspect of some example embodiments. The exposure time of each read-out line equals to the time as of resetting to read-out. For example, after resetting the first read-out line, some 19 other read-out lines are reset and then all the read-out lines have common exposure period that lasts for about 4 scan periods (time taken to read-out or reset one read-out line). Hence, the total exposure period is about 23 scan periods or line scan units as in the legend of the time axis of Fig. 3 out of which the common exposure period lasts about 17 %. If all the read-out lines of Fig. 3 were to be exposed by one pulse, then the exposure time would have to be at least 60 scan periods plus the pulse duration. Assume that the total read-out duration would be e.g. 20 ms, as the case could be with a high resolution image sensor of e.g. 40 Mpixels to 100 Mpixels. The exposure period should then be no shorter than 1/50 s, which would be too long for typical outdoors photographing with even little sunshine and usual optics.
During (see Fig. 4) or after (as in Fig. 3) the read-out of the first band, resetting of a second band of read-out lines (adjacent to the first band) is started and carried out, 330', a second pulse (340') is formed (starting moment) after resetting all the read-out lines of the second band and the read-out of the second band is carried out, 350'. There are different other embodiments with this respect. For example, Fig. 4 illustrates an example embodiment in which resetting of the next band's read-out lines is started immediately after each pulse used to expose the preceding band's read-out lines. In that example embodiment, all the desired read-out lines 242 can be read with little
additional delay. Further, Fig. 5 illustrates another example embodiment in which the pulses are produced a little before completion of resetting of a band of read-out lines.
Next, resetting 330", exposing 340 " and read-out 350" of a third band of read-out lines (adjacent to the second band) is performed correspondingly with the second band.
The process exemplified by Fig. 3 can be carried such that all the read-out lines (from which image information is needed) are read in succession line by line without pause and possibly with constant speed so that two or more pulses are formed with a timing that enables all the read-out lines to be exposed by at least one of the pulses.
In Figs. 3 and 4, the resetting of the read-out lines 242 of the image sensor 240 pauses for the pulse and read operations time or at least for the time of each pulse. However, in an example embodiment, the resetting of the read-out lines 242 proceeds continuously without pausing from the first to last read-out line that is desired to be read. Fig. 5 shows a modification of Figs. 3 and 4 according to such an example embodiment. In sake of clarity of the drawing, some of the texts are now omitted. In this example embodiment, some read-out lines 242 are illuminated partly by two different pulses. This effect can be at least partly compensated by software. In one example embodiment, the sensitivity (ISO value) of these pixels on these read-out lines is reduced e.g. by reducing their biasing so as to reduce risk of over-exposure.
Fig. 6 shows a process according to an example embodiment. The process comprises: obtaining 610 flash pulse control information; and controlling 620 according to the pulse control information a flash unit to produce a plurality of pulses interspersed at desired times during exposure of a digital image.
Without in any way limiting the scope, interpretation, or application of the claims appearing below, a technical effect of one or more of the example embodiments disclosed herein is that an entire digital image can be sufficiently flash-light illuminated even if the read-out time of the image sensor takes most of the exposure period. Another technical effect of one or more of the example embodiments disclosed herein is that flash light can be used with exposure periods shorter than the read-out time of all read-out lines. Another technical effect of one or more of the example embodiments disclosed herein is that motion can be better stopped in pictures taken with flash on an image sensor with relatively long read-out time. Yet another technical effect of one or more of the example embodiments disclosed herein is that it may be possible to avoid containing an automatic neutral density filter that might be needed to enable long
enough exposure when shooting against strong backlight that could otherwise be needed in advanced camera phones, for example.
Embodiments of the present invention may be implemented in software, hardware, application logic or a combination of software, hardware and application logic. The software, application logic and/or hardware may reside on the work memory or persistent memory of the apparatus 200. In an example embodiment, the application logic, software or an instruction set is maintained on any one of various conventional computer-readable media. In the context of this document, a "computer-readable medium" may be any non-transitory media or means that can contain, store, communicate, propagate or transport the instructions for use by or in connection with an instruction execution system, apparatus, or device, such as a computer, with one example of a computer described and depicted in Fig. 2 (in the embodiment that the controller comprises a computer program code execution capable element). A computer-readable medium may comprise a computer-readable storage medium that may be any media or means that can contain or store the instructions for use by or in connection with an instruction execution system, apparatus, or device, such as a computer. If desired, the different functions discussed herein may be performed in a different order and/or concurrently with each other. Furthermore, if desired, one or more of the before- described functions may be optional or may be combined.
Although various aspects of the invention are set out in the independent claims, other aspects of the invention comprise other combinations of features from the described embodiments and/or the dependent claims with the features of the independent claims, and not solely the combinations explicitly set out in the claims.
It is also noted herein that while the foregoing describes example embodiments of the invention, these descriptions should not be viewed in a limiting sense. Rather, there are several variations and modifications which may be made without departing from the scope of the present invention as defined in the appended claims.
Claims
1. An apparatus comprising:
an input configured to obtain image flash pulse control information; and a controller configured to receive the flash pulse control information and to accordingly control a flash unit to produce a plurality of pulses interspersed during exposure of a digital image.
2. The apparatus of claim 1 , wherein the flash pulse control information comprises an indication of a time at which each of the pulses should be produced.
3. The apparatus of claim 1 or 2, wherein the flash pulse control information comprises an indication of an amount of illumination energy with which each of the pulses should be produced.
4. The apparatus of any of preceding claims, wherein the flash unit is controlled to emit light at least 500 times brighter at the peak of the pulses than at the lowest light emission between the pulses.
5. The apparatus of any of preceding claims, wherein each of the pulses is configured to produce identical or corresponding energy.
6. The apparatus of any of preceding claims, wherein the apparatus is a battery operated apparatus that comprises a battery as a power supply.
7. The apparatus of any of preceding claims, wherein the apparatus comprises an image sensor configured to take a digital image during the exposure time using flashlight produced by the flash unit.
8. The apparatus of claim 7, wherein the image sensor comprises numerous readout lines.
9. The apparatus of claim 8, further configured to reset the read-out lines in two or more bands so that in each of the two or more bands, the image sensor is exposed using one of the pulses.
10. The apparatus of claim 9, wherein the controller is configured to control the flash unit to produce each of the pulses during different time periods each of which different time periods overlaps with exposure periods of all read-out lines of one band.
1 1 . The apparatus of claim 9 or 10, wherein the controller is configured to control the flash unit to produce each of the pulses after the first pulse to begin before and extend over the time on which the reading of the read-out lines of one of the bands begins.
12. The apparatus of any of claims 9 to 1 1 , wherein the controller is configured to control the flash unit to produce each of the pulses before the last pulse to overlap over time on which the resetting of the read-out lines of one of the bands ends.
13. The apparatus of any of preceding claims, further comprising the flash unit.
14. The apparatus of claim 13, wherein the flash unit is a gas discharge flash unit capable of producing the plurality of pulses by simmer voltage triggering.
15. The apparatus of claim 13 or 14, wherein the flash unit is further capable of producing a single pulse by external triggering for producing a single flash pulse that is stronger than those that can be produced by the simmering.
16. The apparatus of claim 15 further configured to use the externally triggered single flash pulse when such a pulse is better suited for the photographing than one or more pulses produced by simmering.
17. The apparatus of any of preceding claims, wherein the apparatus is configured to enable reading only a selected portion of the read-out lines of the image sensor so that the read-out time of the selected portion of the read-out lines is not greater than the pulse time of the externally triggered single flash pulse.
18. A method comprising:
obtaining flash pulse control information; and
controlling according to the pulse control information a flash unit to produce a plurality of pulses interspersed at desired times during exposure of a digital image.
19. The method of claim 18, wherein the flash pulse control information comprises an indication of a time at which each of the pulses should be produced.
20. The method of claim 18 or 19, wherein the flash pulse control information comprises an indication of an amount of illumination energy with which each of the pulses should be produced.
21 . The method of any of claims 18 to 20, wherein each of the pulses is configured to produce identical or corresponding energy.
22. The method of any of claims 18 to 21 , further comprising controlling an image sensor configured to take a digital image during the exposure time using flashlight produced by the flash unit.
23. The method of claim 22, wherein the image sensor comprises numerous readout lines.
24. The method of claim 23, further comprising resetting the read-out lines in two or more bands so that in each of the two or more bands, the image sensor is exposed using one of the pulses.
25. The method of claim 24, further comprising controlling the flash unit to produce each of the pulses during different time periods each of which different time periods overlaps with exposure periods of all read-out lines of one band.
26. The method of claim 24 or 25, further comprising controlling the flash unit to produce each of the pulses after the first pulse to begin before and extend over the time on which the reading of the read-out lines of one of the bands begins.
27. The method of any of claims 24 to 25, further comprising controlling the flash unit to produce each of the pulses before the last pulse to overlap over time on which the resetting of the read-out lines of one of the bands ends.
28. The method of any of claims 18 to 27, further comprising causing producing of a single externally triggered flash pulse and reading only a selected portion of the readout lines of an image sensor so that the read-out time of the selected portion of the read-out lines is not greater than the pulse time of the externally triggered single flash pulse.
29. A computer program comprising computer executable program code configured to cause an apparatus perform, when executing the program code, the method of any of claims 18 to 28.
30. The computer program of claim 29, wherein the computer program is a computer program product comprising a computer-readable medium bearing computer program code embodied therein for use with a computer.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/FI2014/050027 WO2015107253A1 (en) | 2014-01-15 | 2014-01-15 | Method and apparatus for pulsed flashlight |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/FI2014/050027 WO2015107253A1 (en) | 2014-01-15 | 2014-01-15 | Method and apparatus for pulsed flashlight |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015107253A1 true WO2015107253A1 (en) | 2015-07-23 |
Family
ID=53542450
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/FI2014/050027 WO2015107253A1 (en) | 2014-01-15 | 2014-01-15 | Method and apparatus for pulsed flashlight |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2015107253A1 (en) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1986007515A1 (en) * | 1985-06-07 | 1986-12-18 | Eastman Kodak Company | Illumination control circuitry for a film video player electronic strobe light |
US20020140845A1 (en) * | 2001-03-30 | 2002-10-03 | Fuji Photo Film Co., Ltd | Electronic camera |
US20030007088A1 (en) * | 2001-06-01 | 2003-01-09 | Nokia Corporation | Control of a flash unit in a digital camera |
US20050218823A1 (en) * | 2004-04-05 | 2005-10-06 | Eastman Kodak Company | Camera flash apparatus using ultraviolet light for triggering of the flash tube |
US20110081142A1 (en) * | 2009-10-06 | 2011-04-07 | Apple Inc. | Pulsed control of camera flash |
-
2014
- 2014-01-15 WO PCT/FI2014/050027 patent/WO2015107253A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1986007515A1 (en) * | 1985-06-07 | 1986-12-18 | Eastman Kodak Company | Illumination control circuitry for a film video player electronic strobe light |
US20020140845A1 (en) * | 2001-03-30 | 2002-10-03 | Fuji Photo Film Co., Ltd | Electronic camera |
US20030007088A1 (en) * | 2001-06-01 | 2003-01-09 | Nokia Corporation | Control of a flash unit in a digital camera |
US20050218823A1 (en) * | 2004-04-05 | 2005-10-06 | Eastman Kodak Company | Camera flash apparatus using ultraviolet light for triggering of the flash tube |
US20110081142A1 (en) * | 2009-10-06 | 2011-04-07 | Apple Inc. | Pulsed control of camera flash |
Non-Patent Citations (1)
Title |
---|
ALMABOUADA, F. ET AL.: "Power supply for Xenon flash-lamp", PROCEEDINGS OF INTERNATIONAL SEMINAR ON PLASMA PHYSICS (SIPP 2011), UKM OUARGLA, February 2011 (2011-02-01), pages 250 - 254 * |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8401378B2 (en) | Flash control for electronic rolling shutter | |
US10200623B1 (en) | Image capture setting determination in flash photography operations | |
US20150181139A1 (en) | Method and apparatus for acquiring a set of images illuminated by a flash | |
JP2005078089A (en) | System and method using light emitting diode for image intake device | |
JP2016099626A (en) | Method of controlling the flash time of external flash lamp | |
JP2005234014A (en) | Imaging device, and light emission control method for flash device | |
KR101544033B1 (en) | Digital camera and controlling method of the same | |
US10609265B2 (en) | Methods and apparatus for synchronizing camera flash and sensor blanking | |
JP2006050337A (en) | Imaging apparatus, imaging method, and imaging control program | |
JP2012095176A (en) | Imaging apparatus, imaging method and program | |
TW201620290A (en) | Method for taking photo with extension flash module of mobile device | |
JP2014049990A (en) | Imaging apparatus and control method | |
WO2015107253A1 (en) | Method and apparatus for pulsed flashlight | |
EP3099059B1 (en) | Camera having hdr during pre-flash | |
KR20090059043A (en) | Photographing apparatus and photographing method | |
JP2007047544A (en) | Strobe apparatus | |
JP6700747B2 (en) | Imaging device, control method thereof, and control program | |
JP4636978B2 (en) | Imaging apparatus and control method thereof | |
TWI584040B (en) | Method for controlling flash timing of extension flash module | |
KR101575628B1 (en) | Method of controlling the intensity of radiaton of flash in digital imaging processing device | |
KR101070812B1 (en) | Apparatus and method for controlling flash | |
JP2007171518A (en) | Imaging apparatus, method for controlling the same and control program | |
EP2938065A1 (en) | Method and device for capturing frames of a scene under different illumination configurations | |
JP2001339636A (en) | Image pickup method and device | |
JP5509128B2 (en) | Image brightness automatic correction device and high-speed photographing device provided with the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14878429 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14878429 Country of ref document: EP Kind code of ref document: A1 |