US20060158536A1 - Image sensing apparatus and method of controlling the image sensing apparatus - Google Patents

Image sensing apparatus and method of controlling the image sensing apparatus Download PDF

Info

Publication number
US20060158536A1
US20060158536A1 US11/334,992 US33499206A US2006158536A1 US 20060158536 A1 US20060158536 A1 US 20060158536A1 US 33499206 A US33499206 A US 33499206A US 2006158536 A1 US2006158536 A1 US 2006158536A1
Authority
US
United States
Prior art keywords
image sensing
firework
sensing mode
mode
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/334,992
Other languages
English (en)
Inventor
Satoshi Nakayama
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Assigned to CANON KABUSHIKI KAISHA reassignment CANON KABUSHIKI KAISHA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: NAKAYAMA, SATOSHI
Publication of US20060158536A1 publication Critical patent/US20060158536A1/en
Priority to US12/701,357 priority Critical patent/US7948523B2/en
Priority to US13/084,443 priority patent/US8558908B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/64—Circuits for processing colour signals
    • H04N9/68—Circuits for processing colour signals for controlling the amplitude of colour signals, e.g. automatic chroma control circuits
    • H04N9/69—Circuits for processing colour signals for controlling the amplitude of colour signals, e.g. automatic chroma control circuits for modifying the colour signals by gamma correction

Definitions

  • the present invention relates to an image sensing apparatus having a firework image sensing mode and, more particularly, to a control method for image processing in the image sensing apparatus.
  • a “firework mode” specialized for taking firework images in image sensing apparatuses such as electronic cameras has been disclosed (see, for example, Japanese Patent Laid-Open No. 2001-311977). Because the human eye has such a characteristic as to maintain an afterimage, long trails of light are perceived in a firework with the eye. In contrast, in image sensing, only trails of light corresponding to the shutter speed are imaged. For example, in still image sensing in a firework mode, therefore, image sensing control such as automatically decreasing the shutter speed is performed to express tails of light of a firework. Special exposure control such as setting the amount of exposure to a value suitable for a firework is also performed in image sensing in a firework mode, because the suitable amount of exposure cannot be obtained by the ordinary exposure control under a dark firework condition.
  • the shutter speed is controlled so that an amount of exposure becomes proper, and an image signal corresponding to the quantity of light to which an image sensing unit during the shutter released period is exposed is generated.
  • a shutter speed of, for example, about 1/30 second is a limit of low shutter speed for prevention of blurriness due to camera shake or blurriness due to movement of an object.
  • the diaphragm is controlled so that the shutter speed is set to a predetermined value for the firework mode, and an image signal corresponding to the quantity of light to which the image sensing unit is exposed during the shutter released period is generated.
  • control such as fixing white balance at a color temperature close to that of sunlight is performed.
  • automatic white balancing is difficult to perform, and white balance close to that used for an image taken under sunlight is used in order to express the color of a firework approximately to the color recognized with the human eye.
  • the conventional image sensing apparatus has drawbacks described below. Noise is noticeable in a dark portion expressing the dark sky imaged as a background. Also, under the influence of smoke of fireworks, a dark portion is often expressed unsuitably blight. Further, while a tailed state can be expressed in a still image by decreasing the shutter speed, a tailed state cannot be expressed in moving image sensing by adjusting the exposure period, because the exposure period is limited to the moving image update period. There is also a problem that in a case where the audio frequency characteristics are optimized for audio recording in the normal image sensing mode, powerful bass sound of a firework cannot be reproduced.
  • the present invention has been made in consideration of the above situation, and has as its first object to enable a high-quality firework image having a suitably dense dark portion to be obtained in an image sensing apparatus.
  • a second object of the present invention is to enable expression of a tailed state of a firework even in moving image sensing.
  • a third object of the present invention is to enable audio recording most suitable for use with imaging of a firework.
  • an image sensing apparatus comprising:
  • an image sensing unit that converts light into an electric signal corresponding to a quantity of incident light, and outputs an image signal obtained by the conversion
  • a mode switch that switches among a plurality of image sensing modes including at least a firework image sensing mode and a normal image sensing mode;
  • a gamma characteristics changing unit that changes gamma characteristics including a first gamma characteristic used in the firework image sensing mode and a second gamma characteristic used in the normal image sensing mode;
  • a gamma conversion unit that, when switch to the firework image sensing mode is made by the mode switch, performs gamma conversion on the image signal output from the image sensing unit by using the first gamma characteristic selected by the gamma characteristics changing unit,
  • the first gamma characteristic comprises a characteristic having the effect of suppressing a low luminance in comparison with the second gamma characteristic.
  • an image sensing apparatus comprising:
  • an image sensing unit that converts light into an electric signal corresponding to a quantity of incident light, and outputs an image signal obtained by the conversion
  • a mode switch that switches among a plurality of image sensing modes including at least a firework image sensing mode and a normal image sensing mode;
  • an edge enhancement amount changing unit that changes edge enhancement amounts including a first edge enhancement amount used in the firework image sensing mode and a second edge enhancement amount used in the normal image sensing mode;
  • an image sensing apparatus comprising:
  • an image sensing unit that converts light into an electric signal corresponding to a quantity of incident light, and outputs an image signal obtained by the conversion
  • a mode switch that switches among a plurality of image sensing modes including at least a firework image sensing mode and a normal image sensing mode;
  • a chromaticity adjustment amount changing unit that changes chromaticity adjustment amounts including a first chromaticity adjustment amount used in the firework image sensing mode and a second chromaticity adjustment amount used in the normal image sensing mode;
  • a chromaticity adjusting unit that, when switch to the firework image sensing mode is made by the mode switch, performs chromaticity adjustment on the image signal output from the image sensing unit by using the first chromaticity adjustment amount selected by the chromaticity adjustment amount changing unit.
  • the foregoing object is attained by providing a method of controlling an image sensing apparatus, comprising:
  • the first gamma characteristic comprises a characteristic having the effect of suppressing a low luminance in comparison with the second gamma characteristic.
  • control method comprising:
  • edge enhancement amounts to a first edge enhancement amount when the firework image sensing mode is selected and to a second edge enhancement amount when the normal image sensing mode is selected;
  • control method comprising:
  • an image sensing apparatus comprising:
  • an image sensing unit that converts light into an electric signal corresponding to a quantity of incident light, and periodically outputs an image signal obtained by the conversion at intervals of a predetermined period
  • a mode switch that switches among a plurality of image sensing modes including at least a firework image sensing mode and a normal image sensing mode;
  • an adder that, when switch to the firework image sensing mode is made by the mode switch, adds the image signal output from the image sensing unit and the image signal output from the delay unit in predetermined proportions, and outputs an image signal obtained by the addition
  • the delay unit delays the image signal obtained by addition performed by the adder.
  • the foregoing object is attained by providing a method of controlling an image sensing apparatus, comprising:
  • an image sensing apparatus that records sound together with an image
  • the device comprising:
  • a sound input unit that inputs sound, converts the sound into an audio signal and outputs the audio signal
  • a mode switch that switches among a plurality of image sensing modes including at least a firework image sensing mode and a normal image sensing mode;
  • a frequency characteristics changing unit that changes frequency characteristics including a first audio frequency characteristic used in the firework image sensing mode and a second audio frequency characteristic used in the normal image sensing mode;
  • a characteristic conversion unit that, when switch to the firework image sensing mode is made by the mode switch, makes audio frequency conversion of the audio signal output from the audio input unit by using the first audio frequency characteristic selected by the frequency characteristics changing unit,
  • the first audio frequency characteristic comprises a characteristic having the effect of enhancing bass sound in comparison with the second audio frequency characteristic.
  • the foregoing object is attained by providing a method of controlling an image sensing apparatus that records sound together with an image, the method comprising:
  • the first audio frequency characteristic comprises a characteristic having the effect of enhancing bass sound in comparison with the second audio frequency characteristic.
  • FIG. 1 is a block diagram showing the configuration of an image sensing apparatus according to a first embodiment of the present invention
  • FIG. 2 is a diagram for explaining a gamma characteristic in a normal image sensing mode according to the first embodiment of the present invention
  • FIG. 3 is a diagram for explaining a gamma characteristic in a firework image sensing mode according to the first embodiment of the present invention
  • FIG. 4 is a diagram showing an example of an image processed on the basis of the gamma characteristic in the normal image sensing mode according to the first embodiment of the present invention
  • FIG. 5 is a diagram showing an example of an image processed on the basis of the gamma characteristic in the firework image sensing mode according to the first embodiment of the present invention
  • FIG. 6 is a diagram showing a signal before edge enhancement according to the first embodiment of the present invention.
  • FIG. 7 is a diagram showing an edge enhancement signal according to the first embodiment of the present invention.
  • FIG. 8 is a diagram showing a signal after edge enhancement according to the first embodiment of the present invention.
  • FIG. 9 is a block diagram showing the configuration of an image sensing apparatus according to a second embodiment of the present invention.
  • FIG. 10 is a block diagram showing the configuration of a frame addition section according to the second embodiment of the present invention.
  • FIG. 11 is a diagram showing a one-frame image in a moving image in the conventional art
  • FIG. 12 is a diagram showing a one-frame image in a moving image taken in a firework image sensing mode according to the second embodiment of the present invention.
  • FIG. 13 is a diagram for explaining audio frequency characteristics according to the second embodiment of the present invention.
  • FIG. 14 is a diagram showing an example of a still image of a firework taken by 1/30 second exposure in the conventional art.
  • FIG. 15 is a diagram showing an example of a still image of the firework taken by 2 seconds exposure in the conventional art.
  • FIG. 1 is a block diagram of an image sensing system of an electronic camera schematically showing a first embodiment of the present invention.
  • reference numeral 101 denotes a lens
  • reference numeral 102 a diaphragm for adjustment of the amount of exposure
  • reference numeral 103 an image sensing unit
  • reference numeral 104 an analog front end (AFE) that samples an output from the image sensing unit and performs A/D conversion of the sample output
  • reference numeral 105 a luminance/color (Y/C) separation circuit
  • reference numeral 106 a color signal processing section
  • reference numeral 107 a luminance signal processing section
  • reference numeral 108 a color difference matrix circuit
  • reference numeral 109 a mode switch section
  • reference numeral 111 , a shutter control section
  • reference numeral 112 a luminance signal processing circuit included in the luminance signal processing section 107
  • reference numeral 113 a gamma circuit that is included in the luminance
  • Light entering the lens 101 is controlled for suitable exposure by the diaphragm 102 and undergoes photoelectric conversion in the image sensing unit 103 .
  • An image signal obtained by photoelectric conversion in the image sensing unit 103 undergoes sampling and A/D conversion in the analog front end 104 and is separated into a luminance signal and a color signal in the Y/C separation circuit 105 .
  • the color signal separated in the Y/C separation circuit 105 undergoes signal processing relating to colors, such as white balancing, in the color signal processing circuit 115 , then undergoes chromaticity correction in the chromaticity correction circuit 116 , and is thereafter input to the color difference matrix circuit 108 .
  • the luminance signal separated in the Y/C separation circuit 105 is input to the luminance signal processing section 107 , undergoes processing relating to luminance in the luminance signal processing circuit 112 , processing for edge enhancement or the like in the edge enhancement circuit 114 and gamma conversion processing in the gamma circuit 113 , and is thereafter input to the color difference matrix circuit 108 . Then a color difference signal is formed in the color difference matrix circuit 108 and is output from this circuit.
  • the diaphragm 102 also functions as a shutter for controlling the exposure period at the time of still image sensing. In still image sensing, the exposure period is determined by closing the diaphragm 102 after the image sensing unit has started accumulating electric charge.
  • the mode control section 110 When a normal image sensing mode is selected in the mode switch section 109 , the mode control section 110 provides a normal gamma curve to the gamma circuit 113 . When a firework image sensing mode is selected in the mode switch section 109 , the mode control section 110 provides a gamma curve suitable for firework image sensing to the gamma circuit 113 .
  • FIG. 2 is a diagram for explaining a luminance gamma characteristic in the normal image sensing mode.
  • the gamma characteristic in the normal image sensing mode is a characteristic adjusted to a gamma characteristic of a television monitor in the case of a moving image for example, or a characteristic suitable for display on a personal computer (PC) monitor or printing in the case of a still image.
  • PC personal computer
  • As the gamma characteristic an output characteristic with respect to the input signal, such as shown in FIG. 2 , is provided.
  • an image with a most suitable level distribution can be obtained by making gamma conversion in accordance with the gamma characteristic for the normal image sensing mode, because the input level in a histogram expression distributes without any extreme irregularity from a dark level to a light level.
  • the background is the dark sky and a firework of high luminance is imaged against the background and, therefore, the input level distribution in a histogram expression has such one-sidedness that almost the entire of the input signal is formed of signals of an extremely low level and signals of an extremely high level.
  • FIG. 4 shows an image of a firework obtained by performing image processing using the luminance gamma characteristic for the normal image sensing mode shown in FIG. 2 .
  • the background is the dark sky, as mentioned above. Random noise in a dark portion at the time of image sensing is generally noticeable and is a serious consideration in firework image sending in particular. Also, the smoke produced in firework is often lighted up by the light of the firework and appears in the image. In firework image sensing, a more preferable image can be obtained by performing image sensing so that firework smoke or the like, as well as random noise, is made as unnoticeable as possible.
  • FIG. 3 is a diagram for explaining a luminance gamma characteristic in the firework image sensing mode, which is the most characteristic in the first embodiment of the present invention.
  • the luminance gamma characteristic in the firework image sensing mode comprises an output characteristic such as shown in FIG. 3 .
  • the output in the gamma characteristic in the firework image sensing mode is reduced relative to that in the normal gamma characteristic for a wide lower-input-level range, and is increased relative to that in the normal gamma characteristic for a wide higher-input-level range.
  • FIG. 5 shows an image of a firework obtained by performing image processing using the luminance gamma characteristic for the firework image sensing mode shown in FIG. 3 .
  • random noise is made unnoticeable and smoke of the firework is also unnoticeable in comparison with the image shown in FIG. 4 .
  • the luminance gamma characteristic for the firework image sensing mode in the first embodiment of the present invention has the effect of darkening by suppressing signals of low input levels for a wider range in comparison with the characteristic in the normal image sensing mode, and thereby ensures that random noise in the dark portion becomes unnoticeable.
  • the luminance gamma characteristic for the firework image sensing mode also has the effect of suppressing the output level corresponding to smoke generated by a firework and thereby ensures that firework smoke for example is unnoticeable.
  • the luminance gamma characteristic for the firework image sensing mode enhances signals of high input levels for a wider range in comparison with the characteristic in the normal image sensing mode, thereby achieving the effect of extracting a signal of a level corresponding to a firework.
  • a user can easily take a high-contrast sharp firework image only by designating the firework image sensing mode.
  • the mode control section 110 supplies normal edge enhancement data to the edge enhancement circuit 114 .
  • the mode control section 110 supplies edge enhancement data suitable for firework image sensing to the edge enhancement circuit 114 .
  • FIG. 6 is a diagram showing an image signal before edge enhancement.
  • FIG. 7 is a diagram showing an edge enhancement signal generated from the image signal of FIG. 6 .
  • FIG. 8 is a diagram showing an edge-enhanced image signal.
  • edge enhancement processing is ordinarily performed to improve the sharpness at the time of reproduction on a television monitor.
  • Edge enhancement processing is a processing to add to an image signal an edge signal generated from a high-frequency component of the image signal in order to improve the apparent sharpness.
  • the edge enhancement circuit 114 When a signal such as shown in FIG. 6 is input to the edge enhancement circuit 114 , the edge enhancement circuit 114 generates an edge enhancement signal such as shown in FIG. 7 and adds the edge enhancement signal to the original signal to output an image signal of improved sharpness such as shown in FIG. 8 .
  • An edge-enhanced image signal has improved apparent sharpness but has a noticeable undershoot or overshoot in its edge portion.
  • An image signal in the case of imaging a firework ordinarily has sufficiently high sharpness even if the edge enhancement amount is small, because a light portion of the firework rises abruptly against a dark portion.
  • the edge enhancement amount can be set by assuming only a firework as a target. If a firework is imaged with performing edge enhancement suitable for an image produced by imaging an ordinary object, the edge is excessively enhanced so that a dark edge of an undershoot is noticeable around the firework. In firework image sensing, therefore, the edge enhancement amount is reduced to obtain an optimum image.
  • the mode control section 110 provides a normal color gain to the chromaticity correction circuit 116 .
  • the mode control section 110 provides a color gain suitable for firework image sensing to the chromaticity correction circuit 116 .
  • the mode control section 110 sets the color gain in the firework image sensing mode higher than the color gain in the normal image sensing mode. A sharp firework image can be obtained if the gain of the color signal is set higher in the firework image sensing mode than in the normal image sensing mode to increase the chromaticity.
  • white balance may be fixed in a state of being adjusted to sunlight or the like to enhance the effect of increasing the chromaticity.
  • the gamma characteristic, edge enhancement signal and chromaticity correction described above in the description of the first embodiment are only an example.
  • a gamma characteristic different from that shown in FIG. 3 a different edge enhancement signal and chromaticity correction may be used for gamma conversion processing, edge enhancement processing and chromaticity correction processing, respectively, according to the kind of firework and the exposure period.
  • the first embodiment has been described for a case where gamma conversion is performed by providing a gamma curve to the gamma circuit 113 .
  • the above-described method of controlling gamma conversion is not exclusively used. Any of other various gamma conversion methods, e.g., one using a conversion equation, i.e., a method in which a variable for forming a conversion equation approximating the gamma curve shown in FIG. 3 when the firework image sensing mode is selected or as such a conversion equation itself is provided to the gamma circuit 113 may be used.
  • the first embodiment has been described with respect to a case where only one gamma circuit is provided and the gamma characteristic is changed while the gamma circuit is being used in common between the normal image sensing mode and the firework image sensing mode
  • a different arrangement may be adopted in which a gamma circuit for the firework image sensing mode is separately provided and switch to the gamma circuit for the firework image sensing mode is made when the firework image sensing mode is selected.
  • edge enhancement circuit capable of obtaining different edge enhancement characteristics with respect to a small-amplitude signal portion and a large-amplitude signal portion
  • a setting described below is conceivable. That is, the amount of edge enhancement associated with a small amplitude is reduced to achieve edge enhancement suitable for a firework, while the amount of edge enhancement associated with a large amplitude is not changed between the normal image sensing mode and the firework image sensing mode.
  • An edge enhancement circuit capable of obtaining an optimum image by changing the setting according to the characteristics of the edge enhancement circuit in the above-described way instead of simply reducing the edge enhancement amount when the firework image sensing mode is selected may be applied to the image sensing apparatus of the present invention.
  • the setting to increase the chromaticity may be changed according to each gamma characteristic, since the output according to the gamma characteristic in the firework image sensing mode is higher than that according to the normal gamma characteristic in a high-input-level range.
  • a different arrangement may be used in which, for example, a shutter is provided separately from a diaphragm or an electronic shutter implemented by controlling reset and accumulation of electric charge generated by photoelectric conversion in the image sensing unit 103 .
  • the first embodiment is effective both in still image sensing and in moving image sensing and different gamma characteristics respectively associated with still image sensing and moving image sensing may be used.
  • FIG. 9 is a block diagram of an image sensing system of a moving image sensing electronic camera schematically showing the second embodiment of the present invention.
  • reference numeral 201 denotes a lens
  • reference numeral 202 a diaphragm for adjustment of exposure
  • reference numeral 203 an image sensing unit
  • reference numeral 204 an analog front end (AFE) that samples an output from the image sensing unit and performs A/D conversion of the sampled output
  • reference numeral 205 , a Y/C separation circuit
  • reference numeral 206 a color signal processing section
  • reference numeral 207 , a luminance signal processing section
  • reference numeral 208 , a color difference matrix circuit
  • reference numeral 209 , a mode switch section
  • reference numeral 210 an addition proportion control section
  • reference numeral 211 a frame addition section for adding a luminance signal (hereinafter referred to as “luminance frame addition section”);
  • reference numeral 212 a frame addition section for adding a luminance
  • Light entering a lens 201 is controlled for suitable exposure by the diaphragm 202 and undergoes photoelectric conversion in the image sensing unit 203 .
  • An image signal obtained by photoelectric conversion in the image sensing unit 203 is read out on a frame-by-frame basis in a predetermined period.
  • the image signal in each frame undergoes sampling and A/D conversion in the analog front end 204 and is separated into a luminance signal and a color signal in the Y/C separation circuit 205 .
  • the color signal separated in the Y/C separation circuit 205 is processed in the color frame addition section 212 in the way as described below, then undergoes signal processing relating to colors, such as white balancing, in the color signal processing circuit 206 , and is thereafter input to the color difference matrix circuit 208 .
  • the luminance signal separated in the Y/C separation circuit 205 is processed in the luminance frame addition section 211 as described below, and is thereafter input to the luminance signal processing section 207 .
  • the processed luminance signal undergoes processing including edge enhancement and gamma conversion.
  • the luminance signal is thereafter input to the color difference matrix circuit 208 .
  • a color difference signal is formed in the color difference matrix circuit 208 and is output from this circuit.
  • FIG. 10 is a diagram for explaining addition circuits in the color frame addition section 212 and the luminance frame addition section 211 .
  • the color frame addition section 212 and the luminance frame addition section 211 are identical in configuration to each other.
  • reference numeral 701 denotes an input signal attenuation circuit
  • reference numeral 702 an addition circuit
  • reference numeral 703 a delayed signal attenuation circuit
  • reference numeral 704 a one-frame delay circuit.
  • the frame addition sections are provided for the purpose of providing a special effect of enabling a moving object to be seen in a tailed state by attenuating past image data and adding the attenuated past image data to the current image data.
  • an input signal is attenuated in advance according to an addition proportion (1-K) in the input signal attenuation circuit 701 and the attenuated signal and a past image signal are mixed or added together in the addition circuit 702 .
  • the signal obtained by this addition is one-frame delayed in the delay circuit 704 , attenuated according to an addition proportion K in the delayed signal attenuation circuit 703 and is thereafter added to a new signal in the addition circuit 702 .
  • the addition proportion K takes a value in the range 0 ⁇ K ⁇ 1. If the K is larger, the proportion of the delayed past image data is increased and the tailing effect becomes higher.
  • the sum of the attenuation rates of the input signal attenuation circuit 701 and the delayed signal attenuation circuit 703 is 1 and the input signal level and the output signal level are equal to each other.
  • the input signals are output from the color frame addition section 212 and the luminance frame addition sections 211 to the color signal processing section 206 and the luminance signal processing section 207 , respectively, without being changed.
  • the addition proportion control section 210 provides an addition proportion K (0 ⁇ K ⁇ 1) suitable for the firework image sensing mode to the color frame addition section 212 and to the luminance frame addition section 211 .
  • Frame addition is performed in both the color signal processing system and the luminance signal processing system to achieve a tailing effect both in color and in luminance.
  • FIG. 11 is a diagram showing one-frame image of a firework imaged as a moving image in a period of 1/60 second. As shown in FIG. 11 , the firework is imaged merely as dots when the exposure period is 1/60 second. When the firework is continuously seen in the moving image, it appears discontinuously.
  • FIG. 12 is a diagram showing one-frame image of a firework imaged as a moving image in the same 1/60 second period by performing frame addition processing by means of the color frame addition section 212 and the luminance frame addition section 211 . The delayed frame image remains inside of the firework as an afterimage in the firework, thus obtaining a smoothly tailed image, as shown in FIG. 12 . When the firework is continuously seen in the moving image, it is recognized as an image with an afterimage, as seen with the human eye.
  • the moving image sensing apparatus in the second embodiment is arranged to take a moving image, it may obtain a tailing effect in still image sensing of a firework by decreasing the shutter speed so that the exposure period is about 2 seconds.
  • the effect of expressing a tailed state of a firework that has been achieved only in still image sensing in the conventional art, can also be achieved in moving image sensing.
  • the present invention is not limited to the described readout method.
  • the present invention is also applicable in a case where an image is read out on a field-by-field basis.
  • sections corresponding to the frame addition sections 211 and 212 may add field images instead of frame images.
  • frame addition sections may be provided for respective fields.
  • the addition proportions in the color signal processing system and the luminance signal processing system may be different from each other. Also, the configuration may be modified by placing the frame addition section in a stage before the Y/C separation circuit 205 .
  • noise reduction processing is performed for the purpose of suppressing such random noise.
  • a method using a frame correlation is known as one of noise reduction processing methods for reducing random noise.
  • a noise reduction circuit may be used as the frame addition section in the second embodiment. For example, since the input signal is attenuated according to the addition proportion (1-K) in the input signal attenuation circuit, a noise signal that exists only in one frame of the image signal can be suppressed by performing frame addition. Also, if the addition proportion K is increased, the amount of attenuation of the signal existing only in the current frame is increased and, therefore, the random noise suppression effect is increased, as described above in the description of the second embodiment.
  • the frame addition section is used for the purpose of suppressing random noise by setting the addition proportion K to a smaller value in the normal image sensing mode, and is used to achieve random noise suppression and tailing as a synergistic effect by setting the addition proportion K to a larger value in the firework image sensing mode.
  • the same effect can also be obtained by changing the correlation ratio in the noise reduction circuit.
  • frame addition may also be performed by noise reduction in the normal image sensing mode.
  • the present invention also comprises changing this ratio between the normal image sensing mode and the firework image sensing mode.
  • sound input through the microphone 220 is converted into an electrical signal, undergoes conversion of the audio frequency characteristics in the sound conversion section 221 , then the processed signal is output.
  • the audio frequency characteristic control section 222 sets in the sound conversion section 221 audio frequency characteristic conversion suitable for the image sensing mode selected by the mode switch section 209 .
  • FIG. 13 is a diagram showing audio frequency characteristics of the electronic camera in the second embodiment of the present invention.
  • dotted line 1201 indicates a frequency characteristic in the normal image sensing mode
  • solid line 1202 indicates a frequency characteristic in the firework image sensing mode.
  • the sound pressure level of bass sound in live sound of an aerial firework is higher than that of ordinary bass sound.
  • such sound cannot be suitably expressed by the audio frequency characteristic in the normal image sensing mode.
  • the frequency characteristic is changed so as to boost the level in the bass range relative to that in the ordinary audio frequency characteristic in the case of setting the firework image sensing mode.
  • the characteristic of the bass portion in the frequency characteristic 1201 in the normal image sensing mode shown in FIG. 13 is changed as expressed in the frequency characteristic 1200 in the firework image sensing mode, thereby improving powerfulness of the bass sound in the firework sound.
  • the audio frequency characteristic in the firework image sensing mode shown in FIG. 13 is only an example. The characteristics in other frequency bands may be changed as well as that in the bass range.
  • the audio frequency changing processing suitable for firework image sensing performed when the firework image sensing mode is selected can be applied to devices capable of recording sound as well as to electronic cameras.
  • the invention can be implemented by supplying a software program, which implements the functions of the foregoing embodiments, directly or indirectly to a system or apparatus, reading the supplied program code with a computer of the system or apparatus, and then executing the program code. In this case, so long as the system or apparatus has the functions of the program, the mode of implementation need not rely upon a program.
  • the program code installed in the computer also implements the present invention.
  • the claims of the present invention also cover a computer program for the purpose of implementing the functions of the present invention.
  • the program may be executed in any form, such as an object code, a program executed by an interpreter, or scrip data supplied to an operating system.
  • Example of storage media that can be used for supplying the program are a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a CD-RW, a magnetic tape, a non-volatile type memory card, a ROM, and a DVD (DVD-ROM and a DVD-R).
  • a client computer can be connected to a website on the Internet using a browser of the client computer, and the computer program of the present invention or an automatically-installable compressed file of the program can be downloaded to a recording medium such as a hard disk.
  • the program of the present invention can be supplied by dividing the program code constituting the program into a plurality of files and downloading the files from different websites.
  • a WWW World Wide Web
  • a storage medium such as a CD-ROM
  • an operating system or the like running on the computer may perform all or a part of the actual processing so that the functions of the foregoing embodiments can be implemented by this processing.
  • a CPU or the like mounted on the function expansion board or function expansion unit performs all or a part of the actual processing so that the functions of the foregoing embodiments can be implemented by this processing.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Color Television Image Signal Generators (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Picture Signal Circuits (AREA)
  • Processing Of Color Television Signals (AREA)
US11/334,992 2005-01-19 2006-01-18 Image sensing apparatus and method of controlling the image sensing apparatus Abandoned US20060158536A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US12/701,357 US7948523B2 (en) 2005-01-19 2010-02-05 Image sensing apparatus and method of controlling the image sensing apparatus
US13/084,443 US8558908B2 (en) 2005-01-19 2011-04-11 Image sensing apparatus and method of controlling the image sensing apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2005-011796 2005-01-19
JP2005011796A JP4522270B2 (ja) 2005-01-19 2005-01-19 撮像装置及びその制御方法

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US12/701,357 Division US7948523B2 (en) 2005-01-19 2010-02-05 Image sensing apparatus and method of controlling the image sensing apparatus

Publications (1)

Publication Number Publication Date
US20060158536A1 true US20060158536A1 (en) 2006-07-20

Family

ID=36683447

Family Applications (3)

Application Number Title Priority Date Filing Date
US11/334,992 Abandoned US20060158536A1 (en) 2005-01-19 2006-01-18 Image sensing apparatus and method of controlling the image sensing apparatus
US12/701,357 Expired - Fee Related US7948523B2 (en) 2005-01-19 2010-02-05 Image sensing apparatus and method of controlling the image sensing apparatus
US13/084,443 Expired - Fee Related US8558908B2 (en) 2005-01-19 2011-04-11 Image sensing apparatus and method of controlling the image sensing apparatus

Family Applications After (2)

Application Number Title Priority Date Filing Date
US12/701,357 Expired - Fee Related US7948523B2 (en) 2005-01-19 2010-02-05 Image sensing apparatus and method of controlling the image sensing apparatus
US13/084,443 Expired - Fee Related US8558908B2 (en) 2005-01-19 2011-04-11 Image sensing apparatus and method of controlling the image sensing apparatus

Country Status (2)

Country Link
US (3) US20060158536A1 (https=)
JP (1) JP4522270B2 (https=)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040091145A1 (en) * 2002-04-11 2004-05-13 Atsushi Kohashi Image signal processing system and camera having the image signal processing system
US20090251562A1 (en) * 2008-04-04 2009-10-08 Panasonic Corporation Image capturing apparatus, image processing apparatus and image processing method
US20100002022A1 (en) * 2008-07-02 2010-01-07 Sony Corporation Display unit
US20110085731A1 (en) * 2009-10-13 2011-04-14 Samsung Electronics Co., Ltd. Digital image processing apparatus for recognizing fireworks, method of operating the same, and computer-readable storage medium
US20120026208A1 (en) * 2010-07-30 2012-02-02 Kabushiki Kaisha Toshiba Image display apparatus
WO2012027186A1 (en) * 2010-08-26 2012-03-01 Eastman Kodak Company Audio processing based on scene type
JP2015041852A (ja) * 2013-08-21 2015-03-02 キヤノン株式会社 撮像装置、撮像システム、撮像装置の制御方法、プログラム、および、記憶媒体
US20150077616A1 (en) * 2013-09-18 2015-03-19 Ability Enterprise Co., Ltd. Electronic device and image displaying method thereof
US20230156309A1 (en) * 2021-11-18 2023-05-18 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and image capturing apparatus

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4522270B2 (ja) * 2005-01-19 2010-08-11 キヤノン株式会社 撮像装置及びその制御方法
JP5013910B2 (ja) * 2007-03-14 2012-08-29 キヤノン株式会社 撮像装置及び撮像装置の制御方法
JP2008263314A (ja) * 2007-04-10 2008-10-30 Sony Corp 撮像装置及び撮像方法
JP5031430B2 (ja) * 2007-04-17 2012-09-19 キヤノン株式会社 撮像装置及び撮像装置の制御方法
JP6433177B2 (ja) * 2014-07-01 2018-12-05 キヤノン株式会社 画像処理装置および画像処理方法
JP6460721B2 (ja) * 2014-10-22 2019-01-30 キヤノン株式会社 画像処理装置、画像処理方法及びプログラム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5705821A (en) * 1996-11-07 1998-01-06 Sandia Corporation Scanning fluorescent microthermal imaging apparatus and method
US5712680A (en) * 1993-12-24 1998-01-27 Canon Kabushiki Kaisha Image pickup device for obtaining both moving and still images
US20020159652A1 (en) * 2001-03-19 2002-10-31 Minolta Co., Ltd. Image processing apparatus, image processing method, and program product
US20050046724A1 (en) * 2003-08-15 2005-03-03 Fuji Photo Film Co., Ltd. Image processing apparatus, method and program

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07199267A (ja) * 1993-12-28 1995-08-04 Nikon Corp 撮影制御装置
JP2000224444A (ja) * 1999-02-04 2000-08-11 Toshiba Corp 巡回型ノイズ低減装置
JP2002369797A (ja) * 2001-06-15 2002-12-24 Pentax Corp 電子内視鏡装置
JP2003163830A (ja) * 2001-11-28 2003-06-06 Olympus Optical Co Ltd 撮像装置
JP2003333416A (ja) * 2002-05-17 2003-11-21 Minolta Co Ltd デジタルカメラ
KR20060019363A (ko) * 2004-08-27 2006-03-03 삼성테크윈 주식회사 디지털 촬영 장치의 제어 방법 및 이 방법을 채용한디지털 촬영 장치
JP4522270B2 (ja) * 2005-01-19 2010-08-11 キヤノン株式会社 撮像装置及びその制御方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5712680A (en) * 1993-12-24 1998-01-27 Canon Kabushiki Kaisha Image pickup device for obtaining both moving and still images
US5705821A (en) * 1996-11-07 1998-01-06 Sandia Corporation Scanning fluorescent microthermal imaging apparatus and method
US20020159652A1 (en) * 2001-03-19 2002-10-31 Minolta Co., Ltd. Image processing apparatus, image processing method, and program product
US20050046724A1 (en) * 2003-08-15 2005-03-03 Fuji Photo Film Co., Ltd. Image processing apparatus, method and program

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7456873B2 (en) * 2002-04-11 2008-11-25 Olympus Corporation Image signal processing system and camera for obtaining luminance-system signal and color-system signal
US20040091145A1 (en) * 2002-04-11 2004-05-13 Atsushi Kohashi Image signal processing system and camera having the image signal processing system
US20090251562A1 (en) * 2008-04-04 2009-10-08 Panasonic Corporation Image capturing apparatus, image processing apparatus and image processing method
WO2009123362A1 (en) * 2008-04-04 2009-10-08 Panasonic Corporation Image capturing apparatus, image processing apparatus and image processing method
US20100002022A1 (en) * 2008-07-02 2010-01-07 Sony Corporation Display unit
US8704858B2 (en) * 2008-07-02 2014-04-22 Sony Corporation Display unit with luminance and chromaticity correction using compressed correction matrix
KR101626005B1 (ko) * 2009-10-13 2016-06-13 삼성전자주식회사 불꽃놀이를 인식하는 디지털 영상 처리 장치, 그 동작 방법 및 판독 가능 저장 매체
US20110085731A1 (en) * 2009-10-13 2011-04-14 Samsung Electronics Co., Ltd. Digital image processing apparatus for recognizing fireworks, method of operating the same, and computer-readable storage medium
KR20110040249A (ko) * 2009-10-13 2011-04-20 삼성전자주식회사 불꽃놀이를 인식하는 디지털 영상 처리 장치, 그 동작 방법 및 판독 가능 저장 매체
US8781226B2 (en) * 2009-10-13 2014-07-15 Samsung Electronics Co., Ltd. Digital image processing apparatus for recognizing fireworks, method of operating the same, and computer-readable storage medium
US20120026208A1 (en) * 2010-07-30 2012-02-02 Kabushiki Kaisha Toshiba Image display apparatus
WO2012027186A1 (en) * 2010-08-26 2012-03-01 Eastman Kodak Company Audio processing based on scene type
JP2015041852A (ja) * 2013-08-21 2015-03-02 キヤノン株式会社 撮像装置、撮像システム、撮像装置の制御方法、プログラム、および、記憶媒体
US20150077616A1 (en) * 2013-09-18 2015-03-19 Ability Enterprise Co., Ltd. Electronic device and image displaying method thereof
US10021342B2 (en) * 2013-09-18 2018-07-10 Ability Enterprise Co., Ltd. Electronic device and image displaying method thereof for catching and outputting image stream
US20230156309A1 (en) * 2021-11-18 2023-05-18 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and image capturing apparatus
US11778308B2 (en) * 2021-11-18 2023-10-03 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and image capturing apparatus

Also Published As

Publication number Publication date
JP2006203450A (ja) 2006-08-03
US8558908B2 (en) 2013-10-15
US20100134658A1 (en) 2010-06-03
JP4522270B2 (ja) 2010-08-11
US7948523B2 (en) 2011-05-24
US20110187901A1 (en) 2011-08-04

Similar Documents

Publication Publication Date Title
US7948523B2 (en) Image sensing apparatus and method of controlling the image sensing apparatus
JP5249077B2 (ja) 撮像装置及び画像処理方法
KR101549529B1 (ko) 촬상장치, 그 제어 방법, 및 기록 매체
US9432647B2 (en) Adaptive auto exposure and dynamic range compensation
US7903148B2 (en) Apparatus, method, and computer program for processing image, and recording medium storing the computer program
CN100568930C (zh) 成像设备、以及曝光控制设备和方法
US20120308156A1 (en) Image processing apparatus, image processing method, and program
JP4822773B2 (ja) 色ノイズ低減回路及びそれを用いた撮像装置
JP2013219684A (ja) 撮像装置およびその制御方法
JP2011228807A (ja) 画像処理プログラム、画像処理装置、および画像処理方法
JP2009124264A (ja) 画像処理装置および画像処理方法
US7265785B2 (en) Imaging apparatus and method that provide high resolution under low illumination without substantial S/N degradation
JP5014253B2 (ja) 撮像装置及びその制御方法
JP2010171940A (ja) 画像処理装置及び画像処理方法
EP1599052A2 (en) Imaging device, image processing method, and color area setting program
JP2008305122A (ja) 画像処理装置、画像処理方法、およびプログラム
US20030128282A1 (en) Apparatus and method for processing image signal and imaging equipment
JP5142833B2 (ja) 画像処理装置及び画像処理方法
US20040119835A1 (en) Exposure compensation in image sensing apparatus
JP5460909B2 (ja) 撮像装置及び画像処理方法
JP5561389B2 (ja) 画像処理プログラム、画像処理装置、電子カメラ、および画像処理方法
JP2002199272A (ja) 撮像装置および撮像方法
JP2011029695A (ja) 画像処理装置、画像処理プログラム
JP2009201062A (ja) 撮像装置及び撮像方法
JP2007336386A (ja) 撮像装置及び撮像方法

Legal Events

Date Code Title Description
AS Assignment

Owner name: CANON KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NAKAYAMA, SATOSHI;REEL/FRAME:017500/0200

Effective date: 20060105

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION