US20030197805A1 - Imaging apparatus with dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal - Google Patents

Imaging apparatus with dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal Download PDF

Info

Publication number
US20030197805A1
US20030197805A1 US10/444,964 US44496403A US2003197805A1 US 20030197805 A1 US20030197805 A1 US 20030197805A1 US 44496403 A US44496403 A US 44496403A US 2003197805 A1 US2003197805 A1 US 2003197805A1
Authority
US
United States
Prior art keywords
red
green
video signals
blue
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/444,964
Inventor
Masayuki Serizawa
Kenji Tabei
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Holdings Corp
Original Assignee
Matsushita Electric Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP9336653A external-priority patent/JPH11155108A/en
Priority claimed from JP9336652A external-priority patent/JPH11155098A/en
Application filed by Matsushita Electric Industrial Co Ltd filed Critical Matsushita Electric Industrial Co Ltd
Priority to US10/444,964 priority Critical patent/US20030197805A1/en
Publication of US20030197805A1 publication Critical patent/US20030197805A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/84Camera processing pipelines; Components thereof for processing colour signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50Control of the SSIS exposure
    • H04N25/57Control of the dynamic range
    • H04N25/58Control of the dynamic range involving two or more exposures
    • H04N25/587Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields
    • H04N25/589Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields with different integration times, e.g. short and long exposures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2209/00Details of colour television systems
    • H04N2209/04Picture signal generators
    • H04N2209/041Picture signal generators using solid-state devices
    • H04N2209/048Picture signal generators using solid-state devices having several pick-up sensors
    • H04N2209/049Picture signal generators using solid-state devices having several pick-up sensors having three pick-up sensors

Definitions

  • This invention relates to an imaging apparatus with its dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal.
  • An imaging apparatus for generating a dynamic range expanded video signal by combining video signals generated substantially at the same time with different exposure intervals is known.
  • Such an image apparatus is disclosed in Japanese patent application provisional publication No. 07131718A.
  • a video signal processing circuit including an edge enhancement signal generation circuit generating an edge enhancement signal from a video signal and a gamma correction circuit for compensating a gamma of the video signal, wherein the edge enhancement signal is not subjected the gamma correction and is added to the gamma-corrected video signal is known.
  • Such a video signal processing circuit is disclosed in Japanese patent application provisional publication No. 63-209373.
  • the aim of the present invention is to provide a superior imaging apparatus with dynamic range expanded, a superior video camera including the same, and a superior method of generating a dynamic range expanded video signal.
  • a first imaging apparatus which comprises: an imager including driving circuit for receiving an optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second effective detection ranges which are different but continuous; a synchronizing circuit for synchronizing the first video signal with the second video signal every corresponding frames of the first and second video signals; an exposure interval ratio detection circuit responsive to the driving circuit for detecting an exposure ratio between the first and second exposure intervals; a gain adjusting circuit responsive to the first and second video signals from the synchronizing circuit for adjusting a difference between gains of the first and second video signals from the synchronizing circuit in accordance with the exposure ratio from the exposure interval ratio detection circuit for linearity; a mixing control signal generation circuit for generating a mixing control signal indicative of a mixing ratio of the first and second video signals in accordance with the first and second video signals from the gain
  • the gain adjusting circuit adjusts the difference between gains of the first and second video signals from the synchronizing circuit to provide a linearity in the expanded detection range.
  • the first imaging apparatus may further comprise: an edge enhancement signal generation circuit for generating an edge enhancement signal from the combined video signal; an edge enhancement amount control circuit for controlling an amount of the edge enhancement signal in accordance with the mixing control signal; and an adding circuit for adding the edge enhancement signal from the gain adjusting circuit and the combined video signal and outputting an edge-enhanced video signal.
  • the edge enhancement amount control circuit controls the amount of the edge enhancement signal in accordance with the exposure ratio in addition to the mixing control signal.
  • the first imaging apparatus may further comprise: an edge enhancement signal generation circuit for generating an edge enhancement signal from the combined video signal; a coring amount control signal generation circuit for generating a coring amount control signal in accordance with the mixing control signal; and a coring circuit for effecting a coring operation to the edge enhanced signal in accordance with the coring amount control signal from the coring amount control signal generation circuit; and an adding circuit for adding the edge enhancement signal from the edge enhancement signal generation circuit and the combined video signal and outputting an edge-enhanced video signal.
  • the coring amount control signal generation circuit generates the coring amount control signal in accordance with the exposure ratio in addition to the mixing control signal.
  • a first method of generating a combined video signal from an optical image comprises the steps of: receiving the optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second effective detection ranges which are different but continuous; synchronizing the first video signal with the second video signal every corresponding frames of the first and second video signals; detecting an exposure ratio between the first and second exposure intervals; adjusting a difference in gains of the synchronized first and second video signal in accordance with the exposure ratio; generating a mixing control signal indicative of a mixing ratio of the first and second video signals in accordance with the gain-adjusted first and second video signals; and generating and outputting the combined video signal from the gain-adjusted first and second video signals in accordance with the mixing control signal and levels of the gain-adjusted first and second video signals to have an
  • a second imaging apparatus which comprises: an imager including a driving circuit for receiving an optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second dynamic ranges which are different but continuous; a synchronizing circuit for synchronizing the first video signal with the second video signal every corresponding frames of the first and second video signals; a mixing control signal generation circuit for generating a mixing control signal indicative of a mixing ratio of the first and second video signals; a video signal generation circuit for generating a combined video signal from the first and second video signals from the synchronizing circuit in accordance with the mixing control signal and levels of the first and second video signals to have an expanded dynamic range such that the first effective detection range is connected to the second effective detection range; an edge enhancement signal generation circuit for generating an edge enhancement signal from the combined video signal; an edge enhancement amount control circuit responsive to the driving circuit for controlling
  • the second imaging apparatus may further comprise a generation circuit generating a coring amount control signal in accordance with the mixing control signal and a coring circuit for effecting a coring operation to the edge enhancement signal in accordance with the coring amount control signal.
  • a second method of generating a combined video signal from an optical image comprises the steps of: receiving the optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second effective detection ranges which are different but continuous; synchronizing the first video signal with the second video signal every corresponding frames of the first and second video signals; generating a mixing control signal indicative of a mixing ratio of the first and second video signals in accordance with the gain-adjusted first and second video signals; generating the combined video signal from the synchronized first and second video signal in accordance with the mixing control signal and levels of the first and second video signals to have an expanded detection range such that the first effective detection range is connected to the second effective detection range; generating an edge enhancement signal from the combined video signal; controlling an amount of the edge enhancement signal in accordance with the mixing control signal; and adding the gain-a
  • the second method may further comprise the steps of: generating a coring amount control signal in accordance with the mixing control signal; and effecting a coring operation to the edge enhancement signal in accordance with the coring amount control signal.
  • a third imaging apparatus which comprises: an imager including driving circuit for receiving an optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second effective detection ranges which are different but continuous; a synchronizing circuit for synchronizing the first video signal with the second video signal every corresponding frames of the first and second video signals; an exposure ratio detection circuit responsive to the driving circuit for detecting an exposure ratio between the first and second exposure intervals; a mixing control signal generation circuit for generating a mixing control signal indicative of a mixing ratio of the first and second video signals in accordance with the first and second video signals from the synchronizing circuit; a combining circuit for generating a combined video signal from the first and second video signals from the synchronizing circuit in accordance with the mixing control signal and levels of the first and second video signals to have an expanded dynamic range-such that the first effective detection range is
  • the third imaging apparatus may further comprise: a coring amount control signal generation circuit for generating a coring amount control signal in accordance with the mixing control signal and the exposure ratio; and a coring circuit for effecting a coring operation to the edge enhanced signal in accordance with the coring amount control signal from the coring amount control signal generation circuit.
  • a third method of generating a combined video signal from an optical image comprises the steps of: receiving the optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second effective detection ranges which are different but continuous; synchronizing the first video signal with the second video signal; detecting an exposure ratio between the first and second exposure intervals; generating a mixing control signal indicative of a mixing ratio of the synchronized first and second video signals in accordance with the synchronized first and second video signals; generating the combined video signal from the synchronized first and second video signals in accordance with the mixing control signal and levels of the first and second video signals to have an expanded detection range such that the first effective detection range is connected to the second effective detection range; generating an edge enhancement signal from the combined video signal; controlling an amount of the edge enhancement signal in accordance with the mixing control signal and the exposure interval;
  • the third method may further comprise the steps of: generating a coring amount control signal in accordance with the mixing control signal and the exposure ratio; and effecting a coring operation to the edge enhancement signal in accordance with the coring amount control signal.
  • a fourth imaging apparatus which comprises: an imager including driving circuit for receiving separated red, green, and blue optical images and generating first red, first green, and first blue video signals with a first exposure interval and second red, second green, and second blue video signals with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first red, green, and blue video signals respectively having first red, first green, and first blue effective detection ranges which are different from the second red, second green, and blue but continuous; a synchronizing circuit for synchronizing the first red, first green, and first blue video signals with second red, second green, and second blue video signals every corresponding frames of the first red, first green, and first blue video signals and the second red, second green, and second blue video signals, respectively; an exposure interval ratio detection circuit responsive to the driving circuit for detecting an exposure ratio between the first and second exposure intervals; a gain adjusting circuit for respectively adjusting difference between gains of the first red, first green, and first blue video signals and second
  • the fourth imaging apparatus may further comprise: a maximum detection circuit for detecting a maximum level among the combined red, combined green, and combined blue video signals for one frame period; and a non-linear processing circuit responsive to display dynamic range data for generating and outputting red, green, and blue display signals respectively having non-linear characteristics such that the maximum level is made equal to or less than the display dynamic range data when the detected maximum level is larger than the display dynamic range data and outputting the combined red, green, and blue video signal as they are when the detected maximum level is not larger than the display dynamic range data.
  • a fourth method of generating a combined video signal from an optical image comprises the steps of: receiving separated red, green, and blue optical images; generating first red, first green, and first blue video signals with a first exposure interval and second red, second green, and second blue video signals with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first red, first green, and first blue video signals respectively having first red, first green, and first blue effective detection ranges and the second red, second green, and second blue video signals respectively having second red, second green, and second blue effective detection ranges which are different from the first red, first green, and first blue effective detection ranges but continuous; synchronizing the first red, first green, and first blue video signals with second red, second green, and second blue video signals every corresponding frames of the first red, first green, and first blue video signals and the second red, second green, and second blue video signals, respectively; detecting an exposure ratio between the first and second exposure intervals; adjusting difference between gains
  • the fourth method may further comprise the steps of: detecting a maximum level among the combined red, combined green, and combined blue video signals for one frame period; and generating and outputting red, green, and blue display signals having non-linear characteristics in accordance with display dynamic data and the maximum level such that the maximum level is made equal to or less than the display dynamic range data when the detected maximum level is larger than the display dynamic range data and outputting the combined red, green, and blue video signal as they are when the detected maximum level is not larger than the display dynamic range data.
  • a video camera which comprises: a lens unit; separation unit for separating an optical image beam into separated red, green, and blue optical images; an imaging unit including driving circuit for receiving separated red, green, and blue optical images and generating first red, first green, and first blue video signals with a first exposure interval and second red, second green, and second blue video signals with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first red, first green, and first blue video signals respectively having first red, first green, and first blue effective detection ranges, the second red, second green, and second blue video signals respectively having second red, second green, and second blue effective detection ranges which are different from first red, first green, and first blue effective detection ranges respectively but continuous; a synchronizing circuit for synchronizing the first red, first green, and first blue video signals with second red, second green, and second blue video signals every corresponding frames of the first red, first green, and first blue video signals and the second red, second green, and second blue
  • the camera may further comprise: a maximum detection circuit for detecting a maximum level among the combined red, combined green, and combined blue video signals for one frame period; and a non-linear processing circuit responsive to display dynamic range data for generating and outputting red, green, and blue display signals having non-linear characteristics such that the maximum level is made equal to or less than the display dynamic range data when the detected maximum level is larger than the display dynamic range data and outputting the combined red, green, and blue video signal as they are when the detected maximum level is not larger than the display dynamic range data.
  • a maximum detection circuit for detecting a maximum level among the combined red, combined green, and combined blue video signals for one frame period
  • a non-linear processing circuit responsive to display dynamic range data for generating and outputting red, green, and blue display signals having non-linear characteristics such that the maximum level is made equal to or less than the display dynamic range data when the detected maximum level is larger than the display dynamic range data and outputting the combined red, green, and blue video signal as they are when the detected maximum level is not larger than
  • FIG. 1 is a block diagram of an imaging apparatus of a first embodiment
  • FIG. 2 is a block diagram of the first embodiment showing the structure of the synchronizing circuit shown in FIG. 1;
  • FIGS. 3A to 3 E are timing charts of the first embodiment for illustrating the synchronizing operation
  • FIG. 4 is a time chart of the first embodiment showing the exposure interval identification signal shown in FIG. 1;
  • FIG. 5 is a time chart of the first embodiment showing the gain control signal shown in FIG. 1;
  • FIGS. 6A to 6 C are graphical drawings of the first embodiment showing the gain-adjusting and combining operations
  • FIGS. 7A to 7 C are graphical drawings of the first embodiment showing another example of the gain-adjusting and combining operations
  • FIG. 8 is a block diagram of an imaging apparatus of a second embodiment
  • FIGS. 9A and 9B are graphical drawings of the second embodiment
  • FIG. 10 is a block diagram of an imaging apparatus of a third embodiment
  • FIGS. 11A to 11 D are graphical drawings of the third embodiment
  • FIG. 12 is a block diagram of an imaging apparatus of a fourth embodiment
  • FIG. 13 is a block diagram of an imaging apparatus of a fifth embodiment
  • FIG. 14 is a block diagram of an imaging apparatus of a sixth embodiment
  • FIG. 15 is a block diagram of an imaging apparatus of a seventh embodiment
  • FIGS. 16 and 17 are graphical drawings of the seventh embodiment of this invention illustrating the dynamic range compression operation
  • FIG. 18 is a block diagram of the non-linear processing circuit of the seventh embodiment.
  • FIGS. 19A to 19 C are graphical drawings of the seventh embodiment illustrating the non-linear processing.
  • FIG. 1 is a block diagram of an imaging apparatus of a first embodiment.
  • An imager 1010 receives an optical image thereon through a lens unit 10 and alternatively generating a long exposure video signal with a first exposure interval and a short interval exposed video signal with a second exposure interval substantially at the same time (at slightly different timings, i.e., consecutive two frames) under control by a driving circuit 1020 .
  • the second exposure interval is shorter than the first exposure interval.
  • the long exposure video signal and the short exposure video signal respectively have first and second effective detection ranges 11 and 12 .
  • a pre-processing circuit 1030 effects pre-processing the long exposure video signal and short exposure video signal.
  • the pre-processing circuit 1030 includes a CDS circuit (not shown) for cancelling noise components in the analog long exposure video signal and the analog short exposure video signal from the imager 1010 by correlation double sampling, an automatic gain controlled amplifier (not shown) for amplifying the long exposure video signal and the short exposure video signal from the CDS circuit with the gain automatically controlled, a clamp circuit for clamping the output of the automatic gain controlled amplifier for inputting it to the following a/d converter 1040 .
  • the a/d converter 1040 a/d-converts the long exposure video signal and the short exposure video signal into a digital long exposure video signal and a digital short exposure video signal.
  • the output 1041 of the a/d converter 1040 is supplied to a synchronizing circuit 1050 .
  • the synchronizing circuit 1050 synchronizes the digital long exposure video signal with the digital short exposure video signal and outputs the digital long exposure video signal and the digital short exposure video signal in parallel at the same time with the slight time different adjusted.
  • An exposure ratio detection circuit 1140 responsive to the driving circuit 1020 detects an exposure ratio between the first and second exposure intervals and outputs a gain control signal 1141 .
  • a gain adjusting circuit 1150 adjusts a difference between gains of the first and second video signals from the synchronizing circuit 1050 in accordance with the exposure ratio in the gain control signal 1141 from the exposure ratio detection circuit 1140 , that is, a gain of the short exposure video signal from the synchronizing circuit 1050 is adjusted.
  • a video signal combining circuit 1080 includes a mixing control signal generation circuit 1083 for generating a mixing control signal indicative of a mixing ratio k between the long exposure video signal and the short exposure video signals and combines the long exposure signal from the synchronizing circuit 1050 with the short exposure video signal from the gain adjusting circuit 1150 in accordance with the mixing control signal 1082 shown in FIG. 7B and levels of the long exposure video signal and the gain adjusted short exposure video signal to have an expanded detection range such that the first effective detection range 11 is connected to the second effective detection range 12 .
  • the combined video signal 1080 shows a linearity because the gain of the short exposure video signal 1070 is adjusted.
  • the combined video signal 1081 is supplied to a gamma adjusting circuit 1090 and to an edge enhancement signal generation circuit 1100 .
  • the gamma adjusting circuit 1090 adjusts the gamma of the combined video signal 1081 .
  • the edge enhancement signal generation circuit 1100 generates an edge enhancement signal from the combined video signal 1081 and supplies the edge enhancement signal to a coring circuit 1110 .
  • the coring circuit 1110 removes noise components of which levels less than a predetermined level and supplies the edge enhancement signal to a multiplexer 1120 .
  • the multiplexer 1120 multiply the edge enhancement signal with an edge enhancement control signal and supplies the edge enhancement signal to an adder 1130 .
  • the adder 1130 adds the edge enhancement signal from the multiplexer 1120 to the gamma-adjusted video signal 1091 to generate an output video signal 1131 .
  • the lens unit 10 is further provided to the imaging apparatus to provide a video camera.
  • FIG. 2 is a block diagram of the first embodiment showing the structure of the synchronizing circuit shown in FIG. 1.
  • the synchronizing circuit 1050 includes a memory for storing the output of the a/d converter 1041 , a selector 10513 for outputting either of the output 1041 of the a/d converter or the output 10512 of the memory 10511 in accordance with an exposure interval identification signal 1021 from the driving circuit 1020 to selectively output the long exposure video signal 1060 , and a selector 10514 for outputting either of the output 1041 of the a/d converter or the output 10512 of the memory 10511 in accordance with the exposure interval identification signal 1021 from the driving circuit 1020 to selectively output the short exposure video signal 1060 .
  • FIGS. 3A to 3 E are timing charts of the first embodiment for illustrating the synchronizing operation by the synchronizing circuit 1050 .
  • the imager 1010 alternately outputs the long exposure video signal and the short exposure video signal as shown in FIG. 3A as the output 1041 of the a/d converter 1040 .
  • the memory 10511 outputs the output 1041 of the a/d converter 1040 with one frame delay. Therefore, one frame of the short exposure video signal on the line 10515 is synchronized with the corresponding frame of the long exposure video signal from the memory 10511 . For the next frame interval, the long exposure video signal on the line 10515 is synchronized with the corresponding frame of the short exposure video signal from the memory 10511 . This operation is repeated as shown in FIGS. 3A and 3B.
  • the exposure interval identification signal 1021 changes its output level between “2” and “64” every frame (field) as shown in FIG. 3C.
  • the selector 10513 performs the switching operation to only output the long exposure video signal 1060 continuously as shown in FIG. 3E.
  • the selector 10514 performs the switching operation to only output the short exposure video signal 1070 continuously, as shown in FIG. 3D.
  • a frame of the short exposure video signal from the selector 10514 is synchronous with the corresponding frame of the long exposure video signal 1060 from the selector 10513 as shown in FIGS. 3D and 3E.
  • FIG. 4 is a time chart of the first embodiment showing the exposure interval identification signal 1021 .
  • the driving circuit 1020 generates the exposure interval identification signal 1021 alternately showing a high level value of “64” for the long exposure interval and a low level value of “2” for the short exposure interval as shown in FIG. 4.
  • FIG. 5 is a time chart of the first embodiment showing the gain control signal 1141 .
  • the exposure ratio detection circuit 1140 detects the exposure ratio of “32” from the high level value of “64” for the long exposure interval (frame) and the low level value of “2” for short exposure interval (frame) as shown in FIG. 5.
  • FIGS. 6A to 6 C are graphical drawings of the first embodiment showing the gain-adjusting and combining operations.
  • a level of the long exposure video signal 1060 increases with the amount of received light up to a saturation level (SAT) at a saturation amount. After (larger) the saturation amount the level of the long exposure video signal 1060 is constant.
  • the long exposure video signal saturates with a relatively low amount of light because the exposure interval is relatively long.
  • the noise level is relatively low. Therefore, the long exposure video signal has the first effective detection range 11 .
  • the short exposure video signal 1070 as shown in FIG. 6B, a level of the short exposure video signal 1070 increases with the amount of received light up to the saturation level at with a low gamma 7 .
  • the short exposure video signal saturates with a relatively high amount of light because the exposure interval is relatively short.
  • the noise level is relatively high. Therefore, the short exposure video signal has the second effective detection range 12 .
  • the long exposure video signal 1060 is combined with the short exposure video signal 1070 to provide an expanded detection range 13 .
  • FIGS. 7A to 7 C are graphical drawings of the first embodiment showing another example of the gain-adjusting and combining operations.
  • FIG. 7B shows the mixing control signal 1083 .
  • the long exposure video signal is modified by ratio (1 ⁇ k) at the mixing region 16 and the short exposure video signal is modified by mixing ratio k at the mixing ratio 16 as shown in FIG. 7A.
  • the combining circuit 1080 combines the short exposure video signal from the gain adjusting circuit 1150 with the short exposure video signal 1060 by adding the modified long exposure video signal to the short exposure video signal as shown in FIGS. 7A and 7C to provide the combined video signal with an expanded detection range 13 such that the first effective detection range 11 is connected to the second effective detection range 12 .
  • the gain of the short exposure video signal is adjusted by the gain adjusting circuit 1150 .
  • FIG. 8 is a block diagram of an imaging apparatus of a second embodiment.
  • the imaging apparatus of the second embodiment has substantially the same structure as that of the first embodiment. The difference is that the gain adjustment circuit 1150 and the exposure ratio detection circuit 1140 are omitted and an edge enhancement amount control signal generation circuit 1160 and a multiplier 1170 are further provided.
  • FIGS. 9A and 9B are graphical drawings of the second embodiment.
  • FIG. 9A shows the mixing control signal which is also shown in FIG. 7A.
  • FIG. 9B shows an edge enhancement amount control signal 1161 .
  • the edge enhancement amount control circuit 1160 generates the edge enhancement amount control signal 1161 in accordance with the mixing control signal 1082 as shown in FIGS. 9A and 9B.
  • the multiplier 1170 controls the amount of the edge enhancement signal 1101 in accordance with the edge enhancement amount control signal 1161 and supplies the edge enhancement signal subjected to the edge enhancement amount controlling to the coring processing circuit 1110 .
  • the edge enhancement amount control signal 1161 at the long exposure region 15 indicates a coefficient of “1” for the multiplier 1170 and a coefficient of “2” at the short exposure region 17 for example. Therefore, the edge enhancement signal is controlled to have a larger edge enhancement signal at the short exposure ratio 17 by the multiplier 1170 .
  • the gain adjusting circuit 1150 and the exposure ratio detection circuit 1140 are omitted.
  • these circuits are further provided to the imaging apparatus of the second embodiment as similar to the first embodiment.
  • FIG. 10 is a block diagram of an imaging apparatus of a third embodiment.
  • the imaging apparatus of the third embodiment has substantially the same structure as that of the second embodiment. The difference is that a coring amount control circuit 1180 and a multiplier 1190 are further provided and an amount of coring can be controlled, that is, a coring circuit 1112 is provided.
  • FIGS. 11A to 11 D are graphical drawings of the third embodiment, wherein FIG. 11A shows the mixing control signal 1082 which is also shown in FIG. 7A.
  • the coring amount control circuit 1180 generates the coring amount control signal 1181 in accordance with the mixing control signal 1082 .
  • the multiplier 1190 multiplies the coring amount control signal 1181 with a coefficient and supplies a final coring amount control signal to the coring circuit 1112 . Therefore, noise components in the edge enhancement signal is controlled by the coring circuit 1112 .
  • FIG. 11C shows the case that the coring amount is “1” and FIG. 11D shows the case that the coring amount is “1.5” Then, the noise components in the edge enhanced video signal at the short exposure region 17 which is conspicuous in the reproduced image is suppressed, so that the noise in the output video signal is improved.
  • the gain adjusting circuit 1150 and the exposure ratio detection circuit 1140 are omitted.
  • these circuits are further provided to the imaging apparatus of the third embodiment as similar to the first embodiment.
  • FIG. 12 is a block diagram of an imaging apparatus of a fourth embodiment.
  • the imaging apparatus of the fourth embodiment has substantially the same structure as that of the second embodiment. The difference is that the exposure ratio detection circuit 1140 and a multiplier 1200 are further provided.
  • the multiplier 1200 controls the edge enhancement amount control signal 1161 in accordance with the gain control signal 1141 indicating the exposure ratio between the long exposure interval and the short exposure interval.
  • the total amount of the edge enhancement signal is controlled, that is, weighted, by the multiplier 1170 in accordance with the edge enhancement amount control signal derived from the mixing control signal 1082 and the gain control signal 1141 derived from the exposure ratio. Then, the edges at the short exposure region which tends to be flat because of the short exposure can be enhanced further.
  • the gain adjusting circuit 1150 is omitted.
  • the gain adjusting circuit 1150 are further provided to the imaging apparatus of the fourth embodiment as similar to the first embodiment.
  • the edge enhancement amount control circuit 1160 can be omitted as the modification of this embodiment.
  • FIG. 13 is a block diagram of an imaging apparatus of a fifth embodiment.
  • the imaging apparatus of the fifth embodiment has substantially the same structure as that of the fourth embodiment. The difference is that a multiplier 1210 and the coring amount control circuit 1180 and the multiplier 1190 which are used in the third embodiment are further provided.
  • the coring amount control circuit 1180 generates the coring amount controls signal 1181 in accordance with the mixing control signal 1082 as mentioned in the third embodiment.
  • the multiplier 1210 controls the coring amount control signal 1181 in accordance with the gain control signal 1141 indicating the exposure ratio between the long exposure interval and the short exposure interval.
  • the second coring amount control signal 1211 is controlled, that is, weighted, by the multiplier 1210 in accordance with the coring amount control signal 1181 derived from the mixing control signal 1082 and the gain control signal 1141 derived from the exposure ratio. Noise components in the edge enhancement signal from the multiplier 1170 is suppressed by the coring circuit 1112 .
  • the edges at the short exposure region which tends to be flat because of the short exposure will be enhanced further and the noise component coring at the short exposure region which tends to be flat because of the short exposure can be enhanced further by providing the edge enhancement control circuit 1160 .
  • the noise components in the edge enhanced video signal at the short exposure region 17 which is conspicuous in the reproduced image is suppressed, so that the noise in the output video signal is improved.
  • the gain adjusting circuit 1150 is omitted.
  • the gain adjusting circuit 1150 are further provided in the imaging apparatus of the fifth embodiment as similar to the first embodiment.
  • FIG. 14 is a block diagram of an imaging apparatus of a sixth embodiment.
  • the imaging apparatus of the sixth embodiment has substantially the same structure as that of the first embodiment.
  • a prism unit 1000 for separating the incident image into color images that is, a red image, a green image, and a blue image
  • the imagers 1010 respectively receives the red image, the green image, and a blue image
  • the processing circuits each including the pre-processing circuit 1030 , the a/d converter 1040 , the synchronizing circuit 1050 , the gain adjusting circuit 1110 , the combining circuit 1080 , are provided for the red, green, and blue images respectively, and camera processing circuit 1090 for processing the respective color video signal is further provided.
  • dichroic mirror units may be used instead the prism unit 1000 .
  • the imager 1010 of each color receives an optical image from the prism 1000 and generates a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second effective detection ranges 11 and 12 .
  • the synchronizing circuit 1050 for each color synchronizes the first video signal with the second video signal.
  • the exposure interval ratio detection circuit 1100 responsive to the driving circuit 1020 detects an exposure ratio between the first and second exposure intervals.
  • the gain adjusting circuit 1110 for each color adjusts the gain of the second video signal from the synchronizing circuit 1050 in accordance with the exposure ratio.
  • the mixing control signal generation 1083 for each color generates a mixing control signal indicative of a mixing ratio of the first and second video signals.
  • the combining circuit 1080 for each color generates a combined video signal from the first and second video signals in accordance with the mixing control signal and levels of the first and second video signals to have an expanded detection range such that the first effective detection range is connected to the second effective detection range as described in the first embodiment.
  • the camera processing circuit 1090 processes the combined video signals 1081 of red, green, and blue color to generates output red signal, an output green signal, and an output blue signal.
  • the second to fifth embodiments are applicable to the imaging apparatus of the sixth embodiment.
  • FIG. 15 is a block diagram of an imaging apparatus of a seventh embodiment.
  • the imaging apparatus of the seventh embodiment has substantially the same structure as that of the sixth embodiment. The difference is that a max detection circuit 1130 , non-linear processing circuits 1120 , and a display dynamic range setting circuit 1140 are further provided.
  • the display dynamic setting circuit 1140 generates or receive and supplies data 1141 of display dynamic range (DISPMAX).
  • the max detection circuit 1130 detects the maximum level among the third red, third green, and third blue video signals for one frame period.
  • the non-linear processing circuits 1120 responsive to display dynamic range data (DISPMAX) 1141 generates and outputs red, green, and blue display signals having non-linear characteristics such that the maximum level is made equal to or less than the display dynamic range data when the detected maximum level is larger than the display dynamic range data and outputs the combined red, green, and blue video signal as they are when the detected maximum level is not larger than the display dynamic range data.
  • the non-linear processing circuit 1120 compress the dynamic range of the combined video signal to obtain a display video signal in accordance with the detected maximum (highest high light) level among the third red, third green and third blue video signals for one frame period, saturation data, and the display dynamic range setting data (DISPMAX) 1141 by internally dividing operation.
  • FIGS. 16 and 17 are graphical drawings of the seventh embodiment of this invention illustrating the dynamic range compression operation.
  • the display dynamic range (DISPMAX) 1141 is 20. and the maximum value (RGBMAX) is 25 .
  • the characteristic (gradation characteristic) curve of the combined video signals 1081 are bent above the saturation level (SAT).
  • the level of the range-compressed video signal is provided by the internally dividing the level of the combined video signal using the maximum (RGBMAX), the saturation level (SAT), and the display dynamic range setting data (DISPMAX) 1141 .
  • the maximum detection circuit 1130 detects a maximum level among the combined video signals 1081 of red, green, and blue for one frame and supplies the maximum level (RGBMAX) 1131 to the non-liner processing circuits 1120 .
  • the non-linear processing circuit 1120 generates the range-compressed video data in accordance with the detected maximum value, the saturation data, and the display range (DISPMAX) 1141 .
  • level A is smaller than the saturation level (SAT)
  • SAT saturation level
  • level A is more than the saturation level (SAT)
  • SAT saturation level
  • ⁇ A ( A ⁇ SAT )/( RGBMAX ⁇ SAT )
  • A′′ A ⁇ ( ⁇ A ) n ⁇ ( RGBMAX ⁇ DISPMAX ) ⁇ .
  • FIG. 17 shows the curves for providing the non-liner characteristic when the control coefficient n is varied from one to three.
  • FIG. 18 is a block diagram of the non-linear processing circuit 1120 of the seventh embodiment.
  • the non-liner processing circuit 1120 includes a judging circuit 20 , subtractors 21 to 24 , multipliers 25 and 26 , a divider 27 , switches 28 and 29 and generates a non-linear video signal 1121 in response to the combined video signal 1081 , the maximum value 1131 , the saturation data 1082 , and a display maximum value 1141 .
  • the control efficient n for the non-liner characteristic is determined by the number of the multipliers 25 and connections around the multipliers 25 .
  • the display dynamic range (DISPMAX) 1141 may be generated by a ROM or a RAM storing the display dynamic range (DISPMAX) 1141 , manually set, or sent from the display apparatus to be connected. Moreover, the saturation value SAT can be decreased as desired by an operator.
  • FIGS. 19A to 19 C are graphical drawings of the seventh embodiment illustrating the non-linear processing.
  • the level of the red video signal is shifted from 20 to 17 by the non-linear processing, the level of the green video signal remains about 5 because the original level “5” is near the cut point “3” which is the saturation level, and the level of the blue video signal is shifted from 25 to 20 by the non-linear processing.
  • the second to fifth embodiments are applicable to the imaging apparatus of the seventh embodiment.

Abstract

An imaging circuit generates a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second dynamic ranges which are different but continues. The first video signal is synchronized with the second video signal. An exposure ratio between the first and second exposure intervals is detected. A gain of the second video signal is adjusted according to the exposure ratio. A combined video signal is generated from the first and second video signals according to a mixing control signal indicative of a mixing ratio between first and second video signals and levels of the first and second video signals to have an expanded dynamic range such that the first dynamic range is connected to the second dynamic range with difference in gains of the first and second video signals adjusted for linearity. An edge enhancement signal may be gain-controlled or coring-controlled according to the mixing control signal or the exposure ratio. The similar apparatus and method for color signals are also disclosed. The output dynamic range for a display is limited by a non-linear process.

Description

    BACKGROUND OF THE INVENTION
  • 1. Field of the Invention [0001]
  • This invention relates to an imaging apparatus with its dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal. [0002]
  • 2. Description of the Prior Art [0003]
  • An imaging apparatus for generating a dynamic range expanded video signal by combining video signals generated substantially at the same time with different exposure intervals is known. Such an image apparatus is disclosed in Japanese patent application provisional publication No. 07131718A. A video signal processing circuit including an edge enhancement signal generation circuit generating an edge enhancement signal from a video signal and a gamma correction circuit for compensating a gamma of the video signal, wherein the edge enhancement signal is not subjected the gamma correction and is added to the gamma-corrected video signal is known. Such a video signal processing circuit is disclosed in Japanese patent application provisional publication No. 63-209373. [0004]
  • SUMMARY OF THE INVENTION
  • The aim of the present invention is to provide a superior imaging apparatus with dynamic range expanded, a superior video camera including the same, and a superior method of generating a dynamic range expanded video signal. [0005]
  • According to the present invention, a first imaging apparatus is provided, which comprises: an imager including driving circuit for receiving an optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second effective detection ranges which are different but continuous; a synchronizing circuit for synchronizing the first video signal with the second video signal every corresponding frames of the first and second video signals; an exposure interval ratio detection circuit responsive to the driving circuit for detecting an exposure ratio between the first and second exposure intervals; a gain adjusting circuit responsive to the first and second video signals from the synchronizing circuit for adjusting a difference between gains of the first and second video signals from the synchronizing circuit in accordance with the exposure ratio from the exposure interval ratio detection circuit for linearity; a mixing control signal generation circuit for generating a mixing control signal indicative of a mixing ratio of the first and second video signals in accordance with the first and second video signals from the gain adjusting circuit; and a combining circuit for generating and outputting a combined video signal from the first and second video signals from the gain adjusting circuit. In accordance with the mixing control signal and levels of the first and second video signals to have an expanded detection range such that the first effective detection range is connected to the second effective detection range. [0006]
  • In the first imaging apparatus, the gain adjusting circuit adjusts the difference between gains of the first and second video signals from the synchronizing circuit to provide a linearity in the expanded detection range. [0007]
  • The first imaging apparatus may further comprise: an edge enhancement signal generation circuit for generating an edge enhancement signal from the combined video signal; an edge enhancement amount control circuit for controlling an amount of the edge enhancement signal in accordance with the mixing control signal; and an adding circuit for adding the edge enhancement signal from the gain adjusting circuit and the combined video signal and outputting an edge-enhanced video signal. In this case, the edge enhancement amount control circuit controls the amount of the edge enhancement signal in accordance with the exposure ratio in addition to the mixing control signal. [0008]
  • The first imaging apparatus may further comprise: an edge enhancement signal generation circuit for generating an edge enhancement signal from the combined video signal; a coring amount control signal generation circuit for generating a coring amount control signal in accordance with the mixing control signal; and a coring circuit for effecting a coring operation to the edge enhanced signal in accordance with the coring amount control signal from the coring amount control signal generation circuit; and an adding circuit for adding the edge enhancement signal from the edge enhancement signal generation circuit and the combined video signal and outputting an edge-enhanced video signal. In this case, the coring amount control signal generation circuit generates the coring amount control signal in accordance with the exposure ratio in addition to the mixing control signal. [0009]
  • According to the present invention, a first method of generating a combined video signal from an optical image is provided which comprises the steps of: receiving the optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second effective detection ranges which are different but continuous; synchronizing the first video signal with the second video signal every corresponding frames of the first and second video signals; detecting an exposure ratio between the first and second exposure intervals; adjusting a difference in gains of the synchronized first and second video signal in accordance with the exposure ratio; generating a mixing control signal indicative of a mixing ratio of the first and second video signals in accordance with the gain-adjusted first and second video signals; and generating and outputting the combined video signal from the gain-adjusted first and second video signals in accordance with the mixing control signal and levels of the gain-adjusted first and second video signals to have an expanded dynamic range such that the first effective detection range is connected to the second effective detection range. [0010]
  • According to the present invention, a second imaging apparatus is provided which comprises: an imager including a driving circuit for receiving an optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second dynamic ranges which are different but continuous; a synchronizing circuit for synchronizing the first video signal with the second video signal every corresponding frames of the first and second video signals; a mixing control signal generation circuit for generating a mixing control signal indicative of a mixing ratio of the first and second video signals; a video signal generation circuit for generating a combined video signal from the first and second video signals from the synchronizing circuit in accordance with the mixing control signal and levels of the first and second video signals to have an expanded dynamic range such that the first effective detection range is connected to the second effective detection range; an edge enhancement signal generation circuit for generating an edge enhancement signal from the combined video signal; an edge enhancement amount control circuit responsive to the driving circuit for controlling an amount of the edge enhancement signal in accordance with the mixing control signal; and an adding circuit for adding the edge enhancement signal from the gain adjusting circuit and the combined video signal and outputting an edge-enhanced video signal. [0011]
  • The second imaging apparatus may further comprise a generation circuit generating a coring amount control signal in accordance with the mixing control signal and a coring circuit for effecting a coring operation to the edge enhancement signal in accordance with the coring amount control signal. [0012]
  • According to the present invention, a second method of generating a combined video signal from an optical image is provided which comprises the steps of: receiving the optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second effective detection ranges which are different but continuous; synchronizing the first video signal with the second video signal every corresponding frames of the first and second video signals; generating a mixing control signal indicative of a mixing ratio of the first and second video signals in accordance with the gain-adjusted first and second video signals; generating the combined video signal from the synchronized first and second video signal in accordance with the mixing control signal and levels of the first and second video signals to have an expanded detection range such that the first effective detection range is connected to the second effective detection range; generating an edge enhancement signal from the combined video signal; controlling an amount of the edge enhancement signal in accordance with the mixing control signal; and adding the gain-adjusted edge enhancement signal and the combined video signal and outputting an edge-enhanced video signal. [0013]
  • The second method may further comprise the steps of: generating a coring amount control signal in accordance with the mixing control signal; and effecting a coring operation to the edge enhancement signal in accordance with the coring amount control signal. [0014]
  • According to the present invention, a third imaging apparatus is provided which comprises: an imager including driving circuit for receiving an optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second effective detection ranges which are different but continuous; a synchronizing circuit for synchronizing the first video signal with the second video signal every corresponding frames of the first and second video signals; an exposure ratio detection circuit responsive to the driving circuit for detecting an exposure ratio between the first and second exposure intervals; a mixing control signal generation circuit for generating a mixing control signal indicative of a mixing ratio of the first and second video signals in accordance with the first and second video signals from the synchronizing circuit; a combining circuit for generating a combined video signal from the first and second video signals from the synchronizing circuit in accordance with the mixing control signal and levels of the first and second video signals to have an expanded dynamic range-such that the first effective detection range is connected to the second effective detection range; an edge enhancement signal generation circuit for generating an edge enhancement signal from the combined video signal; an edge enhancement amount control circuit for controlling an amount of the edge enhancement control signal in accordance with the mixing control signal and the exposure interval ratio; and an adding circuit for adding the edge enhancement signal from the gain adjusting circuit and the combined video signal and outputting an edge-enhanced video signal. [0015]
  • The third imaging apparatus may further comprise: a coring amount control signal generation circuit for generating a coring amount control signal in accordance with the mixing control signal and the exposure ratio; and a coring circuit for effecting a coring operation to the edge enhanced signal in accordance with the coring amount control signal from the coring amount control signal generation circuit. [0016]
  • According to the present invention, a third method of generating a combined video signal from an optical image is provided which comprises the steps of: receiving the optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second effective detection ranges which are different but continuous; synchronizing the first video signal with the second video signal; detecting an exposure ratio between the first and second exposure intervals; generating a mixing control signal indicative of a mixing ratio of the synchronized first and second video signals in accordance with the synchronized first and second video signals; generating the combined video signal from the synchronized first and second video signals in accordance with the mixing control signal and levels of the first and second video signals to have an expanded detection range such that the first effective detection range is connected to the second effective detection range; generating an edge enhancement signal from the combined video signal; controlling an amount of the edge enhancement signal in accordance with the mixing control signal and the exposure interval; and adding the gain-adjusted enhancement signal from the gain adjusting circuit and the combined video signal and outputting an edge-enhanced video signal. [0017]
  • The third method may further comprise the steps of: generating a coring amount control signal in accordance with the mixing control signal and the exposure ratio; and effecting a coring operation to the edge enhancement signal in accordance with the coring amount control signal. [0018]
  • According to the present invention, a fourth imaging apparatus is provided which comprises: an imager including driving circuit for receiving separated red, green, and blue optical images and generating first red, first green, and first blue video signals with a first exposure interval and second red, second green, and second blue video signals with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first red, green, and blue video signals respectively having first red, first green, and first blue effective detection ranges which are different from the second red, second green, and blue but continuous; a synchronizing circuit for synchronizing the first red, first green, and first blue video signals with second red, second green, and second blue video signals every corresponding frames of the first red, first green, and first blue video signals and the second red, second green, and second blue video signals, respectively; an exposure interval ratio detection circuit responsive to the driving circuit for detecting an exposure ratio between the first and second exposure intervals; a gain adjusting circuit for respectively adjusting difference between gains of the first red, first green, and first blue video signals and second red, first, and video signals from the synchronizing circuit in accordance with the exposure ratio from the exposure interval ratio detection circuit; a mixing control signal generation circuit for generating red, green, and blue mixing control signals respectively indicating mixing ratios between the first red, first green, and first blue video signals and second red, second green, and second blue video signals in accordance with the first red, first green, and first blue video signals and second red, second green, and second blue video signals; and a combining circuit for generating and outputting combined red, green, and blue video signals from the first red, first green, and first blue video signals and second red, second green, and second blue video signals from the gain adjusting circuit in accordance with the red, green, and blue mixing control signals and levels of the first red, first green, and first blue video signals and second red, second green, and second blue video signals to have expanded red, green, and blue detection ranges such that the first red, first green, and first blue effective detection ranges are connected to the second red, second green, and second blue video signals, respectively. [0019]
  • The fourth imaging apparatus may further comprise: a maximum detection circuit for detecting a maximum level among the combined red, combined green, and combined blue video signals for one frame period; and a non-linear processing circuit responsive to display dynamic range data for generating and outputting red, green, and blue display signals respectively having non-linear characteristics such that the maximum level is made equal to or less than the display dynamic range data when the detected maximum level is larger than the display dynamic range data and outputting the combined red, green, and blue video signal as they are when the detected maximum level is not larger than the display dynamic range data. [0020]
  • According to the present invention, a fourth method of generating a combined video signal from an optical image is provided which comprises the steps of: receiving separated red, green, and blue optical images; generating first red, first green, and first blue video signals with a first exposure interval and second red, second green, and second blue video signals with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first red, first green, and first blue video signals respectively having first red, first green, and first blue effective detection ranges and the second red, second green, and second blue video signals respectively having second red, second green, and second blue effective detection ranges which are different from the first red, first green, and first blue effective detection ranges but continuous; synchronizing the first red, first green, and first blue video signals with second red, second green, and second blue video signals every corresponding frames of the first red, first green, and first blue video signals and the second red, second green, and second blue video signals, respectively; detecting an exposure ratio between the first and second exposure intervals; adjusting difference between gains of the first red, first green, and first blue video signals and second red, second green, and second blue video signals from the synchronizing circuit in accordance with the exposure ratio; generating red, green, and blue mixing control signals respectively indicating mixing ratios between the first red, first green, and first blue video signals and second red, second green, and second blue video signals; and generating and outputting combined red, green, and blue video signals from the first red, first green, and first blue video signals and second red, second green, and second blue video signals from the gain adjusting circuit in accordance with the red, green, and blue mixing control signals and levels of the first red, first green, and first blue video signals and second red, second green, and second blue video signals to have expanded red, green, and blue detection ranges such that the first red, first green, and first blue effective detection ranges are connected to the second red, second green, and second blue video signals, respectively. [0021]
  • The fourth method may further comprise the steps of: detecting a maximum level among the combined red, combined green, and combined blue video signals for one frame period; and generating and outputting red, green, and blue display signals having non-linear characteristics in accordance with display dynamic data and the maximum level such that the maximum level is made equal to or less than the display dynamic range data when the detected maximum level is larger than the display dynamic range data and outputting the combined red, green, and blue video signal as they are when the detected maximum level is not larger than the display dynamic range data. [0022]
  • According to the present invention, a video camera is provided which comprises: a lens unit; separation unit for separating an optical image beam into separated red, green, and blue optical images; an imaging unit including driving circuit for receiving separated red, green, and blue optical images and generating first red, first green, and first blue video signals with a first exposure interval and second red, second green, and second blue video signals with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first red, first green, and first blue video signals respectively having first red, first green, and first blue effective detection ranges, the second red, second green, and second blue video signals respectively having second red, second green, and second blue effective detection ranges which are different from first red, first green, and first blue effective detection ranges respectively but continuous; a synchronizing circuit for synchronizing the first red, first green, and first blue video signals with second red, second green, and second blue video signals every corresponding frames of the first red, first green, and first blue video signals and the second red, second green, and second blue video signals, respectively; an exposure interval ratio detection circuit responsive to the driving circuit for detecting an exposure ratio between the first and second exposure intervals; a gain adjusting circuit for respectively adjusting difference between gains of the first red, first green, and first blue video signals and second red, first, and video signals from the synchronizing circuit in accordance with the exposure ratio from the exposure interval ratio detection circuit; a mixing control signal generation circuit for generating red, green, and blue mixing control signals respectively indicating mixing ratios between the first red, first green, and first blue video signals and second red, second green, and second blue video signals; and a combining circuit for generating and outputting combined red, green, and blue video signals from the first red, first green, and first blue video signals and second red, second green, and second blue video signals from the gain adjusting circuit in accordance with the red, green and blue mixing control signals and levels of the first red, first green, and first blue video signals and second red, second green, and second blue video signals to have expanded red, green, and blue detection ranges such that the first red, first green, and first blue effective detection ranges are connected to the second red, second green, and second blue video signals, respectively. [0023]
  • The camera may further comprise: a maximum detection circuit for detecting a maximum level among the combined red, combined green, and combined blue video signals for one frame period; and a non-linear processing circuit responsive to display dynamic range data for generating and outputting red, green, and blue display signals having non-linear characteristics such that the maximum level is made equal to or less than the display dynamic range data when the detected maximum level is larger than the display dynamic range data and outputting the combined red, green, and blue video signal as they are when the detected maximum level is not larger than the display dynamic range data.[0024]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The object and features of the present invention will become more readily apparent from the following detailed description taken in conjunction with the accompanying drawings in which: [0025]
  • FIG. 1 is a block diagram of an imaging apparatus of a first embodiment; [0026]
  • FIG. 2 is a block diagram of the first embodiment showing the structure of the synchronizing circuit shown in FIG. 1; [0027]
  • FIGS. 3A to [0028] 3E are timing charts of the first embodiment for illustrating the synchronizing operation;
  • FIG. 4 is a time chart of the first embodiment showing the exposure interval identification signal shown in FIG. 1; [0029]
  • FIG. 5 is a time chart of the first embodiment showing the gain control signal shown in FIG. 1; [0030]
  • FIGS. 6A to [0031] 6C are graphical drawings of the first embodiment showing the gain-adjusting and combining operations;
  • FIGS. 7A to [0032] 7C are graphical drawings of the first embodiment showing another example of the gain-adjusting and combining operations;
  • FIG. 8 is a block diagram of an imaging apparatus of a second embodiment; [0033]
  • FIGS. 9A and 9B are graphical drawings of the second embodiment; [0034]
  • FIG. 10 is a block diagram of an imaging apparatus of a third embodiment; [0035]
  • FIGS. 11A to [0036] 11D are graphical drawings of the third embodiment;
  • FIG. 12 is a block diagram of an imaging apparatus of a fourth embodiment; [0037]
  • FIG. 13 is a block diagram of an imaging apparatus of a fifth embodiment; [0038]
  • FIG. 14 is a block diagram of an imaging apparatus of a sixth embodiment; [0039]
  • FIG. 15 is a block diagram of an imaging apparatus of a seventh embodiment; [0040]
  • FIGS. 16 and 17 are graphical drawings of the seventh embodiment of this invention illustrating the dynamic range compression operation; [0041]
  • FIG. 18 is a block diagram of the non-linear processing circuit of the seventh embodiment; and [0042]
  • FIGS. 19A to [0043] 19C are graphical drawings of the seventh embodiment illustrating the non-linear processing.
  • The same or corresponding elements or parts are designated with like references throughout the drawings. [0044]
  • DETAILED DESCRIPTION OF THE INVENTION
  • (First Embodiment) [0045]
  • FIG. 1 is a block diagram of an imaging apparatus of a first embodiment. An [0046] imager 1010 receives an optical image thereon through a lens unit 10 and alternatively generating a long exposure video signal with a first exposure interval and a short interval exposed video signal with a second exposure interval substantially at the same time (at slightly different timings, i.e., consecutive two frames) under control by a driving circuit 1020. The second exposure interval is shorter than the first exposure interval. The long exposure video signal and the short exposure video signal respectively have first and second effective detection ranges 11 and 12. A pre-processing circuit 1030 effects pre-processing the long exposure video signal and short exposure video signal. The pre-processing circuit 1030 includes a CDS circuit (not shown) for cancelling noise components in the analog long exposure video signal and the analog short exposure video signal from the imager 1010 by correlation double sampling, an automatic gain controlled amplifier (not shown) for amplifying the long exposure video signal and the short exposure video signal from the CDS circuit with the gain automatically controlled, a clamp circuit for clamping the output of the automatic gain controlled amplifier for inputting it to the following a/d converter 1040. The a/d converter 1040 a/d-converts the long exposure video signal and the short exposure video signal into a digital long exposure video signal and a digital short exposure video signal. The output 1041 of the a/d converter 1040 is supplied to a synchronizing circuit 1050.
  • The [0047] synchronizing circuit 1050 synchronizes the digital long exposure video signal with the digital short exposure video signal and outputs the digital long exposure video signal and the digital short exposure video signal in parallel at the same time with the slight time different adjusted.
  • An exposure [0048] ratio detection circuit 1140 responsive to the driving circuit 1020 detects an exposure ratio between the first and second exposure intervals and outputs a gain control signal 1141. A gain adjusting circuit 1150 adjusts a difference between gains of the first and second video signals from the synchronizing circuit 1050 in accordance with the exposure ratio in the gain control signal 1141 from the exposure ratio detection circuit 1140, that is, a gain of the short exposure video signal from the synchronizing circuit 1050 is adjusted.
  • A video [0049] signal combining circuit 1080 includes a mixing control signal generation circuit 1083 for generating a mixing control signal indicative of a mixing ratio k between the long exposure video signal and the short exposure video signals and combines the long exposure signal from the synchronizing circuit 1050 with the short exposure video signal from the gain adjusting circuit 1150 in accordance with the mixing control signal 1082 shown in FIG. 7B and levels of the long exposure video signal and the gain adjusted short exposure video signal to have an expanded detection range such that the first effective detection range 11 is connected to the second effective detection range 12. The combined video signal 1080 shows a linearity because the gain of the short exposure video signal 1070 is adjusted.
  • The combined [0050] video signal 1081 is supplied to a gamma adjusting circuit 1090 and to an edge enhancement signal generation circuit 1100. The gamma adjusting circuit 1090 adjusts the gamma of the combined video signal 1081. The edge enhancement signal generation circuit 1100 generates an edge enhancement signal from the combined video signal 1081 and supplies the edge enhancement signal to a coring circuit 1110. The coring circuit 1110 removes noise components of which levels less than a predetermined level and supplies the edge enhancement signal to a multiplexer 1120. The multiplexer 1120 multiply the edge enhancement signal with an edge enhancement control signal and supplies the edge enhancement signal to an adder 1130. The adder 1130 adds the edge enhancement signal from the multiplexer 1120 to the gamma-adjusted video signal 1091 to generate an output video signal 1131. The lens unit 10 is further provided to the imaging apparatus to provide a video camera.
  • FIG. 2 is a block diagram of the first embodiment showing the structure of the synchronizing circuit shown in FIG. 1. The [0051] synchronizing circuit 1050 includes a memory for storing the output of the a/d converter 1041, a selector 10513 for outputting either of the output 1041 of the a/d converter or the output 10512 of the memory 10511 in accordance with an exposure interval identification signal 1021 from the driving circuit 1020 to selectively output the long exposure video signal 1060, and a selector 10514 for outputting either of the output 1041 of the a/d converter or the output 10512 of the memory 10511 in accordance with the exposure interval identification signal 1021 from the driving circuit 1020 to selectively output the short exposure video signal 1060.
  • FIGS. 3A to [0052] 3E are timing charts of the first embodiment for illustrating the synchronizing operation by the synchronizing circuit 1050.
  • The [0053] imager 1010 alternately outputs the long exposure video signal and the short exposure video signal as shown in FIG. 3A as the output 1041 of the a/d converter 1040. The memory 10511 outputs the output 1041 of the a/d converter 1040 with one frame delay. Therefore, one frame of the short exposure video signal on the line 10515 is synchronized with the corresponding frame of the long exposure video signal from the memory 10511. For the next frame interval, the long exposure video signal on the line 10515 is synchronized with the corresponding frame of the short exposure video signal from the memory 10511. This operation is repeated as shown in FIGS. 3A and 3B. The exposure interval identification signal 1021 changes its output level between “2” and “64” every frame (field) as shown in FIG. 3C. The selector 10513 performs the switching operation to only output the long exposure video signal 1060 continuously as shown in FIG. 3E. The selector 10514 performs the switching operation to only output the short exposure video signal 1070 continuously, as shown in FIG. 3D. A frame of the short exposure video signal from the selector 10514 is synchronous with the corresponding frame of the long exposure video signal 1060 from the selector 10513 as shown in FIGS. 3D and 3E.
  • FIG. 4 is a time chart of the first embodiment showing the exposure [0054] interval identification signal 1021. The driving circuit 1020 generates the exposure interval identification signal 1021 alternately showing a high level value of “64” for the long exposure interval and a low level value of “2” for the short exposure interval as shown in FIG. 4.
  • FIG. 5 is a time chart of the first embodiment showing the [0055] gain control signal 1141. The exposure ratio detection circuit 1140 detects the exposure ratio of “32” from the high level value of “64” for the long exposure interval (frame) and the low level value of “2” for short exposure interval (frame) as shown in FIG. 5.
  • FIGS. 6A to [0056] 6C are graphical drawings of the first embodiment showing the gain-adjusting and combining operations.
  • As shown in FIG. 6A, a level of the long [0057] exposure video signal 1060 increases with the amount of received light up to a saturation level (SAT) at a saturation amount. After (larger) the saturation amount the level of the long exposure video signal 1060 is constant. The long exposure video signal saturates with a relatively low amount of light because the exposure interval is relatively long. On the other hand, at the dark level range, the noise level is relatively low. Therefore, the long exposure video signal has the first effective detection range 11.
  • The short [0058] exposure video signal 1070, as shown in FIG. 6B, a level of the short exposure video signal 1070 increases with the amount of received light up to the saturation level at with a low gamma 7. The short exposure video signal saturates with a relatively high amount of light because the exposure interval is relatively short. On the other hand, at the dark level range, the noise level is relatively high. Therefore, the short exposure video signal has the second effective detection range 12.
  • As shown in FIG. 6C, the long [0059] exposure video signal 1060 is combined with the short exposure video signal 1070 to provide an expanded detection range 13.
  • FIGS. 7A to [0060] 7C are graphical drawings of the first embodiment showing another example of the gain-adjusting and combining operations.
  • FIG. 7B shows the mixing [0061] control signal 1083. The mixing control signal 1082 represents the mixing ratio k=0 at the long exposure region 15, the mixing ratio k=1 at the short exposure region 17, and the mixing ratio proportionally increases from k=0 to k=1 at mixing region 16.
  • The long exposure video signal is modified by ratio (1−k) at the mixing [0062] region 16 and the short exposure video signal is modified by mixing ratio k at the mixing ratio 16 as shown in FIG. 7A. The combining circuit 1080 combines the short exposure video signal from the gain adjusting circuit 1150 with the short exposure video signal 1060 by adding the modified long exposure video signal to the short exposure video signal as shown in FIGS. 7A and 7C to provide the combined video signal with an expanded detection range 13 such that the first effective detection range 11 is connected to the second effective detection range 12.
  • In this embodiment the gain of the short exposure video signal is adjusted by the [0063] gain adjusting circuit 1150. However, it is also possible to adjust the gain of the long exposure video signal to match its gamma to that of the short exposure video signal.
  • (Second Embodiment) [0064]
  • FIG. 8 is a block diagram of an imaging apparatus of a second embodiment. [0065]
  • The imaging apparatus of the second embodiment has substantially the same structure as that of the first embodiment. The difference is that the [0066] gain adjustment circuit 1150 and the exposure ratio detection circuit 1140 are omitted and an edge enhancement amount control signal generation circuit 1160 and a multiplier 1170 are further provided.
  • FIGS. 9A and 9B are graphical drawings of the second embodiment. FIG. 9A shows the mixing control signal which is also shown in FIG. 7A. FIG. 9B shows an edge enhancement [0067] amount control signal 1161.
  • The edge enhancement [0068] amount control circuit 1160 generates the edge enhancement amount control signal 1161 in accordance with the mixing control signal 1082 as shown in FIGS. 9A and 9B.
  • The [0069] multiplier 1170 controls the amount of the edge enhancement signal 1101 in accordance with the edge enhancement amount control signal 1161 and supplies the edge enhancement signal subjected to the edge enhancement amount controlling to the coring processing circuit 1110. The edge enhancement amount control signal 1161 at the long exposure region 15 indicates a coefficient of “1” for the multiplier 1170 and a coefficient of “2” at the short exposure region 17 for example. Therefore, the edge enhancement signal is controlled to have a larger edge enhancement signal at the short exposure ratio 17 by the multiplier 1170.
  • In this embodiment, the [0070] gain adjusting circuit 1150 and the exposure ratio detection circuit 1140 are omitted. However, it is also possible that these circuits are further provided to the imaging apparatus of the second embodiment as similar to the first embodiment.
  • (Third Embodiment) [0071]
  • FIG. 10 is a block diagram of an imaging apparatus of a third embodiment. [0072]
  • The imaging apparatus of the third embodiment has substantially the same structure as that of the second embodiment. The difference is that a coring [0073] amount control circuit 1180 and a multiplier 1190 are further provided and an amount of coring can be controlled, that is, a coring circuit 1112 is provided.
  • FIGS. 11A to [0074] 11D are graphical drawings of the third embodiment, wherein FIG. 11A shows the mixing control signal 1082 which is also shown in FIG. 7A.
  • The coring [0075] amount control circuit 1180 generates the coring amount control signal 1181 in accordance with the mixing control signal 1082.
  • The [0076] multiplier 1190 multiplies the coring amount control signal 1181 with a coefficient and supplies a final coring amount control signal to the coring circuit 1112. Therefore, noise components in the edge enhancement signal is controlled by the coring circuit 1112.
  • FIG. 11C shows the case that the coring amount is “1” and FIG. 11D shows the case that the coring amount is “1.5” Then, the noise components in the edge enhanced video signal at the [0077] short exposure region 17 which is conspicuous in the reproduced image is suppressed, so that the noise in the output video signal is improved.
  • In this embodiment, the [0078] gain adjusting circuit 1150 and the exposure ratio detection circuit 1140 are omitted. However, it is also possible that these circuits are further provided to the imaging apparatus of the third embodiment as similar to the first embodiment.
  • (Fourth Embodiment) [0079]
  • FIG. 12 is a block diagram of an imaging apparatus of a fourth embodiment. [0080]
  • The imaging apparatus of the fourth embodiment has substantially the same structure as that of the second embodiment. The difference is that the exposure [0081] ratio detection circuit 1140 and a multiplier 1200 are further provided.
  • The [0082] multiplier 1200 controls the edge enhancement amount control signal 1161 in accordance with the gain control signal 1141 indicating the exposure ratio between the long exposure interval and the short exposure interval. The total amount of the edge enhancement signal is controlled, that is, weighted, by the multiplier 1170 in accordance with the edge enhancement amount control signal derived from the mixing control signal 1082 and the gain control signal 1141 derived from the exposure ratio. Then, the edges at the short exposure region which tends to be flat because of the short exposure can be enhanced further.
  • In this embodiment, the [0083] gain adjusting circuit 1150 is omitted. However, it is also possible that the gain adjusting circuit 1150 are further provided to the imaging apparatus of the fourth embodiment as similar to the first embodiment. Moreover, the edge enhancement amount control circuit 1160 can be omitted as the modification of this embodiment.
  • (Fifth Embodiment) [0084]
  • FIG. 13 is a block diagram of an imaging apparatus of a fifth embodiment. [0085]
  • The imaging apparatus of the fifth embodiment has substantially the same structure as that of the fourth embodiment. The difference is that a multiplier [0086] 1210 and the coring amount control circuit 1180 and the multiplier 1190 which are used in the third embodiment are further provided.
  • The coring [0087] amount control circuit 1180 generates the coring amount controls signal 1181 in accordance with the mixing control signal 1082 as mentioned in the third embodiment. The multiplier 1210 controls the coring amount control signal 1181 in accordance with the gain control signal 1141 indicating the exposure ratio between the long exposure interval and the short exposure interval. The second coring amount control signal 1211 is controlled, that is, weighted, by the multiplier 1210 in accordance with the coring amount control signal 1181 derived from the mixing control signal 1082 and the gain control signal 1141 derived from the exposure ratio. Noise components in the edge enhancement signal from the multiplier 1170 is suppressed by the coring circuit 1112.
  • Then, the edges at the short exposure region which tends to be flat because of the short exposure will be enhanced further and the noise component coring at the short exposure region which tends to be flat because of the short exposure can be enhanced further by providing the edge [0088] enhancement control circuit 1160. Moreover, the noise components in the edge enhanced video signal at the short exposure region 17 which is conspicuous in the reproduced image is suppressed, so that the noise in the output video signal is improved.
  • In this embodiment, the [0089] gain adjusting circuit 1150 is omitted. However, it is also possible that the gain adjusting circuit 1150 are further provided in the imaging apparatus of the fifth embodiment as similar to the first embodiment. Moreover, it is also possible as modifications of this embodiment that either of the edge enhancement amount control circuit 1160 and the multipliers 1170 and 1200 or the coring amount control circuit 1180 and the multipliers 1190 and 1210 are omitted.
  • (Sixth Embodiment) [0090]
  • FIG. 14 is a block diagram of an imaging apparatus of a sixth embodiment. [0091]
  • The imaging apparatus of the sixth embodiment has substantially the same structure as that of the first embodiment. The difference is that a [0092] prism unit 1000 for separating the incident image into color images, that is, a red image, a green image, and a blue image is further provided and the imagers 1010 respectively receives the red image, the green image, and a blue image, and the processing circuits, each including the pre-processing circuit 1030, the a/d converter 1040, the synchronizing circuit 1050, the gain adjusting circuit 1110, the combining circuit 1080, are provided for the red, green, and blue images respectively, and camera processing circuit 1090 for processing the respective color video signal is further provided. For color separation, dichroic mirror units may be used instead the prism unit 1000.
  • The [0093] imager 1010 of each color receives an optical image from the prism 1000 and generates a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, the second exposure interval being shorter than the first exposure interval, the first and second video signals respectively having first and second effective detection ranges 11 and 12. The synchronizing circuit 1050 for each color synchronizes the first video signal with the second video signal. The exposure interval ratio detection circuit 1100 responsive to the driving circuit 1020 detects an exposure ratio between the first and second exposure intervals. The gain adjusting circuit 1110 for each color adjusts the gain of the second video signal from the synchronizing circuit 1050 in accordance with the exposure ratio. The mixing control signal generation 1083 for each color generates a mixing control signal indicative of a mixing ratio of the first and second video signals. The combining circuit 1080 for each color generates a combined video signal from the first and second video signals in accordance with the mixing control signal and levels of the first and second video signals to have an expanded detection range such that the first effective detection range is connected to the second effective detection range as described in the first embodiment.
  • The [0094] camera processing circuit 1090 processes the combined video signals 1081 of red, green, and blue color to generates output red signal, an output green signal, and an output blue signal.
  • In this embodiment, the second to fifth embodiments are applicable to the imaging apparatus of the sixth embodiment. [0095]
  • (Seventh Embodiment) [0096]
  • FIG. 15 is a block diagram of an imaging apparatus of a seventh embodiment. [0097]
  • The imaging apparatus of the seventh embodiment has substantially the same structure as that of the sixth embodiment. The difference is that a [0098] max detection circuit 1130, non-linear processing circuits 1120, and a display dynamic range setting circuit 1140 are further provided.
  • The display [0099] dynamic setting circuit 1140 generates or receive and supplies data 1141 of display dynamic range (DISPMAX). The max detection circuit 1130 detects the maximum level among the third red, third green, and third blue video signals for one frame period. The non-linear processing circuits 1120 responsive to display dynamic range data (DISPMAX) 1141 generates and outputs red, green, and blue display signals having non-linear characteristics such that the maximum level is made equal to or less than the display dynamic range data when the detected maximum level is larger than the display dynamic range data and outputs the combined red, green, and blue video signal as they are when the detected maximum level is not larger than the display dynamic range data.
  • If the dynamic range of a display apparatus receiving the output red, blue, and green signals from this imaging apparatus is smaller than than the dynamic range of the output red, blue, and green signals, it is necessary to compress the dynamic range of the output the output red, blue, and green signals. [0100]
  • The [0101] non-linear processing circuit 1120 compress the dynamic range of the combined video signal to obtain a display video signal in accordance with the detected maximum (highest high light) level among the third red, third green and third blue video signals for one frame period, saturation data, and the display dynamic range setting data (DISPMAX) 1141 by internally dividing operation.
  • FIGS. 16 and 17 are graphical drawings of the seventh embodiment of this invention illustrating the dynamic range compression operation. [0102]
  • It is assumed that the display dynamic range (DISPMAX) 1141 is 20. and the maximum value (RGBMAX) is [0103] 25. The characteristic (gradation characteristic) curve of the combined video signals 1081 are bent above the saturation level (SAT). In fact, the level of the range-compressed video signal is provided by the internally dividing the level of the combined video signal using the maximum (RGBMAX), the saturation level (SAT), and the display dynamic range setting data (DISPMAX) 1141.
  • The [0104] maximum detection circuit 1130 detects a maximum level among the combined video signals 1081 of red, green, and blue for one frame and supplies the maximum level (RGBMAX) 1131 to the non-liner processing circuits 1120. The non-linear processing circuit 1120 generates the range-compressed video data in accordance with the detected maximum value, the saturation data, and the display range (DISPMAX) 1141.
  • As shown in FIG. 16, level A of the combined video signal is shifted to A″ and level S is shifted to S″(=RGBMAX=DISPMAX) to prevent saturation. However, if level A is smaller than the saturation level (SAT), the non-linear processing is not executed, that is, A=A″. [0105]
  • More specifically, if level A is more than the saturation level (SAT), assuming that n is a control efficient n for controlling the non-linear characteristic curve, the level A″ after non-linear processing is given as follows: [0106]
  • When RGBMAX−DISPMAX≧0 AND A≧SAT, [0107]
  • αA=(A−SAT)/(RGBMAX−SAT)
  • A″=A−{(αA)n×(RGBMAX−DISPMAX)}.
  • When RGBMAX−DISPMAX≧0 AND A<SAT, [0108]
  • αA=0
  • A″=A
  • When RGBMAX−DISPMAX<0, [0109]
  • αA=0
  • A″=A
  • FIG. 17 shows the curves for providing the non-liner characteristic when the control coefficient n is varied from one to three. [0110]
  • FIG. 18 is a block diagram of the [0111] non-linear processing circuit 1120 of the seventh embodiment.
  • The [0112] non-liner processing circuit 1120 includes a judging circuit 20, subtractors 21 to 24, multipliers 25 and 26, a divider 27, switches 28 and 29 and generates a non-linear video signal 1121 in response to the combined video signal 1081, the maximum value 1131, the saturation data 1082, and a display maximum value 1141. The control efficient n for the non-liner characteristic is determined by the number of the multipliers 25 and connections around the multipliers 25.
  • The display dynamic range (DISPMAX) [0113] 1141 may be generated by a ROM or a RAM storing the display dynamic range (DISPMAX) 1141, manually set, or sent from the display apparatus to be connected. Moreover, the saturation value SAT can be decreased as desired by an operator.
  • FIGS. 19A to [0114] 19C are graphical drawings of the seventh embodiment illustrating the non-linear processing.
  • It is assumed that the display dynamic range (DISPMAX) [0115] 1141=20, the maximum level among the red, green, and blue video signals (RGBMAX)=25, and the situation level (SAT) of the long exposure video signal=3 and that the red, green, and blue video signals respectively show levels R:G:B=20:5:25. The level of the red video signal is shifted from 20 to 17 by the non-linear processing, the level of the green video signal remains about 5 because the original level “5” is near the cut point “3” which is the saturation level, and the level of the blue video signal is shifted from 25 to 20 by the non-linear processing. Then, that is, the output levels of the non-linear circuits 1120 are R:G:B=17:5:20, so that saturation in the display apparatus to be connected to this imaging apparatus is prevented and the ratio of levels of the red, green, and blue video signals, that is, a tone of color, is substantially maintained.
  • The second to fifth embodiments are applicable to the imaging apparatus of the seventh embodiment. [0116]

Claims (21)

What is claimed is:
1. An imaging apparatus comprising:
imaging means including driving means for receiving an optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, said second exposure interval being shorter than said first exposure interval, said first and second video signals respectively having first and second effective detection ranges which are different but continuous;
synchronizing means for synchronizing said first video signal with said second video signal every corresponding frames of said first and second video signals;
exposure interval ratio detection means responsive to said driving means for detecting an exposure ratio between said first and second exposure intervals;
gain adjusting means responsive to said first and second video signals from said synchronizing means for adjusting a difference between gains of said first and second video signals from said synchronizing means in accordance with said exposure ratio from said exposure interval ratio detection means;
mixing control signal generation means for generating a mixing control signal indicative of a mixing ratio of said first and second video signals in accordance with said first and second video signals from said gain adjusting means; and
combining means for generating and outputting a combined video signal from said first and second video signals from said gain adjusting means in accordance with said mixing control signal and levels of said first and second video signals to have an expanded detection range such that said first effective detection range is connected to said second effective detection range.
2. A method of generating a combined video signal from an optical image comprising the steps of:
receiving said optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, said second exposure interval being shorter than said first exposure interval, said first and second video signals respectively having first and second effective detection ranges which are different but continuous;
synchronizing said first video signal with said second video signal every corresponding frames of said first and second video signals;
detecting an exposure ratio between said first and second exposure intervals;
adjusting a difference of gains of the synchronized first and second video signals in accordance with said exposure ratio;
generating a mixing control signal indicative of a mixing ratio of said first and second video signals in accordance with said gain-adjusted first and second video signals; and
generating and outputting said combined video signal from the gain-adjusted first and second video signals in accordance with said mixing control signal and levels of the gain-adjusted first and second video signals to have an expanded dynamic range such that said first effective detection range is connected to said second effective detection range.
3. An imaging apparatus comprising:
imaging means including driving means for receiving an optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, said second exposure interval being shorter than said first exposure interval, said first and second video signals respectively having first and second effective detection ranges which are different but continuous;
synchronizing means for synchronizing said first video signal with said second video signal every corresponding frames of said first and second video signals;
mixing control signal generation means for generating a mixing control signal indicative of a mixing ratio of said first and second video signals in accordance with said first and second video signals;
video signal generation means for generating a combined video signal from said first and second video signals from said synchronizing means in accordance with said mixing control signal and levels of said first and second video signals to have an expanded dynamic range such that said first effective detection range is connected to said second effective detection range;
edge enhancement signal generation means for generating an edge enhancement signal from said combined video signal;
edge enhancement amount control means for controlling an mount of said edge enhancement signal in accordance with said mixing control signal; and
adding means for adding said edge enhancement signal from said gain adjusting means and said combined video signal and outputting an edge-enhanced video signal.
4. A method of generating a combined video signal from an optical image comprising the steps of:
receiving said optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, said second exposure interval being shorter than said first exposure interval, said first and second video signals respectively having first and second effective detection ranges which are different but continuous;
synchronizing said first video signal with said second video signal every corresponding frames of said first and second video signals;
generating a mixing control signal indicative of a mixing ratio of said first and second video signals in accordance with the synchronized first and second video signals;
generating said combined video signal from the synchronized first and second video signal in accordance with said mixing control signal and levels of said first and second video signals to have an expanded detection range such that said first effective detection range is connected to said second effective detection range;
generating an edge enhancement signal from said combined video signal;
controlling an amount of said edge enhancement signal in accordance with said mixing control signal; and
adding the amount-controlled edge enhancement signal and said combined video signal and outputting an edge-enhanced video signal.
5. The imaging apparatus as claimed in claim 3, further comprising:
generation means generating a coring amount control signal in accordance with said mixing control signal; and
coring means for effecting a coring operation to the edge enhancement signal in accordance with said coring amount control signal.
6. The method as claimed in claim 4, further comprising the steps of:
generating a coring amount control signal in accordance with said mixing control signal; and
effecting a coring operation to said edge enhancement signal in accordance with said coring amount control signal.
7. An imaging apparatus comprising:
imaging means including driving means for receiving an optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, said second exposure interval being shorter than said first exposure interval, said first and second video signals respectively having first and second effective detection ranges which are different but continuous;
synchronizing means for synchronizing said first video signal with said second video signal every corresponding frames of said first and second video signals;
exposure ratio detection means responsive to said imaging means for detecting an exposure ratio between said first and second exposure intervals;
mixing control signal generation means for generating a mixing control signal indicative of a mixing ratio of said first and second video signals in accordance with said first and second video signals;
combining means for generating a combined video signal from said first and second video signals from said synchronizing means in accordance with said mixing control signal and levels of said first and second video signals to have an expanded dynamic range such that said first effective detection range is connected to said second effective detection range;
edge enhancement signal generation means for generating an edge enhancement signal from said combined video signal;
edge enhancement amount control means for controlling an amount of said edge enhancement signal in accordance with said mixing control signal and said exposure interval ratio; and
adding means for adding said edge enhancement signal from said gain adjusting means and said combined video signal and outputting an edge-enhanced video signal.
8. A method of generating a combined video signal from an optical image comprising the steps of:
receiving said optical image and generating a first video signal with a first exposure interval and a second video signal with a second exposure interval substantially at the same time, said second exposure interval being shorter than said first exposure interval, said first and second video signals respectively having first and second effective detection ranges which are different but continuous;
synchronizing said first video signal with said second video signal;
detecting an exposure ratio between said first and second exposure intervals;
adjusting a gain of said second video signal synchronized in accordance with said exposure ratio every corresponding frames of said first and second video signals;
generating a mixing control signal indicative of a mixing ratio of the synchronized first and second video signals in accordance with the gain-adjusted first and second video signals;
generating said combined video signal from the synchronized first and second video signals in accordance with said mixing control signal and levels of said first and second video signals to have an expanded detection range such that said first effective detection range is connected to said second effective detection range;
generating an edge enhancement signal from said combined video signal;
controlling an amount of said edge enhancement signal in accordance with said mixing control signal and said exposure ratio; and
adding the gain-adjusted enhancement signal from said gain adjusting means and said combined video signal and outputting an edge-enhanced video signal.
9. The imaging apparatus as claimed in claim 7, further comprising:
coring amount control signal generation means for generating a coring amount control signal in accordance with said mixing control signal and said exposure ratio; and
coring means for effecting a coring operation to the edge enhanced signal in accordance with said coring amount control signal from said coring amount control signal generation means.
10. The method as claimed in claim 8, further comprising the steps of:
generating a coring amount control signal in accordance with said mixing control signal and said exposure ratio; and
effecting a coring operation to the edge enhancement signal in accordance with said coring amount control signal.
11. An imaging apparatus comprising:
imaging means including driving means for receiving separated red, green, and blue optical images and generating first red, first green, and first blue video signals with a first exposure interval and second red, second green, and second blue video signals with a second exposure interval substantially at the same time, said second exposure interval being shorter than said first exposure interval, said first red, green, and blue video signals respectively having first red, first green, and first blue effective detection ranges and said second red, green, and blue video signals respectively having second red, second green, and second blue effective detection ranges which are different from said first red, first green, and first blue effective detection ranges respectively but continuous;
synchronizing means for synchronizing said first red, first green, and first blue video signals with second red, second green, and second blue video signals every corresponding frames of said first red, first green, and first blue video signals and said second red, second green, and second blue video signals;
exposure interval ratio detection means responsive to said driving means for detecting an exposure ratio between said first and second exposure intervals;
gain adjusting means for respectively adjusting difference between gains of said first red, first green, and first blue video signals and second red, first, and video signals from said synchronizing means in accordance with said exposure ratio from said exposure interval ratio detection means;
mixing control signal generation means for generating red, green, and blue mixing control signals respectively indicating mixing ratios between said first red, first green, and first blue video signals and second red, second green, and second blue video signals in accordance with said first red, first green, and first blue video signals and second red, second green, and second blue video signals; and
combining means for generating and outputting combined red, green, and blue video signals from said first red, first green, and first blue video signals and second red, second green, and second blue video signals from said gain adjusting means in accordance with said red, green, and blue mixing control signals and levels of said first red, first green, and first blue video signals and second red, second green, and second blue video signals to have expanded red, green, and blue detection ranges such that said first red, first green, and first blue effective detection ranges are connected to said second red, second green, and second blue video signals, respectively.
12. The-imaging apparatus as claimed in claim 11, further comprising:
maximum detection means for detecting a maximum level among said combined red, combined green, and combined blue video signals for one frame period; and
non-linear processing means responsive to display dynamic range data for generating and outputting red, green, and blue display signals having non-linear characteristics such that said maximum level is made equal to or less than said display dynamic range data when the detected maximum level is larger than said display dynamic range data and outputting said combined red, green, and blue video signal as they are when the detected maximum level is not larger than said display dynamic range data.
13. A method of generating a combined video signal from an optical image comprising the steps of:
receiving separated red, green, and blue optical images;
generating first red, first green, and first blue video signals with a first exposure interval and second red, second green, and second blue video signals with a second exposure interval substantially at the same time, said second exposure interval being shorter than said first exposure interval, said first video signals respectively having first red, first green, and first blue effective detection ranges, said second video signals respectively having second red, second green, and second blue effective detection ranges which are respectively different from first red, first green, and first blue effective detection ranges but continuous;
synchronizing said first red, first green, and first blue video signals with second red, second green, and second blue video signals every corresponding frames of said first red, first green, and first blue video signals and said second red, second green, and second blue video signals;
detecting an exposure ratio between said first and second exposure intervals;
adjusting difference between gains of said first red, first green, and first blue video signals and second red, first, and video signals from said synchronizing means in accordance with said exposure ratio;
generating red, green, and blue mixing control signals respectively indicating mixing ratios between said first red, first green, and first blue video signals and second red, second green, and second blue video signals in accordance with said first red, first green, and first blue video signals and second red, second green, and second blue video signals; and
generating and outputting combined red, green, and blue video signals from said first red, first green, and first blue video signals and second red, second green, and second blue video signals from said gain adjusting means in accordance with said mixing control signals and levels of said first red, first green, and first blue video signals and second red, second green, and second blue video signals to have expanded red, green, and blue detection ranges such that said first red, first green, and first blue effective detection ranges are connected to said second red, second green, and second blue video signals, respectively.
14. The method as claimed in claim 13, further comprising the steps of:
detecting a maximum level among said combined red, third green, and third blue video signals for one frame period; and
generating and outputting red, green, and blue display signals having non-linear characteristic in accordance with display dynamic data and said maximum level such that said maximum level is made equal to or less than said display dynamic range data when the detected maximum level is larger than said display dynamic range data and outputting said combined red, green, and blue video signal as they are when the detected maximum level is not larger than said display dynamic range data.
15. A video camera comprising:
a lens unit;
separation means for separating an optical image beam into separated red, green, and blue optical images;
imaging means including driving means for receiving separated red, green, and blue optical images and generating first red, first green, and first blue video signals with a first exposure interval and second red, second green, and second blue video signals with a second exposure interval substantially at the same time, said second exposure interval being shorter than said first exposure interval, said first video signals respectively having first red, first green, and first blue effective detection ranges, said first and second video signals respectively having second red, second green, and second blue effective detection ranges which are different from said first red, first green, and first blue effective detection ranges but continuous;
synchronizing means for synchronizing said first red, first green, and first blue video signals with second red, second green, and second blue video signals every corresponding frames of said first red, first green, and first blue video signals and said second red, second green, and second blue video signals;
exposure interval ratio detection means responsive to said driving means for detecting an exposure ratio between said first and second exposure intervals;
gain adjusting means for adjusting difference between gains of said first red, first green, and first blue video signals and second red, first, and video signals from said synchronizing means in accordance with said exposure ratio from said exposure interval ratio detection means;
mixing control signal generation means for generating red, green, and blue mixing control signals respectively indicating mixing ratios between said first red, first green, and first blue video signals and second red, second green, and second blue video signals in accordance with said first red, first green, and first blue video signals and second red, second green, and second blue video signals; and
combining means for generating and outputting combined red, green, and blue video signals from said first red, first green, and first blue video signals and second red, second green, and second blue video signals from said gain adjusting means in accordance with said mixing control signals and levels of said first red, first green, and first blue video signals and second red, second green, and second blue video signals to have expanded red, green, and blue detection ranges such that said first red, first green, and first blue effective detection ranges are connected to said second red, second green, and second blue video signals, respectively.
16. The camera as claimed in claim 15, further comprising:
maximum detection means for detecting a maximum level among said combined red, third green, and third blue video signals for one frame period; and
non-linear processing means responsive to display dynamic range data for generating and outputting red, green, and blue display signals having non-linear characteristic such that said maximum level is made equal to or less than said display dynamic range data when the detected maximum level is larger than said display dynamic range data and outputting said combined red, green, and blue video signal as they are when the detected maximum level is not larger than said display dynamic range data.
17. The imaging apparatus as claimed in claim 1, wherein said gain adjusting means adjusts said difference between gains of said first and second video signals from said synchronizing means to provide a linearity in the expanded detection range.
18. The imaging apparatus as claimed in claim 1, further comprising:
edge enhancement signal generation means for generating an edge enhancement signal from said combined video signal;
edge enhancement amount control means for controlling an amount of said edge enhancement signal in accordance with said mixing control signal; and
adding means for adding said edge enhancement signal from said gain adjusting means and said combined video signal and outputting an edge-enhanced video signal.
19. The imaging apparatus as claimed in claim 18, wherein said edge enhancement amount control means controls said amount of said edge enhancement signal in accordance with said exposure ratio in addition to said mixing control signal.
20. The imaging apparatus as claimed in claim 1, further comprising:
edge enhancement signal generation means for generating an edge enhancement signal from said combined video signal;
coring amount control signal generation means for generating a coring amount control signal in accordance with said mixing control signal;
coring means for effecting a coring operation to the edge enhanced signal in accordance with said coring amount control signal from said coring amount control signal generation means; and
adding means for adding said edge enhancement signal from said edge enhancement signal generation means and said combined video signal and outputting an edge-enhanced video signal.
21. The imaging apparatus as claimed in claim 20, wherein said coring amount control signal generation means generates said coring amount control signal in accordance with said exposure ratio in addition to said mixing control signal.
US10/444,964 1997-11-21 2003-05-27 Imaging apparatus with dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal Abandoned US20030197805A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US10/444,964 US20030197805A1 (en) 1997-11-21 2003-05-27 Imaging apparatus with dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
JPJP9-336652 1997-11-21
JP9336653A JPH11155108A (en) 1997-11-21 1997-11-21 Video signal processor and processing method and video camera using the same
JPJP9-336653 1997-11-21
JP9336652A JPH11155098A (en) 1997-11-21 1997-11-21 Device and method for processing signal
US09/187,048 US6593970B1 (en) 1997-11-21 1998-11-06 Imaging apparatus with dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal
US10/444,964 US20030197805A1 (en) 1997-11-21 2003-05-27 Imaging apparatus with dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/187,048 Division US6593970B1 (en) 1997-11-21 1998-11-06 Imaging apparatus with dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal

Publications (1)

Publication Number Publication Date
US20030197805A1 true US20030197805A1 (en) 2003-10-23

Family

ID=26575536

Family Applications (3)

Application Number Title Priority Date Filing Date
US09/187,048 Expired - Fee Related US6593970B1 (en) 1997-11-21 1998-11-06 Imaging apparatus with dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal
US10/444,961 Abandoned US20030206241A1 (en) 1997-11-21 2003-05-27 Imaging apparatus with dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal
US10/444,964 Abandoned US20030197805A1 (en) 1997-11-21 2003-05-27 Imaging apparatus with dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US09/187,048 Expired - Fee Related US6593970B1 (en) 1997-11-21 1998-11-06 Imaging apparatus with dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal
US10/444,961 Abandoned US20030206241A1 (en) 1997-11-21 2003-05-27 Imaging apparatus with dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal

Country Status (7)

Country Link
US (3) US6593970B1 (en)
EP (1) EP0920196B1 (en)
CN (1) CN1128540C (en)
AU (1) AU715716B2 (en)
CA (1) CA2252183C (en)
DE (1) DE69808024T2 (en)
NZ (1) NZ332626A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120113303A1 (en) * 2006-06-16 2012-05-10 Samsung Electronics Co., Ltd Apparatus and method to generate image
US20140198226A1 (en) * 2013-01-17 2014-07-17 Samsung Techwin Co., Ltd. Apparatus and method for processing image

Families Citing this family (56)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4245699B2 (en) * 1998-09-16 2009-03-25 オリンパス株式会社 Imaging device
US7193652B2 (en) * 1999-08-17 2007-03-20 Applied Vision Systems, Inc. Dynamic range video recording and playback system and method
CN1276646C (en) * 1999-11-22 2006-09-20 松下电器产业株式会社 Solid-state imaging device
FR2809568B1 (en) * 2000-05-26 2002-11-29 Thomson Csf DEVICE AND METHOD FOR ANALYSIS OF ONE OR MORE SIGNALS WITH A LARGE DYNAMIC
US6943831B2 (en) * 2001-01-24 2005-09-13 Eastman Kodak Company Method and apparatus to extend the effective dynamic range of an image sensing device and use residual images
CN100440926C (en) * 2001-02-27 2008-12-03 张汉臣 Photographic scene toleration technology and image conversion method
JP3948229B2 (en) * 2001-08-01 2007-07-25 ソニー株式会社 Image capturing apparatus and method
US7177430B2 (en) * 2001-10-31 2007-02-13 Portalplayer, Inc. Digital entroping for digital audio reproductions
US6859230B2 (en) * 2001-11-07 2005-02-22 Omnivision Technologies, Inc. Method of fast automatic exposure or gain control in a MOS image sensor
JP4154157B2 (en) * 2002-02-25 2008-09-24 株式会社東芝 Imaging device
US7667760B2 (en) * 2002-05-02 2010-02-23 Honda Giken Kogyp Kabushiki Kaisha Image sensor output correction device
US7508421B2 (en) * 2002-06-24 2009-03-24 Fujifilm Corporation Image pickup apparatus and image processing method
JP2004048561A (en) * 2002-07-15 2004-02-12 Fuji Photo Film Co Ltd Imaging unit and photometric instrument
US6909459B2 (en) * 2002-08-21 2005-06-21 Alpha Innotech Corporation Method of and apparatus for extending signal ranges of digital images
JP3801126B2 (en) * 2002-09-25 2006-07-26 ソニー株式会社 Imaging apparatus, image output method of imaging apparatus, and computer program
US6894264B2 (en) 2002-10-15 2005-05-17 Applera Corporation System and methods for dynamic range extension using variable length integration time sampling
JP3964315B2 (en) * 2002-12-03 2007-08-22 株式会社リコー Digital camera
US6879731B2 (en) * 2003-04-29 2005-04-12 Microsoft Corporation System and process for generating high dynamic range video
DE60333258D1 (en) * 2003-05-06 2010-08-19 St Microelectronics Res & Dev Combined linear and logarithmic image sensor
US7142723B2 (en) * 2003-07-18 2006-11-28 Microsoft Corporation System and process for generating high dynamic range images from multiple exposures of a moving scene
JP4318553B2 (en) * 2004-01-23 2009-08-26 三洋電機株式会社 Image signal processing device
US8218625B2 (en) * 2004-04-23 2012-07-10 Dolby Laboratories Licensing Corporation Encoding, decoding and representing high dynamic range images
US7714928B2 (en) * 2004-05-28 2010-05-11 Konica Minolta Holdings, Inc. Image sensing apparatus and an image sensing method comprising a logarithmic characteristic area and a linear characteristic area
US7602438B2 (en) * 2004-10-19 2009-10-13 Eastman Kodak Company Method and apparatus for capturing high quality long exposure images with a digital camera
US7626614B1 (en) * 2005-02-15 2009-12-01 Apple Inc. Transfer function and high dynamic range images
US7612804B1 (en) 2005-02-15 2009-11-03 Apple Inc. Methods and apparatuses for image processing
JP4855704B2 (en) 2005-03-31 2012-01-18 株式会社東芝 Solid-state imaging device
JP2007300463A (en) * 2006-05-01 2007-11-15 Opt Kk Camera system and image processing method
US8013919B2 (en) * 2006-06-27 2011-09-06 Samsung Electronics Co., Ltd. CMOS image sensor with increased dynamic range based on multiple exposure periods of varying lengths
CN100415158C (en) * 2006-09-08 2008-09-03 浙江大学 Method and system for expanding dynamic range in tomography of optical coherent
DE102006046720A1 (en) 2006-10-02 2008-04-03 Arnold & Richter Cine Technik Gmbh & Co. Betriebs Kg Digital motion-picture camera for taking motion pictures, has opto-electronic sensor device, which has multiple sensor elements for producing of received signals as function of exposure time
US8242426B2 (en) * 2006-12-12 2012-08-14 Dolby Laboratories Licensing Corporation Electronic camera having multiple sensors for capturing high dynamic range images and related methods
JP4919160B2 (en) * 2007-02-02 2012-04-18 カシオ計算機株式会社 Imaging apparatus and program thereof
JP2009111518A (en) * 2007-10-26 2009-05-21 Casio Comput Co Ltd Imaging apparatus, image reproducing unit and program thereof, and data structure of image file
JP5076240B2 (en) * 2008-02-05 2012-11-21 富士フイルム株式会社 Imaging apparatus, imaging method, and program
JP5006814B2 (en) * 2008-02-26 2012-08-22 キヤノン株式会社 Imaging device
JP5181294B2 (en) * 2008-03-31 2013-04-10 富士フイルム株式会社 Imaging system, imaging method, and program
US20100091119A1 (en) * 2008-10-10 2010-04-15 Lee Kang-Eui Method and apparatus for creating high dynamic range image
EP2180692A1 (en) * 2008-10-22 2010-04-28 STWireless SA Method of and a device for producing a digital picture
DE102008044322A1 (en) 2008-12-03 2010-06-10 Robert Bosch Gmbh Control device for a camera arrangement, camera arrangement for a vehicle and method for controlling a camera of a vehicle
US8774559B2 (en) * 2009-01-19 2014-07-08 Sharp Laboratories Of America, Inc. Stereoscopic dynamic range image sequence
US8345975B2 (en) * 2009-06-29 2013-01-01 Thomson Licensing Automatic exposure estimation for HDR images based on image statistics
CN102473290A (en) * 2009-06-29 2012-05-23 汤姆逊许可证公司 Contrast enhancement
US9087382B2 (en) 2009-06-29 2015-07-21 Thomson Licensing Zone-based tone mapping
US8346009B2 (en) * 2009-06-29 2013-01-01 Thomson Licensing Automatic exposure estimation for HDR images based on image statistics
JP4806476B2 (en) * 2010-01-07 2011-11-02 パナソニック株式会社 Image processing apparatus, image generation system, method, and program
JP5953305B2 (en) 2010-08-23 2016-07-20 レッド.コム,インコーポレイテッド High dynamic range video
DE102012217093A1 (en) 2012-09-21 2014-04-17 Robert Bosch Gmbh Camera system, in particular for a vehicle, and method for determining image information of a detection area
US9955084B1 (en) 2013-05-23 2018-04-24 Oliver Markus Haynold HDR video camera
CN104243834B (en) * 2013-06-08 2017-10-13 杭州海康威视数字技术股份有限公司 The image flow-dividing control method and its device of high definition camera
DE102014201181A1 (en) 2014-01-23 2015-07-23 Robert Bosch Gmbh Camera system, in particular for a vehicle, and method for determining image information of a time-pulsed signal source
US10277771B1 (en) 2014-08-21 2019-04-30 Oliver Markus Haynold Floating-point camera
US10225485B1 (en) 2014-10-12 2019-03-05 Oliver Markus Haynold Method and apparatus for accelerated tonemapping
CN105744156A (en) * 2016-01-29 2016-07-06 深圳市美好幸福生活安全系统有限公司 System and method for improving object identification in image
CN106034209B (en) * 2016-04-08 2019-02-22 奇瑞汽车股份有限公司 Obtain the method and device of video
CN112929576B (en) * 2021-02-01 2023-08-01 北京字节跳动网络技术有限公司 Image processing method, device, equipment and storage medium

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5436656A (en) * 1992-09-14 1995-07-25 Fuji Photo Film Co., Ltd. Digital electronic still-video camera and method of controlling same
US5517242A (en) * 1993-06-29 1996-05-14 Kabushiki Kaisha Toyota Chuo Kenkyusho Image sensing device having expanded dynamic range
US5801773A (en) * 1993-10-29 1998-09-01 Canon Kabushiki Kaisha Image data processing apparatus for processing combined image signals in order to extend dynamic range
US5877810A (en) * 1992-12-22 1999-03-02 Fuji Photo Film, Co., Ltd. Video camera, printer apparatus and method of controlling same, and apparatus and method for detecting print inhibit signal
US6078357A (en) * 1996-08-05 2000-06-20 Matsushita Electric Industrial Co., Ltd. Image mixing circuit
US6111980A (en) * 1997-03-18 2000-08-29 Matsushita Electric Industrial Co., Ltd. Method for correcting luminance gradation in an image pickup apparatus
US6160581A (en) * 1993-12-28 2000-12-12 Canon Kabushiki Kaisha Camera having adaptive object image display facility
US6184940B1 (en) * 1997-03-14 2001-02-06 Matsushita Electric Industrial Co., Ltd. Imaging apparatus with dual white balance adjusting systems for different color temperatures
US6204881B1 (en) * 1993-10-10 2001-03-20 Canon Kabushiki Kaisha Image data processing apparatus which can combine a plurality of images at different exposures into an image with a wider dynamic range
US6219097B1 (en) * 1996-05-08 2001-04-17 Olympus Optical Co., Ltd. Image pickup with expanded dynamic range where the first exposure is adjustable and second exposure is predetermined
US6587149B1 (en) * 1997-10-17 2003-07-01 Matsushita Electric Industrial Co., Ltd. Video camera with progressive scanning and dynamic range enlarging modes
US6670993B1 (en) * 1998-01-16 2003-12-30 Matsushita Electric Industrial Co., Ltd. Image pickup device and method for controlling a dynamic range of an image sensor
US6831695B1 (en) * 1999-08-10 2004-12-14 Fuji Photo Film Co., Ltd. Image pickup apparatus for outputting an image signal representative of an optical image and image pickup control method therefor

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63209373A (en) 1987-02-26 1988-08-30 Olympus Optical Co Ltd Video signal processing circuit
JP3074967B2 (en) 1992-10-27 2000-08-07 松下電器産業株式会社 High dynamic range imaging / synthesis method and high dynamic range imaging apparatus
JPH07131718A (en) 1993-10-29 1995-05-19 Canon Inc Picture synthesizer
US5818975A (en) * 1996-10-28 1998-10-06 Eastman Kodak Company Method and apparatus for area selective exposure adjustment

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5436656A (en) * 1992-09-14 1995-07-25 Fuji Photo Film Co., Ltd. Digital electronic still-video camera and method of controlling same
US5877810A (en) * 1992-12-22 1999-03-02 Fuji Photo Film, Co., Ltd. Video camera, printer apparatus and method of controlling same, and apparatus and method for detecting print inhibit signal
US5517242A (en) * 1993-06-29 1996-05-14 Kabushiki Kaisha Toyota Chuo Kenkyusho Image sensing device having expanded dynamic range
US6204881B1 (en) * 1993-10-10 2001-03-20 Canon Kabushiki Kaisha Image data processing apparatus which can combine a plurality of images at different exposures into an image with a wider dynamic range
US5801773A (en) * 1993-10-29 1998-09-01 Canon Kabushiki Kaisha Image data processing apparatus for processing combined image signals in order to extend dynamic range
US6160581A (en) * 1993-12-28 2000-12-12 Canon Kabushiki Kaisha Camera having adaptive object image display facility
US6219097B1 (en) * 1996-05-08 2001-04-17 Olympus Optical Co., Ltd. Image pickup with expanded dynamic range where the first exposure is adjustable and second exposure is predetermined
US6078357A (en) * 1996-08-05 2000-06-20 Matsushita Electric Industrial Co., Ltd. Image mixing circuit
US6184940B1 (en) * 1997-03-14 2001-02-06 Matsushita Electric Industrial Co., Ltd. Imaging apparatus with dual white balance adjusting systems for different color temperatures
US6111980A (en) * 1997-03-18 2000-08-29 Matsushita Electric Industrial Co., Ltd. Method for correcting luminance gradation in an image pickup apparatus
US6587149B1 (en) * 1997-10-17 2003-07-01 Matsushita Electric Industrial Co., Ltd. Video camera with progressive scanning and dynamic range enlarging modes
US6670993B1 (en) * 1998-01-16 2003-12-30 Matsushita Electric Industrial Co., Ltd. Image pickup device and method for controlling a dynamic range of an image sensor
US6831695B1 (en) * 1999-08-10 2004-12-14 Fuji Photo Film Co., Ltd. Image pickup apparatus for outputting an image signal representative of an optical image and image pickup control method therefor

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120113303A1 (en) * 2006-06-16 2012-05-10 Samsung Electronics Co., Ltd Apparatus and method to generate image
US8515206B2 (en) * 2006-06-16 2013-08-20 Samsung Electronics Co., Ltd. Apparatus and method to generate image
US20140198226A1 (en) * 2013-01-17 2014-07-17 Samsung Techwin Co., Ltd. Apparatus and method for processing image
US9124811B2 (en) * 2013-01-17 2015-09-01 Samsung Techwin Co., Ltd. Apparatus and method for processing image by wide dynamic range process

Also Published As

Publication number Publication date
DE69808024D1 (en) 2002-10-24
EP0920196B1 (en) 2002-09-18
US6593970B1 (en) 2003-07-15
NZ332626A (en) 2000-04-28
CA2252183C (en) 2001-06-19
CA2252183A1 (en) 1999-05-21
AU9407098A (en) 1999-06-10
EP0920196A3 (en) 2001-03-14
CN1224973A (en) 1999-08-04
AU715716B2 (en) 2000-02-10
EP0920196A2 (en) 1999-06-02
US20030206241A1 (en) 2003-11-06
DE69808024T2 (en) 2003-06-18
CN1128540C (en) 2003-11-19

Similar Documents

Publication Publication Date Title
US6593970B1 (en) Imaging apparatus with dynamic range expanded, a video camera including the same, and a method of generating a dynamic range expanded video signal
US6747694B1 (en) Television signal processor for generating video signal of wide dynamic range, television camera using the same, and method for television signal processing
KR100871025B1 (en) Contour-emphasizing circuit
EP0823814B1 (en) Image mixing circuit
JP2001197362A (en) Solid-state image pickup device
US6922209B1 (en) Imaging apparatus and image signal processing method producing wide dynamic range
JPH10257516A (en) Image pickup device
US5767900A (en) Digital apparatus for contour enhancement of video signal
EP0391690B1 (en) Image pickup device capable of picking up images while electronically enlarging the same
EP0743787A2 (en) An image pickup apparatus for obtaining a color image over a wider luminance range
US5144399A (en) Color image pickup apparatus
JP2003204450A (en) Imaging apparatus and video signal processing method
JP3748031B2 (en) Video signal processing apparatus and video signal processing method
JPH11155108A (en) Video signal processor and processing method and video camera using the same
JP2000354250A (en) Image pickup device
JPH11155098A (en) Device and method for processing signal
JPS63276374A (en) Video camera
JP3897445B2 (en) Imaging apparatus and image signal processing method
JP2935389B2 (en) Video signal processing device and nonlinear signal processing device
JP3841584B2 (en) Imaging device
JP2004222160A (en) Digital camera
MXPA98009805A (en) Image formation device with expanded dynamic scale, a video camera that includes them, and a method to generate a dynamic scale video signal expand
JP2001045502A (en) Camera
JP2002354496A (en) Image pickup device and signal processing method therefor
JP2001204042A (en) Signal processing method and its device

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION