EP3220637B1 - Vehicle-mounted camera system - Google Patents
Vehicle-mounted camera system Download PDFInfo
- Publication number
- EP3220637B1 EP3220637B1 EP15859559.5A EP15859559A EP3220637B1 EP 3220637 B1 EP3220637 B1 EP 3220637B1 EP 15859559 A EP15859559 A EP 15859559A EP 3220637 B1 EP3220637 B1 EP 3220637B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- white balance
- correction processing
- balance correction
- exposure time
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 claims description 174
- 238000005286 illumination Methods 0.000 claims description 51
- 238000003384 imaging method Methods 0.000 description 12
- 238000000034 method Methods 0.000 description 9
- DGAQECJNVWCQMB-PUAWFVPOSA-M Ilexoside XXIX Chemical compound C[C@@H]1CC[C@@]2(CC[C@@]3(C(=CC[C@H]4[C@]3(CC[C@@H]5[C@@]4(CC[C@@H](C5(C)C)OS(=O)(=O)[O-])C)C)[C@@H]2[C@]1(C)O)C)C(=O)O[C@H]6[C@@H]([C@H]([C@@H]([C@H](O6)CO)O)O)O.[Na+] DGAQECJNVWCQMB-PUAWFVPOSA-M 0.000 description 5
- 229910052708 sodium Inorganic materials 0.000 description 5
- 239000011734 sodium Substances 0.000 description 5
- 238000005034 decoration Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
- H04N23/88—Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B7/00—Control of exposure by setting shutters, diaphragms or filters, separately or conjointly
- G03B7/08—Control effected solely on the basis of the response, to the intensity of the light received by the camera, of a built-in light-sensitive device
- G03B7/091—Digital circuits
- G03B7/093—Digital circuits for control of exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/71—Circuitry for evaluating the brightness variation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/58—Control of the dynamic range involving two or more exposures
- H04N25/581—Control of the dynamic range involving two or more exposures acquired simultaneously
- H04N25/583—Control of the dynamic range involving two or more exposures acquired simultaneously with different integration times
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/01—Circuitry for demodulating colour component signals modulated spatially by colour striped filters by phase separation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/73—Colour balance circuits, e.g. white balance circuits or colour temperature control
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
Definitions
- This invention relates to a vehicle-mounted camera system.
- a technique of obtaining a wide dynamic range image (high dynamic range image) by controlling an exposure time by frame or pixel has been known.
- long exposure time shooting having a relatively long exposure time and short exposure time shooting having a relatively short exposure time are performed, and a long exposure time image obtained by the long exposure time shooting and a short exposure time image obtained by the short exposure time shooting are composed to generate a high dynamic range image.
- a technique of executing an appropriate white balance correction processing to the long exposure time image and the short exposure time image before the long exposure time image and the short exposure time image are composed has been also proposed.
- an imaging device includes a camera sensor and a processor, the processor configured to capture a lighter image and a darker image of a scene. The processor is then configured to white balance the lighter image based on the lighter regions of the image, and to white balance the darker image based on the darker regions of the image. The two images can then be combined to produce a final image.
- JP 2013 192057 A aims for suppressing unevenness in brightness and color among images when performing image processing of the images obtained by plural times of consecutive imaging.
- JP 2013 192057 A proposes that, in a case where consecutive imaging has been performed by an imaging mode of imaging as one set plural sheets of image obtained as a result of imaging with exposure changed, a similarity determination unit obtains a similarity of a predetermined image in one set as a current image to a past image imaged before the current image, in accordance with a predetermined similarity determination reference. If the similarity is not smaller than a predetermined threshold, a control unit determines the correction amount of the current image using a correction amount relating to imaging processing used for the past image.
- a vehicle-mounted camera system that is provided in a vehicle and shoots a circumference of the vehicle has been widespread. It is important for the vehicle-mounted camera system to obtain a high dynamic range image.
- the vehicle-mounted camera system obtains the long exposure time image and the short exposure time image.
- the usage environment of the vehicle-mounted camera system has a feature in which a variously changing illumination environments in shooting of an image changes.
- the illumination environment includes an outside in the daytime with sunlight as a light source, an outside in the nighttime without sunlight, and a location illuminated by a single light source without receiving sunlight.
- the outside in the daytime is strongly affected by sunlight.
- the outside in the nighttime has no sunlight, but has a light-emitting light source such as a signal lamp, a street lamp, and a decoration lamp in addition to reflection light illuminated by a headlight.
- the location illuminated by the single light source includes an inside of a tunnel illuminated by a sodium lamp and an indoor parking illuminated by a fluorescent lamp.
- a technique of giving effective information to a driver or a vehicle based on an image obtained by a vehicle-mounted camera system includes, based on an image shot by the vehicle-mounted camera system, a function of detecting a white line separating a traffic lane, a sign, another vehicle, and a pedestrian, a function as a drive recorder that records an image, and a head-up display function of projecting an image onto a windshield.
- a white balance correction processing to a shot image.
- the present invention has been made in view of the above circumstances, and an object of the present invention is to provide a vehicle-mounted camera system that executes, to the obtained two or more types of exposure images, an appropriate white balance correction processing according to an illumination environment even in variously changing illumination environments.
- the present invention provides a vehicle-mounted camera system including a vehicle-mounted camera that is provided in a vehicle, and shoots in at least two different exposure times, a signal processing device that is configured to execute a white balance correction processing to two or more types of exposure images shot in the at least two different exposure times and generate a high dynamic range image based on the two or more types of the exposure images to which the white balance correction processing is executed, and a processing switch device that is configured to obtain an illumination environment in which the vehicle is placed and switch the white balance correction processing for the two or more types of the exposure images by the signal processing device according to the obtained illumination environment.
- the signal processing device includes, as the white balance correction processing, A-a white balance correction processing for a relatively short exposure time image of the two or more types of the exposure images and a white balance correction processing for a relatively long exposure time image of the two or more types of the exposure images being set to an automatic white balance correction processing; B-the white balance correction processing for the relatively short exposure time image of the two or more types of the exposure images being set to a fixed white balance correction processing having a previously set parameter, and the white balance correction processing for the relatively long exposure time image of the two or more types of the exposure images being set to the automatic white balance correction processing; and C-the white balance correction processing for the relatively short exposure time image of the two or more types of the exposure images and the white balance correction processing for the relatively long exposure time images of the two or more types of the exposure images being set to the fixed white balance correction processing having the predetermined set parameter.
- the processing switch device is configured to specify any one of first illumination environment of an outside in a daytime, second illumination environment of an outside in a nighttime, and third illumination environment of a single light source, and switch the white balance correction processing to the white balance correction processing A when first illumination environment is specified, the white balance correction processing to the white balance correction processing when second illumination environment is specified, and the white balance correction processing to the white balance correction processing C when third illumination environment is specified.
- an appropriate white balance correction processing according to an illumination environment can be executed to the obtained two or more types of exposure images even in variously changing illumination environments.
- Fig. 1 is a block diagram illustrating a configuration of a vehicle-mounted camera system 100 according to one embodiment of the present invention.
- a solid line in Fig. 1 shows flow of an image signal (picture signal) and a dashed line shows flow of a control signal.
- the vehicle-mounted camera system 100 illustrated in the figure is provided in a not-shown vehicle and includes a vehicle-mounted camera 10, a signal processing part 20 (one example of a signal processing device), a system control part 40 (one example of a processing switch device), and an output interface (I/F) part 30.
- a signal processing part 20 one example of a signal processing device
- system control part 40 one example of a processing switch device
- I/F output interface
- the vehicle-mounted camera 10 uses a range including a road surface in front of a vehicle as a subject.
- the vehicle-mounted camera 10 includes a color imaging element 12 and a lens 11 that forms an image of a subject onto the imaging element 12.
- the imaging element 12 is controlled by the after-described system control part 40 to execute short exposure time shooting having a relatively short exposure time and long exposure time shooting having a relatively long exposure time.
- the imaging element 12 therefore alternatively outputs a short exposure time image by the short exposure time shooting and a long exposure time image by the long exposure time shooting.
- the exposure time of the short exposure time shooting is, for example, 1/3000 (second) and the exposure time of the long exposure time shooting is, for example, 1/30 (second).
- the exposure times are not limited to these times.
- the signal processing part 20 executes various signal processings to the long exposure time image and the short exposure time image output from the imaging element 12.
- the signal processing part 20 includes a white balance processing part 25.
- the white balance processing part 25 executes a white balance correction processing to the long exposure time image and the short exposure time image based on a parameter.
- the parameter of the white balance correction processing is set by the after-described white balance (WB) control part 45 of the system control part 40.
- the white balance processing part 25 therefore executes the white balance correction processing based on the parameter set by the white balance control part 45.
- the signal processing part 20 generates a high dynamic range image having a dynamic range wider than that of the short exposure time image and the long exposure time image based on the short exposure time image to which the white balance correction processing is executed and the long exposure time image to which the white balance correction processing is executed.
- Various methods may be applied to the processing of generating a high dynamic range image.
- the system control part 40 receives positional information on a position in which a vehicle is placed and time information on a present time from a position/time information obtaining part 210 in a navigation system 200 provided in the vehicle.
- the navigation system 200 is an external configuration of the vehicle-mounted camera system 100.
- the navigation system 200 includes a map information storing part 220 that stores map information.
- the system control part 40 also receives the map information output from the map information storing part 220.
- the system control part 40 specifies the location of the vehicle based on the received positional information and map information.
- the system control part 40 obtains an illumination environment at the location in which the vehicle is placed based on the location information on the specified location and the received time information.
- the location specified by the system control part 40 includes an outside (for example, a load and a parking lot except a tunnel) and a tunnel.
- the system control part 40 determines (specifies) a day-night classification at the present time in that location based on the positional information and the time information.
- the day-night classification is made as a database corresponding to the location and the time.
- the system control part 40 includes such a database.
- an environment with the sun namely, a daytime is classified as a day and an environment without the sun, namely, a nighttime except a daytime is classified as a night.
- the system control part 40 obtains any one of (1) an illumination environment of an outside in the daytime, (2) an illumination environment of an outside in the nighttime, and (3) an illumination environment of a single light source based on the above-described location information and time information, namely, the day-night classification.
- the illumination environment of the outside in the daytime is an illumination environment in the outside classified as the day, which is an illumination environment with sunlight as a light source
- the illumination environment of the outside in the nighttime is an illumination environment in the outside classified as the night, which is an illumination environment without sunlight and with a light source such as a light-emitting light source, for example, a signal lamp, a street lamp, and a decoration lamp and reflection light of a subject mainly illuminated by a headlight
- the illumination environment of the single light source is an illumination environment in the tunnel illuminated by a single light source (mostly having a single wavelength) such as a sodium lamp regardless of a day and night.
- the system control part 40 includes a white balance control part 45 that switches a white balance correction processing for the long exposure time image and the short exposure time image by setting a parameter for the white balance correction processing executed by the white balance processing part 25 according to the obtained illumination environment.
- the parameter for the white balance correction processing is obtained by known various methods.
- the white balance control part 45 sets a parameter corresponding to any one of the following (A), (B), and (C) white balance correction processings.
- the white balance control part 45 switches the white balance correction processing to the above (A) white balance correction processing (an individual AWB setting 47 to each of the long exposure time image and the short exposure time image).
- the white balance control part 45 switches the white balance correction processing to the above (B) white balance correction processing (the individual AWB setting 47 to the long exposure time image and the fixed WB setting 46 to the short exposure time image).
- the white balance control part 45 switches the white balance correction processing to the above (C) white balance correction processing (the fixed WB setting 46 to each of the long exposure time image and the short exposure time image).
- the system control part 40 outputs, to the signal processing part 20, the parameter corresponding to the set white balance correction processing.
- the white balance processing part 25 of the signal processing part 20 executes the white balance correction processing based on the parameter input from the system control part 40 to each of the long time exposure image and the short time exposure image.
- the output interface part 30 outputs a high dynamic range image output from the signal processing part 20 to an external device, for example, a device having a function of detecting a white line separating a traffic lane, a sign, another vehicle, and a pedestrian based on the image shot by the vehicle-mounted camera system 100, to a drive recorder that records an image, and to a head-up display that projects an image onto a windshield.
- an external device for example, a device having a function of detecting a white line separating a traffic lane, a sign, another vehicle, and a pedestrian based on the image shot by the vehicle-mounted camera system 100, to a drive recorder that records an image, and to a head-up display that projects an image onto a windshield.
- Fig. 2 is a flowchart showing the function (processing) of the system control part 40 of the vehicle-mounted camera system 100 according to the embodiment illustrated in Fig. 1 .
- the processing of the vehicle-mounted camera system 100 will be hereinafter described.
- the vehicle-mounted camera 10 alternatively and continuously performs the above-described short exposure time shooting and long exposure time shooting under the control of the system control part 40.
- the vehicle-mounted camera 10 outputs the short exposure time image and long exposure time image to the signal processing part 20.
- the system control part 40 obtains the map information as well as the positional information and time information of the vehicle corresponding to the timing shot by the vehicle-mounted camera 10 from the navigation system 200.
- the signal processing part 20 calculates a ratio of a red (R) component signal, a green (G) component signal, and a blue (B) component signal from the image signal of each exposure image (short exposure time image and long exposure time image), and outputs the obtained ratio of RGB to the system control part 40.
- the ratio of RGB is used to set the parameter of the white balance correction processing.
- the system control part 40 specifies the location information as well as the day-night classification based on the map information as well as the positional information and time information obtained corresponding to a timing in which the short exposure time image and the long exposure time image to which the ratio of RGB is input are shot by the vehicle-mounted camera 10. As illustrated in Fig. 2 , the system control part 40 determines whether or not the location is inside a tunnel based on the specified location information (S1). When the location is inside the tunnel (Yes in S1), the system control part 40 outputs, relative to each of the short exposure time image and the long exposure time image, the parameter corresponding to the white balance correction processing (fixed WB setting 46 in Fig. 1 ) to the signal processing part 20 (S2). The white balance processing part 25 of the signal processing part 20 thereby executes the white balance correction processing corresponding to the fixed WB setting 46 to each of the short exposure time image and the long exposure time image.
- the inside of the tunnel has the illumination environment illuminated by a single light source such as a sodium lamp that emits light of a single wavelength. Even when the white balance correction processing is executed by any parameter, the RGB component cannot be corrected to 1:1:1.
- the short exposure time image and the long exposure time image obtained in the tunnel are images shot under the illumination environment (for example, 5000 kelvin at a color temperature) with the sunlight as the light source.
- the parameter for the white balance correction processing to be generally executed to the image shot in the illumination environment with the sunlight as the light source is experimentally obtained in advance, and the fixed WB setting 46 of the system control part 40 stores such a parameter.
- an appropriate white balance correction processing is executed to the image obtained in the tunnel.
- the white line separating the traffic lane for example, is output to an external device through the output interface part 30 as an orange line by the illumination of the sodium lamp.
- a processing of converting the image into a gray scale image by eliminating a color phase by an external device is executed.
- the short exposure time image and the long exposure time image to which the above-described white balance correction processing is executed are composed by the signal processing part 20 to be a high dynamic range image.
- the high dynamic range image is output to an external device through the output interface part 30.
- the system control part 40 determines the day-night classification (S3).
- the system control part 40 outputs, to the signal processing part 20, the parameter corresponding to (A3) the white balance correction processing (individual AWB setting 47 in Fig. 1 ), relative to each of the short exposure time image and the long exposure time image (S4).
- the white balance processing part 25 of the signal processing part 20 executes the white balance correction processing corresponding to the individual AWB setting 47 to each of the short exposure time image and long exposure time image.
- the short exposure time image and the long exposure time image obtained in the outside in the daytime are images obtained under the illumination environment with the sunlight as the light source. Even under the illumination environment with the sunlight as the light source, the illumination environment under the sun differs from the illumination environment in the shadow in a color temperature.
- the automatic white balance correction processing corresponding to the illumination environment under the sun is executed to the short exposure time image and the automatic white balance correction processing corresponding to the illumination environment in the shadow is executed to the long exposure time image, a preferable white balance of the high dynamic range image after the composition of the these images is obtained.
- the system control part 40 of the present embodiment outputs the parameter corresponding to the individual AWB setting 47 to the signal processing part 20 (S4), and the white balance processing part 25 executes the white balance correction processing corresponding to the individual AWB setting 47 to each of the short exposure time image and the long exposure time image, so that the high dynamic range image in a color close to a color seen by naked eyes of a driver can be obtained.
- the short exposure time image and the long exposure time image to which the above-described white balance correction processing is executed are composed by the signal processing part 20 to be the high dynamic range image.
- the high dynamic range image is output to an external device through the output interface part 30.
- the system control part 40 In the determination of S3, when the day-night classification is not the daytime (No in S3), the system control part 40 outputs the parameter corresponding to (B) the white balance correction processing (the fixed WB setting 46 to the short exposure time image and the individual AWB setting 47 to the long exposure time image in Fig. 1 ) to the signal processing part 20 (S5).
- the white balance processing part 25 of the signal processing part 20 thereby executes the white balance correction processing corresponding to the fixed WB setting 46 to the short exposure time image and the white balance correction processing corresponding to the individual AWB setting 47 to the long exposure time image.
- the short exposure time image obtained in the outside in the nighttime is an image on which a light-emitting light source such as a signal lamp, a street lamp, and a decoration lamp is projected.
- a light-emitting light source such as a signal lamp, a street lamp, and a decoration lamp
- the system control part 40 executes the white balance correction processing of the fixed WB setting 46 to the short exposure time image, so that the light emitting color of such a signal lamp is prevented from being converted into a color different from appearance.
- the long exposure time image obtained in the outside in the nighttime is an image representing the reflection light of the subject such as a white line mainly illuminated by a headlight.
- the detected white line may be used for a function of maintaining the vehicle in a current traffic lane, for example, by the above-described external device.
- the system control part 40 in this embodiment improves the detection accuracy of the white line, for example, by executing the automatic white balance correction processing for the long exposure time image.
- the short exposure time image and the long exposure time image to which the above white balance correction processing is executed are composed by the signal processing part 20 to be the high dynamic range image.
- the high dynamic range image is output to an external device through the output interface part 30.
- an appropriate white balance correction processing selected from a plurality of white balance correction processings according to the situation of the illumination environment is executed to the long exposure time image and the short exposure time image obtained in variously changing illumination environments.
- the vehicle-mounted camera system 100 of this embodiment shows the example of the illumination environment in the tunnel illuminated by the single light source (mainly single wavelength) such as a sodium lamp as (3) the illumination environment of the single light source.
- the illumination environment of the single light source may include an indoor parking (including underground parking) regardless of the daytime and the nighttime.
- the vehicle-mounted camera system 100 of the present embodiment generates the high dynamic range image based on the two types of exposure images such as the long exposure time image and the short exposure time image.
- the high dynamic range image is an image having an improved gradation in a low illuminance range based on the long exposure time image and an improved gradation in a high illuminance range based on the short exposure time image.
- the vehicle-mounted camera system may generate the high dynamic range image based on three or more types of the exposure images each having a different exposure time.
- the high dynamic range image is an image having an improved gradation in a low illuminance range based on the long exposure time image, an improved gradation in a high illuminance range based on the short exposure time image, and an improved gradation in an intermediate illuminance range based on an intermediate exposure time image (the image exposed by an exposure time shorter than that of the long exposure time image and an exposure time longer than that of the short exposure time image).
- the white balance correction processing is executed to each of the exposure images as follows. Namely, the white balance correction processing similar to that of the long exposure time image in the present embodiment is executed to two or more types of relatively long exposure time images including a specific exposure time image in the three or more types of the exposure images, and the white balance correction processing similar to that of the short exposure time image in the present embodiment is executed to one or more types of relatively short exposure time image without including the specific exposure time image in the three or more types of exposure images.
- the white balance correction processing similar to that of the long exposure time image in the present embodiment is executed to one or more types of relatively long exposure time image without including a specific exposure time image in the three or more types of exposure images and the white balance correction processing similar to that of the short exposure time image in the present embodiment is executed to two or more types of relatively short exposure time images including a specific exposure time image in the three or more types of exposure images.
- a correction process different from that of the long exposure time image and that of the short exposure time image in the present embodiment may be executed to the specific exposure time image in the three or more types of exposure images.
- the above-described white balance correction processings (A), (B), and (C) corresponding to the parameter set by the white balance control part 45 are executed as follows as an example.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Color Television Image Signal Generators (AREA)
- Studio Devices (AREA)
- Processing Of Color Television Signals (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Closed-Circuit Television Systems (AREA)
- Exposure Control For Cameras (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2014230608A JP6533050B2 (ja) | 2014-11-13 | 2014-11-13 | 車載カメラシステム |
PCT/JP2015/076861 WO2016076016A1 (ja) | 2014-11-13 | 2015-09-24 | 車載カメラシステム |
Publications (3)
Publication Number | Publication Date |
---|---|
EP3220637A1 EP3220637A1 (en) | 2017-09-20 |
EP3220637A4 EP3220637A4 (en) | 2018-05-23 |
EP3220637B1 true EP3220637B1 (en) | 2020-09-02 |
Family
ID=55954109
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15859559.5A Active EP3220637B1 (en) | 2014-11-13 | 2015-09-24 | Vehicle-mounted camera system |
Country Status (4)
Country | Link |
---|---|
US (1) | US10356376B2 (ja) |
EP (1) | EP3220637B1 (ja) |
JP (1) | JP6533050B2 (ja) |
WO (1) | WO2016076016A1 (ja) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6860000B2 (ja) * | 2016-03-03 | 2021-04-14 | ソニー株式会社 | 医療用画像処理装置、システム、方法、プログラム、画像処理システム及び医療用画像処理システム |
AU2017308749A1 (en) * | 2016-08-09 | 2019-02-21 | Contrast, Inc. | Real-time HDR video for vehicle control |
JP6740866B2 (ja) | 2016-11-07 | 2020-08-19 | 株式会社デンソー | 画像出力装置 |
DE112019000967T5 (de) | 2018-03-29 | 2020-11-12 | Robert Bosch Gmbh | Verfahren und system für auf fahrzeug-vorinformationen basierende, sichtbasierte fahrzeuginnenraumumgebungsabfühlung |
EP3585047B1 (de) * | 2018-06-20 | 2021-03-24 | ZKW Group GmbH | Verfahren und vorrichtung zur erstellung von hochkontrastbildern |
TWI751717B (zh) | 2020-09-22 | 2022-01-01 | 環鴻科技股份有限公司 | 提升影像辨識率的前處理方法及系統 |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5872433A (en) * | 1986-05-21 | 1999-02-16 | Canon Kabushiki Kaisha | Image pickup apparatus including interruption means for causing recordation of an electrical image signal in response to operation of a second trigger before completion of a predetermined step by a first trigger |
US5170069A (en) * | 1986-05-21 | 1992-12-08 | Canon Kabushiki Kaisha | Image pickup apparatus |
US6952233B2 (en) * | 1992-07-23 | 2005-10-04 | Canon Kabushiki Kaisha | Video camera having a material element for controlling light transmission |
JPH06205249A (ja) * | 1992-10-22 | 1994-07-22 | Konica Corp | ビデオカメラ |
JP2000050238A (ja) * | 1998-07-27 | 2000-02-18 | Matsushita Electric Ind Co Ltd | 監視カメラ装置 |
JP2003174619A (ja) * | 2001-12-07 | 2003-06-20 | Konica Corp | 電子機器 |
JP2003189315A (ja) | 2001-12-18 | 2003-07-04 | Hitachi Ltd | 撮像装置 |
US7599550B1 (en) * | 2003-11-21 | 2009-10-06 | Arecont Vision Llc | Method for accurate real-time compensation for changing illumination spectra in digital video cameras |
JP4424088B2 (ja) * | 2004-06-25 | 2010-03-03 | 株式会社日立製作所 | 撮像装置 |
US7881496B2 (en) * | 2004-09-30 | 2011-02-01 | Donnelly Corporation | Vision system for vehicle |
FR2899696B1 (fr) * | 2006-04-06 | 2008-06-20 | Dxo Labs Sa | Procede de traitement d'un phenomene d'eclairement relatif sur une image numerique et systeme de traitement associe |
JP5181294B2 (ja) * | 2008-03-31 | 2013-04-10 | 富士フイルム株式会社 | 撮像システム、撮像方法、およびプログラム |
JP2010035120A (ja) * | 2008-07-29 | 2010-02-12 | Advas Co Ltd | ビデオカメラ撮像装置 |
JP5375457B2 (ja) * | 2008-09-03 | 2013-12-25 | 株式会社リコー | 撮像装置及び撮像方法 |
JP5366584B2 (ja) * | 2009-02-16 | 2013-12-11 | キヤノン株式会社 | 撮像装置、画像処理方法およびプログラム |
JP5680896B2 (ja) * | 2010-07-30 | 2015-03-04 | 矢崎エナジーシステム株式会社 | ドライブレコーダ |
JP5699482B2 (ja) * | 2010-08-24 | 2015-04-08 | セイコーエプソン株式会社 | 画像処理装置、画像処理方法及び撮像装置 |
US9085261B2 (en) * | 2011-01-26 | 2015-07-21 | Magna Electronics Inc. | Rear vision system with trailer angle detection |
US8947555B2 (en) * | 2011-04-18 | 2015-02-03 | Qualcomm Incorporated | White balance optimization with high dynamic range images |
JP5911340B2 (ja) * | 2012-03-14 | 2016-04-27 | キヤノン株式会社 | 撮像装置およびその制御方法 |
US9654738B1 (en) * | 2013-08-07 | 2017-05-16 | Waymo Llc | Using multiple exposures to improve image processing for autonomous vehicles |
-
2014
- 2014-11-13 JP JP2014230608A patent/JP6533050B2/ja active Active
-
2015
- 2015-09-24 US US15/525,406 patent/US10356376B2/en active Active
- 2015-09-24 EP EP15859559.5A patent/EP3220637B1/en active Active
- 2015-09-24 WO PCT/JP2015/076861 patent/WO2016076016A1/ja active Application Filing
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
WO2016076016A1 (ja) | 2016-05-19 |
EP3220637A4 (en) | 2018-05-23 |
JP2016096417A (ja) | 2016-05-26 |
US20170339385A1 (en) | 2017-11-23 |
US10356376B2 (en) | 2019-07-16 |
JP6533050B2 (ja) | 2019-06-19 |
EP3220637A1 (en) | 2017-09-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3220637B1 (en) | Vehicle-mounted camera system | |
US9639764B2 (en) | Image recognition system for vehicle for traffic sign board recognition | |
JP6026670B2 (ja) | 車両灯体制御装置 | |
US9171215B2 (en) | Image processing device | |
US9319647B2 (en) | Image processing device | |
WO2015098325A1 (ja) | 車載画像認識装置 | |
JP2015066956A (ja) | 車両制御システム、画像センサ | |
US10531057B2 (en) | Vehicle-mounted display device | |
JP4191759B2 (ja) | 車両用オートライトシステム | |
JP2012226513A (ja) | 検知装置、及び検知方法 | |
JPWO2019194256A1 (ja) | 演算処理装置、オブジェクト識別システム、学習方法、自動車、車両用灯具 | |
CN112384400B (zh) | 车载显示控制装置以及计算机可读记录介质 | |
US9214034B2 (en) | System, device and method for displaying a harmonized combined image | |
JP5712821B2 (ja) | 撮影表示制御システム | |
JP6259335B2 (ja) | 車外環境認識装置 | |
TW202133601A (zh) | 低亮度成像系統 | |
KR102155374B1 (ko) | 자동차용 야간 화상들을 형성하는 시스템 및 방법 | |
JP6478138B2 (ja) | 画像処理装置、撮像装置、画像処理プログラム、画像処理方法 | |
CN112565618B (zh) | 曝光控制装置 | |
JP2013009041A (ja) | 車両用撮影表示制御システム | |
JP6866212B2 (ja) | 表示制御装置、表示制御方法及びカメラモニタリングシステム | |
WO2019194233A1 (ja) | 車載システム及び表示装置 | |
KR20230048429A (ko) | 해질녘 및 야간의 야생 동물 횡단으로 인한 사고를 방지하기 위한 시스템 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20170606 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
A4 | Supplementary search report drawn up and despatched |
Effective date: 20180423 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G03B 15/00 20060101ALI20180416BHEP Ipc: G03B 7/093 20060101ALI20180416BHEP Ipc: H04N 5/355 20110101ALI20180416BHEP Ipc: H04N 9/73 20060101ALI20180416BHEP Ipc: H04N 9/04 20060101AFI20180416BHEP Ipc: H04N 5/235 20060101ALI20180416BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20200422 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1310179 Country of ref document: AT Kind code of ref document: T Effective date: 20200915 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602015058584 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201202 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201203 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20200902 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1310179 Country of ref document: AT Kind code of ref document: T Effective date: 20200902 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210104 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210102 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602015058584 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20200930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200924 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20210603 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200930 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200930 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200930 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200924 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200902 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602015058584 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: H04N0009040000 Ipc: H04N0023100000 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200923 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230823 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230822 Year of fee payment: 9 Ref country code: DE Payment date: 20230822 Year of fee payment: 9 |