JP4641601B2 - Image processing apparatus and image processing system - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image processing apparatus, particularly an image processing apparatus mounted on a vehicle and suitable for monitoring a road condition around the vehicle with a video camera. And image processing system About.
[0002]
[Prior art]
The image processing apparatus as described above detects that the vehicle distance from the vehicle traveling ahead is not sufficient and emits an alarm sound to the driver, or comes off the lane mark and the vehicle starts to travel. Similarly, it can be used to make an alarm sound to the driver.
[0003]
The image processing apparatus can be used not only when the vehicle moves forward but also when the vehicle moves backward to confirm the rear.
[0004]
[Problems to be solved by the invention]
As described above, the image processing apparatus performs a function of capturing road conditions such as other vehicles around the vehicle and lane marks as images and recognizing the road conditions. That is, image recognition.
The performance of this image recognition is determined by the performance of the image processing apparatus itself. However, in actual operation, it greatly depends on the shooting situation in which the image processing apparatus is placed. Depending on the shooting conditions (sunshine conditions, weather, etc.), you may encounter when it is difficult to perform the above image recognition.
[0005]
For example, when a vehicle running in front of the vehicle is illuminated at night, the image around the brake light is blurred and the image recognition performance of the image processing device provided in the vehicle is reduced. There is one problem.
FIG. 20 is a diagram illustrating an example of an image showing a first problem of the conventional technique.
As shown in the figure, the above-mentioned “blurring” appears in an image around, for example, the three brake lamps 2, 3, and 4 of the vehicle 1 that runs ahead during night driving.
[0006]
In addition, there is a second problem that there is a restriction on the memory capacity and processing time of the image memory built in the image processing apparatus.
Therefore, in view of the above problems, the present invention can solve the above-described problem of degradation of image recognition performance and the above-described problem of limitations imposed on the memory capacity and processing time at the same time. And image processing system Is intended to provide.
[0007]
[Means for Solving the Problems]
FIG. 1 is a diagram showing a basic configuration of an image processing apparatus according to the present invention.
In this figure, reference numeral 10 denotes an image processing apparatus, which includes an optical system 11 having an image sensor 14 and an arithmetic processing unit 12 that performs image processing with an imaging signal S from the optical system 11 as an input. Become. Only the portion of the image sensor 14 is shown in an enlarged perspective view A. This enlarged perspective view is a view from the lens 13 side.
[0008]
Here, the imaging element 14 is formed by arranging the pixels in the row direction and the pixels in the column direction as a whole in a matrix. However, since this configuration is well known, it is not shown in detail.
The imaging surface 14 ′ of the imaging device 14 is divided into a plurality of regions in units of rows or columns, and the plurality of regions include a first region I and a second filter provided with a first filter F1 on the imaging surface. The second region II includes F2 on the imaging surface 14 ′ and the third region III does not include a filter on the imaging surface 14 ′.
[0009]
Thus, the imaging signal S from the optical system 11 to which the filtering process has been added is input to the arithmetic processing unit 12, and processing such as recognition of the vehicle ahead is performed, for example.
FIG. 2 is a graph showing the spectral sensitivity characteristics of the image sensor 14.
In this figure, the wavelength [nm] is plotted on the horizontal axis and the luminance is plotted on the vertical axis, and the above spectral sensitivity characteristics are shown. However, the example which employ | adopted the CMOS sensor as the image pick-up element (sensor IC) 14 is shown.
[0010]
In the graph of this figure, the part to be particularly noted is the wavelength band B. This band B is a band that causes “blurring” generated around the brake lamp (2, 3, 4) of the vehicle 1 shown in FIG.
Since such blur is in the infrared region (B), it cannot be seen by human eyes. On the other hand, for the CMOS sensor, such a wavelength band is also a detection range. Therefore, a sensor signal based on this wavelength band appears as the blur in the imaging signal S.
[0011]
Therefore, the premise of the present invention is to remove the blur by cutting the wavelength band B with a filter. However, the band B cut by such a filter is known per se. The feature of the present invention lies in the way of forming the filter, specifically, as shown in an enlarged perspective view A in FIG. Note that FIG. A shows one aspect based on the present invention, and all of the regions of the filter F1 (I), the filter F2 (II), and the no filter (III) are on the imaging surface 14 ′. However, the present invention is not limited to this, and it may be configured such that only any two regions of the filter F1 (I), the filter F2 (II), and the no filter (III) exist.
[0012]
Hereinafter, the description of FIG. 2 is continued. In this description, an example using only the first filter F1 and the second filter F2 is used.
FIG. 3 is a plan view showing the filter group 15 formed on the imaging surface 14 ′.
In the example of this figure, an image sensor 14 in which 512 pixels and 480 pixels are arranged in a matrix in 512 columns and 480 rows, respectively, is used. The first filter (F1) and the second filter (F2) are alternately arranged by dividing into even rows. For this reason, the width of each filter is as small as several tens of μm.
[0013]
The image pickup signal S of FIG. 1 is obtained using such a filter group, and predetermined processing is performed by the arithmetic processing unit 12 of FIG.
FIG. 4 is a flowchart showing an example of processing by the arithmetic processing unit 12.
Step S11: The average of the luminance values for 512 pixels × 120 (480/4) pixels in FIG. 3 is calculated. In this case, pixel information for each row is thinned out to ¼ as an example. This row-by-row pixel information is temporarily stored in a memory in the arithmetic processing unit 12 (see a memory 24 in FIG. 5 described later), and an average luminance value is calculated by the CPU 25 in FIG.
[0014]
Step S12: Based on the average luminance value calculated in step S11, the CPU is used to determine the environment (day or night) in which the vehicle is placed.
Step S13: If it is determined by the above judgment that it is daytime, only the odd-numbered rows on which the first filter F1 is placed are scanned by the interlace method. At this time, the first filter F1 obtains the imaging signal S for the entire wavelength band including the wavelength band B of FIG. As a result, daytime image recognition performance can be sufficiently ensured as before.
[0015]
Step S14: On the other hand, if it is determined by the above judgment that it is night, this time, only the even-numbered rows on which the second filter F2 is placed are scanned under the interlace method. As the second filter F2 at this time, an imaging signal S for all the wavelength bands (blue, green, and red) excluding the wavelength band B of FIG. 2 is obtained. As a result, the blur caused by the band B at night is eliminated, and the image recognition performance at night is greatly improved as compared with the past.
[0016]
As described above, it is possible to select optimum filter characteristics for day and night, and the first problem described above is solved.
In this case, since only the imaging surfaces belonging to one of the first and second filters F1 and F2 are used, the amount of image information is almost halved compared to the amount of image information originally obtained. However, according to the actual results, the decrease in the image recognition capability was not a problem in practical use. Such a decrease in capacity is well offset by the effect of complete elimination of blur. Thus, when the vehicle ahead is recognized at night, for example, the outline of the vehicle can be captured very clearly.
[0017]
Further, as described above, since the amount of image information to be used is almost halved, the memory capacity of the memory 24 is almost half that of the prior art. Accordingly, the image processing by the CPU 25 (the determination of the brightness around the vehicle) Processing, processing to extract the contour of the vehicle image, processing to calculate the inter-vehicle distance from the vehicle ahead, processing to generate the alarm sound as described above, etc. Is done. As a result, the second problem described above is also solved.
[0018]
DETAILED DESCRIPTION OF THE INVENTION
FIG. 5 is a diagram showing a specific example of the apparatus configuration of FIG. Throughout the drawings, similar components are denoted by the same reference numerals or symbols.
As shown in FIG. 1, the image processing apparatus 10 includes an optical system 11 and an arithmetic processing unit 12.
[0019]
The optical system 11 is a so-called video camera, and includes a lens 13, an image sensor 14, a filter group 15, and the like. This video camera is mounted, for example, at a rearview mirror in the vehicle and / or near the center of the rear window of the vehicle.
The analog image pickup signal S from the video camera (11) is input to the arithmetic processing unit 12, and is first amplified by the amplifier 21, and further, the digital image pickup signal S by the ADC (Analog / Digital Converter) 22 is obtained. Convert to Further, the memory I / F control circuit 23 controls writing of data (imaging signal) to the memory 24 and reading to the CPU 25 under the instruction of the CPU 25. The circuit 23 also performs other controls.
[0020]
FIG. 6 is a plan view showing a first embodiment according to the present invention,
FIG. 7 is a graph used for explaining the first embodiment. 6 is the same as FIG. 3, and the view of FIG. 7 is the same as FIG.
In the first embodiment, the plurality of regions described above are composed of a first region I and a third region III. In addition, the first filter F1 provided in the first region I is an infrared cut filter.
[0021]
As a result, the portion C of the sensor signal that causes blurring (equivalent to the blurring described above) in FIG. 7 is removed by the infrared cut filter (F1).
More specifically, in order to cope with nighttime when the stop lamp of the vehicle ahead is blurred, the characteristics of the odd-numbered and even-numbered filters are changed. That is, the odd-numbered rows are without a filter, and the even-numbered rows are infrared cut filters (F1). As the processing at this time, the arithmetic processing unit 12 determines whether it is day or night, and based on the result, the processing range of the interlaced video camera signal is set as follows.
[0022]
・ In the daytime, select the odd field without filter,
-At night, select an even field with an infrared cut filter (F1).
FIG. 8 is a plan view showing a second embodiment according to the present invention.
FIG. 9 is a graph used for explaining the second embodiment. 8 is the same as FIG. 3 and FIG. 9 is the same as FIG.
[0023]
In the second embodiment, the plurality of regions described above are composed of a first region I, a second region II, and a third region III. The first filter F1 provided in the first region I is an infrared cut filter, and the second filter F2 provided in the second region II is also an infrared cut filter, and the first filter F1 and the second filter F2 are provided. The spectral sensitivity characteristics are different from each other.
[0024]
As a result, the portion C (same as C in FIG. 7) that causes the blur in FIG. 9 is removed by the infrared cut filter (F1) or the infrared cut filter (F2).
More specifically, in the nighttime when the stop lamp of the vehicle ahead is blurred, the characteristics of the filter are changed every three rows. That is, if n is an integer and n = 0, 1,.
3n + 1 line: No filter
3n + 2 line: Infrared cut filter 1 (F1)
3n + 3 line: Infrared cut filter 2 (F2)
And As the processing at this time, the arithmetic processing unit 12 determines whether it is day or night, and based on the result, the processing range of the interlaced video camera signal is set as follows.
[0025]
・ If noon, select 3n + 1 line without filter,
・ At night, when blurring is small, select 3n + 2 lines of infrared cut filter 1,
・ At night, when blurring is large, select 3n + 3 rows of infrared cut filter 2.
The imaging surface 14 ′ of the imaging device 14 according to the present invention is divided into a plurality of regions in units of rows or columns. In the first and second embodiments described above, the configuration divided into a plurality of regions in units of rows is shown. Next, the configuration partitioned into a plurality of regions in units of columns is shown as third and fourth embodiments.
[0026]
FIG. 10 is a plan view showing a third embodiment according to the present invention.
While the first embodiment (FIG. 6) is in units of rows, the third embodiment is in units of columns.
More specifically, the characteristics of the odd-numbered and even-numbered filters are changed in order to cope with nighttime when the stop lamp of the vehicle ahead is blurred. That is, the odd-numbered columns are without a filter, and the even-numbered columns are infrared cut filters (F1). As processing at this time, the arithmetic processing unit 12 determines whether it is day or night, and based on the result, the processing range of the video camera signal is set as follows.
[0027]
・ In the daytime, select an odd-numbered column without a filter,
-At night, select an even column with an infrared cut filter (F1).
FIG. 11 is a plan view showing a fourth embodiment according to the present invention.
The second embodiment (FIG. 8) is in units of rows, whereas the fourth embodiment is in units of columns.
[0028]
More specifically, the characteristics of the filters of the 3n + 1 column, the 3n + 2 column, and the 3n + 3 column are changed in order to cope with the night when the stop lamp of the vehicle ahead is blurred. That is, if n is an integer and n = 0, 1,.
3n + 1 column: no filter
3n + 2 rows: infrared cut filter 1 (F1)
3n + 3 rows: Infrared cut filter 2 (F2)
And As processing at this time, the arithmetic processing unit 12 determines whether it is day or night, and based on the result, the processing range of the video camera signal is set as follows.
[0029]
・ If noon, select 3n + 1 column without filter,
・ At night, when blurring is small, select 3n + 2 rows of infrared cut filter 1,
・ At night, when blurring is large, select the 3n + 3 column of the infrared cut filter 2.
The third and fourth embodiments described above are effective when it is desired to appropriately set the left and right viewing angles from the video camera. For example, this is effective when a video camera is provided on the rear window side of the vehicle and it is desired to check a white lane mark on the road that is developed behind the vehicle (described later).
[0030]
In order to extract the image pickup signal S in units of columns according to the third and fourth embodiments, the interlace method as in the first and second embodiments cannot be used as it is. .
That is, in the case of the first and second embodiments, the plurality of regions described above that are divided in units of rows are defined by one of the odd-numbered or even-numbered rows of the image sensor 14, and this interlace method is used. If the imaging signal S is stored in the memory 24 constituting the arithmetic processing unit 12, the CPU 25 and the memory I / F control circuit 23 can perform predetermined image processing without performing any complicated control thereafter.
[0031]
However, in the case of the third and fourth embodiments, the arithmetic processing unit 12 has a counter function (see the counter 31 in FIG. 5), and the predetermined count value of the row-by-row image pickup signal S from the image pickup device 14. It is necessary to read out the image signal selected every time the signal reaches 1 from the memory 24 constituting the arithmetic processing unit 12 as the image signal S corresponding to a plurality of regions divided in units of columns.
[0032]
For example, the memory I / F (interface) control circuit 23 in FIG. 5 performs such a read operation. For example, in the case of FIG. 11, the predetermined count value is “2 → 5 → 8 →... → 511” for the infrared cut filter (F1), and for the infrared cut filter (F2). , “3 → 6 → 9 →... → 512”. Further, “No filter (III)” is “1 → 4 → 7 →... → 510”.
[0033]
The count value to be selected depends most simply on whether the environment in which the vehicle is placed is daytime or nighttime. Such day / night identification is performed by the arithmetic processing unit 12 of FIG.
That is, the arithmetic processing unit 12 calculates a luminance value representing the average received light luminance of the entire image sensor based on the data of the imaging signal S stored in the memory 24 constituting the arithmetic processing unit 12, and the luminance value The above-described first, second and third regions (I, II and III) are designated according to the size of. That is, whether to use the first filter F1, the second filter F2, or no filter (III) is determined.
[0034]
The first and second embodiments are based on filter processing only in units of rows, and the third and fourth embodiments are based on filter processing only in columns. If this is further developed, it can be based on a filter processing based on a combination of row units and column units.
FIG. 12 is a diagram showing a fifth embodiment according to the present invention.
[0035]
In the fifth embodiment, filter processing is performed in a composite of row units and column units. In FIG. 12, the first region I (with the first filter F1), the second region II (with the second filter F2), and the third region III (without the filter) are all adopted as the plurality of regions described above. It shows that these regions are arranged in a grid pattern.
Thus, in this fifth embodiment, in the image processing apparatus comprising the optical system 11 having the image sensor 14 and the arithmetic processing unit 12 that performs image processing with the image signal S from the optical system 11 as an input, the image sensor 14 Are arranged in a matrix of pixels in the row direction and pixels in the column direction,
The imaging surface 14 ′ of the imaging device 14 is divided into a plurality of regions in units of intersections of rows and columns, and the plurality of regions includes a first region I and a second region having a first filter F1 on the imaging surface 14 ′. The filter F2 is configured by at least any two of the second region II provided on the imaging surface 14 ′ and the third region III provided with no filter on the imaging surface 14 ′.
[0036]
FIG. 13 is a graph used for explaining the sixth embodiment according to the present invention.
In each of the embodiments described above, an infrared cut filter is used as the first filter F1 (second filter F2). However, in the sixth embodiment (and the seventh embodiment described later), a filter having a uniform density (all wavelength bands) An ND (Neutral Density) filter, which is a filter that suppresses the amount of transmitted light substantially uniformly over (a wavelength band that requires attenuation), is used.
[0037]
That is, the plurality of regions described above are configured by the first region I and the third region III, and the first filter F1 provided in the first region I is an ND filter. .
In each of the above-described embodiments, the cause C of blurring is removed by the infrared cut filter. In the sixth embodiment (seventh embodiment), the ND filter is used to uniformly reduce the transmittance over the entire wavelength band. (suppressing amount of transmitted light) by, in which so as to eliminate the cause C. The effect of preventing the above-described blur is almost the same as that of the infrared cut filter.
[0038]
In FIG. 13, a curve D represents the transmittance characteristic lowered by the ND filter.
FIG. 14 is a graph used for explaining the seventh embodiment according to the present invention.
In the seventh embodiment, the plurality of regions described above are composed of a first region I, a second region II, and a third region III, and the first filter F1 provided in the first region I is an ND filter. The second filter F2 provided in the second region is also an ND filter, and is characterized in that the transmittance characteristics of the first filter F1 and the second filter F2 are different from each other.
[0039]
Referring to FIG. 14, a curve D1 represents the transmittance characteristic of the first ND filter (F1), and a curve D2 represents the transmittance characteristic of the second ND filter (F2). The transmittance of F1 is set larger than the transmittance of F2. Each role is the same as the roles of the first infrared cut filter (F1) and the second infrared cut filter described above.
[0040]
Although the case where the video camera is provided mainly on the front window side of the vehicle has been described in the above embodiment, the case where this video camera is provided on the rear window side of the vehicle will be described below. Moreover, although the infrared cut filter and the ND filter have been described as the filters to be used, in the following description, a case where an RGB color filter is also incorporated will be described.
[0041]
FIG. 15 is a view showing an eighth embodiment according to the present invention.
In the eighth embodiment, the plurality of regions described above are divided only in column units, and the first region I arranged in the middle portion of the imaging surface 14 ′ and the left and right sides of the middle portion in the imaging surface 14 ′. The third region III is arranged in each of a certain left part and right part, and the first filter F1 provided in the first region I is an RGB color filter.
[0042]
FIG. 16 is a diagram showing an example of a captured image under the eighth embodiment.
In this figure, 41 is a display and displays the image | video of the back side of a vehicle. This figure displays a night image, and a rear vehicle is shown in the center (rear vehicle portion in FIG. 15).
When driving at night, there are times when it is desirable to clearly display only the lane mark (white line) 5 on the road developed behind the vehicle. Therefore, the portions of the imaging surface 14 ′ corresponding to the left and right portions of the central display portion of the display are not filtered (third region III) (white line portion in FIG. 15).
[0043]
The image to be developed in the vehicle rear, in addition to the above, there is a case of using, for example, as a confirmation of the vehicle rear during parking. In this case, a color image, it is necessary to project a central portion of the field of view clearly. Providing a RGB color filter (F1) in FIG. 15 for the center of the imaging plane 14 '. Incidentally, such a time the vehicle rear of the check, to enlarge it is convenient. This is shown as display 41 'in FIG.
[0044]
More specifically, when recognizing a white line behind a video camera (see 52 in FIG. 18) attached to the rear of the vehicle, the filter characteristics are changed depending on the range where the vehicle exists and the range where the white line exists. To do. Ie
Vehicle part 1: RGB color filter (I)
White line part 5: No filter (III)
And As the processing at this time, in order to display the video in the central portion on the screen, color display is necessary. .
[0045]
FIG. 17 is a diagram showing a ninth embodiment according to the present invention.
The ninth embodiment is a modification of the eighth embodiment and can be employed when the amount of light in the white line portion (5) is too strong.
That is, in the ninth embodiment, the plurality of regions described above are divided only in column units, and the first region I arranged in the middle portion of the imaging surface 14 ′ and the left and right of the middle portion in the imaging surface 14 ′. The second region II is arranged in each of the left part and the right part, and the first filter F1 provided in the first region I is an RGB color filter, and the second region II is provided in the second region II. The second filter F2 is an infrared cut filter.
[0046]
As for the above infrared cut filter (F2), it can be further divided into two stages this. This is as shown by F1 and F2 of the double arrows in FIG.
In other words, the infrared cut filter forming the second filter F2 includes a first infrared cut filter and a second infrared cut filter, and the spectral sensitivity characteristics of the first and second infrared cut filters are different from each other. I will let you.
[0047]
And as a further modification, it is also possible to ND filter described above in place of the infrared cut filter. That is, according to such an embodiment, the plurality of regions described above are divided only in column units, and the first region I arranged in the middle portion of the imaging surface 14 ′ and the middle portion of the imaging surface 14 ′. The first region F1 is composed of a second region II arranged in the left part and the right part on the right and left sides, and the first filter F1 provided in the first region I is an RGB color filter and is provided in the second region II. The second filter F2 to be used is an ND filter.
[0048]
And for this ND filter (F2), or it may be further divided into two stages this. This is as shown as curves D1 and D2 in FIG. 14 described above.
Under such an embodiment, the ND filter forming the second filter F2 includes the first ND filter and the second ND filter, and the transmittance characteristics of the first and second ND filters are made different from each other.
[0049]
In a tenth embodiment described below, not only a video camera but also illumination means for raising an image behind the vehicle are provided behind the vehicle.
FIG. 18 is a perspective view for explaining a tenth embodiment according to the present invention.
In this figure, the vehicle 1 is traveling along a lane mark (white line) 5, and the video camera already described is shown as 52 behind the vehicle 1, and the above-mentioned illumination means is shown as 51. Has been. However, the employed filter configuration on the imaging surface 14 'is exactly the same as that of the above-described eighth embodiment (FIG. 15) or ninth embodiment (FIG. 17).
[0050]
As the illumination means 51, a light emitting element that emits light at a specific wavelength is used. In the example of this figure, an infrared LED is used as the light emitting element (center frequency 950 nm), and FIG. 18 shows a state in which the lane mark 5 is illuminated.
Figure 19 is a diagram showing a tenth embodiment according to the present invention, shown with a graph G representing the spectral sensitivity characteristics.
[0051]
In the above example, an infrared LED (specific wavelength is 950 nm) is used as the illuminating means 51, and the specific wavelength filter that transmits this specific wavelength region (see H in the graph G of FIG. 19) is used as the second filter F2. Use.
That is, in the tenth embodiment, the plurality of regions described above are divided only in column units, and the first region I arranged in the middle portion of the imaging surface 14 ′ and the middle portion of the imaging surface 14 ′ are arranged. The second region II is arranged in the left part and the right part on the left and right, respectively. Here, the first filter F1 provided in the first region I is an RGB color filter, and in the second region the second filter F2 provided is characterized in that a specific wavelength filter that transmits a specific wavelength range.
[0052]
Further, the specific wavelength filter (F2) includes a first specific wavelength filter and a second specific wavelength filter, and the transmittance characteristics of the first and second specific wavelength filters are different from each other. You can also.
[0053]
【The invention's effect】
As described above, according to the present invention, a video camera in which a desired filter is selectively arranged on the imaging surface 14 ′ of the imaging device 14 is provided.
Thereby, a desired image can be obtained more clearly.
Further, by selectively using a desired filter, the memory capacity of the memory 24 can be reduced, and accordingly, the processing time of the CPU 25 can be shortened.
[Brief description of the drawings]
FIG. 1 is a diagram showing a basic configuration of an image processing apparatus according to the present invention.
FIG. 2 is a graph showing spectral sensitivity characteristics of the image sensor 14;
FIG. 3 is a plan view showing a filter group 15 formed on an imaging surface 14 ′.
FIG. 4 is a flowchart illustrating an example of processing by the arithmetic processing unit 12;
FIG. 5 is a diagram showing a specific example of the device configuration of FIG. 1;
FIG. 6 is a plan view showing a first embodiment according to the present invention.
FIG. 7 is a graph used for explaining the first embodiment.
FIG. 8 is a plan view showing a second embodiment according to the present invention.
FIG. 9 is a graph used for explaining the second embodiment.
FIG. 10 is a plan view showing a third embodiment according to the present invention.
FIG. 11 is a plan view showing a fourth embodiment according to the present invention.
FIG. 12 is a plan view showing a fifth embodiment according to the present invention.
FIG. 13 is a graph used for explaining a sixth embodiment according to the present invention.
FIG. 14 is a graph used for explaining a seventh embodiment according to the present invention.
FIG. 15 is a diagram showing an eighth embodiment according to the present invention.
16 is a diagram showing an example of a captured image under the eighth embodiment.
FIG. 17 is a diagram showing a ninth embodiment according to the present invention.
18 is a perspective view for explaining a tenth embodiment according to the present invention.
FIG. 19 shows a tenth embodiment according to the present invention.
20 is a diagram illustrating an example of an image showing a first problem of the prior art.
[Explanation of symbols]
1 ... Vehicle
2, 3, 4 ... Brake lamp
5 ... Lane mark
10. Image processing apparatus
11 ... Optical system (video camera)
12 ... arithmetic processing unit
13 ... Lens
14: Image sensor
14 '... Imaging surface
15 ... Filter group
21 ... Amplifier
22 ... ADC
23. Memory I / F control circuit
24 ... Memory
25 ... CPU
31 ... Counter
41 ... Display
51. Illumination means
52 ... Video camera
S: Imaging signal
I ... 1st area
II ... 2nd area
III ... 3rd area
F1 ... 1st filter
F2 ... Second filter

Claims (3)

A camera having an image sensor;
An image processing device that performs image processing using an imaging signal of the camera as an input,
The camera
The image pickup device is divided into a plurality of regions, and includes a filter disposed on an image pickup surface of a predetermined region among the plurality of regions,
The image processing apparatus includes:
Based on the ambient environment, an arithmetic processing unit for setting the processing range for performing image processing of the image signal,
An image processing system comprising: at least an RGB color filter as the filter, and the predetermined region in which the RGB color filter is disposed is a region located in the center excluding the left and right portions of the imaging surface . Further, as the filter comprises a filter for attenuating the amount of light transmitted through the transmissive cut, or the entire wavelength band of a predetermined wavelength band, the calculation processing unit, when the ambient environment is the day, as the processing range, the cut or The image processing system according to claim 1, wherein an image signal picked up in an area where a filter to be attenuated is arranged is selected. An image pickup device having an image pickup device, wherein the image pickup device is divided into a plurality of regions, and an image pickup signal from a camera including a filter disposed on an image pickup surface of a predetermined region of the plurality of regions is input; An arithmetic processing unit that performs image processing on the input imaging signal;
The arithmetic processing unit sets a processing range based on the surrounding environment, performs image processing of the image signal,
An image processing apparatus comprising: at least an RGB color filter as the filter, and the predetermined region where the RGB color filter is disposed is a region located in the center excluding the left and right portions of the imaging surface .

Images