JP4747670B2 - Image processing device - Google Patents

Description

  The present invention relates to an image processing apparatus.

  Conventionally, a CCD camera has been proposed in which a single CCD has sensitivity in both the wavelength band of infrared light and the wavelength band of visible light (see, for example, Patent Document 1). According to the CCD camera disclosed in Patent Document 1, an optical filter that selectively gives a wavelength band of extraneous light has a predetermined ratio between a transmission part that does not remove infrared rays and an infrared filter part that cuts infrared light. Distribute.

With this configuration, the external light of visible light and infrared light passes through the optical filter, and the filter transmitted light including the infrared light that has passed through the transmission part is received by the corresponding sensor of each pixel of the CCD, and the infrared filter part The infrared cut light that has passed through is received by the corresponding sensor of each pixel, converted into an electric signal, and extracted as a video signal output.
JP 11-289491 A

  By the way, in known vehicle applications such as white line recognition for recognizing a white line on a road and night view for securing a field of view in front of the vehicle at night, an individual imaging device is used for each application. These imaging apparatuses are prepared for each application due to the difference in optical characteristics due to the difference in application (in other words, the difference in use) even though both of them capture the front of the vehicle.

  On the other hand, the above-described prior art CCD camera has sensitivity in both visible light and infrared light wavelength bands, so if this CCD camera is adopted, the camera can be shared in each application. This is possible and is advantageous in terms of mounting space and cost.

  However, white line recognition and night view have conflicting requirements in terms of optical characteristics such as angle of view, resolution, sensitivity, etc., so simply adopting a CCD camera of the prior art will result in an image that meets the required optical characteristics for each application. The signal cannot be output.

  Also, in applications such as white line recognition, it is assumed that the imaging device has a predetermined distance range in front of the vehicle as the imaging range. Therefore, the imaging range of the imaging device needs to be adjusted to a predetermined target range. In such a case, for example, a target having a predetermined pattern is set so as to have a predetermined positional relationship with the imaging device, and an imaging range of the imaging device is softened using an image signal obtained by imaging the target pattern. Conventionally adjusting techniques have been proposed.

  However, in the case of the conventional technique that adjusts the imaging range of the imaging apparatus in a software manner, if the target background is complicated, it is difficult to determine the position of the target, and the imaging range cannot be adjusted. Therefore, when the imaging range is adjusted by the conventional technique, it is necessary to select a place where the background is uniform or to install a dark curtain or the like so that the background is uniform. Therefore, it takes a lot of time to secure the work space and work itself.

  The present invention has been made in view of the above problems, and a first object thereof is to propose an image processing apparatus capable of outputting a plurality of image signals having different optical characteristics using a single imaging device. It is to be. A second object of the invention is to propose an image processing apparatus that can shorten the work time required for adjusting the imaging range of the imaging apparatus.

The image processing apparatus according to claim 1, which has been made to achieve the above object, has been photographed by a single imaging means having a plurality of light receiving elements having sensitivity in the wavelength band of infrared light and the wavelength band of visible light. An image processing apparatus comprising image processing means for performing image processing for outputting a plurality of image signals having different optical characteristics using an image, wherein the image processing means is a part of an image captured by an imaging means. Image clipping means for cutting out an image of the range, high resolution processing means for increasing the resolution of the partial image cut out by the image cutting means, and sensitivity of the partial image whose resolution is enhanced by the high resolution processing means in the wavelength band of infrared light based partial image sensitivity adjusting means for adjusting an image sensitivity adjusting means for adjusting the sensitivity of the captured image of the imaging means in the wavelength band of visible light, comprising a, a common image captured by the imaging means, Output an image signal of an image whose sensitivity is adjusted to the visible light wavelength band by the image sensitivity adjusting means, and a partial image signal of the partial image whose sensitivity is adjusted to the infrared light wavelength band by the partial image sensitivity adjusting means. It is characterized by.

Thus, the image processing apparatus of the present invention, sensitivity and image signals of the image that is adjusted according to the wavelength of visible light, high-resolution and infrared light the image sensitivity in the wavelength band is adjusted in A partial image signal of the partial image is output. As a result, it is possible to output a plurality of different image signals corresponding to the required optical characteristics using a single imaging means.

An image processing apparatus according to claim 2 is provided.
The image sensitivity adjustment means
To increase the maximum brightness of the image, change the shutter speed setting value of the shooting means,
When reducing the minimum brightness of the image, adjust the output gain of the image signal,
The partial image sensitivity adjustment means
To increase the maximum brightness of the partial image, change the shutter speed setting value of the shooting means,
When reducing the minimum brightness of the partial image, the output gain of the partial image signal is adjusted.

  As a result, when the maximum value of image brightness is increased, it can be adjusted by changing the setting value of the shutter speed, and when the minimum value of image brightness is decreased, the output gain is set for each image. Can be adjusted to be small. As a result, the noise level of each output image signal is adjusted in the direction of reduction.

The image processing apparatus according to claim 3 , when changing the setting value of the shutter speed of the photographing unit, when the image sensitivity adjustment unit and the partial image sensitivity adjustment unit indicate different setting change instruction values, A shutter speed changing means for changing the set value of the shutter speed of the image pickup means to an instruction value indicating a higher value of the above.

  This makes it possible to increase the brightness of an image captured by the imaging unit even when an imaging unit capable of setting only one shutter speed is used.

According to the image processing apparatus of the fourth aspect , the image processing means includes edge enhancement means for performing edge enhancement processing on the partial image, and outputs an image signal of the partial image edge-enhanced by the edge enhancement means. It is characterized by that. Thereby, the partial image signal in which the subject is clearly displayed can be output.

According to the image processing apparatus of the fifth aspect , the image signal is used for an object shape recognition application for recognizing an object existing in front of the vehicle, and the partial image signal is used for an application for securing a field of view in front of the vehicle. It is characterized by being able to.

  For example, in an application such as white line recognition for recognizing a white line on a road, for example, object shape recognition for recognizing an object existing in front of the vehicle, a wide-angle image is required to recognize the white line on the road ahead of the vehicle. In an application that secures a field of view in front of the vehicle such as night view, an image far from the vehicle is required. Therefore, by using the image signal of the wide-angle image captured by the imaging means for white line recognition and using the partial image signal of the distant partial image cut out from the image for night view, the image of the angle of view corresponding to both applications can be obtained. It can be used.

According to the image processing apparatus of claim 6 ,
The image taken by the imaging means is output as a digital image signal,
The image processing means
Storage means for sequentially storing digital image signals output by the imaging means;
Image conversion means for sequentially reading out digital image signals stored in the storage means and converting them into analog image signals;
A digital image signal and an analog partial image signal of a partial image are output simultaneously.

  Thus, by providing the storage means for storing the digital image, it is possible to sequentially read out the digital image for conversion to the analog image. As a result, a digital image signal and an analog partial image signal can be output simultaneously.

According to the image processing device of claim 7 ,
An image or partial image captured by the imaging means, a cursor movable on the image or partial image, and a display means for displaying a coordinate position on the image where the cursor is located;
Cursor operation means for performing cursor movement operations;
A coordinate position input means for inputting a coordinate position on the image where the cursor is located;
And an imaging range adjusting unit that adjusts the imaging range of the imaging unit based on the coordinate position input by the coordinate position input unit.

  Thus, the operator operates the cursor displayed on the image to read the coordinate position of the target on the image, and inputs the read coordinate position, even if the background of the target is complicated, The position of the target can be specified without selecting a place with a uniform background or installing a dark curtain or the like so that the background is uniform. As a result, it is possible to shorten the work time required for adjusting the imaging range of the imaging device.

According to the image processing device of claim 8 ,
Display means for displaying an image or partial image taken by the imaging means, and a cursor movable on the image or partial image;
Cursor movement operation, and a cursor operation means for specifying a partial range in the image,
An imaging range adjusting unit for recognizing a coordinate position of a predetermined feature point from an image of a partial range specified by the cursor operation unit and adjusting an imaging range of the imaging unit based on the recognized coordinate position; It is characterized by that.

  As a result, even when the background of the target is complicated, the range of the predetermined feature point (target) in the image is specified. The target position can be easily determined.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. In the present embodiment, an in-vehicle application system including the image processing apparatus of the present invention will be described. This in-vehicle application system includes a white line recognition for recognizing a white line on a road and a night view application for ensuring a field of view in front of the vehicle.

(First embodiment)
FIG. 1 is a block diagram illustrating an overall configuration of an in-vehicle application system according to an embodiment. As shown in FIG. 1, the camera 100, the image processing ECU 200, the control ECU 300, the displays 400 a to 400 c, and the adjustment tool 500 are configured. The adjustment tool 500 is appropriately connected to the in-vehicle LAN.

  The camera 100 is installed at a predetermined position in the vehicle interior, for example, on the back side of a rearview mirror, and images a landscape in front of the traveling direction of the vehicle. Note that when the camera 100 is installed at a predetermined position in the vehicle interior, the direction and the like of the camera 100 are adjusted so that the imaging range is a predetermined imaging range with respect to the traveling direction of the vehicle. The adjustment of the imaging range is performed using the adjustment tool 500, and details thereof will be described in the second embodiment.

  The camera 100 also outputs digital image signals (wide angle) having different optical characteristics, NTSC analog image signals (wide angle), and NTSC analog image signals (telephoto) at a predetermined frame rate (for example, 30 [fps]). Output simultaneously.

  The image processing ECU 200 processes the digital image signal (wide angle) output from the camera 100 to recognize the position of the white line on the road, and outputs the recognized white line position to the in-vehicle LAN.

  Further, the image processing ECU 200 receives camera control values including the instruction values for the shutter speed of the camera 100 and the output gain of the digital image signal (wide angle) so that the contrast between the white line and the road surface portion excluding the white line is appropriate. Output to.

  The image processing ECU 200 includes an image interface (I / F) 210, a CPU 220, a memory 230, and a communication I / F 240. The image I / F 210 receives position information of pixel values indicating the degree of brightness of each pixel of the digital image signal (wide angle) output from the camera 100 and transmits the position information to the CPU 220. Based on the position information transmitted by the image I / F 210, the CPU 220 recognizes which pixel position the pixel value output for each line of the image corresponds to. Then, the pixel value output from the camera 100 is stored in the memory 230 so as to correspond to the recognized pixel position. In this way, the digital image signal (wide angle) output from the camera 100 is stored in the memory 230.

  Communication I / F 240 adjusts communication between CPU 220 and control ECU 300. In the present embodiment, the CPU 220 recognizes the position of the white line in the image signal and transmits the recognized white line position to the control ECU 300.

  The control ECU 300 is a control device for a lane departure warning, and determines whether or not the host vehicle has deviated from the lane based on the position of the white line transmitted from the CPU 220, and has determined that the vehicle has departed. In this case, the display unit 400a is instructed to display a warning display. The display device 400a displays an image corresponding to an instruction from the control ECU 300.

  The display device 400b is a display device used for applications other than white line recognition and night view. The display device 400b receives the digital image signal (wide angle) output from the camera 100 and displays the image.

  The display device 400c is, for example, a HUD (Head Up Display) disposed in the vicinity of the front window of the vehicle, and constitutes a night view application that secures a field of view in front of the vehicle. The display 400c is compatible with the NTSC system, and receives an NTSC analog image signal (telephoto) output from the camera 100 and displays the telephoto image.

  FIG. 2 is a block diagram showing the internal configuration of the camera 100. The camera 100 includes an imager 110 and a signal processing IC 120. The imager 110 includes an image sensor such as a CCD, and outputs a digital image signal of the image WP to the signal processing IC 120 for each frame. The imager 110 has sensitivity in both the wavelength band of infrared light and the wavelength band of visible light.

  The signal processing IC 120 is an ASIC (Application Specific Integrated Circuit), and various functions of a RAM (telephoto) 130, a RAM (wide angle) 140, a digital processing filter 150, an analog processing filter (telephoto) 160, and an analog processing filter (wide angle) 170. Has a block.

  The signal processing IC 120 inputs an image signal from the imager 110 and inputs a digital image signal (wide angle) having different optical characteristics, an NTSC analog image signal (wide angle), and an NTSC analog image signal (telephoto). Image processing for simultaneous output at a frame rate (for example, 30 [fps]).

  A RAM (telephoto) 130 and a RAM (wide angle) 140 sequentially store (store) digital image signals corresponding to a predetermined number of frames from the imager 110. The digital image signal is sequentially read by the analog processing filter (telephoto) 160 and the analog processing filter 170 (wide angle), and a new digital image signal from the imager 110 is stored in the read storage area.

  As described above, by providing the RAM (telephoto) 130 and the RAM (wide angle) 140 for storing (storing) the digital image signal, it is possible to sequentially read out the digital image signal for conversion into the analog image signal. As a result, a digital image signal (wide angle), an NTSC analog image signal (wide angle), and an NTSC analog image signal (telephoto) are simultaneously output from the signal processing IC 120 at a predetermined frame rate (for example, 30 [fps]). It becomes possible to do.

  The digital processing filter 150 receives the digital image signal from the imager 110 and adjusts the sensitivity of the image WP. According to the camera control value from the image processing ECU 200, the digital processing filter 150 and the digital image signal (wide angle) ) Output gain. The digital image signal (wide angle) whose output gain is adjusted is output to the image processing ECU 200 and the display 400b.

  The analog processing filter (telephoto) 160 sequentially reads the digital image signals stored in the RAM (telephoto) 130, cuts out a partial image PP in a partial range from the image WP of the image signal, and the resolution of the cut out partial image PP In addition, the sensitivity of the partial image PP with an increased resolution is adjusted, and further, an edge enhancement process is performed on the partial image PP, and then an image filter process is performed to convert the partial image PP into an analog image signal. The analog image signal (telephoto) subjected to the image filtering process is output to the display 400c.

  The analog processing filter (wide angle) 170 sequentially reads the digital image signals stored in the RAM (wide angle) 140, adjusts the sensitivity of the image WP of the image signals, and converts them into analog image signals. The analog image signal (wide angle) converted into the analog image signal is output to the adjustment tool 500.

  Next, the characteristic part of this embodiment is demonstrated. When a white line recognition application for recognizing a white line on a road and a night view for securing a field of view in front of the vehicle are mounted on the same vehicle, conventionally, an individual imaging device is used for each application. In this case, although both images are taken in front of the vehicle, individual imaging devices are used because of the difference in optical characteristics due to the difference in application (in other words, difference in application).

  On the other hand, since the imager 110 has sensitivity in both visible light and infrared light wavelength bands, if this imager 110 is employed, it becomes possible to share the imaging device in each of the above applications, and the mounting space. This is advantageous in terms of cost.

  However, as shown in FIG. 3, white line recognition and night view have conflicting demands on optical characteristics such as angle of view, resolution, sensitivity, etc. Therefore, simply adopting the imager 110 requires required optical characteristics for each application. It is not possible to output an image signal corresponding to.

  As shown in FIG. 3, the angle of view requires a wide-angle image (horizontal angle of view of about 50 [degrees]) in white line recognition. This is common in applications such as object shape recognition for recognizing an object existing in front of the vehicle, but not only recognizes the white line of the own lane on which the vehicle travels, but also the white line of another lane adjacent to the own lane. And so on, a wide-angle image is required. In addition, in the night view used for securing the field of view in front of the vehicle, a telephoto image (horizontal angle of view of about 20 [degrees]) is required because it is used to display a distant image on the display 400c. .

  FIG. 4 is a diagram illustrating a necessary field angle of night view with respect to the maximum field angle of the camera 100. As shown in the figure, since the white line recognition requires a wide-angle image, an image having the maximum field angle is used for both the horizontal and vertical field angles. On the other hand, in the night view, since a telephoto image is required, an image in a certain range with respect to the image with the maximum angle of view is used. Thus, the required angle of view differs between white line recognition and night view.

  As shown in FIG. 3, the resolution is 13 [pxl] because the maximum angle of view (horizontal 50 [degrees]) with respect to the maximum number of pixels (about 648 [pxl]) of the camera 100 in white line recognition. / Degree]. On the other hand, in the night view, since the telephoto image is directly displayed on the display 400c, 26 [pxl] is obtained from the number of horizontal pixels (525 [pxl]) of the display 400c and the required horizontal angle of view of about 20 [degrees]. / Degree] or higher resolution is required. Thus, the required resolution differs between white line recognition and night view.

  Furthermore, as shown in FIG. 3, with respect to the sensitivity, it is necessary to perform exposure control specialized for white lines in white line recognition, whereas in night view, it is necessary to perform exposure control that focuses on the distance. Thus, the sensitivity of white line recognition and night view differ depending on the subject.

  Therefore, in the signal processing IC 120 of this embodiment, each of the digital processing filter 150, the analog processing filter (telephoto) 160, and the analog processing filter (wide angle) 170 performs different image processing on the digital image signal from the imager 110. By applying the digital image signal (wide angle) having different optical characteristics, the NTSC analog image signal (wide angle), and the NTSC analog image signal (telephoto) simultaneously at a predetermined frame rate (for example, 30 [fps]). Output it.

  That is, as described above, the digital processing filter 150 receives the digital image signal from the imager 110, adjusts the sensitivity of the image WP, and converts the output image-adjusted digital image signal (wide angle) to the image processing ECU 200 or It outputs to the display 400b. Thereby, the sensitivity of the image WP and the sensitivity of the partial image PP can be individually adjusted.

  On the other hand, in the analog processing filter (telephoto) 160, as described above, a partial image PP in a partial range is cut out from the image WP, and digital zoom (for example, simple interpolation, Bi) is performed in order to increase the resolution of the cut out partial image PP. The resolution is interpolated by a known method such as Linear, Bi Cubic, etc., the sensitivity of the partial image PP with the increased resolution is adjusted, and an edge enhancement process is performed on the partial image PP, and then an analog image signal is obtained. The image filter process for converting to is executed.

  As a result, it is possible to output a plurality of different image signals corresponding to the required optical characteristics using a single imager 110. Then, by using the wide-angle image WP output from the digital processing filter 150 for white line recognition and using the partial image PP cut out from the image WP for night view, it is possible to use images with an angle of view corresponding to both applications. It becomes possible.

  In this analog processing filter (telephoto) 160, edge enhancement processing is performed on the partial image PP. Thereby, the partial image signal of the partial image PP in which the subject is clearly displayed can be output. As a result, a subject such as a pedestrian is clearly displayed on the display 400c.

  In addition, as described above, the analog processing filter (wide angle) 170 adjusts the sensitivity of the image WP and converts it to an analog image signal, and outputs the converted analog image signal (wide angle) to the adjustment tool 500.

  Here, sensitivity adjustment in the digital processing filter 150, the analog processing filter (telephoto) 160, and the analog processing filter (wide angle) 170 will be described. As described above, the digital processing filter 150 adjusts the shutter speed of the imager 110 and the output gain of the digital image signal (wide angle) in accordance with the camera control value from the image processing ECU 200.

  The analog processing filter (telephoto) 160 adjusts the shutter speed of the imager 110 and the output gain of the NTSC analog image signal (telephoto) in accordance with an instruction from the display 400c. The analog processing filter (wide angle) 170 adjusts the shutter speed of the imager 110 and the output gain of the NTSC analog image signal (wide angle) in accordance with an instruction from the adjustment tool 500.

  As described above, in sensitivity adjustment in the digital processing filter 150, the analog processing filter (telephoto) 160, and the analog processing filter (wide angle) 170, the sensitivity is adjusted by adjusting the shutter speed of the imager 110 and the output gain of each image signal. In any case, as shown in FIG. 5A, the shutter speed of the imager 110 is changed when the maximum value of the brightness of the image is increased, and the output gain is the brightness of the image. Adjust to reduce the minimum height.

  As a result, when the maximum brightness value of each image is increased, it can be adjusted by changing the setting value of the shutter speed, and when the minimum brightness value of each image is decreased, it can be adjusted for each image. The output gain can be adjusted to be small. As a result, the noise level of each output image signal is adjusted in the direction of reduction.

  Since only one setting is possible for the shutter speed of the imager 110, when different setting change instruction values are indicated from the digital processing filter 150, the analog processing filter (telephoto) 160, and the analog processing filter (wide angle) 170, It becomes impossible to determine which indicated value should be determined.

  Therefore, in the present embodiment, the setting value of the shutter speed is changed to an instruction value indicating a higher value among the instruction values. Thereby, even if only one setting is possible as the shutter speed, the brightness of each image can be increased.

  As another form for adjusting the sensitivity, as shown in FIG. 5B, linear brightness control and non-linear (logarithmic) control may be switched depending on the number of image signals below the saturation level or 0 level. .

  The white line recognition only needs to be able to identify the white line and the road surface. Therefore, the image signal may be at a saturation level or 0 level or less, except for detecting an edge corresponding to the boundary between the white line and the road surface. On the other hand, in the night view, since an object such as a person is projected on the display 400c, when the image signal is at a saturation level or 0 level or less, the image is white or black. For this reason, when the number of images in which the image signal is at the saturation level or 0 level or less is large, the linear control may be switched to the non-linear (logarithmic) control. As a result, the image can be prevented from flying white or crushed in black, and the subject can be clearly displayed.

  Next, the operation of the signal processing IC 120 of this embodiment will be described using the flowchart shown in FIG. First, in step S10, a digital image signal is acquired from the imager 110. In step S20, the digital image signal is stored in each of the RAM (telephoto) 130 and the RAM (wide angle) 140, and the digital image signal corresponding to the predetermined number of frames is read out.

  In step S30, the above-described processing (image filter processing) is performed in the digital processing filter 150, the analog processing filter (telephoto) 160, and the analog processing filter (wide angle) 170. In step S40, digital image signals having different optical characteristics are processed. (Wide angle), NTSC analog image signal (wide angle), and NTSC analog image signal (telephoto) are simultaneously output. Thereafter, by repeating the processing of steps S10 to S40, the image signals are simultaneously output at a predetermined frame rate (for example, 30 [fps]).

  As described above, in the signal processing IC 120 of the present embodiment, the analog processing filter (telephoto) 160 cuts out a partial image PP in a partial range from the image WP, and uses digital zoom to increase the resolution of the cut out partial image PP. Interpolation of the resolution is performed, the sensitivity of the partial image PP with the increased resolution is adjusted, and further, image enhancement processing is performed to convert the partial image PP into an analog image signal after performing edge enhancement processing. A digital image signal (wide angle) having different optical characteristics, an NTSC analog image signal (wide angle), and an NTSC analog image signal (telephoto) are simultaneously output at a predetermined frame rate (for example, 30 [fps]). . As a result, a single imager 110 can be used to simultaneously output a plurality of different image signals corresponding to the required optical characteristics.

(Second Embodiment)
Since the second embodiment is often in common with that according to the first embodiment, a detailed description of the common parts will be omitted below, and different parts will be mainly described. In the present embodiment, adjustment of the imaging range of the camera 100 performed using the adjustment tool 500 will be described.

  In an application such as white line recognition included in the in-vehicle application system of the present embodiment, it is assumed that the camera 100 has a predetermined distance range in front of the vehicle as an imaging range. Therefore, the imaging range needs to be adjusted to a predetermined target range. In such a case, conventionally, for example, a target having a predetermined pattern is set so as to have a predetermined positional relationship with respect to the camera 100, and the image of the camera 100 is captured using an image signal obtained by capturing the target pattern. The range is softly adjusted.

  However, in this case, if the background of the target is complicated, it becomes difficult to determine the position of the target, and the imaging range cannot be adjusted. Therefore, when the imaging range is adjusted by the conventional technique, it is necessary to select a place where the background is uniform or to install a dark curtain or the like so that the background is uniform. Therefore, it takes a lot of time to secure the work space and work itself.

  Therefore, in the present embodiment, an analog image signal (wide angle) shown in FIG. 7A in which a target having a predetermined pattern is set so as to have a predetermined positional relationship with the camera 100 and the pattern of the target is imaged. ) Is displayed on the display of the adjustment tool 500, the operator reads the center position of the target from the displayed image, and adjusts the imaging range based on the read center position.

  Hereinafter, the imaging range adjustment process executed using the adjustment tool 500 of the present embodiment will be described with reference to the flowchart shown in FIG. First, in step S100, an analog image signal (wide angle) output from the camera 100 is acquired, and the image is displayed on a display (not shown).

  In step S110, the operator operates a movable cursor on the image, aligns the cursor with the center position of the target on the image, and reads the coordinate position on the image where the cursor is located from the display. In step S120, the read coordinate position is input to the adjustment tool 500, and in step S130, the imaging range of the camera 100 is adjusted based on the input coordinate position.

  Thus, the operator operates the cursor displayed on the image to read the coordinate position of the target on the image, and inputs the read coordinate position, even if the background of the target is complicated, The position of the target can be specified without selecting a place with a uniform background or installing a dark curtain or the like so that the background is uniform. As a result, it is possible to shorten the work time required for adjusting the imaging range of the imaging device.

(Modification)
In this embodiment, the imaging range of the camera 100 is adjusted based on the coordinate position input by the operator. For example, as shown in FIG. A range of a part in the image displayed on the display of 500 is specified, a coordinate position of the center of the target is automatically recognized from the image of the specified range of the part, and an imaging unit is based on the recognized coordinate position The image pickup range may be adjusted.

  As a result, even if the background of the target is complicated, the target range in the image is specified. Therefore, when the imaging range of the imaging apparatus is adjusted by software as in the past, the target position is determined. Becomes easy.

It is a block diagram which shows the whole structure of a vehicle-mounted application system. 2 is a block diagram showing a functional configuration of a camera 100. FIG. It is the figure which compared the required optical characteristic of night view and white line recognition. FIG. 5 is a diagram illustrating a necessary view angle of night view with respect to a maximum view angle of the camera 100. (A), (b) is a figure for demonstrating exposure control. 5 is a flowchart for explaining an operation of the signal processing IC 120 according to the first embodiment. (A) is the figure which showed the image when specifying the center of a target with a cursor, (b) is the figure which showed the image when specifying the display range of a target with a cursor. It is a flowchart which shows the flow of the imaging range adjustment process concerning 2nd Embodiment.

Explanation of symbols

100 camera 110 imager 120 signal processing IC
150 Digital processing filter 160 Analog processing filter (Telephoto)
170 Analog processing filter (wide angle)
200 Image processing ECU
500 Adjustment tool

Claims (8)

For outputting a plurality of image signals having different optical characteristics using images taken by a single imaging means having a plurality of light receiving elements having sensitivity in the wavelength band of infrared light and the wavelength band of visible light An image processing apparatus comprising image processing means for performing image processing,
The image processing means includes
Image cutout means for cutting out a partial range image from the image taken by the imaging means;
High resolution processing means for increasing the resolution of the partial image cut out by the image cutting means;
Partial image sensitivity adjusting means for adjusting the sensitivity of the partial image whose resolution is enhanced by the high resolution processing means to the wavelength band of infrared light;
Image sensitivity adjusting means for adjusting the sensitivity of the image taken by the imaging means to the wavelength band of visible light,
Based on a common image taken by the imaging means, an image signal of an image whose sensitivity is adjusted to a visible light wavelength band by the image sensitivity adjusting means, and an infrared light by the partial image sensitivity adjusting means. An image processing apparatus for outputting a partial image signal of a partial image adjusted to a wavelength band of. The image sensitivity adjusting means changes the setting value of the shutter speed of the photographing means when increasing the maximum value of the image brightness, and reduces the minimum value of the image brightness when decreasing the minimum value of the image brightness. Adjust the output gain,
The partial image sensitivity adjusting means, when increasing the maximum value of the brightness of the partial image, changing the setting value of the shutter speed of the photographing means, and decreasing the minimum value of the brightness of the partial image, the image processing apparatus according to claim 1, wherein adjusting the output gain of the partial image signals. When changing the setting value of the shutter speed of the photographing unit, when the image sensitivity adjustment unit and the partial image sensitivity adjustment unit indicate different setting change instruction values, an instruction value indicating a higher value among the respective instruction values The image processing apparatus according to claim 2 , further comprising: a shutter speed changing unit that changes a setting value of the shutter speed of the imaging unit. It said image processing means includes an edge enhancement means for performing edge enhancement processing on the partial image, according to claim 1 to 3, characterized in that outputs an image signal of an edge enhanced partial image by the edge enhancement means The image processing apparatus according to any one of the above. The image signal is used for an object shape recognition application for recognizing an object existing in front of the vehicle,
The partial image signal, the image processing apparatus according to any one of claim 1 to 4, characterized in that for use in applications to ensure the field of view of the vehicle front. The image taken by the imaging means is output as a digital image signal,
The image processing means includes storage means for sequentially storing digital image signals output from the imaging means, and image conversion means for sequentially reading the digital image signals stored in the storage means and converting them into analog image signals. comprising, an image processing apparatus according to any one of claim 1 to 5, characterized in that outputs the digital image signal, and an analog partial image signals of the partial images simultaneously. Display means for displaying an image or partial image taken by the imaging means, a cursor movable on the image or the partial image, and a coordinate position on the image where the cursor is located;
Cursor operating means for performing the cursor moving operation;
Coordinate position input means for inputting a coordinate position on the image where the cursor is located;
Based on the coordinate position input by the coordinate position input means, of any one of of claims 1-6, characterized in that and an imaging range adjusting means for adjusting the imaging range of the image pickup means Image processing device. Display means for displaying an image taken by the imaging means or the partial image, and a cursor movable on the image or the partial image;
A cursor operating means for performing a moving operation of the cursor, and a cursor operating means for specifying a range of a part in the image;
An imaging range adjusting means for recognizing a coordinate position of a predetermined feature point from an image of a partial range specified by the cursor operation means, and adjusting an imaging range of the imaging means based on the recognized coordinate position; the image processing apparatus according to any one of claim 1 to 6, characterized in that it comprises.

Images