JP2019132847A - Imaging device - Google Patents

Abstract

To improve the quality of image data.SOLUTION: The imaging device includes: an imaging element for imaging an object; and an acquisition unit for acquiring image data generated by the imaging element. The condition for imaging the image data of a part of the image data acquired by the acquisition unit, and the condition for imaging the image data of the other region are different. The imaging data may output image data of a region which is not the partial region of the image data. The condition for imaging may include setting of the diaphragm for adjusting the amount of light entering the imaging element.SELECTED DRAWING: Figure 9

Description

  The present invention relates to an imaging apparatus.

There is a vehicular imaging apparatus that acquires images of a plurality of different areas with a single camera and uses different types of determination for each area (see, for example, Patent Document 1).
[Patent Document 1] Japanese Patent Application Laid-Open No. 2010-223585

  In the photographing apparatus, different types of determination for each region are processed by one image processing unit. This complicates the processing circuit and increases the processing time.

  In one embodiment of the present invention, an image sensor that captures an image of an object and an acquisition unit that acquires image data generated by the image sensor are provided, and an image of a partial area of the image data acquired by the acquisition unit. An imaging apparatus is provided in which imaging conditions for imaging data and imaging conditions for imaging image data other than a part of the area are different.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

1 is a perspective view of a vehicle 100. FIG. 3 is a schematic diagram of an imaging region 300. FIG. 2 is an exploded perspective view of a sky imaging optical system 210. FIG. 2 is an exploded perspective view of a raindrop imaging optical system 230. FIG. 3 is a schematic cross-sectional view of a raindrop imaging optical system 230. FIG. 3 is a schematic diagram of image data 400. FIG. 3 is a block diagram of an internal circuit 240. FIG. 3 is a block diagram of an external processing device 270. FIG. It is a schematic diagram of front image data 430 grade | etc.,. 3 is a flowchart showing the operation of an internal circuit 240. It is a schematic diagram of front image data 430 grade | etc.,. 2 is a block diagram of an internal circuit 241. FIG. 3 is a block diagram of an internal circuit 243. FIG.

  Hereinafter, the present invention will be described through embodiments of the invention. The following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 is a partial and schematic perspective view showing a front portion of the vehicle 100. The vehicle 100 includes a windshield 110, a wiper 120, and a light unit 130. For the purpose of simplifying the description, as indicated by arrows in the figure, the vehicle width direction of the vehicle 100 is the X direction, the height direction of the vehicle 100 is the Y direction, and the traveling direction of the vehicle 100 is the Z direction. May be described.

  The windshield 110 is formed of tempered glass fixed to the front surface of the passenger compartment of the vehicle 100. A wiper 120 is disposed near the lower end of the outer surface of the windshield 110. The wiper 120 reciprocates around one end as a rotation axis, and wipes the outer surface of the windshield 110. As a result, raindrops, snowflakes, and the like attached to the windshield 110 are removed, and the forward visibility of the driving vehicle is secured.

  A support portion 114 that supports the rearview mirror 112 and the in-vehicle camera unit 200 together is fixed to the inner surface of the windshield 110. The driver seated in the driver's seat can observe the state in front of the vehicle 100 through the windshield 110 and the state in the rear of the vehicle 100 through the rear mirror 112, respectively.

  The in-vehicle camera unit 200 captures an image outside the passenger compartment through the windshield 110. On the outer surface of the windshield 110, the wiper 120 also wipes the front of the in-vehicle camera unit 200. Therefore, the in-vehicle camera unit 200 can take an image of the outside of the passenger compartment through the windshield 110 even during rain.

  The light unit 130 is disposed near the front end of the vehicle 100. The light unit 130 houses light emitting units such as a main light, a vehicle width light, a direction indicator, a fog lamp, and a daytime light. In the light unit 130, the main lamp and the width lamp are turned on at night, and the fog lamp is turned on when the forward visibility deteriorates due to rain, heavy fog, or the like. The daytime light is lit when the prime mover is running during the day. Thus, the light unit 130 can take various lighting states according to the environmental conditions in which the vehicle 100 is placed.

  FIG. 2 shows the imaging region 300 of the imaging element 222 of the in-vehicle camera unit 200. The image sensor 222 is a CCD, CMOS, or the like in which pixels are two-dimensionally arranged, and generates digital image data corresponding to subject light.

  The imaging area 300 includes a front area 330, a sky area 310, and a raindrop area 320. The sky region 310 occupies a horizontally long region along the upper side of the imaging region 300. The raindrop area 320 occupies a pair of areas along the side of the imaging area 300 in the area excluding the sky area 310 from the imaging area 300. The front area 330 occupies the entire area excluding the sky area 310 and the raindrop area 320 from the imaging area 300. The front area 330 has a larger area than the sky area 310 and the raindrop area 320.

  The front area 330 is a subject in an external space where the driver of the vehicle 100 observes the Z direction through the windshield 110 from the driver's seat. Therefore, the image acquired in the front area 330 includes roads, lanes, preceding vehicles, signs, and the like.

  The sky region 310 uses the sky when looking up in the Y direction with respect to the vehicle 100 as a subject. The image acquired in the sky region 310 may include identifiable objects such as sky and clouds, but mainly shows a luminance distribution. Therefore, the resolution of the sky region 310 may be low.

  The raindrop area 320 is focused on the outer surface of the windshield 110, and acquires an image including the attached matter when raindrops, snowflakes, or the like adhere to the windshield 110. When simply detecting the presence or absence of raindrops, a high resolution is not required for the raindrop region 320.

  FIG. 3 is an exploded perspective view of the sky imaging optical system 210 that guides sky subject light to the sky region 310 in the in-vehicle camera unit 200. The sky imaging optical system 210 includes a light guide unit 211 disposed in front of the imaging unit 220.

  The light guide unit 211 has an entrance end 212 and an exit end 214 that face each other. The incident end 212 is arranged facing the Z direction in front of the vehicle 100. The incident end 212 of the light guide unit 211 is arranged at a position shifted upward in the Y direction with respect to the emission end 214. For this reason, the entrance end 212 and the exit end 214 are coupled by an inclined optical path that gradually descends in the Y direction. Thereby, the sky subject image positioned in the Y direction, that is, above the imaging unit 220 is guided to the imaging unit 220.

  The exit end 214 faces the entrance end of the imaging unit 220. Here, the exit end 214 of the light guide unit 211 is disposed near the upper end of the imaging range of the imaging unit 220. As a result, the subject luminous flux emitted from the light guide unit 211 enters the sky region 310 of the imaging region 300.

  The upper and lower surfaces of the inclined optical path in the light guide unit 211 are respectively covered with a cladding layer 216 having a lower refractive index. Therefore, the subject luminous flux incident from the incident end 212 of the light guide unit 211 is propagated to the exit end 214 with low loss.

  By providing the light guide unit 211 as described above, a sky subject image positioned in the Y direction with respect to the vehicle 100 using the in-vehicle camera unit 200 installed in the Z direction with respect to the vehicle 100, It can be acquired in the sky region 310 and image data can be generated. By analyzing the image data of the sky region 310, for example, the brightness of the environment according to whether it is day or night or according to the weather can be detected.

  FIG. 4 is an exploded perspective view showing a spatial arrangement of the raindrop imaging optical system 230 that guides subject light to the raindrop area 320 in the in-vehicle camera unit 200. The raindrop imaging optical system 230 includes a light source 231, a prism 232, and a plurality of reflecting mirrors 233, 234, and 235. Further, the raindrop imaging optical system 230 includes a light source 231, a prism 232, and a plurality of reflecting mirrors 233, 234, and 235, and a pair of optical systems formed symmetrically in the X direction with respect to the optical axis of the imaging unit 220. including.

  When attention is paid to one of the pair of optical systems, one surface of the prism 232 has an inclination along the inner surface of the windshield 110. The light source 231 is disposed in the prism 232 so as to face a surface adjacent to a surface inclined along the windshield 110.

  The light source 231 generates irradiation light in the infrared band or near infrared band and irradiates the light toward the inside of the prism 232. The irradiation light propagated through the prism 232 is emitted from a surface adjacent to the surface along the inner surface of the windshield 110 in the prism 232 and facing the surface on which the irradiation light is incident.

  One reflecting mirror 233 among the plurality of reflecting mirrors 233, 234, and 235 reflects the irradiation light emitted from the prism 232. Further, the other reflecting mirrors 234 and 235 sequentially reflect the irradiation light and guide it to the incident end of the imaging unit 220. The reflecting mirror 235 serving as the exit end of the raindrop imaging optical system 230 guides the irradiation light to the vicinity of the side edge of the imaging region 300 of the imaging unit 220. As a result, the irradiation light emitted from the raindrop imaging optical system 230 is guided to the raindrop area 320 of the imaging area 300.

  FIG. 5 is a cross-sectional view of the raindrop imaging optical system 230 and shows one optical function of a pair of optical systems that form the raindrop imaging optical system 230 that images the raindrop region 320. FIG. 5 also shows a front imaging optical system 224 used when imaging the front region 330.

  Irradiation light emitted radially from the light source 231 propagates in the prism 232 as parallel light, and is irradiated toward the windshield 110 from the upper surface of the prism 232 in the drawing. An antireflection layer 116 is provided on the inner surface of the windshield 110. Thereby, reflection of the irradiation light on the inner surface of the windshield 110 is suppressed, and the irradiation light is irradiated on the outer surface of the windshield 110. The antireflection layer 116 can be formed of a silicon thin film, a dielectric multilayer film, or the like.

  Here, the irradiation light is applied to the outer surface of the windshield 110 at an angle that causes total reflection at the interface between the region A and the atmosphere on the outer surface of the windshield 110. Therefore, in the region A on the outer surface of the windshield 110, the irradiation light is efficiently reflected, propagates again through the windshield 110 and the prism 232, and then exits from the prism 232 toward the reflecting mirror 233.

  Irradiation light emitted from the prism 232 is sequentially reflected by the plurality of reflecting mirrors 233, 234, and 235 and then enters the imaging unit 220. Since one reflecting mirror 234 has a concave reflecting surface, a reduced image of the entire region A in the windshield 110 is incident on the imaging unit 220.

  When deposits such as raindrops or snowflakes adhere to the outer surface of the windshield 110 in the vehicle 100, the refractive index difference on the outer surface of the windshield 110 changes. Therefore, the critical angle of total reflection on the outer surface changes. As a result, a part of the irradiation light totally reflected on the outer surface of the windshield 110 in the dry state is emitted to the outside of the windshield 110.

  For this reason, when raindrops or the like adhere to the surface of the windshield 110, the amount of irradiation light guided to the imaging unit 220 through the raindrop imaging optical system 230 decreases in the area where the deposits are attached. Therefore, the shape of the deposit on the outer surface of the windshield 110 is imaged as a dark spot by the imaging unit 220. In this manner, by analyzing the image data generated by the imaging unit 220 through the raindrop imaging optical system 230, the amount of deposits attached to the windshield 110 can be detected.

  Note that the raindrop imaging optical system 230 may have other structures. That is, the irradiation light can be converted into parallel rays using a reflecting mirror, a lens, or the like instead of the prism 232. Alternatively, flat mirrors may be used as the reflecting mirrors 233, 234, and 235, and the irradiation light may be focused by another optical component such as a lens. Needless to say, the number of reflecting mirrors 233, 234, 235 is not limited to three.

  As shown in FIG. 5, in the in-vehicle camera unit 200, the imaging unit 220 includes an imaging element 222, a front imaging optical system 224, and a diaphragm device 226. The front imaging optical system 224 is installed in the vehicle 100 in the Z direction, that is, in front of the vehicle 100. A diaphragm device 226 is disposed in the middle of the front imaging optical system 224.

  The front imaging optical system 224 has an optical characteristic that forms an image on the front area 330 of the imaging area 300 in the Z direction, that is, the area in front of the vehicle 100. Therefore, the imaging unit 220 generates image data corresponding to the subject image incident on the front region 330 by subject light flux that is directly incident on the front imaging optical system 224 through the windshield 110. Further, by operating the aperture device 226, the depth of field of the front imaging optical system 224 can be changed, and the field luminance can be adjusted when imaging.

  The imaging unit 220 captures the subject images of the sky region 310, the raindrop region 320, and the front region 330 together using a single image sensor 222. Therefore, based on the output of the single image sensor 222, the sky region 310, the raindrop region 320, and the front region 330 with different visual fields can be collectively converted into image data. Thereby, the vehicle-mounted camera unit 200 can acquire various image information using few hardware resources. Further, by designating the address of the pixel in the imaging area 300, it corresponds to each of the front area 330, the sky area 310, and the raindrop area 320 from the image data generated based on the subject light incident on the imaging area 300. Image data to be extracted is extracted.

  In the above example, the subject image formed by the sky imaging optical system 210 and the raindrop imaging optical system 230 forms an image on the imaging element 222 through the front imaging optical system 224. However, the sky imaging optical system 210, the raindrop imaging optical system 230, and the front imaging optical system 224 may be independent from each other until just before the imaging element 222. Accordingly, the imaging unit 220 can capture images under different imaging conditions in each of the sky imaging optical system 210, the raindrop imaging optical system 230, and the front imaging optical system 224.

  FIG. 6 is a diagram schematically illustrating the image data 400 generated by the imaging unit 220. For convenience of explanation, the image data 400 is shown as an image itself.

  The imaging unit 220 generates image data 400 by converting the imaging region 300 into an electrical signal by the imaging element 222 at time intervals according to a predetermined frame rate. Therefore, the imaging unit 220 sequentially outputs a plurality of frames 1 to n corresponding to the images acquired in the imaging region 300. That is, each of the frames 1 to n is an example of original image data corresponding to the entire image of the imaging region 300. Each of the frames 1 to n includes the sky image data 410 corresponding to the image of the sky region 310 in FIG. 3, the raindrop image data 420 corresponding to the image of the raindrop region 320, and the forward image data of the image corresponding to the front region 330. 430.

  FIG. 7 is a block diagram of a control system of vehicle 100 including internal circuit 240 of in-vehicle camera unit 200. The internal circuit 240 of the in-vehicle camera unit 200 includes an extraction unit 242, an imaging control unit 244, and a built-in processing device 250. The built-in processing device 250 includes a sky image data analysis unit 252, a raindrop image data analysis unit 254, and a transmission unit 256.

  The imaging control unit 244 outputs a shooting control signal toward the imaging unit 220. The imaging control signal instructs imaging conditions when the imaging unit 220 images the imaging area 300. That is, the imaging control unit 244 changes the sensitivity of the imaging element 222, the opening degree of the diaphragm device 226, and the like according to the luminance of the subject light beam incident on the imaging unit 220, for example. Thereby, the imaging unit 220 can convert the imaging region 300 into clear image data 400.

  Further, the imaging control unit 244 may change the imaging conditions of the imaging unit 220 for each frame of the image data 400, and the imaging control unit 244 may change the imaging conditions for each of a plurality of frames. Furthermore, the imaging control unit 244 may change the imaging conditions at unequal frame intervals.

  The extraction unit 242 acquires the image data 400 output by the imaging unit 220 by imaging the imaging region 300 as original image data, and extracts the forward image data 430, the sky image data 410, and the raindrop image data 420, respectively. The forward image data 430 is output to the outside through the image data communication path 262. As the image data communication path 262, for example, a MOST (Media Oriented Systems Transport) bus can be used.

  The sky image data 410 and the raindrop image data 420 extracted by the extraction unit 242 are each output to the built-in processing device 250. In the built-in processing device 250, the sky image data analysis unit 252 analyzes the sky image data 410 and outputs the analysis result as, for example, brightness data 251 in which the brightness of the environment in which the vehicle 100 is placed is digitized. In the built-in processing device 250, the raindrop image data analysis unit 254 analyzes the raindrop image data 420 and outputs the analysis result as, for example, rainfall data 253 in which the presence / absence of rainfall and the amount of rainfall are digitized.

  The transmission unit 256 converts the brightness data 251 output from the sky image data analysis unit 252 and the rain data 253 output from the raindrop image data analysis unit 254 into signal formats corresponding to predetermined communication procedures, respectively. Then, the data is output to the non-image data communication path 264.

  The digitized brightness data 251 has a smaller data capacity than the sky image data 410. The rainfall data 253 also has a smaller data capacity than the raindrop image data 420. Therefore, by transferring the brightness data 251 and the rain data 253, the data transfer amount can be suppressed and the information communication load on the vehicle 100 can be reduced.

  As the non-image data communication path 264, a CAN (Controller Area Network) bus or a LIN (Local Interconnect Network) bus can be used. Alternatively, a multi-channel CAN bus and LIN bus connected by a gateway and a hybrid network thereof may be used.

  FIG. 8 is a block diagram of the external processing device 270. The external processing device 270 is formed as a chip, module, or the like different from the internal circuit 240 and is coupled to the internal circuit 240 through the image data communication path 262 and the non-image data communication path 264.

  The external processing device 270 includes a front image data analysis unit 272, a lighting control unit 274, a wiper control unit 276, and the like. The front image data analysis unit 272, the lighting control unit 274, and the wiper control unit 276 are not necessarily integrated modules, and are individually coupled to the internal circuit 240 through the image data communication path 262 or the non-image data communication path 264. Sometimes it is.

  The front image data analysis unit 272 performs analysis on the front image data 430 received from the extraction unit 242 through the image data communication path 262. The front image data analysis unit 272 executes image processing for detecting, for example, a traveling lane, a preceding vehicle, a road obstacle, and the like from the front image data 430. Further, the front image data analysis unit 272 may detect the road surface temperature in front of the vehicle 100 by performing image analysis on the infrared band of the front image data 430 by image processing.

  Furthermore, the front image data analysis unit 272 performs brightness processing on the brightness data 251 and the rain output from the sky image data analysis unit 252 and the raindrop image data analysis unit 254 of the built-in processing device 250 when performing image processing on the front image data 430. Data 253 may be referred to. Thereby, the analysis accuracy of the front image data 430 by the front image data analysis unit 272 can be improved.

  The analysis result of the front image data analysis unit 272 may be referred to from another external processing device 270, for example, ABS (Antilock Break System), ESC (Electronic Stability Control), or the like. Thereby, the utilization range of the front image data 430 can further be expanded.

  In addition, when the image processing in the front image data analysis unit 272 is executed by the internal circuit 240 of the in-vehicle camera unit 200, the load on the processing device may increase and the processing speed may decrease. However, by entrusting at least part of the image processing to the external processing device 270, high-speed and high-precision processing can be performed, and the front image data 430 can be used more effectively as the entire vehicle 100.

  When the light control unit 274 refers to the brightness data 251 through the non-image data communication path 264, for example, the main light, the vehicle width light, the daytime light, and the like in the light unit 130 are appropriately turned on or off. In addition, the lighting control unit 274 refers to the rain data 253 and turns on or off the fog lamp in the light unit 130. Thereby, the lighting operation of the driver who drives the vehicle 100 can be reduced.

  Further, when the rain data 253 is referred to through the non-image data communication path 264, the wiper control unit 276 operates or stops the wiper 120, for example. Further, the wiper control unit 276 may change the operation speed of the wiper, such as increasing the operation speed of the wiper 120 when the rainfall amount increases. Thereby, the wiper operation of the driver who drives the vehicle 100 can be reduced.

  Further, the wiper control unit 276 refers to the brightness data 251 through the non-image data communication path 264. For example, when the sky is dark even though it is daytime, the wiper control unit 276 determines that it is cloudy or rainy and detects the rain data 253. Control such as shortening the interval may be executed. Thereby, when the rain starts from cloudy weather, the wiper 120 can be operated immediately.

  FIG. 9 is a schematic diagram illustrating processing in the extraction unit 242 of the internal circuit 240. The extraction unit 242 extracts the sky image data 410, the raindrop image data 420, and the forward image data 430 from the image data 400.

  In the illustrated example, the sky image data 410, the raindrop image data 420, and the forward image data 430 are extracted from different frames among the plurality of frames 1 to n of the image data 400. For example, the extraction unit 242 extracts the sky image data 410 from the frames 8 and 16 every 7 frames among the plurality of frames 1 to n forming the image data 400. Further, the extraction unit 242 extracts the raindrop image data 420 from the other frames 4 and 12 every other seven frames. The extraction unit 242 extracts the front image data 430 from the remaining frames.

  Here, focusing on one of the front image data 430, the extraction unit 242 extracts the front image data 430 by designating the address of the pixel corresponding to the front region 330 in the original image data. Therefore, the forward image data 430 does not include the sky image data 410 and the raindrop image data 420 output to the sky image data analysis unit 252 and the raindrop image data analysis unit 254 of the built-in processing device 250.

  Similarly, the sky image data 410 is extracted by designating the address of the pixel corresponding to the sky region 310, and does not include the forward image data 430 and the raindrop image data 420. Further, the raindrop image data 420 is extracted by designating an address of a pixel corresponding to the raindrop region 320, and does not include the forward image data 430 and the sky image data 410.

  Thus, the extraction destination of each frame in the image data 400 is determined in units of frames. Therefore, the imaging control unit 244 can optimize the imaging conditions of the imaging unit 220 in units of frames. Therefore, for example, a frame extracted as the front image data 430 can be imaged under an imaging condition suitable for the front area 330 in the imaging area 300.

  In the frame extracted by the extraction unit 242, the sky image data 410 and the raindrop image data 420 that are not necessarily suitable for the imaging conditions are discarded without being output to the external processing device 270. Accordingly, when the forward image data analysis unit 272 analyzes the extracted forward image data 430, the sky image data 410 and the raindrop image data 420 are not mixed, so that the analysis speed can be improved. Further, since unnecessary sky image data 410 and raindrop image data 420 are not included, the load on the capacity of the image data communication path 262 is also reduced.

  Similarly, the imaging control unit 244 executes imaging under an imaging condition optimal for imaging the sky region 310 when generating a frame extracted as the sky image data 410. Accordingly, the sky image data analysis unit 252 can analyze the brightness data 251 and the like from the high-quality sky image data 410 with high accuracy.

  Furthermore, the imaging control unit 244 executes imaging under an imaging condition optimal for imaging the raindrop region 320 when generating a frame extracted as the raindrop image data 420. For example, the sensitivity of the imaging unit 220 may be increased with respect to the emission wavelength of the light source 231 for the purpose of clearly capturing the raindrop region 320 formed by the light emitted from the light source 231. Thereby, the raindrop image data analysis unit 254 can analyze the brightness data 251 and the like from the high-quality raindrop image data 420 with high accuracy.

  FIG. 10 is a flowchart showing an operation procedure of the internal circuit 240 shown in FIG. When the vehicle 100 is activated and the in-vehicle camera unit 200 starts operating, the internal circuit 240 first sets the imaging condition of the imaging by the imaging unit 220 in the imaging unit 220 in the imaging control unit 244 (step S101). The imaging conditions set in this step are set according to the use of the frame that the imaging unit 220 captures next.

  When capturing a frame for the front image data 430, the imaging control unit 244 sets an imaging condition suitable for imaging the front region 330 in the imaging unit 220. For example, the imaging control unit 244 may set the sensitivity of the imaging element 222 of the imaging unit 220 to be high and reduce the opening of the aperture 226 of the front imaging optical system 224 to increase the depth of field of the imaging unit 220. Good. Thereby, a clear and focused image is captured in a wide area of the front area 330.

  Similarly, when imaging a frame for the sky image data 410, the imaging control unit 244 sets an imaging condition suitable for imaging the sky region 310 in the imaging unit 220. For example, in the daytime, the sky region 310 is often significantly brighter than the front region 330. Therefore, the imaging control unit 244 may reduce the imaging sensitivity of the imaging element 222 and close the aperture. The imaging control unit 244 can also adjust the brightness of the captured image data 400 by changing the charge accumulation time of the imaging element 222.

  When capturing a frame for the raindrop image data 420, the imaging control unit 244 sets an imaging condition suitable for imaging the raindrop region 320 in the imaging unit 220. For example, when the raindrop region 320 is imaged, the sensitivity of the imaging unit 220 may be reduced in areas other than the band of light emitted from the light source 231. Thereby, the contrast with respect to the raindrop area 320 is emphasized, and the influence of the background in the raindrop image data 420 can be suppressed.

  Note that when determining the imaging condition set by the imaging control unit 244, the image data 400 of another frame captured immediately before may be referred to. That is, in the case where overexposure occurs in the frame imaged immediately before, the exposure of the frame to be imaged from now on may be suppressed.

  When the imaging condition is set in the imaging unit 220 in the internal circuit 240, the imaging control unit 244 causes the imaging unit 220 to perform imaging of the imaging area 300 and generate the frame (step S102). In addition, the imaging control unit 244 notifies the extraction unit 242 which of the sky region 310, the raindrop region 320, and the front region 330 is used. The extraction unit 242 acquires the frame generated by the imaging unit 220 (step S103).

  The extraction unit 242 refers to the notification from the imaging control unit 244 and determines whether or not the currently acquired frame is for the front image data 430 (step S104). When the frame is for the front image data 430 (step S104: YES), the extraction unit 242 extracts the front image data 430 from the image data 400 (step S105).

  The extraction unit 242 outputs the front image data 430 to the outside of the internal circuit 240 through the image data communication path 262 (step S106). Note that the sky image data 410 and the raindrop image data 420 in the frame including the extracted front image data 430 are not used in the in-vehicle camera unit 200.

  In the previous step S104, when the frame acquired this time is not for the forward image data 430 (step S104: NO), the extraction unit 242 further determines whether or not the frame is for the sky image data 410 (step S104). S108). When the frame is for the sky image data 410 (step S108: YES), the extraction unit 242 extracts the sky image data 410 from the image data 400 (step S109).

  The extraction unit 242 outputs the extracted sky image data 410 to the built-in processing device 250, and the sky image data analysis unit 252 analyzes the sky image data 410 (step S110). The transmission unit 256 outputs the brightness data 251 obtained as a result of the analysis from the non-image data communication path 264 to the outside (step S111).

  The brightness data 251 output to the non-image data communication path 264 is referred to by, for example, the lighting control unit 274 and the wiper control unit 276 of the external processing device 270 as described above. The front image data 430 and the raindrop image data 420 in the frame including the extracted sky image data 410 are not used in the in-vehicle camera unit 200.

  In the previous step S108, when the currently acquired frame is not for the sky image data 410 (step S108: NO), the extraction unit 242 extracts the raindrop image data 420 assuming that the frame is for the raindrop image data 420 ( Step S112). Further, the extraction unit 242 outputs the raindrop image data 420 to the built-in processing device 250, and the raindrop image data analysis unit 254 analyzes the raindrop image data 420 (step S113).

  The transmission unit 256 outputs the rain data 253 obtained as a result of the analysis from the non-image data communication path 264 to the outside (step S114). The rain data 253 output to the non-image data communication path 264 is referred to by, for example, the lighting control unit 274 and the wiper control unit 276 of the external processing device 270 as described above. Note that the front image data 430 and the sky image data 410 included in the frame are not used in the in-vehicle camera unit 200.

  Subsequent to steps S106, S111, and S114, the extraction unit 242 determines whether there is an instruction to end the operation of the in-vehicle camera unit 200 (step S107). When an instruction to end the operation of the in-vehicle camera unit 200 is detected from an operation on the vehicle 100 such as stopping the prime mover (step S107: YES), the extraction unit 242 stops the operation of the entire in-vehicle camera unit 200. . If there is no instruction to end the operation (step S107: NO), the extraction unit 242 returns the operation procedure to step S101 and repeats the above operation.

  By repeating a series of procedures as described above, the internal circuit 240 continuously extracts the forward image data 430, the sky image data 410, and the raindrop image data 420, and the forward image data 430, the brightness data 251 and the rainfall. Data 253 is sequentially output.

  FIG. 11 is a schematic diagram for explaining another process in the extraction unit 242. In the illustrated example, the forward image data 430, the sky image data 410, and the raindrop image data 420 are extracted from each of the plurality of frames 1 to n forming the image data 400.

  That is, three of the front image data 430, the sky image data 410, and the raindrop image data 420 are extracted from one frame 1 or the like. Therefore, the front image data 430, the sky image data 410, and the raindrop image data 420 are acquired at the same high frame rate. In each of the front image data analysis unit 272, the sky image data analysis unit 252, and the raindrop image data analysis unit 254, Analysis with high temporal accuracy is possible.

  In this case, the imaging control unit 244 images the front area 330, the sky area 310, and the raindrop area 320 together under common imaging conditions. For this reason, the imaging conditions are not always optimal for all of the front area 330, the sky area 310, and the raindrop area 320.

  However, the forward image data analysis unit 272, the sky image data analysis unit 252 and the raindrop image data analysis unit 254 can compensate for an imaging condition deviating from the optimum condition by executing image processing in consideration of the imaging condition. For example, the contrast of the front image data 430 may be emphasized more than the contrast of the sky image data 410. Further, the saturation of the raindrop image data 420 may be intentionally lowered than the saturation of the front image data 430.

  In the internal circuit 240, the extraction unit 242 may switch between the process illustrated in FIG. 9 and the process illustrated in FIG. That is, it is known that it is daytime in time, and in the case of fine weather, as shown in FIG. 9, the interval for extracting the sky image data 410 and the raindrop image data 420 may be increased. Thereby, the time precision of the front image data 430 can be improved.

  If it is already known that it is raining, the extraction interval of the raindrop image data 420 may be narrowed as shown in FIG. Thereby, the control accuracy in the wiper control unit 276 can be improved.

  As described above, the extraction unit 242 in the internal circuit 240 outputs the image data 400 that is the original image data acquired from the imaging unit 220 to the sky image data analysis unit 252 and the raindrop image data analysis unit 254 of the built-in processing device 250. The front image data 430 that does not include the corrected portion is output to the external processing device 270. As a result, the communication load when the front image data 430 is output to the external processing device 270 can be reduced, and the accuracy of the analysis processing in the front image data analysis unit 272 of the external processing device 270 can be improved.

  FIG. 12 is a block diagram of another internal circuit 241. Elements common to the internal circuit 240 shown in FIG. 7 are assigned the same reference numerals, and redundant descriptions are omitted.

  In the internal circuit 241, the sky image data analysis unit 252, the raindrop image data analysis unit 254, and the transmission unit 256 are mounted together with the extraction unit 242 and the like. Such an internal circuit 241 can be manufactured as an integrated module, for example, as a SoC (System on Chip). Therefore, by integrating the internal circuit 241, the in-vehicle camera unit 200 can be downsized, the internal wiring can be shortened, the processing speed can be increased, and the reliability of the internal circuit 241 can be improved.

  FIG. 13 is a block diagram of another internal circuit 243. Elements common to the internal circuit 240 shown in FIG. 7 are assigned the same reference numerals, and redundant descriptions are omitted.

  The internal circuit 243 includes an extraction unit 242 and an imaging control unit 244. The internal circuit 243 includes an accessory processing device 258 arranged outside.

  The accessory processing device 258 includes a sky image data analysis unit 252, a raindrop image data analysis unit 254, and a transmission unit 256. The accessory processor 258 may be coupled to the internal circuit 243 through a dedicated line. Further, the accessory processing device 258 may be coupled to the internal circuit 243 through a MOST bus or the like. In any case, the accessory processing device 258 acquires the sky image data 410 and the raindrop image data 420 from the internal circuit 243 and analyzes them.

  With such a structure, the structure of the internal circuit 243 can be simplified, and the in-vehicle camera unit 200 can be reduced in size and cost. In addition, the functions and performances of the sky image data analysis unit 252 and the raindrop image data analysis unit 254 can be easily changed by replacing the accessory processing device 258.

  9, the extraction unit 242 outputs the front image data 430 to the outside from the image data communication path 262, but instead outputs the entire frame including the front image data 430 to the outside. May be. Similarly, also in the form of FIG. 11, the extraction unit 242 may output the entire frame including the front image data 430 to the outside.

  The present invention has been described above using the embodiment. However, the technical scope of the present invention is not limited to the scope described in the above embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, and method shown in the claims, the specification, and the drawings is particularly “before”, “prior”, etc. It should be noted that it can be implemented in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

DESCRIPTION OF SYMBOLS 100 Vehicle, 110 Windshield, 112 Room mirror, 114 Support part, 116 Antireflection layer, 120 Wiper, 130 Light unit, 200 Car-mounted camera unit, 210 Sky imaging optical system, 211 Light guide unit, 212 Entrance end, 214 Exit end 216 Cladding layer, 220 Imaging unit, 222 Imaging element, 224 Front imaging optical system, 226 Aperture device, 230 Raindrop imaging optical system, 231 Light source, 232 Prism, 233, 234, 235 Reflective mirror, 240, 241, 243 Internal circuit 242 Extraction unit, 244 Imaging control unit, 250 Built-in processing device, 251 Brightness data, 252 Sky image data analysis unit, 253 Rainfall data, 254 Raindrop image data analysis unit, 256 Transmitter, 258 Attached processing device, 262 Image data Through Communication path, 264 Non-image data communication path, 270 External processing device, 272 Image data analysis section, 274 Lighting control section, 276 Wiper control section, 300 Imaging area, 310 Sky area, 320 Raindrop area, 330 Front area, 400 Image data 410 Sky image data, 420 Raindrop image data, 430 Front image data

Claims (4)

An image sensor for imaging a subject;
An acquisition unit for acquiring image data generated by the imaging device;
With
An imaging apparatus in which an imaging condition for imaging image data of a partial area of the image data acquired by the acquisition unit is different from an imaging condition for imaging image data other than the partial area.   The imaging apparatus according to claim 1, wherein image data other than the partial area is output from the image data.   The imaging apparatus according to claim 1, wherein the imaging condition includes a setting of a diaphragm that adjusts an amount of light incident on the imaging element.   The imaging device according to any one of claims 1 to 3, further comprising an image processing unit that processes image data of a partial area of the image data.

Images