JP2013088591A - On-vehicle camera device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an on-vehicle camera device capable of simultaneously focusing on different areas of a photographed image.SOLUTION: An on-vehicle camera device includes: an imaging element 101 for photographing an image; and a lens portion having one or more lenses (a lens 102 and a lens 103 in the shown example) having different focuses in a plurality of stages in one direction of a vertical direction of an image photographed by the imaging element 101. The lens portion has two or more lenses (the lens 102 and the lens 103 in the shown example), and make a number of the lenses through which light from a photographic subject passes differ in each of the plurality of stages, thereby making focuses differ.

Description

  The present invention relates to an in-vehicle camera device.

The entire in-vehicle camera device or its imaging unit is attached to an upper part of an inner mirror or a windshield in order to capture (capture) an image of the front of a vehicle such as an automobile.
For example, processing for recognizing a white line on a road ahead, processing for recognizing a structure existing ahead, and the like are performed based on an image captured by an in-vehicle camera device.

For example, a solid-state image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) is used as an image sensor (image sensor) of such a vehicle-mounted camera device.
In addition, as a lens of an in-vehicle camera device, a lens having a single focus or a lens having a focus adjustment function is used, and is designed or adjusted so that an object for image recognition is uniformly imaged on an image sensor. The

  Conventionally, an optical system for a vehicle-mounted camera has been developed (for example, see Patent Document 1).

JP 2010-32813 A

However, when a lens having a single focal point is used in the in-vehicle camera device in the prior art, when the lens has a focal point in the vicinity, the lens is not focused in the distance, and conversely, the lens is focused in the distance. When it is held, the vicinity is not focused, and different areas (for example, near and far) of the captured image cannot be focused simultaneously.
Further, in the case of using a lens having a focus adjustment function in a vehicle-mounted camera device according to the prior art, when the lens is focused in the vicinity, the lens is not focused in the distance. Since focusing is not possible in the vicinity when focusing, different areas (for example, near and far) of the captured image cannot be focused simultaneously.

FIG. 12 is a block diagram illustrating a configuration of an imaging unit of a vehicle-mounted camera device.
The imaging unit of this in-vehicle camera device includes an imaging element 501 and a lens 502.
Then, the environment image in front of the vehicle is combined with the image of the environment on the image sensor 501 through the lens 502, and processing is performed based on the image captured by this. At this time, when the lens 502 is focused on the nearby component 601, the distant component 602 is not focused. Conversely, when the lens 502 is focused on the distant component 602, the neighboring component 601 is not focused. Lose focus.

  The present invention has been made in view of such circumstances, and provides an in-vehicle camera device that can simultaneously focus on different regions (for example, near and far) of a captured image. It is aimed.

  (1) In order to solve the above-described problem, an in-vehicle camera device according to the present invention has an imaging element that captures an image, and is focused at a plurality of stages in one direction in the vertical direction of the image captured by the imaging element. And a lens portion having one or more lenses that differ from each other.

  (2) According to the present invention, in the in-vehicle camera device according to (1), the lens unit includes two or more lenses, and a lens through which light from an imaging target passes at each of the plurality of stages. It is characterized by having different focus and different focus.

  (3) According to the present invention, in the in-vehicle camera device according to (1) or (2), the lens unit includes two or more lenses, and light from a subject to be photographed in each of the plurality of stages. It is characterized in that the focal point is different by changing the lens through which the lens passes.

  (4) According to the present invention, in the in-vehicle camera device according to (1), the lens unit includes a single lens that is provided with a step in each of the plurality of stages to change the focus. To do.

  (5) In the vehicle-mounted camera device according to any one of (1) to (4), the present invention provides an upper half region of an image photographed by the imaging element as the plurality of stages. And the step of the lower half region are used.

  (6) The present invention provides the vehicle-mounted camera device according to any one of (1) to (5), and further, for each region corresponding to each of the plurality of stages in an image photographed by the image sensor. And an image processing unit that performs different predetermined image processing.

  As described above, according to the present invention, it is possible to provide a vehicle-mounted camera device that can simultaneously focus on different regions (for example, near and far) of a captured image.

It is a block diagram which shows the structure of the vehicle-mounted camera apparatus which concerns on embodiment of this invention. It is a block diagram which shows the structure of the imaging part of the vehicle-mounted camera apparatus which concerns on 1st Embodiment of this invention. It is a figure which shows an example of the image image | photographed with the vehicle-mounted camera apparatus which concerns on embodiment of this invention. It is a block diagram which shows the structure of the imaging part of the vehicle-mounted camera apparatus which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the structure of the imaging part of the vehicle-mounted camera apparatus which concerns on 3rd Embodiment of this invention. It is a block diagram which shows the structure of the imaging part of the vehicle-mounted camera apparatus which concerns on 4th Embodiment of this invention. It is a block diagram which shows the structure of the imaging part of the vehicle-mounted camera apparatus which concerns on 5th Embodiment of this invention. It is a block diagram which shows the structure of the imaging part of the vehicle-mounted camera apparatus which concerns on 6th Embodiment of this invention. It is a block diagram which shows the structure of the imaging part of the vehicle-mounted camera apparatus which concerns on 7th Embodiment of this invention. It is a block diagram which shows the structure of the imaging part of the vehicle-mounted camera apparatus which concerns on 8th Embodiment of this invention. It is a block diagram which shows the structure of the imaging part of the vehicle-mounted camera apparatus which concerns on 9th Embodiment of this invention. It is a block diagram which shows the structure of the imaging part of the vehicle-mounted camera apparatus.

[First Embodiment]
FIG. 1 is a block diagram illustrating a configuration of an in-vehicle camera device 1 according to an embodiment of the present invention.
The in-vehicle camera device 1 according to the present embodiment includes an imaging unit 11, a storage unit 12, and a control unit 13.
The imaging unit 11 includes an imaging element unit 21 and a lens unit 22.
The storage unit 12 includes an image storage unit 31.
The control unit 13 includes an image processing unit 41.

Here, in this embodiment, although the structure which equips the vehicle-mounted camera apparatus 1 with the memory | storage part 12 and the control part 13 other than the imaging part 11 is provided with the imaging part 11 as another structural example, although the memory | storage part 12 or It is also possible to implement an in-vehicle camera device that does not include the control unit 13. In this other configuration example, an in-vehicle camera device including the imaging unit 11 and another device including the storage unit 12 and the control unit 13 (one device may be used, or two or more devices may be used. The vehicle-mounted camera system is configured.
Various other configurations may be used as the in-vehicle camera device.

In addition, the entire in-vehicle camera device 1 according to the present embodiment or its imaging unit 11 is attached to an upper part of an inner mirror or a windshield in order to take an image of the front of a vehicle such as an automobile.
In addition, the memory | storage part 12 and the control part 13 may be provided in the place away from the imaging part 11, for example in the vehicle.

An example of a schematic operation performed in the in-vehicle camera device 1 according to the present embodiment is shown.
The imaging unit 11 combines an image of the environment on the imaging device of the imaging device unit 21 through the lens of the lens unit 22 with respect to the environment ahead of the vehicle, and captures the image.
Note that the image to be captured may be a still image or a moving image, for example.

The storage unit 12 stores data of an image captured by the imaging unit 11 using the image storage unit 31.
In addition, the storage unit 12 may store various information other than image data, such as a template used in image processing, determination conditions, parameters, and the like.

  The control unit 13 performs predetermined image processing by the image processing unit 41 on image data (for example, image data stored in the image storage unit 31) captured by the imaging unit 11. Examples of the image processing include processing for recognizing a white line on a road ahead of the vehicle and processing for recognizing a structure existing in front of the vehicle.

The control unit 13 may perform various processes other than image processing.
As a specific example, the control unit 13 performs various control processes in the vehicle based on the result of the image processing performed by the image processing unit 41.
As a specific example, the control unit 13 may perform control processing (for example, focus adjustment processing) on the lens of the lens unit 22 such as moving the lens of the lens unit 22.

Next, the configuration of the imaging unit 11 in the in-vehicle camera device 1 according to the present embodiment will be described.
FIG. 2 is a block diagram illustrating a configuration of the imaging unit 11 of the in-vehicle camera device 1 according to the first embodiment of the present invention.
In the imaging unit 11 according to the present embodiment, the imaging device unit 21 includes the imaging device 101, and the lens unit 22 includes a far lens 102 and a nearby focus adjustment lens 103.

Also, the nearby component 201 and the distant component 202 shown in FIG. 2 are relatively distant from the vehicle in the direction in which an image is captured by the image sensor 101 (in the present embodiment, the direction in front of the vehicle). It represents what is in the vicinity and what is in the distance.
In the present embodiment, it is assumed that the nearby constituent 201 appears in the lower half area of the image to be photographed, and the distant constituent 202 appears in the upper half area of the image to be photographed.
In the present embodiment, the upper and lower sides of the captured image are reversed on the image sensor 101 shown in FIG.

The far lens 102 is configured so as to be in focus when a far object (for example, the far constituent 202) is photographed by the image sensor 101, and the lens is arranged. In the present embodiment, as shown in FIG. 2, a lens having a normal shape (in this embodiment, a biconvex lens) is used as the far-end lens 102.
Specifically, the distant component 202 is imaged by the image sensor 101 in a focused state through only the distant lens 102.

  The lens 103 for adjusting the focus in the vicinity is combined with the lens 102 for the distant so that the lens is in focus so as to be in focus when the image of the vicinity (for example, the adjacent component 201) is photographed by the image sensor 101. The lens is arranged. In the present embodiment, as the focusing lens 103 in the vicinity, as shown in FIG. 2, only the lower half of the lens is used as compared with a lens having a normal shape (biconvex lens in this embodiment). Used.

In the present embodiment, the near focus adjustment lens 103 is arranged in the lower part of the front of the distant lens 102 and adjusts (adjusts) the near focus.
Specifically, the nearby component 201 is photographed by the image sensor 101 in a focused state via the nearby focus adjustment lens 103 and the far-field lens 102.

  Note that the position of the distant lens 102 and the position of the neighboring focus adjusting lens 103 may be fixed, for example, or the position of the distant lens 102 and the neighboring focusing lens. A configuration in which one or both of the positions 103 can be changed by the control unit 13 and the focus can be adjusted may be used.

  As described above, the vehicle-mounted camera device 1 according to the present embodiment can simultaneously focus on different regions of the captured image (in the present embodiment, near and far). Thereby, for example, in the image sensing technology by the in-vehicle camera device 1 mounted in the vehicle interior or the like, the recognition rate for the object can be improved.

  As a specific example, the in-vehicle camera device 1 according to the present embodiment can capture an image focused on both near and far, so that an image focused on the entire region of the captured image is captured. It is possible to improve the recognition rate in lane recognition (for example, white line recognition) and obstacle detection (for example, structure recognition).

  In the present embodiment, in the case where the focus is varied at a plurality of stages (two stages in the present embodiment) in one direction in the vertical direction of an image captured by the image sensor 101, In the embodiment, the number of lenses (lenses 102 and 103 in the present embodiment) through which light from the components 201 and 202 passes is made different, and the focal points are made different.

FIG. 3 is a diagram illustrating an example of an image captured by the in-vehicle camera device 1 according to the embodiment of the present invention.
In this image (photographed image) 301, the lower half area 311 of the image 301 is focused in the vicinity, and the upper half area 312 of the image 301 is focused in the distance.

Usually, in an image photographed by the in-vehicle camera device 1, a nearby object is reflected on the lower side, such as an image of a road or other vehicle or landscape seen in front of the vehicle, and a distant object is located on the upper side. Things are reflected.
Therefore, as in the present embodiment, it is effective to focus on the vicinity of the lower half area of the image and focus on the far area of the upper half area of the image.

  Here, in the present embodiment, the focusing distance is varied for the lower half area and the upper half area of the captured image, but the ratio of the lower area and the upper area that vary the focusing distance is as follows. , Not necessarily 1: 1, but other ratios may be used.

Next, image processing performed by the image processing unit 41 will be described.
In the present embodiment, the image processing unit 41 performs different image processing (for example, image processing with different purposes) for each region in the captured image with different focus distances. The content of the image processing performed for each region is determined in advance in the image processing unit 41, for example.
Specifically, as in the present embodiment, when the lower region of the image is focused in the vicinity, and the upper region of the image is focused in the distance, for example, the lower region of the image Performs image processing for recognizing white lines or characters written on the road surface. In the upper area of the image, image processing for recognizing obstacles, image processing for recognizing signs, and whether the weather is bright Alternatively, image processing for recognizing whether the image is dark is performed.

  In addition, as a white line or a character etc. which were written on the road surface, the white line showing a lane, the white line showing an intersection, the character showing the speed limit (for example, 60 km) of a road, etc. can be used, for example.

Further, for example, the control unit 13 may perform control processing on the vehicle based on the result of such image processing.
As a specific example, the control unit 13 has a function of controlling the steering wheel (traveling direction) based on the recognition result of the lane, a function of controlling the accelerator and brake (traveling speed) based on the value of the road speed limit, A function of controlling the brake (avoidance of collision with an obstacle) based on the recognition result of the object and a function of controlling the wiper to operate when the weather is dark based on the weather recognition result may be provided.

In the in-vehicle camera device 1 according to the present embodiment, for each region in a captured image with different distances to be focused, different images for each region in a state where the respective regions are in focus at the same time. Processing (for example, image processing with different purposes) can be performed simultaneously.
Specifically, as in this embodiment, the lower region of the image is focused in the vicinity, and the upper region of the image is focused in the distance, thereby performing image processing on the lower region of the image. And other image processing on the upper region of the image can be executed simultaneously.

  Here, in the present embodiment, the configuration in which the focusing distances are different for the two vertical regions (the upper region and the lower region) in the captured image has been described. It is also possible to use a configuration in which the focusing distance is changed for three or more regions in the vertical direction. In such a configuration, the lower region is focused closer and the upper region is focused farther.

[Second Embodiment]
The schematic configuration and operation of the in-vehicle camera device 1 according to the present embodiment are the same as those shown in FIG.
For this reason, this embodiment will be described with reference to FIG.
Hereinafter, the imaging unit 11 having a configuration different from that of the first embodiment will be described in detail. Note that the description of the same points as in the first embodiment is omitted or simplified.

A configuration of the imaging unit 11 in the in-vehicle camera device 1 according to the present embodiment will be described.
FIG. 4 is a block diagram illustrating a configuration of the imaging unit 11 of the in-vehicle camera device 1 according to the second embodiment of the present invention.
In the imaging unit 11 according to the present embodiment, the imaging device unit 21 includes an imaging device 111, and the lens unit 22 includes a near lens 112 and a far focus adjustment lens 113.

Also, the nearby component 211 and the distant component 212 shown in FIG. 4 are relatively distant from the vehicle in the direction in which an image is captured by the image sensor 111 (in the present embodiment, the direction in front of the vehicle). It represents what is in the vicinity and what is in the distance.
In this embodiment, it is assumed that the nearby component 211 appears in the lower half area of the image to be photographed, and the distant composition 212 appears in the upper half area of the image to be photographed.
In the present embodiment, the upper and lower sides of the captured image are reversed on the image sensor 111 shown in FIG.

The lens 112 for the vicinity is configured so as to be in focus when a nearby object (for example, the nearby component 211) is photographed by the image sensor 111, and the lens is disposed. In the present embodiment, as the lens 112 for the vicinity, as shown in FIG. 4, a lens having a normal shape (in this embodiment, a biconvex lens) is used.
Specifically, the nearby component 211 is photographed by the image sensor 111 in a focused state only through the nearby lens 112.

  The far focus lens 113 is combined with the near lens 112 so that the far lens (for example, the far component 212) is focused when the image sensor 111 is used to focus the far lens. The lens is arranged. In the present embodiment, as shown in FIG. 4, only the upper half of the lens is used as the far-focusing lens 113 as shown in FIG. 4, compared to a lens having a normal shape (in this embodiment, a biconvex lens). ing.

In this embodiment, the far focus adjustment lens 113 is disposed in the upper part in front of the near lens 112 and adjusts (adjusts) the far focus.
Specifically, the distant component 212 is photographed by the image sensor 111 in a focused state through the distant focus adjustment lens 113 and the near lens 112.

  The position of the near lens 112 and the position of the far focus adjusting lens 113 may be fixed, for example, or the position of the near lens 112 and the far focus adjusting lens. A configuration in which one or both of the positions 113 can be changed by the control unit 13 and the focus can be adjusted may be used.

  As described above, the vehicle-mounted camera device 1 according to the present embodiment can simultaneously focus on different regions of the captured image (in the present embodiment, near and far). Thereby, for example, in the image sensing technology by the in-vehicle camera device 1 mounted in the vehicle interior or the like, the recognition rate for the object can be improved.

  As a specific example, the in-vehicle camera device 1 according to the present embodiment can capture an image focused on both near and far, so that an image focused on the entire region of the captured image is captured. It is possible to improve the recognition rate in lane recognition (for example, white line recognition) and obstacle detection (for example, structure recognition).

  In the present embodiment, when the focus is varied at a plurality of stages (two stages in the present embodiment) in one direction in the vertical direction of an image photographed by the image sensor 111, the object to be photographed (the book) at each of the plurality of stages. In the embodiment, the number of lenses (lenses 112 and 113 in the present embodiment) through which light from the components 211 and 212) passes is made different, and the focal points are made different.

[Third Embodiment]
The schematic configuration and operation of the in-vehicle camera device 1 according to the present embodiment are the same as those shown in FIG.
For this reason, this embodiment will be described with reference to FIG.
Hereinafter, the imaging unit 11 having a configuration different from that of the first embodiment will be described in detail. Note that the description of the same points as in the first embodiment is omitted or simplified.

A configuration of the imaging unit 11 in the in-vehicle camera device 1 according to the present embodiment will be described.
FIG. 5 is a block diagram illustrating a configuration of the imaging unit 11 of the in-vehicle camera device 1 according to the third embodiment of the present invention.
In the imaging unit 11 according to the present embodiment, the imaging device unit 21 includes an imaging device 121, and the lens unit 22 includes a far-field lens 122 and a nearby focusing lens 123.

Further, the nearby component 221 and the distant component 222 shown in FIG. 5 are relatively distant from the vehicle in the direction in which an image is captured by the image sensor 121 (in the present embodiment, the direction in front of the vehicle). It represents what is in the vicinity and what is in the distance.
In the present embodiment, it is assumed that the nearby component 221 appears in the lower half region of the image to be photographed, and the distant component 222 appears in the upper half region of the image to be photographed.
In the present embodiment, the upper and lower sides of the captured image are reversed on the image sensor 121 shown in FIG.

The far lens 122 is configured so as to be in focus when a far object (for example, a far constituent 222) is photographed by the image sensor 121, and the lens is arranged. In the present embodiment, as shown in FIG. 5, a lens having a normal shape (in this embodiment, a biconvex lens) is used as the far lens 122.
Specifically, the distant component 222 is photographed by the image sensor 121 in a focused state only through the distant lens 122.

  The lens 123 for adjusting the focus in the vicinity is combined with the lens 122 for the distant, and the lens is adjusted so that it is in focus when the image of the vicinity (for example, the component 221 in the vicinity) is photographed by the image sensor 121. The lens is arranged. In the present embodiment, as the focus adjusting lens 123 in the vicinity, as shown in FIG. 5, only the upper half of the lens is used as compared with a normal lens (in this embodiment, a biconvex lens). ing.

In the present embodiment, the near focus adjustment lens 123 is disposed in front of the image sensor 121 (behind the distant lens 122) (portion for photographing the near side), and adjusts the near focus. (adjust.
Specifically, the nearby component 221 is photographed by the image sensor 121 in a focused state via the far lens 122 and the nearby focus adjusting lens 123.

  The position of the distant lens 122 and the position of the nearby focus adjusting lens 123 may be fixed, for example, or the position of the distant lens 122 and the nearby focus adjusting lens. A configuration in which one or both of the positions 123 can be changed by the control unit 13 and the focus can be adjusted may be used.

  As described above, the vehicle-mounted camera device 1 according to the present embodiment can simultaneously focus on different regions of the captured image (in the present embodiment, near and far). Thereby, for example, in the image sensing technology by the in-vehicle camera device 1 mounted in the vehicle interior or the like, the recognition rate for the object can be improved.

  As a specific example, the in-vehicle camera device 1 according to the present embodiment can capture an image focused on both near and far, so that an image focused on the entire region of the captured image is captured. It is possible to improve the recognition rate in lane recognition (for example, white line recognition) and obstacle detection (for example, structure recognition).

  In the present embodiment, when the focus is varied in a plurality of stages (two stages in the present embodiment) in one direction in the vertical direction of an image photographed by the image sensor 121, the object to be photographed (the book) in each of the plurality of stages. In the embodiment, the number of lenses (lenses 122 and 123 in the present embodiment) through which light from the components 221 and 222) passes is varied to make the focal point different.

[Fourth Embodiment]
The schematic configuration and operation of the in-vehicle camera device 1 according to the present embodiment are the same as those shown in FIG.
For this reason, this embodiment will be described with reference to FIG.
Hereinafter, the imaging unit 11 having a configuration different from that of the first embodiment will be described in detail. Note that the description of the same points as in the first embodiment is omitted or simplified.

A configuration of the imaging unit 11 in the in-vehicle camera device 1 according to the present embodiment will be described.
FIG. 6 is a block diagram illustrating a configuration of the imaging unit 11 of the in-vehicle camera device 1 according to the fourth embodiment of the present invention.
In the imaging unit 11 according to the present embodiment, the imaging device unit 21 includes an imaging device 131, and the lens unit 22 includes a near lens 132 and a far focus adjustment lens 133.

In addition, the nearby component 231 and the distant component 232 illustrated in FIG. 6 are relatively distant from the vehicle in the direction in which an image is captured by the imaging element 131 (in the present embodiment, the direction in front of the vehicle). It represents what is in the vicinity and what is in the distance.
In the present embodiment, it is assumed that the nearby constituent 231 appears in the lower half area of the image to be photographed, and the distant constituent 232 appears in the upper half area of the image to be photographed.
In the present embodiment, on the image sensor 131 shown in FIG.

The lens 132 for the vicinity is configured so as to be in focus when a nearby object (for example, the nearby component 231) is photographed by the image sensor 131, and the lens is disposed. In the present embodiment, as the lens 132 for the vicinity, as shown in FIG. 6, a lens having a normal shape (in this embodiment, a biconvex lens) is used.
Specifically, the nearby component 231 is photographed by the imaging device 131 in a focused state only through the nearby lens 132.

  The distant focus adjustment lens 133 is combined with the near lens 132 so that the far focus (for example, the distant component 232) is photographed by the image sensor 131 so that the lens is in focus. The lens is arranged. In this embodiment, as a far-focus lens 133 for focusing, as shown in FIG. 6, only the lower half of the lens is used in comparison with a normal lens (biconvex lens in this embodiment). Used.

In the present embodiment, the far-focus lens 133 is disposed in front of the image sensor 131 (behind the lens 132 for the vicinity) and the lower part (portion for photographing the far side), and adjusts the far focus. (adjust.
Specifically, the distant component 232 is photographed by the image sensor 131 in a focused state via the near lens 132 and the distant focus adjustment lens 133.

  The position of the near lens 132 and the position of the far focus adjusting lens 133 may be fixed, for example, or the position of the near lens 132 and the far focus adjusting lens. A configuration in which one or both of the positions 133 can be changed by the control unit 13 and the focus can be adjusted may be used.

  As described above, the vehicle-mounted camera device 1 according to the present embodiment can simultaneously focus on different regions of the captured image (in the present embodiment, near and far). Thereby, for example, in the image sensing technology by the in-vehicle camera device 1 mounted in the vehicle interior or the like, the recognition rate for the object can be improved.

  As a specific example, the in-vehicle camera device 1 according to the present embodiment can capture an image focused on both near and far, so that an image focused on the entire region of the captured image is captured. It is possible to improve the recognition rate in lane recognition (for example, white line recognition) and obstacle detection (for example, structure recognition).

  In the present embodiment, when the focus is varied in a plurality of stages (two stages in the present embodiment) in one direction in the vertical direction of an image photographed by the image sensor 131, the object to be photographed (the book in each of the plurality of stages). In the embodiment, the number of lenses (lenses 132 and 133 in the present embodiment) through which light from the components 231 and 232 passes is made to be different.

[Fifth Embodiment]
The schematic configuration and operation of the in-vehicle camera device 1 according to the present embodiment are the same as those shown in FIG.
For this reason, this embodiment will be described with reference to FIG.
Hereinafter, the imaging unit 11 having a configuration different from that of the first embodiment will be described in detail. Note that the description of the same points as in the first embodiment is omitted or simplified.

A configuration of the imaging unit 11 in the in-vehicle camera device 1 according to the present embodiment will be described.
FIG. 7 is a block diagram illustrating a configuration of the imaging unit 11 of the in-vehicle camera device 1 according to the fifth embodiment of the present invention.
In the imaging unit 11 according to the present embodiment, the imaging device unit 21 includes an imaging device 141, and the lens unit 22 includes a lens 142 corresponding to both near and far.

In addition, the nearby component 241 and the distant component 242 shown in FIG. 7 are relatively distant from the vehicle in the direction in which an image is captured by the image sensor 141 (in the present embodiment, the direction in front of the vehicle). It represents what is in the vicinity and what is in the distance.
In the present embodiment, it is assumed that the nearby component 241 appears in the lower half region of the image to be photographed, and the distant component 242 appears in the upper half region of the image to be photographed.
In the present embodiment, the upper and lower sides of the captured image are reversed on the image sensor 141 shown in FIG.

  The lens 142 corresponding to both near and far is a lens (a biconvex lens with a step in this embodiment) whose shape is different in the top and bottom (in this embodiment, the upper half and the lower half), The focal point is different between the near side where the lower side of the lens 142 is used and the far side where the upper side of the lens 142 is used.

The lower side of the lens 142 is configured such that the lens portion is configured to be focused when a nearby object (for example, a nearby component 241) is photographed by the image sensor 141, and the lens 142 is disposed. ing.
Specifically, the nearby component 241 is photographed by the image sensor 141 in a focused state via the lower side of the lens 142.

In addition, the upper side of the lens 142 is configured such that the lens portion is in focus when a far object (for example, a distant component 242) is photographed by the image sensor 141, and the lens 142 is disposed. Has been.
Specifically, the distant component 242 is photographed by the image sensor 141 in a focused state via the upper side of the lens 142.

Note that the position of the lens 142 may be fixed, for example, or may be changed by the control unit 13 so that the focus can be adjusted.
In this embodiment, the shape of the lens 142 is such that the upper thickness is thinner than the lower thickness, but various other shapes may be used.

  As described above, the vehicle-mounted camera device 1 according to the present embodiment can simultaneously focus on different regions of the captured image (in the present embodiment, near and far). Thereby, for example, in the image sensing technology by the in-vehicle camera device 1 mounted in the vehicle interior or the like, the recognition rate for the object can be improved.

  As a specific example, the in-vehicle camera device 1 according to the present embodiment can capture an image focused on both near and far, so that an image focused on the entire region of the captured image is captured. It is possible to improve the recognition rate in lane recognition (for example, white line recognition) and obstacle detection (for example, structure recognition).

  In the present embodiment, when the focus is varied at a plurality of stages (two stages in the present embodiment) in one direction in the vertical direction of an image photographed by the image sensor 141, the object to be photographed (the book) at each of the plurality of stages. In the embodiment, a step is provided in the portion of the lens 142 through which the light from the components 241 and 242) passes to make the focus different.

[Sixth Embodiment]
The schematic configuration and operation of the in-vehicle camera device 1 according to the present embodiment are the same as those shown in FIG.
For this reason, this embodiment will be described with reference to FIG.
Hereinafter, the imaging unit 11 having a configuration different from that of the first embodiment will be described in detail. Note that the description of the same points as in the first embodiment is omitted or simplified.

A configuration of the imaging unit 11 in the in-vehicle camera device 1 according to the present embodiment will be described.
FIG. 8 is a block diagram illustrating a configuration of the imaging unit 11 of the in-vehicle camera device 1 according to the sixth embodiment of the present invention.
In the imaging unit 11 according to the present embodiment, the imaging device unit 21 includes an imaging device 151, and the lens unit 22 includes a near lens 152 and a far lens 153.

Further, the nearby component 251 and the distant component 252 shown in FIG. 8 are relatively distant from the vehicle in the direction in which an image is captured by the imaging element 151 (in the present embodiment, the direction in front of the vehicle). It represents what is in the vicinity and what is in the distance.
In the present embodiment, it is assumed that the nearby constituent 251 appears in the lower half area of the image to be photographed, and the distant constituent 252 appears in the upper half area of the image to be photographed.
In the present embodiment, the top and bottom of the captured image are reversed on the image sensor 151 shown in FIG.

The near lens 152 is configured so that it is in focus when a nearby object (for example, a nearby component 251) is photographed by the image sensor 151, and the lens is disposed. In this embodiment, as the lens 152 for the vicinity, as shown in FIG. 8, only the lower half of the lens is used as compared with a normal lens (biconvex lens in this embodiment). .
Specifically, the nearby component 251 is photographed by the imaging device 151 in a focused state only through the nearby lens 152.

The far lens 153 is configured so as to be in focus when a far object (for example, the far constituent 252) is photographed by the image sensor 151, and the lens is arranged. In the present embodiment, as shown in FIG. 8, only the upper half of the lens is used as the far lens 153 as compared with a lens having a normal shape (biconvex lens in the present embodiment).
Specifically, the distant component 252 is photographed by the image sensor 151 in a focused state only through the far lens 153.

  The position of the near lens 152 and the position of the far lens 153 may be fixed, for example, or the position of the near lens 152 and the position of the far lens 153 A configuration in which one or both can be changed by the control unit 13 and the focus can be adjusted may be used.

  As described above, the vehicle-mounted camera device 1 according to the present embodiment can simultaneously focus on different regions of the captured image (in the present embodiment, near and far). Thereby, for example, in the image sensing technology by the in-vehicle camera device 1 mounted in the vehicle interior or the like, the recognition rate for the object can be improved.

  As a specific example, the in-vehicle camera device 1 according to the present embodiment can capture an image focused on both near and far, so that an image focused on the entire region of the captured image is captured. It is possible to improve the recognition rate in lane recognition (for example, white line recognition) and obstacle detection (for example, structure recognition).

  In the present embodiment, when the focus is varied at a plurality of stages (two stages in the present embodiment) in one direction in the vertical direction of an image photographed by the image sensor 151, the object to be photographed (the book) at each of the plurality of stages. In the embodiment, the lenses (lenses 152 and 153 in the present embodiment) through which the light from the components 251 and 252) pass are made different in focus.

[Seventh Embodiment]
The schematic configuration and operation of the in-vehicle camera device 1 according to the present embodiment are the same as those shown in FIG.
For this reason, this embodiment will be described with reference to FIG.
Hereinafter, the imaging unit 11 having a configuration different from that of the first embodiment will be described in detail. Note that the description of the same points as in the first embodiment is omitted or simplified.

A configuration of the imaging unit 11 in the in-vehicle camera device 1 according to the present embodiment will be described.
FIG. 9 is a block diagram illustrating a configuration of the imaging unit 11 of the in-vehicle camera device 1 according to the seventh embodiment of the present invention.
In the imaging unit 11 according to the present embodiment, the imaging device unit 21 includes an imaging device 161, and the lens unit 22 includes a lens 162 for the vicinity, a lens 163 for focus adjustment at a medium distance, and a distant lens 162. And a lens 164 for focus adjustment.

Further, the nearby component 261, the medium-distance component 262, and the distant component 263 shown in FIG. 9 are each in a direction in which an image is captured by the image sensor 161 (in the present embodiment, in the forward direction of the vehicle). Relatively, those that are present in the vicinity of the vehicle, those that are present at a medium distance, and those that are located far away from the vehicle are represented.
In the present embodiment, it is assumed that the nearby component 261 appears in the lower third region of the image to be photographed, and the medium distance component 262 appears in the middle third region of the image to be photographed. It is assumed that the distant component 263 appears in the upper third region of the photographed image.
In the present embodiment, the upper and lower sides of the captured image are reversed on the image sensor 161 shown in FIG.

The lens 162 for the vicinity is configured so as to be in focus when a nearby object (for example, the nearby component 261) is photographed by the image sensor 161, and the lens is disposed. In the present embodiment, as the lens 162 for the vicinity, as shown in FIG. 9, a lens having a normal shape (in this embodiment, a biconvex lens) is used.
Specifically, the nearby component 261 is photographed by the imaging device 161 in a focused state only through the nearby lens 162.

  The mid-range focus adjustment lens 163 is combined with the near-field lens 162 so that a medium-distance object (for example, a medium-distance component 262) is photographed with the image sensor 161 so that it is in focus. The lens is configured, and the lens is arranged. In this embodiment, as shown in FIG. 9, as a focus adjusting lens 163 at a medium distance, only 1/3 of the central portion is compared with a normal-shaped lens (biconvex lens in this embodiment). This lens is used.

In the present embodiment, the mid-range focus adjustment lens 163 is disposed in the center of the front of the proximity lens 162 and adjusts (adjusts) the mid-range focus.
Specifically, the medium-distance component 262 is photographed by the imaging element 161 in a focused state via the medium-distance focus adjustment lens 163 and the vicinity lens 162.

  The far-focus lens 164 is combined with the near-lens 162 so that the far-field object (for example, the far-off component 263) is focused when the image sensor 161 is photographed. The lens is arranged. In the present embodiment, as shown in FIG. 9, the far-focus lens 164 for adjusting the distance is only 1/3 of the upper portion as compared with a normal lens (biconvex lens in the present embodiment). A lens is used.

In the present embodiment, the far focus adjustment lens 164 is disposed in front of the near lens 162 and adjusts (adjusts) the far focus.
Specifically, the distant component 263 is photographed by the image sensor 161 in a focused state via the distant focus adjustment lens 164 and the near lens 162.

  It should be noted that the position of the lens 162 for the vicinity, the position of the lens 163 for focus adjustment at a medium distance, and the position of the lens 164 for focus adjustment at a distance may be fixed, for example. It is possible to adjust the focus by changing one or more of the position of the lens 162, the position of the medium-range focus adjustment lens 163, and the position of the remote focus adjustment lens 164 by the control unit 13. Various configurations may be used.

  As described above, the vehicle-mounted camera device 1 according to the present embodiment can simultaneously focus on different regions of the captured image (in the present embodiment, near, middle, and far). Thereby, for example, in the image sensing technology by the in-vehicle camera device 1 mounted in the vehicle interior or the like, the recognition rate for the object can be improved.

  As a specific example, the in-vehicle camera device 1 according to the present embodiment can shoot an image in which all of the vicinity, the middle distance, and the distance are in focus, so the entire area of the captured image is in focus. An image can be taken, and the recognition rate in lane recognition (for example, white line recognition) and obstacle detection (for example, structure recognition) can be improved.

  For example, the image processing unit 41 performs different image processing (for example, for each of an upper area (distant area), a central area (medium distance area), and a lower area (near area) of the captured image. , Image processing for different purposes). For the central area (intermediate distance area) of the captured image, for example, image processing for recognizing an obstacle is performed.

  In the present embodiment, the focusing distance is different for the upper 1/3 area, the central 1/3 area, and the lower 1/3 area of the captured image, but the focusing distance is different. The ratio of the upper region, the central region, and the lower region that are different from each other is not necessarily 1: 1: 1, and other ratios may be used.

  In the present embodiment, when the focus is varied at a plurality of stages (three stages in the present embodiment) in one direction in the vertical direction of an image photographed by the image sensor 161, the object to be photographed (the book) at each of the plurality of stages. In the embodiment, the focal points are made different by changing the number of lenses (lenses 162, 163, and 164 in this embodiment) through which light from the components 261, 262, and 263) passes.

[Eighth Embodiment]
The schematic configuration and operation of the in-vehicle camera device 1 according to the present embodiment are the same as those shown in FIG.
For this reason, this embodiment will be described with reference to FIG.
Hereinafter, the imaging unit 11 having a configuration different from that of the first embodiment will be described in detail. Note that the description of the same points as in the first embodiment is omitted or simplified.

A configuration of the imaging unit 11 in the in-vehicle camera device 1 according to the present embodiment will be described.
FIG. 10 is a block diagram showing the configuration of the imaging unit 11 of the in-vehicle camera device 1 according to the eighth embodiment of the present invention.
In the imaging unit 11 according to the present embodiment, the imaging device unit 21 includes an imaging device 171, and the lens unit 22 includes a near lens 172, a far focus adjustment lens 173, and an intermediate distance lens. And a lens 174 for focus adjustment.

Further, the nearby component 271, the medium-distance component 272, and the distant component 273 shown in FIG. 10 are each in a direction in which an image is captured by the image sensor 171 (in the present embodiment, in the forward direction of the vehicle). Relatively, those that are present in the vicinity of the vehicle, those that are present at a medium distance, and those that are located far away from the vehicle are represented.
In the present embodiment, it is assumed that the nearby component 271 appears in the lower third region of the image to be photographed, and the medium distance component 272 appears in the middle third region of the image to be photographed. It is assumed that the distant component 273 appears in the upper third region of the image to be photographed.
In the present embodiment, the upper and lower sides of the captured image are reversed on the image sensor 171 shown in FIG.

The lens 172 for the vicinity is configured so as to be in focus when a nearby object (for example, the nearby component 271) is photographed by the image sensor 171, and the lens is disposed. In the present embodiment, as the lens 172 for the vicinity, as shown in FIG. 10, a lens having a normal shape (in this embodiment, a biconvex lens) is used.
Specifically, the nearby component 271 is photographed by the imaging element 171 in a focused state only through the nearby lens 172.

  The far-focus lens 173 is combined with the near-lens 172 so that the far-field object (for example, the distant component 273) is focused with the image sensor 171 so that the lens is in focus. The lens is arranged. In this embodiment, as shown in FIG. 10, the distant focus adjustment lens 173 is only 1/3 of the lower portion as compared with a normal-shaped lens (biconvex lens in this embodiment). This lens is used.

In the present embodiment, the far focus adjustment lens 173 is disposed in front of the image pickup device 171 (behind the near lens 172) (a portion for photographing the far side), and adjusts the far focus. (adjust.
Specifically, the distant component 273 is photographed by the image sensor 171 in a focused state via the near lens 172 and the distant focus adjusting lens 173.

  The middle distance focus adjustment lens 174 is combined with the near lens 172 so that a middle distance object (for example, a medium distance component 272) is photographed with the image sensor 171. The lens is configured, and the lens is arranged. In the present embodiment, as a focus adjustment lens 174 at a medium distance, as shown in FIG. 10, only 1/3 of the central portion is compared with a normal-shaped lens (biconvex lens in the present embodiment). This lens is used.

In the present embodiment, the medium-distance focus adjustment lens 174 is disposed at the center (the part that images the central part) of the front of the image sensor 171 (behind the lens 172 for the vicinity). Adjust (adjust) the focus.
Specifically, the medium-distance component 272 is photographed by the imaging device 171 in a state of being in focus via the proximity lens 172 and the medium-distance focus adjustment lens 174.

  The positions of the proximity lens 172, the distant focus adjustment lens 173, and the mid-range focus adjustment lens 174 may be fixedly configured, for example, or It is possible to adjust the focus by changing one or more of the position of the lens 172, the position of the far-field focus adjustment lens 173, and the position of the mid-range focus adjustment lens 174 by the control unit 13. Various configurations may be used.

  As described above, the vehicle-mounted camera device 1 according to the present embodiment can simultaneously focus on different regions of the captured image (in the present embodiment, near, middle, and far). Thereby, for example, in the image sensing technology by the in-vehicle camera device 1 mounted in the vehicle interior or the like, the recognition rate for the object can be improved.

  As a specific example, the in-vehicle camera device 1 according to the present embodiment can shoot an image in which all of the vicinity, the middle distance, and the distance are in focus, so the entire area of the captured image is in focus. An image can be taken, and the recognition rate in lane recognition (for example, white line recognition) and obstacle detection (for example, structure recognition) can be improved.

  For example, the image processing unit 41 performs different image processing (for example, for each of an upper area (distant area), a central area (medium distance area), and a lower area (near area) of the captured image. , Image processing for different purposes). For the central area (intermediate distance area) of the captured image, for example, image processing for recognizing an obstacle is performed.

  In the present embodiment, the focusing distance is different for the upper 1/3 area, the central 1/3 area, and the lower 1/3 area of the captured image, but the focusing distance is different. The ratio of the upper region, the central region, and the lower region that are different from each other is not necessarily 1: 1: 1, and other ratios may be used.

  In the present embodiment, when the focus is varied at a plurality of stages (three stages in the present embodiment) in one direction in the vertical direction of an image photographed by the image sensor 171, the object to be photographed (the book) at each of the plurality of stages. In the embodiment, the focal points are made different by changing the number of lenses (lenses 172, 173, 174 in the present embodiment) through which light from the components 271 272, and 273) passes.

[Ninth Embodiment]
The schematic configuration and operation of the in-vehicle camera device 1 according to the present embodiment are the same as those shown in FIG.
For this reason, this embodiment will be described with reference to FIG.
Hereinafter, the imaging unit 11 having a configuration different from that of the first embodiment will be described in detail. Note that the description of the same points as in the first embodiment is omitted or simplified.

A configuration of the imaging unit 11 in the in-vehicle camera device 1 according to the present embodiment will be described.
FIG. 11 is a block diagram illustrating a configuration of the imaging unit 11 of the in-vehicle camera device 1 according to the ninth embodiment of the present invention.
In the imaging unit 11 according to the present embodiment, the imaging element unit 21 includes an imaging element 181, and the lens unit 22 includes lenses 182 that correspond to all of the near, intermediate, and far distances.

Further, the nearby component 281, the medium-distance component 282, and the distant component 283 shown in FIG. 11 are each in a direction in which an image is captured by the image sensor 181 (in the present embodiment, in the front direction of the vehicle). Relatively, those that are present in the vicinity of the vehicle, those that are present at a medium distance, and those that are located far away from the vehicle are represented.
In the present embodiment, it is assumed that the nearby constituent 281 appears in the lower third region of the image to be photographed, and the medium distance constituent 282 appears in the middle third region of the photographed image. It is assumed that the distant component 283 appears in the upper third region of the photographed image.
In the present embodiment, the upper and lower sides of the captured image are reversed on the image sensor 181 shown in FIG.

  The lenses 182 corresponding to all of the near, middle distance, and far distance lenses have different shapes in the upper, middle, and lower (in this embodiment, the upper 1/3, the center 1/3, and the lower 1/3). A lens (in this embodiment, a biconvex lens with a step), the lower side of the lens 182 is used, the middle side where the center of the lens 182 is used, and the upper side of the lens 182 are used The focal point is different on the far side to be done.

The lower side of the lens 182 has a lens portion configured so as to be focused when a nearby object (for example, a nearby component 281) is photographed by the image sensor 181 and the lens 182 is disposed. ing.
Specifically, a nearby component 281 is photographed by the image sensor 181 in a focused state via the lower side of the lens 182.

In addition, the center of the lens 182 is configured such that the lens portion is configured to be in focus when an image sensor 181 is used to photograph a medium-distance object (for example, a medium-distance component 282). Is arranged.
Specifically, the medium-distance component 282 is photographed by the image sensor 181 in a focused state through the center of the lens 182.

Further, the upper side of the lens 182 is configured such that its lens portion is in focus when a far object (for example, a distant component 283) is photographed by the image sensor 181, and the lens 182 is disposed. Has been.
Specifically, the distant component 283 is photographed by the image sensor 181 through the upper side of the lens 182 in a focused state.

The position of the lens 182 may be fixed, for example, or may be changed by the control unit 13 so that the focus can be adjusted.
In the present embodiment, the lens 182 has a shape that gradually decreases in the order of the lower thickness, the center thickness, and the upper thickness, but various other shapes may be used.

  As described above, the vehicle-mounted camera device 1 according to the present embodiment can simultaneously focus on different regions of the captured image (in the present embodiment, near, middle, and far). Thereby, for example, in the image sensing technology by the in-vehicle camera device 1 mounted in the vehicle interior or the like, the recognition rate for the object can be improved.

  As a specific example, the in-vehicle camera device 1 according to the present embodiment can shoot an image in which all of the vicinity, the middle distance, and the distance are in focus, so the entire area of the captured image is in focus. An image can be taken, and the recognition rate in lane recognition (for example, white line recognition) and obstacle detection (for example, structure recognition) can be improved.

  For example, the image processing unit 41 performs different image processing (for example, for each of an upper area (distant area), a central area (medium distance area), and a lower area (near area) of the captured image. , Image processing for different purposes). For the central area (intermediate distance area) of the captured image, for example, image processing for recognizing an obstacle is performed.

  In the present embodiment, the focusing distance is different for the upper 1/3 area, the central 1/3 area, and the lower 1/3 area of the captured image, but the focusing distance is different. The ratio of the upper region, the central region, and the lower region that are different from each other is not necessarily 1: 1: 1, and other ratios may be used.

  In the present embodiment, when the focus is varied in a plurality of stages (three stages in the present embodiment) in one direction in the vertical direction of an image photographed by the image sensor 181, the photographing target (the book In the embodiment, a step is provided in the portion of the lens 182 through which the light from the components 281, 282, 283) passes to make the focus different.

(Summary of the above embodiments)
As mentioned above, although embodiment of this invention was explained in full detail with reference to drawings, the specific structure is not restricted to this embodiment, The design change etc. of the range which does not deviate from the summary of this invention are included.

As a specific example, various types and arrangements of image pickup devices may be used.
Various shapes, numbers, or arrangements of lenses may be used.
In addition, when the focus is varied at a plurality of stages in one direction in the vertical direction of the image captured by the image sensor (from the top to the bottom, or from the bottom to the top), the number of these stages (each stage The number of areas in the photographed image corresponding to the above and the size of the area in the photographed image corresponding to each stage may be used.
Various vehicles may be used as a vehicle to which the in-vehicle camera device is applied.

Note that a program for realizing the function of the control unit 13 according to the above-described embodiment (for example, the function of the image processing unit 41 or other functions) is recorded on a computer-readable recording medium, and the recording medium is recorded on this recording medium. Processing may be performed by reading the recorded program into a computer system and executing it.
The “computer system” referred to here may include an OS (Operating System) and hardware such as peripheral devices.
The “computer-readable recording medium” means a flexible disk, a magneto-optical disk, a ROM (Read Only Memory), a writable nonvolatile memory such as a flash memory, a portable medium such as a DVD (Digital Versatile Disk), A storage device such as a hard disk built in a computer system.

Further, the “computer-readable recording medium” refers to a volatile memory (for example, DRAM (DRAM) inside a computer system that becomes a server or a client when a program is transmitted through a network such as the Internet or a communication line such as a telephone line. Dynamic Random Access Memory)) that holds a program for a certain period of time is also included.
The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting a program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.
The program may be for realizing a part of the functions described above.
Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

DESCRIPTION OF SYMBOLS 1 ... Vehicle-mounted camera apparatus 11 ... Imaging part 12 ... Memory | storage part 13 ... Control part 21 ... Imaging element part 22 ... Lens part 31 ... Image memory | storage part 41 ... Image processing part 101, 111, 121, 131, 141, 151, 161, 171, 181, 501 ... Image sensor 102, 103, 112, 113, 122, 123, 132, 133, 142, 152, 153, 162-164, 172-174, 182, 502 ... Lens 201, 202, 211 , 212, 221, 222, 231, 232, 241, 242, 251, 252, 261 to 263, 271 to 273, 281 to 283, 601, 602... Composition 301 ... image 311, 312.

Claims (6)

An image sensor for taking an image;
A lens unit having one or more lenses that change the focus in a plurality of stages in one direction in the vertical direction of an image captured by the image sensor;
An in-vehicle camera device comprising: The lens unit has two or more lenses,
The number of lenses through which light from the object to be photographed differs in each of the plurality of stages, and the focus is varied.
The in-vehicle camera device according to claim 1. The lens unit has two or more lenses,
In each of the plurality of stages, the lens through which the light from the object to be photographed is different, and the focal point is different.
The in-vehicle camera device according to claim 1 or 2, wherein the on-vehicle camera device is provided. The lens unit has one lens that provides a step in each of the plurality of stages to change the focus.
The in-vehicle camera device according to claim 1. As the plurality of steps, a step of an upper half region and a step of a lower half region of an image photographed by the image sensor are used.
The in-vehicle camera device according to any one of claims 1 to 4, wherein the on-vehicle camera device is provided. Further, the image processing unit includes an image processing unit that performs different predetermined image processing for each region corresponding to each of the plurality of stages in the image captured by the image sensor.
The in-vehicle camera device according to any one of claims 1 to 5, wherein:

Images