JP2014045265A - On-vehicle imaging system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an on-vehicle imaging system making it possible to favorably change a range of actual scenery displayed on a display device without the need for a driving mechanism for changing the posture of an imaging device.SOLUTION: An on-vehicle imaging system 1 comprises: an imaging device 3 that is provided on a vehicle body 103; a display device 5 that is provided on the vehicle body 103, and can display an image captured by the imaging device 3 only in a display range 53 as a part within a visual field 51 of the imaging device 3; and a display range change unit 13 that changes the position of the display range 53 in the visual field 51.

Description

  The present invention relates to an in-vehicle imaging system.

  As an in-vehicle imaging system, for example, an imaging system (electronic mirror system) used as a substitute for a side mirror is known (for example, Patent Document 1). In the technique of Patent Document 1, an imaging device is provided at a position where a side mirror is normally attached to a vehicle (vehicle body). Then, the imaging device images the rear of the vehicle, and the captured image is displayed on a display device provided inside the vehicle.

JP 2009-83618 A

  In the vehicle-mounted imaging system as described above, it is conceivable to change the range of the actual landscape that falls within the field of view of the imaging device by providing a drive mechanism that changes the attitude (orientation) of the imaging device with respect to the vehicle body. By configuring in this way, for example, during normal driving, an image that makes it easy to see the following vehicle is displayed, and when driving backward, an image that makes it easy to see the lower rear part of the vehicle body is displayed. Accordingly, an appropriate image can be displayed.

  However, if such a drive mechanism is provided, the equipment provided in the vehicle is increased in size or weight. Increasing the size of the equipment also increases the air resistance of the vehicle.

  Therefore, it is preferable to provide an in-vehicle imaging system that can suitably change the range of the actual landscape displayed on the display device without requiring such a drive mechanism.

  An in-vehicle imaging system of the present invention includes an imaging device provided in a vehicle, and a display provided in the vehicle capable of displaying an image captured by the imaging device only for a display range that is a part of a field of view of the imaging device A display range changing unit that changes the position of the display range within the field of view of the imaging device.

  Suitably, the said imaging device is provided in the side of the said vehicle so that imaging of the back of the said vehicle is possible.

  Preferably, the in-vehicle imaging system further includes a viewpoint detection sensor that detects a position of the viewpoint of the driver of the vehicle or a movement of the viewpoint, and the display range changing unit is responsive to a detection result of the viewpoint detection sensor. To change the position of the display range.

  Preferably, the display range changing unit changes the position of the display range in a direction opposite to the moving direction of the viewpoint obtained from the detection result of the viewpoint detection sensor.

  Preferably, the in-vehicle imaging system further includes a line-of-sight detection sensor that detects the line of sight of the driver, and the display range changing unit displays a line of sight obtained from a detection result of the line-of-sight detection sensor as a screen of the display device. The position of the display range is changed in accordance with the detection result of the viewpoint detection sensor on the condition that it is directed to a predetermined setting range including at least a part of.

  Preferably, the viewpoint detection sensor detects the position of the driver's viewpoint or movement of the viewpoint by capturing the driver and identifying the driver's head or eyes from the captured image.

  Preferably, the viewpoint detection sensor detects a load received by a seat on which the driver sits or a seat belt worn by the driver, and detects movement of the driver's viewpoint based on the detected change in the load. .

  Preferably, the viewpoint detection sensor detects movement of the driver's viewpoint by detecting movement of the seat belt.

  Preferably, the imaging device includes a CMOS sensor capable of outputting an image signal for only a part of the field of view, and the display range changing unit controls the CMOS sensor, thereby An image signal is output only for the display range, and the image captured by the imaging device is displayed only for the display range on the display device, and the position of the display range is changed.

  Preferably, the imaging device outputs an image signal having a width corresponding to the field of view, and the display range changing unit is configured to output a signal from the image signal having a width corresponding to the field of view of the imaging device. Is extracted and output to the display device, and an image captured by the imaging device is displayed on the display device only for the display range by changing a position of a range in which the signal is extracted in the field of view of the imaging device. While displaying, the position of the display range is changed.

  According to said structure, the range of the actual landscape displayed on a display apparatus can be changed, without requiring a drive mechanism.

Fig.1 (a) is a top view of the vehicle which has the vehicle-mounted imaging system based on the 1st Embodiment of this invention, FIG.1 (b) is a front view of the instrument panel periphery of the vehicle of Fig.1 (a). FIG. 1C is a side view of the vicinity of the driver's seat of the vehicle in FIG. FIG. 2A to FIG. 2C are diagrams for explaining the outline of the operation of the in-vehicle imaging system according to the first embodiment. The block diagram which shows the structure of the signal processing system of the vehicle-mounted imaging system which concerns on 1st Embodiment. The flowchart which shows an example of the procedure of the process which the control part of the vehicle-mounted imaging system which concerns on 1st Embodiment performs. The block diagram which shows the structure of the signal processing system of the vehicle-mounted imaging system which concerns on 2nd Embodiment. Sectional drawing which shows typically the principal part of the vehicle-mounted imaging system which concerns on 4th Embodiment. Sectional drawing which shows typically the principal part of the vehicle-mounted imaging system which concerns on 5th Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the second and subsequent embodiments, the same or similar configurations as the configurations of the already described embodiments are denoted by the same reference numerals as the configurations of the already described embodiments, and the description thereof is omitted. There are things to do.

<First Embodiment>
FIG. 1A is a plan view of a vehicle 101 having an in-vehicle imaging system 1 according to the first embodiment of the present invention, and FIG. 1B is a front view of the vicinity of the instrument panel 105 of the vehicle 101. FIG. 1C is a side view around the driver's seat of the vehicle 101.

  The in-vehicle imaging system 1 includes an imaging device 3 (FIGS. 1A and 1B), a display device 5 (FIG. 1B) that displays an image captured by the imaging device 3, and driving of the vehicle 101. A visual sensor 7 (FIGS. 1B and 1C) for acquiring information about the person.

  The imaging device 3 is provided in place of the side mirror, for example, at a position where the side mirror is normally provided in the vehicle 101 (vehicle body 103). That is, one pair is provided on both sides of the vehicle 101. The side mirror here may be a fender mirror provided on the hood of the vehicle 101, a door mirror provided on the front seat door, or other types. Good.

  The imaging device 3 is provided so as to capture a range similar to the range reflected by the side mirror, as indicated by a dotted line in FIG. That is, the imaging device 3 is provided so as to reflect the rear side of the vehicle body 103 (behind the vehicle body 103, and thus the rear side).

  The configuration of the imaging device 3 may be a known configuration. Although not particularly illustrated, the imaging device 3 includes, for example, a lens (or a lens group), an imaging element that receives light collected by the lens, and a housing that houses these. The imaging device 3 has a simple configuration and is preferably reduced in weight or size, but a variable aperture, a zoom lens, or the like may be provided. Further, FIG. 1 illustrates the imaging device 3 having the same appearance as the door mirror, but actually, the imaging device 3 can be made smaller than the door mirror.

  The display device 5 is provided in the vehicle 101 at a position where the driver can visually recognize the screen 5a of the display device 5 while facing the front. Preferably, the display device 5 is provided inside the vehicle 101. For example, the display device 5 is provided on the center upper side of the instrument panel 105. For example, a pair of display devices 5 is provided corresponding to the pair of imaging devices 3. However, only one display device 5 may be provided, and the screen may be divided into displays to display a pair of images captured by the pair of imaging devices 3. The display device 5 is configured by, for example, a liquid crystal display device or an organic EL display device.

  The visual sensor 7 includes a solid-state image sensor such as a CMOS image sensor or a CCD image sensor, for example. The visual sensor 7 is preferably provided at a position in the vehicle 101 where the driver can be imaged from the front (from the display device 5 side). The image captured by the visual sensor 7 is used to acquire information on the driver's viewpoint and line of sight, as will be described later.

  FIG. 2A to FIG. 2C are diagrams for explaining the outline of the operation of the in-vehicle imaging system 1.

  FIG. 2A is a plan view for explaining the operation of the side mirror 151 as a comparative example. In this figure, points P1 and P2 schematically show the driver's viewpoint. When the driver's viewpoint moves between the positions of the points P1 and P2, the range of the actual landscape displayed on the side mirror 151 as viewed from the driver changes as schematically shown by the dotted line and the one-dot chain line. . Therefore, for example, when the vehicle is moving backward, the driver can visually recognize the desired range by the side mirror 151 by moving the viewpoint with respect to the position of the viewpoint during normal traveling, and preferably the vehicle You can drive.

  On the other hand, in the in-vehicle imaging system provided instead of the side mirror 151, when the image captured by the imaging device 3 is simply displayed on the display device 5, even if the driver moves the viewpoint with respect to the display device 5, The range visible to the driver does not change.

  Therefore, the in-vehicle imaging system 1 of the present embodiment is configured such that when the driver moves the viewpoint with respect to the display device 5, the actual landscape range displayed on the display device 5 changes. For example, as with the side mirror 151, when the driver moves the viewpoint with respect to the display device 5, the in-vehicle imaging is performed so that the landscape range displayed on the display device 5 moves in the direction opposite to the moving direction. System 1 is configured.

  At this time, as described in the section of the problem, if a drive mechanism for changing the attitude of the image pickup apparatus 3 is provided, the apparatus is increased in size and the like, so that such a drive mechanism is not necessary. The range displayed on the display device 5 is changed by the method. Specifically, it is as follows.

  FIG. 2B shows a landscape that fits in the field of view 51 of the imaging device 3 or its image, and FIG. 2C shows the screen 5 a of the display device 5.

  The imaging device 3 can capture a landscape that falls within the field of view 51. The field of view 51 here is a field of view in a broad sense, and refers to a range where imaging can be performed without moving the imaging device 3. However, even if the visual field 51 is a narrow visual field (a range defined by the angle of view and the working distance), the configuration and operation of the embodiment are not substantially changed.

  On the other hand, the display device 5 does not display the entire image of the visual field 51, but displays the image captured by the imaging device 3 only for the display range 53 that is a part of the visual field 51. For example, on the screen 5a on the left side of FIG. 2C, an image for the display range 53 located at the position P11 in FIG. 2B is displayed.

  And the vehicle-mounted imaging system 1 will change the position of the display range 53, if a driver | operator's viewpoint moves. For example, as shown by the arrow y1 in FIG. 2B, the in-vehicle imaging system 1 changes the position of the display range 53 from the position P11 to the position P12. That is, the image displayed on the screen 5a is switched from the image shown on the left side of FIG. 2C to the image shown on the right side of FIG. As a result, the display on the screen 5a is switched as if the orientation of the imaging device 3 was changed.

  In FIG. 2C, the image in the display range 53 is displayed on the entire screen 5a. However, as long as it is displayed on a certain area in the screen 5a, it is displayed in a part of the screen 5a. May be. The certain area is, for example, an area having the same position and width on the screen 5a before and after the change of the position of the display range 53. However, the area of the certain area may be adjusted as appropriate by the driver's operation or the like. Further, on the screen 5a, an image that presents appropriate information may be displayed side by side or superimposed on the image captured by the imaging device 3.

  FIG. 3 is a block diagram showing a configuration of a signal processing system of the in-vehicle imaging system 1 that realizes the operation as described above.

  The in-vehicle imaging system 1 includes a control unit 9 in addition to the visual sensor 7, the imaging device 3, and the display device 5 described above.

  For example, although not particularly illustrated, the control unit 9 is configured by a computer including a CPU, a ROM, a RAM, and an external storage device. Note that the computer may be appropriately configured, such as a combination of an image processing IC and a microcomputer that controls the IC, the imaging device 3, and the like.

  For example, the control unit 9 controls the image processing unit 11 that acquires the driver's viewpoint information and line-of-sight information based on the image (signal) from the visual sensor 7, and the imaging device 3 based on the acquired information. And a display range changing unit 13. The visual sensor 7 and the image processing unit 11 constitute a viewpoint / line-of-sight detection sensor 15.

  For example, the image processing unit 11 specifies the driver's head or pupil in the image captured by the visual sensor 7 and specifies the coordinates of the specified head or pupil. That is, the image processing unit 11 specifies the coordinates of the viewpoint. Then, the image processing unit 11 monitors the change in the coordinates of the viewpoint based on the images sequentially acquired from the visual sensor 7 and detects the movement direction and the movement distance of the viewpoint.

  Note that such viewpoint detection may be realized by, for example, a head or pupil detection technique that is used in autofocus of a known imaging device. The coordinates of the viewpoint may be coordinates of an appropriate representative point of the head or pupil, such as the graphic center of gravity of the head or pupil. The coordinates of the viewpoint, the moving direction, or the moving distance may be represented by a numerical value (for example, the number of pixels) different from the actual scale, or may be represented by a numerical value of the actual scale. The actual scale value is calculated based on the position information and visual field information of the visual sensor 7 input in advance.

  In addition, the image processing unit 11 specifies the orientation of the driver's head or pupil in the image captured by the visual sensor 7, for example. That is, the image processing unit 11 specifies the direction (broad line of sight) that the driver is viewing. The image processing unit 11 or the display range changing unit 13 can be viewed by the driver from the viewpoint based on the direction that the driver is viewing and the coordinates of the viewpoint specified as described above (preferably the actual scale). It is possible to specify a straight line (narrow sense of sight) that extends in the direction in which it is located.

  Note that such gaze detection may be realized by a known gaze input technique used in autofocus of an imaging apparatus or a communication support apparatus for a handicapped person. The line-of-sight information may be represented by an angle (direction), may be represented by coordinates, or may be represented by both.

  The imaging device 3 includes, for example, a CMOS (image) sensor 17 as an imaging element. As is well known, the CMOS sensor 17 is an XY address type image sensor. That is, the CMOS sensor 17 includes a plurality of cells 19 (pixels) arranged in the XY direction (left and right direction in FIG. 3), and an X scan shift register 21X and a Y scan shift register 21Y ( In the following description, the two are simply referred to as “scanning shift register 21” without distinguishing between the two. Each cell 19 is configured including a photoelectric conversion element and stores an amount of signal charge corresponding to the amount of received light. Then, the CMOS sensor 17 selects an arbitrary cell 19 by the scanning shift register 21 (actually sequentially selects in the XY direction), and reads out the signal charge accumulated in the selected cell 19.

  Therefore, the CMOS sensor 17 can output the accumulated signal charges for only some of the cells 19. That is, the CMOS sensor 17 can output only the image signal corresponding to the display range 53 among the image signals corresponding to the visual field 51. Note that a commercially available CMOS sensor may have a function of internally correcting a range in which an image signal is output, and this function may be used for the above operation.

  The display range changing unit 13 controls the scan shift register 21 of the imaging device 3 to define a range including the cells 19 from which signal charges are read, and thus defines the display range 53. Further, the display range changing unit 13 changes the position of the display range 53 in the field of view 51 by changing the position on the light receiving surface of the CMOS sensor 17 in the range including the cell 19 from which the signal charge is read. The position of the display range 53 is changed based on viewpoint information and line-of-sight information from the image processing unit 11.

  The display device 5 appropriately displays an image based on the image signal output from the imaging device 3 so that the overall size of the image matches the size of a certain area of the screen 5a (for example, the entire screen 5a). The image is enlarged or reduced to be displayed on the screen 5a. Therefore, the imaging device 3 is controlled by the display range changing unit 13, whereby the range of the cell 19 from which the signal charge is read is defined, and when the position is changed, it is displayed in a certain area of the screen 5 a. The actual landscape range (display range 53) is defined and its position is changed.

  FIG. 4 is a flowchart illustrating an example of a procedure of processing executed by the control unit 9 in order to realize the operation described with reference to FIG. This process is started, for example, when the power of the vehicle 101 is turned on by an ignition key, and is repeatedly executed at a predetermined interval (for example, 0.01 to 0.1 second order). Note that this interval may be longer than the image update interval of the imaging device 3 and the display device 5.

  In step S1, the control unit 9 sets the display range 53 to a preset initial position. Then, for the display range 53 at the initial position, the image captured by the imaging device 3 is displayed on a certain area of the screen 5 a by the display device 5.

  In step S <b> 2, the control unit 9 acquires line-of-sight information based on the image captured by the visual sensor 7.

  In step S3, the control unit 9 determines whether or not the driver's line of sight is directed to a preset setting range including at least a part of the screen 5a based on the acquired line-of-sight information. That is, the control unit 9 determines whether or not the driver is viewing the screen 5a. Specifically, for example, the control unit 9 determines whether or not the direction in which the driver is looking (broad line of sight) is within a preset angle range, or preferably from the viewpoint. It is determined whether or not a straight line (narrowly defined line of sight) extending in the viewing direction passes through a plane having a predetermined area (for example, the screen 5a).

  When it is determined that the line of sight is directed to the set range, the control unit 9 starts measuring time (step S4). In other words, the timer is reset. On the other hand, when it determines with it not being pointed, the control part 9 determines whether it is measuring time (step S5). In other words, the control unit 9 determines whether or not the line of sight has once been directed to the set range so far. If it is determined that the time is not being measured, the process returns to step S2.

  Therefore, when the driver has not seen the screen 5a, the display range 53 remains at the initial position, and the position of the display range 53 is not changed according to the movement of the viewpoint. Thereby, it is suppressed that the display range 53 is uselessly changed. Further, the position of the display range 53 when the driver starts looking at the screen 5a can be set to a fixed position. Note that the setting range of step S3 may be set by the manufacturer of the vehicle 101 or may be set by the driver.

  When the time measurement is started in step S4 or when it is determined in step S5 that the time is being measured, the control unit 9 determines whether or not a predetermined time has elapsed since the start of the time measurement in step S4 (step S6). This predetermined time is longer than the execution cycle of the flowchart of FIG. And the control part 9 returns to step S1, when it determines with predetermined time having passed, and when it determines with not having passed, it progresses to step S7.

  Therefore, when the driver does not watch the screen 5a for a certain time, the display range 53 is returned to the initial position. Thereby, when the screen 5a is seen again, the position of the display range 53 can be set to a fixed position.

  On the other hand, within a certain period of time, the position of the display range 53 is changed according to the movement of the viewpoint according to the procedure described later even when the driver is not viewing the screen 5a. As a result, if the viewpoint moves even if you are not looking at the mirror, then the same situation will be realized when the line of sight is moved back to the mirror and the range displayed on the mirror changes as the viewpoint moves Is done.

  Note that the length of the predetermined time in step S6 may be set as appropriate from the viewpoint of ease of driving or the like, and may be set by the manufacturer of the vehicle 101 or may be set by the driver.

  In step S <b> 7, the control unit 9 acquires viewpoint information based on the image captured by the visual sensor 7.

  In step S8, the control unit 9 determines whether the viewpoint has moved based on the acquired viewpoint information. For example, the previous viewpoint information and the current viewpoint information are compared to determine whether or not the difference exceeds a threshold value. When step S8 is executed for the first time, it is determined that there is no movement. Further, the determination may be made based on the viewpoint information at three or more points in time.

  When the viewpoint has not moved, strictly speaking, when the movement of the viewpoint is relatively small, the control unit 9 returns to step S2. Accordingly, the position of the display range 53 is not changed. Thereby, it is expected that the image is frequently shaken on the screen 5a according to a minute shake of the viewpoint not intended by the driver, and the visibility of the screen 5a is improved.

  When the viewpoint is moving, the control unit 9 proceeds to step S9 and calculates a new position of the display range 53 according to the moving direction and the moving amount of the viewpoint. For example, as described above, the control unit 9 calculates a new position so that the screen 5a can be viewed with the same feeling as when the mirror is viewed. That is, the control unit 9 moves to a position opposite to the viewpoint movement direction and a new position for moving the display range 53 in the field of view 51 by an amount (for example, an amount proportional to the viewpoint movement amount). Is calculated. Note that when the display range 53 reaches the end of the visual field 51 and the viewpoint is moved to move the display range 53 beyond that end, for example, the position of the display range 53 is left as it is.

  In step S10, the control unit 9 sets the display range 53 at the calculated new position. That is, the control unit 9 changes the position of the range including the cell 19 from which the signal charge is read in the control of the CMOS sensor 17. In the display device 5, an image of the display range 53 at a new position is displayed on the screen 5a. Thereafter, the control unit 9 returns to step S2.

  As described above, in the present embodiment, the in-vehicle imaging system 1 captures only the imaging device 3 provided in the vehicle body 103 and the display range 53 provided in the vehicle body 103 and being a part of the field of view 51 of the imaging device 3. It has the display apparatus 5 which can display the image which the apparatus 3 imaged, and the display range change part 13 which changes the position in the visual field 51 of the display range 53. FIG.

  Therefore, the actual landscape range displayed on the display device 5 can be changed without providing a driving device for changing the posture of the imaging device 3. As a result, the imaging device 3 can be reduced in size or weight. Moreover, since the range of the actual landscape displayed on the display device 5 is changed by changing the processing of the electrical signal, the display device 5 displays the range more quickly than when the posture of the imaging device 3 is changed. The actual landscape range can be changed.

  In the present embodiment, the imaging device 3 is provided on the side of the vehicle body 103 so that the rear of the vehicle body 103 can be imaged. That is, the vehicle-mounted imaging system 1 functions as a side mirror or an auxiliary device for the side mirror.

  Since the side mirror and the image pickup device 3 protrude to the side of the vehicle body, when the image pickup device 3 is downsized, the air resistance of the vehicle 101 is reduced to improve traveling performance, It is possible to reduce the parking space by reducing the overall width.

  In the present embodiment, the in-vehicle imaging system 1 includes a viewpoint detection sensor (viewpoint / line-of-sight detection sensor 15: combination of the visual sensor 7 and the image processing unit 11) that detects the position of the viewpoint of the driver of the vehicle 101 or the movement of the viewpoint. ). The display range changing unit 13 changes the position of the display range 53 according to the detection result of the viewpoint detection sensor.

  Therefore, the position of the display range 53 can be changed without operating the switch. As a result, for example, the position of the display range 53 can be changed while operating the steering wheel with both hands, and the drivability of the vehicle is improved. In addition, it is considered that the time required from when the necessity of changing the position of the display range 53 to when the vehicle-mounted imaging system 1 is instructed to change the position of the display range 53 is also shortened. As a result, it is expected that the driver can appropriately deal with an emergency.

  In the present embodiment, the display range changing unit 13 changes the position of the display range 53 in the direction opposite to the moving direction of the viewpoint obtained from the detection result of the viewpoint / gaze detection sensor 15.

  Therefore, the in-vehicle imaging system 1 can provide the driver with the same sensation as viewing the mirror when viewing the display device 5. As a result, it is expected that the operability of the in-vehicle imaging system 1 of the driver is improved.

  In the present embodiment, the vehicle-mounted imaging system 1 further includes a line-of-sight detection sensor (viewpoint / line-of-sight detection sensor 15) that detects the driver's line of sight. The display range changing unit 13 detects the viewpoint on the condition that the line of sight obtained from the detection result of the line of sight detection sensor is directed (at least once) to a predetermined setting range including at least a part of the screen 5a of the display device 5. The position of the display range 53 is changed according to the detection result of the sensor.

  Therefore, as described above, it is possible to suppress the position of the display range 53 from being changed unnecessarily when the driver is not viewing the screen 5a. In addition, the position of the display range 53 when the driver starts looking at the screen 5a can be made constant.

  In this embodiment, the viewpoint detection sensor (viewpoint / gaze detection sensor 15) captures the driver and identifies the driver's viewpoint position or movement by identifying the driver's head or eyes from the captured image. To detect.

  Therefore, it is expected that the viewpoint detection method is more straightforward than the embodiments described later, and the viewpoint can be detected with high accuracy. In addition, as shown in the embodiment, the viewpoint detection sensor can share part of the configuration with the line-of-sight detection sensor, and the cost reduction as a whole is also expected.

  The imaging device 3 includes the CMOS sensor 17 that can output an image signal for only a part of the visual field 51. The display range changing unit 13 controls the CMOS sensor 17, thereby outputting an image signal only for the display range 53 and causing the display device 5 to display and display the image captured by the imaging device 3 only for the display range 53. The position of the range 53 is changed.

  Therefore, the signal amount from the CMOS sensor 17 to the display device 5 is reduced. As a result, reduction of power consumption and improvement of processing speed are expected. In addition, as described above, the CMOS sensor may have a function of internally correcting a signal output range, and design changes can be reduced by using this function. As a result, it is expected that the display range 53 can be changed at low cost.

<Second Embodiment>
FIG. 5 is a block diagram illustrating a configuration of a signal processing system of the in-vehicle imaging system 201 according to the second embodiment.

  The in-vehicle imaging system 201 is different from the in-vehicle imaging system 1 of the first embodiment only in the configuration (operation) of the display range changing unit and the configuration of the imaging element of the imaging device. Specifically, it is as follows.

  An imaging device 203 of the in-vehicle imaging system 201 includes a CCD (Charge Coupled Device) (image) sensor 217 as an imaging element. The CCD sensor 217 is a charge transfer type imaging device as is well known. That is, the CCD sensor 217 has a plurality of cells 219 (pixels) arranged in the XY direction (left and right direction in FIG. 5). Each cell 219 is configured to include a photoelectric conversion element, and stores an amount of signal charge corresponding to the amount of received light. Then, the CCD sensor 217 reads the signal charges sequentially stored in the cell 219 by transferring the charge of the cell 219 to the adjacent cell 219 like a so-called bucket relay.

  Accordingly, the CCD sensor 217 basically outputs signal charges accumulated in all the cells 219 and does not have a function of outputting signal charges only for some of the cells 219. In other words, the CCD sensor 217 outputs an image signal corresponding to the visual field 51 and does not have a function of outputting only an image signal corresponding to the display range 53. Note that the imaging device 203 may be configured to include the CMOS sensor 17 as an imaging element and output signal charges accumulated in all the cells 19.

  The display range changing unit 213 configured in the control unit 209 of the in-vehicle imaging system 201 extracts an image signal corresponding to the display range 53 from the image signal corresponding to the visual field 51 output from the imaging device 203, and the display device 5. Output to. Similar to the first embodiment, the display device 5 displays an image based on the input image signal so that the entire size of the image matches the size of a certain area of the screen 5a (for example, the entire screen 5a). Thus, the image is appropriately enlarged or reduced and displayed on the screen 5a.

  In this way, the display device 5 displays the image captured by the imaging device 203 only for the display range. In addition, the display range changing unit 213 changes the position of the range (display range 53) displayed on the display device 5 by changing the position in the field of view 51 of the range from which the signal is extracted.

  In the second embodiment described above, the same effects as those of the first embodiment are achieved. That is, the actual landscape range displayed on the display device 5 can be changed without providing a driving device that changes the posture of the imaging device 203. As a result, the imaging device 203 can be reduced in size or weight. An effect is produced.

  In the second embodiment, the imaging device 203 outputs an image signal having a width corresponding to the visual field 51, and the display range changing unit 213 starts from the image signal having a width corresponding to the visual field 51. The signal of the part is extracted and output to the display device 5, and the position within the field of view 51 of the range from which the signal is extracted is changed.

  Therefore, the imaging device 203 is not limited to one configured to include an XY address type imaging device. As a result, the degree of freedom in designing the in-vehicle imaging system is improved.

<Third Embodiment>
FIG. 6 is a cross-sectional view schematically illustrating a main part (mainly different from the other embodiments) of the in-vehicle imaging system 301 according to the third embodiment.

  The in-vehicle imaging system 301 is different from the first or second embodiment only in the configuration of the viewpoint detection sensor. Specifically, it is as follows.

  The in-vehicle imaging system 301 includes a load sensor 331 that detects a load received by the seat 111. The load sensors 331 are provided at a plurality of positions in the front-rear direction and the left-right direction of the seat 111, for example. The in-vehicle imaging system 301 includes a load sensor 333 that detects a load (tensile load) received by the seat belt 113.

  When the driver moves the viewpoint (head), the load received by the seat 111 and / or the load received by the seat belt 113 changes. Therefore, the control unit 309 of the in-vehicle imaging system 301 detects the movement of the driver's viewpoint based on the change in the load detected by the load sensors 331 and 333.

For example, in a pair of load sensors 331 arranged on the left and right, if the load detected by one load sensor 331 increases and the load detected by the other load sensor 331 decreases, the viewpoint moves to one side. Can be determined. Further, for example, in the pair of load sensors 331 arranged at the front and rear, if the load detected by the front load sensor 331 increases and the load detected by the rear load sensor 331 decreases, the viewpoint is forward or upward. It can be determined that it has moved to.
<Fourth Embodiment>
FIG. 7 is a cross-sectional view schematically showing a main part (mainly different from the other embodiments) of the in-vehicle imaging system 401 of the fourth embodiment.

  The in-vehicle imaging system 401 is different from the first or second embodiment only in the configuration of the viewpoint detection sensor. Specifically, it is as follows.

  The in-vehicle imaging system 401 includes a sensor that detects the displacement (movement) of the seat belt 113. For example, the sensor includes a light emitting element 431 provided on the instrument panel 105 and an imaging element 433 that is provided on the seat belt 113 and receives light from the light emitting element 431. The control unit 409 of the in-vehicle image pickup system 401 specifies the light emitting element 431 and the coordinates thereof in the image picked up by the image pickup element 433. And the control part 409 can detect the displacement of the seatbelt 113 (imaging element 433) by monitoring the change of the coordinate.

  When the driver moves the viewpoint (head) together with the body, the seat belt 113 is displaced. Accordingly, the control unit 409 can detect the movement of the driver's viewpoint by detecting the movement of the seat belt 113. For example, if the seat belt 113 moves to one side in the left-right direction, the control unit 409 can determine that the viewpoint has moved to the one side.

  The present invention is not limited to the above embodiment, and may be implemented in various aspects.

  An imaging device is provided in the side of a vehicle, and is not limited to what picturizes the back of vehicles. For example, it may be provided in front of the vehicle and image a blind spot in front of the vehicle, or may be provided in the rear of the vehicle and image a blind spot in the rear of the vehicle. It may be provided outside and image a range to be visually recognized by the rearview mirror, or may be provided inside the vehicle and image a passenger seat.

  The configuration of the imaging device may be an appropriate configuration. For example, the imaging device may have a wide angle lens (fisheye lens). In this case, it is possible to reduce the size while reducing the blind spot. In this case, it is preferable that an image on which image processing for correcting distortion caused by the wide-angle lens is performed is displayed on the display device.

  The arrangement position of the display device (screen) is not limited to the upper center of the instrument panel, and may be set as appropriate.

  For example, when imaging the rear of a vehicle with a pair of imaging devices instead of a pair of side mirrors, the pair of display devices that display images of the pair of imaging devices are separated from each other to the left and right as viewed from the driver. May be arranged. Specifically, for example, a pair of display devices may be arranged on the instrument panel on the left and right sides with a meter (handle) interposed therebetween. Further, for example, the pair of display devices may be disposed inside the left and right A pillars or the left and right doors (arranged inside the position where the side mirror is usually disposed across the windshield).

  By arranging the pair of display devices apart from each other as viewed from the driver, for example, it is easy to distinguish the viewpoint and line of sight by the visual sensor. After the driver confirms the surroundings of the vehicle with the display device, Effects such as easy visual shift can be achieved. Further, in the case where the pair of display devices are arranged on the left and right sides with the meter interposed therebetween, for example, an effect that the driver's line-of-sight movement is reduced is achieved. Further, when the pair of display devices are arranged inside the A pillar or the door, for example, an effect that the display device can be visually recognized with the same feeling as the side mirror is produced.

  The position change of the display range is not limited to that performed according to the movement of the viewpoint. For example, the position change of the display range may be performed according to an operation on a dedicated operation member provided on an instrument panel or the like, or may be performed according to an operation on a screen of a touch panel display device. Alternatively, it may be performed according to a driving operation such as a gear change to the back gear, or may be performed according to a driving situation such as a change in the positional relationship between the vehicle and surrounding obstacles.

  In addition, when the position change of the display range is performed according to the movement of the viewpoint, the person whose viewpoint is detected is not limited to the driver but may be a passenger. Further, the position change of the display range in accordance with the movement of the viewpoint may not give the driver the same feeling as the mirror. For example, the display range may move in the same direction as the viewpoint movement direction.

  In the embodiment, since the movement of the viewpoint is detected in a relatively short cycle and the display range is changed according to the movement of the viewpoint, the position of the display range is continuous as if the imaging device is changing the posture. Will be changed. However, the position change of the display range may be performed intermittently as if the image capturing apparatus that displays an image is switched among a plurality of image capturing apparatuses.

  Further, changing the position of the display range may involve changing the area of the display range within the field of view. For example, when the viewpoint approaches the screen of the display device, the display range may be widened. Such a change in the display range can also provide the driver with the same feeling as when the viewpoint is moved with respect to the mirror. In such a case, the display range may be temporarily as wide as the visual field.

  In addition, for example, in the case of a right turn or a left turn, the display range is expanded and / or the position of the display range is changed in conjunction with the direction indicator, and the display range is a range necessary for confirmation of entrainment (the rear side of the vehicle) May be included. In this case, information for improving safety can be actively provided to the driver. In this aspect, it is preferable that the imaging device has the above-described wide-angle lens and the imaging device has a wide field of view.

  The flowchart illustrated in FIG. 4 may be changed as appropriate. For example, steps S4 to S6 may be omitted, and when the line of sight is not directed to the display device, the process may return to step S2. In other words, only when the line of sight is directed to the display device, the position of the display range may be changed according to the movement of the viewpoint. Conversely, steps S2 and S3 may also be omitted, and the position of the display range may be changed according to the movement of the viewpoint, regardless of whether or not the line of sight is directed to the display device. Further, for example, step S8 may be omitted, and the position change of the display range may be adapted to a minute movement of the viewpoint.

  When displaying an image captured by the imaging device only for a display range that is part of the field of view of the imaging device, an image signal outside the display range may be used to display an image in the display range. For example, an image signal outside the display range may be used for color correction of pixels at the outer peripheral edge of the image corresponding to the display range.

  Further, the first embodiment and the second embodiment may be appropriately combined. For example, the image signal is output to the imaging device in a range slightly wider than the display range, and the image signal corresponding to the display range is extracted from the image signal, and the image signal outside the display range is used for the correction as described above. You can do it.

  In the vehicle-mounted imaging system of the present invention, the display device may display an image captured by the imaging device for the entire field of view of the imaging device, according to an appropriate operation or the like.

  The present invention eliminates the need for a driving device that changes the attitude of the imaging device. However, such a driving device may be provided. Even if the driving device is provided, for example, changing the display range only changes the signal processing, so that the actual landscape range displayed on the display device can be quickly switched. The In addition, by providing a drive device, for example, after parking, the imaging device is moved (stored) to the vehicle body side to reduce the width of the entire vehicle, or to adjust the field of view of the imaging device before traveling. The actual landscape range displayed on the display device can be greatly changed by combining the change in the attitude of the imaging device by the drive device and the change in the display range.

DESCRIPTION OF SYMBOLS 1 ... Vehicle-mounted imaging system, 3 ... Imaging device, 5 ... Display apparatus, 13 ... Display range change part, 51 ... Visual field, 53 ... Display range, 103 ... Vehicle body.

Claims (10)

An imaging device provided in the vehicle;
A display device provided in the vehicle and capable of displaying an image captured by the imaging device only for a display range that is a part of a field of view of the imaging device;
A display range changing unit for changing the position of the display range in the field of view of the imaging device;
A vehicle-mounted imaging system. The in-vehicle imaging system according to claim 1, wherein the imaging device is provided on a side of the vehicle so as to be capable of imaging the rear of the vehicle. A viewpoint detection sensor for detecting the position of the viewpoint of the driver of the vehicle or the movement of the viewpoint;
The in-vehicle imaging system according to claim 1, wherein the display range changing unit changes a position of the display range according to a detection result of the viewpoint detection sensor. The in-vehicle imaging system according to claim 3, wherein the display range changing unit changes the position of the display range in a direction opposite to a moving direction of the viewpoint obtained from a detection result of the viewpoint detection sensor. Further comprising a gaze detection sensor for detecting the gaze of the driver;
The display range changing unit detects the detection result of the viewpoint detection sensor on the condition that the line of sight obtained from the detection result of the line of sight detection sensor is directed to a predetermined setting range including at least a part of the screen of the display device. The in-vehicle imaging system according to claim 3 or 4, wherein the position of the display range is changed according to the condition. The viewpoint detection sensor detects the position of the driver's viewpoint or movement of the viewpoint by capturing the driver and identifying the driver's head or eyes from the captured image. The vehicle-mounted imaging system according to any one of claims. The viewpoint detection sensor detects a load received by a seat on which the driver sits or a seat belt worn by the driver, and detects a movement of the driver's viewpoint based on the detected change in the load. The in-vehicle imaging system according to any one of 5. The in-vehicle imaging system according to any one of claims 3 to 5, wherein the viewpoint detection sensor detects movement of the driver's viewpoint by detecting movement of the seat belt. The imaging device is configured to include a CMOS sensor that can output an image signal only for a part of its visual field,
The display range changing unit controls the CMOS sensor, thereby outputting an image signal only for the display range and causing the display device to display an image captured by the imaging device only for the display range. The in-vehicle imaging system according to claim 1, wherein the position of the display range is changed. The imaging device outputs an image signal having a width corresponding to the field of view,
The display range changing unit extracts a part of a signal from an image signal having a width corresponding to the field of view of the imaging device and outputs the signal to the display device, and the field of view of the imaging device in a range in which the signal is extracted The position of the display range is changed while the image captured by the imaging device is displayed only on the display range on the display device by changing the position in the display. In-vehicle imaging system.

Images