JP2018069806A - Display control device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display control device which allows a user to more easily recognize the content of a dead angle region when achieving display of the dead angle region of a vehicle by using a photographed image.SOLUTION: A display control device includes: an acquisition unit which acquires photographed image data from an imaging unit of imaging a vehicle outside region containing a dead angle region being the dead angle with a pillar section supporting a windshield of the vehicle when a driver is seated on a driver seat; an image processing unit which cuts out a dead angle visible image containing the dead angle region from the image based on the photographed image data; and a control unit which causes a display device arranged at a position of the pillar section so as to cover the dead angle region with the dead angle visible image to display the dead angle visible image.SELECTED DRAWING: Figure 7

Description

  Embodiments described herein relate generally to a display control apparatus.

  Conventionally, when the user wants to check the situation around the vehicle, for example, when turning right or left, or when changing lanes, an area that is difficult to visually check in a normal driving posture, such as when changing lanes, There is a so-called “blind spot”. In response to this problem, for example, in the case of a motorcycle (motorcycle), in addition to information obtained from the rearview mirror, a blind spot of the rearview mirror is obtained by displaying on the display device a screen by an imaging device that images the rear region. A backward visual recognition device that makes it easy for the user to recognize the state of the blind spot area behind has been proposed.

JP 2006-131213 A

  The “blind spot” problem also exists in vehicles other than motorcycles, such as four-wheel vehicles. In particular, in the case of a four-wheel vehicle, a large number of pillar portions (so-called “pillars”) that support window glass and a roof member on the body exist around the driver's seat. For example, in the case of a vehicle having four doors, there are a pair of front pillars (A pillars), center pillars (B pillars), rear pillars (C pillars), and the like. In recent years, there has been a tendency to increase the thickness of each pillar in order to improve the body rigidity, or the shape of the body has become complicated due to the improvement in design, resulting in an increase in “blind spot area”. In addition, for example, in the case of a four-wheeled vehicle, since there is a tendency that there are more blind spots compared to a motorcycle, it is difficult to apply the blind spot display technique using a captured image of a motorcycle as it is, and there is room for improvement. is there.

  Accordingly, one of the problems of the present invention is to provide a display control device that makes it easier for the user to recognize the contents of the blind spot area when the captured image is used to display the blind spot area of the vehicle. It is.

  The display control apparatus according to the embodiment of the present invention is, for example, imaged image data from an imaging unit that images a vehicle outside area including a blind spot area that becomes a blind spot by a pillar part that supports a window glass of a vehicle when seated in a driver's seat. An image processing unit that cuts out a blind spot visible image including the blind spot area from an image based on the captured image data, and a position of the column part that supplements the blind spot area with the blind spot visible image. A control unit that displays the blind spot visible image on the display device. According to this configuration, since the blind spot visible image is displayed on the display device arranged at the position of the pillar part that can compensate for the blind spot area, for example, as if the pillar part does not exist or has passed through the pillar part. The area outside the vehicle can be displayed. As a result, the user can obtain information on the outside area corresponding to the blind spot area by moving the line of sight during normal driving without changing the driving posture.

  For example, the acquisition unit of the display control apparatus according to the embodiment of the present invention images a vehicle outside area including a blind spot area that becomes a blind spot by a front column part that supports a front windshield in front of the position of the driver seat. The first captured image data from the imaging unit may be acquired, and the control unit may display the blind spot visible image on the display device arranged at the base of the front pillar. According to this configuration, for example, at the time of the backward confirmation operation using the side mirror performed during driving, it is possible to confirm the area that has become a blind spot by the front pillar portion. As a result, it becomes easier for the user to grasp the situation around the vehicle more quickly.

  For example, the image processing unit of the display control apparatus according to the embodiment of the present invention may change the cutout range of the blind spot visible image cut out from the captured image data according to the speed of the vehicle. The direction of the user's line of sight varies depending on the speed of the vehicle. For example, in the case of a low speed, the line of sight tends to be directed closer to the driver's seat. On the other hand, as the speed increases, there is a tendency to look closer. According to this configuration, for example, it is possible to provide a blind spot visible image corresponding to an appropriate blind spot area corresponding to the driving situation.

  The acquisition unit of the display control device according to the embodiment of the present invention further acquires, for example, second captured image data captured by a second imaging unit that captures a rear exterior area behind the driver seat position, The control unit displays an image based on the first captured image data on the display device when the vehicle can move forward, and displays an image based on the second captured image data on the display device when the vehicle can move backward. You may do it. According to this configuration, for example, in a state in which the vehicle can move forward, a blind spot visible image corresponding to a blind spot area existing ahead of the driver's seat that requires attention is displayed on the display device. On the other hand, when the vehicle is in a reversible state, an image showing a region behind the driver's seat that requires attention is displayed on the display device. At this time, for example, the second captured image displayed on the display device together with the area reflected on the side mirror that may be arranged near the base of the pillar part can be recognized without substantially moving the line of sight. As a result, the user can recognize a wider rear region.

  The image processing unit of the display control device according to the embodiment of the present invention detects, for example, a predetermined object in the blind spot area from the captured image data, and the control unit causes the vehicle to move in the direction of the blind spot area. When moving, guidance indicating the presence of the predetermined object may be output. According to this configuration, when the vehicle is directed in the direction in which the blind spot area exists, a predetermined object existing in the blind spot area, for example, a pedestrian or the like, can be detected and the presence thereof can be guided, for example, notified. As a result, for example, it becomes easier for the user to determine the state of the blind spot area more reliably.

FIG. 1 is a perspective view illustrating an example of a state in which a part of a passenger compartment of a vehicle on which the display control device according to the embodiment is mounted is seen through. FIG. 2 is a diagram illustrating an example of an area that becomes a blind spot when a user is seated in a driver's seat of a vehicle. FIG. 3 is a diagram illustrating an example of a blind spot generated by the right front pillar when a user is seated in the driver seat of a right-hand drive vehicle. FIG. 4 is a diagram illustrating an arrangement example of the display device and the imaging device used together with the display control device according to the embodiment. FIG. 5 is a diagram illustrating an example in which a blind spot visible image using the display control device of the present embodiment is displayed on a display device (right front pillar monitor) disposed on the right front pillar. FIG. 6 is a diagram for explaining an example in which a blind spot visible image using the display device of the present embodiment is displayed on a display device (left front pillar monitor) arranged on the left front pillar. FIG. 7 is a block diagram illustrating an example of a display system including the display control apparatus according to the present embodiment. FIG. 8 is a diagram for explaining a blind spot region to be dealt with by the display control apparatus when the speed at the intersection is equal to or higher than a predetermined speed, as an example, in the display control apparatus according to the embodiment. FIG. 9 is a diagram for explaining a blind spot area to be dealt with by the display control apparatus when the speed at the intersection is less than a predetermined speed, as an example, in the display control apparatus according to the embodiment. FIG. 10 is a flowchart for explaining an example of a processing procedure for realizing display of a blind spot visible image in the display control apparatus according to the embodiment.

  Hereinafter, exemplary embodiments of the present invention are disclosed. The configuration of the embodiment shown below and the operations, results, and effects brought about by the configuration are examples. The present invention can be realized by configurations other than those disclosed in the following embodiments, and at least one of various effects based on the basic configuration and derivative effects can be obtained. .

  FIG. 1 is a perspective view illustrating an example of a state in which a part of a passenger compartment 12 of a vehicle 10 equipped with a display control device according to an embodiment is seen through. In the present embodiment, the vehicle 10 equipped with a display control device (display control system) may be, for example, a four-wheeled vehicle having an internal combustion engine (not shown) as a drive source, that is, an internal combustion engine vehicle, or not shown. It may be an automobile using the electric motor as a drive source, that is, an electric automobile, a fuel cell automobile, or the like. Moreover, the hybrid vehicle which uses both of them as a drive source may be sufficient, and the vehicle provided with the other drive source may be sufficient.

  As illustrated in FIG. 1, the vehicle 10 constitutes a passenger compartment 12 in which an unillustrated occupant (driver, passenger) rides. A plurality of seats 14 such as a driver's seat 14a (driver's seat), a passenger's seat 14b (passenger seat), and a rear seat (not shown) are provided in the passenger compartment 12. A steering wheel 16 and a dashboard 18 are provided in a state facing the seat 14a. In the present embodiment, a right-hand drive vehicle in which the steering wheel 16 is disposed on the right side of the vehicle 10 is shown as an example. A monitor device 20 is provided at an almost central portion of the dashboard 18 as an information providing unit for providing various information to a driver (user) and a passenger. The monitor device 20 includes a display device 22 configured by, for example, an LCD (liquid crystal display), an OELD (organic electroluminescent display), or the like. The monitor device 20 includes an audio output device (for example, a speaker 23; see FIG. 7). The display device 22 is covered with a transparent operation input unit such as a touch panel, for example. An occupant (driver or passenger) can visually recognize an image displayed on the display screen of the display device 22 via the operation input unit. In addition, the occupant can execute an operation input by operating the operation input unit by touching, pushing, or moving the operation input unit with a finger or the like at a position corresponding to the image displayed on the display screen of the display device 22. The monitor device 20 can have an operation input unit (not shown) such as a switch, a dial, a joystick, and a push button. In addition, a voice output device (not shown) can be provided at another position in the passenger compartment 12 different from the monitor device 20, and voice can be output from the voice output device of the monitor device 20 and other voice output devices. Can do. Note that the monitor device 20 can also be used as, for example, a navigation system or an audio system.

  The vehicle 10 of this embodiment supports the window glass (front window glass, rear window glass, etc.) by the pillar 24 and is fixed to the body. Further, the pillar 24 is a part of a frame constituting the body of the vehicle 10 and supports the roof member and improves the body rigidity. The vehicle 10 shown in FIG. 1 has a structure including four doors as an example. The pillar 24 mainly includes a right front pillar 24aR, a left front pillar 24aL, and mainly a roof member that support the front window glass and the front part of the roof member. The right center pillar 24bR and the left center pillar (not shown) provided between the front and rear doors, the right rear pillar 24cR mainly supporting the rear portion of the rear window glass and the roof member, and the left rear pillar (not shown) are supported. ).

  FIG. 2 mainly shows that when a user 26 (driver) sits on a seat 14a (driver's seat) facing the steering wheel 16 in the vehicle 10, the right front pillar 24aR, the left front pillar 24aL, the right rear pillar 24cR, It is a figure explaining the area | region which becomes a blind spot by the left rear pillar 24cL. In the case of FIG. 2, the right center pillar 24bR and the left center pillar are not shown. For example, the right front blind spot region DFR is formed by the right front pillar 24aR. Similarly, a left front blind spot area DFL is formed by the left front pillar 24aL. Further, the left rear blind spot region DRL is formed by the left rear pillar 24cL, and the right rear blind spot region DRR is formed by the right rear pillar 24cR. The left rear blind spot area DRL and the right rear blind spot area DRR are driving angles in which the user 26 is seated on the seat 14a, and are blind spots formed by the right rear pillar 24cR and the left rear pillar 24cL in the rear view as viewed through the room mirror 29. It is an area. 2, the right side mirror 28R is formed in the vicinity of the base portion of the right front pillar 24aR, and the left side mirror 28L is formed in the vicinity of the base portion of the left front pillar 24aL. The right side mirror 28 </ b> R and the left side mirror 28 </ b> L are generally adjusted so as to reflect a far region behind the vehicle 10. Therefore, the road surface on the side of the vehicle 10 often does not fall within the field of view of the right side mirror 28R and the left side mirror 28L. In the case of the example shown in FIG. 2, the right side mirror 28R is outside the display range, that is, the road area on the right side of the vehicle 10 is indicated by the right side blind spot region DSR, and the left side mirror 28L is outside the display range, The left side road surface area is indicated by a left side blind spot area DSL.

  FIG. 3 is a diagram for explaining a specific example of how the blind spots generated by the right front pillar 24aR appear when the user 26 (driver; not shown) is seated in the driver's seat facing the steering wheel 16. In the example of FIG. 3, pedestrians 32 a to 32 d exist around the vehicle 10 as an example. A pedestrian 32a and a pedestrian 32b can be seen through the front window glass FW. A pedestrian 32d can be seen through the right side window SRW. On the other hand, the pedestrian 32c present in the blind spot in the right front pillar 24aR is not visible to the user 26 sitting in the driver's seat. The right front pillar 24aR and the left front pillar 24aL may have, for example, a rectangular observation window 30 for reducing the blind spot. However, the area that can be visually recognized by the observation window 30 is limited. In many cases, it is difficult to recognize the pedestrian 32c existing at a position as shown in FIG.

  The display control apparatus according to the present embodiment has the visibility by the right front blind spot area DFR, left front blind spot area DFL, left rear blind spot area DRL, right rear blind spot area DRR, left side blind spot area DSL, and right side blind spot area DSR. In order to eliminate the decrease, a plurality of imaging devices 34a to 34d and a plurality of display devices (right front pillar monitor 36a to right rear pillar monitor 36d) are used as shown in FIG. The imaging devices 34a to 34d are digital cameras that incorporate an imaging device such as a charge coupled device (CCD) or a CMOS image sensor (CIS). The imaging devices 34a to 34d can output moving image data (captured image data) at a predetermined frame rate. Each of the imaging devices 34a to 34d has, for example, a standard lens with little distortion, and can image a range of, for example, 90 ° in the horizontal direction. The right front pillar monitor 36a to the right rear pillar monitor 36d as the display device 36 are, for example, an LCD (liquid crystal display), an OELD (organic electroluminescent display), or the like. When the right front pillar monitor 36a to the right rear pillar monitor 36d are constituted by LCDs, a rectangular shape, a circular shape, or the like can be adopted. Further, in the case of OELD, the surface of the pillar 24 can be configured to follow the shape of the pillar 24 to form a display device, and imaging can be performed without making the user 26 aware of the presence of the display device. An image (a blind spot visible image) based on captured image data captured by the devices 34a to 34d can be displayed. The right front pillar monitor 36a to the right rear pillar monitor 36d do not have to be the same type (LCD or OELD), and may be combined as appropriate. For example, the right front pillar monitor 36a and the left front pillar monitor 36b may be OECD, and the left rear pillar monitor 36c and the right rear pillar monitor 36d may be LCDs. A specific example using OELD is shown in FIG.

  In the case of the present embodiment, the imaging device 34a and imaging device 34b are blinded by the left front pillar 24aL and the right front pillar 24aR (column part) that support the windshield FW in front of the position of the seat 14a that is the driver's seat. It may be referred to as a first imaging unit that captures an area outside the vehicle including the front blind spot area DFL and the right front blind spot area DFR. The captured image data provided from the first imaging unit may be referred to as first captured image data. In addition, the imaging device 34c and imaging device 34d that capture the rear outside area of the vehicle behind the position of the seat 14a are referred to as a second imaging unit, and the captured image data provided from the second imaging unit is referred to as second captured image data. There is.

  An imaging device 34a for acquiring a blind spot visible image for visualizing the right forward blind spot region DFR generated by the right front pillar 24aR is, for example, in the vicinity of the left front pillar 24aL in the vehicle compartment 12 of the vehicle 10, preferably the front The window glass FW is installed at a position so as to enter the wiper wiping area of the wiper disposed outside the vehicle. In other words, the vehicle exterior area can be clearly photographed without being affected by rain, snow and dirt due to dust or the like from the passenger compartment 12 during rain or snow. Then, a blind spot visible image corresponding to the right front blind spot area DFR is cut out from the image based on the captured image data of the right front imaging area VFR captured by the imaging device 34a. As shown in FIG. 5, the clipped blind spot visible image is displayed on the right front pillar monitor 36a (display device) disposed at the position of the right front pillar 24aR so as to supplement the right front blind spot region DFR (see FIG. 4). Is displayed. In other words, by displaying the blind spot visible image on the right front pillar monitor 36a, it is possible to provide a situation outside the vehicle that passes through the right front pillar 24aR (a situation outside the vehicle where the right front pillar 24aR does not exist). . In this case, the pedestrian 32c hidden when the right front blind spot region DFR is generated by the right front pillar 24aR in FIG. 3 is displayed and visualized on the right front pillar monitor 36a in FIG. As a result, the user 26 can easily recognize the presence of the pedestrian 32c.

  In the case where the right front pillar monitor 36a is configured by OELD, it can easily follow the shape of the right front pillar 24aR. In the case of FIG. 5, an example is shown in which the size of the right front pillar monitor 36a is about half from the base of the right front pillar 24aR upward. In another embodiment, the entire right front pillar 24aR may be covered with the right front pillar monitor 36a. In this case, although the upper area of the right front pillar monitor 36a mainly displays the sky area of the vehicle 10, it can be seen as a pillar-less, and there is an advantage that it is easy to give design features.

  The right front imaging area VFR of the imaging device 34a can image a wide area outside the vehicle including the right front blind spot area DFR, that is, the right front area of the vehicle 10. Therefore, even if the blind spot area recognized by the user 26 changes due to the physique and seating posture of the user 26 sitting on the seat 14a (driver's seat) facing the steering wheel 16, the front-rear position and the vertical position of the seat 14a, etc. The display range (cutout range) of the blind spot visible image displayed on the right front pillar monitor 36a can be easily adjusted, and the blind spot visible image supplementing the right forward blind spot area DFR according to the situation can be displayed.

  An imaging device 34b for acquiring a blind spot visible image for visualizing the left front blind spot region DFL generated by the left front pillar 24aL is, for example, in the vicinity of the right front pillar 24aR in the passenger compartment 12 of the vehicle 10. It can be installed in a similar manner. Then, a blind spot visible image corresponding to the left front blind spot area DFL is cut out from the image based on the captured image data of the left front imaging area VFL captured by the imaging device 34b. The cutout blind spot visible image is displayed on the left front pillar monitor 36b (display device) disposed at the position of the left front pillar 24aL so as to supplement the left front blind spot area DFL. Accordingly, the blind spot visible image is displayed on the left front pillar monitor 36b, so that, as in the example of the right front pillar monitor 36a shown in FIG. 5, the situation outside the vehicle that is transmitted through the left front pillar 24aL (the left front pillar Provision of a situation outside the vehicle where 24aL does not exist can be realized. The left front imaging area VFL of the imaging device 34b can image a wide range outside the vehicle including the left front blind spot area DFL, that is, the left front area of the vehicle 10, and similarly to the image captured by the imaging device 34a, the left front The display range (cutout range) of the blind spot visible image displayed on the pillar monitor 36b can be easily adjusted, and the blind spot visible image that complements the left front blind spot area DFL according to the situation can be displayed.

  The imaging device 34c for obtaining a blind spot visible image for visualizing the left rear blind spot region DRL generated by the left rear pillar 24cL recognized by the user 26 via the room mirror 29 is, for example, the base of the left front pillar 24aL of the vehicle 10 Can be disposed on the left side mirror 28L provided outside the vehicle. The imaging device 34c is preferably arranged so as to reduce the influence of rain, snow, dirt, and the like. For example, it may be arranged inside the housing case of the left side mirror 28L or may be provided with a hood in a manner that does not hinder the imaging range. The imaging range of the imaging device 34 c can be a left rear body including the left rear wheel periphery of the vehicle 10, a road surface around the left rear body, and a left rear region including the horizontal rear of the vehicle 10. Then, a blind spot visible image corresponding to the left rear blind spot area DRL is cut out from the image based on the captured image data of the left rear imaging area VSL captured by the imaging device 34c. The clipped blind spot visible image is displayed on the left rear pillar monitor 36c (display device) disposed at the position of the left rear pillar 24cL so as to compensate the left rear blind spot area DRL. That is, the blind spot visible image is displayed on the left rear pillar monitor 36c, so that, as in the example of the right front pillar monitor 36a shown in FIG. 5, the vehicle exterior situation (the left rear pillar 24cL exists) that is transmitted through the left rear pillar 24cL. It is possible to provide a situation outside the vehicle that does not seem to occur. The left rear imaging area VSL of the imaging device 34c can image a wide area outside the vehicle including the left rear blind spot area DRL, that is, the left rear area of the vehicle 10. Therefore, even when the blind spot area recognized by the user 26 via the room mirror 29 changes depending on the physique, the sitting posture, etc. of the user 26, it is displayed on the left rear pillar monitor 36c in the same manner as the images taken by the imaging device 34a and the imaging device 34b. It is possible to easily adjust the display range (cutout range) of the blind spot visible image to be displayed and to display the blind spot visible image that supplements the left rear blind spot area DRL according to the situation.

  As described above, the imaging range of the imaging device 34 c can be a left rear body including the left rear wheel periphery of the vehicle 10, a road surface in the vicinity thereof, and a left rear region including the horizontal rear of the vehicle 10. As described in FIG. 2, the left side blind spot area DSL is not included in the rear area reflected on the left side mirror 28L. For example, when moving the vehicle 10 to a parking space while moving backward, it may be difficult for the user 26 to grasp the situation around the left rear wheel (such as the vicinity of the ground contact portion of the left rear wheel). Therefore, when the vehicle 10 moves backward, the display control device according to the present embodiment includes the left rear body including the periphery of the left rear wheel in the left rear imaging region VSL imaged by the imaging device 34c on the left front pillar monitor 36b and its surroundings. Is extracted as a blind spot visible image corresponding to the left blind spot area DSL. Then, when the vehicle 10 is in a reversible state, for example, when the shift lever is moved to the reverse position (“R”), as shown in FIG. 6, the left front arranged in the left front pillar 24aL. The display on the pillar monitor 36b is switched from the blind spot visible image corresponding to the left front blind spot area DFL to the blind spot visible image corresponding to the left side blind spot area DSL. Since the left front pillar monitor 36b is disposed at the base of the left side mirror 28L, the user 26 can check the display content of the left front pillar monitor 36b at that time when viewing the left side mirror 28L when retreating. For example, it is possible to easily recognize the partition line 38a shown in the parking space that is difficult to confirm with the left side mirror 28L, the wheel stopper 38b arranged in the parking space, and the like. Further, since the imaging device 34c is installed on the left side mirror 28L and images the area outside the vehicle from the position, the wall 38c reflected on the mirror surface 28a of the left side mirror 28L is also displayed on the left front pillar monitor 36b. Is possible. The left rear imaging region VSL also includes a host vehicle image 10a showing the vehicle 10 and is displayed on the left front pillar monitor 36b. Therefore, the positional relationship between the vehicle 10 and the lane markings 38a and wheel stoppers 38b is also easy. It can be grasped. As a result, following confirmation of the left rear pillar monitor 36c via the room mirror 29, confirmation of the left front pillar monitor 36b and the left side mirror 28L is performed, thereby allowing the user 26 to check the left side of the vehicle 10 and the left rear exterior. It is possible to easily check the situation (check the entire area of the left area) and to make it easier to intuitively grasp the situation outside the vehicle.

  An imaging device 34d for obtaining a blind spot visible image for visualizing the right rear blind spot region DRR generated by the right rear pillar 24cR recognized by the user 26 via the room mirror 29 is, for example, the base of the right front pillar 24aR of the vehicle 10 Can be disposed on the right side mirror 28R provided outside the vehicle. Similarly to the imaging device 34c, the imaging device 34d may be disposed inside the housing case of the right side mirror 28R or may be provided with a hood in a manner that does not interfere with the imaging range. The imaging range of the imaging device 34 d can include a right rear body including the right rear wheel periphery of the vehicle 10, a road surface around the right rear body, and a right rear region including the horizontal rear of the vehicle 10. Then, a blind spot visible image corresponding to the right rear blind spot area DRR is cut out from the image based on the captured image data of the right rear pickup area VSR captured by the imaging device 34d. The cutout blind spot visible image is displayed on the right rear pillar monitor 36d (display device) disposed at the position of the right rear pillar 24cR so as to supplement the right rear blind spot area DRR. By displaying the blind spot visible image on the right rear pillar monitor 36d, as in the example of the right front pillar monitor 36a shown in FIG. 5, the vehicle is in a state of being transmitted through the right rear pillar 24cR (the right rear pillar 24cR does not exist). Can be provided. The right rear imaging region VSR of the imaging device 34d can image a wide area outside the vehicle including the right side blind spot region DSR, that is, the right rear region of the vehicle 10. Therefore, even when the blind spot area recognized by the user 26 via the room mirror 29 changes depending on the physique and sitting posture of the user 26, the blind spot visible image displayed on the right rear pillar monitor 36d is the same as the image captured by the imaging device 34c. Can be easily adjusted to display a blind spot visible image that compensates for the right rear blind spot area DRR according to the situation.

  As described above, the imaging range of the imaging device 34d can also be a right rear body including the periphery of the right rear wheel of the vehicle 10, a road surface in the vicinity thereof, and a right rear region including the horizontal rear of the vehicle 10. The rear area reflected on the right side mirror 28R does not include the right side blind spot area DSR. Therefore, when the vehicle 10 moves backward, the right rear blind area including the right rear body including the periphery of the right rear wheel and the surrounding road surface in the right rear imaging area VSR imaged by the imaging device 34d on the right front pillar monitor 36a. Cut out as a blind spot visible image corresponding to DSR. When the vehicle 10 is in a reversible state, the right front pillar monitor 36a is displayed on the right side from the blind spot visible image corresponding to the right front blind spot area DFR, as in the example of the left front pillar monitor 36b shown in FIG. Switching to a blind spot visible image corresponding to the blind spot area DSR. Since the right front pillar monitor 36a is arranged at the base of the right side mirror 28R, the user 26 confirms the right rear pillar monitor 36d via the rear mirror 29 and then checks the right front pillar monitor 36a and the right side mirror 28R. By performing the confirmation, the user 26 can easily confirm the vehicle exterior situation on the right side and the right rear side of the vehicle 10 (confirmation of almost the entire area of the right region) and intuitively grasp the vehicle exterior situation. It can be made easier. Note that the imaging ranges of the imaging device 34a and the imaging device 34b can be substantially the same. Similarly, the imaging ranges of the imaging device 34c and the imaging device 34d can be substantially the same.

  It should be noted that the confirmation of the vehicle exterior situation on the right side and the right rear side of the vehicle 10 can be executed by the user 26 looking back from the right side window SRW, and therefore the right rear pillar monitor 36d and the imaging device 34d are omitted as appropriate. May be. In another embodiment, a dedicated imaging device that images the rear region of the vehicle 10 may be provided. In this case, the rear dedicated imaging device may be provided, for example, on the inner side of the rear window or on the rear end of the vehicle body, for example, on the outer wall surface of the rear trunk. In this case, the imaging range of the imaging device 34c and the imaging device 34d may be the rear body including the periphery of the rear wheel and the road surface around the rear body. In this way, by narrowing the imaging range by dedicating the imaging device to each blind spot area, it becomes easy to acquire a high-quality image with little distortion.

  FIG. 7 is a block diagram illustrating an example of a display system 100 including a display control device that displays a blind spot visible image as described above. The ECU 40 constituting the display control device includes, for example, a CPU 40a (central processing unit), a ROM 40b (read only memory), a RAM 40c (random access memory), an SSD 40d (solid state drive, flash memory), and the like.

  For example, the CPU 40 a cuts out a blind spot visible image corresponding to each blind spot area from an image based on the captured image data captured by the imaging device 34 (34 a to 34 d) and displays the blind spot visible image on the display device 36 or according to the state of the vehicle 10. The blind spot visible image displayed on the display device 36 (36a to 36d) is switched. In addition, a predetermined object is detected from the blind spot visible image, and processing for notifying the user 26 of the presence of the object is executed. The CPU 40a reads a program stored (installed) in a non-volatile storage device such as the ROM 40b or the SSD 40d, and executes arithmetic processing according to the program. Details of each module will be described later.

  The RAM 40c temporarily stores various data used in the calculation by the CPU 40a. The SSD 40d is a rewritable nonvolatile storage unit that can store data even when the power of the ECU 40 is turned off. Note that the CPU 40a, the ROM 40b, the RAM 40c, and the like can be integrated in the same package. Further, the ECU 40 may be configured such that another logical operation processor such as a DSP (digital signal processor), a logic circuit, or the like is used instead of the CPU 40a. Further, an HDD (hard disk drive) may be provided instead of the SSD 40d, and the SSD 40d and the HDD may be provided separately from the display control ECU 40.

  For example, the imaging device 34 (imaging devices 34a to 34d) and the display device 36 (right front pillar monitor 36a, left front pillar monitor 36b, left rear pillar monitor 36c, right side) are connected to the CPU 40a via an interface (not shown). In addition to the rear pillar monitor 36d), the monitor device 20 (display device 22, speaker 23) is electrically connected to send and receive various control signals. Further, a wheel speed sensor 42, a shift sensor 44, a rudder angle sensor 46, a winker operation unit 48, a brake system 50, and the like are connected to the CPU 40a through an interface.

  The wheel speed sensor 42 is, for example, a sensor that detects the amount of rotation of the wheels of the vehicle 10 and the number of rotations per unit time. The wheel speed sensor 42 is disposed on each wheel, and outputs a wheel speed pulse number indicating the rotation speed detected by each wheel as a sensor value. The wheel speed sensor 42 can be configured using, for example, a hall element. The ECU 40 calculates the vehicle speed, movement amount, and the like of the vehicle 10 based on the sensor value acquired from the wheel speed sensor 42, and executes various controls. When calculating the vehicle speed of the vehicle 10 based on the sensor value of each wheel speed sensor 42, the ECU 40 determines the vehicle speed of the vehicle 10 based on the speed of the wheel having the smallest sensor value among the wheels, and executes various controls. . In the case of this embodiment, the sensor value detected by the wheel speed sensor 42 is used to switch the display range of the blind spot visible image displayed on the right front pillar monitor 36a or the left front pillar monitor 36b (switching the cutout range of the captured image data). ) Can be used as one of the command signals.

  The shift sensor 44 is, for example, a sensor that detects an operation position of a shift lever protruding from the center console. The shift sensor 44 may include a displacement sensor or may be configured as a switch. The detection signal detected by the shift sensor 44 can be used when determining whether the vehicle 10 can move forward or backward. According to the result, for example, the left front pillar monitor 36b displays the left front blind spot area DFL. It can be determined whether to display the corresponding blind spot visible image or to display the blind spot visible image corresponding to the left side blind spot area DSL.

  The steering angle sensor 46 is a sensor that detects a steering amount of the steering wheel 16 or the like, for example. The rudder angle sensor 46 is configured using, for example, a hall element. The ECU 40 acquires the steering amount of the steering wheel 16 by the user 26 and the steering amount of each wheel during automatic steering from the steering angle sensor 46 and executes various controls. The rudder angle sensor 46 is an example of an angle sensor. The detected value of the rudder angle sensor 46 is one of the command signals for switching the display range of the blind spot visible image displayed on the right front pillar monitor 36a and the left front pillar monitor 36b, similarly to the sensor value of the wheel speed sensor 42. It can be used as one. In addition, when a “pedestrian” or the like is detected in the blind spot visible image, for example, it can be used as a determination signal when determining whether or not a situation that calls attention is made.

  The winker operation unit 48 is a lever arranged in the vicinity of the steering wheel 16 and is operated by the user 26 when blinking the winker that displays the intention when the vehicle 10 is turned, and an operation signal indicating the operation state is displayed. Output. As with the detected value of the steering angle sensor 46, the operation signal of the blinker operation unit 48 is one of command signals for switching the display range of the blind spot visible image displayed on the right front pillar monitor 36a and the left front pillar monitor 36b. It can be used as one. Further, when a “pedestrian” or the like is detected in the blind spot visible image, for example, it can be used as a determination signal when determining whether or not to call attention.

  The brake system 50 includes, for example, an anti-lock brake system (ABS) that suppresses brake locking, an anti-slip device (ESC: electronic stability control) that suppresses side slip of the vehicle 10 during cornering, and enhances braking force ( Electric brake system that executes brake assist, BBW (brake by wire), etc. The brake system 50 applies a braking force to the wheels and thus to the vehicle 10 via the actuator 50a. In addition, the brake system 50 can execute various controls by detecting a brake lock, a wheel idling, a sign of skidding, or the like based on a difference in rotation between the left and right wheels. The brake sensor 50b is, for example, a sensor that detects the position of the brake pedal. The brake sensor 50b includes a displacement sensor. In the case of the present embodiment, the brake system 50 automatically decelerates or stops the vehicle 10 when the ECU 40 detects an object to which attention should be paid, such as “pedestrian”, in the blind spot visible image. Can be.

  The CPU 40a included in the ECU 40 includes various modules as shown in FIG. 7 in order to realize the display control of the blind spot visible image as described above. The CPU 40a includes an acquisition unit 52, an image processing unit 54, a control unit 56, and the like as modules. The control unit 56 includes a display control unit 58, a display switching unit 60, a guidance control unit 62, a vehicle control unit 64, and the like. These modules can be realized by reading a program installed and stored in a storage device such as the ROM 40b and executing it.

  The acquisition unit 52 includes captured image data (first captured image data) provided from the imaging device 34a (first imaging unit) that captures an outside vehicle area including the right front blind spot area DFR, and an outside vehicle area including the left front blind spot area DFL. Captured image data (first captured image data) provided from the imaging device 34b (first imaging unit) that captures images is acquired. In addition, the imaged image data (second imaged image data) provided from the imaging device 34c (second imaging unit) that images the vehicle exterior area including the left side blind spot area DSL and the left rear blind spot area DRL, the right side blind spot area DSR, Captured image data (second captured image data) provided from the imaging device 34d (second imaging unit) that captures an outside vehicle area including the right rear blind spot region DRR is acquired. In addition, the acquisition unit 52 acquires various detection values provided from the wheel speed sensor 42, the shift sensor 44, the rudder angle sensor 46, the winker operation unit 48, the brake sensor 50b, and the like.

  The image processing unit 54 performs a process of cutting out a blind spot visible image including each blind spot area from an image based on the captured image data acquired by the acquisition unit 52. Further, the image processing unit 54 can change the extraction range of the blind spot visible image extracted from the captured image data acquired by the acquisition unit 52 according to the speed of the vehicle 10. For example, as shown in FIG. 8, when the vehicle 10 makes a right turn at a relatively large intersection 70, there is a sufficient distance to the pedestrian crossing 70a where there may be a pedestrian 32 to pay attention to. It is relatively easy to grasp the situation inside, for example, the situation on the near side of the intersection 70. In this case, the user 26 tries to check the status of the pedestrian crossing 70a while maintaining a certain speed while facing almost the front. In such a case, the right front blind spot area DFR by the right front pillar 24aR felt by the user 26 is as shown in FIG. On the other hand, as shown in FIG. 9, when the vehicle 10 tries to enter a relatively small intersection 70, the distance until the vehicle 10 finishes passing through the intersection 70 is relatively short, and a wall or a building near the intersection 70, etc. As a result, the blind spot area from the position of the user 26 increases, and it becomes more difficult to grasp the situation in the intersection 70, for example, the situation on the near side of the intersection 70 than in the case of FIG. In this case, the user 26 turns the line of sight toward the corner of the intersection 70 and confirms the presence or absence of the pedestrian 32, while reducing the vehicle speed from the case of FIG. Try to check the edges more carefully. In such a case, the right front blind spot area DFR by the right front pillar 24aR felt by the user 26 is as shown in FIG.

  Therefore, when the vehicle speed is equal to or higher than a predetermined speed, for example, when the vehicle speed is 6 km / h or higher, the image processing unit 54 sets the cut-out range of the blind spot visible image from the captured image data acquired by the acquisition unit 52 as shown in FIG. As the cut-out image range “A” in the imaging region VFR, the display control unit 58 causes the right front pillar monitor 36 a to display the blind spot visible image cut out in the cut-out image range “A”. As a result, the user 26 operates in the same manner as a normal driving operation when passing through a relatively large intersection 70 as shown in FIG. 8, that is, a situation in which the user 26 faces substantially forward and is near the corner of the intersection 70 at the corner of the field of view. Can be confirmed. In addition, when the vehicle speed is less than a predetermined speed, for example, when the vehicle speed is less than 6 km / h, when the right turn operation signal indicating the intention of turning right is output from the turn signal operation unit 48, the acquisition unit 52 acquires As shown in FIG. 4, the cutout range of the blind spot visible image from the captured image data is set as the cutout image range “B” in the right front imaging region VFR, and the display control unit 58 cuts out the cutout image range “B”. A blind spot visible image is displayed on the right front pillar monitor 36a. As a result, the user 26 can perform an operation similar to a normal driving operation when passing through a relatively small intersection 70 as shown in FIG. 9, that is, the end closer to the vehicle 10, particularly the end closer to the vehicle 10. It becomes easy to confirm. As shown in FIG. 4, the imaging device 34a that captures the right front imaging area VFR corresponding to the right front blind spot area DFR has an intersection 70 at a shallower angle in front of the vehicle 10 than the user 26 sitting on the seat 14a. It is installed at the position on the passenger seat side where the front side of the can be photographed. As a result, the right front imaging region VFR using the cut-out image range “B” can obtain an image in which the user 26 tries to secure his / her field of vision when turning right. That is, the user 26 can confirm the right front blind spot area DFR blocked by the right front pillar 24aR on the right front pillar monitor 36a without changing the driving posture (without getting out of the body). The same applies to the case where the vehicle 10 is about to turn left, and the cut-out image range of the left front imaging area VFL is switched between the range “A” and the range “B” so as to compensate for the left front blind spot area DFL.

  In addition, the image processing unit 54 of the present embodiment can detect a predetermined object in the corresponding blind spot area, for example, “pedestrian” from the captured image data captured by each imaging device 34. For example, some imaging devices can acquire infrared image data together with visible light image data. When such an imaging device is used as each imaging device 34, an image for a blind spot visible image can be acquired, and for example, an infrared image for detecting the presence or absence of “pedestrian (human)” can be acquired. That is, each imaging device 34 can function as an infrared thermography. Infrared thermography detects infrared radiant energy emitted from an object, converts it to an apparent temperature, and displays an image of the temperature distribution. The presence or absence of a human or animal in the image can be detected. In the case of infrared image data, the detection result may shift depending on the air temperature or the road surface temperature. In such a case, the detection accuracy of a predetermined object (for example, a human being or an animal) may be improved by comparing the sample shape data of the object stored in advance with the temperature distribution of the infrared image. In another embodiment, a predetermined object (for example, a human being or an animal) is detected by comparing the sample shape data of the object stored in advance with the visible light image data by using a well-known pattern recognition technique. Also good.

  The display control unit 58 displays the blind spot visible image on the right front pillar monitor 36a disposed at the position of the right front pillar 24aR so as to supplement the right forward blind spot area DFR with the blind spot visible image. Similarly, the blind spot visible image is displayed on the left front pillar monitor 36b arranged at the position of the left front pillar 24aL so as to supplement the blind spot area such as the left front blind spot area DFL with the blind spot visible image. Further, the blind spot visible image acquired by the imaging device 34c (imaging device 34d) is also displayed on the left rear pillar monitor 36c (right rear pillar monitor 36d). The display control unit 58 acquires the right front pillar monitor 36a and the left front pillar monitor 36b with the imaging device 34a and the imaging device 34b when the vehicle 10 can move forward (when the shift lever is in the “D” position or the like). A blind spot visible image in front of the vehicle 10 is displayed. On the other hand, when the vehicle 10 can move backward (when the shift lever is in the “R” position), the left blind spot area DSL or the right side captured by the imaging device 34c or the imaging device 34d on the right front pillar monitor 36a or the left front pillar monitor 36b. A blind spot visible image corresponding to the blind spot area DSR is displayed.

  As described with reference to FIG. 4, the display switching unit 60 displays the left front imaging region VFL on the left front pillar monitor 36 b (right front pillar monitor 36 a) based on the traveling state of the vehicle 10, for example, whether it can move forward or backward. Switching between (right front imaging area VFR) and left rear imaging area VSL (right rear imaging area VSR) is switched. This switching may be performed automatically based on the operation state of the shift lever, or may be performed manually by the user 26 using a switch or the like. When the shift lever is in the “P” position, the default blind spot visible image may be displayed, and the user 26 may manually switch to the rear blind spot visible image display using a switch or the like. .

  The guidance control unit 62 performs control related to guidance information for notifying the user 26 of the presence of a pedestrian when the image processing unit 54 detects a predetermined object such as a “pedestrian” in the blind spot visible image. . For example, the guidance control unit 62 outputs a message held in the ROM 40b or the like, for example, a voice message such as “There is a pedestrian in the visible image of the right blind spot. A similar text message may be displayed on the device 22. Further, a warning lamp may be lit in a blind spot visible image displayed on the right front pillar monitor 36a or the left front pillar monitor 36b, or a message mark (for example, “!”) May be displayed.

  The vehicle control unit 64 executes deceleration of the vehicle 10 via the brake system 50 regardless of the operation of the user 26 when the image processing unit 54 detects a predetermined object (for example, a pedestrian) in the blind spot visible image. Or turn on the brake lamp automatically.

  An example of a processing procedure for realizing the processing related to the display of such a blind spot visible image will be described with reference to the flowchart of FIG.

  The CPU 40a does not execute this flow when the ignition switch (IG) is not ON, that is, when the power of the vehicle 10 is not ON (No in S100). On the other hand, when the IG is ON (Yes in S100), the CPU 40a acquires captured image data obtained by imaging the vehicle outside area of the vehicle 10 from each imaging device 34 (34a to 34d) (S102). When the current shift lever position is not the reverse “R” position and the vehicle is in a forward advanceable state (No in S104), the display switching unit 60 is based on the detection value from the rudder angle sensor 46 or the output value of the winker operation unit 48. It is determined whether or not the vehicle 10 may turn (S106). If the steering wheel 16 is rotated by a predetermined amount in either the left or right direction from the neutral position, or if the left or right turn signal is lit (Yes in S106), the control unit 56 controls the image processing unit 54. To confirm whether a predetermined object, for example, “person” is detected in the target blind spot area of the front in the direction of turning (S108). For example, when the turning direction is the right direction and “person” is detected in the right front blind spot area DFR (Yes in S108), the guidance control unit 62 outputs a front alarm that calls the user 26 to be alerted. (S110). Then, based on the sensor value output from the wheel speed sensor 42, the image processing unit 54 determines that the current front speed V is equal to or higher than the predetermined speed αkm / h (Yes in S112), for example, 6 km / h or higher. The range “A” is selected as the cut-out image range of the right front imaging region VFR to be displayed on the pillar monitor 36a (S114). Further, when the current vehicle speed V is less than the predetermined speed α km / h (No in S112), for example, less than 6 km / h, the image processing unit 54 displays the right front imaging region VFR to be displayed on the right front pillar monitor 36a. The range “B” is selected as the cutout image range (S116). When the turning direction is the left direction, the same processing is executed for the left front imaging area VFL displayed on the left front pillar monitor 36b.

  When the vehicle 10 does not turn in S106 (No in S106), the CPU 40a, for example, when the detected value of the rudder angle sensor 46 indicates that the operation position of the steering wheel 16 is substantially a neutral position, or the winker operation unit 48. Is not operated (the blinker is not lit), the process of S108 to S112 is skipped and the process proceeds to S114. In other words, the right front pillar monitor 36a and the left front pillar monitor 36b are displayed in the display state, that is, the right front blind spot area DFR, which is a blind spot area when the user 26 is seated in the front facing the seat 14a, left The blind spot visible image corresponding to the front blind spot area DFL is determined to be cut out in the range “A”.

  On the other hand, when “person” is not detected in the front turning blind spot area in the direction to turn in S108 (No in S108), the CPU 40a skips the processing of S110 and proceeds to S112 to execute the subsequent processing.

  The display control unit 58 is used for the right front pillar monitor 36a and the left front pillar monitor 36b based on the clipped image range selected by the image processing unit 54, and the front side blind spot corresponding to the right front blind spot area DFR and the left front blind spot area DFL. An image cutout process of a visible image is executed. Similarly, cut-out image processing of a blind spot visible image corresponding to the left rear blind spot area DRL and right rear blind spot area DRR is executed from the captured image data captured by the left rear pillar monitor 36c and the right rear pillar monitor 36d (S118). Then, the display control unit 58 displays the front cutout images corresponding to the right front blind spot area DFR and the left front blind spot area DFL on the right front pillar monitor 36a and the left front pillar monitor 36b. Further, the display control unit 58 displays a rear cutout image as a blind spot visible image corresponding to the left rear blind spot area DRL and the right rear blind spot area DRR on the left rear pillar monitor 36c and the right rear pillar monitor 36d (S120). Then, when the blind spot visible image display end condition is satisfied (Yes in S122), for example, when the IG is turned OFF, this flow is temporarily ended. If the blind spot visible image display end condition is not satisfied (No in S122), the process returns to S102 and the display of the blind spot visible image is continued.

  In S104, when the current shift lever position is the reverse “R” position (Yes in S104), the display switching unit 60 displays an image to be displayed on the right front pillar monitor 36a and the left front pillar monitor 36b. The image is switched to the image captured by the imaging device 34d (S124). In this case, the display control unit 58 performs image extraction processing of the rear-side blind spot visible image corresponding to the left-side blind spot area DSL and the right-side blind spot area DSR for the right front pillar monitor 36a and the left front pillar monitor 36b. . Similarly, cut-out image processing of a blind spot visible image corresponding to the left rear blind spot area DRL and right rear blind spot area DRR is executed from the captured image data captured by the left rear pillar monitor 36c and the right rear pillar monitor 36d (S126). Then, the display control unit 58 displays cut-out images of the side road surfaces corresponding to the left side blind spot area DSL and the right side blind spot area DSR on the right front pillar monitor 36a and the left front pillar monitor 36b. Further, on the left rear pillar monitor 36c and the right rear pillar monitor 36d, a rear cutout image is displayed as a blind spot visible image corresponding to the left rear blind spot area DRL and the right rear blind spot area DRR (S128). Then, the control unit 56 confirms whether “person” is detected in the rear target blind spot area of the left side blind spot area DSL, the right side blind spot area DSR, the left rear blind spot area DRL, and the right rear blind spot area DRR (S130). . When a predetermined object, for example, a “pedestrian” such as a pedestrian is detected in the target blind spot area of the rear (Yes in S130), the guidance control unit 62 causes the user 26 to call attention when the vehicle 10 is moved backward. An alarm is output (S132), the process proceeds to S122 and the process is continued. For example, a voice message such as “There is a pedestrian behind the vehicle 10. Be careful.” Is output from the speaker 23, or a text message having the same content is output from the display device 22. On the other hand, if “person” is not detected in the rear target blind spot area in S130 (No in S130), the CPU 40a skips the process in S132 and proceeds to S122 to continue the process.

  As described above, according to the display control apparatus of the present embodiment, when the display of the blind spot area of the vehicle 10 is realized using the captured image, the user 26 can more easily recognize the contents of the blind spot area.

  In the above-described embodiment, the right front pillar monitor 36a, the left front pillar monitor 36b, the left rear pillar monitor 36c, and the right rear pillar monitor 36d have shown examples in which a blind spot visible image is always displayed when the IG is ON. It may be displayed only when the user 26 operates a display switch or the like.

  Further, as described above, the blind spot area recognized by the user 26 changes due to the physique of the user 26 (driver), the sitting posture, the position of the seat 14a, and the like. In this case, a known line-of-sight detection device provided in the passenger compartment 12 is used to detect the position of the line of sight in the normal sitting posture of the user 26, or the position of the seat 14a (front and rear positions and height The blind spot area may be automatically detected, and the range of the blind spot visible image cut out from the captured image data captured by each imaging device 34 may be determined. In this case, the difference between the image displayed by each display device 36 and the actual outside scenery is reduced, and a display with a more uncomfortable feeling can be realized. In another embodiment, the display area of the blind spot visible image displayed on each display device 36 may be intentionally wider than the actual blind spot area. In this case, the situation around the blind spot area can be confirmed on each display device 36, and the area outside the vehicle including the blind spot area can be easily grasped on the display device 36. These displays may be switchable by the user 26.

  In the above-described embodiment, an example in which the cut-out image area “A” for the front pillar and the cut-out image area “B” are switched according to the vehicle speed has been described, but may be switched by an operation by the user 26, for example. In this case, it is possible to prevent the screen from being switched more than necessary. Further, when the display device 36 is configured by an LCD, the LCD main body may protrude from the pillar 24. In this case, a blind spot area including the area blocked by the LCD main body may be used, or the range of the blind spot visible image cut out from the right rear imaging area VSR or the like may be adjusted. In this case, even if an LCD that is relatively cheaper than OELD is used, the display quality of the blind spot visible image can be made equal to that when OELD is used. Further, in the above-described embodiment, an example in which the blind spot area generated when turning right or left is mainly supplemented with the blind spot visible image. However, for example, the blind spot area generated by the pillar 24 when changing the lane or the like is supplemented with the blind spot visible image. Is also possible, and the same effect can be obtained.

  Although embodiments and modifications of the present invention have been described, these embodiments and modifications are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

  DESCRIPTION OF SYMBOLS 10 ... Vehicle, 24 ... Pillar, 24aL ... Left front pillar, 24aR ... Right front pillar, 24cL ... Left rear pillar, 24cR ... Right rear pillar, 26 ... User, 28L ... Left side mirror, 28R ... Right side mirror, 29 ... Room mirror 32, 32a, 32b, 32c, 32d ... Pedestrian, 34, 34a, 34b, 34c, 34d ... Imaging device, 36 ... Display device, 36a ... Right front pillar monitor, 36b ... Left front pillar monitor, 36c ... Left rear pillar Monitor, 36d ... Right rear pillar monitor, 40 ... ECU, 40a ... CPU, 42 ... Wheel speed sensor, 44 ... Shift sensor, 46 ... Steering angle sensor, 48 ... Blinker operation unit, 50 ... Brake system, 52 ... Acquisition unit, 54 ... image processing unit, 56 ... control unit, 58 ... display control unit, 60 ... display switching unit, 62 ... plan Control part, 64 ... Vehicle control part, DFL ... Left front blind spot area, DFR ... Right front blind spot area, DRL ... Left rear blind spot area, DRR ... Right rear blind spot area, DSL ... Left side blind spot area, DSR ... Right side blind spot area , VFL: left front imaging area, VFR: right front imaging area, VSL ... left rear imaging area, VSR ... right rear imaging area.

Claims (5)

An acquisition unit that acquires captured image data from an imaging unit that captures an area outside the vehicle including a blind spot area that becomes a blind spot by a pillar that supports the window glass of the vehicle when seated in a driver's seat;
An image processing unit that cuts out a blind spot visible image including the blind spot area from an image based on the captured image data;
A control unit for displaying the blind spot visible image on a display device arranged at the position of the pillar part so as to supplement the blind spot area by the blind spot visible image;
A display control device. The acquisition unit acquires first captured image data from a first imaging unit that images a vehicle exterior region including a blind spot region that is a blind spot by a front pillar supporting a front windshield in front of the position of the driver seat;
The display control device according to claim 1, wherein the control unit displays the blind spot visible image on the display device arranged at a base portion of the front pillar portion.   The display control apparatus according to claim 1, wherein the image processing unit changes a cutout range of the blind spot visible image cut out from the captured image data according to a speed of the vehicle. The acquisition unit further acquires second captured image data captured by a second imaging unit that captures a rear outside region behind the position of the driver seat,
The control unit displays an image based on the first captured image data on the display device when the vehicle can move forward, and displays an image based on the second captured image data on the display device when the vehicle can move backward. The display control apparatus according to claim 2. The image processing unit detects a predetermined object in the blind spot area from the captured image data,
The display control device according to any one of claims 1 to 4, wherein the control unit outputs a guide indicating the presence of the predetermined object when the vehicle moves in the direction of the blind spot region.

Images