WO2016185677A1

WO2016185677A1 - Vehicle periphery display device and vehicle periphery display method

Info

Publication number: WO2016185677A1
Application number: PCT/JP2016/002214
Authority: WO
Inventors: 大貴五藤
Original assignee: 株式会社デンソー
Priority date: 2015-05-15
Filing date: 2016-04-27
Publication date: 2016-11-24
Also published as: JP2016215726A

Abstract

A vehicle periphery display device equipped with an image acquisition unit (21), an image display unit (23), a state determination unit (24), and a display region change unit (25). The image acquisition unit (21) acquires a first peripheral image and a second peripheral image, which respectively capture a first region and a second region that differ from one another in an exterior peripheral region of a vehicle. The image display unit (23) displays the first and second peripheral images captured by the image acquisition unit (21) on one screen of a display device provided inside a vehicle compartment. The state determination unit (24) determines the state of travel of the vehicle. The display region change unit (25) sets the region in which the first peripheral image is displayed on the display screen of the display device as a principal display region, and sets the region thereof in which the second peripheral image is displayed as a secondary display region, and according to the determination results from the state determination unit (24), causes the image display unit (23) to enlarge the secondary display region when prescribed travel state conditions are met.

Description

Vehicle periphery display device and vehicle periphery display method

Cross-reference of related applications

This application is based on Japanese Patent Application No. 2015-1000016 filed on May 15, 2015, the contents of which are incorporated herein by reference.

The present disclosure relates to a vehicle periphery display device and a vehicle periphery display method for displaying an image of an external periphery region of the vehicle.

Conventionally, a technology has been proposed in which a display is provided inside each of the pair of left and right front pillars in a vehicle, and an image of a blind spot area outside the vehicle that is generated when the driver's field of view is blocked by the front pillars is displayed (patent) Reference 1).

International Publication No. 2009/157446

Nowadays, it is desired to reduce the number of displays as much as possible from the viewpoints of cost, vehicle interior design, and the like. In addition, in a configuration for displaying an image or the like of the external peripheral area of the vehicle, it is desired to present the image or the like of a plurality of areas to the driver in addition to the blind spot area.

However, in the conventional technology, for example, if an image of the blind spot area is presented to the driver in an easy-to-understand manner so that the pillar is transmitted, there is a restriction that a dedicated display must be arranged along the pillar. However, there is a problem that it is difficult to present a plurality of areas of video to the driver on one display.

The present disclosure has been made in view of the above points, and it is possible to easily present a video image of a plurality of areas in the external peripheral area of the vehicle to the driver without unnecessarily increasing the number of display devices. An object of the present invention is to provide a display device and a vehicle periphery display method.

The vehicle periphery display device according to an aspect of the present disclosure includes an image acquisition unit, an image display unit, a situation determination unit, and a display area change unit. The image acquisition unit acquires a first peripheral image and a second peripheral image obtained by imaging a first region and a second region that are different from each other in the external peripheral region of the vehicle.

The image display unit displays the first peripheral image and the second peripheral image acquired by the image acquisition unit on one screen of a display device provided in the vehicle interior. The situation determination unit determines a traveling situation of the vehicle.

The display area changing unit uses a display area of the display device in which the first peripheral image is displayed as a main display area and the second peripheral image is displayed as a sub display area. Accordingly, when a predetermined traveling condition is satisfied, the sub display area is enlarged on the image display unit.

According to such a configuration, a plurality of peripheral images are displayed on the display screen with a master-slave relationship, so that the driver can intuitively know the image portion corresponding to each of the external peripheral regions of the vehicle. It becomes possible. Furthermore, by expanding the sub display area according to the driving situation of the vehicle, the driver can instantly understand the area that has become necessary to be checked according to the driving scene, and an image of the area is displayed to the driver. Can be presented with good visibility. Therefore, according to the present disclosure, it is possible to easily present the driver with images of a plurality of areas in the external peripheral area of the vehicle without increasing the number of display devices.

Further, the vehicle periphery display method according to another aspect of the present disclosure acquires a first peripheral image and a second peripheral image obtained by capturing a first region and a second region that are different from each other in the external peripheral region of the vehicle. An area in which the first peripheral image is displayed on the display screen of the display device by displaying the image and the second peripheral image on one screen of a display device provided in the vehicle interior to determine the traveling state of the vehicle. Is the main display area, and the area where the second peripheral image is displayed is the sub display area. When a predetermined driving condition is satisfied according to the driving condition of the vehicle, the sub display area is enlarged.

According to this vehicle periphery display method, the same effects as those already described in the vehicle periphery display device according to the aspect of the present disclosure can be obtained.

The above and other objects, features, and advantages of the present disclosure will become more apparent from the following detailed description with reference to the accompanying drawings. The drawing
FIG. 1 is a block diagram illustrating an overall configuration of a vehicle periphery display device according to an embodiment of the present disclosure. FIG. 2 is a top view of a vehicle equipped with a vehicle periphery display device, FIG. 3 is a diagram showing the interior of a vehicle equipped with a vehicle periphery display device, FIG. 4 is a block diagram showing a functional configuration of the ECU, FIG. 5 is a flowchart of image generation processing according to the first embodiment of the present disclosure. FIG. 6A is a diagram showing a boundary visualized image including a contour line superimposed image; FIG. 6B is a diagram showing a boundary visualization image including a transparent superimposed image; FIG. 7 is a flowchart of the display control process. FIG. 8A is a diagram illustrating a case where the sub display area is reduced and displayed in the display example of the left display 7. FIG. 8B is a diagram showing a case where the sub display area is enlarged and displayed in the display example of the left display 7. FIG. 9A is a diagram showing a case where the sub display area is reduced and displayed in the display example of the right display 6; FIG. 9B is a diagram showing a case where the sub display area is enlarged and displayed in the display example of the right display 6; FIG. 10 is a flowchart of image generation processing according to the second embodiment of the present disclosure. FIG. 11 is a diagram illustrating a boundary visualized image including a mask superimposed image.

Hereinafter, embodiments to which the present disclosure is applied will be described with reference to the drawings.

(First embodiment)
1 includes an ECU (Electronic Control Unit) 2, a rear side camera 3, a front side camera 4, an ADAS locator 5, a right display 6, a left display 7, and a vehicle speed sensor. 8, a direction indicator 9, a brightness detection unit 15, a driver camera 18, and a body shape DB (Data Base) 19.

The rear side camera 3 is mounted in the vicinity of the position where the side mirror is normally installed on the right side and the left side of the vehicle shown in FIG. 2, and the rear side region (corresponding to the first region) of the vehicle is respectively set. It is composed of a right rear camera 3A and a left rear camera 3B for imaging. Each of the right rear camera 3A and the left rear camera 3B is configured by a CMOS camera or the like, and images a region within the range of the imaging field angle G (that is, the rear side region) and captures an image (hereinafter referred to as “first” (Referred to as “peripheral image”) to the ECU 2. In addition, the side mirror is not installed in the vehicle, but the so-called electronic mirror is configured together with the rear side camera 3 by the

displays

6 and 7 displaying the first peripheral image.

The front side camera 4 includes a right front camera 4A and a left front camera 4B that respectively image a front side region (corresponding to a second region) of the vehicle including a blind spot region of the right front pillar 31 and the left front pillar 32. The blind spot area is a peripheral area outside the vehicle that is generated when the driver's field of view is blocked by the vehicle frame including the left and right

front pillars

31 and 32. Each of the right front camera 4A and the left front camera 4B is configured by a CMOS camera or the like, images a region within the range of the imaging field angle F (that is, the front side region), and captures an image (hereinafter, “second peripheral image”). Is output to the ECU 2. Hereinafter, in the front side region, a region other than the blind spot region is referred to as an adjacent region, and a boundary between the blind spot region and the adjacent region is referred to as a blind spot region boundary.

Referring back to FIG. 1, the ECU 2 is an electronic control unit that controls the entire apparatus. The ECU 2 is configured mainly by the CPU 10 and includes a memory 11 such as a ROM, a RAM, and a flash memory, an input signal circuit, an output signal circuit, a power supply circuit, and the like. In the ECU 2, the CPU 10 acquires the first peripheral image and the second peripheral image from the rear side camera 3 and the front side camera 4 based on the program stored in the memory 11, and the acquired left and right peripheral images are respectively left and right. Various processes such as setting display areas of the

displays

6 and 7 are performed.

The right display 6 and the left display 7 have a function of displaying the first peripheral image and the second peripheral image in the display area set by the ECU 2, respectively. For example, as shown in FIG. 3, the right display 6 is configured by a liquid crystal display or the like provided in the vicinity of the right front pillar 31 in the vehicle interior, and the first peripheral image of the right rear camera 3A and the right front camera 4A. The second peripheral image is displayed. Similarly, the left display 7 is constituted by a liquid crystal display or the like provided in the vicinity of the left front pillar 32 in the vehicle interior, and displays the first peripheral image of the left rear camera 3B and the second peripheral image of the left front camera 4B. indicate.

The ADAS locator 5 is a well-known device used in the advanced driver assistance system, and detects the current position of the vehicle using a global positioning system (so-called GPS) or the like. The ADAS locator 5 has a map database (DB) including road map information in association with position information such as latitude and longitude. The road map information is a table-like DB in which link information of links constituting a road is associated with node information of nodes connecting the links. Since the link information includes link length, width, connection node, curve information, etc., the road shape can be detected using the road map information.

The vehicle speed sensor 8 is configured as a known sensor that detects the vehicle speed based on the rotational speed of the wheel, and outputs the detection result to the ECU 2. Further, the direction indicator 9 is a well-known device for indicating the direction to the surroundings by the driver's turn signal operation when turning right or left or changing the course of the vehicle. The result is output to the ECU 2. Moreover, the brightness detection part 15 is comprised by the illumination intensity sensor etc. which detect the brightness outside a vehicle, and outputs the detection result to ECU2.

The driver camera 18 is disposed in the passenger compartment so as to capture a face area including the driver's eyes. The driver camera 18 uses a well-known gaze detection technique to detect a three-dimensional position of each of the driver's eyes in the captured image, for example, using the eye head or corneal reflection as a reference point and the iris or pupil as a moving point. Then, the driver's line of sight is detected based on the position of the moving point with respect to the reference point. Basically, for example, if the iris of the left eye is far from the eye, the driver is looking at the left side, and if the iris is close to the eye of the left eye, the driver is looking at the right side. By applying such a basic principle, the driver's line-of-sight direction can be obtained in a three-dimensional space from the three-dimensional relative position of the moving point with respect to the reference point. The driver camera 18 outputs information indicating the driver's eye position and line-of-sight direction thus detected (hereinafter referred to as “driver camera information”) to the ECU 2.

The body shape DB 19 stores body shape data indicating a three-dimensional position relating to each part of the frame such as a front pillar constituting the vehicle body. The body shape DB 19 may be built in the memory 11.

Next, the functional configuration of the ECU 2 will be described with reference to the block diagram of FIG.

The ECU 2 functionally includes an image acquisition unit 21, an image generation unit 22, an image display unit 23, a situation determination unit 24, and a display area change unit 25. The processing for realizing each function as the image acquisition unit 21, the image generation unit 22, the image display unit 23, the situation determination unit 24, and the display area change unit 25 is based on a program stored in the memory 11. Executed by.

The image acquisition unit 21 acquires the first peripheral image and the second peripheral image from each of the right rear camera 3A, the right front camera 4A, the left rear camera 3B, and the left front camera 4B in time series, and acquires the respective peripheral images. Among these, the first peripheral image is supplied to the image display unit 23, and the second peripheral image is supplied to the image generation unit 22.

For each of the right front camera 4A and the left front camera 4B, the image generation unit 22 uses the second peripheral image supplied from the image acquisition unit 21 as an original image, and the blind spot between the blind spot area and the adjacent area in the front side area of the vehicle. Processing (hereinafter referred to as “image generation processing”) for generating an image in which the region boundary is visualized (hereinafter referred to as “boundary visualization image”) is executed, and each of the generated boundary visualization images is displayed along the time series. To supply.

The image display unit 23 includes a first peripheral image supplied from the image acquisition unit 21 in time series for each of the right rear camera 3A and the left rear camera 3B, and an image generation unit for each of the right front camera 4A and the left front camera 4B. The boundary visualized images supplied along the time series from 22 are displayed as images on the right display 6 and the left display 7 respectively. Specifically, the first peripheral video and boundary visualized video corresponding to the

right cameras

3A and 4A are displayed on the right display 6, and the first peripheral video and boundary visualized video corresponding to the

left cameras

3B and 4B are displayed on the left display 7. indicate.

Next, image generation processing executed by the image generation unit 22 will be described with reference to the flowchart of FIG. Note that this processing is repeatedly activated at predetermined cycles while, for example, a switch (not shown) for inputting activation and stop operation details regarding the vehicle periphery display function is on. In this process, in order to avoid complexity, the processing target is described as the second peripheral image supplied from the image acquisition unit 21 without particularly distinguishing the right front camera 4A and the left front camera 4B.

When this processing is started, the image generation unit 22 first acquires driver camera information from the driver camera 18 in step (hereinafter simply referred to as “S”) 110.

Subsequently, in S120, body shape data is read from the body shape DB 19.

Next, in S130, based on the positional relationship between the position of the driver's eyes and the position of the front pillar, a blind spot area when the driver looks at the front side area of the vehicle is set on the second peripheral image. The driver's eye position is read from the driver camera information, and the front pillar position is extracted from the body shape data. Specifically, the blind spot area corresponding to the vector from the driver's eye position to the front pillar position is converted from world coordinates into a camera image using the camera parameters of the front side camera 4. At this time, the vector can also be corrected based on the driver's line-of-sight direction.

Subsequently, in S140, a contour line superimposed image shown in FIG. 6A is generated by superimposing a contour line image corresponding to the blind spot region boundary on the second peripheral image. As the contour image, an image that transmits the blind spot region boundary of the second peripheral image is preferable, and an image in which image attributes such as hue, brightness, saturation, and luminance are set to default values in advance is used.

Next, in S150, a transparent superimposed image shown in FIG. 6B is generated by superimposing a transparent image corresponding to the blind spot area on the second peripheral image. Specifically, a transparent superimposed image is generated by performing known filter processing on the blind spot area portion of the second peripheral image. The transparent image preferably has a vehicle body color or a color imitating translucent acrylic so as to remind the driver of the frame portion including the front pillar, in order to transmit the blind spot area portion of the surrounding image. The default value of which the image attribute is set in advance is used.

Subsequently, in S160, an attribute change process for changing the image attributes of the contour superimposed image and the transparent superimposed image is performed, and a second peripheral image (that is, the second peripheral image including the contour superimposed image and the transparent superimposed image subjected to the attribute change process) The boundary visualization image) is supplied to the image display unit 23, and this process is terminated.

For example, in the attribute change process, the brightness and / or brightness relating to each of the contour superimposed image and the transparent superimposed image is changed according to the brightness of the vehicle peripheral region. Specifically, based on the detection result of the brightness detection unit 15, when the illuminance of the vehicle surrounding area is low, the brightness and / or luminance relating to each of the contour superimposed image and the transmission superimposed image is increased, and the vehicle surrounding area is When the illuminance is high, the brightness and / or luminance relating to each of the contour superimposed image and the transparent superimposed image is lowered.

Also, for example, in the attribute change process, the image attributes relating to each of the contour superimposed image and the transparent superimposed image are changed so that the contrast is higher with respect to the second peripheral image. Specifically, when the hue, brightness, saturation, and / or luminance related to the second peripheral image supplied from the image acquisition unit 21 are low, the hue, brightness, saturation related to each of the contour superimposed image and the transparent superimposed image. Increase the degree and / or brightness. Further, when the hue, lightness, saturation, and / or luminance related to the second peripheral image supplied from the image acquisition unit 21 are high, the hue, lightness, saturation, and / or Or lower the brightness.

Next, the display control processing executed by the situation determination unit 24 and the display area changing unit 25 will be described with reference to the flowchart of FIG. Note that this processing is repeatedly activated at predetermined cycles while, for example, a switch (not shown) for inputting activation and stop operation details regarding the vehicle periphery display function is on. Moreover, in this process, in order to avoid complexity, the control object is set as each display area of the first peripheral video and the boundary visualization video displayed by the image display unit 23 without particularly distinguishing the right display 6 and the left display 7. explain.

When this process is started, the situation determination unit 24 first determines whether or not the host vehicle speed is equal to or lower than a predetermined threshold value based on the detection result of the vehicle speed sensor 8 in S210. The threshold value is set in advance with reference to an upper limit speed at which the vehicle slows down when the vehicle turns right or left at an intersection or the like. If it is determined that the host vehicle speed is less than or equal to the threshold value, the process proceeds to S220. If it is determined that the host vehicle speed exceeds the threshold value, the process proceeds to S230.

In S220, based on the detection result of the direction indicator 9, the situation determination unit 24 determines whether one of the left and right turn signal operations has been performed, that is, whether the direction indicator 9 is in an on state. If it is determined that the direction indicator 9 is on, the process proceeds to S240, and if it is determined that the direction indicator 9 is off, the process proceeds to S230.

As described above, in S210 to S220, it is determined whether or not the vehicle is going to turn right or left, and if it is determined that the vehicle is going to turn right or left, the process proceeds to S240 and it is determined that the vehicle is not going to turn right or left. If so, the process proceeds to S230.

Next, in S230, the situation determination unit 24 determines whether or not the vehicle is going to travel in a curve, and if it is determined that the vehicle is going to travel in a curve, the process proceeds to S240 and the vehicle tries to travel in a curve. If it is determined that there is not, the process proceeds to S250. Specifically, when the situation determination unit 24 determines that the road shape ahead of the vehicle is a curve shape based on, for example, the map information and vehicle position information of the ADAS locator 5, the vehicle is about to curve. Can be determined.

On the other hand, the display area changing unit 25 performs a process of changing each display area of the first peripheral video and the boundary visualized video displayed by the image display unit 23 according to the determination result by the situation determination unit 24. Specifically, if any one of the driving situation conditions, that is, whether the vehicle is going to turn left or right and the vehicle is going to drive a curve, the process of S240 is performed, If not, the process of S250 is performed.

In S240, the display area changing unit 25 displays, in the display screen displayed by the image display unit 23, the area in which the first peripheral video is displayed as the main display area and the boundary visualized video (that is, the second peripheral video). The area to be displayed is set as a sub display area, and a command for enlarging and displaying the sub display area is sent to the image display unit 23. For example, when the vehicle is going to turn left or turn left, the sub display area arranged at the upper right end of the left display 7 shown in FIG. 8A is enlarged so that the diagonal line extends to the lower left as shown in FIG. 8B. Display. Further, for example, when the vehicle is going to turn right or turn right, similarly, the sub display area arranged at the upper right end of the right display 6 is enlarged and displayed so that the diagonal line extends to the lower left.

In S250, the display area changing unit 25 displays, in the display screen displayed by the image display unit 23, the area in which the first peripheral video is displayed as the main display area and the boundary visualized video (that is, the second peripheral video). The area to be displayed is set as a sub display area, and a command for reducing the sub display area is sent to the image display unit 23. For example, if none of the driving condition conditions regarding left turn and left curve driving is satisfied, the sub display area arranged on the left display 7 shown in FIG. 8B is reduced and displayed on the upper right end as shown in FIG. 8A. . Further, for example, when none of the traveling condition conditions related to right turn or right curve traveling is satisfied, the sub display area arranged on the right display 6 is similarly reduced and displayed on the upper right end.

In this embodiment, a side mirror (that is, a door mirror) is not installed in the vehicle, and a so-called electronic mirror is configured in which the first peripheral image is displayed in the main display area of the

displays

6 and 7. For this reason, the image display unit 23 displays the first peripheral image in the main display area that simulates the shape of the door mirror, so that the image display unit 23 looks as if the rear side area outside the vehicle displayed on the door mirror is viewed. One peripheral image can be presented to the driver.

In this case, in S240, for example, when the vehicle is going to turn right or turn to the right in S240, the display area changing unit 25 is arranged in the upper display and the lower display area in the right display 6 shown in FIG. 9A. The sub display area is enlarged and displayed by shifting the boundary between the main display area and the main display area (hereinafter referred to as “main sub area boundary”) downward as shown in FIG. 9B. Further, for example, when the vehicle is going to turn left or turn left, similarly, the sub display area is enlarged and displayed by shifting the main sub area boundary downward on the left display 7.

Also, in S250, for example, if the display area changing unit 25 does not correspond to any driving condition regarding right turn or right curve driving, the main / sub area boundary is set to FIG. 9A on the right display 6 shown in FIG. 9B. As shown, the sub display area is reduced and displayed by shifting upward. Further, for example, when none of the traveling condition conditions regarding left turn or left curve traveling is satisfied, the sub display area is similarly reduced by shifting the main sub area boundary upward on the left display 7.

According to the first embodiment described in detail above, the following effects can be obtained.

(1a) By displaying the two peripheral images with a master-slave relationship on the display screen, it is possible to intuitively let the driver know the image portion corresponding to each of the external peripheral regions of the vehicle. . Furthermore, by expanding the sub display area according to the driving situation of the vehicle, the driver can instantly understand the area that has become necessary to be checked according to the driving scene, and an image of the area is displayed to the driver. Can be presented with good visibility. Therefore, it is possible to present the images of the two areas in the external peripheral area of the vehicle in an easy-to-understand manner without increasing the number of displays.

(2a) When the vehicle is about to turn left or right, the second peripheral image showing the front side area of the vehicle is displayed in an enlarged manner, so that the driver displays on-demand images of the blind spot area that should be noted when turning right or left. can do.

(3a) When the vehicle is about to drive a curve, the second peripheral image showing the front side area of the vehicle is displayed in an enlarged manner, so that an image of a blind spot area, etc. that should be noted when driving a curve is presented to the driver on demand. can do.

(4a) On the display screen, an image obtained by imaging the rear side area of the vehicle is displayed as the first peripheral image in the main display area, and the front side area including the blind spot area of the vehicle is displayed as the second image in the sub display area. Since the captured image is displayed, the display can be shared with the so-called electronic mirror function and the blind spot display function.

(5a) Since the first peripheral image is displayed in the main display area simulating the shape of the door mirror, the driver can intuitively know that the display image is an image of the rear side area of the vehicle. Can do.

(6a) On the display screen, the main display area is arranged below the sub display area, and the boundary of the main sub area is shifted upward when the driving condition is satisfied. The second peripheral image can be presented to the driver as if he / she is watching.

(7a) Since the blind spot area boundary is visualized in the display image, the driver can intuitively know the image portion corresponding to the blind spot area, and the blind spot area and the vehicle peripheral area (or adjacent area) ) Can be instantly understood by the driver regardless of the shape and arrangement of the

displays

6 and 7. Therefore, the blind spot area can be presented to the driver in an easy-to-understand manner with an image without complicating the vehicle design.

(8a) Based on the positional relationship between the driver's eye position and the front pillar position, the blind spot area when the driver views the vehicle peripheral area is set on the peripheral image. It is possible to move the contour line representing the position of the driver in accordance with the position of the eyes of the driver, and the blind spot area can be presented to the driver more intuitively and intelligibly.

(9a) By superimposing a contour image corresponding to the blind spot area boundary on the second peripheral image, the driver can clearly inform the driver of the blind spot area boundary in the display image.

(10a) By superimposing a transmission image corresponding to the blind spot area on the second peripheral image, the blind spot area can be presented to the driver more intuitively and easily in the display image.

(11a) By changing the image attributes of the contour superimposed image and the transparent superimposed image, for example, by resetting the image attributes so that the contrast with respect to the brightness of the vehicle peripheral region and the second peripheral image becomes higher, the display Visibility can be improved in the image.

(Second Embodiment)
Since the basic configuration of the second embodiment is the same as that of the first embodiment, the description of the common configuration will be omitted, and the description will focus on the differences.

In the first embodiment described above, when the boundary visualization image is generated, the transmission image corresponding to the blind spot area is superimposed on the second peripheral image. In contrast, the second embodiment is different from the first embodiment in that a mask image corresponding to an adjacent region is superimposed on the second peripheral image when generating a boundary visualized image.

Next, image generation processing executed by the image generation unit 22 of the second embodiment instead of the image generation processing (FIG. 5) of the first embodiment will be described with reference to the flowchart of FIG. Note that the processing of S310 to S340 in FIG. 10 is the same as the processing of S110 to S140 in FIG.

When this process is started, the image generation unit 22 first acquires driver camera information from the driver camera 18 in S310.

Subsequently, in S320, the body shape data is read from the body shape DB 19.

Next, in S330, a blind spot area when the driver looks at the front side area of the vehicle is set on the second peripheral image based on the positional relationship between the driver's eye position and the front pillar position.

Subsequently, in S340, a contour line superimposed image shown in FIG. 6A is generated by superimposing a contour line image corresponding to the blind spot region boundary on the second peripheral image.

Next, in S350, a mask superimposed image shown in FIG. 11 is generated by superimposing a mask image corresponding to the adjacent region on the second peripheral image. Specifically, a mask superimposed image is generated by performing a known filter process on the adjacent region portion of the second peripheral image. As this mask image, an adjacent region portion of the second peripheral image is used so as to remind the driver that it is a portion other than the blind spot region in the vehicle peripheral region or a region that can be directly recognized by the driver. An image attribute set in advance as a default value to make it inconspicuous is used.

Subsequently, in S260, an attribute change process for changing the image attributes of the contour superimposed image and the mask superimposed image is performed, and a second peripheral image including the contour superimposed image and the mask superimposed image subjected to the attribute change process (that is, The boundary visualization image) is supplied to the image display unit 23, and this process is terminated.

For example, in the attribute changing process, the brightness and / or luminance relating to each of the contour superimposed image and the mask superimposed image is changed according to the brightness of the vehicle peripheral region. Specifically, based on the detection result of the brightness detection unit 15, when the illuminance of the vehicle surrounding area is low, the brightness and / or brightness relating to each of the contour superimposed image and the mask superimposed image is increased, and the vehicle surrounding area is When the illuminance is high, the brightness and / or luminance relating to each of the contour superimposed image and the mask superimposed image is lowered.

Also, for example, in the attribute change process, the image attributes relating to each of the contour line superimposed image and the mask superimposed image are changed so that the contrast is higher with respect to the second peripheral image. Specifically, when the hue, brightness, saturation, and / or luminance related to the second peripheral image supplied from the image acquisition unit 21 are low, the hue, brightness, saturation related to each of the contour superimposed image and the mask superimposed image. Increase the degree and / or brightness. Further, when the hue, lightness, saturation, and / or luminance related to the second peripheral image supplied from the image acquisition unit 21 is high, the hue, lightness, saturation, and / or brightness related to each of the contour superimposed image and the mask superimposed image. Or lower the brightness.

According to the second embodiment described in detail above, in addition to the effects (1a) to (9a) of the first embodiment described above, the following effects can be obtained.

(1b) By superimposing the mask image corresponding to the adjacent area on the second peripheral image, the blind spot area in the display image can be presented to the driver more intuitively and easily.

(2b) By changing the image attributes of the contour superimposed image and the mask superimposed image, for example, by resetting the image attributes so that the contrast with respect to the brightness of the vehicle peripheral region and the second peripheral image becomes higher, the display Visibility can be improved in the image.

(Other embodiments)
As mentioned above, although embodiment of this indication was described, this indication can take various forms, without being limited to the above-mentioned embodiment.

In the above embodiment, the image attributes of the contour superimposed image and the transparent superimposed image, or the contour superimposed image and the mask superimposed image are changed, but the present invention is not limited to this. For example, at least one image attribute of the contour superimposed image, the transparent superimposed image, and the mask superimposed image may be changed.

In the above embodiment, the boundary visualized image is generated by visualizing the region boundary between the blind spot region of the left and right

front pillars

31 and 32 and the adjacent region. However, the present invention is not limited to this. For example, the boundary visualized image may be generated in the same manner for the blind area of other pillars such as a center pillar and a rear pillar.

In the above-described embodiment, two peripheral images obtained by imaging two different areas in the external peripheral area of the vehicle are displayed on one screen of each of the

displays

6 and 7, respectively. However, the present invention is not limited to this. Absent. For example, the number of regions may be further increased so that three or more regions are imaged, and three or more peripheral images may be displayed on one screen of each of the

displays

6 and 7, respectively. In this case, two or more main display areas may be arranged on the display screen, or two or more sub display areas may be arranged.

The functions of one component in the above embodiment may be distributed as a plurality of components, or the functions of a plurality of components may be integrated into one component. Further, at least a part of the configuration of the above embodiment may be replaced with a known configuration having the same function. Moreover, you may abbreviate | omit a part of structure of the said embodiment. In addition, at least a part of the configuration of the above embodiment may be added to or replaced with the configuration of the other embodiment. In addition, all the aspects included in the technical idea specified only by the wording described in the claims are embodiments of the present disclosure.

In addition to the vehicle periphery display device 1 described above, a system including the vehicle periphery display device 1 as a constituent element, one or more programs for causing a computer to function as the vehicle periphery display device 1, and at least a part of the program are recorded. The present disclosure can be realized in various forms such as one or a plurality of media and a vehicle periphery display method.

Although the present disclosure has been described with reference to the embodiments, it is understood that the present disclosure is not limited to the embodiments and structures. The present disclosure includes various modifications and modifications within the equivalent range. In addition, various combinations and forms, as well as other combinations and forms including only one element, more or less, are within the scope and spirit of the present disclosure.

Claims

An image acquisition unit (21) for acquiring a first peripheral image and a second peripheral image obtained by imaging a first region and a second region that are different from each other in the external peripheral region of the vehicle;
An image display unit (23) for displaying the first peripheral image and the second peripheral image acquired by the image acquisition unit (21) on one screen of a display device provided in a room of the vehicle;
A situation determination unit (24) for determining a running situation of the vehicle;
Of the display screen of the display device, a region where the first peripheral image is displayed is a main display region, and a region where the second peripheral image is displayed is a sub display region, and the determination result by the situation determination unit (24) Accordingly, when a predetermined traveling condition is established, a display area changing section (25) that enlarges the sub display area on the image display section (23),
A vehicle periphery display device comprising:
The vehicle periphery display device according to claim 1,
The situation determination unit (24) sets that the vehicle is going to turn right or left as a requirement for satisfying the traveling condition.
Vehicle periphery display device.
The vehicle periphery display device according to claim 1 or 2,
The situation determination unit (24) sets that the vehicle is about to travel in a curve as a requirement for establishment of the traveling situation condition.
Vehicle periphery display device.
The vehicle periphery display device according to any one of claims 1 to 3, wherein
The first peripheral image is an image obtained by imaging a rear side region of the vehicle as the first region,
The second peripheral image is an image obtained by capturing a front side region of the vehicle as the second region, which has a blind spot region outside the vehicle that is generated when a driver's view is blocked by a frame including the pillar of the vehicle. ,
Vehicle periphery display device.
The vehicle periphery display device according to claim 4,
The image display unit (23) displays the first peripheral image in the main display area simulating the shape of a door mirror.
Vehicle periphery display device.
The vehicle periphery display device according to claim 5,
The image display unit (23) arranges the sub display area above the main display area on the display screen,
The display area changing unit (25) shifts a main sub area boundary, which is a boundary between the main display area and the sub display area, downward when the traveling condition is satisfied.
Vehicle periphery display device.
The vehicle periphery display device according to any one of claims 4 to 6,
A boundary visualization image that visualizes a blind spot area boundary, which is a boundary between the blind spot area and another area in the front side area of the vehicle, using the second peripheral image acquired by the image acquisition unit (21) as an original image. An image generation unit (22) for generating
Further comprising
The image display unit (23) displays the boundary visualized image generated by the image generation unit (22) in the sub display area.
Vehicle periphery display device.
Obtaining a first peripheral image and a second peripheral image obtained by imaging a first region and a second region, which are different from each other, in the external peripheral region of the vehicle
Displaying the first peripheral image and the second peripheral image on one screen of a display device provided in a room of the vehicle;
Determining the running status of the vehicle,
Of the display screen of the display device, an area where the first peripheral image is displayed is a main display area, and an area where the second peripheral image is displayed is a sub-display area. A vehicle periphery display method including enlarging the sub display area when the driving condition condition is satisfied.