WO2022244673A1

WO2022244673A1 - Display system for vehicle, display method for vehicle, and display program for vehicle

Info

Publication number: WO2022244673A1
Application number: PCT/JP2022/020067
Authority: WO
Inventors: 健史山元; 静香横山; 清貴田口
Original assignee: 株式会社デンソー
Priority date: 2021-05-19
Filing date: 2022-05-12
Publication date: 2022-11-24
Also published as: JP7428161B2; JP2022178102A

Abstract

In this invention, a margin generation unit (13a) generates a margin for displaying a sub content in a display region of a display (3) on the basis of a size difference in aspect ratio between the display region and a main content. An allocation unit (13b) allocates the main content to the display region and the sub content to the margin. A display processing unit (13) displays the main content in the display region of the display (3) and displays the sub content in the margin of the display region. The margin generation unit (13a) generates the margin in correspondence to the direction of a peripheral event occurring with an own vehicle outside the own vehicle, and the allocation unit (13b) allocates the sub content to the margin.

Description

Vehicle display system, vehicle display method, and vehicle display program

Cross-reference to related applications

This application is based on Japanese Application No. 2021-084648 filed on May 19, 2021, and the contents thereof are incorporated herein.

The present disclosure relates to a vehicle display system, a vehicle display method, and a vehicle display program.

Conventionally, in vehicle cockpit systems, the size of the display to be installed is determined based on the mechanical dimension design of the instrument panel. For this reason, vehicles may be equipped with displays with non-standard aspect ratios, displays with minor aspect ratios, or may be equipped with a combination of multiple displays.

On the other hand, for general video content other than in-vehicle use, standards have been formulated for each application, and a large number of video content with aspect ratios conforming to the established standards are provided. When video content is displayed on a vehicle display, the aspect ratios are often not the same. At this time, when the content is displayed on the display, the margin is displayed in black and nothing is displayed, or the content is displayed after taking some measures in advance. For example, in the technique described in Patent Document 1, the vertical and horizontal lengths of the captured image are adjusted so that the aspect ratio corresponds to the imaging angle of view of the in-vehicle camera. A mask process is applied to blacken the top and bottom edges of the .

JP-A-2008-4990

As a general countermeasure, there are solutions such as aligning the aspect ratio, making the display mode different from the original video content, enlarging the display, and utilizing the blank space. The method of using the blank space is a display method that respects the intention of the creator of the video content, so it is the best solution for the passengers to enjoy the content, but the blank space is wasted. It is thought that not wasting the limited effective display area of the display would be beneficial for the user as well.

In other words, it is conceivable to effectively use the display area of the display by displaying video content in the display area of the display and displaying other content in the margins of the display area. However, under the present circumstances, there is a situation that other content cannot be provided beneficially to vehicle occupants.

An object of the present disclosure is to provide a vehicle display system, a vehicle display method, and a vehicle display program that enable effective use of blank space based on the difference in aspect ratio between the display area of the display and the main content.

According to one aspect of the present disclosure, the allocation unit allocates the sub-content to the margin of the display area based on the difference in aspect ratio between the display area of the display and the main content displayed in the display area. In addition, the display processing unit displays the main content in the display area and displays the sub-content in the margin of the display area.

At this time, the blank generation unit generates a blank corresponding to the direction of the peripheral event occurring outside the vehicle and allocates the sub-content to the vehicle by the allocation unit. According to one aspect of the present disclosure, it becomes easier for the occupant to grasp the positional relationship between himself and the sub-content. For example, peripheral events occurring on the right side of the occupant will be displayed on the right side, so that the occupant can intuitively understand. This makes it possible to effectively utilize the margins based on the difference in aspect ratio between the display area of the display and the main content.

According to another aspect of the present disclosure, since the allocation unit normally divides the display area of the main content evenly in the vertical or horizontal direction, the sub-contents can be displayed in a divided manner in normal times, which is intuitive for the occupant. It becomes easier to understand the relationship with the own vehicle. In addition, when the allocation unit allocates the peripheral event that draws the occupant's attention to one of the top, bottom, left, and right margins of the display area of the main content, it allocates it to either one of the vertical direction or the horizontal direction. It becomes easier to notice a peripheral event to be noticed, and it is possible to intuitively recognize in which direction the peripheral event to be noticed is occurring.

The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description with reference to the accompanying drawings. The drawing is
FIG. 1 is a diagram schematically showing a control form of a vehicle display system in the first embodiment, FIG. 2 is a block diagram showing the electrical configuration of the vehicle display system; FIG. 3 is a flowchart for explaining the flow of processing; FIG. 4 is part 1 of an explanatory diagram showing margin generation positions and sub-content allocation areas. FIG. 5 is Part 2 of an explanatory diagram showing margin generation positions and sub-content allocation areas; FIG. 6 is Part 3 of the explanatory diagram showing the margin generation positions and sub-content allocation areas. FIG. 7 is a flowchart for explaining the flow of processing in the second embodiment; FIG. 8 is Part 4 of the explanatory diagram showing the margin generation positions and sub-content allocation areas. FIG. 9 is part 5 of an explanatory diagram showing margin generation positions and sub-content allocation areas; FIG. 10 is a flowchart for explaining the flow of processing in the third embodiment; FIG. 11 is part 6 of an explanatory diagram showing margin generation positions and sub-content allocation areas; FIG. 12 is a flowchart for explaining the flow of processing in the fourth embodiment; FIG. 13 is the seventh explanatory diagram showing the margin generation positions and sub-content allocation areas.

Several embodiments of the vehicle display system 1, the vehicle display method, and the vehicle display program will be described below with reference to the drawings. In addition, the same code|symbol is attached|subjected and demonstrated to the site|part which is substantially common in each embodiment.

(First embodiment)
As shown in FIG. 1 , a vehicle display system 1 is configured by a cockpit system including a plurality of displays such as a center display 3 and an electronic mirror 4 . However, the number, installation position, or configuration of the display is an example, and the present invention is not limited to these.

The center display 3 is composed of, for example, a liquid crystal display or an organic EL display. The center display 3 is provided in the vicinity of the center console, which is easily visible to both the driver and the passenger in the front passenger seat, and is capable of displaying various contents in full graphic display. An operation panel 21 is formed on the center display 3, and selection of contents to be displayed on the center display 3, air conditioning operation, audio operation, and input operation of the navigation function can be performed.

The electronic mirror 4 is configured using a display 4a and a door mirror camera 4b. The display 4a of the electronic mirror 4 is composed of, for example, a liquid crystal display or an organic EL display. The displays 4a are installed one by one at the left and right positions of the driver, for example, under the A pillar in the vehicle interior. The door mirror camera 4b is a peripheral camera 23 that takes an image of the rear side of the vehicle Ca from the position where the door mirror of the vehicle Ca is installed, that is, the side rear, and its focal length and angle of view are fixed in advance. The display 4a of the electronic mirror 4 is provided at a position where the driver can easily check the rear side of the vehicle.

In addition, as shown in FIG. 2 , a plurality of ECUs 5 are configured in the vehicle and connected to the in-vehicle network 25 . The ECU 5 includes a display system ECU, a surrounding monitoring system ECU, a travel control system ECU, and a DCM that communicates with the outside of the vehicle. DCM is an abbreviation for Data Communication Module. The travel control system ECU includes a well-known vehicle control ECU, engine control ECU, motor control ECU, brake control ECU, steering control ECU, integrated control ECU, and the like. The travel control system ECU includes an automatic driving ECU. The autonomous driving ECU is the Autonomous Driving Electric Control Unit.

When the automatic driving ECU receives an automatic control signal, it drives the driving actuator to provide a corresponding predetermined level of driving support and automatic driving. For example, level I driving support includes automatic braking to avoid collisions with obstacles, follow-up driving to follow the vehicle Cc in front, and lane-departure prevention driving to control the vehicle so that it does not stray from the lanes on both sides. , can be executed.

In level II automated driving, a combination of level I driving assistance, or automated driving under specific conditions, such as automatic lane change that automatically overtakes a slow vehicle on an expressway, and automatic merging on an expressway. You can run the automatic driving mode to do. Levels I and II require the driver to perform driving maneuvers similar to normal manual driving. Also, it is considered unfavorable to draw the driver's line of sight from the system.
In Level III and higher autonomous driving, the system performs all driving tasks while being supervised by the system. In automatic driving at level III or higher, an automatic lane change can be executed to automatically change the lane of the host vehicle Ca from the driving lane to the passing lane. Automated driving at level III or higher is automated driving on the assumption that the driver does not visually recognize the front.

Each ECU 5 is mainly composed of a microcomputer equipped with a processor, various storage units 6 such as cache memory, RAM and ROM, I/O, and a bus connecting them. Each ECU 5 is communicably connected to other ECUs 5 provided in the vehicle through the communication control unit 7 and the in-vehicle network 25 . Further, the ECU 5 is communicably connected to a communication unit provided outside the vehicle by using a DCM.

The ECU 5 communicates with other vehicles outside the own vehicle Ca, road shoulders, or communication units mounted in mobile phone base stations to communicate various types of data with the outside. communication can be performed. Technologies for communication between vehicles, road users, and pedestrians are collectively referred to as V2X: Vehicle to X. Vehicle-to-vehicle communication is called V2V (Vehicle to Vehicle), and transmits and receives information about other vehicles and road conditions around the vehicle. Road-to-vehicle communication is called V2I: Vehicle-to-roadside-Infrastructure, and transmits and receives information on the general traffic environment.

The ECU 5 also acquires information distributed by VICS (registered trademark). VICS (registered trademark) stands for Road Traffic Information and Communication System. VICS (registered trademark) transmits radio wave beacons and optical beacons to an unspecified number of people from roadside units installed on expressways and major arterial roads. Information on the time required to When the ECU 5 acquires this distribution information, the display system ECU 5 can display the distribution information on the display 3 or output the information from the speaker 18 by the audio processing unit 14 .

In this embodiment, as shown in FIG. 2, the display system ECU 5 constitutes the HCU as the vehicle device 10, and the display system ECU 5 performs display processing on the

displays

3 and 4a. The display system ECU 5 may be configured by connecting a plurality of ECUs 5 to each other via a dedicated line, or may be configured by one ECU 5 . HCU is an abbreviation for Human Machine Interface Control Unit and indicates an information presentation control device. The storage unit 6 described above indicates a non-transitional material storage medium that non-temporarily stores computer-readable programs and data. A non-transitional material storage medium is implemented by a semiconductor memory or the like.

As shown in FIG. 2, the vehicle device 10 includes a control device 11, a storage unit 6, a display processing unit 13, an audio processing unit 14, an I/O control unit 15 for managing inputs or outputs from various devices, and other devices. A communication control unit 7 that manages communication with the ECU 5 is provided. Here, the output signals of main components such as the position detector 19, the operation panel 21, the passenger monitor 22, the vehicle interior camera 20, the peripheral camera 23, and the distance detection sensor 24 shown in FIG. Although a mode of signal input through the unit 15 will be described, the signal may also be input from other ECUs 5 such as an ECU for surroundings monitoring and an ECU for travel control through the in-vehicle network 25 .

The control device 11 calculates the display area M (see FIG. 4 onwards) to be displayed on the center display 3 and the display 4a of the electronic mirror 4 for various contents stored in the storage unit 6. The control device 11 calculates in which area of the display screen of the center display 3 the contents of images and characters are to be displayed and in which area they are to be superimposed and displayed. The display processing unit 13 displays content on the display area M of the display 4 a of the center display 3 and the electronic mirror 4 under the control of the control device 11 .

Under the control of the control device 11 , the voice processing unit 14 receives the received voice input from the microphone 17 and outputs the transmitted voice from the speaker 18 . When the text content is input from the control device 11, the voice processing unit 14 converts it into voice, reads it out through the speaker 18, and outputs it.

The position detector 19 detects the position with high accuracy using a well-known GNSS receiver such as GPS (not shown) and an inertial sensor such as an acceleration sensor or a gyro sensor. The position detector 19 outputs a position detection signal to the control device 11 through the I/O control section 15 . The position specifying unit 11a of the control device 11 realizes a function as an ADAS locator that sequentially measures the current position of the vehicle with high accuracy based on the map information input from the map data input device and the position detection signal of the position detector 19. do. ADAS stands for Advanced Driver Assistance Systems.

In this case, the vehicle position is represented by a coordinate system consisting of latitude and longitude. In this coordinate system, for example, the X axis indicates longitude and the Y axis indicates latitude. The vehicle speed sensor detects the speed of the vehicle, but it is also possible to use information such as distance traveled based on the sensing result of the vehicle speed sensor. Various configurations can be adopted as long as the configuration can identify the position of the own vehicle Ca. The control device 11 can perform so-called navigation processing based on the current position of the host vehicle Ca.

The operation panel 21 is a touch panel configured on the center display 3, and the vehicular device 10 receives operation input when there is an operation input by the passenger. The control device 11 executes control based on operation signals from the operation panel 21 .

The occupant monitor 22 detects the state of the occupant in the vehicle or the operating state. The occupant monitor 22 is configured using, for example, a power switch, a turn switch, an automatic control switch, etc., and outputs various signals to the control device 11 .

When the power switch is turned on by the user inside the vehicle in order to start the internal combustion engine or the electric motor, it outputs a signal corresponding to the operation. The turn switch is turned on by an occupant in the vehicle interior when activating the direction indicator of the vehicle Ca, and outputs a turn signal for turning right or left according to the operation.

The automatic control switch outputs an automatic control signal according to the operation when it is turned on by the passenger inside the vehicle in order to command a predetermined driving assistance or automatic control for the running state of the vehicle. By outputting this automatic control signal to the ECU 5 of the travel control system, a corresponding predetermined level of driving assistance or automatic driving control can be executed.

The control device 11 can input the operation state of the power switch, the operation state of the direction indicator, command information for automatic control of the vehicle, and other sensor information and operation information from various sensors.

The vehicle interior camera 20 is a camera that captures an image of the interior of the vehicle, and is a camera that outputs an imaging signal equivalent to that of a rearview mirror that the driver checks while looking forward. The vehicle interior camera 20 outputs an imaging signal to the control device 11 through the I/O control unit 15 , so that the imaging signal is stored in the storage unit 6 .

The peripheral cameras 23 include a front view camera 23a that captures the front of the vehicle, a back camera 23b that captures the rear of the vehicle, a corner camera 23c that captures the front and rear sides of the vehicle, or a side of the vehicle. It is a peripheral monitoring sensor such as a side camera 23d that These cameras 23a to 23d are output to the control device 11 through the I/O control section 15 and stored in the storage section 6 as respective signals for the front guide monitor, back guide monitor, corner view monitor, and side guide monitor. The communication control unit 7 is connected to an in-vehicle network 25 such as CAN or LIN, and controls data communication with other ECUs 5 .

In addition, a distance detection sensor 24 that detects the distance to obstacles and the like is installed in the vehicle as a peripheral monitoring sensor, and outputs a signal to the control device 11 through the I/O control section 15 . The distance detection sensor 24 is composed of clearance sonar, LiDAR, radar using millimeter waves or quasi-millimeter waves, or the like. Detect distance to obstacles such as Here, the subject vehicle Ca is described, but similar functions are also installed in the forward vehicle Cc and the other vehicle Ce, which will be described later.

Each ECU 5 is equipped with SoC. SoC is an abbreviation for System On Chip. The mounted SoC incorporates the aforementioned microcomputer. The microcomputer incorporated in the SoC of the ECU 5 is configured to run various applications (hereinafter abbreviated as apps) on a pre-installed general-purpose OS and real-time OS. 10 can realize various functions by running an application.

The apps mentioned above include image processing apps and other apps. A processor incorporated in the SoC performs drawing processing on the display screens of the center display 3 and the display 4 a of the electronic mirror 4 in response to a drawing request from the image processing application.

Apps include navigation apps. The navigation application implements a navigation function and draws a navigation screen mainly including a map image and the current position of the vehicle Ca on the center display 3 . The display processing unit 13 of the vehicle device 10 also functions as a blank space generating unit 13a and an allocating unit 13b by executing an application.

The operation of the above configuration will be explained with reference to FIG. 3 and subsequent drawings. Here, a form in which the main content and the sub-contents are displayed on the display area M of the center display 3 will be described, but the same applies when displaying them on the display 4a of the electronic mirror 4 or the like.

Standards for general entertainment video content have been formulated for each application, and are produced with an aspect ratio that complies with the established standards. When this type of video content is displayed on a vehicle display, for example, the display 3, the aspect ratio may not be uniform.

When it is assumed that the display processing unit 13 displays video content as main content on the display 3, margins Y1a and Y1b are generated based on the difference in aspect ratio between the display area M of the display 3 and the main content. In such a case, in the present embodiment, the blank space generator 13a creates blank spaces Y1a and Y1b, and the allocation unit 13b allocates the sub-contents to the blank spaces Y1a and Y1b generated based on the difference in aspect ratio.

As shown in FIG. 3, the display processing unit 13 detects the aspect ratio of the main content, and determines NO in S1 when this aspect ratio matches the aspect ratio of the display area M of the display 3 or is closer than a predetermined value. . In this case, the display processing unit 13 outputs the image of the main content to the display 3 in S0, and displays the main content in the display area M of the display 3. FIG.

Conversely, when the display processing unit 13 determines that there is a difference in the aspect ratio of the main content with respect to the aspect ratio of the display area M of the display 3, it determines YES in S1. In S2, the blank space generator 13a creates blank spaces Y1a and Y1b that are uniform in the vertical direction or the horizontal direction. Then, the allocation unit 13b allocates the main content to the central screen SC in S3, and allocates the sub-contents to the margins Y1a and Y1b in S4.

The display processing unit 13 outputs the image of the main content to the display 3 in S5, and displays the main content and the sub-contents in the display area M of the display 3.

The blank generation unit 13a generates blanks Y1a and Y1b for displaying the sub-contents on the own vehicle Ca in response to the peripheral events occurring outside the own vehicle Ca. Assignment to Y1b is desirable. The display processing unit 13 can display the sub-contents according to the peripheral events outside the vehicle while displaying the main content on the center side, for example. The term "peripheral event" as used herein refers to an event that occurs in the vicinity of the vehicle Ca, and can be acquired by a peripheral monitoring sensor or communication with the outside (for example, road-to-vehicle, vehicle-to-vehicle, pedestrian-to-vehicle communication, VICS (registered trademark)). , indicating an event that will draw the attention of the occupants of the

For example, as shown in FIG. 4, the case where the margin generation unit 13a generates margins Y1a and Y1b evenly on the left and right will be described. In this case, the allocation unit 13b allocates the sub-content representing the surrounding situation on the left side of the host vehicle Ca to the left margin Y1a. Also, the allocation unit 13b allocates the sub-content representing the surrounding situation on the right side of the own vehicle Ca to the right margin Y1b. In this case, it is desirable to divide the content C1 modeled after the own vehicle Ca at the center of the vehicle, and to allocate and display the left and right portions respectively. The content C1 may include information such as the surrounding situation of the host vehicle Ca, such as the set inter-vehicle distance. FIG. 4 shows, for example, the content C1 representing the set inter-vehicle distance ahead of the host vehicle Ca as a sub-content.

Thereafter, for example, when another vehicle Cb traveling in the right lane of the vehicle Ca is about to cut into the vehicle Ca's lane, surrounding monitoring sensors such as the surrounding camera 23 and the distance detection sensor 24, and the vehicle-to-vehicle distance It is preferable to detect the movement of the other vehicle Cb by acquiring the operation state of the direction indicator of the other vehicle Cb using communication.

At this time, as shown in FIG. 5, the display processing unit 13 should display the result of monitoring the movement of the other vehicle Cb as content representing the surrounding events of the own vehicle Ca in the right margin Y1b. As a result, it is possible to detect the intrusion of the own vehicle Ca into the safety zone and alert the driver. Also, when a lane change is detected, it is preferable to display an interrupt by the other vehicle Cb in the right margin Y1b as shown in FIG. When vehicle occupants confirm this subcontent, they can intuitively recognize the displayed direction.

Also, as shown in FIG. 6, when the main content is content with an aspect ratio that is horizontally long compared to the display area M of the display 3, the blank generation unit 13a generates blanks Y1a and Y1b evenly in the vertical direction. will be explained. In this case, the allocation unit 13b allocates the sub-content representing the surrounding situation ahead of the host vehicle Ca to the upper margin Y1a. Conversely, the allocation unit 13b allocates the sub-content representing the surrounding situation behind the host vehicle Ca to the lower blank space Y1b.

In this case, it is desirable to divide the content C2 indicating the inter-vehicle distances between the forward vehicle Cc and the rearward vehicle Cd and the host vehicle Ca and display them by dividing them in the vertical direction and assigning them to the upper and lower margins Y1a and Y1b. FIG. 6 shows, as a sub-content, a content C2 that expresses, as a moving image, the inter-vehicle distance between the host vehicle Ca and the forward vehicle Cc when, for example, the vehicle follows the forward vehicle Cc. When the vehicle occupant confirms the sub-content, he or she can intuitively recognize the displayed direction.

As described above, according to the present embodiment, the margin generation unit 13a generates the margins Y1a and Y1b corresponding to the direction of the peripheral event occurring outside the vehicle Ca with respect to the vehicle Ca, and the allocation unit 13b assigns the sub-contents to the margins Y1a and Y1b. When the display processing unit 13 displays the sub-contents in the margins Y1a and Y1b, the vehicle occupant can intuitively recognize the display direction of the sub-contents when checking the sub-contents together with the main content. This makes it easier for the occupants of the own vehicle Ca to grasp the positional relationship between themselves and the sub-contents. For example, a peripheral event occurring on the right side of the vehicle occupant will be displayed on the right side and thus intuitively understood by the occupant. This makes it possible to effectively utilize the blank spaces Y1a and Y1b based on the difference in aspect ratio between the display area M of the display 3 and the main content.

(Second embodiment)
A second embodiment will be described with reference to FIGS. 7 to 9. FIG. Regarding the second embodiment, a display mode when inputting interruption information (for example, information on the front and rear of the own vehicle Ca) that is not related to the left and right will be described.

As shown in FIG. 7, when the display processing unit 13 determines that the aspect ratio of the main content differs from the aspect ratio of the display area M of the display 3, it determines YES in S1. Subsequently, when the sub-content is input, the display processing unit 13 determines whether or not the sub-content to be displayed on the display 3 is information related to the horizontal position. If the sub-content to be evaluated includes information related to the horizontal position, YES is determined in S6.

At this time, the display processing unit 13 generates a margin Y2 on the side corresponding to either the left or right position in S2a, allocates the main content to the screen SC in S3a, allocates the sub-content to the margin Y2 in S4a, and allocates the sub-content to the margin Y2 in S5. The content is output to the display 3 and displayed.

For example, as shown in FIG. 8, when the position specifying unit 11a specifies that the control device 11 has approached a confluence of highways by executing the navigation application, the direction of the confluence in FIG. It is determined that there is a possibility that another vehicle will join from the side road Na on the left side. Note that junctions of expressways include branching points such as interchanges and junctions.

The blank space generation unit 13a of the display processing unit 13 creates a blank space Y2 on the left side in the merging direction, and the allocation unit 13b allocates and displays a navigation map, a bird's eye view including the own vehicle Ca, and an around view monitor. A real image captured by the surrounding camera 23 may be displayed, or an illustration including character information and non-character information such as navigation branch guidance may be used for display.

Further, when the content to be evaluated in S6 of FIG. 7 is the content C2 (see the first embodiment) that indicates the inter-vehicle distance to the forward vehicle Cc, it is information related to the front-rear direction and the left-right position. Since it is irrelevant information, it is determined as NO in S6.

At this time as well, the margin generator 13a generates a margin Y2 on either the left or the right. However, in this case, the blank space generation unit 13a is placed on the driver's seat (hereinafter referred to as D seat) side in the case of content related to driving and vehicles in S2b, and on the front passenger seat (hereinafter referred to as P seat) side in the case of entertainment content. Generate a margin Y2 so as to assign to .

Then, the allocation unit 11b allocates the main content to the screen SC in S3b, allocates the sub-contents to the margin Y2 in S4b, and the display processing unit 13 outputs and displays each content on the display 3 in S5.

For example, as shown in FIG. 9, when the display processing unit 13 receives content indicating the following distance between the own vehicle Ca and the preceding vehicle Cc as sub-content, it determines in S2b that the content is related to driving/vehicle information. do. In this case, the blank space generation unit 13a creates a blank space Y2 on the D seat side, and the assigning unit 13b assigns the content indicating the inter-vehicle distance between the own vehicle Ca and the forward vehicle Cc to the blank space Y2 and displays it.

For example, when the distance between the vehicle Cc and the preceding vehicle Cc is reduced in the driving lane of the own vehicle Ca, if a dangerous situation such as the possibility of sudden braking increases, it can be displayed together in the space Y2 on the D seat side. Therefore, highly urgent content can be effectively displayed to the driver.

Conversely, when the display processing unit 13 receives entertainment-related content as sub-content, it determines that the content is not related to driving or vehicles. In this case, the blank space generation unit 13a creates a blank space Y2 on the P seat side, and the allocation unit 13b allocates the entertainment content to the blank space Y2. Passengers in the P seat can enjoy entertainment images. As described above, this embodiment also has the same effects as those of the first embodiment.

(Third embodiment)
A third embodiment will be described with reference to FIGS. 10 and 11. FIG. In this embodiment, for example, a display mode when an automatic lane change is performed during automatic driving of level III or higher will be described.

In particular, if level III or higher automated driving becomes widespread, vehicle occupants will be able to enjoy main content such as videos and movies while the vehicle is in motion without having to drive or check the surroundings. When the vehicle occupants enjoy the main content during automatic driving, they may be surprised by sudden changes in the surrounding environment, such as the shadows and sounds of other vehicles that suddenly cut into the lane of the vehicle Ca, and this problem can be avoided. is necessary. Therefore, it is desirable to display on the center display 3 as described below.

As shown in FIG. 10, when the display processing unit 13 determines that the aspect ratio of the main content differs from the aspect ratio of the display area M of the center display 3, it determines YES in S1. The display processing unit 13 generates left and right margins Y1a and Y1b evenly in S2, allocates and displays the main content on the screen SC, allocates the sub-contents to the margins Y1a and Y1b, and outputs and displays them on the center display 3 in S5. . The processing up to this point is the same as in the first embodiment.

Subsequently, the control device 11 determines whether or not an automatic lane change to the right has started in S7 during automatic driving based on the input of the automatic control signal of the automatic control switch. When the own vehicle Ca starts an automatic lane change to the right lane, the blank space generation unit 13a generates a stepwise wide blank space Y1b on the right side in S2c, while the allocation unit 13b allocates the main content to the screen SC in S3c, In S4c, the sub-contents are assigned to the margins Y1a and Y1b, and the display processing section 13 outputs and displays them on the center display 3 in S5. These processes S2c, S3c, S4c, and S5 are repeated until the control device 11 determines in S8 that the automatic lane change has ended. Although the widths of the left and right margins Y1a and Y1b are switched stepwise in three or more steps, the division ratio of the top and bottom or the left and right may be changed smoothly or in two steps. In other words, the width of the margin Y1b may be changed smoothly, or the width of the margin Y1b may be changed instantaneously.

Also, as a result of the control device 11 determining whether or not the automatic lane change to the right side has started in S7, if it is determined that the automatic lane change to the left side will start, the determination is NO in S7. When the own vehicle Ca starts an automatic lane change to the left lane, the blank space generating unit 13a generates a wide left blank space Y1b step by step in S2d, while the assigning unit 13b assigns the main content to the screen SC in S3d. In S4d, the sub-contents are assigned to the blanks Y1a and Y1b, and the display processing section 13 outputs them to the center display 3 in S5 for display. These processes S2d, S3d, S4d, and S5 are repeated until the control device 11 determines in S8 that the automatic lane change has ended.

For example, as shown in the upper diagram of FIG. 11, margins Y1a and Y1b are evenly allocated to the left and right of the screen SC on which the main content is displayed, and peripheral information on both left and right sides of the host vehicle Ca is assigned to the margins Y1a and Y1b as sub-contents. is displayed.

When the vehicle starts an automatic lane change, the display processing unit 13 moves the display position step by step while maintaining the aspect ratio of the main content. At this time, when the control device 11 determines that a peripheral event that draws attention to the right direction has occurred, the allocation unit 13b gradually widens the right margin Y1b of the main content, and displays the peripheral situation on the right side of the host vehicle Ca. is widened, and the information of the peripheral camera 23 on the right side is displayed as content.

That is, when an automatic lane change is performed, the division ratio is changed step by step, and the margin Y1b on the side of the automatic lane change can be generated step by step. By widening the right margin Y1b in stages, it is possible to give notice in a countdown manner. As a result, it is possible to notify the occupants of the vehicle of the surrounding conditions of the own vehicle Ca during automatic driving while making a countdown-like advance notice of the occurrence of an event during automatic driving.

If the video content is displayed as the main content on the screen SC, the occupants can enjoy the video content on a display screen with a regular aspect ratio, and by checking the sub-content, they can also grasp the surrounding environment during autonomous driving. can.

According to the present embodiment, when assigning a peripheral event to be focused on to the right margin Y1b in the display area M of the main content, the margin generation unit 13a generates the margin Y1a, Y1b is generated, and the allocation unit 13b allocates sub-contents to the margins Y1a and Y1b. As a result, the situation around the host vehicle Ca can be conveyed to the vehicle occupants in an impressive manner. The same applies when assigning a peripheral event to be noticed to either one of the upward, downward, or leftward margins Y1a and Y1b, but the description thereof will be omitted.

(Fourth embodiment)
A fourth embodiment will be described with reference to FIGS. 12 and 13. FIG. In this embodiment, a mode will be described in which margins are generated in at least one of the four corners of the lower right corner, upper right corner, upper left corner, and lower left corner of the screen SC on which the main content is displayed, and the sub content is assigned and displayed. "Margins" in this embodiment correspond to the margins Y3a, Y3b, and Y3c in FIG.

As described in the above embodiment, it is desirable to allocate and display the contents corresponding to the directions of the surrounding events of the own vehicle Ca at the lower right, upper right, upper left, and lower left corners as sub-contents. When the driver is driving normally, if the driver's attention is on either the left or right side and the front or back of the vehicle Ca at the same time, the display can be divided into an L-shape as in the following example. desirable.

A case will be explained using FIGS. 12 and 13. When the display processing unit 13 determines that there is a difference in the aspect ratio of the main content with respect to the aspect ratio of the display area M of the center display 3, it determines YES in S1 of FIG.

As shown in FIG. 13, consider the case where the vehicle Ca merges with the main line N of the expressway located on the right side due to the driving of the driver. In this case, the control device 11 determines by the navigation function that it is an expressway junction, and determines YES in S9 of FIG.

The margin generator 13a moves the screen SC displaying the main content to the upper left corner of the display area M, and generates margins Y3a, Y3b, and Y3c on the right, lower right, and lower sides of the screen SC. Then, the allocation unit 13b allocates the main content to the screen SC in S3e, and allocates the bird's-eye view to the right margin Y3a in S4e.

The allocation unit 13b allocates the captured image of the door mirror camera 4b to the lower right margin Y3b, and further allocates the rearward image captured by the back camera 23b or the captured image corresponding to the door mirror captured by the vehicle interior camera 20 to the lower margin Y3c. Then, the display processing unit 13 outputs these images to the center display 3 to display them in S5.

As a result, the sub-contents can be displayed in the right margin Y3a, the lower right margin Y3b, and the lower margin Y3c of the main content as shown in FIG. It can be understood multilaterally and intuitively together with the position of the vehicle Ca. FIG. 13 shows a situation in which another vehicle Ce is approaching the main line N of the highway located to the right rear of the own vehicle Ca. It can be understood.

(Other embodiments)
The present disclosure is not limited to the embodiments described above, and can be implemented in various modifications, and can be applied to various embodiments without departing from the scope of the present disclosure.

In the drawing, 1 is a vehicle display system, 3 is a center display (display), 4a is an electronic mirror display, 13a is a blank space generation unit, 13b is an allocation unit, 13 is a display processing unit, 23 is a peripheral camera (perimeter monitoring sensor ), 24 is a distance detection sensor (surroundings monitoring sensor), Ca is the subject vehicle, and Y1a and Y1b are margins.

The vehicle device 10, display processing unit 13 approach described in the present disclosure is provided by configuring a processor and memory programmed to perform one or more functions embodied by a computer program. It may also be realized by a dedicated computer. Alternatively, the vehicular device 10, display processor 13, and techniques described in the present disclosure may be implemented by a dedicated computer provided by configuring a processor with one or more dedicated hardware logic circuits. Alternatively, the vehicular device 10, display processor 13, and techniques described in this disclosure comprise a processor and memory and one or more hardware logic circuits programmed to perform one or more functions. It may also be implemented by one or more dedicated computers configured in combination with a dedicated processor. The computer program may also be stored as computer-executable instructions on a computer-readable non-transitional tangible storage medium.

Although the present disclosure has been described based on the above-described embodiments, it is understood that the present disclosure is not limited to those embodiments or structures. The present disclosure also includes various modifications and modifications within the equivalent range. In addition, various combinations and configurations, as well as other combinations and configurations including one, more, or less elements thereof, are within the scope and spirit of this disclosure.

Claims

A margin generation unit ( 13a) and
an allocation unit (13b) that allocates the main content to the display area and the sub-content to the margin;
a display processing unit (13) for displaying the main content in the display area of the display and displaying the sub-content in the margin of the display area;
A display for a vehicle in which the blank space generating unit generates the blank space corresponding to the direction of a peripheral event occurring outside the own vehicle (Ca) with respect to the own vehicle (Ca), and the assigning unit assigns the sub-content to the blank space. system.
2. The vehicle according to claim 1, wherein the peripheral event is an event that occurs in the vicinity of the own vehicle, can be acquired by peripheral monitoring sensors (23, 24) or communication with the outside, and indicates an event that draws the attention of the occupants of the vehicle. display system.
The allocation unit normally allocates the sub-content to the margins (Y1a, Y1b) equally divided vertically or horizontally in the display area of the main content,
When assigning the peripheral event that draws the passenger's attention to either the top, bottom, left, or right margins with respect to the display area of the main content as the sub-content, either the top, bottom, left, or right margin (Y1b ), the vehicle display system according to claim 1 or 2.
When the allocation unit allocates the sub-contents to either the vertical direction or the horizontal direction of the main content, it allocates the contents related to driving and vehicles to the driver's seat side and the entertainment-related contents to the passenger's seat side as the sub-contents. 4. The vehicle display system according to claim 3.
When allocating the peripheral event that draws attention to one of the blank spaces to the display area of the main content, the blank space generating unit generates the blank space while changing the division ratio between the top and bottom or the left and right, and the allocation unit 4. The vehicle display system according to claim 3, wherein the sub-content is allocated to the margin.
A margin generator (13a) for displaying sub-content in the display area (3, 4a) based on the size difference in aspect ratio between the display area (M) of the display (3, 4a) and the main content to be displayed in the display area. generate margins,
an allocation unit (13b) allocating the main content to the display area and the sub-content to the margin;
When the display processing unit (13) causes the main content to be displayed in the display area of the display and the sub-content to be displayed in the margin of the display area,
The margin generation unit generates the margin corresponding to the direction of a peripheral event occurring outside the vehicle (Ca) with respect to the vehicle (Ca),
A display method for a vehicle, wherein the allocation unit allocates the sub-content to the blank space.
A margin generator (13a) for displaying sub-contents in the display area based on the size difference in aspect ratio between the display area (M) of the display (3, 4a) and the main content to be displayed in the display area. Let it run the procedure to generate the margins,
causing an allocation unit (13b) to execute a procedure for allocating the main content to the display area and the sub-content to the margin;
When causing the display processing unit (13) to display the main content in the display area of the display and display the sub-content in the margin of the display area,
causing the margin generating unit to execute a procedure for generating the margin corresponding to the direction of a peripheral event occurring outside the own vehicle (Ca) with respect to the own vehicle (Ca), and the assigning unit assigning the sub-content to the margin; A display program for vehicles that executes the allocation procedure.