CN116788156A

CN116788156A - Environment image display method and device, vehicle and storage medium

Info

Publication number: CN116788156A
Application number: CN202310651414.XA
Authority: CN
Inventors: 王旭; 范志超
Original assignee: Great Wall Motor Co Ltd
Current assignee: Great Wall Motor Co Ltd
Priority date: 2023-06-02
Filing date: 2023-06-02
Publication date: 2023-09-22

Abstract

The application provides an environment image display method, a device, a vehicle and a storage medium, wherein the method is applied to the field of vehicle electronics and comprises the following steps: acquiring an environment image acquired by an electronic exterior rearview mirror; in the event of a failure of the electronic rear view mirror, determining a target screen within the vehicle based on the failed component of the electronic rear view mirror; and sending the environment image to the target screen for display. According to the method, under the condition that the electronic rearview mirror fails, the environment image acquired by the electronic outside rearview mirror is displayed in other screens in the vehicle, so that the display success rate of the environment image is improved, the reliability and the safety of the electronic rearview mirror are further improved, driving accidents caused by incapability of displaying the environment image are avoided, and the driving safety is improved.

Description

Environment image display method and device, vehicle and storage medium

Technical Field

The present application relates to the field of vehicle electronics, and more particularly, to an environmental image display method, apparatus, vehicle, and storage medium in the field of vehicle electronics.

Background

With the progressive development of the automotive industry, more and more automobiles support the enhancement of the driver's visual perception of the surroundings of the vehicle through electronic rear-view mirrors within the vehicle.

Compared with the traditional rearview mirror, the electronic rearview mirror has the advantages of small volume, small wind resistance, more flexible installation angle and capability of shooting the information of the surrounding environment of the vehicle in a larger range, thereby enhancing the visual perception of a driver to the surrounding environment of the vehicle, further improving the driving safety of the vehicle and avoiding accidents caused by the shielding of the visual field of the traditional rearview mirror.

However, if the electronic rearview mirror is abnormal during driving of the vehicle, surrounding environment information cannot be displayed normally, and driving safety is greatly affected.

Disclosure of Invention

The application provides an environment image display method, an environment image display device, a vehicle and a storage medium.

In a first aspect, there is provided an environmental image display method applied to a vehicle on which an electronic rear view mirror is mounted, the method including:

acquiring an environment image acquired by an electronic exterior rearview mirror;

in the event of a failure of the electronic rear view mirror, determining a target screen within the vehicle based on the failed component of the electronic rear view mirror;

And sending the environment image to the target screen for display.

According to the technical scheme, under the condition that the electronic rearview mirror breaks down, the environment images acquired by the electronic outside rearview mirror are displayed on other screens in the vehicle, so that the success rate of displaying the environment images is improved, the reliability and the safety of the electronic rearview mirror are further improved, driving accidents caused by incapability of displaying the environment images are avoided, and the driving safety is improved.

With reference to the first aspect and the foregoing implementation manner, in some possible implementation manners, the electronic rearview mirror includes a rearview mirror controller and two rearview mirror display screens, where the two rearview mirror display screens are installed on two sides in the vehicle;

the determining a target screen in the vehicle based on the component with the electronic rearview mirror malfunctioning comprises:

under the condition that the rearview mirror display screen at one side fails, determining the transparent A column display screen at the one side as a target screen;

and under the condition that both rearview mirror display screens at two sides are failed and/or a rearview mirror controller is failed, determining the transparent A column display screens at two sides as target screens.

According to the technical scheme, under the condition that the rearview mirror display screen fails, the transparent A column display screen on the corresponding side of the failed rearview mirror display screen is used as a target screen to display the environment image which is required to be displayed in the rearview mirror display screen, so that the display success rate of the image acquired by the electronic outside rearview mirror is improved, the use habit of a driver is changed as little as possible, and the driving experience of a user is ensured.

With reference to the first aspect and the foregoing implementation manner, in some possible implementation manners, the determining, based on the component in which the electronic rearview mirror fails, a target screen in the vehicle includes:

a target screen within the vehicle is determined based on the failed component of the electronic rear view mirror and a direction of travel of the vehicle.

According to the technical scheme, the driving direction of the vehicle is considered when the target screen is determined, the influence on a driver caused by changing the screen displaying the environment image is reduced, and the driving safety is further ensured.

With reference to the first aspect and the foregoing implementation manner, in some possible implementation manners, the determining, based on the component in which the electronic rearview mirror fails and the driving direction of the vehicle, a target screen in the vehicle includes:

determining the one side of the electronic interior rear view mirror as a target screen in the case that the rear view mirror display screen at the one side fails and the vehicle travels to the one side;

under the condition that both rearview mirror display screens at two sides are failed and the vehicle runs to any side, determining that both sides of the electronic inner rearview mirror are target screens;

and under the condition that the rearview mirror controller fails and the vehicle runs to any side, determining the two sides of the electronic inner rearview mirror as target screens.

According to the technical scheme, when the vehicle runs to any side, the environment image is displayed in the electronic inner rearview mirror, and as the vehicle needs to observe the environments on two sides of the vehicle when running to two sides, the interference to a driver can be reduced, and the driving safety is further ensured.

With reference to the first aspect and the foregoing implementation manner, in some possible implementation manners, the acquiring an environmental image acquired by the electronic exterior rearview mirror includes:

and acquiring an environment image acquired by the electronic outside rear view mirror through a target image transmission link corresponding to the component with the fault of the electronic rear view mirror.

In the technical scheme, different image transmission links are arranged for different components with faults in the electronic rearview mirror, so that the success rate of image transmission is ensured, and the success rate of image display is further ensured.

With reference to the first aspect and the foregoing implementation manner, in some possible implementation manners, the vehicle further includes an intelligent driving controller, and the electronic rearview mirror is communicatively connected with the intelligent driving controller;

the obtaining the environmental image collected by the electronic exterior rearview mirror through the target image transmission link corresponding to the component with the failure of the electronic rearview mirror comprises the following steps:

Under the condition that the rearview mirror display screen at any side fails, acquiring an environment image acquired by the electronic exterior rearview mirror through the rearview mirror controller;

and under the condition that the rearview mirror controller fails, acquiring an environment image acquired by the electronic exterior rearview mirror through the intelligent driving controller.

According to the technical scheme, the environment images acquired by the electronic exterior rearview mirror are supported to be acquired by adopting the intelligent driving controller and the rearview mirror controller, so that the image transmission success rate is improved, and the image display success rate is further improved.

With reference to the first aspect and the foregoing implementation manner, in some possible implementation manners, the electronic rearview mirror includes a rearview mirror controller and two rearview mirror display screens, the vehicle further includes an intelligent driving controller, and before determining the target screen in the vehicle based on the component in which the electronic rearview mirror fails, the method further includes:

determining, by the rearview mirror controller, whether the rearview mirror display screen has failed; and/or the number of the groups of groups,

determining, by the intelligent driving controller, whether the rearview mirror controller has failed; and/or the number of the groups of groups,

and determining whether the rearview mirror controller fails or not according to the pressing state of the preset key.

Among the above-mentioned technical scheme, detect the electron rear-view mirror through multiple mode, improve the trouble detection rate to the electron rear-view mirror, and then can in time show the environment image through other display screens, further strengthen electron rear-view mirror reliability and security.

In a second aspect, there is provided an environmental image display device applied to a vehicle on which an electronic rear view mirror is mounted, the device comprising:

the acquisition module is used for acquiring an environment image acquired by the electronic exterior rearview mirror;

a determining module for determining a target screen in the vehicle based on a component of the electronic rear view mirror that fails in case of failure of the electronic rear view mirror;

and the sending module is used for sending the environment image to the target screen for display.

In a third aspect, a vehicle is provided that includes a memory and a processor. The memory is for storing executable program code and the processor is for calling and running the executable program code from the memory such that the vehicle performs the method of the first aspect or any of the possible implementations of the first aspect.

In a fourth aspect, there is provided a computer program product comprising: computer program code which, when run on a computer, causes the computer to perform the method of the first aspect or any one of the possible implementations of the first aspect.

In a fifth aspect, a computer readable storage medium is provided, the computer readable storage medium storing computer program code which, when run on a computer, causes the computer to perform the method of the first aspect or any one of the possible implementations of the first aspect.

Drawings

FIG. 1 is a schematic diagram of the working principle of an electronic exterior rear view mirror;

FIG. 2 is a schematic view of still another operational principle of the electronic outside rear view mirror;

FIG. 3 is a schematic flow chart of an environmental image display method provided by an embodiment of the present application;

FIG. 4 is a schematic view showing an electronic endoscope in accordance with an embodiment of the present application;

fig. 5 is a schematic structural diagram of an environmental image display device according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a vehicle according to an embodiment of the present application.

Detailed Description

The technical scheme of the application will be clearly and thoroughly described below with reference to the accompanying drawings. Wherein, in the description of the embodiments of the present application, unless otherwise indicated, "/" means or, for example, a/B may represent a or B: the text "and/or" is merely an association relation describing the associated object, and indicates that three relations may exist, for example, a and/or B may indicate: the three cases where a exists alone, a and B exist together, and B exists alone, and furthermore, in the description of the embodiments of the present application, "plural" means two or more than two.

The terms "first," "second," and the like, are used below for descriptive purposes only and are not to be construed as implying or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature.

As the automotive industry has evolved, more and more vehicles have begun to use electronic rear view mirrors (Camera Monitor System, CMS) to collect and display environmental information about the surroundings of the vehicle.

The electronic rearview mirror is an indirect view device for acquiring a prescribed view through a system composed of a camera and a monitor, and the indirect view device in a vehicle is a device for providing a vehicle driver with a view of a region behind, beside and in front of the vehicle which cannot be directly observed in the vehicle. The electronic rearview mirror is a system formed by a plurality of components, wherein the components comprise a high-definition camera, a controller, a liquid crystal display and the like. The high-definition camera is used for collecting the surrounding image of the vehicle, particularly the surrounding image of the rear of the vehicle, so that the function of the traditional rearview mirror is realized, and in this case, the high-definition camera is installed at the rear and two sides of the vehicle. In some embodiments, the high definition camera is mounted around the vehicle. For example, the high-definition camera may include a front view camera installed at a front of a vehicle, such as a front license plate frame, a front logo of the vehicle, a side view camera installed at two sides of the vehicle, such as a rear view mirror of the vehicle, a B pillar of the vehicle, and a rear view camera installed at a rear of the vehicle, such as a rear license plate frame of the vehicle, etc., and may be used to collect environmental information of the vehicle looking around, and behind the front of the vehicle.

From the exterior, electronic rear-view mirrors typically include an electronic exterior rear-view mirror and an electronic interior rear-view mirror. The electronic outer rearview mirror is used for realizing the function of the traditional outer rearview mirror, and is mainly used for displaying the rear environment images on two sides of a vehicle and assisting a driver in observing the environment conditions of the vehicle, pedestrians, roads and the like on the rear side. The electronic inner rearview mirror realizes the function of the traditional inner rearview mirror, is mainly used for displaying the environment image behind the vehicle and assisting a driver in observing the environment conditions of the vehicle, pedestrians, roads and the like behind the vehicle. The electronic inside rear view mirror and the electronic outside rear view mirror are each exemplified below:

the electronic inside rear view mirror is also called a streaming media rear view mirror and is composed of an electronic inside rear view mirror camera, an electronic inside rear view mirror display screen and an electronic inside rear view mirror controller. The electronic endoscope camera generally comprises a rearview camera in the high-definition camera, and is used for collecting an environment image right behind a vehicle. Electronic interior rear view mirror displays are typically mounted in the vehicle interior, such as may be mounted on the front windshield top of the vehicle. The implementation scheme of the electronic interior rearview mirror is that an electronic interior rearview mirror camera collects an environment image and transmits the environment image to an electronic interior rearview mirror controller, and the electronic interior rearview mirror controller processes the environment image and controls an electronic interior rearview mirror display screen to display the processed environment image. Compared with the traditional internal rearview mirror, the electronic internal rearview mirror camera can acquire an environment image of the right rear of the vehicle in a larger range, so that the visual perception of a driver to the right rear of the vehicle is enhanced.

An electronic outside rear view mirror is generally composed of an electronic outside rear view mirror camera mounted on both sides of a vehicle, a liquid crystal display (referred to as a rear view mirror display screen in the present application) mounted on both sides of the vehicle, and an electronic outside rear view mirror controller (referred to as a rear view mirror controller in the present application). The electronic exterior rearview mirror camera generally comprises a side view camera of the high-definition camera, and is mainly used for collecting environment images behind two sides of a vehicle. The electronic outside rearview mirror collects environmental images at the rear sides of the vehicle through the electronic rearview mirror cameras at the two sides, sends the environmental images to the rearview mirror controller, and the rearview mirror controller processes the environmental images and sends the environmental images to a rearview mirror display screen in the vehicle for displaying. Compared with the traditional external rearview mirror, the electronic external rearview mirror camera can acquire the vehicle side rear environment image in a larger range, so that the electronic external rearview mirror can enhance the visual perception of a driver to the vehicle side rear environment.

The implementation scheme of the electronic exterior rearview mirror mainly comprises the following two types: one implementation scheme is shown in fig. 1, the electronic outside rear view mirror cameras on two sides are connected to the same rear view mirror controller through a coaxial line, environmental images collected by the electronic outside rear view mirror cameras on two sides are processed by the rear view mirror controller, and the display screens of the rear view mirrors on two sides are driven to display the processed images. In another implementation scheme, as shown in fig. 2, two side electronic exterior rearview mirror cameras are respectively connected to two rearview mirror controllers through coaxial lines, and the two rearview mirror controllers respectively process images acquired by the two side electronic exterior rearview mirror cameras and respectively drive two side display screens to display the images.

In order to improve reliability and safety of an electronic rearview mirror and further improve driving safety, the application provides an environment image display method, an environment image display device, a vehicle and a storage medium. An exemplary description will be first made of an environmental image display method provided by the present application. The environment image display method provided by the application can be applied to vehicles. The environment image display method provided by the application can be applied to a controller in a vehicle, and can be the rearview mirror controller or a general controller in the vehicle. For an automatic driving vehicle, the environment image display method provided by the application can be applied to an intelligent driving controller of the automatic driving vehicle. The intelligent driving controller is a controller which performs intelligent control of the vehicle, such as driving decision, image processing and the like, in the automatic driving vehicle.

Fig. 3 is a schematic flowchart of an environmental image display method provided in an embodiment of the present application. Illustratively, as shown in FIG. 3, the method includes:

301, acquiring an environment image acquired by an electronic exterior rearview mirror;

the environment images are environment images at the rear of two sides of the vehicle, which are acquired by the electronic exterior rearview mirror camera.

302, in the event of a failure of the electronic rear view mirror, determining a target screen within the vehicle based on the failed component of the electronic rear view mirror;

the components in the electronic rearview mirror can be electronic equipment capable of realizing functions such as image acquisition, processing or transmission, and the like, and can comprise a rearview mirror display screen, a rearview mirror controller and the like. Failure of an electronic rearview mirror means that components in the electronic rearview mirror cannot normally perform their own functions. For example, the mirror controller cannot receive, process or transmit an image, the mirror display screen is damaged in appearance, an environmental image cannot be normally displayed, and so on.

When the electronic rearview mirror fails and the rearview mirror display screen on one side or two sides cannot normally display the environment image, other screens in the vehicle can be determined as target screens to display the environment image acquired by the electronic outside rearview mirror.

303, sending the environment image to the target screen for display.

In summary, according to the environmental image display method provided by the application, after the electronic rearview mirror is detected to be faulty, the environmental image collected by the electronic outside rearview mirror is sent to other screens in the vehicle for display, so that the display success rate of the environmental image collected by the electronic outside rearview mirror is improved, accidents caused by the fact that the image collected by the electronic outside rearview mirror cannot be displayed are avoided, the reliability and the safety of the electronic rearview mirror are improved, and the driving safety is further improved.

The above steps 301-303 are exemplarily described below:

as described above, in the electronic exterior mirror, the environment image acquired by the electronic exterior mirror camera is generally acquired by the mirror controller, and is transmitted to the mirror display screen for display after the environment image is processed. However, if the rearview mirror controller fails to work properly, other components in the vehicle are required to acquire, process, send and the like the environment image.

Taking the above-mentioned autonomous vehicle as an example, in the case where the mirror controller fails, the intelligent driving controller may be used to perform the processing performed by the original mirror controller. In a conventional manually driven vehicle, if the mirror controller fails, the overall controller in the vehicle may be used to perform the processing that was performed by the mirror controller.

Accordingly, in a possible embodiment, in step 301, when the environmental image acquired by the electronic outside rear view mirror is acquired, the target image transmission link may be determined according to the component where the electronic rear view mirror fails, and the environmental image acquired by the electronic outside rear view mirror is acquired through the target image transmission link. The above-mentioned image transmission link refers to a link from an acquisition component of an environmental image to a component that performs image processing on the environmental image.

Optionally, taking an automatic driving vehicle as an example, under the condition that the display screen of the rearview mirror on any side or the display screens of the rearview mirrors on both sides have faults, acquiring an environment image acquired by the electronic exterior rearview mirror through the rearview mirror controller; under the condition that the rearview mirror controller fails, an environment image acquired by the electronic exterior rearview mirror is acquired through the intelligent driving controller.

If only the rearview mirror display screen fails, the rearview mirror controller can still normally perform image processing, and then the environment image acquired by the electronic exterior rearview mirror can be continuously acquired through the rearview mirror controller.

Specifically, as shown in fig. 1, the rearview mirror controller may obtain an environmental image collected by the electronic exterior rearview mirror camera through an LVDS (Low-Voltage Differential Signaling, low voltage differential signaling) harness.

If the rearview mirror controller fails, the rearview mirror controller cannot acquire, process or send the environment image acquired by the electronic exterior rearview mirror. At this time, the intelligent driving controller may perform acquisition, processing, and the like of the environmental image acquired by the electronic outside rear view mirror. The intelligent driving controller is in communication connection with the electronic exterior rearview mirror camera through an LVDS wire harness, and can acquire and process an environment image acquired by the electronic exterior rearview mirror through the LVDS wire harness under the condition that the rearview mirror controller fails. Optionally, the processing the environmental image may refer to fusing, noise reduction, split screen and the like of the environmental images acquired by different cameras, which is not particularly limited in the present application.

In the case that a component in the electronic rear view mirror fails, and the environmental image acquired by the electronic exterior rear view mirror camera cannot be normally displayed in the rear view mirror display screen, other screens in the vehicle are determined to be target screens for displaying the environmental image acquired by the electronic exterior rear view mirror.

Multiple screens are typically provided in a vehicle. By way of example, a center control display, a rearview mirror display, an electronic inside rearview mirror display, a transparent a-pillar display, and the like may be included in a vehicle. The above-mentioned central control display screen is generally used to display driving information, control information, and the like of a vehicle. Such as displaying a car navigation page, a multimedia information playing page, etc. The transparent A column display screen is a display screen arranged on an A column at two sides of the vehicle and used for displaying the environmental information shielded by the A column, such as the environmental information at the left front and the right front of the vehicle. The traditional automobile A column can block the sight of a driver, the transparent A column display screen can display the environmental information which is originally blocked by the automobile A column, the view blocking of the driver can be reduced as much as possible, and the driving safety is improved.

In step 302, in the case where the electronic rearview mirror fails and the rearview mirror display screen cannot normally display the environment, other screens in the vehicle except the rearview mirror display screen are determined as target screens for displaying the environment image according to the components where the electronic rearview mirror fails.

The following describes an example of an environment image display method provided by the application, in which the environment image cannot be normally displayed by the rearview mirror display screen due to the failure of the rearview mirror controller and the rearview mirror display screen:

in one possible implementation, in the case that the rearview mirror display screen on one side fails, determining the transparent a-pillar display screen on the side as a target screen; and under the condition that the rearview mirror display screens at two sides are failed and/or the rearview mirror controller is failed, determining the transparent A column display screens at two sides as target screens.

And under the condition that the display screen of the rearview mirror on one side fails and the environment image cannot be displayed normally, taking the transparent A column display screen on the same side as the failed display screen of the rearview mirror as a target screen. The other side of the rearview mirror display screen which does not have faults normally displays the environment image acquired by the electronic exterior rearview mirror. The rearview mirror display screen is usually arranged at a position close to the A column of the vehicle, and by using the technical scheme, the use habit of a driver can be changed as little as possible while the reliability of the electronic rearview mirror is improved.

For example, the correspondence between the failed component in the electronic rearview mirror and the target screen may be stored in advance, for example, the correspondence between the component identifier and the screen identifier may be stored in advance. According to the stored corresponding relation, the vehicle can determine the transparent A column display screen on the same side as the target screen under the condition that the rearview mirror display screen on one side fails.

If the rearview mirror display screens at the two sides are failed or the rearview mirror controller is failed, so that the rearview mirror display screens at the two sides can not normally display the environment images, the transparent A column display screens at the two sides can be used as target screens to display the environment images which are required to be displayed on the corresponding rearview mirror display screens.

As described above, the transparent A column display screen can reduce the shielding of the visual field of the driver, especially the shielding of the visual field during turning and lane changing, of the traditional automobile A column, and further improve the driving safety. In these scenes, if the transparent a-pillar display screen is used as the target screen to display the environmental image that needs to be displayed in the rearview mirror display screen, the view of the driver may be blocked, and thus the driving safety is affected.

Thus, in one embodiment of the application, the target screen within the vehicle may also be determined based on the malfunctioning component of the electronic rear view mirror and the direction of travel of the vehicle.

Therefore, when the electronic rearview mirror breaks down and the vehicle needs to use the transparent A column to observe the environments on two sides of the vehicle, other screens in the vehicle are determined to serve as target screens to display the environment images acquired by the electronic outside rearview mirror, the safety of the electronic rearview mirror can be improved, the interference to a driver can be reduced, and the driving safety is further guaranteed.

For example, in the event that a rear view mirror display screen on one side fails and the vehicle is traveling to that side, then determining that side of the electronic interior rear view mirror as the target screen; under the condition that both rearview mirror display screens at two sides are out of order and the vehicle runs to any side, determining the two sides of the electronic inner rearview mirror as target screens; in the case where the mirror controller fails and the vehicle is traveling to either side, it is determined that both sides of the electronic inside rear view mirror are the target screens.

In this embodiment, the electronic endoscope may display the environmental image in a split screen manner. The left half part of the electronic inner rearview mirror can be used for displaying the environment image which is required to be displayed on the left rearview mirror display screen, and the right half part of the electronic inner rearview mirror can be used for displaying the environment image which is required to be displayed on the right rearview mirror display screen.

For example, the vehicle is traveling to the left, such as changing lanes or turning left, while the mirror display screen at the left of the vehicle is malfunctioning, and the environmental image cannot be displayed normally. At this time, the left side screen of the electronic inside rear view mirror inside the vehicle may be determined as a target screen to display an environmental image that is originally required to be displayed in the left side rear view mirror display screen of the vehicle. The right screen of the electronic inside rear view mirror can normally display an image of the environment behind the vehicle, and so on.

As a specific embodiment, the electronic outside mirror failure component and the correspondence relationship between the vehicle traveling direction and the target screen may be stored in advance. For example, the component identifier and the travel direction identifier may be stored in correspondence with the screen identifier. When a side mirror display screen fails and the vehicle is traveling toward the side, the vehicle may determine that the side screen of the electronic rear view mirror is the target screen.

When the rearview mirror controller is out of order or both rearview mirror display screens are out of order, the images can not be normally displayed on both rearview mirror display screens, and meanwhile, the vehicle runs to any side, such as left/right lane changing or turning around and the like, and at the moment, a driver needs to observe the side environment through the transparent A column. Therefore, in this scenario, both sides of the electronic rear view mirror can be taken as the target screen, and the environment image originally required to be displayed in the rear view mirror screen on both sides can be split-screen displayed in the electronic rear view mirror, as shown in fig. 4. In this way, the environmental images are displayed in the same electronic rearview mirror screen, so that the driver can more conveniently view the environment condition behind the vehicle side while reducing the interference to the driver's visual field.

In one possible embodiment, in order not to affect the display of the image behind the vehicle by the electronic inside rear view mirror, the vehicle may fuse the environmental images collected by the electronic rear view mirror on both sides of the vehicle and behind the vehicle, and then display the fused images on the electronic inside rear view mirror by using a screen to ensure the integrity of the information contained in the environmental images as much as possible, so as to further reduce the field of view disturbance to the driver.

The images may be fused in a variety of ways in this embodiment. For example, if the mirror controller can function properly. The side view cameras on two sides and the environment images acquired by the rear view cameras are acquired through the rearview mirror controller, and the 3 environment images are spliced according to the overlapping scene parts in the acquired environment images, so that a fusion image is obtained. The rearview mirror controller can carry out split-screen processing on the fused images to obtain two environment images to be displayed. One of the environmental images needs to be displayed on the left screen of the electronic inside rear view mirror, and the other environmental image needs to be displayed on the right screen of the electronic inside rear view mirror. Of course, three environmental images may be sequentially arranged according to the camera direction in which the environmental images are actually collected and then displayed in the electronic rearview mirror.

The application does not limit the type of the displayed image specifically, and can determine according to the actual driving scene. For example, the left and right looking-around images of the vehicle can be displayed when the vehicle is stopped, and the left and right looking-around images of the vehicle can be displayed when the vehicle is running normally.

In one possible embodiment, the target screen may also be specified by the user. For example, an identification of a candidate screen indicating a screen that can be used to display an environmental image in the case where the rear view mirror display screen cannot normally display the environmental image may be displayed in the rear view mirror display screen. As a specific implementation, optional candidate screen identifiers can be displayed when the rearview mirror display screen is used for the first time, such as a transparent A column display screen, an electronic inner rearview mirror, a central control display screen identifier and the like. The user can select a target screen for displaying the environment image in the case that the rear view mirror display screen cannot normally display the environment image in a touch screen, a key and the like. After receiving the user input, the rearview mirror controller can correspondingly store the target screen selected by the user and the rearview mirror display screen. When the rearview mirror display screen fails, the rearview mirror controller or the intelligent driving controller can determine the target screen based on the corresponding relation between the target screen and the rearview mirror display screen.

After the target screen is determined, the environment image can be sent to the target screen for display. The following describes the procedure of transmitting the environment image to the target screen for display by the rearview mirror controller and the intelligent driving controller, respectively, for example, in the following step 303:

after the environment image is processed by the rearview mirror controller, the processed environment image can be sent to a target screen for display. The image processing may refer to fusing, noise reduction, split screen, etc. of images acquired by different cameras, which is not particularly limited in the present application.

Taking the target screen as a transparent A-column display screen as an example, the rearview mirror controller can still work normally, so that the environment image can be sent to the transparent A-column controller by the rearview mirror controller through the vehicle-mounted Ethernet, and the image is displayed in the transparent A-column display screen by the transparent A-column controller.

Taking the target screen as an electronic inner rear view mirror as an example, the rear view mirror controller can send the environmental image to the electronic inner rear view mirror controller through the vehicle-mounted Ethernet, and meanwhile, the rear view mirror controller can also send the display position identification of the environmental image to the electronic inner rear view mirror controller. The above display position identification may indicate a screen on which side of the electronic rear view mirror the environment image is displayed. After the electronic inner rearview mirror controller receives the information, the environment image can be displayed in the corresponding side screen according to the display position identification.

If the rearview mirror controller fails, the rearview mirror controller cannot process the environment image acquired by the electronic exterior rearview mirror. At this time, the intelligent driving controller can acquire the environment image acquired by the electronic exterior rearview mirror, process the environment image, and send the processed image to the target screen for display. Specifically, the intelligent driving controller is in communication connection with the electronic rearview mirror through an LVDS wire harness. Therefore, the intelligent driving controller can acquire the image acquired by the electronic exterior rearview mirror through the LVDS wire harness and send the image to the target screen for display after processing the image.

Taking the target screen as a transparent A-column display screen as an example, the intelligent driving controller is generally in communication connection with the transparent A-column through a coaxial line LVDS wire harness, and correspondingly, the intelligent driving controller can send an image acquired by the electronic outside rear-view mirror to the transparent A-column controller through the LVDS wire harness, so that the image is displayed on the transparent A-column display screen.

Therefore, under the condition that the rearview mirror controller does not fail, the rearview mirror controller can be continuously used for image processing, and only the intelligent driving controller is used for image processing under the condition that the rearview mirror controller fails, so that the reliability of the electronic rearview mirror is improved, and meanwhile, the resource consumption of the intelligent driving controller is reduced.

In one possible embodiment, the electronic rear view mirror may also be fault detected prior to step 302 described above. The application can detect the fault condition of the electronic outside rear-view mirror in various modes.

In one possible embodiment, it may be determined by the rearview mirror controller whether the rearview mirror display screen is malfunctioning;

the rearview mirror controller is in communication connection with the rearview mirror display screen through a wire harness. If the rearview mirror display screen fails and can not normally display images, the wire harness can be actively used for sending error reporting signals to the rearview mirror controller. And after receiving the error signal, the rearview mirror controller can determine that the rearview mirror display screen fails.

In one possible embodiment, it is also possible to determine whether the mirror controller is malfunctioning by the intelligent driving controller. The intelligent driving controller is in communication connection with the electronic rearview mirror.

For example, a fault alarm module may be included in the rearview mirror controller, and the fault alarm module may send an alarm signal to the intelligent driving controller when the rearview mirror controller fails. The intelligent driving controller can determine that the rearview mirror controller fails after receiving the alarm signal.

In one possible embodiment, it is also possible to determine whether the mirror controller has failed by the pressed state of the preset key.

For example, mechanical keys or screen keys or the like may be provided in the vehicle in advance. When the rearview mirror controller fails, the rearview mirror failure condition can be displayed in a display screen, for example, a word of 'controller failure' can be displayed. After the user sees the display, he can press the above-mentioned key. For an intelligent driving vehicle, the pressing state of the key can be monitored by an intelligent driving controller. If the intelligent driving controller detects that the key is pressed, the rearview mirror controller can be determined to be faulty.

And under the condition that the electronic rearview mirror is detected to be in fault, the environment image acquired by the electronic outside rearview mirror can be sent to other screens in the vehicle for display.

Therefore, by applying the embodiment of the application, the existing system hardware resources of the transparent A column controller and the display screen and the electronic inner rearview mirror controller and the display screen can be relied on, and under the fault scene of the electronic rearview mirror, the existing system hardware is used as a redundant system, so that a user is effectively assisted to safely control and park, and the reliability and safety of the electronic rearview mirror are improved.

The present embodiment also provides an environmental image display device applied to a vehicle, where the vehicle is equipped with an electronic rearview mirror, as shown in fig. 5, the device may include:

an acquisition module 501, configured to acquire an environmental image acquired by an electronic exterior mirror;

a determining module 502, configured to determine a target screen in the vehicle based on the component in which the electronic rearview mirror fails in the event that the electronic rearview mirror fails;

and the sending module 503 is configured to send the environment image to the target screen for display.

In one possible embodiment, the electronic rear view mirror includes a rear view mirror controller and two rear view mirror display screens mounted on either side of the vehicle. The determining module 502 is configured to determine that the transparent a-pillar display screen on one side is a target screen in case that the rearview mirror display screen on the one side fails. And under the condition that the rearview mirror display screens at two sides are failed and/or the rearview mirror controller is failed, determining the transparent A column display screens at two sides as target screens.

In one possible embodiment, the determining module 502 is configured to determine a target screen within the vehicle based on the failed component of the electronic rear view mirror and the traveling direction of the vehicle.

In a possible embodiment, the determining module 502 is configured to determine that the one side of the electronic inside rear view mirror is the target screen in a case where the rear view mirror display screen of the one side fails and the vehicle travels to the one side. And under the condition that the display screens of the rearview mirrors at the two sides are failed and the vehicle runs to any side, determining the two sides of the electronic inner rearview mirror as target screens. In the event that the mirror controller fails and the vehicle is traveling to either side, it is determined that both sides of the electronic inside rear view mirror are target screens.

In a possible embodiment, the acquiring module 501 is configured to acquire the environmental image acquired by the electronic outside rear view mirror through the target image transmission link corresponding to the component where the electronic rear view mirror fails.

In one possible embodiment, the vehicle further comprises an intelligent drive controller, the electronic rear view mirror being communicatively connected to the intelligent drive controller. The acquiring module 501 is configured to acquire, by using the rearview mirror controller, an environmental image acquired by the electronic exterior rearview mirror in a case that the rearview mirror display screen on any side fails. And under the condition that the rearview mirror controller fails, acquiring an environment image acquired by the electronic exterior rearview mirror through the intelligent driving controller.

In one possible embodiment, the electronic rear view mirror comprises a rear view mirror controller and two rear view mirror display screens, the vehicle further comprises an intelligent driving controller, the apparatus further comprises:

and the fault determining module is used for determining whether the rearview mirror display screen has faults or not through the rearview mirror controller. And/or determining, by the intelligent driving controller, whether the rearview mirror controller is malfunctioning. And/or determining whether the rearview mirror controller fails according to the pressing state of the preset key.

Illustratively, as shown in FIG. 6, the vehicle includes: a memory 601 and a processor 602, wherein the memory 601 stores executable program code 6011 therein, and the processor 602 is configured to call and execute the executable program code 6011 to execute an environment image display method.

In addition, the embodiment of the application also protects a device, which can comprise a memory and a processor, wherein executable program codes are stored in the memory, and the processor is used for calling and executing the executable program codes to execute the environment image display method provided by the embodiment of the application.

In this embodiment, the functional modules of the apparatus may be divided according to the above method example, for example, each functional module may be corresponding to one processing module, or two or more functions may be integrated into one processing module, where the integrated modules may be implemented in a hardware form. It should be noted that, in this embodiment, the division of the modules is schematic, only one logic function is divided, and another division manner may be implemented in actual implementation.

In the case of dividing each functional module by corresponding each function, the apparatus may further include an acquisition module, a determination module, a transmission module, and the like. It should be noted that, all relevant contents of each step related to the above method embodiment may be cited to the functional description of the corresponding functional module, which is not described herein.

It should be understood that the apparatus provided in this embodiment is used to perform the above-described environmental image display method, and thus the same effects as those of the above-described implementation method can be achieved.

In case of an integrated unit, the apparatus may comprise a processing module, a memory module. Wherein, when the device is applied to a vehicle, the processing module can be used for controlling and managing the action of the vehicle. The memory module may be used to support the vehicle in executing mutual program code, etc.

Wherein a processing module may be a processor or controller that may implement or execute the various illustrative logical blocks, modules, and circuits described in connection with the present disclosure. A processor may also be a combination of computing functions, e.g., including one or more microprocessors, digital signal processing (digital signal processing, DSP) and microprocessor combinations, etc., and a memory module may be a memory.

In addition, the device provided by the embodiment of the application can be a chip, a component or a module, wherein the chip can comprise a processor and a memory which are connected; the memory is used for storing instructions, and when the processor calls and executes the instructions, the chip can be caused to execute the environment image display method provided by the embodiment.

The present embodiment also provides a computer-readable storage medium having stored therein computer program code which, when run on a computer, causes the computer to execute the above-described related method steps to implement an environmental image display method provided in the above-described embodiments.

The present embodiment also provides a computer program product, which when run on a computer, causes the computer to perform the above-mentioned related steps to implement an environmental image display method provided by the above-mentioned embodiments.

The apparatus, the computer readable storage medium, the computer program product, or the chip provided in this embodiment are used to execute the corresponding method provided above, and therefore, the advantages achieved by the apparatus, the computer readable storage medium, the computer program product, or the chip can refer to the advantages of the corresponding method provided above, which are not described herein.

It will be appreciated by those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional modules is illustrated, and in practical application, the above-described functional allocation may be performed by different functional modules according to needs, i.e. the internal structure of the apparatus is divided into different functional modules to perform all or part of the functions described above.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of modules or units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another apparatus, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application. Therefore, the protection scope of the application is subject to the protection scope of the claims.

Claims

1. An environmental image display method applied to a vehicle on which an electronic rear view mirror is mounted, the method comprising:

and sending the environment image to the target screen for display.

2. The method of claim 1, wherein the electronic rear view mirror comprises a rear view mirror controller and two rear view mirror displays mounted on either side of the vehicle;

3. The method of claim 1, wherein the determining a target screen within the vehicle based on the failed component of the electronic rear view mirror comprises:

4. A method according to claim 3, wherein the determining a target screen within the vehicle based on the malfunctioning component of the electronic rear view mirror and the direction of travel of the vehicle comprises:

5. The method of claim 2, wherein the acquiring the environmental image acquired by the electronic exterior mirror comprises:

6. The method of claim 5, wherein the vehicle further comprises an intelligent drive controller, the electronic rearview mirror being communicatively coupled to the intelligent drive controller;

7. The method of claim 1, wherein the electronic rear view mirror comprises a rear view mirror controller and two rear view mirror displays, the vehicle further comprising an intelligent drive controller, the determining a target screen within the vehicle based on the failed component further comprising:

8. An environmental image display device applied to a vehicle on which an electronic rear view mirror is mounted, the device comprising:

9. A vehicle, characterized in that the vehicle comprises:

a memory for storing executable program code;

a processor for calling and running the executable program code from the memory, causing the vehicle to perform the method of any one of claims 1 to 7.

10. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when executed, implements the method according to any of claims 1 to 7.