CN115476767A - Display method and device of electronic exterior rearview mirror - Google Patents

Display method and device of electronic exterior rearview mirror Download PDF

Info

Publication number
CN115476767A
CN115476767A CN202211101683.0A CN202211101683A CN115476767A CN 115476767 A CN115476767 A CN 115476767A CN 202211101683 A CN202211101683 A CN 202211101683A CN 115476767 A CN115476767 A CN 115476767A
Authority
CN
China
Prior art keywords
streaming media
controller
environment
vehicle
electronic exterior
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202211101683.0A
Other languages
Chinese (zh)
Inventor
姚劲
奚叶飞
张海波
孔军旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhiji Automobile Technology Co Ltd
Original Assignee
Zhiji Automobile Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhiji Automobile Technology Co Ltd filed Critical Zhiji Automobile Technology Co Ltd
Priority to CN202211101683.0A priority Critical patent/CN115476767A/en
Publication of CN115476767A publication Critical patent/CN115476767A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/25—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the sides of the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/303—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using joined images, e.g. multiple camera images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/304—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/802—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8046—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for replacing a rear-view mirror system

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Mechanical Engineering (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The invention discloses a display method and a display device of an electronic exterior rearview mirror, wherein the method comprises the following steps: the left side rearview camera acquires a first environment video from the left rear of the vehicle, and the right side rearview camera acquires a second environment video from the right rear of the vehicle; the controller receives the first environment video and the second environment video, processes the first environment video and the second environment video as streaming media and processes the first environment video and the second environment video into first streaming media and second streaming media, forms warning information based on the first streaming media in a recognition and perception mode, and is used for transmitting the second streaming media to the electronic exterior rear view mirror controller; and the electronic exterior rear view mirror controller receives the second streaming media, processes the second streaming media into an environment video at the rear of the automobile, and displays the environment video on an electronic exterior rear view mirror display screen, and the electronic exterior rear view mirror display screen displays the warning information after receiving the warning information.

Description

Display method and device of electronic exterior rearview mirror
Technical Field
The invention relates to the field of electronic exterior rearview mirror display, in particular to a display method and device of an electronic exterior rearview mirror.
Background
It should be clear to the driver of car at night always, when meeting the far-reaching headlamp in rear night, the light dazzles and can very be difficult to suffer, seriously influences the security of driving. Of course, the current electronic anti-glare rearview mirror has good effect on far-distance light prevention, but the electronic anti-glare rearview mirror is not a pair of common glass lenses, but an intelligent rearview mirror combined with an electronic technology. In addition, in rainy and snowy weather, the windows of the automobile are easy to fog, driving is seriously affected, and the problem that the blind area of the rearview mirror in the visual field is large is also urgently needed to be solved. Electronic exterior rear view mirrors can solve certain of the above-mentioned drawbacks, but are not fully utilized.
The prior art is therefore still subject to further development.
Disclosure of Invention
In view of the above technical problems, the present invention provides a display method and device for an electronic exterior mirror.
The invention provides a display method of an electronic exterior mirror, which is applied to an intelligent vehicle, wherein the intelligent vehicle comprises a left side rearview camera, a right side rearview camera, an electronic exterior mirror display screen, an electronic exterior mirror controller and a controller, and the display method comprises the following steps:
the left side rearview camera acquires a first environment video from the left rear of the vehicle, and the right side rearview camera acquires a second environment video from the right rear of the vehicle;
the controller receives the first environment video and the second environment video, processes the first environment video and the second environment video as streaming media and processes the first environment video and the second environment video into first streaming media and second streaming media, forms warning information based on the first streaming media in a recognition and perception mode, and is used for transmitting the second streaming media to the electronic exterior rear view mirror controller;
and the electronic exterior rear view mirror controller receives the second streaming media, processes the second streaming media into a video of the environment behind the vehicle, and displays the video on the display screen of the electronic exterior rear view mirror, and the display screen of the electronic exterior rear view mirror displays the warning information after receiving the warning information.
In some embodiments, the controller processes the first and second ambient videos as streaming media and as first and second streaming media, comprising:
the controller marks left and right side parts of the first environment video and the second environment video, transmits the marked first environment video and the marked second environment video as a streaming media file to a decoder, and the decoder divides the streaming media into two parts to form a first streaming media and a second streaming media.
In some embodiments, the electronic exterior mirror controller receives the second streaming media and processes the second streaming media into a video of an environment behind the vehicle for display on the electronic exterior mirror display screen, comprising:
and the electronic exterior rear view mirror controller performs linear correction, noise point removal, dead pixel repair, color interpolation, white balance correction and exposure correction on the second streaming media to form a third streaming media.
In some embodiments, the electronic exterior rear view mirror controller receives the second streaming media and processes the second streaming media into the video of the environment behind the vehicle to be displayed on the electronic exterior rear view mirror display screen, including:
and transmitting the third streaming media to the controller, wherein the third streaming media are cut and rendered by the controller and then transmitted to an electronic exterior rearview mirror display screen for display.
In some embodiments, the transmitting the third streaming media to the controller, the clipping, rendering and transmitting the third streaming media to an electronic exterior mirror display by the controller includes:
and the controller splices the cut and rendered third streaming media to form fourth streaming media, and the electronic exterior rearview mirror displays the fourth streaming media.
In some embodiments, the intelligent vehicle is provided with an electronic exterior rear view mirror, and the electronic exterior rear view mirror displays the second streaming media and marks the area division of the left side and the right side of the vehicle.
In a second aspect of the present invention, there is provided a display device applied to an intelligent vehicle, including: the system comprises a left side rearview camera, a right side rearview camera, an electronic outer rearview mirror display screen, an electronic outer rearview mirror controller and a controller;
the left side rearview camera is used for obtaining a first environment video from the left rear of the vehicle, and the right side rearview camera is used for obtaining a second environment video from the right rear of the vehicle;
the controller includes a decoder for receiving the first and second ambient videos, processing the first and second ambient videos as streaming media and as first and second streaming media;
the controller comprises a processing chip, the processing chip forms warning information based on the first streaming media identification perception, and the second streaming media is used for being transmitted to the electronic exterior rear view mirror controller;
and the electronic exterior rear view mirror controller receives the second streaming media, processes the second streaming media into an environment video at the rear of the automobile, and displays the environment video on an electronic exterior rear view mirror display screen, and the electronic exterior rear view mirror display screen displays the warning information after receiving the warning information.
In some embodiments, the intelligent vehicle is provided with an electronic exterior rear view mirror, and the electronic exterior rear view mirror displays the second streaming media and marks the division of the areas on the left side and the right side of the vehicle.
In a third aspect of the present invention, a display method for an electronic exterior mirror is provided, which is applied to an intelligent vehicle, and the display method includes:
the method comprises the steps of obtaining environment videos from the rear of the left side and the right side of a vehicle, and dividing the environment videos into a first streaming media and a second streaming media;
recognizing the environment behind the vehicle based on the first streaming media and outputting warning information, and splicing the environment videos behind the left side and the right side of the vehicle into third streaming media which can be displayed on an electronic exterior rearview mirror display screen based on the second streaming media;
and the electronic exterior rear view mirror display screen displays the third streaming media, marks the area division of the left side and the right side of the vehicle, and displays the warning information after receiving the warning information.
In a fourth aspect of the present invention, a display device is provided for an intelligent vehicle, where the intelligent vehicle includes a left-side rearview camera, a right-side rearview camera, a controller, and an electronic outside rearview mirror display screen;
the controller acquires environment videos behind the left side and the right side of the automobile, divides the environment videos into a first streaming media and a second streaming media, identifies the environment behind the automobile based on the first streaming media and outputs warning information, and splices the environment videos behind the left side and the right side of the automobile into a third streaming media which can be displayed on an electronic exterior rear-view mirror display screen based on the second streaming media;
and the electronic exterior rear view mirror display screen displays the third streaming media, marks the area division of the left side and the right side of the vehicle, and displays the warning information after receiving the warning information.
In a fifth aspect of the invention, a vehicle is provided, comprising a processor, a memory and a computer program stored on the memory and being executable on the processor, the computer program, when executed by the processor, implementing the method as provided in the first aspect of the invention.
A sixth aspect of the present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a computer, performs the method provided by the first aspect of the present invention.
According to the invention, the video data of the left and right rear-view cameras are acquired and then divided into two paths, one path is used for identifying the environment, and the other path is displayed by a user, so that the purpose of multiplexing the left rear-view camera and the right rear-view camera can be achieved, and the material cost of the whole vehicle is reduced.
Meanwhile, the electronic exterior rearview mirror display screen can be used for displaying the video data together, so that the display mode is changed, and the material cost of the whole vehicle is further reduced.
Drawings
Fig. 1 is a schematic flow chart illustrating a display method of an electronic exterior mirror according to an embodiment of the present invention;
FIG. 2 is a block diagram of a display device according to an embodiment of the present invention;
FIG. 3 is a schematic flow chart illustrating another method for displaying an electronic exterior mirror according to an embodiment of the present invention;
fig. 4 is a block diagram of another display device according to another embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the related art, an intelligent driving vehicle includes a sensor system having a plurality of sensors that detect information about an environment in which the vehicle travels. The vehicle and its associated controller use the detected information to detect outside information or information of the vehicle itself or information of the user inside the vehicle. The smart vehicle may manage any data related to the user's trip or route through the location module. The user may log in and specify the start location and destination of the trip via the user interface. The location module communicates with other components of the intelligent driven vehicle, such as maps and route information, to obtain trip related data. In some embodiments, the location module may obtain real-time traffic information from a traffic information system or server as the vehicle moves along the route.
The automatic intelligent driving function in the intelligent automobile generally utilizes sensors such as a vehicle-mounted camera, an ultrasonic sensor, a temperature and humidity sensor and a radar to acquire data so as to realize that a control system replaces manual driving. The sensors are special, functions such as obstacle recognition and early warning, door opening early warning, blind area detection alarm and the like are customized by taking the vehicle-mounted camera and the radar as examples, the vehicle-mounted camera and the radar are special and cannot realize the multiple purposes of the sensors, and the special functions can cause the waste of equipment and the overstaffed car body accessories along with the increase of the functions of the car.
As shown in fig. 1 in detail, the display method of the electronic exterior mirror provided by the invention is applied to an intelligent vehicle, and the intelligent vehicle comprises a left-side rearview camera, a right-side rearview camera, an electronic exterior mirror display screen, an electronic exterior mirror controller and a controller. The environment videos collected by the left side rearview camera and the right side rearview camera can be used as rearview mirrors for content display, and can also identify information such as vehicles behind the automobile, so that driving warning and reminding are achieved, and driving experience of a user is improved.
The rearview mirror of the traditional vehicle is a glass mirror, and the electronic external rearview mirror adopts a camera and a set of display system to replace the glass mirror. The video collected by the camera can reduce the interference of the high beam after being processed, so that the display image is more easily accepted by a driver.
The display method of the electronic exterior rear view mirror is applied to an intelligent vehicle (such as an automobile), and the intelligent vehicle comprises a left side rear view camera, a right side rear view camera, an electronic exterior rear view mirror display screen, an electronic exterior rear view mirror controller and a controller. The display method comprises the following steps:
step 101: the left-side rearview camera acquires a first environment video from the left rear of the vehicle, and the right-side rearview camera acquires a second environment video from the right rear of the vehicle.
The left side rear view camera and the right side rear view camera are located at the rearview mirror position of the vehicle, the left side rear view camera and the right side rear view camera are controlled by the intelligent driving system, and it should be understood that other positions can be selected according to the arrangement position of the left side camera and the right side camera. After a user opens a vehicle door, the whole vehicle starts to be awakened, and the controller for intelligent driving and the electronic exterior rearview mirror controller start at the moment, so that camera data can be rapidly processed after power is on. The collected first environment video and the second environment video can be processed by the controller, and can also be processed by the electronic exterior rear view mirror controller. And in some embodiments may also be processed by the domain controller of the vehicle. And the electronic exterior rearview mirror controller and the domain controller process the first environment video and the second environment video and forward the processed videos to the intelligent driving controller SOC.
Step 102: the controller receives the first environment video and the second environment video, processes the first environment video and the second environment video as streaming media and processes the streaming media into first streaming media and second streaming media, forms warning information based on the first streaming media identification perception, and transmits the second streaming media to the electronic exterior mirror controller.
In this embodiment, the first environmental video and the second environmental video are received and processed by the controller for smart driving. The controller comprises a decoder which can divide the first environment video and the second environment video into two parts and transfer the two parts to the electronic exterior rearview mirror in a hard forwarding mode.
In an embodiment, the first environmental video and the second environmental video may be separately processed as two separate streams. That is, the first ambient video is split into two and received by the controller and the electronic exterior mirror controller, and the second ambient video is split into two and received by the controller and the electronic exterior mirror controller. The controller receives the first environment video and the second environment video and is used for recognizing whether pedestrians, vehicles, obstacles and the like exist on the left rear side and the right rear side of the sensed self-vehicle or not, and the recognition results are used as warning information to be displayed to a driving user through an interactive interface. The electronic exterior mirror controller receives the first environment video and the second environment video and is mainly used for displaying the first environment video and the second environment video. In some embodiments, a display is provided for displaying, and the first environment video and the second environment video can be further distinguished from each other on the left and right sides, so that a driving user can identify a rear area and make driving judgment and decision. If the left and right sides are respectively provided with a display, the first environment video and the second environment video on the left and right sides can be respectively displayed on the two displays.
In another embodiment, the first environment video and the second environment video can be processed together as a whole streaming media, the first environment video and the second environment video have the same timestamp information, so that the processing and the combination are convenient, the shooting is performed, the rear blind area can be better reduced after the combination of the first environment video and the second environment video, the display of the video behind the vehicle is facilitated, for example, the video is displayed on a display screen, and two displays are not used for simultaneously displaying the first environment video and the second environment video respectively, so that the use of one display screen can be reduced, and the reduction of the material cost of the whole vehicle is facilitated. Of course, the first environment video and the second environment video may be marked by streaming media in the forwarding process, for example, the identifier of the first environment video is marked as "left" and the identifier of the second environment video is marked as "right", so as to better identify the areas on the left and right sides.
In the above implementation process, a video is divided into two parts by a decoder, and for convenience of understanding, the two parts are divided into a first streaming media and a second streaming media, which should be combined with the above two embodiments, where the first streaming media and the second streaming media may both be the first environment video and the second environment video, and the first streaming media and the second streaming media may also both be one streaming media data formed by splicing the first environment video and the second environment video.
Step 103: and the electronic exterior rear view mirror controller receives the second streaming media, processes the second streaming media into a video of the environment behind the vehicle, and displays the video on the display screen of the electronic exterior rear view mirror, and the display screen of the electronic exterior rear view mirror displays the warning information after receiving the warning information.
The electronic exterior rear view mirror comprises an electronic exterior rear view mirror display screen, and the electronic exterior rear view mirror controller receives the second streaming media, processes the second streaming media and then pushes the processed second streaming media to the electronic exterior rear view mirror display screen for display. Of course, the warning information sent by the controller after identifying the object in the first streaming media can also be pushed to the electronic exterior rear view mirror controller and then displayed on the electronic exterior rear view mirror display screen.
In one embodiment, the electronic exterior mirror controller receives the second streaming media and processes the second streaming media to remove data from the second streaming media for clear display of video content. The processing procedure involves performing linear correction, noise point removal, dead pixel repair, color interpolation, white balance correction and exposure correction on the second streaming media, and processing the second streaming media to form a third streaming media.
The linear correction means that too many linear individuals exist in an unbalanced system to transfer negative entropy flow, so that the bearing upper limit of the system in unit time is exceeded, and the correction is carried out through an algorithm. Noise removal is also called noise and noise removal, and mainly refers to a rough portion in an image generated in a process in which a CCD (CMOS) receives and outputs light as a received signal, and also refers to a foreign pixel which should not appear in the image, and is generally generated by electronic interference. The pixel points on the CCD/CMOS image sensor have problems and defects, are presented as black or white on a video monitoring picture and are called dead pixels, and can be generally repaired by adopting a dead pixel repairing algorithm. In the video processing process, the color interpolation algorithm, the white balance correction algorithm, the exposure correction algorithm and the like can be realized by adopting video processing software or a conventional algorithm, and are not repeated. As a processing method, the ISP chip may be used to process the second streaming media. Of course, when the controller for intelligent driving processes the first environment video and the second environment video, the controller may also process the first environment video and the second environment video to implement the video processing. It is to be understood that the controller and the electronic exterior mirror controller need not be a single processor unit but may comprise other functional processor units to jointly carry out one or more associated functions.
Further, the electronic exterior mirror controller transmits the third streaming media to the controller, and the third streaming media is cut and rendered by the controller and then transmitted to the electronic exterior mirror display screen for display. It can be easily understood that the controller for smart driving has an entertainment function, and can cut the third streaming media by means of cutting software, remove unnecessary visual field ranges or repeated visual field ranges, and the like, or adapt to the display range of the display screen of the electronic exterior rearview mirror. The processing of the ISP chip on the second streaming media is combined, so that the displayed video can be effectively ensured to be clear, and the method is particularly effective to the interference of a rear vehicle high beam.
In order to facilitate a user to look up a rear video, the controller splices the cut and rendered third streaming media to form a fourth streaming media, and then the fourth streaming media is displayed by the electronic exterior rearview mirror. The specific image stitching process may be to determine an overlapping area of the first environment video and the second environment video, and then stitch the first environment video and the second environment video according to the overlapping area.
In an embodiment of the invention, the intelligent vehicle is provided with an electronic exterior rear view mirror, and the electronic exterior rear view mirror marks the area division of the left side and the right side of the vehicle when displaying the second streaming media. When the fourth streaming media formed by the processed second streaming media is displayed on the display screen of the electronic exterior rear view mirror, the rear video on the left side of the self-vehicle is marked in a certain area, and the rear video on the right side of the self-vehicle is marked in other areas. For example, indicated by a box and provided with left and right side text.
Of course, as a simpler method, the first environment video and the second environment video may be displayed on a single display in a split-screen manner. The single screen display does not require the user to turn left and right to look at different displays, so that the driving user is more focused on driving.
The present invention further provides another display method, which is different from the above embodiments. In a different embodiment of the present invention, the controller (vehicle system on chip SOC or domain controller) completely processes the first environment video and the second environment video, and then performs linear correction, noise point removal, dead pixel repair, color interpolation, white balance correction, and exposure correction on the first environment video and the second environment video to form a third streaming media, and the third streaming media is cut and rendered by the controller. The controller marks left and right side sections of the processed first environment video and the second environment video, transmits the marked first environment video and the second environment video as a streaming media file to a decoder, and the decoder divides the streaming media into two parts to form a first streaming media and a second streaming media. The electronic exterior mirror controller is only used to receive streaming media and push the display.
Corresponding to the display method, as shown in fig. 2, the present invention further provides a display device applied to an intelligent vehicle, the display device comprising: a left rear view camera 21, a right rear view camera 22, an electronic outside rear view mirror display screen 23, an electronic outside rear view mirror controller 24, and a controller 25. In the display device, the intelligent vehicle is provided with an electronic external rear-view mirror, and the electronic external rear-view mirror marks the left side and the right side of the vehicle to be divided when displaying the second streaming media. Specifically, the method comprises the following steps:
the left rear-view camera 21 is used for obtaining a first environment video from the left rear of the vehicle, and the right rear-view camera 22 is used for obtaining a second environment video from the right rear of the vehicle;
the controller 25 includes a decoder for receiving the first and second ambient videos, processing the first and second ambient videos as streaming media and as first and second streaming media;
the controller 25 comprises a processing chip, the processing chip forms warning information based on the first streaming media identification perception, and the second streaming media is used for transmitting to the electronic exterior mirror controller 24;
the electronic exterior mirror controller 24 receives the second streaming media, processes the second streaming media into a video of an environment behind the vehicle, and displays the video on the electronic exterior mirror display screen 23, and the electronic exterior mirror display screen 23 displays the warning information after receiving the warning information.
The implementation process of the above components of the display device can refer to the content described in the above display method.
As shown in fig. 3, the present invention further provides a method applied to an intelligent vehicle, specifically a display method of an electronic exterior mirror, which is different from the display method shown in fig. 1, in this example, videos collected by left and right cameras are processed as an independent streaming video, and the specific display includes:
step 301: the method comprises the steps of obtaining environment videos from the rear of the left side and the rear of the right side of a vehicle, and dividing the environment videos into a first streaming media and a second streaming media.
For example, the controller respectively acquires the environment videos collected by the left rear-view camera and the right rear-view camera from the rear of the vehicle, and the controller is responsible for processing the environment videos. The method comprises the steps of merging the environment videos into one streaming media, dividing the streaming media into two parts, and dividing the environment videos into two streaming media with two flow directions by adopting a one-to-two decoder. The first flow medium is reserved for the controller and the second flow medium is reserved for the electronic exterior rearview mirror display.
Step 302: and identifying the environment behind the vehicle based on the first streaming media to output warning information, and splicing the environment videos behind the left side and the right side of the vehicle into a third streaming media which can be displayed on an electronic exterior rearview mirror display screen based on the second streaming media.
After receiving the first streaming media, the controller can realize warning information such as door opening warning, blind area detection warning and the like based on recognition by utilizing an image recognition technology. The controller may also stitch the streamed second media stream based on time stamps, overlap areas, etc. to accommodate a display screen, such as an electronic exterior rear view mirror display screen.
Of course, the controller may also perform linear correction, noise point removal, dead pixel repairing, color interpolation, white balance correction, exposure correction, clipping, rendering, and the like on the second streaming media, and the second streaming media is used as the finally output third streaming media.
Step 303: and the electronic exterior rear view mirror display screen displays the third streaming media, marks the area division of the left side and the right side of the vehicle, and displays the warning information after receiving the warning information.
The controller in the display method can be executed by one or more of a controller of an intelligent vehicle (a main controller for intelligent driving), a domain controller and an electronic exterior mirror controller.
Taking the controller and the electronic exterior rear view mirror controller as examples, the controller is responsible for processing the video images sent by the left and right cameras as a streaming media, that is, combining the videos at the rear of the left and right sides into a streaming media video. The main controller is divided into a first streaming media and a second streaming media through a decoder with one-to-two function and hard forwards the first streaming media and the second streaming media to the electronic exterior mirror controller, and the first streaming media are used by environment sensing application software of the main controller; the second streaming media is operated by an ISP chip in the electronic exterior rear-view mirror controller to obtain the results after linear correction, noise point removal, dead pixel repair, color interpolation, white balance correction, exposure correction and the like.
The second streaming media is processed by the ISP chip and then transmitted to the main controller for cutting and rendering, and then output to a display screen of the electronic exterior rearview mirror for display.
The invention also provides a display device applied to an intelligent vehicle, wherein the intelligent vehicle comprises a left rear-view camera 43, a right rear-view camera 44, a controller 41 and an electronic outside rear-view mirror display screen 42. As shown in fig. 4, the display device includes:
the controller 41 acquires the environment videos behind the left side and the right side of the vehicle, divides the environment videos into a first streaming media and a second streaming media, identifies the environment behind the vehicle based on the first streaming media and outputs warning information, and splices the environment videos behind the left side and the right side of the vehicle into a third streaming media which can be displayed on an electronic exterior mirror display screen based on the second streaming media;
the electronic exterior mirror display screen 42 displays the third streaming media, marks the area division of the left side and the right side of the vehicle, and displays the warning information after receiving the warning information.
The invention also provides a vehicle comprising a processor, a memory and a computer program stored on the memory and capable of running on the processor, which computer program, when executed by the processor, carries out the steps of the in-vehicle multimedia zone switching method as described above.
The present invention also provides a computer-readable storage medium on which a computer program is stored, which computer program, when being executed by a processor, realizes the steps of the display method of the electronic exterior mirror as described above.
It is understood that the computer-readable storage medium may include: any entity or device capable of carrying a computer program, recording medium, U-disk, removable hard disk, magnetic disk, optical disk, computer Memory, read-Only Memory (ROM), random Access Memory (RAM), software distribution medium, and the like. The computer program includes computer program code. The computer program code may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable storage medium may include: any entity or device capable of carrying computer program code, recording medium, U.S. disk, removable hard disk, magnetic diskette, optical disk, computer Memory, read-Only Memory (ROM), random Access Memory (RAM), and software distribution medium.
In some embodiments of the present invention, the apparatus may include a controller, and the controller is a single chip integrated with a processor, a memory, a communication module, and the like. The processor may refer to a processor included in the controller. The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable gate array (FPGA) or other Programmable logic device, discrete gate or transistor logic device, discrete hardware component, etc.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described in a functional general in the foregoing description for the purpose of illustrating clearly the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The above examples are only intended to illustrate the technical solution of the present invention, and not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (11)

1. The utility model provides a display method of electron outside rear-view mirror, is applied to intelligent vehicle, intelligent vehicle includes left side rear-view camera, right side rear-view camera, electron outside rear-view mirror display screen, electron outside rear-view mirror controller and controller, its characterized in that includes:
the left side rearview camera acquires a first environment video from the left rear of the vehicle, and the right side rearview camera acquires a second environment video from the right rear of the vehicle;
the controller receives the first environment video and the second environment video, processes the first environment video and the second environment video as streaming media and processes the first environment video and the second environment video into first streaming media and second streaming media, forms warning information based on the first streaming media identification perception, and transmits the second streaming media to the electronic exterior rear view mirror controller;
the electronic exterior rear view mirror controller receives the second streaming media, processes the second streaming media into an environment video behind the automobile and displays the environment video on an electronic exterior rear view mirror display screen, and the electronic exterior rear view mirror display screen displays the warning information after receiving the warning information;
wherein the controller processes the first environment video and the second environment video as streaming media and as first streaming media and second streaming media, comprising:
the controller marks the left and right sides of the first environment video and the second environment video, transmits the marked first environment video and the second environment video as a streaming media file to a decoder, and the decoder divides the streaming media into two parts to form a first streaming media and a second streaming media.
2. The method as claimed in claim 1, wherein the electronic exterior mirror controller receives the second streaming media and processes the second streaming media into a video of an environment behind the vehicle for displaying on the electronic exterior mirror display screen, comprising:
and the electronic exterior rear view mirror controller performs linear correction, noise point removal, dead pixel repair, color interpolation, white balance correction and exposure correction on the second streaming media to form a third streaming media.
3. The method as claimed in claim 2, wherein the electronic exterior mirror controller receives the second streaming media and processes the second streaming media into a video of an environment behind the vehicle for displaying on the electronic exterior mirror display screen, comprising:
and transmitting the third streaming media to the controller, wherein the third streaming media is cut and rendered by the controller and then transmitted to an electronic exterior rear view mirror display screen for display.
4. The method for displaying an electronic exterior mirror according to claim 3, wherein the transmitting the third streaming media to the controller, and the transmitting the third streaming media to the electronic exterior mirror for displaying after being cut and rendered by the controller, comprises:
and the controller splices the cut and rendered third streaming media to form fourth streaming media, and the electronic exterior rearview mirror displays the fourth streaming media.
5. The method as claimed in claim 4, wherein the smart vehicle is provided with an electronic exterior mirror, and the electronic exterior mirror displays the second streaming media by dividing the area of the left side of the vehicle into the area of the right side of the vehicle.
6. A display device is applied to an intelligent vehicle and is characterized by comprising: the system comprises a left side rearview camera, a right side rearview camera, an electronic outer rearview mirror display screen, an electronic outer rearview mirror controller and a controller;
the left side rearview camera is used for acquiring a first environment video from the left rear of the vehicle, and the right side rearview camera is used for acquiring a second environment video from the right rear of the vehicle;
the controller includes a decoder for receiving the first and second ambient videos, processing the first and second ambient videos as streaming media and as first and second streaming media;
the controller comprises a processing chip, the processing chip forms warning information based on the first streaming media identification perception, and the second streaming media is used for being transmitted to the electronic exterior rear view mirror controller;
and the electronic exterior rear view mirror controller receives the second streaming media, processes the second streaming media into an environment video at the rear of the automobile, and displays the environment video on an electronic exterior rear view mirror display screen, and the electronic exterior rear view mirror display screen displays the warning information after receiving the warning information.
7. The display device according to claim 6, wherein the smart vehicle is provided with an electronic exterior rear view mirror, and the electronic exterior rear view mirror displays the second streaming media by indicating the division of the area between the left side and the right side of the smart vehicle.
8. A display method of an electronic exterior mirror is applied to an intelligent vehicle, and is characterized by comprising the following steps:
acquiring environment videos from the rear of the left side and the right side of the vehicle, and shunting the environment videos into a first streaming media and a second streaming media;
recognizing the environment behind the vehicle based on the first streaming media and outputting warning information, and splicing the environment videos behind the left side and the right side of the vehicle into third streaming media which can be displayed on an electronic exterior rearview mirror display screen based on the second streaming media;
and the electronic exterior rear view mirror display screen displays the third streaming media, marks the area division of the left side and the right side of the vehicle, and displays the warning information after receiving the warning information.
9. A display device is applied to an intelligent vehicle, the intelligent vehicle comprises a left side rearview camera, a right side rearview camera, a controller and an electronic outside rearview mirror display screen, and is characterized in that,
the controller acquires environment videos behind the left side and the right side of the automobile, divides the environment videos into a first streaming media and a second streaming media, identifies the environment behind the automobile based on the first streaming media and outputs warning information, and splices the environment videos behind the left side and the right side of the automobile into a third streaming media which can be displayed on an electronic exterior rear-view mirror display screen based on the second streaming media;
and the electronic exterior rear view mirror display screen displays the third streaming media, marks the area division of the left side and the right side of the vehicle, and displays the warning information after receiving the warning information.
10. A vehicle comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program when executed by the processor implementing the method of any one of claims 1 to 5 or claim 8.
11. A computer-readable storage medium, having stored thereon a computer program which, when executed by a computer, performs the method of any one of claims 1 to 5 or claim 8.
CN202211101683.0A 2022-09-09 2022-09-09 Display method and device of electronic exterior rearview mirror Withdrawn CN115476767A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211101683.0A CN115476767A (en) 2022-09-09 2022-09-09 Display method and device of electronic exterior rearview mirror

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211101683.0A CN115476767A (en) 2022-09-09 2022-09-09 Display method and device of electronic exterior rearview mirror

Publications (1)

Publication Number Publication Date
CN115476767A true CN115476767A (en) 2022-12-16

Family

ID=84392672

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211101683.0A Withdrawn CN115476767A (en) 2022-09-09 2022-09-09 Display method and device of electronic exterior rearview mirror

Country Status (1)

Country Link
CN (1) CN115476767A (en)

Similar Documents

Publication Publication Date Title
CN108460734B (en) System and method for image presentation by vehicle driver assistance module
US11917281B2 (en) Camera system, method and instructions using images captured by a first mage sensor and a second image sensor to generate a third image corresponding to a simulated lens having an intermediate focal length
CN101088027B (en) Stereo camera for a motor vehicle
KR100936558B1 (en) Perimeter monitoring apparatus and image display method for vehicle
JP4491453B2 (en) Method and apparatus for visualizing the periphery of a vehicle by fusing infrared and visual images depending on the periphery
CN108860045B (en) Driving support method, driving support device, and storage medium
US20180015879A1 (en) Side-view mirror camera system for vehicle
JP2008530667A (en) Method and apparatus for visualizing the periphery of a vehicle by fusing infrared and visible images
US9815408B2 (en) Method for operating a rearview camera system of a motor vehicle after detection of a headlight flasher, rearview camera system and motor vehicle
JP2008193339A (en) Rear monitoring system
US20230174091A1 (en) Motor-vehicle driving assistance in low meteorological visibility conditions, in particular with fog
JP2008285105A (en) Information display device
WO2017169614A1 (en) Image processing device
JP2019001325A (en) On-vehicle imaging device
CN115476767A (en) Display method and device of electronic exterior rearview mirror
WO2019177036A1 (en) Vehicle imaging system
JP2004302903A (en) Vehicle display device
JP4795813B2 (en) Vehicle perimeter monitoring device
CN211628409U (en) Large scene recognition camera based on fisheye lens
JP2006024120A (en) Image processing system for vehicles and image processor
JP2004172828A (en) Night vision device for vehicle
JPH0891122A (en) Visibility assisting device for vehicle
US11778316B2 (en) Imaging apparatus
CN118560516A (en) HUD self-adaptive display method, HUD self-adaptive display system, HUD self-adaptive display equipment and vehicle
JP2024088276A (en) Display controller and image display device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20221216