CN115061648A - Operation method of vehicle-mounted display system and vehicle-mounted display system - Google Patents
Operation method of vehicle-mounted display system and vehicle-mounted display system Download PDFInfo
- Publication number
- CN115061648A CN115061648A CN202210524600.2A CN202210524600A CN115061648A CN 115061648 A CN115061648 A CN 115061648A CN 202210524600 A CN202210524600 A CN 202210524600A CN 115061648 A CN115061648 A CN 115061648A
- Authority
- CN
- China
- Prior art keywords
- display
- camera
- video frame
- hardware
- driver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0656—Data buffering arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
Abstract
The application discloses an operation method of a vehicle-mounted display system and the vehicle-mounted display system. The operation method of the vehicle-mounted display system comprises the following steps: a camera hardware interface of the vehicle-mounted display system receives video frames from a camera; the camera hardware interface writes the video frame into the hardware buffer, and only sends the first message to the display hardware unit through the driving layer, so that the sending path of the first message is shortened to inform the display hardware unit to read/receive the video frame, wherein the driving layer comprises a camera driver and a display driver. By the method, the video display of the driving video auxiliary function such as reversing can be realized with low time delay, and the real-time performance of the vehicle-mounted display system is improved. Thereby improving the driving safety and the competitiveness of the product.
Description
Technical Field
The present disclosure relates to the field of vehicle-mounted systems, and more particularly, to an operating method of a vehicle-mounted display system and a vehicle-mounted display system.
Background
Modern vehicle-mounted display systems have become standard in people's lives. With the development of the automobile industry and the popularization of vehicle-mounted display systems in recent years, the reversing image or parking auxiliary system is widely applied to the reversing or driving safety auxiliary field of various large, medium and small vehicles. The image of backing a car lets the user can see the situation behind the car more directly perceivedly when backing a car, avoids not knowing the various unexpected circumstances that take place under the situation behind the car.
The video display time delay (the time from the time when the video data enters the system to the time when the data is displayed on the vehicle-mounted display screen) of the functions of reversing images (RVC), panoramic reversing (AVM) and the like of the vehicle-mounted system is of great importance to the driving safety. Therefore, shortening the transmission time delay of the reverse image to assist the vehicle-mounted display system is a problem to be solved.
Disclosure of Invention
The application provides an operation method of a vehicle-mounted display system and the vehicle-mounted display system, which can realize the video display of the driving video auxiliary function such as backing and the like with low time delay display, and improve the real-time performance of the display of the vehicle-mounted display system. Thereby improving the driving safety and the competitiveness of the product.
In order to solve the technical problem, the application provides an operation method of a vehicle-mounted display system, wherein a camera hardware interface of the vehicle-mounted display system receives a video frame from a camera; the camera hardware interface writes the video frame into a hardware cache, and sends a first message to a display hardware unit only through a driving layer to shorten a sending path of the first message to inform the display hardware unit to read/receive the video frame, wherein the driving layer comprises a camera driver and a display driver.
In order to solve the technical problem, the application provides an operation method of a vehicle-mounted display system, wherein a camera hardware interface receives a video frame from a camera; the camera hardware interface sends the video frame to a middle layer through a camera driver; the middle layer processes the video frame and sends a first message to a display hardware unit through a display driver so as to shorten a sending path of the first message and inform the display hardware unit to read/receive the processed video frame; the display hardware unit reads/receives the processed video frame and sends the processed video frame to a display for displaying; wherein, when the display hardware unit reads/receives the processed video frame of the first frame, the time point of the first message being sent is configured to enable the display hardware unit to completely read/receive the processed video frame of the first frame.
In order to solve the above technical problem, the present application provides an on-vehicle display system, including: a camera, a chip and a display, the chip being adapted to perform the method of any of the embodiments, wherein the camera is connected to the chip and the chip is connected to the display.
In order to solve the above technical problem, the present application provides a chip of a vehicle-mounted display system, where the chip of the vehicle-mounted display system includes: a camera hardware interface, an intermediate layer, a driver layer, a display hardware unit, and a hardware cache, where the chip is configured to perform the method described in any embodiment, where the driver layer includes: camera driving, display driving; the camera hardware interface is connected with a camera, the camera driver and the hardware cache, the middle layer is connected with the camera driver and the display driver, the camera driver is connected with the camera hardware interface, the display driver and the middle layer, the display driver is connected with the camera driver, the middle layer and the display hardware unit, and the display hardware unit is connected with the hardware cache, the hardware driver and a display; the camera hardware interface receives video frames from a camera; the camera hardware interface writes the video frame into the hardware cache, and sends a first message to the display hardware unit only through the driver layer, so as to shorten a sending path of the first message informing the display hardware unit to read/receive the video frame, or the camera hardware interface receives the video frame from a camera; the camera hardware interface sends the video frame to the middle layer through the camera driver; the middle layer processes the video frame and sends a first message to the display hardware unit through the display driver so as to shorten a sending path of the first message to inform the display hardware unit to read/receive the processed video frame; the display hardware unit reads/receives the processed video frame and sends the processed video frame to a display for displaying; wherein, when the display hardware unit reads/receives the processed video frame of the first frame, the time point of the first message being sent is configured to enable the display hardware unit to completely read/receive the processed video frame of the first frame.
Compared with the prior art, the beneficial effects of this application are: an operation method of a vehicle-mounted display system and a vehicle-mounted display system are disclosed. By enabling the camera hardware interface to inform the display hardware unit in advance or shortening the informing path between the camera hardware interface and the display hardware unit, the time for the camera hardware interface to inform the display hardware unit of preparing for reading the video data is saved, so that the video display of the driving video auxiliary function such as backing and the like can be displayed with low time delay, and the real-time performance of the display of the vehicle-mounted display system is improved. Thereby improving the driving safety and the competitiveness of the product.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a first flowchart illustrating a method for operating a vehicle display system according to the present application.
FIG. 2 is a first timing diagram of a display driver sending a first message to a display hardware unit according to the present application.
FIG. 3 is a second timing diagram of the present application showing the driver sending a first message to the display hardware unit.
FIG. 4 is a second flowchart of a method of operating the in-vehicle display system of the present application.
FIG. 5 is a third flowchart illustrating a method of operating the in-vehicle display system of the present application.
FIG. 6 is a fourth flowchart illustrating a method of operating the in-vehicle display system of the present application.
Fig. 7 is a timing diagram of the middle layer sending a first message to a display hardware unit according to the present application.
FIG. 8 is a schematic structural diagram of an embodiment of the in-vehicle display system of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
The terms "first", "second", etc. in this application are used to distinguish between different objects and not to describe a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein may be combined with other embodiments.
At present, many vehicle models of various large brands are equipped with vehicle-mounted RVC (reverse video) and AVM (panoramic reverse) systems when leaving a factory, and vehicle owners can also install vehicle recorders or vehicle-mounted electronic control systems with RVC (reverse video) and AVM (panoramic reverse) functions according to the requirements of the vehicle owners, so that the video display time delay (Latency: the time from the video data frame entering the system to the frame displayed on a screen) of the RVC (reverse video) and AVM (panoramic reverse) functions of the vehicle-mounted systems is crucial to the driving safety, the time delay of the existing RVC & AVM systems developed based on Android & Linux systems exceeds 100ms or even longer, and the driving safety is greatly influenced in practice.
Through observation, thinking and testing, the inventor of the application provides a method capable of shortening the time delay of functional video display such as RVC, AVM and the like, and the method obviously shortens the time delay of video display by shortening the transmission path of video data and control/notification messages and adopting a method of simultaneously carrying out advanced notification, writing and reading. The embodiment that this application provided can ensure that the time delay is within 80ms, has improved the real-time of on-vehicle system video display, and then has increased the factor of safety in RVC & AVM system use, has not only increased a guarantee for vehicle user's safety, has still increased the competitiveness of product for the brand.
FIG. 1 is a first flowchart illustrating a method for operating a vehicle display system according to the present application. It should be noted that, if the result is substantially the same, the flow sequence shown in fig. 1 is not limited in this embodiment. As shown in fig. 1, the present embodiment includes:
s11: a camera hardware interface of the in-vehicle display system receives video frames from the camera.
The camera is a video camera or an image sensor or the like capable of at least continuously obtaining video frames, the video frames may be RGB, HSV, SILTP or the like, and the video frames are subjected to image digitization and converted into YUV format, which is not limited herein.
The Camera hardware Interface (Camera Interface) is a Camera hardware Interface manufactured according to a Mobile Industry Processor Interface (MIPI CSI) Camera Interface
S12: the camera hardware interface writes the video frames into a hardware cache.
The hardware cache is a shared memory between the camera hardware interface and the display hardware unit.
S13: the camera hardware interface sends a first message to the camera driver.
The first message is sent to the camera driver before the camera hardware interface finishes writing the video frame into the hardware cache, for example, 16ms before the video frame is written into the hardware cache, the camera hardware interface sends the first message to the camera driver.
The time point of this completion may be determined according to specific situations, but it is required to ensure that when the display hardware unit reads/receives the video frames, the time point at which the first message is sent is configured to enable the display hardware unit to continuously read/receive the video frames, and the camera hardware interface sends the first message to the display hardware unit, so that the display hardware unit is ready to read the video frames written by the camera hardware interface in the hardware cache.
The first message is used for informing the display hardware unit of being ready to read the video frame written by the camera hardware interface in the hardware cache and the storage address of the video frame written by the camera hardware interface in the hardware cache, and finally the display hardware unit reads the video frame according to the first message.
In this embodiment, in order for the camera hardware interface to send the first message to the display hardware unit, the camera hardware interface first sends the first message to the camera driver.
S14: the camera driver sends a first message to the display driver.
The camera driver sends a first message to the display driver, wherein the camera driver belongs to the driver layer.
S15: the display driver sends a first message to the display hardware unit.
The display driver informs the display hardware unit of the memory address of the video frame that needs to be read and prepares the display hardware unit to read the video frame, wherein the display driver belongs to the driver layer.
S16: the display hardware unit is ready to read the video frame.
The display hardware unit enters a state of preparing to read the video frame according to the storage address of the video frame in the first message.
S17: the display hardware unit reads the video frame from the hardware buffer.
The display hardware unit reads the video frame according to the storage address of the video frame in the first message.
S18: the display hardware unit sends the video frames to the display.
The display hardware unit sends the read video frames to the display.
S19: the display displays video frames.
The display receives and displays the video frames.
FIG. 2 is a first timing diagram of a display driver sending a first message to a display hardware unit according to the present application. As shown in fig. 2, the present embodiment is as follows:
s21: the camera hardware interface begins writing video frames to the hardware cache.
After the camera hardware interface receives a video frame from the camera, the camera hardware interface writes the video frame to the hardware cache.
S22: the camera hardware interface sends the first message to the display hardware unit.
In this embodiment, after a preset time period after the camera hardware interface starts writing the video frame into the hardware cache, the camera hardware interface sends a first message to the display hardware unit through the display driver.
Wherein, the length of this preset time quantum can satisfy: when the display hardware unit receives the first message to start reading, the camera hardware interface has finished writing the video frame into the hardware cache.
For example, 15ms before the camera hardware interface finishes writing the video frame into the hardware cache, the camera hardware interface sends a first message to the display hardware unit, and after a period of time, the display hardware unit receives the first message and starts reading the video frame, and at this time, the camera hardware interface finishes the process of writing the video frame into the hardware cache.
S23: the camera hardware interface finishes writing the video to the hardware cache.
The camera hardware interface writes a frame of video frames completely into the hardware cache so that the video frame can be read directly by the display hardware unit.
S24: the display hardware unit receives the first message.
In this embodiment, after the camera hardware interface finishes writing the video frame into the hardware cache, the display hardware unit receives the first message, and at this time, the camera hardware interface finishes writing the video frame into the hardware cache.
S25: the display hardware unit starts reading the video from the hardware cache.
The display hardware unit reads the video frame written by the camera hardware interface from the same address.
FIG. 3 is a second timing diagram of the present application showing the driver sending a first message to the display hardware unit. As shown in fig. 3, the present embodiment is as follows:
s31: the camera hardware interface begins writing video frames to the hardware cache.
After the camera hardware interface receives a video frame from the camera, the camera hardware interface writes the video frame to a hardware cache.
S32: the camera hardware interface sends the first message to the display hardware unit.
In this embodiment, after a preset time period after the camera hardware interface starts writing the video frame into the hardware cache, the camera hardware interface sends a first message to the display hardware unit through the display driver.
Wherein, the length of this preset time quantum can satisfy: the data volume of the video frames written in the hardware cache by the machine hardware interface in the preset time period is enough to display that the hardware unit starts to continuously read the video frames.
For example, 15ms before the camera hardware interface finishes writing the video frame into the hardware cache, the camera hardware interface sends a first message to the display hardware unit, the display hardware unit starts reading the video frame after receiving the first message after a period of time, and the process of reading the video frame continues until the display hardware unit completely reads the video frame written by the camera hardware interface.
S33: the display hardware unit receives the first message.
In this embodiment, the display hardware unit receives the first message before the camera hardware interface finishes writing the video frame into the hardware cache, for example, the first message is received 4ms before the camera hardware interface finishes writing the video frame into the hardware cache.
S34: the display hardware unit starts reading the video from the hardware cache.
The display hardware unit reads the video frame written by the camera hardware interface from the same address.
Meanwhile, the camera hardware interface does not completely write the frame of video frame into the hardware cache, which may cause the situation of writing while reading, but because the camera hardware interface has already written most of the video frame into the hardware cache and the reading speed is lower than the writing speed, the data interruption in the process of reading the video frame may not be caused.
FIG. 4 is a second flowchart of a method of operating the in-vehicle display system of the present application. As shown in fig. 4, the present embodiment is as follows:
s41: a camera hardware interface of the in-vehicle display system receives video frames from the camera.
Specifically, the description of step S11 is referred to, and will not be repeated herein.
S42: the camera hardware interface transmits the video frames to the hardware cache.
The hardware cache is a shared memory between the camera hardware interface and the display hardware unit.
Before the camera hardware interface finishes writing the video frame into the hardware cache, for example, 16ms before the video frame is written into the hardware cache, the time point of the completion may be determined according to specific situations, and is not limited herein; the camera hardware interface sends a first message to the display hardware unit to prepare the display hardware unit to read the video frame written by the camera hardware interface in the hardware cache.
S43: the middle layer sends a second message to the display driver.
The middle layer sends a second message to the display driver.
Wherein the second message is for notifying the display hardware unit to receive the preprocessed first trace line.
S44: the display driver receives the second message and sends it to the display hardware unit.
The display driver receives the second message from the middle layer and sends it to the display hardware unit, informing the display hardware unit to prepare to receive the preprocessed first trace.
S45: the intermediate layer sends the pre-processed first trace line to the display driver.
In this embodiment, the middle layer sends the first trace line to the display driver before the end of the camera hardware interface writing the video frame to the hardware cache.
S46: the display driver sends the preprocessed first trace line to the display hardware unit.
Wherein S43 is not synchronized with S45, and S44 is synchronized with S46, and the display hardware unit receives the preprocessed first trace line from the display driver in S46 in response to the second message in S44.
In this embodiment, the display driver sends the first trace line to the display hardware unit before the camera hardware interface finishes writing the video frame to the hardware cache.
In this embodiment, the display hardware unit receives the first trace line before the camera hardware interface finishes writing the video frame to the hardware cache.
S47: the display hardware unit reads the video frame.
In response to the first message, the display hardware unit reads the video frame from the hardware cache. The detailed process can refer to fig. 2 and 3, and is not described herein again.
S48: the display hardware unit merges the preprocessed first trajectory line with the video frame into a first merged frame.
The first trajectory line is displayed at a fixed position of the video frame, and may be, for example, an auxiliary line displayed in the reversing radar, which is not limited herein.
In this embodiment, the first trajectory line and the video frame are merged in the display hardware unit to form a first merged frame, wherein the merging may be performed by the display hardware unit hardware combining the first trajectory line and the video frame, or other manners, which is not limited herein. For example, a first merged frame C ═ α × a + (1- α) × B is obtained by hardware, where C is the first merged frame, a is the video frame, B is the first trace line, and α is a constant.
S49: the display hardware unit sends the first merged frame to the display.
The display hardware unit sends the first merged frame to the display.
S410: the display displays the first merged frame.
The display receives and displays the first merged frame.
FIG. 5 is a third flowchart illustrating a method of operating the in-vehicle display system of the present application. As shown in fig. 5, the present embodiment is as follows:
s51: a camera hardware interface of the in-vehicle display system receives video frames from the camera.
Referring to step S11 specifically, details are not repeated here.
S52: the camera hardware interface merges the video frame and the second trajectory line into a second merged frame.
The second trajectory line is displayed at a fixed position of the video frame, and may be an auxiliary line displayed in the reversing radar, for example, without limitation.
In this embodiment, the camera hardware interface adds a merge function, which may merge the second trajectory line and the video frame in a hardware manner, or in another manner, which is not limited herein.
S53: the camera hardware interface writes the second merged frame into a hardware cache.
The hardware cache is a shared memory between the camera hardware interface and the display hardware unit.
S54: the camera hardware interface sends the first message to the camera driver.
The first message is used for informing the display hardware unit to be ready to read the video frame written by the camera hardware interface in the hardware cache and the storage address of the video frame written by the camera hardware interface in the hardware cache, and is used for informing the display driver to inform the display hardware unit to read the video frame.
S55: the camera driver sends a first message to the display driver.
The camera driver sends a first message to the display driver.
S56: the display driver sends the first message to the display hardware unit.
The display driver sends a first message to the display hardware unit.
S57: the display hardware unit is ready to read the second merged frame.
The display driver informs the display hardware unit of the memory address of the second merged frame that needs to be read and prepares the display hardware unit to read the second merged frame.
S58: the display hardware unit reads the second merged frame from the hardware cache.
Wherein the second merged frame is a merged frame of the video frame and the second trajectory line.
S59: the display hardware unit sends the second merged frame to the display.
The display hardware unit sends the second merged frame to the display.
S510: the display displays the second merged frame.
The display receives and displays the second merged frame.
FIG. 6 is a fourth flowchart illustrating a method of operating the in-vehicle display system of the present application. As shown in fig. 6, the first message of this embodiment is different from the first messages of the other embodiments above, and the present embodiment is as follows:
s61: a camera hardware interface of the in-vehicle display system receives video frames from the camera.
Specifically, the description of step S11 is referred to, and will not be repeated herein.
S62: the camera hardware interface sends the video frames to the camera driver.
The camera hardware interface sends video frames to the camera driver.
S63: the camera driver sends the video frames to the middle layer.
The camera driver sends the video frame to the middle layer.
S64: the middle layer processes the video frames.
Specific reference is made to the description of S81, which is not repeated here.
S65: the middle layer sends the first message to the display driver
Wherein the first message is used to notify the display hardware unit to prepare to accept the processed video frame.
The middle layer sends a first message to the display driver.
S66: the display driver sends the first message to the display hardware unit.
The display driver sends a first message to the display hardware unit.
In this embodiment, the intermediate layer sends a first message to the display hardware unit before the intermediate layer finishes processing the video frame.
In this embodiment, the display hardware unit receives the first message when the middle layer finishes processing the video frame.
S67: the display hardware unit is ready to read the processed video frame.
In this embodiment, the display hardware unit receives the first message and is ready to receive the processed video frame before the middle layer finishes processing the video frame.
S68: the display hardware unit receives the processed video frames.
S69: and the display hardware unit sends the processed video frame to a display.
The display hardware unit sends the processed video frames to the display.
S610: the display displays the processed video frame.
The display receives and displays the processed video frames.
FIG. 7 is a timing diagram of a middle layer sending a first message to a display hardware unit according to the present application. As shown in fig. 7, the present embodiment is as follows:
s71: the middle layer begins processing the video frame.
For the specific steps, reference is made to the description of S81, which is not repeated herein.
S72: the middle layer sends the first message to the display hardware unit.
In this embodiment, the middle layer sends a first message to the display hardware unit before the middle layer finishes processing the video frame. For example, the middle layer sends the first message to the display hardware unit 14ms before the middle layer finishes processing the video frame (the advanced time point is set according to specific situations and is not limited herein). After the display hardware unit receives the first message, the display hardware unit prepares to read the video frame.
In this embodiment, the display hardware unit receives the first message and is ready to read the processed video frame at the time the intermediate layer finishes processing the video frame.
S73: the display hardware unit receives the first message.
S74: the display hardware unit is ready to receive the processed video frame.
S75: the middle layer finishes processing the video frame.
S76: and the middle layer sends the processed video frame to a display hardware unit.
The middle layer sends the processed video frames to the display hardware unit.
In another embodiment, S81: the intermediate layer processes the video frame into a panorama.
In this embodiment, the intermediate layer seamlessly splices the obtained multiple frames of video frames at the same time to obtain a single panoramic image (a bird's-eye view or other image information, such as image information around the vehicle, which is not limited herein). The multiple frames of video frames at the same time can be obtained by multiple cameras or image sensors, for example, obtaining image information of the surroundings of the vehicle from different directions.
The above description is only for the purpose of illustrating embodiments of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application or are directly or indirectly applied to other related technical fields, are also included in the scope of the present application.
FIG. 8 is a schematic structural diagram of an embodiment of the in-vehicle display system of the present application. As shown in fig. 8, the present embodiment is as follows: the embodiment is a chip of a vehicle-mounted display system and a camera and a display connected with the chip.
The chip of the vehicle-mounted display system comprises a camera hardware interface, a middle layer, a driving layer, a display hardware unit and a hardware cache, wherein the driving layer comprises a camera driver and a display driver. The chip of the vehicle-mounted display system is used for executing the operation method of the vehicle-mounted display system in any one of the above embodiments. The camera hardware interface is connected with the camera, the camera driver and the hardware cache, the middle layer is connected with the camera driver, the display driver and the display hardware unit, the camera driver is connected with the camera hardware interface, the display driver and the middle layer, the display driver is connected with the camera driver, the middle layer and the display hardware unit, and the display hardware unit is connected with the hardware cache, the hardware driver and the display.
A camera hardware interface receives video frames from a camera; the camera hardware interface writes the video frame into a hardware cache, and sends a first message to the display hardware unit only through the driving layer so as to shorten a sending path of the first message informing the display hardware unit to read/receive the video frame; or, the camera hardware interface receives a video frame from the camera; the camera hardware interface sends the video frame to the middle layer through a camera driver; the middle layer processes the video frame and sends a first message to the display hardware unit through the display driver so as to shorten the sending path of the first message and inform the display hardware unit to read/receive the processed video frame; the display hardware unit reads/receives the processed video frame and sends the processed video frame to the display for displaying; wherein, when the display hardware unit reads/receives the first frame processed video frame, the time point at which the first message is transmitted is configured to enable the display hardware unit to completely read/receive the first frame processed video frame.
The chip may be a CPU (Central Processing Unit). The chip may be an integrated circuit chip having signal processing capabilities. The chip may also be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware component. The general purpose processor may be a microprocessor or the chip may be any conventional processor or the like.
The hardware cache may be a RAM, a ROM, or other types of storage devices. In particular, the memory may include one or more computer-readable storage media, which may be non-transitory. The memory may also include high speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in a memory is used to store at least one program code.
Claims (10)
1. A method of operating an in-vehicle display system, comprising:
a camera hardware interface of the vehicle-mounted display system receives video frames from a camera;
the camera hardware interface writes the video frame into a hardware cache, and sends a first message to a display hardware unit only through a driving layer, so as to shorten a sending path of the first message to inform the display hardware unit of reading/receiving the video frame, wherein the driving layer comprises a camera driver and a display driver.
2. The method of claim 1, wherein the camera hardware interface writes the video frame into a hardware cache and sends a first message to a display hardware unit only through a driver layer to shorten a sending path of the first message to inform the display hardware unit to read/receive the video frame, comprising:
the camera hardware interface writes a collected first frame of video frame into a hardware cache, and sends a first message to a display hardware unit only through a driving layer before writing is finished so as to inform the display hardware unit to read/receive the first frame of video frame;
wherein, when the display hardware unit reads/receives the video frame, the time point when the first message is sent is configured to enable the display hardware unit to completely read/receive the first frame video frame.
3. The method of claim 2, wherein the camera hardware interface writes the video frame into a hardware cache and sends a first message to a display hardware unit only through a driver layer before writing is completed to inform the display hardware unit to read/receive the video frame, comprising:
the camera hardware interface writes the video frame into the hardware cache and waits to send a first message to the camera driver;
the camera driver sends the first message to a display driver;
the display driver sending the first message to the display hardware unit to cause the display hardware unit to read the video frame;
the display hardware unit reads the video frame and sends the video frame to a display for display.
4. The method of any of claims 1-2, wherein the camera hardware interface writes the video frame to a hardware cache and sends a first message to a display hardware unit only through a driver layer to notify the display hardware unit to read/receive the video frame before writing is complete, further comprising:
the middle layer sends a second message and the preprocessed first track line to the display hardware unit through a display driver;
and the display hardware unit reads the video frame according to the first message, receives the first track line according to the second message, combines the first track line and the video frame into a first combined frame, and sends the first combined frame to a display for displaying.
5. The method of any of claims 1-3, wherein the camera hardware interface writes the video frame into a hardware cache and sends a first message to a display hardware unit only through a driver layer before writing is complete to inform the display hardware unit to read/receive the video frame, comprising:
the camera hardware interface merges the video frame and a second trajectory line into a second merged frame, sends the second merged frame to the hardware cache, and sends a first message to a camera driver;
the camera driver sends the first message to a display driver;
the display driver sending the first message to the display hardware unit to prepare the display hardware unit to read the second merged frame;
and the hardware display unit reads the second combined frame and sends the second combined frame to the display for displaying.
6. A method of operating an in-vehicle display system, comprising:
a camera hardware interface receives video frames from a camera;
the camera hardware interface sends the video frame to a middle layer through a camera driver;
the intermediate layer processes the video frame and sends the processed video frame and a first message to a display hardware unit through a display driver so as to shorten a sending path of the first message and inform the display hardware unit to read/receive the processed video frame.
7. The method of claim 6, wherein the intermediate layer processes the video frame and sends the processed video frame and a first message to a display hardware unit through a display driver to shorten a sending path of the first message to inform the display hardware unit to read/receive the processed video frame, comprising:
the middle layer sends a first frame of processed video frame to a display hardware unit through a display driver, and sends a first message to the display hardware unit through the display driver before sending is finished so as to inform the display hardware unit to read/receive the first frame of video frame;
wherein, when the display hardware unit reads/receives the processed video frame of the first frame, the time point of the first message being sent is configured to enable the display hardware unit to completely read/receive the processed video frame of the first frame.
8. The method of claim 6, wherein the intermediate layer processes the video frame, comprising:
the intermediate layer processes the video frame into a panorama.
9. An in-vehicle display system, comprising:
a camera, a chip and a display, the chip being adapted to perform the method of any one of claims 1-8, wherein the camera is connected to the chip and the chip is connected to the display.
10. A chip of an on-vehicle display system, comprising:
camera hardware interface, intermediate layer, driver layer, display hardware unit and hardware cache, the chip being configured to perform the method of any of claims 1-8, wherein the driver layer comprises: camera driving, display driving;
the camera hardware interface is connected with the camera, the camera driver and the hardware cache, the middle layer is connected with the camera driver and the display driver, the camera driver is connected with the camera hardware interface, the display driver and the middle layer, the display driver is connected with the camera driver, the middle layer and the display hardware unit, and the display hardware unit is connected with the hardware cache, the hardware driver and the display.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210524600.2A CN115061648A (en) | 2022-05-13 | 2022-05-13 | Operation method of vehicle-mounted display system and vehicle-mounted display system |
| PCT/CN2022/143035 WO2023216618A1 (en) | 2022-05-13 | 2022-12-28 | Operation method for vehicle-mounted display system, and vehicle-mounted display system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210524600.2A CN115061648A (en) | 2022-05-13 | 2022-05-13 | Operation method of vehicle-mounted display system and vehicle-mounted display system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115061648A true CN115061648A (en) | 2022-09-16 |
Family
ID=83198384
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210524600.2A Pending CN115061648A (en) | 2022-05-13 | 2022-05-13 | Operation method of vehicle-mounted display system and vehicle-mounted display system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN115061648A (en) |
| WO (1) | WO2023216618A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023216618A1 (en) * | 2022-05-13 | 2023-11-16 | 合肥杰发科技有限公司 | Operation method for vehicle-mounted display system, and vehicle-mounted display system |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103226448B (en) * | 2013-03-21 | 2016-09-07 | 华为技术有限公司 | The driving method of solid state hard disc and device |
| CN105045745B (en) * | 2015-08-31 | 2017-10-27 | 华中科技大学 | A kind of FCoE read-writes processing system, processing method and exchange id distribution method |
| CN105282510A (en) * | 2015-10-21 | 2016-01-27 | 畅索软件科技（上海）有限公司 | Method and device for starting reverse image |
| CN106043124A (en) * | 2016-05-25 | 2016-10-26 | 青岛海信移动通信技术股份有限公司 | Method and device for controlling vehicle backing image display |
| CN107920204B (en) * | 2017-11-29 | 2020-04-24 | 珠海亿智电子科技有限公司 | Device and method for rapidly displaying reversing video in cold start |
| KR102628629B1 (en) * | 2019-06-05 | 2024-01-23 | 삼성전자주식회사 | Semiconductor device |
| CN110588515B (en) * | 2019-09-04 | 2022-06-07 | 常州新途软件有限公司 | Vehicle-mounted reversing image display method |
| CN113835616A (en) * | 2020-06-23 | 2021-12-24 | 华为技术有限公司 | Data management method and system of application and computer equipment |
| CN113542757B (en) * | 2021-07-20 | 2024-04-02 | Oppo广东移动通信有限公司 | Image transmission method and device for cloud application, server and storage medium |
| CN115061648A (en) * | 2022-05-13 | 2022-09-16 | 合肥杰发科技有限公司 | Operation method of vehicle-mounted display system and vehicle-mounted display system |
-
2022
- 2022-05-13 CN CN202210524600.2A patent/CN115061648A/en active Pending
- 2022-12-28 WO PCT/CN2022/143035 patent/WO2023216618A1/en unknown
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023216618A1 (en) * | 2022-05-13 | 2023-11-16 | 合肥杰发科技有限公司 | Operation method for vehicle-mounted display system, and vehicle-mounted display system |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023216618A1 (en) | 2023-11-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4661734B2 (en) | In-vehicle warning system | |
| JP4742953B2 (en) | Image processing apparatus, image display system, and program | |
| CN108574811B (en) | Image recording system, image recording method, and image recording program | |
| CN109318799B (en) | Automobile, automobile ADAS system and control method thereof | |
| WO2023216618A1 (en) | Operation method for vehicle-mounted display system, and vehicle-mounted display system | |
| CN115767038A (en) | Data transmission method, image acquisition device on vehicle and system-on-chip | |
| CN106945605B (en) | Vehicle blind area monitoring system and control method | |
| CN111332287B (en) | Driving assistance method and system | |
| US20220408062A1 (en) | Display control apparatus, display control method, and program | |
| CN110834582B (en) | Automatic turn-off method and device for steering lamp, hydrogen energy automobile and storage medium | |
| US20110080495A1 (en) | Method and camera system for the generation of images for the transmission to an external control unit | |
| US10037169B2 (en) | Image processing semiconductor device and image processing device | |
| CN113968186A (en) | Display method, device and system | |
| CN211731213U (en) | Vehicle-mounted information entertainment system and vehicle | |
| CN219428021U (en) | Streaming media rearview mirror image processing circuit and IVI system | |
| JP2006160192A (en) | Vehicular drive supporting device | |
| CN204674475U (en) | A kind of integrated vehicle drive assist system based on array DSP | |
| CN115465225B (en) | Service life extension method and device of vehicle-mounted camera, vehicle and storage medium | |
| CN116416359A (en) | Multi-path image parallel rendering method, device, computer equipment and storage medium | |
| CN217238939U (en) | Support traffic signal lamp discernment and vehicle-mounted AR navigation of driving record | |
| JPS61249199A (en) | Vehicle identifier | |
| CN116101174A (en) | Collision reminding method and device for vehicle, vehicle and storage medium | |
| US20240007595A1 (en) | Camera monitoring system, control method for camera monitoring system, and storage medium | |
| CN115209050A (en) | Image processing method, in-vehicle system, vehicle, and medium | |
| JP6942424B2 (en) | Rear image display device for vehicles |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |