CN115190343B - Method and system for reducing video delay of streaming media rearview mirror - Google Patents
Method and system for reducing video delay of streaming media rearview mirror Download PDFInfo
- Publication number
- CN115190343B CN115190343B CN202110356088.0A CN202110356088A CN115190343B CN 115190343 B CN115190343 B CN 115190343B CN 202110356088 A CN202110356088 A CN 202110356088A CN 115190343 B CN115190343 B CN 115190343B
- Authority
- CN
- China
- Prior art keywords
- streaming media
- offset
- data
- video data
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 238000006243 chemical reaction Methods 0.000 claims abstract description 37
- 238000001914 filtration Methods 0.000 claims abstract description 12
- 238000012545 processing Methods 0.000 claims description 56
- 238000004364 calculation method Methods 0.000 claims description 32
- 238000012805 post-processing Methods 0.000 claims description 28
- 230000003139 buffering effect Effects 0.000 claims description 3
- 230000005611 electricity Effects 0.000 claims 1
- 230000005540 biological transmission Effects 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N21/41422—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance located in transportation means, e.g. personal vehicle
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method for reducing video delay of a streaming media rearview mirror, which comprises the following steps: step S10, acquiring real-time video of the rear of the vehicle through a rearview camera; step S11, carrying out analog-to-digital conversion on the real-time video, then converting the real-time video into serial data, and adding a real-time timestamp into a data frame to form streaming media video data; step S12, filtering, noise reduction and deserializing are carried out on the streaming media video data, a timestamp offset value is obtained by comparing the timestamp on a data frame with the current system time, and the streaming media video data is offset according to the timestamp offset value and is subjected to digital/analog conversion; and step S13, displaying on a display screen of the streaming media rearview mirror. The invention also provides a corresponding system. By implementing the invention, video delay in the video transmission process of the streaming media rearview mirror can be eliminated, the end-to-end real-time video transmission can be realized, and the driving safety can be improved.
Description
Technical Field
The invention relates to the technical field of streaming media rearview mirrors of vehicles, in particular to a method and a system for reducing video delay of the streaming media rearview mirrors.
Background
Vehicles on the market have begun to deploy streaming rearview mirrors. The streaming media rearview mirror is characterized in that a traditional rearview mirror lens is replaced by a screen, a camera arranged at the rear of a vehicle body is connected, and images at the rear of the vehicle are displayed on the screen in real time. Compared with the traditional rearview mirror, the streaming media rearview mirror has the advantages that firstly, the visual angle is increased by at least three times, the horizontal FOV (field of view) can reach more than 80 degrees, and the visual field range is enlarged; and secondly, the complex light after the automobile can be automatically adjusted, so that the image quality is ensured, especially in rainy days and evening environments, the rear environments are still clearly visible, and the driving safety is improved.
The streaming media rearview mirror is applied to automobiles and has extremely high requirements on the real-time performance of video transmission. The current industry recommended standard for automotive enterprises is that video latency cannot be higher than 40ms. For a vehicle traveling at a high speed of 120km/h, a delay of 40ms means an error of 1.33m above the spatial distance, and above this distance, a driver may misjudge the error, and the driving safety is affected.
However, in the prior art, the disadvantage is that the video transmission delay is not enough, even if noise interference in the video transmission process is ignored, the processing time of the analog signal of the camera is also needed, and the video delay of more than 40ms is usually generated from the signal end of the camera to the display end of the screen. For a car running at a high speed, the prior art has certain potential safety hazards.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a method and a system for reducing video delay of a streaming media rearview mirror, which can eliminate the video delay in the video transmission process of the streaming media rearview mirror, realize end-to-end real-time video transmission and improve driving safety.
In order to solve the above technical problems, as one aspect of the present invention, a method for reducing video delay of a streaming media rearview mirror is provided, which includes the following steps:
step S10, acquiring real-time video through a rearview camera arranged on a vehicle;
step S11, carrying out analog-to-digital conversion on the real-time video, converting the real-time video into serial data, adding a real-time timestamp into a data frame to form streaming media video data, storing the streaming media video data into a data buffer area, and transmitting the streaming media video data to a streaming media rearview mirror through an LVDS cable;
step S12, the streaming media rearview mirror carries out filtering noise reduction and deserializing treatment on streaming media video data transmitted by the LVDS cable, then compares the current system time with a time stamp on a data frame to obtain a time stamp offset value, carries out offset treatment on the streaming media video data according to the time stamp offset value, and carries out digital-to-analog conversion on the streaming media video data after the offset treatment;
step S13, the streaming media video data converted by the digital/analog module is displayed on the display screen of the streaming media rearview mirror.
Wherein, the step S12 further includes:
step S120, the streaming media rearview mirror carries out filtering noise reduction and deserialization processing on streaming media video data transmitted by the LVDS cable;
step S121, periodically selecting a data frame in the streaming media video, comparing a time stamp on the data frame with the current system time to obtain a time stamp offset value, and forming a delay calculation reference value;
step S122, calculating a reference value and the refresh rate of the current streaming media video according to the delay, determining an offset frame number, performing offset processing according to the offset frame number, and discarding the data frames with the corresponding number;
step S123, performing digital-to-analog conversion on the offset-processed streaming video data.
Wherein, the step S121 further includes:
and comparing the timestamp offset value with a preset allowable offset threshold value to obtain a delay calculation reference value, wherein the range of the allowable offset threshold value is 0-40 milliseconds.
Wherein, in the step S122, the offset frame number is obtained by calculating according to the following formula:
M＝[A*F/1000]
wherein: m is the offset frame number; a is a delay calculation reference value, and the unit is millisecond; f is refresh rate in Hertz; [] As a rounding function.
Correspondingly, the invention also provides a system for reducing video delay of the streaming media rearview mirror, which comprises a rearview camera, a front-end processing module, a post-processing module and a display screen which are electrically connected in sequence, wherein the front-end processing module is connected with the post-processing module through an LVDS cable, and the system comprises the following components:
the rearview camera is arranged on the vehicle and used for collecting real-time videos behind the vehicle;
the front-end processing module is used for carrying out analog-to-digital conversion on the real-time video acquired by the rearview camera, converting the real-time video into serial data, adding a real-time timestamp into a data frame to form streaming media video data, storing the streaming media video data into a data buffer zone, and transmitting the streaming media video data to the post-processing module through an LVDS cable;
the post-processing module is used for carrying out filtering noise reduction and deserializing processing on the streaming media video data transmitted by the LVDS cable, comparing the time stamp on the data frame with the current system time to obtain a time stamp offset value, carrying out offset processing on the streaming media video data according to the time stamp offset value, and carrying out digital-to-analog conversion on the streaming media video data after the offset processing;
the display screen is arranged on the streaming media rearview mirror and displays the streaming media video data processed by the post-processing module.
Wherein the front-end processing module further comprises:
the analog-to-digital conversion unit is used for performing analog-to-digital conversion on the real-time video acquired by the rearview camera;
the serial processing unit is used for carrying out parallel-serial conversion processing on the data output by the analog-to-digital conversion unit to form serial data;
the time stamp adding unit is used for adding a real-time stamp into the data frame output by the serial processing unit;
and the buffer processing unit is used for buffering the streaming media video data output by the timestamp adding unit and transmitting the streaming media video data to the post-processing module through an LVDS cable.
Wherein the post-processing module further comprises:
the equalization processing unit is used for filtering and reducing noise of streaming media video data transmitted by the LVDS cable;
the deserializing unit is used for deserializing the streaming media video data output by the equalization processing unit to form parallel data;
the delay calculation reference value obtaining unit is used for periodically selecting a data frame in the streaming media video, comparing a time stamp on the data frame with the current system time to obtain a time stamp offset value, and forming a delay calculation reference value;
the offset processing unit is used for calculating a reference value and the refresh rate of the current streaming media video according to the delay, determining an offset frame number, and discarding the subsequent data frames with corresponding numbers according to the offset frame number;
the digital-to-analog conversion unit is used for carrying out digital-to-analog conversion on the subsequent streaming media video data.
Wherein the delay calculation reference value obtaining unit further includes:
and the calculating unit is used for comparing the timestamp offset value with a preset allowable offset threshold value to obtain a delay calculation reference value, wherein the range of the allowable offset threshold value is 0-40 milliseconds.
The offset processing unit specifically calculates to obtain an offset frame number according to the following formula:
M＝[A*F/1000]
wherein: m is the offset frame number; a is a delay calculation reference value, and the unit is millisecond; f is refresh rate in Hertz; [] As a rounding function.
The post-processing module and the post-processing module are at least partially realized by adopting an FPGA.
The embodiment of the invention has the following beneficial effects:
the embodiment of the invention provides a method and a system for reducing video delay of a streaming media rearview mirror, which are characterized in that a timestamp is arranged in video frames acquired by a rearview camera, a delay calculation reference value is determined at a receiving end according to a timestamp offset value, an offset frame number is determined by combining with the refresh rate of the current streaming media video, and a corresponding number of subsequent data frames are discarded according to the offset frame number, so that the video frame number is played in advance, the delay of streaming media between a rear end and a front end is eliminated, and driving safety can be improved;
in the embodiment of the invention, the characteristics of low power consumption, low error rate, low crosstalk and low radiation of the LVDS signal are utilized, so that the adjustment efficiency in the method provided by the invention is high, the cost is low, and the influence on the work of a subsequent image processing module is avoided;
the scheme adopted by the invention can realize real-time long-distance transmission of the digital video, has strong scheme universality and expansibility, can be applied to a streaming media rearview mirror system with high frame rate and high resolution, and has wide application scene and strong adaptability.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions of the prior art, the drawings which are required in the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the description below are only some embodiments of the invention, and that it is within the scope of the invention to one skilled in the art to obtain other drawings from these drawings without inventive faculty.
FIG. 1 is a schematic diagram of a main flow of an embodiment of a method for reducing video delay of a streaming rearview mirror according to the present invention;
FIG. 2 is a more detailed flow chart of step S12 in FIG. 1;
FIG. 3 is a schematic diagram illustrating a system for reducing video delay of a rearview mirror with streaming media according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of the front end processing module of FIG. 3;
FIG. 5 is a schematic diagram of the post-processing module of FIG. 3;
fig. 6 is a schematic diagram of a structure of the delay calculation reference value obtaining unit in fig. 3.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings, for the purpose of making the objects, technical solutions and advantages of the present invention more apparent.
Fig. 1 is a schematic flow chart of an embodiment of a method for reducing video delay of a streaming media rearview mirror according to the present invention. As shown in fig. 2, the method includes the following steps:
step S10, acquiring real-time video of the rear of a vehicle through a rearview camera arranged on the vehicle;
step S11, carrying out analog-to-digital conversion on the real-time video, converting the real-time video into serial data, adding a real-time timestamp into a data frame to form streaming media video data, storing the streaming media video data into a data buffer area, and transmitting the streaming media video data to a streaming media rearview mirror through an LVDS cable;
specifically, in one example, the step S11 further includes:
performing analog-to-digital conversion on the real-time video acquired by the rearview camera;
performing parallel-to-serial conversion on the data output in the previous step to form serial data;
adding a real-time timestamp in each data frame of the serial data;
and storing the streaming media video data added with the time stamp into a buffer area, and transmitting the streaming media video data through an LVDS cable.
Step S12, the streaming media rearview mirror carries out filtering noise reduction and deserializing treatment on streaming media video data transmitted by the LVDS cable, then compares the current system time with a time stamp on a data frame to obtain a time stamp offset value, carries out offset treatment on the streaming media video data according to the time stamp offset value, and carries out digital-to-analog conversion on the streaming media video data after the offset treatment;
specifically, in one example, the step S12 further includes:
step S120, the streaming media rearview mirror carries out filtering noise reduction and deserialization processing on streaming media video data transmitted by the LVDS cable;
step S121, periodically selecting a data frame in the streaming media video, and comparing (e.g. subtracting) the time stamp on the data frame with the current system time according to the time stamp of each frame to obtain a time stamp offset value, thereby forming a delay calculation reference value;
in some examples, the timestamp offset value may be directly used as a delay calculation reference value; in other examples, the following steps may be used to obtain the delay calculation reference value:
comparing the timestamp offset value with a preset allowable offset threshold value to obtain a delay calculation reference value, wherein the range of the allowable offset threshold value is 0-40 milliseconds;
for example, in one practical example, assume that the timestamp offset value is 70 milliseconds; while the allowable offset threshold is 30 ms, the delay calculation reference value can be calculated to be 40ms.
Step S122, calculating a reference value and the refresh rate of the current streaming media video according to the delay, determining an offset frame number, performing offset processing according to the offset frame number, and specifically discarding the data frames with the corresponding number;
in a specific example, in the step S122, the offset frame number is calculated according to the following formula:
M＝[A*F/1000]
wherein: m is the offset frame number; a is a delay calculation reference value, and the unit is millisecond; f is refresh rate in Hertz; [] As a rounding function.
For example, an example in which the delay calculation reference value is 40 milliseconds is illustrated as an example shown in step S121; assuming that the refresh rate of the streaming media in the display screen is 60Hz, the streaming media is substituted into the above formula, and the offset frame number M is 2 frames. It is necessary to discard 2 frames of data.
Step S123, performing digital-to-analog conversion on the offset-processed streaming video data.
Step S13, the streaming media video data converted by the digital/analog module is displayed on the display screen of the streaming media rearview mirror.
It can be appreciated that in the embodiment of the present invention, the delay is generated by determining the streaming media between the back end and the front end according to the timestamp offset value; and then determining a delay calculation reference value according to the timestamp offset value, determining an offset frame number by combining the refresh rate of the current streaming media video, discarding a corresponding number of subsequent data frames according to the offset frame number, and playing the video frame number in advance to eliminate the delay of the streaming media between the rear end and the front end.
Fig. 3 is a schematic structural diagram of an embodiment of a system for reducing video delay of a streaming rearview mirror according to the present invention. Referring to fig. 5 to fig. 6 together, the system includes a rear-view camera 1, a front-end processing module 2, a post-processing module 3 and a display screen 4 which are electrically connected in sequence, wherein the front-end processing module 2 and the post-processing module 3 are connected through an LVDS cable, and the LVDS cable comprises:
the rearview camera 1 is arranged on a vehicle and is used for collecting real-time videos behind the vehicle;
the front-end processing module 2 is used for carrying out analog-to-digital conversion on the real-time video acquired by the rearview camera, converting the real-time video into serial data, adding a real-time timestamp into a data frame to form streaming media video data, storing the streaming media video data into a data buffer zone, and transmitting the streaming media video data to the post-processing module through an LVDS cable;
the post-processing module 3 is used for performing filtering, noise reduction and deserializing on the streaming media video data transmitted by the LVDS cable, comparing the current system time with a time stamp on a data frame to obtain a time stamp offset value, performing offset processing on the streaming media video data according to the time stamp offset value, and performing digital-to-analog conversion on the streaming media video data after the offset processing;
and the display screen 4 is arranged on the streaming media rearview mirror and displays the streaming media video data processed by the post-processing module.
More specifically, in one example, the front-end processing module 2 further includes:
an analog-to-digital conversion unit 21, configured to perform analog-to-digital conversion on the real-time video acquired by the rearview camera;
a serial processing unit 22 for performing parallel-to-serial conversion processing on the data output from the analog-to-digital conversion unit to form serial data;
a time stamp adding unit 23 for adding a real-time stamp to the data frame output from the serial processing unit;
and the buffer processing unit 24 is used for buffering the streaming media video data output by the timestamp adding unit and transmitting the streaming media video data to a post-processing module through an LVDS cable.
More specifically, in one example, the post-processing module 3 further includes:
the equalization processing unit 31 is configured to filter and reduce noise of streaming media video data transmitted by the LVDS cable;
the deserializing unit 32 is configured to deserialize the streaming video data output by the equalization processing unit to form parallel data;
the delay calculation reference value obtaining unit 33 is configured to periodically select a data frame in the streaming media video, and compare a timestamp on the data frame with a current system time to obtain a timestamp offset value, thereby forming a delay calculation reference value;
an offset processing unit 34, configured to calculate a reference value and a refresh rate of the current streaming media video according to the delay, determine an offset frame number, and discard a subsequent corresponding number of data frames according to the offset frame number;
the digital-to-analog conversion unit 35 is configured to perform digital-to-analog conversion on the subsequent streaming video data.
In a specific example, the delay calculation reference value obtaining unit 33 further includes:
the calculating unit 330 is configured to compare the timestamp offset value with a preset allowable offset threshold value, so as to obtain a delay calculation reference value, where the allowable offset threshold value ranges from 0ms to 40ms.
In a specific example, the offset processing unit 34 calculates the offset frame number according to the following formula:
M＝[A*F/1000]
wherein: m is the offset frame number; a is a delay calculation reference value, and the unit is millisecond; f is refresh rate in Hertz; [] As a rounding function.
In some examples, the post-processing modules 2, 3 are implemented at least in part using FPGAs (programmable logic devices).
For more details, reference is made to the foregoing descriptions of fig. 1 and 2, and details are not repeated here.
The embodiment of the invention has the following beneficial effects:
the embodiment of the invention provides a method and a system for reducing video delay of a streaming media rearview mirror, which are characterized in that a timestamp is arranged in video frames acquired by a rearview camera, a delay calculation reference value is determined at a receiving end according to a timestamp offset value, an offset frame number is determined by combining with the refresh rate of the current streaming media video, and a corresponding number of subsequent data frames are discarded according to the offset frame number, so that the video frame number is played in advance, the delay of streaming media between a rear end and a front end is eliminated, and driving safety can be improved;
in the embodiment of the invention, the characteristics of low power consumption, low error rate, low crosstalk and low radiation of the LVDS signal are utilized, so that the adjustment efficiency in the method provided by the invention is high, the cost is low, and the influence on the work of a subsequent image processing module is avoided;
the scheme adopted by the invention can realize real-time long-distance transmission of the digital video, has strong scheme universality and expansibility, can be applied to a streaming media rearview mirror system with high frame rate and high resolution, and has wide application scene and strong adaptability.
It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above disclosure is only a preferred embodiment of the present invention, and it is needless to say that the scope of the invention is not limited thereto, and therefore, the equivalent changes according to the claims of the present invention still fall within the scope of the present invention.
Claims (10)
1. A method for reducing video delay of a streaming media rearview mirror, comprising the steps of:
step S10, acquiring real-time video of the rear of a vehicle through a rearview camera arranged on the vehicle;
step S11, carrying out analog-to-digital conversion on the real-time video, converting the real-time video into serial data, adding a real-time timestamp into a data frame to form streaming media video data, storing the streaming media video data into a data buffer area, and transmitting the streaming media video data to a streaming media rearview mirror through an LVDS cable;
step S12, the streaming media rearview mirror carries out filtering noise reduction and deserializing treatment on streaming media video data transmitted by the LVDS cable, then compares the current system time with a time stamp on a data frame to obtain a time stamp offset value, carries out offset treatment on the streaming media video data according to the time stamp offset value, and carries out digital-to-analog conversion on the streaming media video data after the offset treatment;
step S13, displaying the streaming media video data converted by the digital/modular on a display screen of the streaming media rearview mirror;
wherein, the step S12 at least includes:
step S121, periodically selecting a data frame in the streaming media video, comparing a time stamp on the data frame with the current system time to obtain a time stamp offset value, and forming a delay calculation reference value;
step S122, according to the delay time, calculating a reference value and the refresh rate of the current streaming media video, determining an offset frame number, according to the offset frame number, performing offset processing, and discarding the data frames with the corresponding number.
2. The method of claim 1, wherein the step S12 further comprises:
step S120, the streaming media rearview mirror carries out filtering noise reduction and deserialization processing on streaming media video data transmitted by the LVDS cable;
step S123, performing digital-to-analog conversion on the offset-processed streaming video data.
3. The method of claim 2, wherein the step S121 further comprises:
and comparing the timestamp offset value with a preset allowable offset threshold value to obtain a delay calculation reference value, wherein the range of the allowable offset threshold value is 0-40 milliseconds.
4. The method of claim 3, wherein the step S122 is performed to obtain the offset frame number according to the following formula:
M＝[A*F/1000]
wherein: m is the offset frame number; a is a delay calculation reference value, and the unit is millisecond; f is refresh rate in Hertz; [] As a rounding function.
5. The utility model provides a reduce video time delay's of streaming media rear-view mirror system, its characterized in that, including rear-view camera, front end processing module, post-processing module and the display screen that connects gradually the electricity, front end processing module is connected through the LVDS cable with post-processing module, wherein:
the rearview camera is arranged on the vehicle and used for collecting real-time videos behind the vehicle;
the front-end processing module is used for carrying out analog-to-digital conversion on the real-time video acquired by the rearview camera, converting the real-time video into serial data, adding a real-time timestamp into a data frame to form streaming media video data, storing the streaming media video data into a data buffer zone, and transmitting the streaming media video data to the post-processing module through an LVDS cable;
the post-processing module is used for carrying out filtering noise reduction and deserializing processing on the streaming media video data transmitted by the LVDS cable, comparing the time stamp on the data frame with the current system time to obtain a time stamp offset value, carrying out offset processing on the streaming media video data according to the time stamp offset value, and carrying out digital-to-analog conversion on the streaming media video data after the offset processing;
the display screen is arranged on the streaming media rearview mirror and displays streaming media video data processed by the post-processing module;
wherein, the post-processing module at least includes:
the delay calculation reference value obtaining unit is used for periodically selecting a data frame in the streaming media video, comparing a time stamp on the data frame with the current system time to obtain a time stamp offset value, and forming a delay calculation reference value;
and the offset processing unit is used for calculating a reference value and the refresh rate of the current streaming media video according to the delay, determining an offset frame number, and discarding the subsequent data frames with corresponding numbers according to the offset frame number.
6. The system of claim 5, wherein the front-end processing module further comprises:
the analog-to-digital conversion unit is used for performing analog-to-digital conversion on the real-time video acquired by the rearview camera;
the serial processing unit is used for carrying out parallel-serial conversion processing on the data output by the analog-to-digital conversion unit to form serial data;
the time stamp adding unit is used for adding a real-time stamp into the data frame output by the serial processing unit;
and the buffer processing unit is used for buffering the streaming media video data output by the timestamp adding unit and transmitting the streaming media video data to the post-processing module through an LVDS cable.
7. The system of claim 6, wherein the post-processing module further comprises:
the equalization processing unit is used for filtering and reducing noise of streaming media video data transmitted by the LVDS cable;
the deserializing unit is used for deserializing the streaming media video data output by the equalization processing unit to form parallel data;
the digital-to-analog conversion unit is used for carrying out digital-to-analog conversion on the subsequent streaming media video data.
8. The system of claim 7, wherein the delay calculation reference value obtaining unit further comprises:
and the calculating unit is used for comparing the timestamp offset value with a preset allowable offset threshold value to obtain a delay calculation reference value, wherein the range of the allowable offset threshold value is 0-40 milliseconds.
9. The system of claim 8, wherein the offset processing unit calculates the offset frame number according to the following formula:
M＝[A*F/1000]
wherein: m is the offset frame number; a is a delay calculation reference value, and the unit is millisecond; f is refresh rate in Hertz; [] As a rounding function.
10. The system of claim 9, the post-processing module, post-processing module being implemented at least in part with an FPGA.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110356088.0A CN115190343B (en) | 2021-04-01 | 2021-04-01 | Method and system for reducing video delay of streaming media rearview mirror |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110356088.0A CN115190343B (en) | 2021-04-01 | 2021-04-01 | Method and system for reducing video delay of streaming media rearview mirror |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115190343A CN115190343A (en) | 2022-10-14 |
| CN115190343B true CN115190343B (en) | 2023-10-27 |
Family
ID=83512360
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110356088.0A Active CN115190343B (en) | 2021-04-01 | 2021-04-01 | Method and system for reducing video delay of streaming media rearview mirror |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115190343B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005017725A (en) * | 2003-06-26 | 2005-01-20 | Nec Plasma Display Corp | Display device and image signal processing method for the image display device |
| CN101998101A (en) * | 2009-08-31 | 2011-03-30 | 中兴通讯股份有限公司 | Video data receiving and transmitting systems and video data processing method for video telephone |
| CN103139636A (en) * | 2011-12-05 | 2013-06-05 | 优视科技有限公司 | Streaming media data processing method and device and streaming media data reproduction equipment |
| CN105933800A (en) * | 2016-04-29 | 2016-09-07 | 联发科技（新加坡）私人有限公司 | Video play method and control terminal |
| CN106060580A (en) * | 2016-06-08 | 2016-10-26 | 浙江宇视科技有限公司 | Synchronous image display method and device |
| CN106851259A (en) * | 2017-01-17 | 2017-06-13 | 中国科学院上海高等研究院 | video delay test device in monitoring system |
| CN110572695A (en) * | 2019-08-07 | 2019-12-13 | 苏州科达科技股份有限公司 | media data encoding and decoding methods and electronic equipment |
| CN111901612A (en) * | 2019-05-05 | 2020-11-06 | 东莞潜星电子科技有限公司 | Non-delay automobile streaming media system and working method thereof |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8364024B2 (en) * | 2009-02-03 | 2013-01-29 | Broadcom Corporation | Constructing video frames and synchronizing audio data in a media player from data received via a plurality of diverse protocol stack paths |
-
2021
- 2021-04-01 CN CN202110356088.0A patent/CN115190343B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005017725A (en) * | 2003-06-26 | 2005-01-20 | Nec Plasma Display Corp | Display device and image signal processing method for the image display device |
| CN101998101A (en) * | 2009-08-31 | 2011-03-30 | 中兴通讯股份有限公司 | Video data receiving and transmitting systems and video data processing method for video telephone |
| CN103139636A (en) * | 2011-12-05 | 2013-06-05 | 优视科技有限公司 | Streaming media data processing method and device and streaming media data reproduction equipment |
| CN105933800A (en) * | 2016-04-29 | 2016-09-07 | 联发科技（新加坡）私人有限公司 | Video play method and control terminal |
| CN106060580A (en) * | 2016-06-08 | 2016-10-26 | 浙江宇视科技有限公司 | Synchronous image display method and device |
| CN106851259A (en) * | 2017-01-17 | 2017-06-13 | 中国科学院上海高等研究院 | video delay test device in monitoring system |
| CN111901612A (en) * | 2019-05-05 | 2020-11-06 | 东莞潜星电子科技有限公司 | Non-delay automobile streaming media system and working method thereof |
| CN110572695A (en) * | 2019-08-07 | 2019-12-13 | 苏州科达科技股份有限公司 | media data encoding and decoding methods and electronic equipment |
Non-Patent Citations (1)
| Title |
|---|
| 一种电子流媒体后视镜方案关键技术及实现;孙德生;;汽车实用技术(第18期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115190343A (en) | 2022-10-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113276774B (en) | Method, device and equipment for processing video picture in unmanned vehicle remote driving process | |
| CN204258976U (en) | A kind of vehicle-mounted panoramic visible system | |
| EP1227683A1 (en) | Monitor camera, method of adjusting camera, and vehicle monitor system | |
| US11082626B2 (en) | Image processing device, imaging device, and image processing method | |
| CN107235008B (en) | Vehicle-mounted driving-assisting panoramic image system and panoramic image acquisition method | |
| CN207140946U (en) | A kind of vehicle-mounted auxiliary drives panoramic picture system | |
| US20200250985A1 (en) | Image display system and riding device | |
| CN102006460A (en) | Automatic control and prompt-based assistant driving method and system | |
| CN110363085B (en) | Method for realizing looking around of heavy articulated vehicle based on articulation angle compensation | |
| WO2018008426A1 (en) | Signal processing device and method, and imaging device | |
| CN109591703A (en) | A kind of electronic rear view mirror system of automobile and its display methods | |
| CN115190343B (en) | Method and system for reducing video delay of streaming media rearview mirror | |
| JP2005184395A (en) | Method, system and apparatus for image processing, and photographing equipment | |
| CN105216715A (en) | A kind of motorist vision assists enhancing system | |
| CN209089078U (en) | A kind of embedded six road panorama system towards motorbus | |
| CN108833797B (en) | Device for improving performance of vehicle-mounted binocular vision system and using method thereof | |
| CN203872281U (en) | Wide-field foresight system | |
| CN213384056U (en) | Low-delay motor vehicle indirect visual field device based on FPGA | |
| CN114339059A (en) | Method and device for adjusting remote driving picture | |
| EP2466889A2 (en) | Multi-camera system for an automobile, automobile and method for operating a multi-camera system in an automobile | |
| CN114222032A (en) | Vision auxiliary method applied to large vehicle | |
| CN204498258U (en) | To park auxiliary monitoring system | |
| JP7384343B2 (en) | Image processing device, image processing program | |
| WO2020149094A1 (en) | Imaging device, imaging system and failure detection method | |
| JP2017228850A (en) | Camera monitor system for vehicle and vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |