CN116156154A - Video data stream state judging method and system - Google Patents

Abstract

The invention belongs to the technical field of electronic rearview mirrors, and particularly relates to a video data stream state judging method and system. The method for judging the state of the video data stream comprises the following steps: extracting first frame image data from the image capturing module and second frame image data from the image display module respectively at intervals of a preset time; calculating a corrected difference value of color and/or brightness of the first frame image data and the second frame image data; and when the corrected difference value of at least one of the color and/or the brightness is greater than the difference threshold value, judging that the video data stream state is normal, and otherwise, judging that the video data stream state is abnormal. The initial difference value of the color and/or brightness of the first frame image data and the second frame image data is calculated, and then the difference threshold value is more easily met when the vehicle speed is lower, the difference threshold value is more difficult to meet when the vehicle speed is higher, namely the early warning of the image clamping stagnation is less sensitive when the vehicle speed is lower, and the early warning of the image clamping stagnation is more sensitive when the vehicle speed is higher.

Description

Video data stream state judging method and system

Technical Field

The invention belongs to the technical field of electronic rearview mirrors, and particularly relates to a video data stream state judging method and system.

Background

With the rapid development of new and quadruple (intelligent, networking, electric and sharing) automobiles, automobile models are increasingly technological, and the problem brought is that drivers cannot see the dead zone behind the automobile clearly from common outside rearview mirrors, passengers or piled articles are additionally arranged on secondary driving, dark-colored adhesive films are attached to automobile windows, and the like, so that the rear situation of the drivers is seriously influenced. Particularly in extreme environments such as rainy and snowy weather, the rear road can not be captured basically. These all contribute to the rapid development of electronic exterior rear-view mirrors.

The electronic rearview mirror, which may be described as CMS, indirect view device, etc., is an electronic rearview mirror system composed of high-definition cameras, image sensors, imaging processors, display screens, etc., and compared with the traditional rearview mirror, the electronic rearview mirror not only can be more in accordance with aerodynamic design, but also has small improvement in visual angle and night tolerance. The electronic exterior rearview mirror has a more flexible visual angle, compared with the traditional rearview mirror, the camera is smaller in size for a driver, the sight shielding caused to the driver is smaller, and the electronic exterior rearview mirror can bring wider visual coverage, so that the electronic exterior rearview mirror can complete free switching from a wide angle to a long-focus angle, and can display more visual and accurate pictures through distortion correction of a system.

Thus, the CMS system is critical to functional safety requirements, and responds quickly and accurately to camera failure, monitor failure, control unit failure, etc. That is, the failure of the electronic rearview mirror can be classified into three major types, i.e., failure of the image acquisition device, failure of the video transmission link, and failure of the display host image display, as a vehicle-mounted electronic device related to driving safety, and when the safety-related function fails, the failure state of the driver device should be notified by a warning signal.

When the image acquisition device or the video transmission link fails, if the display host does not perform effective detection and judgment, the last frame of image data reserved in the buffer memory is continuously displayed, and the environmental change around the vehicle, namely the image clamping stagnation (or image freezing) cannot be reflected in real time. The image jamming gives the driver an illusion that the driver cannot distinguish the normal image from the jammed image, and when an obstacle or a pedestrian appears around the vehicle, serious traffic accidents are most likely to occur. Thus, image sticking is generally considered more severe than other types of faults from the consequences of this. In order to reduce the driving potential safety hazard caused by image jamming, the electronic rearview mirror host needs to quickly and accurately identify the occurrence of the image jamming (generally less than 400 ms), and early warning prompt is carried out to a driver through various preset warning signals within 100ms after the detection of the abnormality.

Chinese patent CN115134590a discloses a method for detecting image jamming of an electronic rearview mirror, which covers detection of an image coding transmission link, data verification of a video data stream, and fault state detection of a display processing module, and can detect whether the video data stream is normal or not from the whole video transmission link, so that occurrence of accident potential can be reduced. However, this method does not take into account the possibility that the color and/or brightness of the selected region does not change so much in a short time during the vehicle stopping process that the system misjudges as abnormal in the video stream state.

Disclosure of Invention

The invention aims to provide a method and a system for judging the state of a video data stream.

In order to solve the above technical problems, the present invention provides a method for determining a status of a video data stream, which is applied to an electronic rearview mirror system, and includes: extracting first frame image data from the image capturing module and second frame image data from the image display module respectively at intervals of a preset time; calculating a corrected difference value of color and/or brightness of the first frame image data and the second frame image data; when the corrected difference value of at least one of the color and/or the brightness is greater than the difference threshold value, judging that the video data stream state is normal, otherwise, judging that the video data stream state is abnormal; the method for calculating the correction difference value comprises the following steps:

X＝W*(1+p)；

p＝0.8-v*0.4％，v∈[0,175)；

p＝0.1,v≥175；

wherein X is a corrected difference value; w is the initial difference value of the color and/or brightness of the first frame image data and the second frame image data; p is a vehicle speed correction coefficient; v is the real-time vehicle speed in km/h.

In still another aspect, the present invention further provides a system for judging a status of a video data stream, including: the first image data sampling module and the second image data sampling module are used for respectively extracting first frame image data from the image capturing module and second frame image data from the image display module at intervals of a preset time; the correction difference value calculation module is used for calculating the correction difference value of the color and/or brightness of the first frame image data and the second frame image data; and the state judging module judges the state of the video data stream to be normal when the corrected difference value of the color or the brightness is larger than the difference threshold value, and otherwise, the state of the video data stream is abnormal.

In still another aspect, the present invention further provides a method for determining an image clamping stagnation of an electronic rearview mirror, including:

s1, judging the working state of a video transmission link and the working state of an image display module, and executing S2 if the working state of the video transmission link and the working state of the image display module are normal; otherwise, executing S4;

s2, judging the state of the video data stream, and if the state is normal, executing S3; otherwise, executing S4;

s3, judging that the electronic rearview mirror image is free of clamping stagnation;

s4, judging that the electronic rearview mirror image is stuck; wherein the method comprises the steps of

The step S2 of judging the video data stream state adopts the video data stream state judging method.

In still another aspect, the present invention further provides an electronic rearview mirror image clamping stagnation detection device, including: comprising a memory and a processor; the processor is configured to execute computer instructions stored in the memory to implement the electronic rear view mirror image sticking judgment method according to claim 7.

In yet another aspect, the present invention also provides an electronic rearview mirror system, including: the camera and the host; the camera comprises an image sensing module and an image coding and transmitting module; the host includes: the device comprises an image decoding and receiving module, an image capturing module, a data buffer area module, an image display module, a first image data sampling module, a second image data sampling module and a processing module; the image decoding and receiving module is used for decoding the image data in the coding format transmitted by the camera and outputting the image data to the image capturing module; the image capturing module is used for outputting the received image data to the data buffer area module; the image display module is used for displaying and outputting the image data in the data buffer area module; the first image data sampling module and the second image data sampling module are used for respectively extracting first frame image data from the image capturing module and second frame image data from the image display module at intervals of a preset time; the processing module is suitable for judging whether the electronic rearview mirror image is jammed or not by adopting the electronic rearview mirror image jamming judging method.

In still another aspect, the present invention further provides a method for calculating a corrected difference value of image data, including:

X＝W*(1+p)；

p＝0.8-v*0.4％，v∈[0,175)；

p＝0.1,v≥175；

wherein X is a corrected difference value; w is the initial difference value of the color and/or brightness of the first frame image data and the second frame image data; p is a vehicle speed correction coefficient; v is the real-time vehicle speed in km/h.

The video data stream state judging method has the advantages that the initial difference value of the color and/or the brightness of the first frame image data and the second frame image data is calculated firstly, and then the difference threshold value is more easily met when the vehicle speed is lower, the difference threshold value is more difficult to be met when the vehicle speed is higher, namely the early warning of the image clamping stagnation is less sensitive when the vehicle speed is lower, and the early warning of the image clamping stagnation is more sensitive when the vehicle speed is higher through being related to the vehicle speed correction coefficient.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

In order to make the above objects, features and advantages of the present invention more comprehensible, preferred embodiments accompanied with figures are described in detail below.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the present invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.

FIG. 1 is a flow chart of a video data stream status determination method according to the present invention;

FIG. 2 is a schematic diagram of an electronic rearview mirror system of the present invention;

FIG. 3 is a schematic diagram of an electronic rearview mirror image jam judging method according to the invention;

FIG. 4 is a schematic view of a localized area of an image of an electronic rearview mirror of the present invention;

fig. 5 is a schematic diagram of an updated image center according to the present invention.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

As shown in fig. 2, in one application scenario, an electronic rearview mirror system may include a camera and a host; the camera comprises an image sensing module and an image coding and transmitting module; the host includes: the device comprises an image decoding and receiving module, an image capturing module, a data buffer area module, an image display module, a first image data sampling module, a second image data sampling module and a processing module; the image decoding and receiving module is used for decoding the image data in the coding format transmitted by the camera and outputting the image data to the image capturing module; the image capturing module is used for outputting the received image data to the data buffer area module; the image display module is used for displaying and outputting the image data in the data buffer area module.

As shown in fig. 1, the present embodiment provides a method for determining a status of a video data stream, which is applied to an electronic rearview mirror system, and includes: extracting first frame image data from the image capturing module and second frame image data from the image display module respectively at intervals of a preset time; calculating a corrected difference value of color and/or brightness of the first frame image data and the second frame image data; when the corrected difference value of at least one of the color and/or the brightness is greater than the difference threshold value, judging that the video data stream state is normal, otherwise, judging that the video data stream state is abnormal; wherein the method comprises the steps of

The calculation method of the correction difference value comprises the following steps:

X＝W*(1+p)；

p＝0.8-v*0.4％，v∈[0,175)；

p＝0.1,v≥175；

wherein X is a corrected difference value; w is the initial difference value of the color and/or brightness of the first frame image data and the second frame image data; p is a vehicle speed correction coefficient; v is the real-time vehicle speed in km/h.

In this embodiment, the initial difference value of the color and/or brightness of the first frame image data and the second frame image data is calculated first, and then by correlating with the vehicle speed correction coefficient, it is possible to achieve that the difference threshold is more easily satisfied when the vehicle speed is lower, and the difference threshold is more difficult to be satisfied when the vehicle speed is higher, that is, the early warning of the image jam is less sensitive when the vehicle speed is lower, and the early warning of the image jam is more sensitive when the vehicle speed is higher.

Specifically, in a vehicle stopping state, that is, when the vehicle speed v=0 km/h, the change of the vehicle environment image is not large, and the normal running requirement of the rearview mirror is relatively low in the stopping state, then p is maximum, the easier X meets a preset difference threshold value, the requirement on an initial difference value W is reduced, and the possibility of false triggering of the system can be reduced as much as possible in the vehicle stopping state; in the running process of the vehicle, the requirements on the normal running of the rearview mirror are relatively high, and the normal running of the rearview mirror system is theoretically ensured to ensure the running safety, so that the higher the running speed of the vehicle is, the smaller the p is, the less the X is, the more sensitive the early warning of the image clamping stagnation is, and the easier the early warning of the image clamping stagnation is triggered.

In this embodiment, only the corrected difference value of the color of the first frame image data and the second frame image data may be calculated, and when the corrected difference value of the color is greater than the difference threshold, the video data stream state is judged to be normal, otherwise, the video data stream state is judged to be abnormal; the method comprises the steps of calculating the brightness correction difference value of the first frame image data and the second frame image data, judging the video data stream state to be normal when the brightness correction difference value is larger than a difference threshold value, and judging the video data stream state to be abnormal otherwise; and the correction difference value of the color and the brightness of the first frame image data and the second frame image data can be calculated at the same time, and if at least one of the two correction difference values is larger than a difference threshold value, the video data stream state is judged to be normal, otherwise, the video data stream state is judged to be abnormal.

In this embodiment, as an alternative way of obtaining the initial difference values of the two images: a difference value hash algorithm (dhsh) can be adopted to shrink each image to 8×9 pixels of 72 total, and then the scaled picture is converted into a 256-level gray scale map; by calculating the difference between adjacent pixels in each row, if the left pixel is brighter or has a difference in color than the right pixel, the pixel is recorded as 1, otherwise, the pixel is 0, 64 values are formed in a conformal mode, namely a 0-1 sequence with the length of 64 is formed, and the fingerprint of the corresponding image is obtained. Then, calculating the Hamming distance of the corresponding sequences of the two images to be compared, and obtaining initial difference values of the two images; of course, according to specific requirements, the initial difference value may also be obtained by multiplying the hamming distance by an adjustment coefficient, and a person skilled in the art may select the adjustment coefficient according to actual requirements, which may be a constant value, and will not be described herein. dHash is much faster than other algorithms, and works better with nearly the same efficiency, which is based on a gradual change.

In this embodiment, as another alternative acquisition method of the initial difference values of the two images: for example, when comparing colors, comparing colors of pixels at the same position of two image data, judging whether the colors are the same, accumulating the numbers of pixels with different colors, dividing the accumulated numbers by the total number of pixels of the whole image data after the comparison is finished, and obtaining a difference percentage, thus obtaining two image initial difference values; of course, according to specific requirements, the initial difference value may also be obtained by multiplying the difference percentage by an adjustment coefficient, and a person skilled in the art may select the adjustment coefficient according to actual requirements, and may be a constant value, which is not described herein. The same processing method can be used for comparing brightness.

In this embodiment, preferably, in the process of acquiring the initial difference value, the image area may be reduced to an area close to the middle position of the whole image data, so that the calculation efficiency may be improved, and thus whether the electronic rearview mirror image is jammed may be determined more quickly.

As shown in fig. 4, in this embodiment, preferably, the initial difference value is a difference value of a local area of the image; the image local area is: taking an area outside the center of the image in the horizontal direction, wherein the width is 1/3-1/2 of the width of the whole image; the region with the center of the image down is taken in the vertical direction.

In the optional application scene, the middle area of the electronic rearview mirror is generally covered with a main target which is photographed and generally changes; outside the area, the ground, the car body, the sky and the like may not change for a long time or the area with small change is easy to generate system misjudgment, so that a user is misled to generate image clamping stagnation for the system; therefore, the efficiency can be improved by selecting the image local area to acquire the initial difference value, and the authenticity of the difference value can be improved on the other hand.

In an optional application scenario, because the angle of the electronic rearview mirror is adjusted by the user, the image local area is dynamically changed, and on the basis of a preset image data center, after the user manually adjusts the shooting angle of the electronic rearview mirror, the processor needs to memorize the operation of the user and update the image data center, namely update the image local area, so that after each adjustment, the initial difference value is obtained for the updated image local area.

Based on this, as shown in fig. 5, in the present embodiment, before extracting the first frame image data from the image capturing module and the second frame image data from the image display module, further includes: after the user adjusts the mirror angle, the image center is updated.

In one application scenario, assume that the electronic rear view mirror has a Horizontal viewing angle (Horizontal) of 76 °, a Vertical viewing angle (Vertical) of 50 °, and an initial image data center of 0 ° (H), 0 ° (V). The user manually adjusts the angle of the rearview mirror, the angle is outwards adjusted by m degrees, and the angle is upwards adjusted by n degrees, so that the image data center is dynamically adjusted to be m degrees (H) and n degrees (V); conversely, when m DEG is adjusted inwards and n DEG is adjusted downwards, the image data center is also dynamically adjusted to be-m DEG (H), -n DEG (V); after the image data center update is completed, the image local area is updated based on the image data center update.

In this embodiment, preferably, when the user manually adjusts the horizontal and/or vertical angle of the electronic rearview mirror to exceed the preset angle threshold, the user is reminded that the position of the rearview mirror is abnormal and needs to be readjusted.

In some application scenarios, when a user manually adjusts the shooting angle of the electronic rearview mirror to exceed a preset angle threshold, a local area of an image can cover an area where more ground, car body and sky appear, and the obtained initial difference value can be distorted, so that the user needs to be reminded of readjustment.

In this embodiment, as an alternative implementation of the variance threshold, the variance threshold may be 1.2 times the original variance value; the original difference value can be an initial difference value calculated by sampling original data according to the requirement in the test process. Of course, in other embodiments, the difference threshold value may be adjusted according to a sufficient test to obtain the difference threshold value that is available to meet the actual requirement, or the difference threshold value may be directly assigned, which is not described herein.

On the basis of the foregoing embodiment, this embodiment further provides a video data stream status judging system, including: the first image data sampling module and the second image data sampling module are used for respectively extracting first frame image data from the image capturing module and second frame image data from the image display module at intervals of a preset time; the correction difference value calculation module is used for calculating the correction difference value of the color and/or brightness of the first frame image data and the second frame image data; and the state judging module judges the state of the video data stream to be normal when the corrected difference value of the color or the brightness is larger than the difference threshold value, and otherwise, the state of the video data stream is abnormal.

In this embodiment, the method for correcting the difference value may be adopted, and will not be described herein.

In this embodiment, the video data stream status judging system further includes: the image center updating module is used for updating the image center after the angle of the rearview mirror is adjusted by a user; the first image data sampling module and the second image data sampling module are adapted to sample after an update of the image center.

In this embodiment, the video data stream status judging system may further include a rearview mirror angle judging module and a reminding module, where the rearview mirror angle judging module may judge whether the horizontal and/or vertical angles of the rearview mirror exceed a preset angle threshold, and when the horizontal and/or vertical angles exceed the preset angle threshold, the reminding module reminds the user to readjust.

In this embodiment, the number of the elements, alternatively,

as shown in fig. 4, on the basis of the above embodiment, the present embodiment provides a method for determining image sticking of an electronic rearview mirror, including:

s1, judging the working state of a video transmission link and the working state of an image display module, and executing S2 if the working state of the video transmission link and the working state of the image display module are normal; otherwise, executing S4;

s2, judging the state of the video data stream, and if the state is normal, executing S3; otherwise, executing S4;

s3, judging that the electronic rearview mirror image is free of clamping stagnation;

s4, judging that the electronic rearview mirror image is stuck; wherein the method comprises the steps of

The method for determining the video data stream state in S2 may be the method for determining the video data stream state as described above, and will not be described herein.

In this embodiment, the latter two are selected from the video data stream state, the video transmission link working state and the image display module working state for preferential judgment, and because the latter two do not need an algorithm, only the active and passive acquisition states are needed by software, and the method is simple, fast and effective. On the premise that the two are normal, the state of the video data stream is judged, at the moment, different time nodes of the video stream are extracted, and the current vehicle speed information (the premise that the CMS system can acquire the vehicle speed information) is combined to compare the difference between the extracted image data, so that whether the video data stream is normal or not can be accurately judged according to the difference result. In addition, in the comparison process, the selected area is generally a smaller pixel area, and the calculation amount can be reduced while the judgment accuracy is met through a difference value hash algorithm. In addition, when fewer states are selected for judgment, higher processing speed can be ensured, so that image clamping stagnation of the electronic rearview mirror can be found in time, and the occurrence of accident potential is reduced. And the reality of the difference value can be improved by updating the image local area in time after the angle of the rearview mirror is adjusted by the user.

In this embodiment, optionally, the working state of the video transmission link includes whether the camera is normal, whether the image transmission line bundle is normal, and the like, and the normal state and the abnormal state can be fed back through the hardware I/O state, and the main control system or the processing module can acquire the I/O state in real time through a software callback mode, so as to determine the working state of the video transmission link; to meet the robustness principle, the manner in which I/O states are actively acquired (every 200ms interval) may be generally combined.

In this embodiment, optionally, the working state of the image display module is generally a display screen working state, the normal state and the abnormal state can be fed back through the I/O state of the hardware of the display screen, and the main control system or the processing module can acquire the I/O state in real time through a software callback or the like, so as to determine the connection state of the video transmission link. To meet the robustness principle, the manner in which I/O states are actively acquired (every 200ms interval) may be generally combined.

On the basis of the above embodiment, this embodiment further provides an electronic rearview mirror image clamping stagnation detecting device, including: comprising a memory and a processor; the processor is configured to execute computer instructions stored in the memory to implement the electronic rearview mirror image stuck determination method as described above.

As shown in fig. 2, on the basis of the above embodiment, this embodiment provides an electronic rear view mirror system, including: the camera and the host; the camera comprises an image sensing module and an image coding and transmitting module; the host includes: the device comprises an image decoding and receiving module, an image capturing module, a data buffer area module, an image display module, a first image data sampling module, a second image data sampling module and a processing module; the image decoding and receiving module is used for decoding the image data in the coding format transmitted by the camera and outputting the image data to the image capturing module; the image capturing module is used for outputting the received image data to the data buffer area module; the image display module is used for displaying and outputting the image data in the data buffer area module and outputting state feedback information to the main control processing unit; the first image data sampling module and the second image data sampling module are used for respectively extracting first frame image data from the image capturing module and second frame image data from the image display module at intervals of a preset time; the processing module is suitable for judging whether the electronic rearview mirror image is jammed or not by adopting the electronic rearview mirror image jamming judging method.

In this embodiment, optionally, the first image data sampling module may backup the designated area aeroa (x, y, w, h) of a frame of video image data of the image capturing module to the designated data buffer according to the trigger instruction of the processing module. Wherein x, y represents the starting point coordinates of the backup data, w represents the pixel width of the backup data, and h represents the pixel height of the backup data. The second image data sampling module may backup the designated area aaera (x, y, w, h) of the video image data of the current frame of the image display module to the designated data buffer according to the trigger instruction of the processing module.

On the basis of the above embodiment, the present embodiment provides a method for calculating a correction difference value of image data, including:

X＝W*(1+p)；

p＝0.8-v*0.4％，v∈[0,175)；

p＝0.1,v≥175；

wherein X is a corrected difference value; w is the initial difference value of the color and/or brightness of the first frame image data and the second frame image data; p is a vehicle speed correction coefficient; v is the real-time vehicle speed in km/h.

In this embodiment, the clamping stagnation phenomenon occurring in the electronic rearview mirror image may give an early warning to the customer.

In summary, the method for judging the image clamping stagnation of the electronic rearview mirror selects the video data stream state, the video transmission link working state and the image display module working state to judge preferentially, and the two states do not need an algorithm and only need to be obtained by actively adding passive software, so that the method is simple, quick and effective. On the premise that the two are normal, the state of the video data stream is judged, at the moment, different time nodes of the video stream are extracted, and the current vehicle speed information (the premise that the CMS system can acquire the vehicle speed information) is combined to compare the difference between the extracted image data, so that whether the video data stream is normal or not can be accurately judged according to the difference result. In addition, in the comparison process, the selected area is generally a smaller pixel area, and the calculation amount can be reduced while the judgment accuracy is met through a difference value hash algorithm. In addition, when fewer states are selected for judgment, higher processing speed can be ensured, so that image clamping stagnation of the electronic rearview mirror can be found in time, and the occurrence of accident potential is reduced. And the reality of the difference value can be improved by updating the image local area in time after the angle of the rearview mirror is adjusted by the user.

In the several embodiments provided in this application, it should be understood that the described apparatus and methods may be implemented in other ways. The apparatus embodiments described above are merely illustrative, for example, of the flowcharts and block diagrams in the figures that illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

In addition, functional modules in the embodiments of the present invention may be integrated together to form a single part, or each module may exist alone, or two or more modules may be integrated to form a single part.

The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

With the above-described preferred embodiments according to the present invention as an illustration, the above-described descriptions can be used by persons skilled in the relevant art to make various changes and modifications without departing from the scope of the technical idea of the present invention. The technical scope of the present invention is not limited to the description, but must be determined according to the scope of claims.

Claims (10)

1. A method for determining a status of a video data stream, applied to an electronic rearview mirror system, comprising:

extracting first frame image data from the image capturing module and second frame image data from the image display module respectively at intervals of a preset time;

calculating a corrected difference value of color and/or brightness of the first frame image data and the second frame image data;

when the corrected difference value of at least one of the color and/or the brightness is greater than the difference threshold value, judging that the video data stream state is normal, otherwise, judging that the video data stream state is abnormal; wherein the method comprises the steps of

The calculation method of the correction difference value comprises the following steps:

X＝W*(1+p)；

p＝0.8-v*0.4％，v∈[0,175)；

p＝0.1,v≥175；

wherein X is a corrected difference value; w is the initial difference value of the color and/or brightness of the first frame image data and the second frame image data; p is a vehicle speed correction coefficient; v is the real-time vehicle speed in km/h.

2. The method for determining the status of a video data stream according to claim 1, wherein,

the electronic rearview mirror system comprises a camera and a host; wherein the method comprises the steps of

The camera comprises an image sensing module and an image coding and transmitting module; and

the host includes: the device comprises an image decoding and receiving module, an image capturing module, a data buffer area module and an image display module; the image decoding and receiving module is used for decoding the image data in the coding format transmitted by the camera and outputting the image data to the image capturing module; the image capturing module is used for outputting the received image data to the data buffer area module; the image display module is used for displaying and outputting the image data in the data buffer area module.

3. The method for determining the status of a video data stream according to claim 1, wherein,

the initial difference value is the difference value of the local area of the image;

the image local area is: taking an area outside the center of the image in the horizontal direction, wherein the width is 1/3-1/2 of the width of the whole image; the region with the center of the image down is taken in the vertical direction.

4. The method for determining the status of a video data stream according to claim 3,

the method further comprises the steps of, before extracting the first frame of image data from the image capturing module and the second frame of image data from the image display module:

after the user adjusts the mirror angle, the image center is updated.

5. A video data stream status determination system, comprising:

the first image data sampling module and the second image data sampling module are used for respectively extracting first frame image data from the image capturing module and second frame image data from the image display module at intervals of a preset time;

the correction difference value calculation module is used for calculating the correction difference value of the color and/or brightness of the first frame image data and the second frame image data;

and the state judging module judges the state of the video data stream to be normal when the corrected difference value of the color or the brightness is larger than the difference threshold value, and otherwise, the state of the video data stream is abnormal.

6. The video data stream status determination system of claim 5, further comprising:

the image center updating module is used for updating the image center after the angle of the rearview mirror is adjusted by a user;

the first image data sampling module and the second image data sampling module are adapted to sample after an update of the image center.

7. The method for judging the image clamping stagnation of the electronic rearview mirror is characterized by comprising the following steps of:

s1, judging the working state of a video transmission link and the working state of an image display module, and executing S2 if the working state of the video transmission link and the working state of the image display module are normal; otherwise, executing S4;

s2, judging the state of the video data stream, and if the state is normal, executing S3; otherwise, executing S4;

s3, judging that the electronic rearview mirror image is free of clamping stagnation;

s4, judging that the electronic rearview mirror image is stuck; wherein the method comprises the steps of

The video data stream state judgment in S2 adopts the video data stream state judgment method according to any one of claims 1 to 4.

8. An electronic rearview mirror image clamping stagnation detection device is characterized by comprising:

comprising a memory and a processor;

the processor is configured to execute computer instructions stored in the memory to implement the electronic rear view mirror image sticking judgment method according to claim 7.

9. An electronic rearview mirror system, comprising:

the camera and the host; wherein the method comprises the steps of

The camera comprises an image sensing module and an image coding and transmitting module; and

the host includes: the device comprises an image decoding and receiving module, an image capturing module, a data buffer area module, an image display module, a first image data sampling module, a second image data sampling module and a processing module; wherein the method comprises the steps of

The image decoding and receiving module is used for decoding the image data in the coding format transmitted by the camera and outputting the image data to the image capturing module;

the image capturing module is used for outputting the received image data to the data buffer area module;

the image display module is used for displaying and outputting the image data in the data buffer area module;

the first image data sampling module and the second image data sampling module are used for respectively extracting first frame image data from the image capturing module and second frame image data from the image display module at intervals of a preset time;

the processing module is suitable for judging whether the electronic rearview mirror image is jammed or not by adopting the electronic rearview mirror image jamming judging method as claimed in claim 7.

10. A method for calculating a corrected difference value of image data, comprising:

X＝W*(1+p)；

p＝0.8-v*0.4％，v∈[0,175)；

p＝0.1,v≥175；

wherein X is a corrected difference value; w is the initial difference value of the color and/or brightness of the first frame image data and the second frame image data; p is a vehicle speed correction coefficient; v is the real-time vehicle speed in km/h.

Images