CN112242045A

CN112242045A - Fault alarm method and device

Info

Publication number: CN112242045A
Application number: CN202011501270.2A
Authority: CN
Inventors: 沈斌; 陈逸民
Original assignee: Ningbo View Control Automotive Electronics Co ltd
Current assignee: Ningbo View Control Automotive Electronics Co ltd
Priority date: 2020-12-18
Filing date: 2020-12-18
Publication date: 2021-01-19

Abstract

The application relates to a fault alarm method and a fault alarm device, wherein the fault alarm method comprises the following steps: the camera module collects real-time image data of a preset direction of the vehicle based on an image collection instruction and sends the real-time image data to the control module; the control module divides the image frames of the real-time image data and the image frames of the historical image data into a plurality of regions with the same number and compares the regions; if one or more regional pictures in the image frames of the real-time image data and the historical image data are the same, fault detection is carried out on the vehicle, a control instruction is generated based on a fault detection result, and the control instruction is sent to an alarm module; and the alarm module acquires the control instruction and sends alarm information based on the control instruction. Through the method and the device, the problem of how to identify the vehicle-mounted camera to be shielded by the stain is solved, and the technical effect of automatic alarm when the vehicle-mounted camera is shielded by the stain is realized.

Description

Fault alarm method and device

Technical Field

The application relates to the field of vehicle fault detection, in particular to a fault alarm method and device.

Background

With the development of the automobile industry, the interior rearview mirror is developed from the original traditional rearview mirror to the current streaming media rearview mirror. The streaming media rearview mirror shoots a picture behind a vehicle in real time through a camera arranged behind the vehicle, and the picture is displayed on a display screen of the rearview mirror in the vehicle without damage and delay, namely the real situation behind the vehicle is observed according to the visual angle of the camera. Therefore, partial shielding of the back seat headrest, the back passenger or other objects in the tail of the vehicle to the rear view of the driver can be eliminated.

However, since the rear camera of the streaming media rearview mirror is located outside the vehicle, if dirt such as muddy water is encountered during driving, the camera is shielded, so that the rearview mirror is blinded, and potential safety hazard exists. At present, no effective solution is provided for the problem of identifying the dirt shielding of the vehicle-mounted camera.

Disclosure of Invention

The embodiment of the application provides a fault alarm method and device, and aims to at least solve the problem that a vehicle-mounted camera is covered by dirt in the related art.

In a first aspect, an embodiment of the present application provides a fault alarm method, including:

the camera module collects real-time image data of a preset direction of the vehicle based on an image collection instruction and sends the real-time image data to the control module;

the control module divides the image frames of the real-time image data and the image frames of the historical image data into a plurality of areas with the same number and compares the areas, wherein the historical image data is image data acquired at the past moment;

if one or more regional pictures in the image frames of the real-time image data and the historical image data are the same, fault detection is carried out on the vehicle, a control instruction is generated based on a fault detection result, and the control instruction is sent to an alarm module;

and the alarm module acquires the control instruction and sends alarm information based on the control instruction.

In one embodiment, the camera module acquires real-time image data of a preset direction of the vehicle based on an image acquisition instruction, and after the real-time image data is sent to the control module, the method includes: the control module sends the real-time image data to the display module; the display module displays the real-time image data.

In one embodiment, the display module comprises a streaming media rearview mirror.

In one embodiment, the fault detection comprises: one or more of display screen temperature diagnosis, IEM voltage diagnosis, DVR voltage diagnosis, IEM connection diagnosis, front camera connection diagnosis, rear camera connection diagnosis, and SD anomaly diagnosis.

In one embodiment, after the fault detection of the vehicle, the method further includes: and if the vehicle fault is not detected by the fault detection, judging that the shielding object exists in the vehicle-mounted camera equipment.

In one embodiment, before the displaying module displays the real-time image data, the method further includes: acquiring a first adjusting signal; the reflectivity of the streaming media rearview mirror is adjusted based on the first adjusting signal.

In one embodiment, the adjusting the reflectivity of the streaming media rearview mirror based on the first adjustment signal comprises: if the first adjusting signal is at a low level, adjusting the reflectivity of the streaming media rearview mirror according to the ambient light intensity and the preset light intensity; and if the first adjusting signal is at a high level, adjusting the reflectivity of the streaming media rearview mirror to a preset reflectivity.

In one embodiment, the control module establishes communication with an automobile control system and sends a fault detection result to the automobile control system, wherein the communication mode comprises one or more of a serial bus, an ethernet and a controller area network.

In one embodiment, the fault alarm method further comprises: and the control module receives the online upgrading signal and downloads an updating program according to the online upgrading signal to perform online upgrading.

In a second aspect, an embodiment of the present application provides a fault alarm device, including camera module, control module and alarm module that connect gradually, wherein:

the camera module is used for acquiring real-time image data in a preset direction of the vehicle based on an image acquisition instruction and sending the real-time image data to the control module;

the control module is used for dividing the image frames of the real-time image data and the image frames of the historical image data into a plurality of regions with the same quantity and comparing the regions, wherein the historical image data is image data acquired at the past moment; if one or more regional pictures in the image frames of the real-time image data and the historical image data are the same, fault detection is carried out on the vehicle, a control instruction is generated based on a fault detection result, and the control instruction is sent to an alarm module;

and the alarm module is used for sending alarm information based on the control instruction.

Compared with the prior art, the fault alarm method provided by the embodiment of the application acquires real-time image data of a preset direction of a vehicle based on an image acquisition instruction through the camera module, and sends the real-time image data to the control module; the control module divides the image frames of the real-time image data and the image frames of the historical image data into a plurality of areas with the same number and compares the areas, wherein the historical image data is image data acquired at the past moment; if one or more regional pictures in the image frames of the real-time image data and the historical image data are the same, fault detection is carried out on the vehicle, a control instruction is generated based on a fault detection result, and the control instruction is sent to an alarm module; the alarm module acquires the control instruction and sends alarm information based on the control instruction, so that the problem of how to identify the vehicle-mounted camera to be shielded by stains is solved, and the technical effect of automatic alarm when the vehicle-mounted camera is shielded by stains is achieved.

The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below to provide a more thorough understanding of the application.

Drawings

The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:

FIG. 1 is a flow chart of a fault alerting method of an embodiment of the present application;

fig. 2 is a block diagram of a streaming media rearview mirror control system according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a streaming media rearview mirror control system according to another embodiment of the present application;

fig. 4 is a block diagram of a configuration of a malfunction warning apparatus according to an embodiment of the present application.

Description of the drawings: 31. a rearview camera; 32. a controller; 33. a streaming media rearview mirror; 34. an automobile.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments provided in the present application without any inventive step are within the scope of protection of the present application.

It is obvious that the drawings in the following description are only examples or embodiments of the present application, and that it is also possible for a person skilled in the art to apply the present application to other similar contexts on the basis of these drawings without inventive effort. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.

Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of ordinary skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments without conflict.

Unless defined otherwise, technical or scientific terms referred to herein shall have the ordinary meaning as understood by those of ordinary skill in the art to which this application belongs. Reference to "a," "an," "the," and similar words throughout this application are not to be construed as limiting in number, and may refer to the singular or the plural. The present application is directed to the use of the terms "including," "comprising," "having," and any variations thereof, which are intended to cover non-exclusive inclusions; for example, a process, method, system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to the listed steps or elements, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Reference to "connected," "coupled," and the like in this application is not intended to be limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The term "plurality" as referred to herein means two or more. "and/or" describes an association relationship of associated objects, meaning that three relationships may exist, for example, "A and/or B" may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. Reference herein to the terms "first," "second," "third," and the like, are merely to distinguish similar objects and do not denote a particular ordering for the objects.

The streaming media rearview mirror shoots a picture behind a vehicle in real time through a camera behind the vehicle and displays the picture on a central rearview mirror display screen without damage or delay. Namely, the real situation behind the vehicle is observed from the visual angle of the camera. Because the stream media rear-view mirror sees through the picture of camera direct shooting vehicle rear, so the field of vision that its presented is wider, the picture is also more directly perceived, just so can very big reduction vision blind area, promote the security of driving. In addition, when the vehicle is driven at night, the extremely strong night vision capability of the streaming media camera can play a great role, so that a driver can clearly observe the traffic flow situation behind the vehicle when driving at night. However, the conventional streaming media rearview mirror has the defects of fear of dirt and distortion. The rear camera of the existing streaming media rearview mirror is positioned on the outer side of a vehicle, and if dirt such as muddy water and the like is encountered in the driving process, the camera can be shielded, so that the 'blindness' phenomenon of the rearview mirror is caused, and certain potential safety hazards exist. The imaging distortion of the streaming media camera is large, which easily causes the misjudgment of the vehicle distance by the driver and even causes the vertigo. The existing streaming media rearview mirrors are all independent systems at present, communication with an automobile is not established, when the streaming media rearview mirror control system makes an error, the control system cannot report the error to the automobile control system to give feedback, and online upgrading cannot be realized.

The embodiment also provides a fault alarm method. Fig. 1 is a flowchart of a fault alarm method according to an embodiment of the present application, and as shown in fig. 1, the flowchart includes the following steps:

and S101, acquiring real-time image data of a preset direction of the vehicle by the camera module based on an image acquisition instruction, and sending the real-time image data to the control module.

Specifically, the camera module adopts a vehicle-scale high-definition camera, and has a pixel resolution of more than 200 ten thousand and a dynamic picture of 60 frames. The camera collects real-time road conditions near the vehicle based on the acquired image collection instruction, and in one embodiment, the camera is arranged behind the vehicle and collects an environment image behind the vehicle.

In one embodiment, the camera module acquires real-time image data of a preset direction of the vehicle based on an image acquisition instruction, and after the real-time image data is sent to the control module, the method includes: the control module sends the real-time image data to the display module; the display module displays the real-time image data. Specifically, the camera module adopts a vehicle-level high-definition camera, and the display module is used for displaying image information acquired by the camera. The camera collects the environmental information near the vehicle according to the image collection instruction of the control module, and transmits the image data with the environmental information near the vehicle to the control module in real time, and the control module is installed in the ornament in the vehicle. The control signal displays the image data transmitted by the camera on the display module.

In one embodiment, the display module comprises a streaming media rearview mirror. Specifically, when the display module is a streaming media rearview mirror, the camera module may be preferably a vehicle-scale high-definition camera, or may be other camera sensor assemblies, which is not limited in the present invention. The control module, the vehicle camera assembly and the streaming media rearview mirror form a streaming media rearview mirror control system.

Step S102, the control module divides the image frames of the real-time image data and the image frames of the historical image data into a plurality of regions with the same number and compares the regions.

Specifically, the historical image data is image data acquired at a past time. When the camera acquires real-time image data containing environment and road condition information around the vehicle, the real-time image data is stored to a designated storage position at intervals, for example, an image acquired by the camera is stored to an SD card of the control module every 1 second. The image data stored in the storage location is referred to as history image data. Image frames of real-time image data and image frames of historical image data are acquired. And dividing the image frame of the real-time image data and the image frame of the historical image data into a plurality of areas of the same data for comparison. For example: dividing an image frame of real-time image data into four regions according to the shape of a field character grid, wherein the four regions comprise a region A, a region B, a region C and a region D; the image frame of the history image data is divided into four regions including a region 1, a region 2, a region 3, and a region 4 in the shape of a grid of "tian". Compare region a to region 1, region B to region 2, region C to region 3, and region D to region 4. In one embodiment, the real-time image data may be compared with a plurality of image frames of the historical image data stored in the storage location and closest in storage time.

And step S103, if one or more regional pictures in the image frames of the real-time image data and the historical image data are the same, performing fault detection on the vehicle, generating a control instruction based on a fault detection result, and sending the control instruction to an alarm module.

Specifically, a comparison condition is set in the control module in advance, for example: if the image frame of the real-time image data is the same as the image frame of the historical image data in one area, and the images of other areas are different, it is determined that the related components of the camera are possibly in fault or the camera lens is shielded by muddy water. And carrying out fault detection on the vehicle, generating a control instruction according to a detection result, and controlling an alarm module to send alarm information.

In one embodiment, if a plurality of pictures in the image frame of the real-time image data and the image frame of the historical image data are the same, the fault detection is carried out on the vehicle. For example: dividing an image frame of real-time image data into four regions according to the shape of a field character grid, wherein the four regions comprise a region A, a region B, a region C and a region D; the image frame of the history image data is divided into four regions including a region 1, a region 2, a region 3, and a region 4 in the shape of a grid of "tian". Compare region a to region 1, region B to region 2, region C to region 3, and region D to region 4. If the pictures of the area 2 and the area B are the same, the picture of the area 3 and the area C are the same, and the pictures of other areas are different, it is determined that related components of the camera may have a fault or the camera lens is shielded by muddy water. And carrying out fault detection on the vehicle, generating a control instruction according to a detection result, and controlling an alarm module to send alarm information.

In one embodiment, an image similarity calculation module may also be provided. The module is internally provided with an image similarity algorithm which can calculate the similarity between the image frame of the real-time image data and the image frame of the historical image data. For example: dividing an image frame of real-time image data into four regions according to the shape of a field character grid, wherein the four regions comprise a region A, a region B, a region C and a region D; the image frame of the history image data is divided into four regions including a region 1, a region 2, a region 3, and a region 4 in the shape of a grid of "tian". Compare region a to region 1, region B to region 2, region C to region 3, and region D to region 4. The similarity threshold value can be set according to the actual application condition; if the image similarity of the area B and the area 2 reaches the similarity threshold, the image similarity of the area C and the area 3 reaches the similarity threshold; if the picture of the area B is the same as that of the area 2, the picture of the area C is the same as that of the area 3, and the pictures of other areas are different, it is determined that a fault may occur in a related component of the camera or the camera lens is shielded by muddy water. And carrying out fault detection on the vehicle, generating a control instruction according to a detection result, and controlling an alarm module to send alarm information.

In one embodiment, the comparison between the picture frame of the real-time image data and the picture frames of the plurality of copies of the historical image data can be further set. For example: dividing an image frame of real-time image data into four regions according to the shape of a field character grid, wherein the four regions comprise a region A, a region B, a region C and a region D; dividing an image frame of the first historical image data into four regions according to the shape of a grid of a field, wherein the four regions comprise a region 1, a region 2, a region 3 and a region 4; the image frame of the second history image data is divided into four regions including a region a, a region b, a region c, and a region d in the shape of a grid of "tian". Comparing the image pictures of the area A, the area 1 and the area a, comparing the image pictures of the area B, the area 2 and the area B, comparing the image pictures of the area C, the area 3 and the area C, and comparing the image pictures of the area D, the area 4 and the area D; if the area A is the same as the picture of the area 1 and the area A is the same as the picture of the area a; and if the image frames of the real-time image data are different from the images of other corresponding areas of the image frames of the first historical image data and the second historical image data, it is determined that a fault may occur in a related component of the camera or the camera lens is shielded by muddy water. And carrying out fault detection on the vehicle, generating a control instruction according to a detection result, and controlling an alarm module to send alarm information.

In one embodiment, the fault detection comprises: one or more of display screen temperature diagnosis, IEM voltage diagnosis, DVR voltage diagnosis, IEM connection diagnosis, front camera connection diagnosis, rear camera connection diagnosis, and SD anomaly diagnosis. Specifically, the fault detection may be performed by generating a detection signal by the control module; or the control module can be communicated with the automobile control system, the control module generates a detection signal and sends the detection signal to the automobile control system, and the automobile control system carries out fault detection. The fault detection performed also includes, but is not limited to, the above-described display screen temperature diagnosis, IEM voltage diagnosis, DVR voltage diagnosis, IEM connection diagnosis, front camera connection diagnosis, rear camera connection diagnosis, and SD abnormality diagnosis. The Intelligent Energy Management function can provide road condition and environment information according to navigation and the like, intelligently selects the most suitable power system operation mode and Energy recovery intensity, optimizes the efficiency of the whole travel system to the maximum extent, and improves the driving experience. A DVR (Digital Video Recorder, DVR for short) is a set of computer systems for storing and processing images and has the functions of recording images/voices for a long time, recording, remotely monitoring and controlling. SD memory card is a memory device based on semiconductor flash memory.

In one embodiment, the display screen temperature diagnosis includes: the NCT resistor, i.e. the thermistor, has a characteristic that a resistance value changes according to a temperature change, and the NCT resistor is arranged at a place close to an LCD (Liquid Crystal Display) screen, and the screen may also be an OLED (Organic Light-Emitting Diode) screen, which is not limited in this respect; when the temperature of the LCD screen rises, the resistance value of the NCT resistor changes correspondingly, the voltage of a related circuit changes synchronously, then corresponding data can be acquired by an ADC (analog-to-digital converter), and different screen temperatures can be acquired according to different data. Preferably, in order to improve the accuracy of the obtained LCD screen temperature, the relationship between the voltage and the screen temperature may be precisely calibrated in advance, a voltage-screen temperature correspondence table is established, the program may obtain a relatively precise LCD screen temperature by querying the table in the running process, and finally the data is transmitted to the control module to determine whether the temperature of the display screen is abnormal.

In one embodiment, the IEM voltage diagnostics include: the voltage of the IEM power supply circuit is obtained by the ADC device, and whether the voltage of the IEM is in a normal range or not is judged according to the obtained data, so that whether the voltage is abnormal or not is judged.

In one embodiment, DVR voltage diagnostics includes: the ADC device is used for obtaining the voltage of the DVR power supply circuit, and the control module judges whether the voltage of the DVR is in a normal range or not according to the obtained data, so that whether the voltage is abnormal or not is judged.

In one embodiment, the IEM connection diagnostics include: the DVR end and the IEM end are designed with a heartbeat packet through I2C communication, when the data packet sent to the IEM end by the DVR end does not receive the feedback of the IEM end, the IEM is considered to be disconnected, and the IEM is diagnosed to be disconnected. I2C refers to I2C bus, which is a bidirectional two-wire synchronous serial bus.

In one embodiment, the front camera connection diagnosis comprises: the front camera is connected with the system through a decoding chip. Under normal conditions, the front-facing camera continuously initiates an IRQ (Interrupt ReQuest) ReQuest to the control module through the decoding chip to ReQuest the control module to process the video data transmitted by the camera. When the connection of the front camera is in a problem, the IRQ request is interrupted, and whether the connection of the front camera is normal can be diagnosed by judging whether the IRQ request is interrupted. The role of the IRQ request is: when the hardware interface device starts or finishes receiving and sending information and needs the CPU to process information operation, it will send out interrupt request signal to CPU through IRQ to let CPU store the ongoing work and then suspend the ongoing work to process the demand of peripheral hardware in advance, which is the effect of interrupt request.

In one embodiment, the rear camera connection diagnosis includes: the rear camera is connected with the control system through a decoding chip. Under normal conditions, the rear camera continuously sends an IRQ request to the control module through the decoding chip so as to request the system to process the video data transmitted by the camera. When the connection of the rear camera is in a problem, the IRQ request is interrupted, and whether the connection of the rear camera is normal can be diagnosed by judging whether the IRQ request is interrupted.

In one embodiment, the SD anomaly diagnosis includes: under normal conditions, the control module continuously scans the state of the SD card to determine whether the SD card is available, but when the control module detects that the SD card is unavailable, the control module considers that the SD card is abnormal.

And step S104, the alarm module acquires the control instruction and sends alarm information based on the control instruction.

Specifically, the alarm information may be a voice alarm or an alarm bell.

In one embodiment, before the displaying module displays the real-time image data, the method further includes: acquiring a first adjusting signal; the reflectivity of the streaming media rearview mirror is adjusted based on the first adjusting signal. Specifically, in the streaming media rearview mirror control system, the control module can control the inner and outer anti-glare lenses of the streaming media rearview mirror according to the difference value between the ambient light and the glare, so as to achieve the anti-glare function.

In one embodiment, the adjusting the reflectivity of the streaming media rearview mirror based on the first adjustment signal comprises: if the first adjusting signal is at a low level, adjusting the reflectivity of the streaming media rearview mirror according to the ambient light intensity and the preset light intensity; and if the first adjusting signal is at a high level, adjusting the reflectivity of the streaming media rearview mirror to a preset reflectivity. Specifically, in the present embodiment, the streaming media rearview mirror adopts an EC lens, that is, electrochromic anti-glare glass. And acquiring a first adjusting signal, and if the first adjusting signal is at a low level, disabling the signal for starting the EC mirror, namely the function of the EC mirror is in an automatic state, namely an Auto state. Acquiring the current light intensity of ambient light, if the light intensity of the ambient light is less than a preset value for starting the automatic color changing function of the EC mirror, the automatic color changing function of the EC mirror is not started, and the streaming media rearview mirror keeps the current reflectivity state of the lens; if the light intensity of the ambient light is larger than or equal to the preset value for starting the automatic color changing function of the EC mirror, the automatic color changing function of the EC mirror is started, the EC mirror driving circuit starts to work, and the surface of the streaming media rearview mirror is in a low-reflectivity state, namely a dark color state. If the first adjusting signal is at a high level, the automatic color changing function of the EC mirror is in a quick recovery state, and if the surface of the current streaming media rearview mirror is in a low reflectivity state, the reflectivity is quickly recovered to the preset reflectivity.

In one embodiment, the streaming media rearview mirror is further provided with a screen display function and a screen switch function. The screen display function means that the streaming media rearview mirror is provided with a display screen, so that a real picture transmitted by the camera can be displayed in a high-definition and undistorted manner, and the display screen is preferably a display screen with 200 ten thousand pixels. The screen switching function means that the display device of the streaming media rearview mirror can control the on/off of the screen based on a button, a touch screen, a remote control and the like.

In one embodiment, the control module establishes communication with an automobile control system and sends a fault detection result to the automobile control system, wherein the communication mode comprises one or more of a serial bus, an ethernet and a controller area network. Specifically, the signal communication between the control module and the vehicle control system may be realized by a USB (serial bus), an ethernet, a CAN (controller area network) signal, or the like. Signals that the control module communicates with the vehicle control system include, but are not limited to: system diagnostic signals, streaming media rearview mirror operation signals, online upgrade signals and the like.

The system diagnosis signal is used for transmitting a fault detection result to the automobile control system by the control module. In one embodiment, the diagnostic signal comprises the following: bit0=1 indicates IEM voltage too low, Bit1=1 indicates IEM voltage too high, Bit2=1 indicates screen temperature too high, Bit3=1 indicates screen display abnormality, Bit 4-7 is reserved for transmitting other fault signals, Bit8=1 indicates DVR voltage too low, Bit9=1 indicates DVR voltage too high, Bit10=1 indicates IEM connection abnormality, Bit11=1 indicates front camera connection abnormality, Bit12=1 indicates rear camera connection abnormality, Bit13=1 indicates SD abnormality, and Bit 14-21 is reserved for other diagnostic signals. The control module in this embodiment can drive camera assemblies of different brands and specifications. Along with the upgrading of the specification of the rearview camera, the control module is not required to be replaced, the control module can automatically identify the chip signal of the rearview camera component and automatically match corresponding functional software to realize the corresponding function of the streaming media rearview mirror, and therefore the technical effect of reducing cost waste is achieved.

In one embodiment, the fault alarm method further comprises: and the control module receives the online upgrading signal and downloads an updating program according to the online upgrading signal to perform online upgrading. Specifically, the control module can perform OTA online upgrade through the vehicle control system. OTA (Over-the-Air Technology ) is a Technology for remotely managing SIM card data and applications through an Air interface of mobile communication (GSM or CDMA) on a mobile phone, and particularly, in the field of automobiles, on-line updating and upgrading of a system is realized. The automobile is provided with a gateway of the networking module, so that the automobile can realize functions of uploading, downloading, code updating and the like by software and hardware capable of carrying out data transmission. Further, in this embodiment, the step of the control module upgrading the controller software through the vehicle system includes: starting the FTP-server by the automobile system, and storing the software upgrading packet into an OTA directory of the FTP main directory; wherein, the software upgrading package is the OTA full package; inputting: h &/usr/local/share/script/update; after the upgrade is finished, the streaming media rearview mirror control system terminal corresponding to the control module can be automatically restarted; the overall process of OTA upgrade by the control module takes approximately 5 minutes.

In one embodiment, the failure warning method corresponds to a streaming media rearview mirror control system, fig. 2 is a block diagram of a structure of the streaming media rearview mirror control system according to the embodiment of the present application, and as shown in fig. 2, the streaming media rearview mirror control system specifically includes: the system comprises a rearview camera component, a controller component and a streaming media rearview mirror component; the controller assembly establishes a connection with the vehicle control system. Fig. 3 is a schematic structural diagram of a streaming media rearview mirror control system according to another embodiment of the present application, and as shown in fig. 3, the system includes a rearview camera 31, a controller 32 and a streaming media rearview mirror 33, the rearview camera 31 is connected to the controller 31 through a rearview camera signal line, the controller 31 is connected to the streaming media rearview mirror 33 through a streaming media rearview mirror signal line, and the controller 32 is connected to a car 34 through a car system communication signal line. The signal line of the rear-view camera, the signal line of the streaming media rear-view mirror and the communication signal line of the automobile system are preferably LVDS lines. LVDS (Low Voltage Differential Signaling), a data transmission and interface technology. The LVDS line has characteristics of low noise and low power consumption. The content of this controller subassembly and back vision camera subassembly, streaming media rear-view mirror subassembly and vehicle control system communication includes: the communication content comprises the following contents: streaming media restore default settings, streaming media display mode settings, streaming media picture zoom settings, streaming media picture angle settings, streaming media backlight brightness settings, streaming media parameter acquisition, SD card partitioning and planning, SD card status checking, SD card information acquisition, SD card formatting, DVR restore factory settings, DVR video status, DVR parameter settings, DVR parameter acquisition, DVR time update, DVR time setting, DVR time acquisition, whether DVR secure area is full, DVR emergency photo, DVR emergency video status, DVR normal photo (proactive), DVR normal video (proactive), DVR set Preview function, DVR acquire Preview function, DVR delete NFS files, DVR enable settings, DVR watermark content settings, IEM/DVR fault notification, IEM start mode notification, IEM normal photo (post), IEM normal photo status (post), IEM normal video (post) TBD, IEM normal video status (post), and software version OTA upgrade.

Through the steps, whether the repeated regions with the same picture exist or not is identified by comparing the image frame of the real-time image data with the image frame of the historical image data, and if the repeated regions exist, fault detection is carried out. The fault detection can diagnose whether the camera module or the display module has internal faults or not; if the internal fault is not detected, the muddy water is considered to shield the camera and an alarm is given, so that the technical problem of how to identify that the muddy water shields the camera in the driving process is solved, and the technical effect of automatically giving an alarm when the vehicle-mounted camera is shielded by dirt is achieved. In addition, this application is through the difference of first adjustment signal and ambient light intensity and preset glare light intensity, and the anti-dazzle mesh function of the EC lens of control flow media rear-view mirror starts or closes to reach anti-dazzle mesh technological effect. Further, aiming at the condition that the streaming media rearview mirror and the automobile do not communicate in the prior art, the communication between the streaming media rearview mirror and the automobile system is realized through the modes of USB, Ethernet, CAN signals and the like; the control module of the streaming media rearview mirror can also realize online updating and upgrading through an automobile system.

It should be noted that the steps illustrated in the above-described flow diagrams or in the flow diagrams of the figures may be performed in a computer system, such as a set of computer-executable instructions, and that, although a logical order is illustrated in the flow diagrams, in some cases, the steps illustrated or described may be performed in an order different than here.

The present embodiment further provides a fault alarm device, which is used to implement the foregoing embodiments and preferred embodiments, and the description of the fault alarm device is omitted. As used hereinafter, the terms "module," "unit," "subunit," and the like may implement a combination of software and/or hardware for a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.

Fig. 4 is a block diagram of a fault alarm device according to an embodiment of the present application, and as shown in fig. 4, the device includes a camera module 10, a control module 20, and an alarm module 30, which are connected in sequence, wherein:

the camera module 10 is configured to acquire real-time image data of a preset direction of the vehicle based on an image acquisition instruction, and send the real-time image data to the control module;

the control module 20 is configured to divide and compare image frames of the real-time image data and image frames of historical image data into a plurality of regions of the same number, where the historical image data is image data acquired at a past time; if one or more regional pictures in the image frames of the real-time image data and the historical image data are the same, fault detection is carried out on the vehicle, a control instruction is generated based on a fault detection result, and the control instruction is sent to an alarm module;

and the alarm module 30 is configured to send alarm information based on the control instruction.

The above modules may be functional modules or program modules, and may be implemented by software or hardware. For a module implemented by hardware, the modules may be located in the same processor; or the modules can be respectively positioned in different processors in any combination.

The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. A method of fault alerting, comprising:

2. The fault alarm method according to claim 1, wherein the camera module collects real-time image data of a preset direction of the vehicle based on an image collection instruction, and the sending of the real-time image data to the control module comprises:

the control module sends the real-time image data to the display module;

the display module displays the real-time image data.

3. The malfunction alerting method of claim 2, wherein the display module comprises a streaming media rearview mirror.

4. The fault alerting method of claim 1, wherein the fault detection comprises: one or more of display screen temperature diagnosis, IEM voltage diagnosis, DVR voltage diagnosis, IEM connection diagnosis, front camera connection diagnosis, rear camera connection diagnosis, and SD anomaly diagnosis.

5. The malfunction alerting method of claim 1, further comprising, after the malfunction detecting the vehicle:

and if the vehicle fault is not detected by the fault detection, judging that the shielding object exists in the vehicle-mounted camera equipment.

6. The malfunction alerting method of claim 2, wherein before the displaying the real-time image data by the display module, further comprising:

acquiring a first adjusting signal;

the reflectivity of the streaming media rearview mirror is adjusted based on the first adjusting signal.

7. The fault alerting method of claim 6, wherein the adjusting the reflectivity of the streaming media rearview mirror based on the first adjustment signal comprises:

if the first adjusting signal is at a low level, adjusting the reflectivity of the streaming media rearview mirror according to the ambient light intensity and the preset light intensity;

and if the first adjusting signal is at a high level, adjusting the reflectivity of the streaming media rearview mirror to a preset reflectivity.

8. The method according to claim 1, wherein the control module establishes communication with a vehicle control system and sends the fault detection result to the vehicle control system, and the communication mode comprises one or more of a serial bus, an ethernet and a controller area network.

9. The fault alerting method of claim 8, further comprising:

and the control module receives the online upgrading signal and downloads an updating program according to the online upgrading signal to perform online upgrading.

10. The utility model provides a fault alarm device which characterized in that, including camera module, control module and the alarm module who connects gradually, wherein: