CN111157223B - Fault detection method, device and system - Google Patents

Fault detection method, device and system Download PDF

Info

Publication number
CN111157223B
CN111157223B CN201911418997.1A CN201911418997A CN111157223B CN 111157223 B CN111157223 B CN 111157223B CN 201911418997 A CN201911418997 A CN 201911418997A CN 111157223 B CN111157223 B CN 111157223B
Authority
CN
China
Prior art keywords
picture
picture message
message
sending
equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911418997.1A
Other languages
Chinese (zh)
Other versions
CN111157223A (en
Inventor
何敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201911418997.1A priority Critical patent/CN111157223B/en
Publication of CN111157223A publication Critical patent/CN111157223A/en
Application granted granted Critical
Publication of CN111157223B publication Critical patent/CN111157223B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M11/00Testing of optical apparatus; Testing structures by optical methods not otherwise provided for

Landscapes

  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Telephonic Communication Services (AREA)
  • Alarm Systems (AREA)

Abstract

A device fault detection technology is characterized in that when no service picture message is sent, picture message sending equipment sends an additional picture detection message to picture message receiving equipment, so that the sending frequency of the picture message is maintained, and the picture message sending equipment is prevented from sending no picture message for a long time. The picture message receiving equipment receives the picture message generated by the picture message sending equipment, and when the picture message receiving equipment does not receive the picture message within the preset time length, the picture message sending equipment is indicated to have a fault, and the picture message receiving equipment can send a fault alarm.

Description

Fault detection method, device and system
Technical Field
The invention relates to the field of computers, in particular to equipment fault detection.
Background
Video monitoring gradually develops from the traditional mode that the content of videos is taken as the main mode to the mode that the content of intelligent pictures is taken to better support business application. In the current intelligent era, a large number of intelligent snapshot pictures are generated by a front-end camera or a rear-end analysis platform, and the method is widely applied to public security, traffic and various industries.
However, how to find out whether the camera is working properly is a difficult problem for industry standards and industry manufacturers. One current practice is to establish a heartbeat (heartbeat) mechanism between a picture sender and a picture receiver, and the receiver can determine whether the sender is alive by detecting a heartbeat message. The heartbeat mechanism is applicable between most computer devices.
However, the heartbeat mechanism can only perform detection of less functions, such as: and detecting whether network channels of both communication parties are normal and whether a heartbeat sender is down. If the functions of the camera as a picture message generation device and related to the picture message are required to be detected to be normal, the existing heartbeat mechanism cannot be used.
Disclosure of Invention
In a first aspect, an embodiment of the present invention provides an apparatus fault detection method, where a picture packet receiving apparatus communicates with a picture packet sending apparatus, the method including: the picture message receiving equipment receives a first picture message sent by the picture message sending equipment; the picture message receiving equipment judges whether a second picture message sent by the picture message sending equipment is received within a first time period since the first picture message is received; and when the picture message receiving equipment does not receive the second picture message, the picture message receiving equipment sends out a fault alarm signal, wherein the second picture message is a detected picture message.
By applying the scheme, the picture message receiving equipment can find whether the function of the picture message transmitting equipment, which relates to the picture message, is in fault.
In a first possible implementation manner of the first aspect, the alarm signal is used to indicate a failure of a picture message generation function of the picture message sending apparatus. The alarm signal in the scheme further prompts the specific type of the fault.
In a second possible implementation manner of the first aspect, the picture detection packet is an RTP packet encapsulated by a TLV data structure, and the fault indicated by the alarm signal includes: the function of constructing the TLV data structure fails; or encapsulating the TLV data structure to the functional failure of the RTP message. The alarm signal in the scheme further prompts the specific type of the fault.
In a third possible implementation manner of the first aspect, the detecting picture message is an HTTP message encapsulated by a json data structure, and the fault indicated by the alarm signal includes: the function of constructing the json data structure fails; or encapsulating the json data structure to the function fault of the HTTP message. The alarm signal in the scheme further prompts the specific type of the fault.
In a fourth possible implementation manner of the first aspect, the picture message receiving device stores a service picture in the first picture message; and the picture message receiving equipment discards the data in the second picture message. The scheme does not store the content in the detected picture message, thereby saving the storage space.
In a fourth possible implementation manner of the first aspect, the picture message sending device sends the first picture message to the picture message receiving device; and when the time length for the picture message sending equipment to stop sending the service picture message reaches a second time length, the picture message sending equipment sends the fault detection message to the picture message receiving equipment, wherein the second time length is less than or equal to the first time length. The steps executed by the picture message sending equipment are introduced in the scheme.
In a second aspect, the present invention provides a fault detection apparatus comprising: the receiving module is used for receiving a first picture message sent by the message sending device; the processing module is used for judging whether a second picture message sent by the picture message sending equipment is received within a first time period since the first picture message is received; and the warning module is used for sending a fault warning signal when the judgment result of the processing module is that the second picture message is not received, wherein the second picture message is a detection picture message.
The second aspect has the similar possible implementation manners as the first aspect and various possible implementation manners of the first aspect, and has corresponding technical effects.
In a third aspect, an embodiment of an apparatus fault detection system is provided, where the apparatus fault detection system includes a picture message sending apparatus and a picture message receiving apparatus in communication with the picture message sending apparatus. The picture message sending device is used for: sending a service message carrying a service picture to the picture message receiving equipment; when the time length for stopping sending the service picture reaches a second time length, continuously sending a fault detection message to the picture message receiving equipment, wherein the time interval between the fault detection messages is less than the second time length; the picture message receiving device is used for: and receiving the picture messages sent by the picture message sending equipment, and sending an alarm signal by the picture message receiving equipment when the 2 picture messages are not received after the first time length is exceeded.
The third aspect has the similar possible implementation manners as the first aspect and various possible implementation manners of the first aspect, and has corresponding technical effects.
In a fourth aspect, an embodiment of a storage medium is provided, which includes computer instructions that, when executed on a picture message receiving apparatus, cause the picture message receiving apparatus to perform the method of the first aspect and each possible implementation manner of the first aspect.
The fourth aspect has the first aspect and possible implementations similar to the various possible implementations of the first aspect, and has corresponding technical effects.
In a fifth aspect, an embodiment of a computer program product, which is executable by a picture messaging apparatus, includes: the instruction is used for receiving a first picture message sent by picture message sending equipment; the instruction is used for judging whether a second picture message sent by the picture message sending equipment is received within a first time period since the first picture message is received; and the image message receiving equipment is used for sending a fault alarm signal when the second image message is not received, wherein the second image message is an instruction for detecting the image message.
The fifth aspect has the similar possible implementation manners as the first aspect and various possible implementation manners of the first aspect, and has corresponding technical effects.
In a sixth aspect, the present invention further provides an embodiment of a picture message receiving device, where the picture message receiving device includes a processor (optionally, a memory storing computer instructions may also be included), and the processor executes, by executing the computer instructions, the steps performed by the picture message receiving device in the foregoing first aspect.
Drawings
FIG. 1 is a topological diagram of an embodiment of an image monitoring system.
Fig. 2 is a flow chart of an embodiment of a camera fault detection method.
Fig. 3 is a schematic diagram of an embodiment of the TLV data structure of the present invention.
Fig. 4 is a schematic diagram of an embodiment of the TLV data structure of the present invention.
Fig. 5 is a schematic diagram of an embodiment of a TLV data structure of the present invention.
Fig. 6 is a schematic diagram of an embodiment of the TLV data structure of the present invention.
Fig. 7 is a flow chart of an embodiment of a method for device fault detection performed by a camera.
FIG. 8 is a flow chart of an embodiment of a method for device failure detection performed by a storage server.
Fig. 9 also provides a schematic diagram of an embodiment of a fault detection system.
Detailed Description
The image monitoring equipment is used in the fields of security protection and the like with strict requirements on time efficiency. Therefore, for an image monitoring system, if it can be detected that a video camera (which may also be a monitoring camera, and may be used for taking pictures) is normal in function, the user can intervene in time once the video camera is detected to be abnormal, which is a problem generally paid attention to in the industry.
Referring to the image monitoring system of fig. 1, the camera 111 and the camera 112 are each in communication with the storage server 12, and the storage server 12 is in communication with the image analysis server 14. The management server 13 is located between the camera 111 and the storage server 12, and is used for registration of the camera 111.
Taking the camera 111 as an example, in the embodiment of the present invention: when the camera 111 does not send a service picture message, the camera 111 constructs a detection picture message and sends the detection picture message to the storage server 12. The storage server 12 receives the detected picture message from the camera 111, and determines that the camera 111 has a failure if the picture message from the camera 111 is not received for more than a predetermined time. The type of the fault may be a picture message generation fault or a picture message sending fault, and after the fault of the camera 111 is known, the camera 111 can be intervened as soon as possible in time, for example, processing such as upgrading, restarting, and maintaining is performed.
Similarly, the method may be used between a storage server 12 and an image analysis server 14, with the image analysis server 14 detecting a failure of the storage server 12. Therefore, the embodiment of the present invention is not limited to such a combination of a camera and a storage server, and may be, for example, a combination of a camera and an image analysis device, a combination of an image storage device and an image analysis device, a combination of an image analysis device and an image analysis device, and a combination of an image storage device and an image storage device. In other words, embodiments of the invention may be broadly construed to be used for: and detecting the picture message generating/sending function of the picture message sending equipment by the picture message receiving equipment. When the picture message sending equipment does not send the service picture message to the picture message receiving equipment, the picture message sending equipment sends an additional picture detection message to the picture message receiving equipment, so that the sending frequency of the picture message is maintained, and the picture message sending equipment is prevented from sending out no picture message for a long time. The picture message receiving equipment judges whether the picture message sending equipment normally operates or not by detecting whether the next picture message is not received within the preset time duration or not after the previous message is received.
Referring to fig. 2, the following description will be made in detail by taking an example in which the picture message sending device is a camera and the picture message receiving device is a storage server.
21. The camera (camera) sends a registration message to a management server, and the management server registers the camera after receiving the registration message. And after the registration is successful, the management node informs the storage server of the information that the camera is on line. The registration information includes identification information of the camera, such as a camera ID, or a camera position.
The channel for communicating the registration message between the camera and the management server and between the management server and the storage server may be a dedicated management channel, which is not used for transmitting traffic data (e.g., pictures). The management server may be independent of the camera, the storage server, or may be integrated with one of the cameras and the storage server.
22. The storage server sends a picture (or picture message) request to the camera to request the camera to obtain a picture (or picture message).
23. And after receiving the picture request sent by the storage server, the camera sends a response message to the storage server. The response message carries: the method comprises the steps of sending a message confirmation instruction, detecting a picture message instruction and detecting a picture message sending period.
Wherein, the message sending confirmation instruction is used for informing the storage server that: the camera is ready to send picture messages.
And the instruction for detecting the picture message and the sending period of the detected picture message are used for negotiating with the storage server. The instruction for detecting the picture message is used for informing the storage server that: the camera supports the function of message sending function detection; therefore, the storage server can open the corresponding function, so as to detect whether the picture message generation function of the camera is normal. The message sending period is used for informing the storage server that: an extra message sending period supported by the camera (in this embodiment, this message sending period is set to 10 seconds).
24. And after receiving the response message, the storage server starts an equipment fault detection function so as to judge the time interval of the received message. And the storage server records the message sending period so as to detect whether the function of the camera is normal or not according to the sending period in the subsequent steps.
It should be noted that there are various ways to negotiate the message sending period. For example: (1) the camera sends a single time period for the storage server to record; (2) the camera sends a plurality of time periods for the storage server to select; (3) the storage server and the camera each transmit a time period that can be supported by themselves, with a third party device (e.g., the management server) arbitrating a period that is supported by both parties.
25. And the camera sends a service picture message to the storage server in a picture message mode. In the embodiment of the present invention, the camera shoots an object to generate a service picture, and the shot object may be a moving object, for example, one of the following objects: any moving object, vehicle, pedestrian, animal. And the shot pictures are sent to the storage server by the camera for persistent storage.
Pictures taken by the camera (pictures obtained through taking are referred to as service pictures for distinction from detection pictures) are first encoded in a TLV (type/tag, length, value) data structure. tag (or type) describes the data type of value, length describes the length of value, and the value carries data including service pictures, for example, one value includes 2 pictures, or another TLV data structure may be nested in the value. Fig. 3 is a schematic diagram of an embodiment of TLV data structure according to the present invention, wherein pictures are carried in value; the optional value may also carry a picture serial number, where the picture serial number describes the number of a picture sent by the camera, and the serial numbers of different pictures are also different. Optionally, the value may also carry the number of pictures (not shown).
The TLV data format is encapsulated as payload (payload) into a real-time transport protocol (RTP) message for network transmission. The RTP protocol is used to provide end-to-end streaming media transmission services for various multimedia data requiring real-time transmission, such as voice, image, fax, etc. The RTP packet includes: header (head), extension (extended), and payload (payload). The picture message is transmitted between the camera and the storage server in a media stream mode, and the camera sends pictures including a first picture and a second picture to the storage server through the media stream. The media stream used to transmit the pictures may also be referred to as a picture stream.
Similarly, the picture may be encoded into a json data format, and the json data format is encapsulated into an HTTP protocol message for transmission.
26. And when the time length for the camera to stop sending the service pictures reaches the message sending period, the specific picture starts to continuously send the detection picture message to the storage server, and the time interval between the detection messages is less than or equal to the message sending period. And stopping sending the detection picture message after the service picture is sent again, restarting sending the detection picture message until the service picture message is sent again, and repeating the steps.
The format of the detected picture message in this step is the same as the message format introduced in step 25, for example, TLV + RTP or json + HTTP. The difference is that in step 25, the value in the data format carries the service picture, and does not carry the detection tag; in the embodiment of the invention, the value additionally carries the detection label, and the message carrying the detection label is the detection picture message. The value can also carry a detection picture, for example: blank pictures, company logo (logo), etc. The value may not carry pictures.
In practical use, the shooting objects of the camera often do not appear every moment, but have a temporal regularity, so that the service pictures sent by the camera are discontinuous rather than continuous, and the discontinuous time length is long or short. In the following, the description will be given by taking an example in which the camera takes a picture of a pedestrian after detecting the pedestrian and sends the picture to the storage server. Such a camera can be installed in a subway entrance, an office building, a hospital, or the like. Taking a camera installed at the doorway of an office building as an example, during the daytime when people go to and from the office building frequently, the service pictures may be continuous (in this case, pictures are continuously sent from the camera to the storage server), or the interval between the picture streams is very short although discontinuous (for example, the sending interval between two service picture messages before and after the service picture messages does not exceed 2 seconds). In the non-commuting time, the number of people getting in and out of the office building is reduced, and the business pictures are not continuous but have longer time intervals. At night, pedestrians that can be shot by the camera become extremely rare, and even possibly no people pass by the camera all night, so that no picture is sent to the storage server all night by the camera.
There are two possibilities that no picture is sent from the camera to the storage server: one possible case is that no photographic subject is present within the shooting range of the camera; another possibility is a partial malfunction of the camera, which, although taking a picture, cannot send out a picture message. And the night is a high-occurrence time period of a public security event, once the function of the camera is abnormal, the camera needs to be maintained in time so as to avoid missing key picture messages. In the prior art, whether a camera is normal is detected by using schemes such as a heartbeat technology, however, heartbeat messages are too simple, and a storage server can only prove that the heartbeat messages are received: the network between the camera and the storage server is normal, and the network function of the camera is normal; it is impossible to detect whether the function of the camera for generating the picture message is normal or not and whether the function of the camera for sending the picture message is normal or not.
In this embodiment, after the service picture transmission is finished once, the camera starts the timer, sends an additional detection picture message to the storage server after the timer reaches 10 seconds, and sends an additional picture message to the storage server again after the timer reaches 10 seconds again. That is, when the camera does not have a picture message to send to the storage server, the camera periodically sends a detection picture message to the storage server. When the camera has a new service picture to be sent to the storage server (for example, when a pedestrian is detected to pass through the shooting range of the camera, the picture is shot and a picture message is sent to the storage server), the timer is cleared.
Referring to fig. 4, the detection picture message carries a detection tag, specifically, the detection tag may carry a value in a TLV data structure; it should be noted that the picture data is not the necessary content in the detected picture message, so that the detected picture message does not carry pictures, even if no pictures are carried, it is a picture message at all. Referring to fig. 5, the TLV data structure of the detected picture packet may further carry: number of pictures, pictures (picture 1, picture 2). Further, the value may also carry information such as a picture date (not shown) and a size of each picture (not shown). There are many options for pictures, such as: blank pictures; company logo pictures, advertising pictures, sent business pictures, etc.
Referring to fig. 6, optionally, in each picture message sent by the camera, the serial number of each picture may also be added. In the embodiment of the invention, the carrying rules of the picture serial number include three types: (1) the service picture message and the detection picture message do not carry picture serial numbers; (2) carrying picture serial numbers in both the service picture message and the detection picture message, wherein the serial numbers are continuous; (3) carrying picture serial numbers in the service picture message, wherein the serial numbers are continuous; the detection picture message does not carry a picture sequence number.
27. When the storage server does not receive the picture message from the camera within a preset time length (for example, 1 message sending period: 10 seconds, or 3 message sending periods: 10 seconds × 3 ═ 30 seconds), an alarm is sent.
And when the storage server does not receive the picture message from the camera within a preset time length, the storage server receives the picture message from the camera. This means that the camera has failed. Besides basic faults such as network faults, downtime faults and the like, the function of generating the picture message may have faults, for example: constructing a TLV data structure, or encapsulating the TLV data structure to the functional failure of the RTP message; it is also possible that the function of sending RTP packets has failed. These faults are often caused by software factors such as system instability, software incompatibility, etc., and are therefore relatively easy to occur with respect to other faults. In particular, these faults are undetectable by prior art techniques such as heartbeat messages. Therefore, compared with the prior art, the embodiment of the invention can detect the specific fault of the camera.
The embodiment of the invention can cover the fault range which can be detected by the heartbeat message, thereby replacing a heartbeat mechanism. Of course, the embodiments of the present invention may be used in parallel with the heartbeat mechanism, so that if a heartbeat message is normally received but a detection picture message is not normally received, some basic failures (for example, a network failure between the camera and the storage server, and a failure that the camera is down) may be eliminated, so as to more accurately locate the failure to the TLV generation failure, the RTP message generation failure, and the like described in the embodiments of the present invention.
And after receiving the detection picture message, the storage server analyzes the received message, and can confirm whether the received message is a service picture message or a detection picture message by judging whether the detection identifier exists. For the service pictures, the storage server needs to store the service pictures; and for the detected picture, the storage server can discard the detected picture. Therefore, after the storage server detects the detection identifier in the message, it can recognize that the message is a detected picture message. Therefore, the storage server can judge that the camera is currently in a normal working state, but no business picture needs to be sent; in addition, the storage server strips the detection picture message from the common picture message and does not perform persistent storage. Of course, optionally, the additional message may also be stored.
The alarm can prompt the camera to be abnormal and trigger the maintenance process. For example: the storage server tries to reestablish a data channel between the storage server and the camera, and whether the camera is abnormal or not is confirmed again; alternatively, the administrator may perform further detection of the camera after receiving the alarm.
When the data structure carries the picture serial number, the picture serial number is further recorded in the step.
28. And after receiving the picture message, the storage server reads the TLV in the RTP message and acquires the picture serial number from the TLV. This step is an optional step and may be performed periodically, for example, every 24 hours.
And when the service picture message and the detection picture message both carry picture serial numbers. If the sequence number is not continuous, indicating that there is a picture loss (possibly a service picture or a detected picture), recording is performed. According to the check identification, whether the lost picture is a service picture or a detection picture can be further judged, and if the lost picture is the service picture, the storage server sends a retransmission request except for recording to request the camera to resend the lost picture. If the lost is a detected picture, only recording is performed without retransmission.
And when the service picture message carries the picture serial number, the detection picture message does not carry the picture serial number. If the sequence number is discontinuous, the loss of the service picture is indicated, so that the storage server sends a retransmission request to request the camera to resend the lost picture; and recording the loss condition. And obtaining the loss rate of the service pictures according to the loss condition of the picture serial numbers in the plurality of service pictures received by statistics.
The storage server can summarize the message loss condition to obtain the message loss rate and feed the message loss rate back to the host (personal computer, mobile phone, PAD, etc.). The reliability degree of the network can be judged according to the message loss rate.
Referring to fig. 7 and 8, embodiments of the device failure detection method are described from the camera side and the storage server side, respectively.
The flow of the camera is as follows:
and step 31, the camera sends a service picture message, and after each service picture message is sent, a local timer of the camera is started.
Step 32, when the timer counts for more than 10 seconds, no new service picture message is sent, and step 34 is entered; when a new service picture message is sent within 10 seconds, the step 33 is entered.
Step 33, the local timer is reset.
And step 34, generating a detection picture message and sending the detection picture message to the storage server. The sending period of the detection message is less than 10 seconds (at least less than 30 seconds).
Step 35, when the camera sends a detection picture message and a new service picture message needs to be sent within 10 seconds, the step 33 is entered, and the local timer is reset; otherwise, step 34 is entered to send the inspection picture message again.
The flow of the storage server is as follows:
and step 41, receiving the picture message sent by the camera, and starting a local timer to start timing after receiving the picture message. And resetting the local timer of the storage server to restart timing every time a new picture message is received.
And step 42, the storage server detects whether a new picture is received within 30 seconds according to the timing of the timer.
When the timer counts for 30 seconds and is not reset, the step 44 is entered; otherwise, step 43 is entered.
Step 43, reset the local timer.
And step 44, sending out a warning signal that the camera is in failure. The alarm may carry a specific fault type: a picture message generation function failure, or a picture message transmission function failure. Considering that the probability of the failure of the picture messaging function is low and can be ignored in some cases, the failure type may also be: and generating a functional fault by the picture message.
Referring to fig. 9, the present invention further provides an embodiment of a fault detection system, where the fault detection system includes: a picture message transmitting device 4 and a failure detecting device 5. Wherein, the picture message sending apparatus 4 may execute the embodiments described in the above methods 31 to 35; the fault detection means 5 may perform the embodiments described above for the methods 41-44; a combination of two devices may perform the embodiments described above for method steps 21-28. The following is only a brief description, since the method embodiments have already been described in detail.
The picture message transmission device 6 includes: the processing module 61, the detection message generating module 62 and the sending module 63. The sending module 63 is configured to send a service picture message. The processing module 61 is configured to determine whether the duration in which the picture message sending device stops sending the service picture message reaches a second duration. The sending module 63 is further configured to send the fault detection message (second picture message) when the determination result indicates that the second duration is reached.
The failure detection device 5 includes: a receiving module 51, a processing module 52, and an alarm module 53. The receiving module 51 is configured to receive the message sent by the sending module 63. The processing module 52 is configured to determine whether a second picture packet sent by the picture packet sending device is received within a first time period since the first picture packet is received. And an alarm module 53, configured to send a fault alarm signal when the picture message receiving apparatus does not receive the second picture message.
The invention also provides an embodiment of a device fault detection system, which comprises a picture message sending device and a picture message receiving device communicated with the picture message sending device, wherein the device fault detection system comprises: the picture message sending device is used for: sending a service message carrying a service picture to the picture message receiving equipment; when the time length for stopping sending the service picture reaches a second time length, continuously sending a fault detection message to the picture message receiving equipment, wherein the time interval between the fault detection messages is less than the second time length; the picture message receiving device is used for: and receiving the picture messages sent by the picture message sending equipment, and sending an alarm signal by the picture message receiving equipment when the 2 picture messages are not received after the first time length is exceeded.
The present invention also provides an embodiment of a storage medium comprising computer instructions that, when run on a picture message receiving device, cause the picture message receiving device to perform the steps performed by the picture message receiving device in the aforementioned method.
The present invention further provides an embodiment of a picture message receiving device, where the picture message receiving device includes a processor (optionally, a memory storing computer instructions may also be included), and the processor executes, by executing the computer instructions, the steps executed by the picture message receiving device in the foregoing method.
An embodiment of a computer program product is executable by the steps executed by the image message sending device. The computer program product comprises: the instruction is used for receiving a first picture message sent by picture message sending equipment; the instruction is used for judging whether a second picture message sent by the picture message sending equipment is received within a first time period since the first picture message is received; and the image message receiving equipment is used for sending a fault alarm signal when the second image message is not received, wherein the second image message is an instruction for detecting the image message.
One or more of the above modules may be implemented in software, hardware, or a combination of both. When any of the above modules is implemented in software, the software exists as computer program instructions and is stored in a memory, which may be used by a processor to execute the program instructions and implement the above method flows. The processor may include, but is not limited to, at least one of: various computing devices that run software, such as a Central Processing Unit (CPU), a microprocessor, a Digital Signal Processor (DSP), a Microcontroller (MCU), or an artificial intelligence processor, may each include one or more cores for executing software instructions to perform operations or processing. The processor may be built in an SoC (system on chip) or an Application Specific Integrated Circuit (ASIC), or may be a separate semiconductor chip. The processor may further include a necessary hardware accelerator such as a Field Programmable Gate Array (FPGA), a PLD (programmable logic device), or a logic circuit for implementing a dedicated logic operation, in addition to a core for executing software instructions to perform an operation or a process.
When the above modules are implemented in hardware, the hardware may be any one or any combination of a CPU, microprocessor, DSP, MCU, artificial intelligence processor, ASIC, SoC, FPGA, PLD, dedicated digital circuit, hardware accelerator, or non-integrated discrete device, which may run necessary software or not rely on software to perform the above method flows.

Claims (14)

1. A fault detection method of a picture message sending device is characterized in that a picture message receiving device is communicated with the picture message sending device, and the method comprises the following steps:
the picture message receiving equipment receives a first picture message from the picture message sending equipment;
the picture message receiving equipment judges whether a second picture message sent by the picture message sending equipment is received within a first time period after the first picture message is received;
when the picture message receiving equipment does not receive the second picture message, the picture message receiving equipment sends a fault warning signal, wherein the first picture message is a service picture message carrying a service picture, and the second picture message is a detection picture message; the detection picture is constructed by the picture message sending equipment.
2. The method of claim 1,
the fault alarm signal is used for indicating the picture message generation function fault of the picture message sending equipment.
3. The method according to claim 2, wherein the detected picture packet is an RTP packet encapsulated by a TLV data structure, and the fault alarm signal is used for indicating a fault including:
the function of constructing the TLV data structure of the picture message sending equipment fails; or
And the picture message sending equipment encapsulates the TLV data structure to the function fault of the RTP message.
4. The method according to claim 2, wherein the detecting picture message is an HTTP message encapsulated by a json data structure, and the fault indicating by the fault alarm signal comprises:
the function of constructing the json data structure of the picture message sending equipment fails; or
And the picture message sending equipment encapsulates the json data structure to the function fault of the HTTP message.
5. The method of claim 1, further comprising:
the picture message receiving equipment receives a plurality of service picture messages sent by the picture message sending equipment, and the service picture messages further carry picture serial numbers;
and obtaining the loss rate of the service pictures according to the picture sequence numbers in the plurality of service picture messages received by statistics.
6. The method of claim 1, further comprising:
the picture message receiving equipment stores the service picture in the first picture message;
and the picture message receiving equipment discards the data in the second picture message.
7. The method according to any one of claims 1-6, wherein the method further comprises:
the picture message sending equipment sends the first picture message to the picture message receiving equipment;
and when the time length for the picture message sending equipment to stop sending the first picture message reaches a second time length, the picture message sending equipment sends the second picture message to the picture message receiving equipment, wherein the second time length is less than or equal to the first time length.
8. The method according to any one of claims 1 to 6,
the picture message sending equipment is a camera, and pictures in the first picture message are obtained by shooting through the camera; the picture message receiving device is a storage server or the picture message receiving device is an image analysis server.
9. A fault detection device of a picture message sending device is characterized by comprising:
the receiving module is used for receiving a first picture message from the picture message sending equipment;
the processing module is used for judging whether a second picture message sent by the picture message sending equipment is received within a first time period after the first picture message is received;
the alarm module is used for sending a fault alarm signal when the judgment result of the processing module is that the second picture message is not received, wherein the first picture message is a service picture message carrying a service picture, and the second picture message is a detection picture message; the detection picture is constructed by the picture message sending equipment.
10. The apparatus according to claim 9, wherein the inspection picture packet is an RTP packet encapsulated by a TLV data structure, and the failure alarm signal is used to indicate a failure including:
the function of constructing the TLV data structure of the picture message sending equipment fails; or
And the picture message sending equipment encapsulates the TLV data structure to the function fault of the RTP message.
11. The apparatus according to claim 9, wherein the inspection picture message is an HTTP message encapsulated by a json data structure, and the failure alarm signal is used to indicate a failure including:
the function of constructing the json data structure of the picture message sending equipment fails; or
And the picture message sending equipment encapsulates the json data structure to the function fault of the HTTP message.
12. The apparatus according to any one of claims 9-11, wherein the picture messaging device is a camera, and the picture in the first picture message is captured by the camera; the apparatus is a storage server, or an image analysis server.
13. A fault detection system of a picture message sending device comprises the picture message sending device and a picture message receiving device communicated with the picture message sending device, and is characterized in that:
the picture message sending device is used for: sending a service picture message carrying a service picture to the picture message receiving equipment; when the time length for stopping sending the service picture message reaches a second time length, continuously sending a fault detection message to the picture message receiving equipment, wherein the time interval between the fault detection messages is less than the second time length; the fault detection message is a picture detection message; the detection picture is constructed by the picture message sending equipment;
the picture message receiving device is used for: and receiving the picture messages sent by the picture message sending equipment, and sending out fault alarm signals by the picture message receiving equipment when the 2 picture messages are not received after the first time length is exceeded.
14. A storage medium comprising computer instructions which, when run on a picture message receiving device, cause the picture message receiving device to perform the method of any one of claims 1 to 8.
CN201911418997.1A 2019-12-31 2019-12-31 Fault detection method, device and system Active CN111157223B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911418997.1A CN111157223B (en) 2019-12-31 2019-12-31 Fault detection method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911418997.1A CN111157223B (en) 2019-12-31 2019-12-31 Fault detection method, device and system

Publications (2)

Publication Number Publication Date
CN111157223A CN111157223A (en) 2020-05-15
CN111157223B true CN111157223B (en) 2022-05-10

Family

ID=70560499

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911418997.1A Active CN111157223B (en) 2019-12-31 2019-12-31 Fault detection method, device and system

Country Status (1)

Country Link
CN (1) CN111157223B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000092055A (en) * 1998-09-11 2000-03-31 Toshiba Corp Network fault detection system and network fault detection method
CN101587629A (en) * 2008-05-21 2009-11-25 上海新联纬讯科技发展有限公司 Fault alarm system of monitoring camera
CN102497283A (en) * 2011-11-24 2012-06-13 杭州华三通信技术有限公司 Method, system and device for data transmission based on Ethernet passive coax network (EPCN)
CN105872391A (en) * 2016-06-15 2016-08-17 华为技术有限公司 Control method, control device and control system for IP (Internet Protocol) Camera
CN105991371A (en) * 2015-04-16 2016-10-05 杭州迪普科技有限公司 Fault detection method and device
CN106656653A (en) * 2016-10-28 2017-05-10 浙江宇视科技有限公司 Method and device for processing registration and keeping alive
CN109246424A (en) * 2018-08-17 2019-01-18 安徽四创电子股份有限公司 Failure video camera method for rapidly positioning based on space-time analysis technology

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8013738B2 (en) * 2007-10-04 2011-09-06 Kd Secure, Llc Hierarchical storage manager (HSM) for intelligent storage of large volumes of data
CN101783970B (en) * 2009-12-22 2011-11-09 新太科技股份有限公司 Methods, devices and systems for automatically detecting and managing fault of camera
CN104601411A (en) * 2015-02-02 2015-05-06 华为技术有限公司 Link failure detection method and device
CN108650503B (en) * 2018-04-28 2020-08-21 努比亚技术有限公司 Camera fault determination method and device and computer readable storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000092055A (en) * 1998-09-11 2000-03-31 Toshiba Corp Network fault detection system and network fault detection method
CN101587629A (en) * 2008-05-21 2009-11-25 上海新联纬讯科技发展有限公司 Fault alarm system of monitoring camera
CN102497283A (en) * 2011-11-24 2012-06-13 杭州华三通信技术有限公司 Method, system and device for data transmission based on Ethernet passive coax network (EPCN)
CN105991371A (en) * 2015-04-16 2016-10-05 杭州迪普科技有限公司 Fault detection method and device
CN105872391A (en) * 2016-06-15 2016-08-17 华为技术有限公司 Control method, control device and control system for IP (Internet Protocol) Camera
CN106656653A (en) * 2016-10-28 2017-05-10 浙江宇视科技有限公司 Method and device for processing registration and keeping alive
CN109246424A (en) * 2018-08-17 2019-01-18 安徽四创电子股份有限公司 Failure video camera method for rapidly positioning based on space-time analysis technology

Also Published As

Publication number Publication date
CN111157223A (en) 2020-05-15

Similar Documents

Publication Publication Date Title
CN109889762B (en) Conference control method and device
US7663665B2 (en) Communication device and method for transferring video-stream data to a display device and a storage device
CN111614953B (en) Restarting control method and system for fault IP camera
CN108924485B (en) Client real-time video stream interrupt processing method and system and monitoring system
CN101389036B (en) Error correcting device suitable for video conference and method thereof
WO2016187979A1 (en) Transmitting method and apparatus for bidirectional forwarding detection (bfd) message
WO2011015068A1 (en) Failure detection method and system
WO2012075934A1 (en) Method for detecting message loop, routing agent apparatus and networking system
CN114285765A (en) Link failure detection method, device and computer readable storage medium
CN110098884A (en) Determine exception clock
CN111157223B (en) Fault detection method, device and system
CN111935497B (en) Video stream management method and data server for traffic police system
CN113645103B (en) Method and device for detecting communication link abnormity between video monitoring platform and front-end equipment
WO2023125777A1 (en) Video recording data replenishment method, cloud storage server, system and storage medium
CN104904170A (en) Method and apparatus for efficiently prioritizing elements in a video stream for low-bandwidth transmission
CN106603977B (en) Video acquisition method and device based on Linux multi-core environment
WO2023024469A1 (en) Video quality problem determination method and apparatus, storage medium, and program product
JP4808645B2 (en) Device monitoring network system and SNMP trap management method
WO2017107083A1 (en) Data sending method and receiving method, apparatus and system
JP5506362B2 (en) Transmission device and transmission method
CN112929228A (en) Bandwidth testing method, user equipment and storage device
CN102291315B (en) Method and system for transmitting information in monitoring system
CN115883466B (en) Switch control method and device, storage medium and electronic device
CN111935313B (en) Connection pool management method and device
CN110769190B (en) Event detection and recording system, and management and starting method of information acquisition device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant