CN114173087A - Video data acquisition and processing method, edge gateway and storage medium - Google Patents
Video data acquisition and processing method, edge gateway and storage medium Download PDFInfo
- Publication number
- CN114173087A CN114173087A CN202111291354.2A CN202111291354A CN114173087A CN 114173087 A CN114173087 A CN 114173087A CN 202111291354 A CN202111291354 A CN 202111291354A CN 114173087 A CN114173087 A CN 114173087A
- Authority
- CN
- China
- Prior art keywords
- data
- packet
- network
- data packet
- load
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 22
- 230000005540 biological transmission Effects 0.000 claims abstract description 52
- 238000004458 analytical method Methods 0.000 claims abstract description 43
- 238000000034 method Methods 0.000 claims abstract description 24
- 238000001914 filtration Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 11
- 238000012545 processing Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 238000012986 modification Methods 0.000 description 6
- 230000004048 modification Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a video data acquisition and processing method, an edge gateway and a storage medium, wherein the method comprises the following steps: acquiring a transport layer data packet, wherein the transport layer data packet is acquired from the edge gateway when a network camera pushes network data to a pull stream client through the edge gateway; obtaining an H264 data frame according to the transmission layer data packet; performing combined decoding on the H264 data frame to obtain a target video image frame; and analyzing the target video image frame to obtain an analysis result, solving the problem of network camera burden caused by the connection of a network camera and a plurality of devices and the pushing of data, and reducing the network data transmission burden.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a video data acquisition and processing method, an edge gateway and a storage medium.
Background
Currently, video surveillance is widely used in open roads, public places, residential areas, enterprise factories, and the like as an important management means. For the collected video images, real-time inspection and storage are usually required so as to find the abnormality and retain the basis in time. With the development of machine vision technology, people analyze the video images collected by the camera through image and video intelligent analysis technology so as to further strengthen the video monitoring effect.
In the related art, a video image intelligent analysis terminal firstly needs to acquire video image data from a network camera, and the current main way is that the analysis terminal directly sends a stream pulling request to the network camera to establish a formal data transmission relation with the network camera. Therefore, when a plurality of video image analyzing, storing and real-time playing devices in the network request video image data from the same network camera, the network camera needs to be simultaneously connected with the plurality of devices and push the data, so that the burden of the network camera is caused; meanwhile, the processing capacity of the network camera is limited, and if the equipment needing the video images exceeds the network data quantity limit of the network camera, the required data cannot be acquired from the network camera. In addition, the video image data volume is large, and the video image data of the same camera is transmitted in multiple copies in the network, which greatly increases the burden of network data transmission.
Disclosure of Invention
The embodiment of the application aims to reduce the problem of network transmission burden by providing a video data acquisition and processing method, an edge gateway and a storage medium.
The embodiment of the application provides a video data acquisition and processing method applied to a gateway, and the video data acquisition and processing method comprises the following steps:
acquiring a transport layer data packet, wherein the transport layer data packet is acquired from the edge gateway when a network camera pushes network data to a pull stream client through the edge gateway;
obtaining an H264 data frame according to the transmission layer data packet;
performing combined decoding on the H264 data frame to obtain a target video image frame;
and analyzing the target video image frame to obtain an analysis result.
In one embodiment, the step of obtaining the transport layer packet comprises:
copying all original data packets through an original socket when network data passes through the edge gateway;
unpacking the original data packet to obtain packet header information and a first load of a data link layer data packet;
unpacking the first load to obtain packet header information of a network layer data packet and packet header information of a transmission layer data packet;
and filtering the packet header information of the network layer data packet based on preset attribute information to obtain a transmission layer data packet.
In an embodiment, the preset attribute information includes: the source port number of the transport layer packet, the source address of the transport layer packet, the destination address of the transport layer packet, and the sequence number of the transport layer packet.
In an embodiment, the step of obtaining the H264 data frame according to the transport layer data packet includes:
acquiring a second load of a transmission layer data packet, wherein the second load of the transmission layer data packet is obtained by unpacking the first load;
unpacking the second load to obtain packet header information and a third load of an RTP data packet;
and unpacking the third load to obtain an H264 data frame.
In an embodiment, the step of performing combined decoding on the H264 data frames to obtain target video image frames includes:
acquiring frame header information of the H264 data frame;
and adopting the frame header information to recombine and decode the H264 data frame to obtain a decoded target video image frame.
In one embodiment, the step of analyzing the target video image frame to obtain an analysis result includes:
and sending the target video image frame to an analysis application for analysis so as to obtain an analysis result.
In addition, to achieve the above object, the present invention further provides an edge gateway, including: the video data acquisition and processing method comprises a memory, a processor and a video data acquisition and processing program which is stored on the memory and can run on the processor, wherein the video data acquisition and processing program realizes the steps of the video data acquisition and processing method when being executed by the processor.
In addition, to achieve the above object, the present invention also provides a storage medium having a video data acquisition and processing program stored thereon, which when executed by a processor, implements the steps of the above video data acquisition and processing method.
According to the technical scheme of the video data obtaining and processing method, the edge gateway and the storage medium, when the network camera pushes network data to the streaming client through the edge gateway, when the network data passes through the edge gateway, an original data packet is copied, and the original data packet is unpacked to obtain a transmission layer data packet; obtaining an H264 data frame according to the transmission layer data packet; the H264 data frames are combined and decoded to obtain target video image frames, the target video image frames are analyzed to obtain an analysis result, the problem that a network camera is connected with a plurality of devices and pushes network data to cause network camera burden is solved, in the process, only one path of flow passes through the intranet device, so that the network data required to be transmitted by the network camera and the intranet device is reduced, and the pushing flow and forwarding pressure of the network camera and the intranet device is correspondingly reduced; meanwhile, the streaming media protocol is converted into the H264 stream composed of H264 data frames by packet capturing at the edge gateway, so that the network data required to be transmitted is reduced, and the network data transmission load is reduced.
Drawings
FIG. 1 is a schematic diagram of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of a video data acquisition and processing method according to a first embodiment of the present invention;
FIG. 3 is a flowchart illustrating a video data acquiring and processing method according to a second embodiment of the present invention;
FIG. 4 is a flowchart illustrating a video data acquiring and processing method according to a third embodiment of the present invention;
FIG. 5 is a schematic view of a video data acquisition and processing flow according to the present invention.
The objects, features, and advantages of the present invention will be further explained with reference to the accompanying drawings, which are an illustration of one embodiment, and not an entirety of the invention.
Detailed Description
For a better understanding of the above technical solutions, exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
As shown in fig. 1, fig. 1 is a schematic structural diagram of a hardware operating environment according to an embodiment of the present invention.
It should be noted that fig. 1 is a schematic structural diagram of a hardware operating environment of a gateway.
As shown in fig. 1, the gateway may include: a processor 1001, such as a CPU, a memory 1005, a user interface 1003, a network interface 1004, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the configuration of the gateway shown in fig. 1 is not intended to be limiting of the gateway and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a storage medium, may include therein an operating system, a network communication module, a user interface module, and a video data acquisition and processing program. Among them, the operating system is a program that manages and controls the gateway hardware and software resources, a video data acquisition and processing program, and the operation of other software or programs.
In the gateway shown in fig. 1, the user interface 1003 is mainly used for connecting a terminal and performing data communication with the terminal; the network interface 1004 is mainly used for the background server and performs data communication with the background server; the processor 1001 may be used to invoke a video data acquisition and processing program stored in the memory 1005.
In this embodiment, the gateway includes: a memory 1005, a processor 1001 and a video data acquisition and processing program stored on the memory and executable on the processor, wherein:
when the processor 1001 calls the video data acquisition and processing program stored in the memory 1005, the following operations are performed:
acquiring a transport layer data packet, wherein the transport layer data packet is acquired from the edge gateway when a network camera pushes network data to a pull stream client through the edge gateway;
obtaining an H264 data frame according to the transmission layer data packet;
performing combined decoding on the H264 data frame to obtain a target video image frame;
and analyzing the target video image frame to obtain an analysis result.
When the processor 1001 calls the video data acquisition and processing program stored in the memory 1005, the following operations are also performed:
copying all original data packets through an original socket when network data passes through the edge gateway;
unpacking the original data packet to obtain packet header information and a first load of a data link layer data packet;
unpacking the first load to obtain packet header information of a network layer data packet and packet header information of a transmission layer data packet;
and filtering the packet header information of the network layer data packet based on preset attribute information to obtain a transmission layer data packet.
When the processor 1001 calls the video data acquisition and processing program stored in the memory 1005, the following operations are also performed:
the preset attribute information includes: the source port number of the transport layer packet, the source address of the transport layer packet, the destination address of the transport layer packet, and the sequence number of the transport layer packet.
When the processor 1001 calls the video data acquisition and processing program stored in the memory 1005, the following operations are also performed:
acquiring a second load of a transmission layer data packet, wherein the second load of the transmission layer data packet is obtained by unpacking the first load;
unpacking the second load to obtain packet header information and a third load of an RTP data packet;
and unpacking the third load to obtain an H264 data frame.
When the processor 1001 calls the video data acquisition and processing program stored in the memory 1005, the following operations are also performed:
acquiring frame header information of the H264 data frame;
and adopting the frame header information to recombine and decode the H264 data frame to obtain a decoded target video image frame.
When the processor 1001 calls the video data acquisition and processing program stored in the memory 1005, the following operations are also performed:
and sending the target video image frame to an analysis application for analysis so as to obtain an analysis result.
While a logical order is shown in the flow chart, in some cases, the steps shown or described may be performed in an order different than that shown or described herein.
As shown in fig. 2, in a first embodiment of the present application, a video data acquiring and processing method of the present application includes the following steps:
step S110, a transport layer packet is obtained, wherein the transport layer packet is obtained from the edge gateway when the network camera pushes network data to the pull stream client through the edge gateway;
step S120, obtaining an H264 data frame according to the transmission layer data packet;
step S130, carrying out combined decoding on the H264 data frame to obtain a target video image frame;
step S140, analyzing the target video image frame to obtain an analysis result.
In this embodiment, in order to solve the problem that a network camera is connected with multiple devices and pushes network data to cause network camera burden, the present application designs a video data acquisition and processing method applied to an edge gateway. Different analysis applications are run in the gateway, and when the network camera pushes network data to the pull stream client through the edge gateway, the transport layer data packet is obtained from the edge gateway. In order to further reduce the network data transmission burden, according to the method and the device, after a transmission layer data packet is obtained, an H264 data frame is obtained according to the transmission layer data packet, and the H264 data frame is subjected to combined decoding to obtain a target video image frame; analyzing the target video image frame to obtain an analysis result; compared with the prior art that the transmission layer data packet is sent to the analysis application for analysis, the method and the device for analyzing the H264 data stream send the H264 data stream composed of the H264 data frames to the analysis application for analysis, reduce the network data transmission quantity and reduce the network transmission pressure.
In the prior art, if 3 analysis applications and 1 NVR require stream pulling, the output of a network camera is 720p (1280 × 720), and a target video stream of 24 frames per second, 50M bandwidth is required for transmitting 4 streams; the network camera only needs to push one path of flow, the required bandwidth is about 10M, and the pressure of the network camera on the flow pushing and the forwarding of the edge gateway is reduced.
In this embodiment, the transport layer packet is a UDP packet; the pull stream client can be a network video recorder or other equipment. As shown in fig. 5, fig. 5 is a schematic view of a video data acquiring and processing flow of the present invention, wherein NVR is a stream pulling client, the stream pulling client is a store-and-forward part of a network video monitoring system, and the NVR cooperates with a video encoder or a network camera to complete video recording, storing and forwarding functions of a video; an edge gateway is deployed between a network camera and a stream pulling client, and different analysis applications run in the edge gateway and are used for performing different service analysis processing on a video stream; according to the method and the device, when the network camera pushes network data to the pull stream client through the edge gateway, the transport layer data packet is obtained from the edge gateway.
Specifically, different analysis applications are built in a gateway according to business requirements, and the target video stream is sent to the different analysis applications for analysis processing; because the types of the video image frames in the target video stream comprise I frames, P frames and B frames, in order to reduce the network transmission pressure, only key frames, namely I frames, in the target video stream need to be extracted, the extracted key frames are subjected to different analysis application analysis to obtain analysis information, the key frames describe details of image backgrounds and moving bodies, and complete video pictures can be restored during decoding.
In this embodiment, after a transport layer packet is obtained, an H264 data frame is obtained according to the transport layer packet; specifically, unpacking the first load to obtain a second load of a transport layer packet; unpacking the second load to obtain packet header information and a third load of an RTP data packet; and unpacking the third load to obtain an H264 data frame.
In this embodiment, after acquiring an H264 data frame, the H264 data frame is subjected to combined decoding to obtain a target video image frame, where the format of the H264 data frame is NV12 format, and the format of the H264 data frame may also be YV12 format.
In this embodiment, after the H264 data frames are combined and decoded to obtain a target video image frame, the target video image frame is sent to an analysis application for analysis, so as to obtain an analysis result. Specifically, the process of obtaining the target video image frame by performing the combined decoding on the H264 data frame substantially includes: and acquiring frame header information of the H264 data frame, and adopting the frame header information to recombine and decode the H264 data frame to obtain a decoded target video image frame. The target video image frame is a key frame, and different analysis applications can be adopted for analyzing the target video image frame to obtain an analysis result corresponding to the analysis applications. In the process, different analysis applications analyze the same target video image frame, and the target video image frame comes from the same transmission layer data packet, so that the network data transmission amount is reduced, and the network transmission pressure is reduced.
According to the technical scheme, when the network camera pushes network data to the pull stream client through the edge gateway, when the network data passes through the edge gateway, the original data packet is copied, and the original data packet is unpacked to obtain a transmission layer data packet; obtaining an H264 data frame according to the transmission layer data packet; the H264 data frames are combined and decoded to obtain target video image frames, the target video image frames are analyzed to obtain an analysis result, the problem that a network camera is connected with a plurality of devices and pushes network data to cause network camera burden is solved, in the process, only one path of flow passes through the intranet device, so that the network data required to be transmitted by the network camera and the intranet device is reduced, and the pushing flow and forwarding pressure of the network camera and the intranet device is correspondingly reduced; meanwhile, the streaming media protocol is converted into the H264 stream composed of H264 data frames by packet capturing at the edge gateway, so that the network data required to be transmitted is reduced, and the network data transmission load is reduced.
As shown in fig. 3, based on the first embodiment step S120, in the second embodiment of the present application, the video data acquiring and processing method of the present application includes the following steps:
step S111, when the network data passes through the edge gateway, copying all original data packets through an original socket;
step S112, unpacking the original data packet to obtain packet header information and a first load of a data link layer data packet;
step S113, unpacking the first load to obtain the header information of the network layer data packet and the header information of the transmission layer data packet;
step S114, filtering the packet header information of the network layer packet based on the preset attribute information to obtain a transport layer packet.
In this embodiment, the network data includes a middle transport layer packet; the first payload is a payload of the data link layer packet. The method comprises the steps that a connection relation is established between an edge gateway and a network camera through an original socket, and when network data pass through the edge gateway, all original data packets are copied through the original socket; the original video data packet includes a transport layer data packet, a data link layer data packet, and a network layer data packet, so that after the gateway acquires the original video data packet, the gateway needs to process the original video data packet to obtain the transport layer data packet.
Specifically, when network data passes through the edge gateway, all original data packets are copied through original sockets, the original data packets are unpacked to obtain packet header information and a first load of a data link layer data packet, and the first load is unpacked to obtain the packet header information of the network layer data packet and the packet header information of a transmission layer data packet. The method comprises the steps that preset attribute information of a transmission layer packet is preconfigured in a gateway, the preset attribute information comprises information such as a source port number of the transmission layer packet, a source address of the transmission layer packet, a destination address of the transmission layer packet and a sequence number of the transmission layer packet, and packet header information of the network layer packet is filtered according to the preset attribute information to obtain the transmission layer packet.
The source address of the target data packet is substantially the serial number of the network camera corresponding to the target data packet; the destination address of the target data packet comprises a storage address of the target data packet in the pull stream client. For example, a transport layer packet stored in the network data of the storage address B by the network camera a is acquired, and the transport layer packet stored in the network data of the storage address B by the network camera a is sent to the storage address C of the gateway, so that the packet header information of the network layer packet is filtered based on the preset attribute information, and the transport layer packet is obtained.
According to the technical scheme, all original data packets are copied through the original sockets when network data pass through the edge gateway; unpacking the original data packet to obtain packet header information and a first load of a data link layer data packet; unpacking the first load to obtain packet header information of a network layer data packet and packet header information of a transmission layer data packet; and filtering the packet header information of the network layer data packet based on the preset attribute information to obtain a technical means of a transmission layer data packet, thereby obtaining the transmission layer data packet.
As shown in fig. 4, based on the first embodiment step S120, in a third embodiment of the present application, a video data acquiring and processing method of the present application includes the following steps:
step S121, a second load of a transmission layer data packet is obtained, wherein the second load of the transmission layer data packet is obtained by unpacking the first load;
step S122, unpacking the second load to obtain packet header information and a third load of the RTP data packet;
and step S123, unpacking the third load to obtain an H264 data frame.
In this embodiment, the second payload is a payload of the transport layer packet; the third payload is a payload of the RTP packet. The transmission layer data packet is a UDP data packet, and the UDP data packet is packaged by a UDP protocol; the UDP data packet comprises an RTP data packet, and the RTP data packet stores an H264 data frame; unpacking the transport layer data packet to obtain an H264 data frame; specifically, the unpacking process of the transport layer packet includes: when the first load is unpacked to obtain a second load of a transmission layer data packet; further unpacking the second load to obtain packet header information and a third load of the RTP data packet; and unpacking the third load after obtaining the header information and the third load of the RTP data packet, thereby obtaining an H264 data frame.
According to the technical scheme, the second load of the transport layer packet is obtained by unpacking the first load; unpacking the second load to obtain packet header information and a third load of an RTP data packet; and unpacking the third load to obtain an H264 data frame, thereby obtaining the H264 data frame.
Based on the same inventive concept, an embodiment of the present application further provides a storage medium, where the storage medium stores a video data acquisition and processing program, and when the video data acquisition and processing program is executed by a processor, the video data acquisition and processing program implements the steps of the video data acquisition and processing, and can achieve the same technical effect, and is not described herein again to avoid repetition.
Since the storage medium provided in the embodiments of the present application is a storage medium used for implementing the method in the embodiments of the present application, based on the method described in the embodiments of the present application, a person skilled in the art can understand a specific structure and a modification of the storage medium, and thus details are not described here. Any storage medium used in the methods of the embodiments of the present application is intended to be within the scope of the present application.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (8)
1. A video data acquisition and processing method is characterized in that the method is applied to an edge gateway; the video data acquisition and processing method comprises the following steps:
acquiring a transport layer data packet, wherein the transport layer data packet is acquired from the edge gateway when a network camera pushes network data to a pull stream client through the edge gateway;
obtaining an H264 data frame according to the transmission layer data packet;
performing combined decoding on the H264 data frame to obtain a target video image frame;
and analyzing the target video image frame to obtain an analysis result.
2. The method of claim 1, wherein the step of obtaining the transport layer packet comprises:
copying all original data packets through an original socket when network data passes through the edge gateway;
unpacking the original data packet to obtain packet header information and a first load of a data link layer data packet;
unpacking the first load to obtain packet header information of a network layer data packet and packet header information of a transmission layer data packet;
and filtering the packet header information of the network layer data packet based on preset attribute information to obtain a transmission layer data packet.
3. The method of claim 2, wherein the preset attribute information comprises: the source port number of the transport layer packet, the source address of the transport layer packet, the destination address of the transport layer packet, and the sequence number of the transport layer packet.
4. The method of claim 2, wherein said step of deriving H264 data frames from said transport layer data packets comprises:
acquiring a second load of a transmission layer data packet, wherein the second load of the transmission layer data packet is obtained by unpacking the first load;
unpacking the second load to obtain packet header information and a third load of an RTP data packet;
and unpacking the third load to obtain an H264 data frame.
5. The method of claim 1, wherein said step of combinatorial decoding said H264 data frames to obtain target video image frames comprises:
acquiring frame header information of the H264 data frame;
and adopting the frame header information to recombine and decode the H264 data frame to obtain a decoded target video image frame.
6. The method of claim 1, wherein the step of analyzing the target video image frame to obtain an analysis result comprises:
and sending the target video image frame to an analysis application for analysis so as to obtain an analysis result.
7. An edge gateway, characterized in that the edge gateway comprises: memory, processor and video data acquisition and processing program stored on the memory and executable on the processor, the video data acquisition and processing program when executed by the processor implementing the steps of the video data acquisition and processing method according to any one of claims 1-6.
8. A storage medium having stored thereon a video data acquisition and processing program which, when executed by a processor, implements the steps of the video data acquisition and processing method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111291354.2A CN114173087A (en) | 2021-11-02 | 2021-11-02 | Video data acquisition and processing method, edge gateway and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111291354.2A CN114173087A (en) | 2021-11-02 | 2021-11-02 | Video data acquisition and processing method, edge gateway and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114173087A true CN114173087A (en) | 2022-03-11 |
Family
ID=80477845
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111291354.2A Pending CN114173087A (en) | 2021-11-02 | 2021-11-02 | Video data acquisition and processing method, edge gateway and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114173087A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115297323A (en) * | 2022-08-16 | 2022-11-04 | 广东省信息网络有限公司 | RPA process automation method and system |
| CN115379233A (en) * | 2022-08-16 | 2022-11-22 | 广东省信息网络有限公司 | Big data video information analysis method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110233984A (en) * | 2018-03-06 | 2019-09-13 | 北京视联动力国际信息技术有限公司 | A kind of monitoring system and method based on view networking |
| CN111723727A (en) * | 2020-06-17 | 2020-09-29 | 平安科技（深圳）有限公司 | Cloud monitoring method and device based on edge computing, electronic equipment and storage medium |
| CN112565606A (en) * | 2020-12-02 | 2021-03-26 | 鹏城实验室 | Panoramic video intelligent transmission method and equipment and computer storage medium |
| US20210256824A1 (en) * | 2018-08-30 | 2021-08-19 | Nagravision Sa | Local decision making |
-
2021
- 2021-11-02 CN CN202111291354.2A patent/CN114173087A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110233984A (en) * | 2018-03-06 | 2019-09-13 | 北京视联动力国际信息技术有限公司 | A kind of monitoring system and method based on view networking |
| US20210256824A1 (en) * | 2018-08-30 | 2021-08-19 | Nagravision Sa | Local decision making |
| CN111723727A (en) * | 2020-06-17 | 2020-09-29 | 平安科技（深圳）有限公司 | Cloud monitoring method and device based on edge computing, electronic equipment and storage medium |
| CN112565606A (en) * | 2020-12-02 | 2021-03-26 | 鹏城实验室 | Panoramic video intelligent transmission method and equipment and computer storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115297323A (en) * | 2022-08-16 | 2022-11-04 | 广东省信息网络有限公司 | RPA process automation method and system |
| CN115379233A (en) * | 2022-08-16 | 2022-11-22 | 广东省信息网络有限公司 | Big data video information analysis method and system |
| CN115379233B (en) * | 2022-08-16 | 2023-07-04 | 广东省信息网络有限公司 | Big data video information analysis method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20190332522A1 (en) | Microservice platform with messaging system | |
| CN105610824B (en) | A kind of screen sharing method based on screen mirror image and RTSP Streaming Media frame | |
| CN114173087A (en) | Video data acquisition and processing method, edge gateway and storage medium | |
| US10516856B2 (en) | Network video recorder cluster and method of operation | |
| US11770538B2 (en) | Method for providing prunable video | |
| US20240098132A1 (en) | Apparatus and method for encoding video with ultra-low latency | |
| CN108419046B (en) | Monitoring method and device for multi-channel video | |
| KR101484933B1 (en) | A method, a system, a server, a device, a computer program and a computer program product for transmitting data in a computer network | |
| CN110113558B (en) | Data processing method, device, system and computer readable storage medium | |
| CN108696505A (en) | Video distribution apparatus, video reception apparatus, method of video distribution and recording medium | |
| CN114900662A (en) | Method, system, device and medium for determining video stream transmission quality information | |
| CN110830763A (en) | Monitoring video inspection method and device | |
| CN104904170B (en) | Method and apparatus for efficiently prioritizing elements in a video stream for low bandwidth transmission | |
| CN111782876A (en) | Data processing method, device and system and storage medium | |
| CN107959828A (en) | A kind of network video server and its design, transplantation method based on MJPG streaming | |
| CN116193197A (en) | Data processing method, device, equipment and readable storage medium | |
| CN110753243A (en) | Image processing method, image processing server and image processing system | |
| US20220224955A1 (en) | Method and apparatus for firewalling images at a network endpoint | |
| CN110795008B (en) | Picture transmission method and device and computer readable storage medium | |
| CN114222096A (en) | Data transmission method, camera and electronic equipment | |
| CN110958461B (en) | Method and device for detecting connection state of video networking server | |
| JP2022075532A (en) | Image processing method and video processing device | |
| CN113784094A (en) | Video data processing method, gateway, terminal device and storage medium | |
| CN104010221B (en) | Digital billboard playing system, instant monitoring system and instant monitoring method thereof | |
| US10536501B2 (en) | Automated compression of data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |