CN114745229B - Embedded AI video gateway and implementation method thereof - Google Patents
Embedded AI video gateway and implementation method thereof Download PDFInfo
- Publication number
- CN114745229B CN114745229B CN202210137227.5A CN202210137227A CN114745229B CN 114745229 B CN114745229 B CN 114745229B CN 202210137227 A CN202210137227 A CN 202210137227A CN 114745229 B CN114745229 B CN 114745229B
- Authority
- CN
- China
- Prior art keywords
- module
- video
- algorithm
- protocol
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 238000012545 processing Methods 0.000 claims abstract description 34
- 238000006243 chemical reaction Methods 0.000 claims description 27
- 238000012795 verification Methods 0.000 claims description 13
- 238000004458 analytical method Methods 0.000 claims description 11
- 238000004891 communication Methods 0.000 claims description 7
- 238000012544 monitoring process Methods 0.000 abstract description 10
- 238000004364 calculation method Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 239000003795 chemical substances by application Substances 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/61—Network physical structure; Signal processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses an embedded AI video gateway and an implementation method thereof, belonging to the technical field of security protection, and comprising a video access module, a video processing module, an algorithm application module and a data proxy module; the video access module is used for accessing video image data; the video processing module is used for processing the accessed image data; the algorithm application module is used for synchronously transmitting the video image data to the algorithm application module after the video image data are accessed, a plurality of AI application modes are arranged in the algorithm application model, the AI application modes of the algorithm application module are dynamically switched according to actual scenes, and the identification result information is output after the video image data are processed in the algorithm application module; and the data proxy module is used for realizing the connection between the external network platform and the internal network equipment. The invention can upgrade the security system of the deployed common monitoring camera into a full-intelligent security system with algorithm function and switchable AI application rapidly and at low cost.
Description
Technical Field
The invention relates to the technical field of security protection, in particular to an embedded AI video gateway and an implementation method thereof.
Background
At present, a plurality of security environments are provided with common security monitoring cameras, but with the high-speed development of technology, AI (advanced technology) intelligent security monitoring cameras are mature. The traditional security monitoring camera needs to be upgraded into an AI (advanced technology) safe intelligent security system with an algorithm function. If the scheme of completely replacing the monitoring equipment is adopted, the monitoring cameras at all the points need to be purchased again, and the problems of high labor cost and long time period of installation and deployment exist.
Disclosure of Invention
The invention aims to overcome the defects of the prior art, and provides an embedded AI video gateway and an implementation method thereof, which can upgrade a security system of a deployed common monitoring camera into a full-intelligent security system with an algorithm function and switchable AI application and the like rapidly and at low cost.
The invention aims at realizing the following scheme:
an embedded AI video gateway comprises a video access module, a video processing module, an algorithm application module and a data proxy module;
the video access module is used for accessing video image data;
the video processing module is used for processing the accessed image data, including direct forwarding of the video data and high-performance protocol conversion and forwarding; the high-performance protocol conversion and forwarding comprises supporting RTSP, onvif, GB28181 protocol conversion, wherein when the RTSP protocol and the GB28181 protocol are converted mutually, after protocol header analysis is completed, the bottom layer directly converts RTP packets and PS stream data; after the Onvif protocol is used for connecting camera equipment, negotiating a video playing address of an Rtsp protocol so as to enable the actual video access to be accessed by the Rtsp protocol;
the algorithm application module is used for synchronously transmitting the video image data to the algorithm application module after the video image data are accessed, a plurality of AI application modes are arranged in the algorithm application model, the AI application modes of the algorithm application module are dynamically switched according to actual scenes, and the identification result information is output after the video image data are processed in the algorithm application module;
and the data proxy module is used for realizing the connection between the external network platform and the internal network equipment.
Further, the video coding formats of the video processing modules are compatible with H264 and H265.
Further, the data proxy module includes a port connected to an extranet environment.
Further, the data proxy module includes a port connected to a private network environment.
Further, a key verification module is included for verifying the key when the external network establishes a connection with each port.
Further, after the connection between the external network platform and the proxy port is established, the data proxy module performs advanced dynamic key verification and communicates after verification.
Further, a license plate recognition algorithm module and a vehicle type recognition algorithm module are arranged in the algorithm application module.
Further, the algorithm application module is provided with a humanoid snapshot algorithm module and a non-motor vehicle recognition algorithm module.
Further, the algorithm application module is provided with a face snapshot algorithm module and a face recognition algorithm module.
The implementation method of the embedded AI video gateway as claimed in any one of the above, comprising the steps of:
s1, video access, wherein image data are input to a video processing module and an algorithm application module;
s2, a plurality of AI application modes are arranged in an algorithm application module, wherein the AI application modes comprise a support mode A: a face is snap shot and recognized; support mode B: license plate recognition and vehicle type recognition; support mode C: human-shaped snapshot and non-motor vehicle identification; after processing in the algorithm application module, entering step S3; processing at a video processing module, comprising: video data is directly forwarded, and high-performance protocol conversion and forwarding are performed; the high-performance protocol conversion and forwarding comprises supporting RTSP, onvif, GB28181 protocol conversion, wherein when the RTSP protocol and the GB28181 protocol are mutually converted, after protocol header analysis is completed, the bottom layer directly converts RTP packets and PS stream data; after the Onvif protocol is used for connecting camera equipment, negotiating a video playing address of an Rtsp protocol so as to enable the actual video access to be accessed by the Rtsp protocol;
and S3, outputting an algorithm identification result of the algorithm application module, wherein the algorithm identification result comprises structural information, pictures and videos.
The beneficial effects of the invention are as follows:
1. according to the invention, the traditional security camera does not need to be replaced, so that the security system of the deployed common monitoring camera can be quickly upgraded to a safe intelligent security system with algorithm function and switchable AI application at low cost;
2. the invention can realize that the external network can watch the video of the internal network equipment in real time, and can realize high-performance protocol conversion and forwarding, and can be connected with platforms of various protocols;
3. the invention has safe data proxy service, can proxy nonstandard (including standard) protocol, is convenient and fast to use, meets the requirements of full-function operation and management of SDK of manufacturers, manages intranet equipment and can ensure network security.
4. The full-intelligent AI gateway realized by the embodiment of the invention can switch any mode aiming at multi-scene application.
5. The embedded AI video gateway realizes video access and forwarding of multiple channels, multiple protocols and multiple coding formats, and supports high-performance protocol conversion and forwarding functions; the AI application switchable full intelligent algorithm application function which can adapt to multiple scenes and the TCP port mapping data proxy function can proxy nonstandard (including standard) protocols.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the description below are only some embodiments of the invention, and that other drawings can be obtained according to these drawings without inventive faculty for a person skilled in the art.
FIG. 1 is a functional block diagram of a system according to an embodiment of the present invention;
fig. 2 is a flow chart of video access and forwarding data according to an embodiment of the present invention;
FIG. 3 is a block diagram of an AI application multi-mode architecture in accordance with an embodiment of the invention;
fig. 4 is a TCP port map data flow chart according to an embodiment of the invention.
Detailed Description
All of the features disclosed in all of the embodiments of this specification, or all of the steps in any method or process disclosed implicitly, except for the mutually exclusive features and/or steps, may be combined and/or expanded and substituted in any way.
The technical conception, the working principle, the efficacy and the working process of the present invention are further described in detail below with reference to fig. 1 to 4.
In the process of solving the problems in the background, the following technical problems are found: the existing security video monitoring scheme related to AI calculation has single application scene, the existing AI service depends on a cloud server, and the working mode is that video files are transmitted to an upper layer to operate, and the real-time performance is not achieved. When video data is accessed, video data transfer files are mostly adopted and transmitted to an AI calculation module for calculation, and then a result is output, and when the equipment is completely idle, the output of the detection result does not contain AI algorithm processing time, delay exists, instantaneity is poor, and the data agent capability is not provided. In addition, in the existing scheme, equipment for transmitting video data to a cloud server in real time is utilized, and the problems of high occupied network bandwidth, high use operation and maintenance cost and the like exist.
The embodiment of the invention aims at least solving the technical problems, provides an embedded AI video gateway, solves the problem of a security system of a deployed common monitoring camera, and can be quickly and cost-effectively upgraded into a full-intelligent security system with an algorithm function and switchable AI application. In a specific implementation process, the embodiment of the invention aims to enable the device to be used as a gateway, and under the condition of internal and external network isolation, the embedded AI video gateway can be compatible with various protocols and various coding formats to access videos in a private network, provide video forwarding, high-performance protocol conversion and forwarding to an external network environment, and provide proxy services of nonstandard and standard protocols for key verification protection. As shown in fig. 1, the system comprises a video processing module, a full intelligent algorithm application module and a data agent module.
The video processing module supports access to videos with multiple manufacturers, multiple protocols and multiple coding formats, and video data is directly forwarded and protocol conversion and forwarding with high performance are achieved. The video processing module supports access to protocols such as RTSP, onvif, GB28181 and the like, the video coding format is compatible with H264 and H265, when the RTSP protocol and the GB28181 protocol are mutually converted, after protocol header analysis is completed, the bottom layer directly converts RTP packets and PS stream data, and the data flow of the functional implementation is shown in the figure 2 and comprises the following steps:
when the video playing address (URL) is known, adopting RTSP protocol to access; in a specific embodiment, chip hard decoding is carried out when AI processing is carried out, and decoded image data enter an AI application module for AI identification; when video forwarding is performed, 1) when the transfer-out protocol is the RTSP protocol, the bottom data stream transfer mode is the complete RTSP protocol direct conversion, only RTCP instruction (command such as control play, pause, continue, stop and the like) related information is needed to be analyzed, the video data of the RTP protocol (decoding recombination package not related to H264 and H265) is not needed to be analyzed, and after protocol header analysis is completed, the video data is directly transferred out in high performance; 2) When the roll-out protocol is GB28181 protocol, after the protocol header analysis is completed, the protocol bottom layer directly converts the video data-RTP protocol packet of the RTSP protocol into PS protocol data of the GB28181 protocol for video transmission, so that the processes of framing, decoding H264 and H265 of the complete RTSP protocol video analysis and converting each frame of image into PS stream are avoided, and high-performance forwarding is realized.
When the device supporting the onvif protocol is accessed, the device can be logged in by using a user name and password through the device searching function of the local area network, and the device is connected, so that the device can be operated, the device can be selected in batches for login connection, and batch operation management can be performed. The AI video gateway applies the onvif protocol, and has the main function of acquiring a video play address (URL), accessing camera equipment in a network by the onvif protocol, negotiating the video play address (URL) of the Rtsp protocol, and accessing video data by the Rtsp protocol.
When the network camera equipment is accessed by using a GB28181 protocol, and AI processing is performed, video data are taken out and then enter an AI application module for AI identification; when video forwarding is performed, 1) when the transfer-out protocol is an RTSP protocol, after protocol header analysis is completed, the PS stream bottom layer of the GB28181 protocol is directly converted into an RTP data packet of the RTSP protocol, and video data converted into the RTSP protocol is subjected to high-performance forwarding; 2) When the transfer-out protocol is GB28181 protocol, the video data at the bottom layer of the protocol is directly transferred into an output PS stream by the accessed PS stream, and is transferred. The conversion of the video protocol is as follows: the RTSP protocol bottom layer protocol is converted into GB28181 protocol, and the GB28181 protocol bottom layer is converted into RTSP protocol.
After the video data is accessed, the image data is synchronously transmitted to a full intelligent algorithm application module, and the full intelligent algorithm application module outputs identification result information. The AI application mode of the full intelligent algorithm application module can be dynamically switched according to the actual scene, and the operation logic is shown in fig. 3, and specifically comprises the following procedures:
when the accessed video channel starts the application of the AI algorithm, the video data of the channel enters an AI application module for AI identification; the user can select a corresponding AI mode according to the actual application scene and the requirements; algorithms included in each mode include, but are not limited to, the algorithms shown in the figures; and multiple algorithms may be used in combination as one pattern if not mutually exclusive. For example: human image mode-can be used for face snapshot recognition; parking lot bayonet mode-license plate snapshot recognition can be performed; the human-vehicle non-mode-can be used for face human-shape snap shot recognition and motor vehicle snap shot recognition and non-motor vehicle snap shot recognition.
Supporting the motor vehicle identification algorithm includes: appearance recognition of motor vehicles, vehicle types (sedans, SUVs, buses, trucks and the like), vehicle colors, license plate recognition (license plate colors, types, license plate numbers and the like), non-motor vehicles, vehicle shape snap shots and the like.
Supporting person identification algorithms includes: appearance of human body (clothes color, etc.), face snap (sex, age, hat, mask, etc.), face recognition;
supporting the electric alarm blocking algorithm comprises: non-motor vehicle violations (without helmets, overload, etc.), motor vehicle violations are identified (without safety belts, on-the-fly phone call, etc.).
The output information of the algorithm application module can be structural information of key features, snap shot identification pictures (key feature small pictures and full-size background large pictures), video data of time periods before and after the snap shot time and data existing in other equipment can be output according to requirements. In the practical application process, the method comprises the following substeps:
SS1, video access, image data input to AI application module;
SS2, processing at AI application module, includes supporting mode a: a face snapshot algorithm and a face recognition algorithm; support mode B: license plate recognition algorithm and vehicle type recognition algorithm; support mode C: a humanoid snapshot algorithm, a non-motor vehicle recognition algorithm and the like;
and SS3, outputting algorithm results, including structural information, pictures, videos and the like.
The data proxy module realizes that the external network platform can operate and manage intranet equipment, when the external network platform establishes connection with a proxy port, strict dynamic key verification is needed, communication can be performed after verification, the communication structure of the data proxy is shown in fig. 4, and the communication structure comprises ports A1, B1, C1 and the like which are connected with an external network environment, and when connection is established with each port, the keys are needed to be verified, and the communication structure comprises ports A2, B2, C2 and the like which are connected with a private network environment, and the communication structure is connected with the equipment through the ports.
Because of network security requirement, the private network environment and the external network cannot be directly communicated, the AI video gateway provides a security check method, each data proxy connection independently operates, and if one proxy is blocked, the normal operation of other proxy connections is not affected.
In the integral design scheme of the embedded AI video gateway, video with multiple channels, protocols and coding formats is accessed and forwarded, and high-performance protocol conversion and forwarding functions are supported; an AI application switchable full intelligent algorithm application function capable of adapting to multiple scenes; the TCP port maps the data proxy function, can proxy nonstandard and standard protocols.
According to the invention, the conventional security cameras are accessed through the AI edge node video server, so that the conventional security equipment can be modified and upgraded. Based on the traditional video gateway, unified bridging among different systems, different network systems, different services and different platforms can be realized, and interconnection and interworking among different network domains and different types of terminal equipment can be ensured. Meanwhile, the AI video gateway provided by the invention can be used as an embedded video gateway device with stronger calculation power, supports the device access of various standard protocols, is compatible with conventional various video formats, supports the video access and forwarding of multiple channels, multiple protocols and multiple coding formats, supports the protocol conversion and forwarding of high performance, and has configurable forwarding authority of each video channel; the AI algorithm can switch a plurality of modes to adapt to different scene requirements; in addition, the embodiment of the invention can provide the data proxy service of TCP port mapping, and can perform proxy of nonstandard and standard protocols after the key security verification. The invention has the following technical advantages:
1. the AI video gateway realized by the embodiment of the invention opens the completely isolated internal and external networks, can access the camera video of the internal network, forward the video to the external network platform for watching with high performance, and the accessed video data can output the detection result in real time; the video and the identification result are synchronously output in real time.
2. The embodiment of the invention supports the security camera international standard protocol onvif protocol, and the AI video gateway supports the onvif protocol, so that IPC equipment in an intranet local area network can be directly searched and added, batch operation is carried out, and the video related protocol is involved after the camera is accessed.
The AI video gateway realized by the embodiment of the invention does not limit the video resolution, can realize 100 paths of video access, and transmits 40 paths of concurrent videos, and 16 paths of concurrent AI algorithm; video protocol depth optimization, conversion of underlying protocols RTCP, RTP teardown to other protocols, etc.
4. The AI video gateway of the embodiment of the invention has rich algorithm capability.
5. The TCP proxy service of the AI video gateway realized by the invention supports the complete transparent transmission of various protocols, and the external network platform can use the management software of the internal network equipment factory or the SDK of the IPC factory to carry out connection configuration without additional development work only by configuring the proxy table.
Example 1
An embedded AI video gateway comprises a video access module, a video processing module, an algorithm application module and a data proxy module;
the video access module is used for accessing video image data;
the video processing module is used for processing the accessed image data, including direct forwarding of the video data and high-performance protocol conversion and forwarding; the high-performance protocol conversion and forwarding comprises supporting RTSP, onvif, GB28181 protocol conversion, wherein when the RTSP protocol and the GB28181 protocol are converted mutually, after protocol header analysis is completed, the bottom layer directly converts RTP packets and PS stream data; after the Onvif protocol is used for connecting camera equipment, negotiating a video playing address of an Rtsp protocol so as to enable the actual video access to be accessed by the Rtsp protocol;
the algorithm application module is used for synchronously transmitting the video image data to the algorithm application module after the video image data are accessed, a plurality of AI application modes are arranged in the algorithm application model, the AI application modes of the algorithm application module are dynamically switched according to actual scenes, and the identification result information is output after the video image data are processed in the algorithm application module;
and the data proxy module is used for realizing the connection between the external network platform and the internal network equipment.
In an actual application process, in an alternative implementation manner, the video coding format of the video processing module is compatible with H264 and H265.
In an actual application process, in an optional implementation manner, the data proxy module includes a port connected with an external network environment.
In an actual application process, in an optional implementation manner, the data proxy module includes a port connected with a private network environment.
In the practical application process, the optional implementation manner includes a key verification module, which is used for verifying the key when the external network establishes a connection with each port.
In an optional implementation manner, the data proxy module performs advanced dynamic key verification after the connection between the external network platform and the proxy port is established, and performs communication after verification.
In the practical application process, in an optional implementation manner, a license plate recognition algorithm module and a vehicle type recognition algorithm module are arranged in the algorithm application module.
In the practical application process, in an optional implementation manner, the algorithm application module is provided with a humanoid snapshot algorithm module and a non-motor vehicle identification algorithm module.
In the practical application process, in an optional implementation manner, the algorithm application module is provided with a face snapshot algorithm module and a face recognition algorithm module.
Example 2
The implementation method of the embedded AI video gateway as claimed in any one of the above, comprising the steps of:
s1, video access, wherein image data are input to a video processing module and an algorithm application module;
s2, a plurality of AI application modes are arranged in an algorithm application module, wherein the AI application modes comprise a support mode A: a face is snap shot and recognized; support mode B: license plate recognition and vehicle type recognition; support mode C: human-shaped snapshot and non-motor vehicle identification; after processing in the algorithm application module, entering step S3; processing at a video processing module, comprising: video data is directly forwarded, and high-performance protocol conversion and forwarding are performed; the high-performance protocol conversion and forwarding comprises supporting RTSP, onvif, GB28181 protocol conversion, wherein when the RTSP protocol and the GB28181 protocol are mutually converted, after protocol header analysis is completed, the bottom layer directly converts RTP packets and PS stream data; after the Onvif protocol is used for connecting camera equipment, negotiating a video playing address of an Rtsp protocol so as to enable the actual video access to be accessed by the Rtsp protocol;
and S3, outputting an algorithm identification result of the algorithm application module, wherein the algorithm identification result comprises structural information and pictures.
The invention is not related in part to the same as or can be practiced with the prior art.
The foregoing technical solution is only one embodiment of the present invention, and various modifications and variations can be easily made by those skilled in the art based on the application methods and principles disclosed in the present invention, not limited to the methods described in the foregoing specific embodiments of the present invention, so that the foregoing description is only preferred and not in a limiting sense.
In addition to the foregoing examples, those skilled in the art will recognize from the foregoing disclosure that other embodiments can be made and in which various features of the embodiments can be interchanged or substituted, and that such modifications and changes can be made without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (9)
1. The implementation method of the embedded AI video gateway is characterized in that the embedded AI video gateway comprises a video access module, a video processing module, an algorithm application module and a data proxy module;
the video access module is used for accessing video image data;
the video processing module is used for processing the accessed image data, including direct forwarding of the video data and high-performance protocol conversion and forwarding; the high-performance protocol conversion and forwarding comprises supporting RTSP, onvif, GB28181 protocol conversion, wherein when the RTSP protocol and the GB28181 protocol are converted mutually, after protocol header analysis is completed, the bottom layer directly converts RTP packets and PS stream data; after the Onvif protocol is used for connecting camera equipment, negotiating a video playing address of an Rtsp protocol so as to enable the actual video access to be accessed by the Rtsp protocol;
the algorithm application module is used for synchronously transmitting the video image data to the algorithm application module after the video image data are accessed, wherein a plurality of AI application modes are arranged in the algorithm application module, the AI application modes of the algorithm application module are dynamically switched according to actual scenes, and the identification result information is output after the video image data are processed in the algorithm application module;
the data proxy module is used for realizing the connection between the external network platform and the internal network equipment; the method comprises the following steps:
s1, video access, wherein image data are input to a video processing module and an algorithm application module;
s2, a plurality of AI application modes are arranged in an algorithm application module, wherein the AI application modes comprise a support mode A: a face is snap shot and recognized; support mode B: license plate recognition and vehicle type recognition; support mode C: human-shaped snapshot and non-motor vehicle identification; after processing in the algorithm application module, entering step S3; processing at a video processing module, comprising: video data is directly forwarded, and high-performance protocol conversion and forwarding are performed; the high-performance protocol conversion and forwarding comprises supporting RTSP, onvif, GB28181 protocol conversion, wherein when the RTSP protocol and the GB28181 protocol are mutually converted, after protocol header analysis is completed, the bottom layer directly converts RTP packets and PS stream data; after the Onvif protocol is used for connecting camera equipment, negotiating a video playing address of an Rtsp protocol so as to enable the actual video access to be accessed by the Rtsp protocol;
and S3, outputting an algorithm identification result of the algorithm application module, wherein the algorithm identification result comprises structural information, pictures and videos.
2. The method of claim 1, wherein the video coding format of the video processing module is H264 and H265 compatible.
3. The method of claim 1, wherein the data proxy module comprises a port for connection to an extranet environment.
4. The method of any of claims 1 or 3, wherein the data proxy module comprises a port connected to a private network environment.
5. The method for implementing an embedded AI video gateway of claim 3 including a key verification module for verifying a key when the external network establishes a connection with each port.
6. The method of claim 1, wherein the data proxy module performs advanced dynamic key verification after the connection between the external network platform and the proxy port is established, and performs communication after verification.
7. The method for implementing an embedded AI video gateway of claim 1, wherein a license plate recognition algorithm module and a vehicle model recognition algorithm module are provided in the algorithm application module.
8. The method for implementing an embedded AI video gateway of claim 1, wherein the algorithm application module is provided with a humanoid snapshot algorithm module and a non-motor vehicle recognition algorithm module.
9. The method for implementing an embedded AI video gateway of claim 1, wherein the algorithm application module is provided with a face snapshot algorithm module and a face recognition algorithm module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210137227.5A CN114745229B (en) | 2022-02-15 | 2022-02-15 | Embedded AI video gateway and implementation method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210137227.5A CN114745229B (en) | 2022-02-15 | 2022-02-15 | Embedded AI video gateway and implementation method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114745229A CN114745229A (en) | 2022-07-12 |
| CN114745229B true CN114745229B (en) | 2024-04-12 |
Family
ID=82274975
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210137227.5A Active CN114745229B (en) | 2022-02-15 | 2022-02-15 | Embedded AI video gateway and implementation method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114745229B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117459792B (en) * | 2023-12-20 | 2024-04-26 | 深圳市奔迈科技有限公司 | Video processing method and AI box based on visual algorithm |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109151394A (en) * | 2018-10-09 | 2019-01-04 | 成都云格致力科技有限公司 | A kind of general video monitoring system that supporting terminal cross-platform interchange and monitoring method |
| CN110519641A (en) * | 2019-09-10 | 2019-11-29 | 深圳市同洲电子股份有限公司 | A kind of the video fusion transmission exchange system and method for multi-source multi-protocols |
| CN110532882A (en) * | 2019-07-30 | 2019-12-03 | 长江大学 | Recognition of face safety alarm system and equipment based on embedded artificial intelligent chip |
| CN111541875A (en) * | 2020-05-14 | 2020-08-14 | 深圳市康拓普信息技术有限公司 | Electric power video monitoring video network platform |
| CN111770306A (en) * | 2020-05-22 | 2020-10-13 | 深圳奇迹智慧网络有限公司 | Scene monitoring method and device, computer equipment and storage medium |
| CN112866199A (en) * | 2020-12-31 | 2021-05-28 | 北京优锘科技有限公司 | Method for viewing device supporting GB/T28181 protocol in main stream browser |
| CN113194292A (en) * | 2021-04-30 | 2021-07-30 | 招商局金融科技有限公司 | Coordination management method, device, equipment and storage medium for intelligent equipment |
| CN113851013A (en) * | 2021-08-06 | 2021-12-28 | 厦门识图科技有限公司 | Vehicle data processing system and method for multiple parking lots |
-
2022
- 2022-02-15 CN CN202210137227.5A patent/CN114745229B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109151394A (en) * | 2018-10-09 | 2019-01-04 | 成都云格致力科技有限公司 | A kind of general video monitoring system that supporting terminal cross-platform interchange and monitoring method |
| CN110532882A (en) * | 2019-07-30 | 2019-12-03 | 长江大学 | Recognition of face safety alarm system and equipment based on embedded artificial intelligent chip |
| CN110519641A (en) * | 2019-09-10 | 2019-11-29 | 深圳市同洲电子股份有限公司 | A kind of the video fusion transmission exchange system and method for multi-source multi-protocols |
| CN111541875A (en) * | 2020-05-14 | 2020-08-14 | 深圳市康拓普信息技术有限公司 | Electric power video monitoring video network platform |
| CN111770306A (en) * | 2020-05-22 | 2020-10-13 | 深圳奇迹智慧网络有限公司 | Scene monitoring method and device, computer equipment and storage medium |
| CN112866199A (en) * | 2020-12-31 | 2021-05-28 | 北京优锘科技有限公司 | Method for viewing device supporting GB/T28181 protocol in main stream browser |
| CN113194292A (en) * | 2021-04-30 | 2021-07-30 | 招商局金融科技有限公司 | Coordination management method, device, equipment and storage medium for intelligent equipment |
| CN113851013A (en) * | 2021-08-06 | 2021-12-28 | 厦门识图科技有限公司 | Vehicle data processing system and method for multiple parking lots |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114745229A (en) | 2022-07-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101536141B1 (en) | Apparatus and method for converting signal between ethernet and can in a vehicle | |
| US7882254B2 (en) | Common protocol layer architecture and methods for transmitting data between different network protocols and a common protocol packet | |
| CN108696424A (en) | Vehicle communication system | |
| CN1207862A (en) | Crossbar/hub arrangement for multimedia network | |
| CN110225071A (en) | Vehicle intelligent gateway and automobile | |
| CN114745229B (en) | Embedded AI video gateway and implementation method thereof | |
| CN114339719B (en) | DPI data acquisition method and related device | |
| KR102275144B1 (en) | Can frame-ethernet packet converting method in domain control unit | |
| CN110035297B (en) | Video processing method and device | |
| CN109150829B (en) | Software-defined cloud network trusted data distribution method, readable storage medium and terminal | |
| CN207926649U (en) | Vehicle intelligent gateway and automobile | |
| CN207926623U (en) | Vehicle netbios and automobile | |
| CN107835509A (en) | A kind of method, apparatus, system, equipment and the storage medium of equipment room interconnection | |
| CN108900518B (en) | Credible software-defined cloud network data distribution system | |
| CN112351355B (en) | Management method and system of ONU channel based on gPC | |
| CN115865835A (en) | Master and backup exchange board, interface board, exchange system and state summarizing method thereof | |
| CN109150724A (en) | A kind of communication means and network interface card | |
| CN112235663B (en) | System-on-chip for realizing fusion of optical network unit and set top box | |
| CN113381988B (en) | Unmanned aerial vehicle data access security isolation system with CPU heterogeneous architecture | |
| KR101851362B1 (en) | Service Terminal Capable of Connecting LPWAN Network and Black-Box Installed in the Car and Method thereof | |
| KR101990859B1 (en) | Service Terminal Capable of Connecting LPWAN Network and Black-Box Installed in the Car and Method thereof | |
| KR101797151B1 (en) | Service Terminal Capable of Connecting LPWAN Network and Black-Box Installed in the Car and Method thereof | |
| CN110418096B (en) | Data processing method and device for video network | |
| CN111030939B (en) | Method and device for realizing IPFIX output based on chip | |
| KR101224991B1 (en) | The cctv telling about a number of small moving vehicles |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |