CN114745229A - Embedded AI video gateway and implementation method thereof - Google Patents
Embedded AI video gateway and implementation method thereof Download PDFInfo
- Publication number
- CN114745229A CN114745229A CN202210137227.5A CN202210137227A CN114745229A CN 114745229 A CN114745229 A CN 114745229A CN 202210137227 A CN202210137227 A CN 202210137227A CN 114745229 A CN114745229 A CN 114745229A
- Authority
- CN
- China
- Prior art keywords
- video
- module
- algorithm
- protocol
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 238000012545 processing Methods 0.000 claims abstract description 33
- 238000006243 chemical reaction Methods 0.000 claims description 33
- 238000012795 verification Methods 0.000 claims description 12
- 238000004458 analytical method Methods 0.000 claims description 7
- 238000004891 communication Methods 0.000 claims description 5
- 238000012544 monitoring process Methods 0.000 abstract description 9
- 238000004364 calculation method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/61—Network physical structure; Signal processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses an embedded AI video gateway and a realization method thereof, belonging to the technical field of security protection, comprising a video access module, a video processing module, an algorithm application module and a data agent module; the video access module is used for accessing video image data; the video processing module is used for processing the accessed image data; the algorithm application module is used for synchronously transmitting the video image data to the algorithm application module after the video image data is accessed, a plurality of AI application modes are arranged in the algorithm application module, the AI application modes of the algorithm application module are dynamically switched according to actual scenes, and the video image data are processed in the algorithm application module and then output identification result information; and the data agent module is used for realizing the connection between the external network platform and the internal network equipment. The invention can rapidly upgrade the security system with the deployed common monitoring camera into the full-intelligent security system with algorithm function and switchable AI application at low cost.
Description
Technical Field
The invention relates to the technical field of security protection, in particular to an embedded AI video gateway and an implementation method thereof.
Background
At present, common security monitoring cameras have been deployed in many security environments, but along with the rapid development of science and technology, AI full-intelligent security monitoring cameras have matured. The traditional security monitoring camera needs to be upgraded to an AI full intelligent security system with an algorithm function urgently. If the scheme of replacing all monitoring devices is adopted, monitoring cameras of all point positions need to be purchased again, and the problems of high labor cost for installation and deployment and long time period exist.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides an embedded AI video gateway and an implementation method thereof, which can be used for rapidly upgrading a security system with a deployed common monitoring camera into a fully intelligent security system with an algorithm function and switchable AI application and the like at low cost.
The purpose of the invention is realized by the following scheme:
an embedded AI video gateway comprises a video access module, a video processing module, an algorithm application module and a data agent module;
the video access module is used for accessing video image data;
the video processing module is used for processing the accessed image data, and comprises direct forwarding of the video data and high-performance protocol conversion and forwarding; the high-performance protocol conversion and forwarding comprises the support of RTSP, Onvif and GB28181 protocol conversion, wherein when the RTSP protocol and the GB28181 protocol are mutually converted, the bottom layer directly performs RTP packet and PS stream data conversion after the protocol head analysis is completed; after the Onvif protocol is used for connecting the camera equipment, a video playing address of an Rtsp protocol is negotiated, so that the actual video access is accessed by the Rtsp protocol;
the algorithm application module is used for synchronously transmitting the video image data to the algorithm application module after the video image data is accessed, a plurality of AI application modes are arranged in the algorithm application module, the AI application modes of the algorithm application module are dynamically switched according to actual scenes, and the video image data is processed in the algorithm application module and then recognition result information is output;
and the data agent module is used for realizing the connection between the external network platform and the internal network equipment.
Further, the video coding format of the video processing module is compatible with H264 and H265.
Further, the data agent module includes a port for connection to an extranet environment.
Further, the data proxy module includes a port to connect with a private network environment.
Further, the device comprises a key checking module for checking the key when the external network establishes connection with each port.
Furthermore, after the connection between the external network platform and the agent port is established, the data agent module firstly performs dynamic key verification and performs communication after the verification.
Furthermore, a license plate recognition algorithm module and a vehicle type recognition algorithm module are arranged in the algorithm application module.
Furthermore, a humanoid snapshot algorithm module and a non-motor vehicle identification algorithm module are arranged in the algorithm application module.
Furthermore, a face snapshot algorithm module and a face recognition algorithm module are arranged in the algorithm application module.
An implementation method of the embedded AI video gateway includes the following steps:
s1, video access, image data input to the video processing module and the algorithm application module;
s2, setting a plurality of AI application modes in the algorithm application module, including a support mode A: face snapshot and face recognition; mode B is supported: recognizing license plates and vehicle types; support mode C: human-shaped snapshot and non-motor vehicle identification; after the processing in the algorithm application module, the process proceeds to step S3; processing at a video processing module, comprising: direct forwarding of video data and high-performance protocol conversion and forwarding; the high-performance protocol conversion and forwarding comprises the steps of supporting RTSP, Onvif and GB28181 protocol conversion, and when the RTSP protocol and the GB28181 protocol are mutually converted, after the protocol head analysis is completed, the bottom layer directly performs RTP packet and PS stream data conversion; after the Onvif protocol is used for connecting the camera equipment, a video playing address of an Rtsp protocol is negotiated, so that the actual video access is accessed by the Rtsp protocol;
and S3, outputting the algorithm identification result of the algorithm application module, wherein the algorithm identification result comprises structural information, pictures and videos.
The invention has the beneficial effects that:
1. the invention does not need to replace the traditional security camera, and can quickly upgrade the security system with the deployed ordinary monitoring camera into a full-intelligent security system with algorithm function and switchable AI application;
2. the invention can realize that the outer network can watch the video of the inner network equipment in real time, the protocol conversion and forwarding with high performance can be realized, and the invention can be connected with platforms of various protocols;
3. the invention has safe data proxy service, can proxy non-standard (including standard) protocols, is convenient, quick and safe, meets the requirement of full-function operation and management of intranet equipment of SDK of manufacturers, and can ensure the network safety.
4. The fully intelligent AI gateway realized by the embodiment of the invention can switch any mode aiming at the application of multiple scenes.
5. The embedded AI video gateway realizes the video access and forwarding of multiple channels, multiple protocols and multiple coding formats, and supports the high-performance protocol conversion and forwarding functions; the adaptive multi-scenario AI application switchable full-intelligent algorithm application function and the TCP port mapping data proxy function can proxy non-standard (including standard) protocols.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a functional block diagram of a system according to an embodiment of the present invention;
fig. 2 is a video access and forwarding data flow diagram according to an embodiment of the present invention;
FIG. 3 is a block diagram of an AI application multimodal architecture in accordance with an embodiment of the present invention;
fig. 4 is a TCP port mapping data flow diagram according to an embodiment of the present invention.
Detailed Description
All features disclosed in all embodiments in this specification, or all methods or process steps implicitly disclosed, may be combined and/or expanded, or substituted, in any way, except for mutually exclusive features and/or steps.
The technical concept, operation principle, efficacy and operation of the present invention will be further described in detail with reference to the accompanying drawings 1 to 4.
In the process of solving the problems in the background, the following technical problems are found: the existing security protection video monitoring scheme related to AI calculation has a single application scene, the existing AI service depends on a cloud server, the working mode of the existing AI service is to transmit a video file to an upper layer for operation, and the existing AI service does not have real-time performance. Moreover, when video data is accessed, the video data is mostly transferred to an AI calculation module for calculation by adopting a video data dump file, and then a result is output. In addition, in the existing scheme, the device for transmitting the video data to the cloud server in real time has the problems of high occupied network bandwidth, high use, operation and maintenance cost and the like.
The embodiment of the invention aims to at least solve the technical problems and provides an embedded AI video gateway, which solves the problem that a security system of a deployed common monitoring camera can be rapidly upgraded into a fully intelligent security system with an algorithm function and switchable AI application at low cost. In a specific implementation process, the purpose of the embodiments of the present invention is to enable a device to be used as a gateway, where an embedded AI video gateway is compatible with multiple protocols and multiple coding formats to access a video in a private network under the condition of internal and external network isolation, and provides video forwarding, high-performance protocol conversion and forwarding to an external network environment, and provides a non-standard and standard protocol proxy service for key verification protection. As shown in fig. 1, the system comprises a video processing module, a full intelligent algorithm application module and a data agent module.
The video processing module supports accessing of videos with multiple manufacturers, multiple protocols and multiple coding formats, direct forwarding of video data and high-performance protocol conversion and forwarding. The video processing module supports access to RTSP, Onvif, GB28181 and other protocols, the video coding format is compatible with H264, H265, when the RTSP protocol and GB28181 protocol are mutually converted, after the protocol header is analyzed, the bottom layer directly performs the RTP packet and PS stream data conversion, the data flow for the above function implementation is as shown in fig. 2, and includes the following flows:
when a video playing address (URL) is known, adopting an RTSP protocol for access; in the specific embodiment, chip hard decoding is carried out during AI processing, and the decoded image data enters an AI application module for AI identification; when video forwarding is carried out, 1) when the transfer-out protocol is the RTSP, the bottom layer data stream transfer mode is complete RTSP direct conversion, only the related information of RTCP instructions (commands for controlling playing, pausing, continuing, stopping and the like) is needed to be analyzed, the video data of an RTP protocol (not related to decoding recombination packets of H264 and H265) is not needed to be analyzed, and after the protocol head is analyzed, the video data is directly transferred out in high performance; 2) when the protocol of the transfer-out is GB28181, after the protocol head is analyzed, the protocol bottom layer directly converts the video data-RTP protocol packet of the RTSP protocol into the PS protocol data of the GB28181 protocol for video transmission, so that the process of framing of the complete RTSP protocol video analysis, decoding of H264 and H265, and then converting each frame of image into PS stream is avoided, and high-performance forwarding is realized.
When accessing the device supporting the onvif protocol, the user can log in the device by using the user name and the password through the device searching function of the local area network, connect the device, further operate the device, select the device in batches to log in and connect, and perform batch operation management. The AI video gateway applies an onvif protocol, and has the main functions of acquiring a video playing address (URL), accessing camera equipment in a network by using the onvif protocol, negotiating the video playing address (URL) of the Rtsp protocol, and accessing video data by using the Rtsp protocol.
When the network camera equipment is accessed by a GB28181 protocol and is subjected to AI processing, the data after the video data is taken out enters an AI application module for AI identification; when video forwarding is performed, 1) when the transfer-out protocol is an RTSP protocol, after the protocol header is analyzed, the PS stream bottom layer of the GB28181 protocol is directly converted into an RTP data packet of the RTSP protocol, and video data converted into the RTSP protocol is subjected to high-performance forwarding; 2) when the transfer-out protocol is the GB28181 protocol, the video data at the bottom layer of the protocol directly uses the accessed PS stream as the output PS stream for transferring. Conversion of video protocol: the RTSP protocol bottom layer protocol is converted into a GB28181 protocol, and the GB28181 protocol bottom layer is converted into the RTSP protocol.
After the video data is accessed, the image data is synchronously transmitted to the full intelligent algorithm application module, and the full intelligent algorithm application module outputs identification result information. The AI application mode of the fully intelligent algorithm application module may be dynamically switched according to an actual scene, and the operation logic is as shown in fig. 3, and specifically includes the following processes:
when an accessed video channel starts an AI algorithm application, video data of the channel enters an AI application module for AI identification; the user can select a corresponding AI mode according to the actual application scene and requirements; the algorithms contained in each mode, including but not limited to the algorithms shown in the figures; and if not mutually exclusive, a plurality of algorithms may be used in combination as one mode. For example: portrait mode-can be face snapshot recognition; the parking lot is in a bayonet mode, and license plate snapshot recognition can be performed; the human-vehicle non-mode can be used for face human shape snapshot recognition, motor vehicle snapshot recognition and non-motor vehicle snapshot recognition.
The support motor vehicle identification algorithm comprises: appearance recognition of motor vehicles, vehicle type (cars, SUVs, buses, trucks, etc.), vehicle color, license plate recognition (license plate color, type, license plate number, etc.), non-motor vehicles, vehicle shape capture, etc.
The algorithm for supporting human recognition comprises the following steps: human-shaped appearance (characteristics such as clothes color), face snapshot (characteristics such as gender, age, hat, mask and the like), face recognition;
the algorithm for supporting the electric police card comprises the following steps: non-motor vehicle law violation (no helmet, overload, etc.), motor vehicle law violation identification (no safety belt, driving to make a call, etc.).
The output information of the algorithm application module can be structural information of key features + snapshot identification pictures (key feature small pictures + full-size background large pictures), and video data of periods before and after the snapshot time and data existing in other equipment can be output according to requirements. In the practical application process, the method comprises the following substeps:
SS1, video access, image data input to AI application module;
SS2, processing at the AI application module, including supporting mode a: a face snapshot algorithm and a face recognition algorithm; mode B is supported: a license plate recognition algorithm and a vehicle type recognition algorithm; support mode C: a humanoid snap-shot algorithm, a non-motor vehicle recognition algorithm, and the like;
SS3, algorithm result output, including structured information, pictures and videos.
The data agent module realizes that the outer network platform can operate and manage the intranet equipment, when the outer network platform establishes connection with the agent port, strict dynamic key verification is needed firstly, communication can be carried out after verification, the communication structure of the data agent is shown in fig. 4 and comprises a port A1, a port B1, a port C1 and the like which are connected with the outer network environment, when connection is established with each port, a key is needed to be verified, and the data agent module comprises a port A2, a port B2, a port C2 and the like which are connected with the private network environment, and equipment is connected through the ports.
Because the special network environment and the external network can not directly communicate with each other due to the network security requirement, the AI video gateway of the invention provides a security verification method, each data agent connection operates independently, and if a certain agent is blocked, the normal operation of other agent connections can not be influenced.
The video access and forwarding of multi-channel, multi-protocol and multi-coding formats in the overall design scheme of the embedded AI video gateway supports high-performance protocol conversion and forwarding functions; the method comprises the following steps of (1) adapting to a switchable full-intelligent algorithm application function of multi-scene AI application; the TCP port maps the data proxy function and can proxy a non-standard and standard protocol.
According to the invention, the traditional security camera is accessed through the AI edge node video server, so that the traditional security equipment can be modified and upgraded. Based on the traditional video gateway, the unified bridging among different systems, different network systems, different services and different platforms can be realized, and the interconnection and the intercommunication among different network domains and different types of terminal equipment are ensured. Meanwhile, the AI video gateway provided by the invention can be used as embedded video gateway equipment with strong calculation power, supports equipment access of various standard protocols, is compatible with various conventional video formats, supports video access and forwarding of multiple channels, multiple protocols and multiple coding formats, supports high-performance protocol conversion and forwarding, and can configure forwarding permission of each video channel; the AI algorithm can switch a plurality of modes and adapt to different scene requirements; in addition, the embodiment of the invention can provide the data proxy service mapped by the TCP port, and can carry out the proxy of the non-standard and standard protocols after the key security verification is carried out. The invention has the following technical advantages:
1. the AI video gateway realized by the embodiment of the invention gets through the completely isolated internal and external networks, can access the camera video of the internal network, can forward the high performance to the external network platform for watching, and can output the detection result in real time by the accessed video data; the video and the recognition result are synchronously output in real time.
2. The embodiment of the invention supports an onvif protocol of an international standard protocol of a security camera, the AI video gateway supports the onvif protocol, IPC equipment in an intranet local area network can be directly searched and added, batch operation is carried out, and the camera is connected to a video related protocol.
3, the AI video gateway realized by the embodiment of the invention does not limit the video resolution, can realize 100 paths of video access, 40 paths of concurrent video forwarding and 16 paths of concurrent AI algorithm; and deeply optimizing a video protocol, and converting a bottom layer protocol RTCP and RTP into other protocols.
4. The AI video gateway of the embodiment of the invention has rich algorithm capability.
5. The TCP proxy service of the AI video gateway realized by the invention supports the complete transparent transmission of a plurality of protocols, and the external network platform can use the management software of the original factory of the internal network equipment or the SDK of the IPC factory to carry out connection configuration only by configuring the proxy table without additional development work.
Example 1
An embedded AI video gateway comprises a video access module, a video processing module, an algorithm application module and a data agent module;
the video access module is used for accessing video image data;
the video processing module is used for processing the accessed image data, and comprises direct forwarding of the video data and high-performance protocol conversion and forwarding; the high-performance protocol conversion and forwarding comprises the support of RTSP, Onvif and GB28181 protocol conversion, wherein when the RTSP protocol and the GB28181 protocol are mutually converted, the bottom layer directly performs RTP packet and PS stream data conversion after the protocol head analysis is completed; after the Onvif protocol is used for connecting the camera equipment, a video playing address of an Rtsp protocol is negotiated, so that the actual video access is accessed by the Rtsp protocol;
the algorithm application module is used for synchronously transmitting the video image data to the algorithm application module after the video image data is accessed, a plurality of AI application modes are arranged in the algorithm application module, the AI application modes of the algorithm application module are dynamically switched according to actual scenes, and the video image data is processed in the algorithm application module and then recognition result information is output;
and the data agent module is used for realizing the connection between the external network platform and the internal network equipment.
In practical applications, in an optional embodiment, the video encoding format of the video processing module is compatible with H264 and H265.
In an optional implementation manner, the data proxy module includes a port connected to an external network environment.
In an optional implementation manner, in the practical application process, the data proxy module includes a port connected to a private network environment.
In an actual application process, an optional embodiment includes a key verification module, configured to verify a key when an external network establishes a connection with each port.
In an optional implementation manner, in the actual application process, after the data proxy module establishes connection between the external network platform and the proxy port, the dynamic key is verified first, and communication is performed after verification.
In the practical application process, in an optional implementation manner, the algorithm application module is provided with a license plate recognition algorithm module and a vehicle type recognition algorithm module.
In an optional implementation manner, in the actual application process, a humanoid snap-shot algorithm module and a non-motor vehicle recognition algorithm module are arranged in the algorithm application module.
In an actual application process, in an optional implementation manner, the algorithm application module is provided with a face snapshot algorithm module and a face recognition algorithm module.
Example 2
An implementation method of the embedded AI video gateway described in any one of the above embodiments includes the steps of:
s1, video access, image data input to the video processing module and the algorithm application module;
s2, setting a plurality of AI application modes in the algorithm application module, including a support mode A: face snapshot and face recognition; mode B is supported: identifying license plates and vehicle types; support mode C: human-shaped snapshot and non-motor vehicle identification; after the processing in the algorithm application module, the process proceeds to step S3; processing at a video processing module, comprising: direct forwarding of video data and high-performance protocol conversion and forwarding; the high-performance protocol conversion and forwarding comprises the steps of supporting RTSP, Onvif and GB28181 protocol conversion, and when the RTSP protocol and the GB28181 protocol are converted mutually, after the protocol head analysis is completed, the bottom layer directly performs RTP packet and PS stream data conversion; after the Onvif protocol is used for connecting the camera equipment, a video playing address of an Rtsp protocol is negotiated, so that the actual video access is accessed by the Rtsp protocol;
and S3, outputting the algorithm identification result of the algorithm application module, wherein the algorithm identification result comprises structural information and pictures.
The parts not involved in the present invention are the same as or can be implemented using the prior art.
The above-described embodiment is only one embodiment of the present invention, and it will be apparent to those skilled in the art that various modifications and variations can be easily made based on the application and principle of the present invention disclosed in the present application, and the present invention is not limited to the method described in the above-described embodiment of the present invention, so that the above-described embodiment is only preferred, and not restrictive.
Other embodiments than the above examples may be devised by those skilled in the art based on the foregoing disclosure, or by adapting and using knowledge or techniques of the relevant art, and features of various embodiments may be interchanged or substituted and such modifications and variations that may be made by those skilled in the art without departing from the spirit and scope of the present invention are intended to be within the scope of the following claims.
Claims (10)
1. An embedded AI video gateway is characterized by comprising a video access module, a video processing module, an algorithm application module and a data agent module;
the video access module is used for accessing video image data;
the video processing module is used for processing the accessed image data, and comprises direct forwarding of the video data and high-performance protocol conversion and forwarding; the high-performance protocol conversion and forwarding comprises the support of RTSP, Onvif and GB28181 protocol conversion, wherein when the RTSP protocol and the GB28181 protocol are mutually converted, the bottom layer directly performs RTP packet and PS stream data conversion after the protocol head analysis is completed; after the Onvif protocol is used for connecting the camera equipment, a video playing address of an Rtsp protocol is negotiated, so that the actual video access is accessed by the Rtsp protocol;
the algorithm application module is used for synchronously transmitting the video image data to the algorithm application module after the video image data is accessed, a plurality of AI application modes are arranged in the algorithm application module, the AI application modes of the algorithm application module are dynamically switched according to actual scenes, and the video image data is processed in the algorithm application module and then recognition result information is output;
and the data agent module is used for realizing the connection between the external network platform and the internal network equipment.
2. The embedded AI video gateway of claim 1, wherein the video encoding format of the video processing module is H264, H265 compatible.
3. The embedded AI video gateway of claim 1, wherein the data proxy module includes a port to connect to an extranet environment.
4. The embedded AI video gateway of any of claims 1 or 3, wherein the data proxy module includes a port to connect with a private network environment.
5. The embedded AI video gateway of claim 3, comprising a key verification module configured to verify a key when the external network establishes a connection with each port.
6. The embedded AI video gateway of claim 1, wherein the data proxy module performs dynamic key verification after the connection between the extranet platform and the proxy port is established, and performs communication after the verification.
7. The embedded AI video gateway of claim 1, wherein the algorithm application module includes a license plate recognition algorithm module and a vehicle type recognition algorithm module.
8. The embedded AI video gateway of claim 1, wherein the algorithm application module has a humanoid snap algorithm module and a non-motor vehicle recognition algorithm module disposed therein.
9. The embedded AI video gateway of claim 1, wherein the algorithm application module includes a face snapshot algorithm module and a face recognition algorithm module.
10. An implementation method of the embedded AI video gateway according to any one of claims 1 to 9, comprising the steps of:
s1, video access, image data input to the video processing module and the algorithm application module;
s2, setting a plurality of AI application modes in the algorithm application module, including a support mode A: face snapshot and face recognition; mode B is supported: recognizing license plates and vehicle types; support mode C: human-shaped snapshot and non-motor vehicle identification; after the processing in the algorithm application module, the process proceeds to step S3; processing at a video processing module, comprising: direct forwarding of video data and high-performance protocol conversion and forwarding; the high-performance protocol conversion and forwarding comprises the steps of supporting RTSP, Onvif and GB28181 protocol conversion, and when the RTSP protocol and the GB28181 protocol are mutually converted, after the protocol head analysis is completed, the bottom layer directly performs RTP packet and PS stream data conversion; after the Onvif protocol is used for connecting the camera equipment, a video playing address of an Rtsp protocol is negotiated, so that the actual video access is accessed by the Rtsp protocol;
and S3, outputting the algorithm identification result of the algorithm application module, wherein the algorithm identification result comprises structural information, pictures and videos.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210137227.5A CN114745229B (en) | 2022-02-15 | 2022-02-15 | Embedded AI video gateway and implementation method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210137227.5A CN114745229B (en) | 2022-02-15 | 2022-02-15 | Embedded AI video gateway and implementation method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114745229A true CN114745229A (en) | 2022-07-12 |
| CN114745229B CN114745229B (en) | 2024-04-12 |
Family
ID=82274975
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210137227.5A Active CN114745229B (en) | 2022-02-15 | 2022-02-15 | Embedded AI video gateway and implementation method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114745229B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117459792A (en) * | 2023-12-20 | 2024-01-26 | 深圳市奔迈科技有限公司 | Video processing method and AI box based on visual algorithm |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109151394A (en) * | 2018-10-09 | 2019-01-04 | 成都云格致力科技有限公司 | A kind of general video monitoring system that supporting terminal cross-platform interchange and monitoring method |
| CN110519641A (en) * | 2019-09-10 | 2019-11-29 | 深圳市同洲电子股份有限公司 | A kind of the video fusion transmission exchange system and method for multi-source multi-protocols |
| CN110532882A (en) * | 2019-07-30 | 2019-12-03 | 长江大学 | Recognition of face safety alarm system and equipment based on embedded artificial intelligent chip |
| CN111541875A (en) * | 2020-05-14 | 2020-08-14 | 深圳市康拓普信息技术有限公司 | Electric power video monitoring video network platform |
| CN111770306A (en) * | 2020-05-22 | 2020-10-13 | 深圳奇迹智慧网络有限公司 | Scene monitoring method and device, computer equipment and storage medium |
| CN112866199A (en) * | 2020-12-31 | 2021-05-28 | 北京优锘科技有限公司 | Method for viewing device supporting GB/T28181 protocol in main stream browser |
| CN113194292A (en) * | 2021-04-30 | 2021-07-30 | 招商局金融科技有限公司 | Coordination management method, device, equipment and storage medium for intelligent equipment |
| CN113851013A (en) * | 2021-08-06 | 2021-12-28 | 厦门识图科技有限公司 | Vehicle data processing system and method for multiple parking lots |
-
2022
- 2022-02-15 CN CN202210137227.5A patent/CN114745229B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109151394A (en) * | 2018-10-09 | 2019-01-04 | 成都云格致力科技有限公司 | A kind of general video monitoring system that supporting terminal cross-platform interchange and monitoring method |
| CN110532882A (en) * | 2019-07-30 | 2019-12-03 | 长江大学 | Recognition of face safety alarm system and equipment based on embedded artificial intelligent chip |
| CN110519641A (en) * | 2019-09-10 | 2019-11-29 | 深圳市同洲电子股份有限公司 | A kind of the video fusion transmission exchange system and method for multi-source multi-protocols |
| CN111541875A (en) * | 2020-05-14 | 2020-08-14 | 深圳市康拓普信息技术有限公司 | Electric power video monitoring video network platform |
| CN111770306A (en) * | 2020-05-22 | 2020-10-13 | 深圳奇迹智慧网络有限公司 | Scene monitoring method and device, computer equipment and storage medium |
| CN112866199A (en) * | 2020-12-31 | 2021-05-28 | 北京优锘科技有限公司 | Method for viewing device supporting GB/T28181 protocol in main stream browser |
| CN113194292A (en) * | 2021-04-30 | 2021-07-30 | 招商局金融科技有限公司 | Coordination management method, device, equipment and storage medium for intelligent equipment |
| CN113851013A (en) * | 2021-08-06 | 2021-12-28 | 厦门识图科技有限公司 | Vehicle data processing system and method for multiple parking lots |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117459792A (en) * | 2023-12-20 | 2024-01-26 | 深圳市奔迈科技有限公司 | Video processing method and AI box based on visual algorithm |
| CN117459792B (en) * | 2023-12-20 | 2024-04-26 | 深圳市奔迈科技有限公司 | Video processing method and AI box based on visual algorithm |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114745229B (en) | 2024-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20060053229A1 (en) | Common protocol layer architecture and methods for transmitting data between different network protocols and a common protocol packet | |
| KR101536141B1 (en) | Apparatus and method for converting signal between ethernet and can in a vehicle | |
| US9025609B2 (en) | Video router and method of automatic configuring thereof | |
| CN108737768B (en) | Monitoring method and monitoring device based on monitoring system | |
| CN108696424A (en) | Vehicle communication system | |
| CN109787992B (en) | Method and device for accessing private network through video network | |
| KR20060093279A (en) | Method for performing data transport over a serial bus using internet protocol and apparatus for use in the method | |
| WO2023274327A1 (en) | Data transmission method, data transmission apparatus, data transmission device, and terminal | |
| EP2816761A1 (en) | Wifi display compatible network gateway | |
| CN114745229A (en) | Embedded AI video gateway and implementation method thereof | |
| CN113115346A (en) | Gateway multi-protocol conversion device based on 5G and method thereof | |
| CN108574816B (en) | Video networking terminal and communication method and device based on video networking terminal | |
| CN110035297B (en) | Video processing method and device | |
| CN114071080A (en) | Automatic driving platform based on imaging adjustment intelligent gateway | |
| CN110324667B (en) | Novel video stream playing method and system | |
| CN115865835A (en) | Master and backup exchange board, interface board, exchange system and state summarizing method thereof | |
| CN112235663B (en) | System-on-chip for realizing fusion of optical network unit and set top box | |
| CN109618125B (en) | Monitoring method and device based on video network | |
| CN110098993B (en) | Method and device for processing signaling message | |
| CN110475143B (en) | Switching method and device of HDMI video data | |
| CN110661997B (en) | Method and device for transmitting analog signals | |
| CN110475089B (en) | Multimedia data processing method and video networking terminal | |
| CN110392018B (en) | Communication method and system of interphone | |
| CN101072338A (en) | Inter-chip data and message same frame transmission system and method | |
| CN110677458A (en) | Virtual number distribution method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |