CN113114992A - Intelligent video gateway, and expressway monitoring system and method - Google Patents
Intelligent video gateway, and expressway monitoring system and method Download PDFInfo
- Publication number
- CN113114992A CN113114992A CN202110371898.3A CN202110371898A CN113114992A CN 113114992 A CN113114992 A CN 113114992A CN 202110371898 A CN202110371898 A CN 202110371898A CN 113114992 A CN113114992 A CN 113114992A
- Authority
- CN
- China
- Prior art keywords
- camera
- monitoring
- video
- module
- video data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 127
- 238000000034 method Methods 0.000 title claims abstract description 25
- 230000002159 abnormal effect Effects 0.000 claims abstract description 24
- 239000000779 smoke Substances 0.000 claims abstract description 13
- 238000001514 detection method Methods 0.000 claims abstract description 11
- 238000012937 correction Methods 0.000 claims description 15
- RZVHIXYEVGDQDX-UHFFFAOYSA-N 9,10-anthraquinone Chemical compound C1=CC=C2C(=O)C3=CC=CC=C3C(=O)C2=C1 RZVHIXYEVGDQDX-UHFFFAOYSA-N 0.000 claims description 13
- 238000004891 communication Methods 0.000 claims description 11
- 230000005540 biological transmission Effects 0.000 claims description 10
- 230000000712 assembly Effects 0.000 claims description 9
- 238000000429 assembly Methods 0.000 claims description 9
- 238000011156 evaluation Methods 0.000 claims description 9
- 238000003780 insertion Methods 0.000 claims description 7
- 230000037431 insertion Effects 0.000 claims description 7
- 238000013441 quality evaluation Methods 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 4
- 239000000126 substance Substances 0.000 claims description 4
- 238000006073 displacement reaction Methods 0.000 claims description 3
- 239000013307 optical fiber Substances 0.000 claims description 3
- 230000003068 static effect Effects 0.000 claims description 3
- 230000005611 electricity Effects 0.000 description 3
- 230000006698 induction Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000003032 molecular docking Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007306 functionalization reaction Methods 0.000 description 1
- 230000001939 inductive effect Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 210000001503 joint Anatomy 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Studio Devices (AREA)
- Closed-Circuit Television Systems (AREA)
- Alarm Systems (AREA)
Abstract
The invention provides an intelligent video gateway, a highway monitoring system and a highway monitoring method. The intelligent video gateway comprises a video uploading module, a video transcoding module, a video analyzing module and a video storing module; the video storage module is used for acquiring and storing original video data from the monitoring camera; the video transcoding module is used for transcoding the original video data to generate transcoded video data; the video analysis module is used for carrying out image recognition on original video data according to an image recognition algorithm, the recognition content comprises smoke detection, flame monitoring, illegal parking monitoring, congestion monitoring and retrograde monitoring, and prompt information is sent to a monitoring center after abnormal content is recognized, wherein the prompt information comprises corresponding old field pictures; the video uploading module is used for uploading the transcoded video data to the cloud platform through the 5G network. The invention has the characteristic of rich functions.
Description
Technical Field
The invention relates to a video information processing technology, in particular to an intelligent video gateway, a highway monitoring system and a method.
Background
The intelligent gateway plays an important role in building an intelligent network system, along with the gradual enhancement of the performance of a chip, the intelligent gateway is gradually developing towards high-performance, integration and multi-functionalization, and the intelligent gateway on the market at present has single large function, can only realize simple data receiving and sending and protocol conversion, and cannot meet the higher requirement of modern informatization.
Disclosure of Invention
In view of the above, a first object of the present invention is to provide an intelligent video gateway, which has rich functions.
In order to solve the technical problems, the technical scheme of the invention is as follows:
an intelligent video gateway comprises a video uploading module, a video transcoding module, a video analyzing module and a video storing module; wherein the content of the first and second substances,
the video storage module is used for acquiring and storing original video data from the monitoring camera;
the video transcoding module is used for transcoding the original video data to generate transcoded video data;
the video analysis module is used for carrying out image recognition on original video data according to an image recognition algorithm, the recognition content comprises smoke detection, flame monitoring, illegal parking monitoring, congestion monitoring and retrograde monitoring, and prompt information is sent to a monitoring center after abnormal content is recognized, wherein the prompt information comprises corresponding field pictures;
the video uploading module is used for uploading the transcoded video data to the cloud platform through the 5G network.
Preferably, the video analysis module comprises a prompt unit, a coordination unit and five different analysis units, and the processing contents of the five analysis units respectively correspond to smoke detection, flame monitoring, illegal parking monitoring, congestion monitoring and retrograde monitoring; wherein the content of the first and second substances,
the coordination unit is used for copying five copies of one original video data and respectively distributing the five copies to five different analysis units; and for notifying the other four analysis units to stop the analysis after receiving a valid recognition result from one of the analysis units;
the analysis unit is used for carrying out image recognition on the received copy and feeding back a recognition result to the coordination unit;
and the prompting unit is used for extracting the field picture from the corresponding copy when the analysis unit generates an effective recognition result, generating prompting information according to the field picture and then sending the prompting information to the monitoring center.
Preferably, the intelligent video gateway further comprises a video quality evaluation module, and the video quality evaluation module is configured to analyze the original video data, and further evaluate shooting performance of the corresponding monitoring camera head.
Preferably, the method of evaluating photographing performance includes:
analyzing the brightness, the chroma, the definition and the noise of the video image to obtain a corresponding first analysis result; when the analysis result is abnormal, continuing the following steps;
transferring an unmanned aerial vehicle carrying a correction camera to fly to a position corresponding to the monitoring camera, wherein the specification and model of the correction camera are the same as those of the monitoring camera;
the unmanned aerial vehicle is communicated with the monitoring camera through a wireless network so as to obtain a section of reference video data from the monitoring camera and store the reference video data;
the unmanned aerial vehicle adjusts the posture of the unmanned aerial vehicle, so that the position and the orientation of the correction camera are as close as possible to those of the monitoring camera, and then a section of correction video data is shot and stored;
the control system of the unmanned aerial vehicle is provided with an auxiliary evaluation module, and the auxiliary evaluation module is used for analyzing reference video data and correction video data; if the evaluation results of the two data are normal, the transmission line is indicated to have a fault; if the reference video data is abnormal and the corrected video data is normal, the corresponding monitoring camera has a fault.
A second object of the present invention is to provide a highway monitoring system having a feature of rich functions.
In order to solve the technical problems, the technical scheme of the invention is as follows:
a highway monitoring system comprises a monitoring camera, the intelligent video gateway, a monitoring center and a cloud platform; the monitoring camera transmits data to the intelligent video gateway through an optical fiber network; the intelligent video gateway is communicated with the monitoring center and the cloud platform through a 5G network; the cloud platform comprises a video storage module and a video transmission module, wherein the video storage module is used for receiving video data from the intelligent video gateway and storing the video data in a database; the video transmission module is used for transmitting corresponding video data to the user terminal according to a data acquisition request initiated by the user terminal.
Preferably, the monitoring camera comprises a camera rear section and a camera front section, four rotor assemblies are mounted on the side surface of the camera front section, the end parts of the rotor assemblies are rotatably connected with a shell of the camera front section, and a first driving part for driving the rotor assemblies to rotate is arranged at the connection part; the front section of the camera is provided with a camera component, a flight control module and a main control module, the rotor component is electrically connected with the flight control module, and the main camera component and the flight control module are electrically connected with the main control module;
the front section of the camera is provided with a voice talkback module which is electrically connected with the main control module;
the front end of the rear section of the camera is open, a gripping device is arranged in the rear section of the camera, the gripping device is provided with a gripping disk which can extend out of the open, and the rear end of the front section of the camera is provided with a connecting disk which is matched with the gripping disk;
the interior of the rear section of the camera is also provided with an auxiliary control module, and the gripping device is electrically connected with the auxiliary control module; the main control module and the auxiliary control module are respectively provided with a first communication module and a second communication module which are communicated with each other;
the front end of the rear section of the camera is provided with a first plug-in terminal, the rear end of the front section of the camera is provided with a second plug-in terminal matched with the first plug-in terminal, and when the rear section of the camera is successfully butted with the front section of the camera, the first plug-in terminal and the second plug-in terminal are in plug-in fit; the first plug terminal is electrically connected with the auxiliary control module, and the second plug terminal is electrically connected with the main control module.
Preferably, the gripping device comprises an electric push rod, a connecting frame, a first rod body, a second rod body and a gripping disk; the electric push rod is arranged on the side wall of the rear section of the camera and faces towards the opening; the connecting frame is arranged at the front end of the electric push rod, one end of the first rod body is fixed on the connecting frame, the other end of the first rod body is rotatably connected with the second rod body, and a second driving part for driving the second rod body to rotate relative to the first rod body is arranged at the joint; the grabbing disc is fixed at the other end of the second rod body; the second driving part is electrically connected with the auxiliary control module;
preferably, the rotor assembly comprises a rotor body, a first strut, a second strut, and a rotary member; one end of the first support rod is rotatably connected with the front section of the camera, and the other end of the first support rod is connected with the bottom of the rotating component; the rotating head of the rotating component is connected with one end of the second supporting rod; the other end of the second supporting rod is connected with the rotor wing body; the outer surface of the shell at the rear section of the camera is provided with an inserted bar, and the surface of the first support bar or the second support bar is provided with a jack matched with the inserted bar; when the first supporting rod rotates to the original position, the inserting rod is in inserting fit with the inserting hole.
The third purpose of the invention is to provide a highway monitoring method which has the characteristic of comprehensive monitoring.
In order to solve the technical problems, the technical scheme of the invention is as follows:
an expressway monitoring method implemented based on the expressway monitoring system of claim 8; the method is characterized by comprising the following steps:
the intelligent video gateway receives and stores the original video data from the monitoring camera, and processes the original video data as follows: A. transcoding the original video data to generate transcoded video data; B. carrying out image recognition on original video data according to an image recognition algorithm, wherein the recognition content comprises smoke detection, flame monitoring, illegal parking monitoring, congestion monitoring and retrograde monitoring, and sending prompt information to a monitoring center after abnormal content is recognized, wherein the prompt information comprises a corresponding old scene picture; C. and uploading the transcoded video data to a cloud platform through a 5G network.
Preferably, the method further comprises the following steps:
when abnormal content is monitored, the monitoring center calls a monitoring camera and sends a follow-up shooting instruction;
after the camera receives the follow-up shooting instruction, the auxiliary control module sends a first instruction to the main control module, and after receiving the first instruction, the auxiliary control module controls the first driving part to work so as to drive the rotor wing assembly to rotate to a state vertical to a shell at the front section of the camera, and then controls the rotating part to work so as to drive the second supporting rod to rotate 180 degrees; then the auxiliary control module controls the electric push rod to extend out, so that the front section of the camera is separated from the rear section of the camera; then the secondary control module controls the second driving part to work so as to drive the second rod body to rotate downwards to form a 90-degree included angle with the first rod body; then the flight control module controls the rotor wing assembly to work, so that the front section of the camera enters an unmanned aerial vehicle mode; then the vice accuse module control grabs the dish unblock, and after the unblock, flight control system control camera rotor subassembly work for the camera anterior segment is with clapping unusual target with unmanned aerial vehicle's form.
Preferably, the method for calling the monitoring camera comprises the following steps:
if the abnormal object is a moving object, analyzing the moving speed S of the moving object through a video picture, if S is not more than S0, obtaining the displacement distance L1 of the moving object according to the time difference delta T between the shooting time T0 and the current time T1 multiplied by S, and calling another monitoring camera with the distance difference closest to L1+ T2S from the monitoring camera shooting the video picture; if S is larger than S0, not calling any monitoring camera; the method comprises the following steps that S0 is the maximum flying speed of the front section of the camera in the unmanned aerial vehicle state, and T2 is the time required for the front section of the camera to change into the unmanned aerial vehicle state;
and if the abnormal target is a static target, directly calling a monitoring camera for shooting the picture.
The technical effects of the invention are mainly reflected in the following aspects:
1. the system can analyze and detect the events such as illegal parking, retrograde motion, congestion, sprinkles, flame, smoke and the like on the highway;
2. from a closed intranet environment to an open public network environment, the public can obtain the information from the cloud platform through terminal equipment in real time.
Drawings
FIG. 1 is a block diagram of an intelligent video gateway in an embodiment;
FIG. 2 is a system configuration diagram of an embodiment of a highway monitoring system;
FIG. 3 is a perspective view of a monitoring camera in an embodiment;
fig. 4 is an internal schematic view of a monitoring camera in an embodiment.
Reference numerals: 100. an intelligent video gateway; 110. a video storage module; 120. a video transcoding module; 130. a video analysis module; 140. a video uploading module; 150. a video quality evaluation module; 200. a cloud platform; 300. a surveillance camera; 310. a camera rear section; 311. inserting a rod; 320. a camera front section; 321. a connecting disc; 400. a monitoring center; 500. a rotor assembly; 510. a first support bar; 520. a second support bar; 530. a rotor body; 540. a rotating member; 610. an electric push rod; 620. a connecting frame; 630. a first rod body; 640. a second rod body; 641. grabbing a disc; 650. a second drive member; 710. a first plug terminal; 720. a second plug terminal; 800. a user terminal.
Detailed Description
The following detailed description of the embodiments of the present invention is provided in order to make the technical solution of the present invention easier to understand and understand.
The first embodiment,
Referring to fig. 1, the present embodiment provides an intelligent video gateway 100, which includes a video uploading module 140, a video transcoding module 120, a video analyzing module 130, and a video storing module 110.
The video storage module 110 is used for acquiring and storing original video data from the monitoring camera 300.
The video transcoding module 120 is configured to transcode the original video data to generate transcoded video data; the video uploading module 140 is configured to upload the transcoded video data to the cloud platform 200 through the 5G network.
The video analysis module 130 is configured to perform image recognition on the original video data according to an image recognition algorithm, where the recognition content includes smoke detection, flame monitoring, illegal parking monitoring, congestion monitoring, and retrograde monitoring, and send a prompt message to the monitoring center 400 after recognizing the abnormal content, where the prompt message includes a corresponding scene picture. Since the video picture analysis is adopted to realize smoke detection, flame monitoring, illegal parking monitoring, congestion monitoring, retrograde motion monitoring and the like, which belong to the prior art, the specific principle of the method is not repeated in this embodiment.
Specifically, the video analysis module 130 includes a prompt unit, a coordination unit and five different analysis units, and the processing contents of the five analysis units respectively correspond to smoke detection, flame monitoring, illegal parking monitoring, congestion monitoring and retrograde monitoring; the coordination unit is used for copying five copies of one original video data and respectively distributing the five copies to five different analysis units; and for notifying the other four analysis units to stop the analysis after receiving a valid recognition result from one of the analysis units; the analysis unit is used for carrying out image recognition on the received copy and feeding back a recognition result to the coordination unit; the prompting unit is used for extracting the scene picture from the corresponding copy when the analysis unit generates an effective recognition result, and generating prompting information according to the scene picture and then sending the prompting information to the monitoring center 400.
The video quality evaluation module 150 is configured to analyze the raw video data, and further evaluate the shooting performance of the corresponding monitoring camera head. The method for evaluating shooting performance includes: 1. analyzing the brightness, the chroma, the definition and the noise of the video image to obtain a corresponding first analysis result; when the analysis result is abnormal, continuing the following steps; 2. moving an unmanned aerial vehicle carrying a correction camera to fly to a position corresponding to the monitoring camera 300, wherein the correction camera and the monitoring camera 300 have the same specification and model; 3. the unmanned aerial vehicle communicates with the monitoring camera 300 through a wireless network to acquire and store a section of reference video data from the monitoring camera 300; 4. the unmanned aerial vehicle adjusts the posture of the unmanned aerial vehicle, so that the position and the orientation of the correction camera are close to those of the monitoring camera 300 as much as possible, and then a section of correction video data is shot and stored; 5. the control system of the unmanned aerial vehicle is provided with an auxiliary evaluation module, and the auxiliary evaluation module is used for analyzing reference video data and correction video data; if the evaluation results of the two data are normal, the transmission line is indicated to have a fault; if the reference video data is abnormal and the corrected video data is normal, it indicates that the corresponding monitoring camera 300 has a fault.
Example II,
Referring to fig. 2, the embodiment provides a highway monitoring system, which includes a monitoring camera 300, the above-mentioned intelligent video gateway 100, a monitoring center 400, and a cloud platform 200; the monitoring camera 300 transmits data to the intelligent video gateway 100 through the optical fiber network; the intelligent video gateway 100 communicates with the monitoring center 400 and the cloud platform 200 through a 5G network; the cloud platform 200 comprises a video storage module 110 and a video transmission module, wherein the video storage module 110 is used for receiving video data from the intelligent video gateway 100 and storing the video data in a database; the video transmission module is configured to transmit corresponding video data to the user terminal 800 according to a data acquisition request initiated by the user terminal 800. The user terminal 800 may be a PC, a tablet, or a mobile phone, and the user terminal 800 is installed with wechat or map software, so as to obtain video data from the cloud platform 200.
Referring to fig. 4, the monitoring camera 300 includes a camera rear section 310 and a camera front section 320, four rotor assemblies 500 are mounted on the side of the camera front section 320, the end portions of the rotor assemblies 500 are rotatably connected with the housing of the camera front section 320, and a first driving part for driving the rotor assemblies 500 to rotate is arranged at the connection; camera subassembly, flying control module and host system are installed to camera anterior segment 320, and rotor subassembly 500 is connected with flying control module electricity, and camera anterior segment 320 is provided with pronunciation module of talkbacking, and pronunciation module of talkbacking, main camera subassembly, flying control module are connected with the host system electricity. The flight control module is basically the same as a control system of a common unmanned aerial vehicle, and therefore, detailed description is not provided.
The front end of camera back end 310 is uncovered setting, and the internally mounted of camera back end 310 has grabbing device, and grabbing device has one can follow uncovered department and stretches out grabs dish 641, and the rear end of camera anterior segment 320 is provided with the connection pad 321 with grabbing dish 641 adaptation. The inside of camera back end 310 still is provided with vice accuse module, and grabbing device is connected with vice accuse module electricity. The grabbing device comprises an electric push rod 610, a connecting frame 620, a first rod body 630, a second rod body 640 and a grabbing disc 641; the electric push rod 610 is arranged on the side wall of the camera rear section 310 and faces towards the opening; the connecting frame 620 is installed at the front end of the electric push rod 610, one end of the first rod body 630 is fixed to the connecting frame 620, the other end is rotatably connected with the second rod body 640, and a second driving part 650 for driving the second rod body 640 to rotate relative to the first rod body 630 is installed at the connection position; the catch tray 641 is fixed at the other end of the second lever 640; the second driving part 650 is electrically connected with the sub control module.
Specifically, an electromagnetic lock may be installed on the grabbing disk 641, and when the connecting disk 321 is close to the disk body of the grabbing disk 641, the secondary control module controls the electromagnetic lock to lock the connecting disk 321 (by means of magnetic force). It should be noted that, an induction device can be installed on the grab disk 641 for inducing whether the connection disk 321 is close to, and the induction device is electrically connected with the sub-control module to transmit an induction signal to the sub-control module.
The main control module and the auxiliary control module are respectively provided with a first communication module and a second communication module which are communicated with each other. Specifically, the first communication module and the second communication module may be radio modules or other communication modules, so as to implement remote communication. If the distance between the two modules is too far, the master control module searches nearby for the secondary control modules of other monitoring cameras 300 for communication.
The front end of the camera rear section 310 is provided with a first plug terminal 710, the rear end of the camera front section 320 is provided with a second plug terminal 720 matched with the first plug terminal 710, and when the camera rear section 310 and the camera front section 320 are successfully butted, the first plug terminal 710 and the second plug terminal 720 are in plug fit; the first plug terminal 710 is electrically connected to the sub-control module, and the second plug terminal 720 is electrically connected to the main control module. The first plug-in terminal 710 and the second plug-in terminal 720 are mainly used for charging a standby power supply of the main control module, and when the front camera section 320 is successfully docked with the rear camera section 310, data and signals are transmitted through the first plug-in terminal 710 and the second plug-in terminal 720 without depending on radio, so that the transmission stability is ensured.
Example III,
Based on the second embodiment, the present embodiment provides a highway monitoring method, including:
the intelligent video gateway 100 receives and stores the original video data from the monitoring camera 300, and performs the following processing on the original video data: A. transcoding the original video data to generate transcoded video data; B. performing image recognition on original video data according to an image recognition algorithm, wherein the recognition content comprises smoke detection, flame monitoring, illegal parking monitoring, congestion monitoring and retrograde monitoring, and sending prompt information to the monitoring center 400 after abnormal content is recognized, wherein the prompt information comprises corresponding field pictures; C. and uploading the transcoded video data to the cloud platform 200 through the 5G network.
When abnormal content is monitored, the monitoring center 400 calls one monitoring camera 300 and sends a follow-up shooting instruction;
after the camera receives the follow-up shooting instruction, the auxiliary control module sends a first instruction to the main control module, and after receiving the first instruction, the auxiliary control module controls the first driving part to work so as to drive the rotor wing assembly 500 to rotate to a state vertical to the shell of the front section 320 of the camera, and then controls the rotating part 540 to work so as to drive the second support rod 520 to rotate by 180 degrees; then the auxiliary control module controls the electric push rod 610 to extend out, so that the front camera section 320 is separated from the rear camera section 310; then, the secondary control module controls the second driving part 650 to work so as to drive the second rod 640 to rotate downwards to a state of forming an included angle of 90 degrees with the first rod 630; then the flight control module controls the rotor assembly 500 to work, so that the front camera section 320 enters an unmanned aerial vehicle mode; then vice accuse module control catch disc 641 unblock, the unblock back, flight control system control camera rotor subassembly 500 work for camera anterior segment 320 is with taking a photograph unusual target with unmanned aerial vehicle's form. The anomaly targets are typically a smoke target, a flame target, and a retrograde target.
When the front camera section 320 approaches an abnormal target, the monitoring center related personnel can command and communicate with the on-site personnel through the voice intercom module built in the front camera section 320.
The method for calling the monitoring camera comprises the following steps: if the abnormal object is a moving object, analyzing the moving speed S of the moving object through a video picture, if S is not more than S0, obtaining the displacement distance L1 of the moving object according to the time difference delta T between the shooting time T0 and the current time T1 multiplied by S, and calling another monitoring camera 300 the distance difference of which from the monitoring camera 300 for shooting the video picture is closest to L1+ T2S; if S is greater than S0, not calling any monitoring camera 300; wherein, S0 is the maximum flying speed of the front camera section 320 in the unmanned aerial vehicle state, and T2 is the time required for the front camera section 320 to change into the unmanned aerial vehicle state; if the abnormal target is a static target, the monitoring camera 300 for shooting the picture is directly called.
When the front camera section 320 completes the task and needs to return to the navigation, if the current electric quantity is not enough to return to the navigation, a monitoring camera 300 is searched nearby and communicated with the monitoring camera 300, and the communicated monitoring camera 300 separates the front camera section 320 in the same way and is in butt joint with the front camera section 320 which needs to return to the navigation; the separated front camera 320 automatically flies to the previous position of the monitoring camera 300 according to the GPS navigation and completes the docking.
The docking method comprises the following steps: navigation is performed to an approximate position through a GPS, then the master control module and the auxiliary control module are both provided with Bluetooth modules, and the two modules realize accurate positioning through the Bluetooth modules, namely, the front section 320 of the camera flies to the position right below the grab disk 641, then whether the camera is in place is confirmed through the connecting disk 321 and infrared devices on the grab disk 641, and after the camera is in place, the auxiliary control module controls an electromagnetic lock on the grab disk to be locked; then, the second driving part 630 is sequentially controlled to rotate reversely by 90 degrees, and then the electric push rod 610 is controlled to reset, so that the front section 320 of the camera is pulled back, and the first plug terminal is butted with the second plug terminal; finally, the main control module controls the first driving part to rotate reversely, so that the rotor wing assembly resets, and the insertion rod 311 is matched with the insertion hole.
The above are only typical examples of the present invention, and besides, the present invention may have other embodiments, and all the technical solutions formed by equivalent substitutions or equivalent changes are within the scope of the present invention as claimed.
Claims (10)
1. An intelligent video gateway (100) is characterized by comprising a video uploading module (140), a video transcoding module (120), a video analyzing module (130) and a video storage module (110); wherein the content of the first and second substances,
the video storage module (110) is used for acquiring and storing original video data from the monitoring camera (300);
the video transcoding module (120) is used for transcoding the original video data to generate transcoded video data;
the video analysis module (130) is used for carrying out image recognition on original video data according to an image recognition algorithm, the recognition content comprises smoke detection, flame monitoring, illegal parking monitoring, congestion monitoring and retrograde monitoring, and prompt information is sent to the monitoring center (400) after abnormal content is recognized, and the prompt information comprises corresponding field pictures;
the video uploading module (140) is used for uploading the transcoded video data to the cloud platform (200) through the 5G network;
the video analysis module (130) comprises a prompt unit, a coordination unit and five different analysis units, wherein the processing contents of the five analysis units respectively correspond to smoke detection, flame monitoring, illegal parking monitoring, congestion monitoring and retrograde monitoring; wherein the content of the first and second substances,
the coordination unit is used for copying five copies of one original video data and respectively distributing the five copies to five different analysis units; and for notifying the other four analysis units to stop the analysis after receiving a valid recognition result from one of the analysis units;
the analysis unit is used for carrying out image recognition on the received copy and feeding back a recognition result to the coordination unit;
and the prompting unit is used for extracting the scene picture from the corresponding copy when the analysis unit generates an effective recognition result, generating prompting information according to the scene picture and then sending the prompting information to the monitoring center (400).
2. The intelligent video gateway (100) according to claim 1, wherein the intelligent video gateway (100) further comprises a video quality evaluation module (150), and the video quality evaluation module (150) is configured to analyze the raw video data to evaluate the shooting performance of the corresponding monitoring camera head.
3. The intelligent video gateway (100) of claim 2, wherein the method of evaluating the shooting performance comprises:
analyzing the brightness, the chroma, the definition and the noise of the video image to obtain a corresponding first analysis result; when the analysis result is abnormal, continuing the following steps;
transferring an unmanned aerial vehicle carrying a correction camera to fly to a position corresponding to the monitoring camera (300), wherein the correction camera and the monitoring camera (300) have the same specification and model;
the unmanned aerial vehicle is communicated with the monitoring camera (300) through a wireless network so as to obtain a section of reference video data from the monitoring camera (300) and store the reference video data;
the unmanned aerial vehicle adjusts the posture of the unmanned aerial vehicle, so that the position and the orientation of the correction camera are close to those of the monitoring camera (300) as much as possible, and then a section of correction video data is shot and stored;
the control system of the unmanned aerial vehicle is provided with an auxiliary evaluation module, and the auxiliary evaluation module is used for analyzing reference video data and correction video data; if the evaluation results of the two data are normal, the transmission line is indicated to have a fault; if the reference video data is abnormal and the corrected video data is normal, the fault of the corresponding monitoring camera (300) is represented.
4. A highway monitoring system, comprising a monitoring camera (300), an intelligent video gateway (100) according to any one of claims 1-3, a monitoring center (400) and a cloud platform (200); the monitoring camera (300) transmits data to the intelligent video gateway (100) through an optical fiber network; the intelligent video gateway (100) is communicated with the monitoring center (400) and the cloud platform (200) through a 5G network; the cloud platform (200) comprises a video storage module (110) and a video transmission module, wherein the video storage module (110) is used for receiving video data from the intelligent video gateway (100) and storing the video data in a database; the video transmission module is used for transmitting corresponding video data to the user terminal (800) according to a data acquisition request initiated by the user terminal (800).
5. The highway monitoring system according to claim 4, wherein the monitoring camera (300) comprises a camera rear section (310) and a camera front section (320), four rotor assemblies (500) are mounted on the side surface of the camera front section (320), the end parts of the rotor assemblies (500) are rotatably connected with the shell of the camera front section (320), and a first driving part for driving the rotor assemblies (500) to rotate is arranged at the connection part; the front camera section (320) is provided with a camera assembly, a flight control module and a main control module, the rotor assembly (500) is electrically connected with the flight control module, and the main camera assembly and the flight control module are electrically connected with the main control module;
the front end of the camera rear section (310) is arranged in an open manner, a grabbing device is arranged in the camera rear section (310), the grabbing device is provided with a grabbing disc which can extend out of the open, and the rear end of the camera front section (320) is provided with a connecting disc matched with the grabbing disc;
the front section of the camera is provided with a voice talkback module which is electrically connected with the main control module;
the interior of the rear camera section (310) is also provided with an auxiliary control module, and the gripping device is electrically connected with the auxiliary control module; the main control module and the auxiliary control module are respectively provided with a first communication module and a second communication module which are communicated with each other;
the front end of the camera rear section (310) is provided with a first plug terminal (710), the rear end of the camera front section (320) is provided with a second plug terminal (720) matched with the first plug terminal (710), and when the camera rear section (310) and the camera front section (320) are successfully butted, the first plug terminal (710) and the second plug terminal (720) are in plug fit; the first plug terminal (710) is electrically connected with the secondary control module, and the second plug terminal (720) is electrically connected with the main control module.
6. The highway monitoring system according to claim 5, wherein said grasping means comprises an electric push rod (610), a connecting frame (620), a first rod (630), a second rod (640) and a grasping disk; the electric push rod (610) is arranged on the side wall of the camera rear section (310) and faces towards the opening; the connecting frame (620) is arranged at the front end of the electric push rod (610), one end of the first rod body (630) is fixed on the connecting frame (620), the other end of the first rod body is rotatably connected with the second rod body (640), and a second driving part (650) for driving the second rod body (640) to rotate relative to the first rod body (630) is arranged at the joint; the grabbing disc is fixed at the other end of the second rod body (640); the second driving part (650) is electrically connected with the sub-control module.
7. The highway monitoring system according to claim 6, wherein said rotor assembly (500) comprises a rotor body (530), a first strut (510), a second strut (520), and a rotating member (540); one end of the first supporting rod (510) is rotatably connected with the front camera section (320), and the other end of the first supporting rod is connected with the bottom of the rotating component (540); the rotating head of the rotating member (540) is connected with one end of the second supporting rod (520); the other end of the second supporting rod (520) is connected with a rotor wing body (530); an inserting rod is arranged on the outer surface of the shell of the camera rear section (310), and an inserting hole matched with the inserting rod is formed in the surface of the first supporting rod (510) or the second supporting rod (520); when the first support rod (510) rotates to the original position, the insertion rod is in insertion fit with the insertion hole.
8. An expressway monitoring method implemented based on the expressway monitoring system of claim 7; the method is characterized by comprising the following steps:
the intelligent video gateway (100) receives and stores the original video data from the monitoring camera (300), and processes the original video data as follows: A. transcoding the original video data to generate transcoded video data; B. carrying out image recognition on original video data according to an image recognition algorithm, wherein the recognition content comprises smoke detection, flame monitoring, illegal parking monitoring, congestion monitoring and retrograde monitoring, and sending prompt information to a monitoring center (400) after abnormal content is recognized, wherein the prompt information comprises a corresponding old field picture; C. uploading the transcoded video data to a cloud platform (200) through a 5G network;
the identification method specifically comprises the following steps:
copying five copies of one original video data, and distributing the five copies to five different analysis units respectively; and for notifying the other four analysis units to stop the analysis after receiving a valid recognition result from one of the analysis units;
the analysis unit is used for carrying out image recognition on the received copy and feeding back a recognition result to the coordination unit;
and the prompting unit is used for extracting the scene picture from the corresponding copy when the analysis unit generates an effective recognition result, generating prompting information according to the scene picture and then sending the prompting information to the monitoring center (400).
9. The method of highway monitoring according to claim 8 further comprising:
when abnormal content is monitored, the monitoring center (400) calls a monitoring camera (300) and sends a follow-up shooting instruction;
after the camera receives the follow-up shooting instruction, the auxiliary control module sends a first instruction to the main control module, and after receiving the first instruction, the auxiliary control module controls the first driving part to work so as to drive the rotor wing assembly (500) to rotate to a state vertical to the shell of the front section (320) of the camera, and then controls the rotating part (540) to work so as to drive the second supporting rod (520) to rotate 180 degrees; then the auxiliary control module controls the electric push rod (610) to extend out, so that the front camera section (320) is separated from the rear camera section (310); then the secondary control module controls the second driving part (650) to work so as to drive the second rod body (640) to rotate downwards to a state that an included angle of 90 degrees is formed between the second rod body and the first rod body (630); then the flight control module controls the rotor wing assembly (500) to work, so that the front camera section (320) enters an unmanned aerial vehicle mode; then the unlocking of the grab disk is controlled by the auxiliary control module, and after the unlocking, the flight control system controls the camera rotor wing assembly (500) to work, so that the camera front section (320) can follow the shooting of an abnormal target in an unmanned aerial vehicle mode.
10. The method for monitoring a highway according to claim 9 wherein the method for invoking the surveillance camera comprises:
if the abnormal object is a moving object, analyzing the moving speed S of the moving object through the video picture, if S is not more than S0, obtaining the displacement distance L1 of the moving object according to the time difference delta T between the shooting time T0 and the current time T1 multiplied by S, and calling another monitoring camera (300) of which the distance difference with the monitoring camera (300) for shooting the video picture is closest to L1+ T2S; if S is greater than S0, not calling any monitoring camera (300); the S0 is the maximum flying speed of the front camera section (320) in the unmanned aerial vehicle state, and the T2 is the time required for the front camera section (320) to change into the unmanned aerial vehicle state;
if the abnormal target is a static target, the monitoring camera (300) for shooting the picture is directly called.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110371898.3A CN113114992B (en) | 2021-04-07 | 2021-04-07 | Intelligent video gateway and highway monitoring system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110371898.3A CN113114992B (en) | 2021-04-07 | 2021-04-07 | Intelligent video gateway and highway monitoring system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113114992A true CN113114992A (en) | 2021-07-13 |
| CN113114992B CN113114992B (en) | 2021-11-09 |
Family
ID=76714299
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110371898.3A Active CN113114992B (en) | 2021-04-07 | 2021-04-07 | Intelligent video gateway and highway monitoring system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113114992B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114511179A (en) * | 2021-12-28 | 2022-05-17 | 江苏东晔电气设备有限公司 | Intelligent planning method and system for processing abnormity of power distribution cabinet |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080126031A1 (en) * | 2006-11-29 | 2008-05-29 | Mitsubishi Electric Research Laboratories | System and Method for Measuring Performances of Surveillance Systems |
| US20100321183A1 (en) * | 2007-10-04 | 2010-12-23 | Donovan John J | A hierarchical storage manager (hsm) for intelligent storage of large volumes of data |
| KR20160065339A (en) * | 2014-11-28 | 2016-06-09 | 한국도로공사 | Portable roadway detector evaluation system and monitoring system |
| CN106375721A (en) * | 2016-09-14 | 2017-02-01 | 重庆邮电大学 | Smart video monitoring system based on cloud platform |
| CN107318000A (en) * | 2017-06-22 | 2017-11-03 | 重庆邮电大学 | A kind of wireless video monitoring system based on cloud platform |
| WO2018027448A1 (en) * | 2016-08-08 | 2018-02-15 | 深圳秦云网科技有限公司 | Intelligent monitoring cloud transcoding platform |
| CN111541852A (en) * | 2020-05-07 | 2020-08-14 | 华人运通(上海)自动驾驶科技有限公司 | Video processing method and device, electronic equipment and computer storage medium |
-
2021
- 2021-04-07 CN CN202110371898.3A patent/CN113114992B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080126031A1 (en) * | 2006-11-29 | 2008-05-29 | Mitsubishi Electric Research Laboratories | System and Method for Measuring Performances of Surveillance Systems |
| US20100321183A1 (en) * | 2007-10-04 | 2010-12-23 | Donovan John J | A hierarchical storage manager (hsm) for intelligent storage of large volumes of data |
| KR20160065339A (en) * | 2014-11-28 | 2016-06-09 | 한국도로공사 | Portable roadway detector evaluation system and monitoring system |
| WO2018027448A1 (en) * | 2016-08-08 | 2018-02-15 | 深圳秦云网科技有限公司 | Intelligent monitoring cloud transcoding platform |
| CN106375721A (en) * | 2016-09-14 | 2017-02-01 | 重庆邮电大学 | Smart video monitoring system based on cloud platform |
| CN107318000A (en) * | 2017-06-22 | 2017-11-03 | 重庆邮电大学 | A kind of wireless video monitoring system based on cloud platform |
| CN111541852A (en) * | 2020-05-07 | 2020-08-14 | 华人运通(上海)自动驾驶科技有限公司 | Video processing method and device, electronic equipment and computer storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114511179A (en) * | 2021-12-28 | 2022-05-17 | 江苏东晔电气设备有限公司 | Intelligent planning method and system for processing abnormity of power distribution cabinet |
| CN114511179B (en) * | 2021-12-28 | 2023-09-12 | 江苏东晔电气设备有限公司 | Intelligent planning method and system for processing abnormality of power distribution cabinet |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113114992B (en) | 2021-11-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105100249B (en) | Picture transfer control system and its involved safeguard protection respectively held, transmission method | |
| WO2017018744A1 (en) | System and method for providing public service using autonomous smart car | |
| WO2018152849A1 (en) | Control method, remote monitoring device, base station, server and steaming media server | |
| CN112650267B (en) | Flight control method and device of aircraft and aircraft | |
| CN113114992B (en) | Intelligent video gateway and highway monitoring system | |
| WO2023120908A1 (en) | Drone having onboard flight control computer, and system for obtaining positional coordinates of drone camera video object by using drone | |
| CN112703727B (en) | Tethered unmanned aerial vehicle system with monitoring data management | |
| WO2016011590A1 (en) | Data processing method and device, and aircraft | |
| WO2014169582A1 (en) | Configuration parameter sending and receiving method and device | |
| CN106814742A (en) | A kind of control method of unmanned plane, control device and unmanned plane | |
| CN104869303A (en) | Imaging apparatus, communication device, imaging method, and information notification method | |
| CN106394918A (en) | Unmanned aerial vehicle carried panorama camera system and operation method thereof | |
| CN108419052B (en) | Panoramic imaging method for multiple unmanned aerial vehicles | |
| CN110174904A (en) | A kind of more rotors based on cloud platform are taken photo by plane unmanned plane job scheduling system | |
| TWI573104B (en) | Indoor monitoring system and method thereof | |
| CN108108396A (en) | A kind of aircraft take photo by plane picture splicing management system | |
| CN207491089U (en) | A kind of unmanned machine head device for intelligently switching | |
| KR101779255B1 (en) | Automatic navigation and communication possible drones operating system | |
| CN112004060B (en) | Unmanned aerial vehicle sightseeing method for scenic spot | |
| WO2021060113A1 (en) | Photography system, control device, control method, program, and storage medium | |
| WO2017166239A1 (en) | Method, device, and system for controlling camera shutter | |
| CN106108209A (en) | A kind of visual positioning security cap system and operational approach thereof | |
| CN106101517A (en) | A kind of vehicle-mounted panoramic camera system and operational approach thereof | |
| CN210689623U (en) | Be used for unmanned aerial vehicle aerial survey cloud platform system | |
| WO2019178832A1 (en) | Load device control method, adapter apparatus, unmanned aerial vehicle, and control terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |