CN217849510U - Rail transit video analysis control box and system - Google Patents

Rail transit video analysis control box and system Download PDF

Info

Publication number
CN217849510U
CN217849510U CN202220006889.4U CN202220006889U CN217849510U CN 217849510 U CN217849510 U CN 217849510U CN 202220006889 U CN202220006889 U CN 202220006889U CN 217849510 U CN217849510 U CN 217849510U
Authority
CN
China
Prior art keywords
video analysis
control box
intelligent
track traffic
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202220006889.4U
Other languages
Chinese (zh)
Inventor
周超
杜呈欣
王志飞
李樊
孟宇坤
吴跃
赵俊华
韩佩瑶
吴卉
王越彤
李高科
李帅
魏耀南
郭顺利
汪晓臣
赵伟慧
蔡宇晶
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Academy of Railway Sciences Corp Ltd CARS
Institute of Computing Technologies of CARS
Beijing Jingwei Information Technology Co Ltd
Original Assignee
China Academy of Railway Sciences Corp Ltd CARS
Institute of Computing Technologies of CARS
Beijing Jingwei Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Academy of Railway Sciences Corp Ltd CARS, Institute of Computing Technologies of CARS, Beijing Jingwei Information Technology Co Ltd filed Critical China Academy of Railway Sciences Corp Ltd CARS
Priority to CN202220006889.4U priority Critical patent/CN217849510U/en
Application granted granted Critical
Publication of CN217849510U publication Critical patent/CN217849510U/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Closed-Circuit Television Systems (AREA)

Abstract

The utility model relates to a relevant technical field of track traffic provides a track traffic video analysis control box and system. Track traffic video analysis control box includes: the intelligent core board and the intelligent carrier board; the intelligent core board is connected with the first communication interface, acquires video information and audio information, performs intelligent security scene identification to obtain an identification result, and sends the identification result to the central server; wherein, the identification result is a scene needing to be alarmed; the intelligent carrier plate is connected with the intelligent core plate and used for protecting the control box, acquiring the recognition result and the running state of the intelligent core plate and giving an alarm based on the recognition result and the running state. So, track traffic video analysis control box can directly carry out security protection scene intelligent identification after obtaining the video, obtains the recognition result, reduces the volume of sending data to central server, and ductility when reducing terminal data analysis and response production avoids leading to the staff to deal with the delay because of the system feedback is untimely.

Description

Rail transit video analysis control box and system
Technical Field
The utility model relates to a relevant technical field of rail transit especially relates to a rail transit video analysis controls box and system.
Background
The track video monitoring system is mainly deployed in stations, parking lots and vehicle sections, transmits video images of the line to a subway control center for monitoring, and becomes an important means for guaranteeing the safety of track traffic organizations and maintaining the riding order of stations and the safety of passengers.
The prior applied track traffic video monitoring system belongs to a central centralized processing type framework, and the following problems exist when the monitored object is analyzed and processed by centralized computing resources. In the aspect of system architecture, mass video data are all transmitted to a computing center for processing, so that the terminal data analysis and response generate time delay, and the processing delay of workers can be caused due to untimely system feedback.
SUMMERY OF THE UTILITY MODEL
The embodiment of the utility model provides a track traffic video analysis control box and system for solve the equal transmission of magnanimity video data and handle to calculation center, ductility when causing terminal data analysis and response to produce may lead to the staff to deal with the problem of postponing often because of the system feedback is not timely.
In a first aspect, an embodiment of the present invention provides a track traffic video analysis control box, include: the intelligent core board comprises a shell, an intelligent core board and an intelligent carrier board;
the shell is provided with a first communication interface;
the intelligent core board and the intelligent carrier board are arranged inside the shell;
the intelligent core board is connected with the first communication interface, obtains video information and audio information, carries out intelligent security scene identification based on the video information and the audio information to obtain an identification result, and sends the identification result to a central server through the first communication interface; wherein the identification result is a scene needing to be alarmed;
the intelligent carrier plate is connected with the intelligent core plate and used for protecting the rail transit video analysis control box, acquiring the recognition result and the running state of the intelligent core plate, and giving an alarm based on the recognition result and the running state.
Preferably, the smart core board comprises: the system comprises an audio and video information decoding module, a central processing unit and a graphic processor;
the central processor is respectively connected with the audio and video information decoding module and the graphic processor;
the audio and video information decoding module is used for acquiring the video information and the audio information and decoding the video information and the audio information to obtain an original code stream;
the central processing unit is used for processing the original code stream to obtain high-order tensor data of video information and audio information;
the image processor is used for inputting the high-order tensor data into a preset neural network model to obtain a primary output low-order tensor;
the central processing unit is used for clustering the preliminary output low-order tensor to obtain image classification features and audio classification features based on the timestamp, fusing the image classification features and the audio classification features based on the timestamp, and identifying based on a preset rule to obtain an identification result; the image classification features include: video passenger abnormal behavior characteristics, station abnormal environment characteristics, abnormal light brightness characteristics and large passenger flow characteristics; the audio classification features include: a sound abnormal pitch feature, an abnormal timbre feature, an abnormal loudness feature, a loudness change rate feature, and a delay time feature.
Preferably, the intelligent carrier board includes: the system comprises a micro control unit, a wireless communication module and a protection device;
the micro control unit is in communication connection with the intelligent core board and is used for acquiring the running state and the over-temperature state of the intelligent core board and controlling a preset fan and an alarm unit based on the running state and the over-temperature state;
the wireless communication module is used for sending the identification result of the intelligent core board to a mobile station terminal;
the protection device includes: overcurrent safety device, pin electrostatic protection device, two-way voltage level converter.
Preferably, the alarm unit includes an indicator light and a sound unit.
Preferably, the intelligent core board and the intelligent carrier board are in communication connection through a USB communication module and/or a UART communication module.
In a second aspect, an embodiment of the present invention provides a track traffic video analysis control system, including: the system comprises a central server and a plurality of groups of track video monitoring systems; each group of track video monitoring system comprises: the track video monitoring device, the switch and like the utility model provides a track traffic video analysis control box;
the track video monitoring device is used for acquiring audio information and video information and sending the audio information and the video information to the switch;
the switch sends the audio information and the video information to the rail transit video analysis control box;
the rail transit video analysis control box identifies the audio information and the video information to obtain an identification result, and sends the identification result to the switch;
and the switch sends the identification result to the central server.
Preferably, the track traffic video analysis control box is further configured to send a first control instruction to the controlled device based on the identification result, so as to control the controlled device to perform information broadcasting and event processing.
The controlled device includes: platform door, automatic escalator, vertical elevator, floodgate machine, broadcasting equipment and display screen.
Preferably, the method further comprises the following steps: a mobile station service terminal;
and the track traffic video analysis control box is also used for sending an identification result to the mobile station service terminal.
Preferably, the track video monitoring system further comprises: a manual console;
the manual control console is used for providing control instructions input by staff to control the rail transit controlled equipment
And the track traffic video analysis control box is also used for sending an identification result to the mobile station service terminal.
Preferably, the track traffic video analysis control box is further used for acquiring a manual identifier fed back by an employee;
the rail transit video analysis control box is used for sending a second control instruction to the controlled equipment to control the controlled equipment to broadcast information and process events when the artificial identification is used for representing that the identification result is an emergency; when the artificial identification is used for representing that the identification result is wrong, recording the wrong identification result;
and the wrong recognition result and the corresponding artificial identification are used for retraining a module for carrying out intelligent security scene recognition in the rail transit video analysis control box.
In a third aspect, an embodiment of the present invention provides a rail transit video analysis control method, including: the rail transit video analysis control method is applied to a rail transit video analysis control box, the rail transit video analysis control box is arranged in one-to-one correspondence with a rail video monitoring device, and the rail transit video analysis control method comprises the following steps:
acquiring video information and audio information;
based on the video information and the audio information, performing intelligent identification on a security scene to obtain an identification result;
sending the identification result to a central server; and the identification result is a scene needing to be alarmed.
Preferably, the method further comprises the following steps: based on the identification result, sending a control instruction to controlled equipment in the rail transit video analysis control system to control the controlled equipment to broadcast information and process events; wherein the controlled device includes: platform doors, escalators, vertical elevators, gates, broadcasting equipment and display screens;
and sending the identification result to a preset mobile station service terminal.
In the rail transit video analysis control box provided by the embodiment of the utility model, the intelligent core board is connected with the first communication interface, acquires video information and audio information, performs intelligent security scene identification based on the video information and the audio information to obtain an identification result, and sends the identification result to a central server through the first communication interface; wherein the identification result is a scene needing to be alarmed; the intelligent carrier plate is connected with the intelligent core board and used for protecting the rail transit video analysis control box, acquiring the recognition result and the running state of the intelligent core board and giving an alarm based on the recognition result and the running state. So, track traffic video analysis control box can be directly after obtaining the video, directly carries out security protection scene intelligent recognition, obtains the recognition result, avoids sending video information and audio information to central server, reduces data transmission's volume, and ductility when reducing terminal data analysis and response production avoids leading to the staff to deal with the delay untimely because of system feedback.
Drawings
In order to clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the description below are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a track traffic video analysis control box according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a track traffic video analysis control system according to an embodiment of the present invention;
fig. 3 is a flow chart of station video analysis edge calculation of the rail transit video analysis control system provided by the embodiment of the present invention;
fig. 4 is a schematic flow chart of a track traffic video analysis control method according to an embodiment of the present invention;
fig. 5 is a schematic flow chart of a track traffic video analysis control method according to another embodiment of the present invention.
Reference numerals are as follows:
1: an intelligent core board; 11: an audio and video information decoding module; 12: a central processing unit;
13: a graphics processor; 2: an intelligent carrier plate; 21: a micro control unit;
22: a wireless communication module; 23: a protection device; 3: a central server;
4: a track video monitoring system; 5: a track video monitoring device; 6: a switch;
7: track traffic video analysis control box.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by a person skilled in the art without making creative efforts belong to the protection scope of the present invention.
The track video monitoring system is mainly deployed in stations, parking lots and vehicle sections, and transmits video images of the line to a subway control center for monitoring, so that the track video monitoring system becomes an important means for guaranteeing the safety of track traffic driving organizations and maintaining the bus taking order of the stations and the safety of passengers. However, the track video monitoring system is limited by the self framework and the application shortage of the new technology, so that some problems occur during further intelligent upgrading and optimization, and even certain restrictions are generated on the aspect of supporting track traffic safety guarantee.
The prior applied track traffic video monitoring system belongs to a central centralized processing type framework, and the following problems exist when the monitored object is analyzed and processed by centralized computing resources. On the aspect of system architecture, mass video data are transmitted to a computing center for processing, so that the analysis and response of terminal data are time-delayed, and when high risk levels such as fighting, crowding and trampling, track falling and other events occur, the handling delay of workers can be caused by untimely system feedback. In the aspect of system functions, the traditional rail transit video monitoring system mainly collects and transmits video image data due to the fact that front-end camera equipment is weak in intelligent analysis capacity, and generally does not have the functions of behavior detection, large article leaving detection, platform boarding and alighting people number statistical analysis and the like, stations can only analyze feedback and work personnel through a system center to achieve station safety inspection, and the problems of low safety operation management efficiency, untimely management and poor flexibility exist. To this problem, the embodiment of the utility model provides a track traffic video analysis control box. Fig. 1 is the utility model provides a track traffic video analysis and control box's schematic structure diagram, as shown in fig. 1, track traffic video analysis and control box includes: the intelligent core board comprises a shell, an intelligent core board 1 and an intelligent carrier board 2;
the shell is provided with a first communication interface;
the intelligent core board 1 and the intelligent carrier board 2 are arranged inside the shell;
the intelligent core board 1 is connected with the first communication interface, acquires video information and audio information, performs intelligent security scene identification based on the video information and the audio information to obtain an identification result, and sends the identification result to a central server through the first communication interface; wherein the identification result is a scene needing to be alarmed;
the intelligent carrier plate 2 is connected with the intelligent core board 1 and used for protecting the rail transit video analysis control box, acquiring a recognition result and the running state of the intelligent core board 1 and giving an alarm based on the recognition result and the running state.
In a specific use process, the rail transit video analysis control box is connected with the switch through a first communication interface; video information and audio information acquired by a track video monitoring system are acquired through a first communication interface, security and protection scene intelligent identification is directly carried out on the video information and the audio information, an identification result is obtained, the identification result is sent to a central server through a switch, therefore, a track traffic video analysis control box can directly carry out security and protection scene intelligent identification after videos are acquired, the identification result is obtained, sending of the video information and the audio information to the central server is avoided, the data transmission amount is reduced, the time delay of terminal data analysis and response generation is reduced, and the problem that staff treatment is delayed due to untimely system feedback is avoided.
Wherein, intelligence core board 1 includes: the system comprises an audio and video information decoding module 11, a central processing unit 12 and a graphic processor 13;
the central processor 12 is respectively connected with the audio and video information decoding module 11 and the graphic processor 13;
specifically, the central processing unit is configured to process the original code stream to obtain high-order tensor data of video information and audio information;
the image processor is used for inputting the high-order tensor data into a preset neural network model to obtain a primary output low-order tensor;
the central processing unit is used for clustering the preliminary output low-order tensor to obtain image classification characteristics and audio classification characteristics based on timestamps; the image classification features include: video passenger abnormal behavior characteristics, station abnormal environment characteristics, abnormal light brightness characteristics and large passenger flow characteristics; the audio classification features include: a sound abnormal tone feature, an abnormal loudness feature, a loudness change rate feature, and a delay time feature; fusing image classification features and audio classification features based on the timestamp, and identifying based on a preset rule to obtain an identification result; specifically, the method comprises the following steps: the feature fusion rules are as follows:
Figure BDA0003455627870000071
as shown in the above table, fusing image classification features and audio classification features based on timestamps includes: fusing passenger behavior characteristics with sound tone characteristics; fusing passenger behavior characteristics and sound tone characteristics; fusing passenger behavior characteristics and sound loudness; fusing passenger behavior characteristics and loudness change rate characteristics; fusion of passenger behavior characteristics with sound delay time; fusing station environment characteristics and sound tone characteristics; fusing station environment characteristics and sound tone characteristics; fusing station environmental characteristics and sound loudness; fusing station environment characteristics and loudness change rate characteristics; fusing station environmental characteristics and sound delay time; fusing the light brightness characteristic and the sound tone characteristic; fusing the light brightness characteristic and the sound tone characteristic; fusing the brightness characteristic of light and the loudness of sound; fusing the light brightness characteristic and the loudness change rate characteristic; fusing the light brightness characteristic with the sound delay time; fusing a large passenger flow characteristic and a sound tone characteristic; fusing the characteristics of the large passenger flow and the characteristics of the sound timbre; fusing the characteristics of the large passenger stream and the loudness of sound; fusing the characteristics of the large passenger flow and the characteristics of the loudness change rate; fusing the characteristics of the large passenger flow and the sound delay time; in conclusion, the fusion quantity is the product of the quantity of the audio abnormal features and the quantity of the image classification features. For example, if the number of audio abnormality features is N and the number of image classification features is M, there are N × M kinds of fusions.
Furthermore, any k features of the (N + M) features can be selected for fusion. For example, referring to table N above, N is 5; m is 4; k takes a value from 2 to (N + M); for example, k may be 3; when k is 3, the feature to be fused may be any three of the above-mentioned 9 features.
The intelligent carrier plate 2 comprises: a micro control unit 21, a wireless communication module 22 and a protection device 23;
the micro control unit 21 is in communication connection with the intelligent core board 1, and is configured to acquire an operating state and an over-temperature state of the intelligent core board 1, and control a preset fan and an alarm unit based on the operating state and the over-temperature state;
the wireless communication module 22 is configured to send the identification result of the intelligent core board 1 to a mobile station service terminal;
the protection device 23 includes: overcurrent safety device, pin electrostatic protection device, two-way voltage level converter.
The alarm unit comprises an indicator light and a sounding unit.
Specifically, a Micro Control Unit (MCU) in an intelligent carrier plate adopts a mainstream mixed signal ARM Cortex-M4 processor STM32F303CBT6 series with a DSP (digital signal processor) and a FPU (field programmable gate array) as a development platform, communicates with an intelligent core plate through a USB (universal serial bus) and a UART (universal asynchronous receiver/transmitter), receives an instruction of the intelligent core plate through a DMA-UART module, comprises a system running state, an over-temperature state and the like, controls the color and sound alarm of a fan and an indicator light according to the states, and can send control box information and video scene alarm information to a mobile station terminal through a wireless communication module (WTM); in JWIS, TPS25200DRVR electronic fuse realizes the overcurrent protection of USB; SP3012-06UTG is an ESD protection device that protects each pin from electrostatic damage; the TXB0108PWR is provided with an 8-bit bidirectional voltage level converter with automatic direction induction and +/-15kV ESD protection, so that level unification between JWIC and JWIS is realized, and stable and reliable communication is ensured.
Fig. 2 is a schematic structural diagram of a track traffic video analysis control system according to an embodiment of the present invention; referring to his 2, a track traffic video analysis control system includes: the system comprises a central server 3 and a plurality of groups of track video monitoring systems 4; each group of track video monitoring systems 4 includes: the track video monitoring device 5, the switch 6 and the track traffic video analysis control box 7 provided by the embodiment of the utility model;
the track video monitoring device 5 is used for acquiring audio information and video information and sending the audio information and the video information to the switch 6;
the switch 6 sends the audio information and the video information to the rail transit video analysis control box 7;
the rail transit video analysis control box 7 is used for identifying the audio information and the video information to obtain an identification result and sending the identification result to the switch 6;
the switch 6 sends the identification result to the central server.
So set up, each has avoided carrying out the analysis of concentrating a large amount of video data transmission to station server through at edge end video analysis, can realize video analysis near the equipment end to the accessible is wired, wireless multiple mode carries out information transmission, has improved track traffic video monitoring scene analysis's real-time, intelligent. Through the video analysis at the edge end, the construction and maintenance cost of the track traffic video monitoring system using the video analysis server is reduced. Through the intelligent video analysis who realizes all kinds of scenes at the edge, and through the feature fusion of video and audio frequency, help promoting track traffic's safety guarantee ability, improve station operation management efficiency.
Specifically, the track traffic video analysis control box 7 is further configured to send a first control instruction to the controlled device based on the identification result, so as to control the controlled device to perform information broadcasting and event processing.
The controlled device includes: platform door, automatic escalator, vertical elevator, floodgate machine, broadcasting equipment and display screen.
Track traffic video analysis control system still includes: a mobile station service terminal;
the track traffic video analysis control box 7 is further configured to send an identification result to the mobile station service terminal.
So set up, can make relevant staff in time acquire the state of track traffic to in time handle.
The track video monitoring system 4 further comprises: a manual console;
the manual control console is used for controlling the control instruction input by the staff so as to control the rail transit controlled equipment
The track traffic video analysis control box 7 is further configured to send the identification result to the mobile station service terminal.
It should be noted that, in actual use, the system probably has the erroneous judgement, needs manual intervention this moment, the embodiment of the utility model provides an in the scheme, can control the system based on manual control platform by the staff.
Further, the track traffic video analysis control box 7 is also used for acquiring a manual identifier fed back by an employee; the rail transit video analysis control box 7 is used for sending a second control instruction to the controlled equipment to control the controlled equipment to broadcast information and process events when the artificial identification is used for representing that the identification result is an emergency; when the artificial identification is used for representing that the identification result is wrong, recording the wrong identification result;
the wrong recognition result and the corresponding artificial identification are used for retraining a module for performing intelligent security scene recognition in the rail transit video analysis control box 7.
It should be noted that the manual identifier may be obtained through manual control, or may be obtained based on the mobile station service terminal.
To sum up, the embodiment of the utility model provides a track traffic video analysis and control box 7 and system, wherein track traffic video analysis and control box 7 is high performance, low-cost, low-power consumption microprocessor's track traffic security protection intelligent control box based on NVIDIA card ARM, and this control box hardware comprises JWIC (intelligent core plate 1) and JWIS (intelligent support plate 2). Various video AI analysis algorithms are integrated and operated in the JWIC, and various video scenes can be quickly analyzed and processed at the edge terminal according to scene definition abnormal events. The JWIS is communicated with the JWIC to realize the functions of monitoring the state of the equipment, wirelessly transmitting data, arranging acousto-optic alarm and the like. The intelligent control box for the rail transit security protection based on the edge calculation can replace a traditional video analysis server, and the real-time performance and the intelligence of the rail transit video monitoring are effectively improved.
The embodiment of the utility model provides a track traffic video analysis control system's concrete work flow is shown in figure 3: and step 101, after acquiring a video stream and an audio stream, a station camera transmits the video stream and the audio stream to a rail transit video analysis control box based on edge calculation through a switch. And 102, transmitting the video stream and the Audio stream to a Central Processing Unit (CPU) through a JWIC (gigabit-capable) network interface (GBE), and transmitting the video stream and the Audio stream to an Audio and video information decoding module (Audio & video decoder) through an internal Direct Memory Access (DMA) for decoding to obtain an original code stream. And 103, preprocessing the original code stream by the CPU, wherein the preprocessing comprises processes of Resize, crop, normalization, standardization and the like, tensor data suitable for deep neural network input are obtained, and preprocessing the audio code stream by the CPU comprises MFCC, MEL and the like, and audio features are obtained. And 104, inputting tensor data into the GPU, and obtaining a primary output tensor through a neural network model, such as target detection, abnormal audio detection and the like, preloaded by the GPU. And 105, transmitting the preliminary output tensor back to the CPU again, carrying out tensor clustering on the preliminary output tensor to obtain an image classification result based on the timestamp, simultaneously adding audio features based on the timestamp to fuse the image, and classifying the identification scene based on a management method and station customization requirements. And step 106, carrying out data packing on the image grading and classification results, packaging the image grading and classification results into an Http data stream, sending the Http data stream to a mobile terminal based on the special wireless B-trunk/5G for rail transit, or sending the Http data stream to a central server side based on CAN/RS485 for alarm information confirmation, and simultaneously sending out sound and light alarm by the equipment. And 107, if the alarm information is accurate, further constructing a knowledge graph about the alarm scene disposal process and linkage. According to the station scene risk level, on one hand, the alarm information is released through a PIS system and broadcasting through a mobile terminal station APP and a server terminal, and on the other hand, a PIS screen, a platform door or broadcasting equipment which is closest to the position of the event scene is selected according to the video analysis result to release the information; such as serious risk events like fire, terrorist attack, flood and the like, and equipment emergency cooperative linkage control is realized through linkage event related equipment such as platform doors, escalators, vertical elevators, gates, videos and the like; and on the other hand, manual intervention and treatment of the station are simultaneously adopted. And step 108, if the alarm information is inaccurate, manually marking, and storing the scene as a knowledge base for the GPU neural network model to continue training and optimizing.
The embodiment of the utility model provides a still provide a track traffic video analysis control method, be applied to track traffic video analysis control box, track traffic video analysis control box sets up and track video monitoring device one-to-one sets up, refer to fig. 4, track traffic video analysis control method includes:
step 201, acquiring video information and audio information;
step 202, performing intelligent security scene identification based on the video information and the audio information to obtain an identification result;
step 203, sending the identification result to a central server; and the identification result is a scene needing to be alarmed.
Optionally, the track traffic video analysis control method further includes:
step 204, based on the identification result, sending a control instruction to a controlled device in the rail transit video analysis control system to control the controlled device to perform information broadcasting and event processing;
wherein the controlled device includes: platform doors, escalators, vertical elevators, gates, broadcasting equipment and display screens;
and step 205, sending the identification result to a preset mobile station service terminal.
The embodiment of the utility model provides a concrete implementation process of method with the embodiment of the utility model provides a track traffic video analysis control box and track traffic video analysis control system's relevant explanation is not being repeated here one by one.
Fig. 5 is a schematic flow chart of a track traffic video analysis control method according to another embodiment of the present invention. Referring to fig. 5, an embodiment of the present invention provides a method for analyzing and controlling a track traffic video, including:
a plurality of cameras (camera 1 to camera N) collect videos;
the rail transit video analysis control box acquires a video;
step 301, decoding is performed by Audio & VideoDecoder;
step 302, the CPU carries out preprocessing and tensor transformation on video and audio streams;
303, training and primarily classifying video features and audio features by the GPU through a preloaded neural network;
wherein step 302 and step 303 are performed in cooperation.
Step 304, clustering the video and audio quantitative data by the CPU;
305, fusing the video characteristic and the audio characteristic by the CPU based on the same time stamp;
step 306, the CPU classifies the station monitoring scene based on a management method and station requirements in a grading way;
307, emitting an audible and visual alarm through the equipment;
step 308, outputting the alarm state to a station service APP of the mobile terminal for confirmation;
wherein, step 308 can be performed by the private radio B-Trunc/5G.
Step 309, outputting the alarm state to a monitoring server terminal and the like for confirmation;
wherein step 309 may be performed by a wired RS 485/CAN.
Step 310, if the alarm information is inaccurate, manually marking, and storing the scene as a knowledge base for continuous training and optimization of a GPU neural network model;
step 311, establishing a knowledge graph about the alarm scene disposal process and linkage according to the scene risk level;
step 312, on one hand, the mobile terminal station affair APP and the server terminal issue the alarm information to the abnormal event through the PIS system and broadcast, wherein according to the video analysis risk level, a PIS screen, a platform door or a broadcast device closest to the event position can be selected to issue information in forms of text, image, sound, video and the like;
313, in case of fire, terrorist attack, flood and other serious risk events, realizing emergency cooperative linkage control of equipment through linkage event related equipment such as platform doors, escalators, vertical elevators, gates, videos and the like;
and step 314, on the other hand, simultaneously adopting station manual intervention and treatment.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes commands for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it should be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (5)

1. A track traffic video analysis control box, characterized by comprising: the track traffic video analysis control box comprises a shell, an intelligent core board, an intelligent carrier board, an indicator light and a sound production unit, wherein the track traffic video analysis control box is an analysis box based on NVIDIA CarmelARM;
the shell is provided with a first communication interface; the intelligent core board and the intelligent carrier board are arranged inside the shell; the intelligent core board is connected with the first communication interface and used for acquiring an identification result and sending the identification result, wherein the identification result is a scene needing to be alarmed;
the intelligent carrier plate is connected with the intelligent core plate through a USB communication module and/or a UART communication module, and the intelligent carrier plate is connected with the indicator light and the sounding unit and used for giving an alarm;
the intelligent carrier board comprises a TPS25200DRVR electronic fuse, a SP3012-06UTG and a TXB0108PWR, wherein the TPS25200DRVR electronic fuse is used for realizing overcurrent protection of a USB, the SP3012-06UTG is used for protecting each pin from being damaged by static electricity, and the TXB0108PWR is a bidirectional voltage level converter and is used for realizing level unification between the intelligent core board and the intelligent carrier board.
2. A rail transit video analysis control system is characterized by comprising: the system comprises a central server and a plurality of groups of track video monitoring systems; each group of track video monitoring system comprises: the track traffic video analysis control box comprises a track video monitoring device, a switch and the track traffic video analysis control box according to claim 1;
the track video monitoring device is used for acquiring audio information and video information and sending the audio information and the video information to the switch;
the switch sends the audio information and the video information to the rail transit video analysis control box;
the rail transit video analysis control box identifies the audio information and the video information to obtain an identification result, and sends the identification result to the switch;
and the switch sends the identification result to the central server.
3. The track traffic video analysis and control system according to claim 2, wherein the track traffic video analysis and control box is further configured to send a first control instruction to a controlled device based on the recognition result to control the controlled device to perform information broadcasting and event processing;
the controlled device includes: platform door, automatic escalator, vertical elevator, floodgate machine, broadcasting equipment and display screen.
4. The track traffic video analysis control system according to claim 2, further comprising: a mobile station service terminal;
and the track traffic video analysis control box is also used for sending an identification result to the mobile station service terminal.
5. The track traffic video analysis and control system according to claim 2, wherein the track video monitoring system further comprises: a manual console;
the manual control console is used for controlling the rail transit controlled equipment by a control instruction input by an employee;
and the track traffic video analysis control box is also used for sending an identification result to the manual control console.
CN202220006889.4U 2022-01-04 2022-01-04 Rail transit video analysis control box and system Active CN217849510U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202220006889.4U CN217849510U (en) 2022-01-04 2022-01-04 Rail transit video analysis control box and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202220006889.4U CN217849510U (en) 2022-01-04 2022-01-04 Rail transit video analysis control box and system

Publications (1)

Publication Number Publication Date
CN217849510U true CN217849510U (en) 2022-11-18

Family

ID=84010784

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202220006889.4U Active CN217849510U (en) 2022-01-04 2022-01-04 Rail transit video analysis control box and system

Country Status (1)

Country Link
CN (1) CN217849510U (en)

Similar Documents

Publication Publication Date Title
CN114390156A (en) Rail transit video analysis control box, system and method
CN101795395B (en) System and method for monitoring crowd situation
CN109801420B (en) Multi-concurrent face recognition access control system based on classification algorithm and recognition method thereof
CN109283897A (en) A kind of wisdom power plant comprehensively monitoring center intelligent monitoring implementation method
CN101465055A (en) Rapid intelligent public transport stereo monitoring apparatus and working method thereof
CN104038952A (en) Emergency prediction method and system
CN214704896U (en) AI-based video snapshot device for dangerous actions of intelligent construction site
CN108046073A (en) A kind of elevator network monitoring system for things
CN111792487A (en) Elevator intelligent management system and management method based on big data platform
CN212032366U (en) Dispatching system and public transport system in ground public transport area
CN112477927A (en) Rail transit station control information system based on mobile terminal
CN112233003A (en) Green intelligent passenger station system and integration method
CN111583699A (en) Intelligent bus monitoring system
CN111160537B (en) Crossing traffic police force resource scheduling system based on ANN
CN211184122U (en) Intelligent video analysis system for linkage of railway operation safety prevention and control and large passenger flow early warning
CN117392852B (en) Cloud computing resource scheduling optimization system oriented to big data analysis
CN217849510U (en) Rail transit video analysis control box and system
CN116128678A (en) Intelligent campus emergency response system
CN112598384B (en) Station passenger flow monitoring method and system based on building information model
CN107909159A (en) A kind of municipal rail train emergence treating method
CN107665577A (en) A kind of traffic alert treating method and apparatus
CN207796846U (en) Integrated street lamp
CN112581098A (en) Building site wisdom management system
CN111008922A (en) Hui-Zhi-an comprehensive management and public security robot and operation method thereof
CN110867086A (en) Urban road construction traffic organization management system

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant