CN109640032A - Based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence - Google Patents

Based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence Download PDF

Info

Publication number
CN109640032A
CN109640032A CN201810332637.9A CN201810332637A CN109640032A CN 109640032 A CN109640032 A CN 109640032A CN 201810332637 A CN201810332637 A CN 201810332637A CN 109640032 A CN109640032 A CN 109640032A
Authority
CN
China
Prior art keywords
video
artificial intelligence
camera
data
overall view
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810332637.9A
Other languages
Chinese (zh)
Other versions
CN109640032B (en
Inventor
冯保国
张静
Original Assignee
Zhejiang Haolan Technology Co Ltd
Hebei Deguron Electronic Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Haolan Technology Co Ltd, Hebei Deguron Electronic Technology Co Ltd filed Critical Zhejiang Haolan Technology Co Ltd
Priority to CN201810332637.9A priority Critical patent/CN109640032B/en
Publication of CN109640032A publication Critical patent/CN109640032A/en
Application granted granted Critical
Publication of CN109640032B publication Critical patent/CN109640032B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B19/00—Alarms responsive to two or more different undesired or abnormal conditions, e.g. burglary and fire, abnormal temperature and abnormal rate of flow

Abstract

The invention proposes one kind based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence, it include: the more element overall view monitoring detection devices of at least one front end artificial intelligence and central management device, camera shooting unit, more essential sensors, communication module, mobile terminal and the interface unit that each fore device includes central control processing unit, is connected with central control processing unit, more essential sensors include: brightness light intensity sensor, Temperature Humidity Sensor, precipitation rain fall sensor, wind speed wind direction sensor, integrated gas sensor；Imaging unit includes more Zoom cameras and IPC thermal infrared imaging camera；Central control processing unit mainly completes the image information that will be received and carries out splicing fusion and data acquisition, logical operation and logic control output by stitching algorithm；Central management device carries out scene five by big data cloud processing platform and ties up figure real-time display.The present invention externally exports 5 groups of video flowings, supports one 180 ° or 360 ° of panoramic seamless splicing video flowings.

Description

Based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence
Technical field
It is the present invention relates to overall view monitoring technical field, in particular to a kind of based on the more element overall view monitoring detections of artificial intelligence Five dimension early warning systems.
Background technique
Firstly, high-definition monitoring camera be widely used every field include: traffic, bank, airport, oil field, Railway, safe city, rail traffic, public place, national defence etc. numerous areas have become a kind of indispensable important set It is standby.It furthermore is again the video camera having a single function based on important technicals such as video analysis processing, detection, candid photograph, data extractions It is filled with new life.
Although monitor camera has been assigned many functions, but by the institutes such as its installation environment, position, angle, height Limit, however it remains various drawbacks make it can only be in special occasions, particular surroundings, special mounting position, special angle and height When spending, its use demand could be met to greatest extent.As soon as example to realize a day uninterrupted monitoring in 24 hours, must be taken the photograph Camera installation light compensating apparatus just may be implemented.For another example to allowing video camera in various weather environments (rain, snow, mist, haze, sand Dirt etc.) under can normal use, just must use specific video camera such as thermal infrared imaging camera, to accurately to vehicle Information extracts candid photograph, and candid camera must be just mounted on to the surface of road track and mended with light filling etc. Light.Blind angle or dead zone are eliminated in order to monitor larger range of region, must just lay a greater amount of video camera ability It enough meets the actual needs, even the mode of gunslinging and ball machine linkage.Such as plan in safe city each 50 meters- 100 meters of layings for just having 3 video cameras almost just have 1 pair of monitor camera to lay, in tunnel in highway every 1 kilometer Just there is a video camera to be laid for each 100 meters -200 meters in road, including bridge pier at each 50 meters -100 meters of Very Large Bridge will Lay one, in this way important area device layout density will be bigger, although can satisfy actual use demand in technical aspect, " black under lamp " (can generate blind area below installation video camera pole) phenomenon is that not can avoid.Furthermore the cloth of so a large amount of video cameras If tangible or invisible cost caused by and is that can not estimate, for example power for a long time, is basic, vertical required for installation laying Bar, maintenance, maintenance etc..Although furthermore market has had already appeared 180 ° of panoramic mosaics or 360 ° of panoramic mosaic monitoring cameras now Machine, but many disadvantages, such as 1 180 ° of splicing video camera are still had in actual use, pacified using east-west direction When dress, since photechic effects (backlight or backlight) different in different time sections can be such that different splicing video cameras generate not on picture With image effect, the video camera overall picture of backlight can dimmed, wherein to lose original image information whole for the object being monitored Body becomes target information that is darker, and can not identifying preparation, and the object color that the video camera of backlight can become brighter, monitored loses Very.And picture so for 180 ° of panoramic mosaic video cameras is exactly an extremely big disaster, if in this way The Image Acquisition analysis of son obtains data will be more difficult, although can be by manually can change image product come adjusting parameter Matter, but operating process is very cumbersome, and persistently to adjust under different care light environments just can allow picture to become always It must can be used, however this way is impossible.Furthermore present panoramic mosaic technology has been solved from certain degree Portions of client demand, but since environment that video camera is mounted is different, different, monitored detectable substance of monitoring detection object The distance of body is different, illumination is different, the elevation angle difference of installation and other reasons is also very big limits pushing away for this new technology Wide and use, secondly existing panoramic mosaic technology still has some defects, video camera used camera lens whole when appearing on the scene For tight shot, even zoom lens is also required to after personnel dismantle equipment manual adjustment lens parameters, equipment is restored and has led to again Software correction parameter is crossed, best splicing effect can be reached, even the height and angle of video camera installation in this way, also can Very big limitation is received, so cumbersome operating process layman is difficult to grasp and handle.Many monitoring inspections now Zone user or unit in charge of construction are surveyed in order to facilitate reliable and stable, is still ready to select multiple video cameras to the prison of big regional scope Inspection surveys application scheme.
Secondly, total factor weather station follows the design of International Meteorological Organization (WMO) meteorological observation standard and specification, mainly for Including right: environment temperature, ambient humidity, dew-point temperature, wind speed, wind direction, air pressure, total solar radiation, rainfall, ground temperature (including Surface temperature, shallow earth, deep ground temperature), soil moisture, soil water potential, soil heat flux, evaporation, carbon dioxide, sunshine when Totally two ten item data indexs carry out detection point for number, direct solar radiation, ultraviolet radioactive, terrestrial radiation, net total radiation, environmental gas Analysis, majority use unattended mode, and installation or portion are located at important area to obtain various significant datas.
Although total factor weather station can satisfy the use demand of most of personnel or department, but since cost is high Expensive to be still widely used, even many functions, which are not utilized, causes very big waste.Since Professional Meteorological station is all It is laid on the position of a certain fixation and cannot at will be moved by fixed point, acquired data also can only be the meteorological number of single-point According to, rather than continuum or a wide range of accurate data, although we can be obtained by meteorological observatory following several days or The local weather condition on the same day, but the situation of " here raining, fine over there " is tended to occur in same city or uniform areas. And such case be even more very big influence is caused on important mechanism or department, even cause unnecessary economic loss or It is the danger of life.Such as winter highway or urban transportation major trunk roads will cause after snowing it is icy on road, and this Kind is icy on road and is not fixed point, this just needs the ice condition to entire road, the effective detection of weather condition progress to obtain Take authentic and valid data that can take significantly more efficient methods to avoid the generation of various disasters.There are also in haze sky Gas rains, snows weather or foggy weather equally also has a generation of such case, and it is this under the conditions of pinpoint meteorological detection dress The power that will seem is set to have no way of the heart.Although being all that fixed point is laid there are also smoke sensor device has also been laid in tunnel still, there are also tunnels Pernicious gas detection and environment measuring in road be all using fixed point detection, and quantity seldom can only be unilateral reflect it is a certain The data of a node and/or a section cannot represent the large-scale accurate data in successional region, once especially tunnel In occur traffic accident event when, this data are even more important, earlier obtain continuity accurately and reliably valid data to danger Alarm reconciliation lifesaving life provides technical support, this is extremely important for a traffic administration person.
Furthermore tunnel fire hazard is that public transport endangers maximum safety accident, not only result in the traffic jam in tunnel and And there may be heavy losses and life security.Once explosion or fire occur in tunnel will all be difficult to succour, for quickly examining Accurate early warning is surveyed to reduce wrong report and fail to report for fast and accurately handling major event, being rapid control fire behavior and implementing personnel Rescue and the key for reducing loss.Fire detection technology traditional now specifically includes that temperature-sensitive detection, the detection of sense cigarette, temperature-sensitive light The technologies such as fine detection, fiber grating detection, double UV check, video detection and infrared detection, the shadow vulnerable to tunnel complex environment It rings, it is difficult to realize fire real-time detection and pre-warning time lags, in addition current Detection Techniques are difficult to ensure to be formed comprehensively Safety monitoring system, in addition after being abnormal event many monitoring devices under being concerned about of dense smoke all by failure.
The region of smog sprawling, pernicious gas constitute situation and staff in tunnel and evacuate situation, and distribution situation all can be The function of script, rescue personnel and monitoring personnel are lost in the case where dense smoke raging fire can not obtain in tunnel accurately When information, it can not all carry out and effectively succour.Field Force can only be look to save oneself once there is this situation.There are also existing Fire alarm detection device almost all is alarm, the auxiliary work such as is more instructed, monitored, observe without intuitive video With, existing video detection warning device all can in the case where dense smoke failure.There are also the discrepancy that a kind of disaster is exactly tunnel It is mouthful icy on road, after especially entering the winter, once Plain even after freezing occurs in extremely frigid zones road surface, all will be to road The vehicle of upper traveling constitutes serious damage, economic loss or personnel caused by this accident of even great traffic accident Injures and deaths are all the largest, although being able to solve certain need of user now with many detection technique or equipment icy on road It asks, but the use of the reliable wide coverage of simple and stable and intuitive pavement detection equipment is always quick and precisely that owner is continuous Pursuit.
It summarizes, various equipment described above, has respective advantage and disadvantage, but being the largest disadvantage is exactly each equipment Oneself independent system compartment, so huge data information how to integrate as human security trip or Person is that rescue provides help, is the current technical issues that need to address.
Summary of the invention
The purpose of the present invention aims to solve at least one of described technological deficiency.
For this purpose, a kind of based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence it is an object of the invention to propose System.
To achieve the goals above, the embodiment of the present invention is provided based on more five dimensions of element overall view monitoring detection of artificial intelligence Early warning system, comprising: the more element overall view monitoring detection devices of at least one front end artificial intelligence and central management device, Mei Gesuo Stating the more element overall view monitoring detection devices of front end artificial intelligence includes that central control processing unit and the center control processing are single One group of connected Zoom camera of member (realizes 180 ° or 360 ° of panoramic mosaic functions, it is possible to provide a wide range of video road conditions are looked into real time See, provide it is various based on video and graphic analysis monitor and detection functions), IPC thermal infrared imaging camera (realize high temperature substrate physical examination Survey, the dark ice detection of road, fire alarm alarm detection, night vision function etc. belong to sension unit), more essential sensors, communication mould Block and interface unit and power supply module, wherein more essential sensors include: brightness light intensity sensor, Temperature Humidity Sensor, Precipitation rain fall sensor, wind speed wind direction sensor, integrated gas sensor, wherein the brightness light intensity sensor is current for acquiring The brightness light intensity value of environment；The Temperature Humidity Sensor is used to acquire the data of the Temperature and Humidity module of current environment, the precipitation rain fall sensor For acquiring the rainfall value of current environment, the wind speed wind direction sensor is used to acquire the wind speed and direction data of current environment, institute Integrated gas sensor is stated for acquiring the concentration value of all kinds of gases in current environment, wherein every leading portion artificial intelligence More element overall view monitoring detection devices are installed on the predetermined position in section, then by collected all kinds of environmental data information It is sent to the central control processing unit, is detected the more element overall view monitorings of each leading portion artificial intelligence by central control unit Device uploads to central management device (five dimension early warning alarm management platforms), progress analog simulation scene actual environment (such as: rain, Snow, mist, wind, sunshine etc.) and it is dissolved into real-time display in five dimension figures, it is checked for road conditions, the prediction of roadside assistance, environmental hazard Assessment, emergency schemes generation provide basic basis；The camera shooting unit includes more Zoom cameras, for realizing 180 ° or 360 ° of panoramic mosaic functions, and a wide range of video road conditions in real time are provided and checks, the various monitoring based on video and graphic analysis is provided Detection function, wherein every more element overall view monitoring detection devices of leading portion artificial intelligence are installed on the default position in section Place is set, acquires the image information of different location on section respectively, wherein every video camera uses the Varifocal zoom lens of different focal length It monitors the object of different distance, and acquires corresponding image information, acquired image information is then sent to the center Processing unit is controlled, the more element overall view monitoring detection devices of each leading portion artificial intelligence are uploaded into center by central control unit Managing device carries out secondary video image mosaic and is dissolved into real-time display in five dimension figures, realizes anomalous event accident detection Alarm, positioning, traffic behavior preview and assessment, complete trails video check the functions such as roaming；The IPC infrared thermal imaging camera shooting Machine is for realizing detecting high temp objects, the dark ice detection of road, fire alarm alarm detection, providing night vision perspective function, first The region for needing to detect delimited, then object, pedestrian, the subgrade and pavement etc. in detected region be measured in real time, and general Logical video camera night or environment it is dim by blinding when, play the role of night vision perspective monitoring；Every leading portion artificial intelligence More element overall view monitoring detection devices are installed on the predetermined position in section, and IPC thermal camera acquires on section not respectively With the object of position, pedestrian, subgrade and pavement data information and image information, then collected data information is sent to described Central control processing unit is uploaded to the more element overall view monitoring detection devices of each leading portion artificial intelligence by central control unit Central management device carries out concentrating Macro or mass analysis and is dissolved into real-time display in five dimension figures, realizes abnormal vehicle, object, row The alarm of the anomalous events accident detection such as people, subgrade and pavement, positioning, traffic behavior preview and assessment, night vision perspective function；In described Centre control processing unit is used to the above-mentioned one group of Zoom camera image information received carrying out splicing fusion by stitching algorithm With data acquisition, logical operation and logic control output, centre management is uploaded to after forming 180 ° or 360 ° of panoramic mosaic images On device, and when receiving from the warning message of the IPC thermal infrared imaging camera, sensed in conjunction with more elements The all data of device acquisition is analysed in depth after learning certainly according to preset alarm parameters or central control unit artificial intelligence The dynamic alarm plan generated exports warning message by the interface unit, and is sent to local warning device or third party sets In standby, and central server is uploaded to by network interface and carries out summarizing alarm or alarm triggering；The central control processing unit By the upper surface of described in panoramic mosaic video or image, the warning message of IPC thermal infrared imaging camera, video, image and more The data and warning message of essential sensor acquisition, by the communication module dispatching centre managing device or mobile terminal, Maintenance personnel checks real time monitoring information by the mobile terminal back-end platform, checks all in access local area network setting online Standby state and faulty equipment position and fault condition are quickly repaired in turn；The central management device receives each Video that fore device is sent, image, data, all data and warning message of the acquisition of more essential sensors, by N number of front end Equipment cascading and associate and obtain front end data, pass through big data cloud processing platform carry out scene five tie up figure show, system-wide The roaming of diameter traffic behavior video preview, the simulation of actual environment, emulation, playback, obtain environmental simulation as a result, and by figure and The form of sound informs manager and rescue personnel and fire fighter, takes maintenance measure；Central management device is by counting greatly Scene five is carried out according to cloud processing platform and ties up figure real-time display, comprising: graphical display is tieed up at scene five, practical weather perceives environment mould Quasi- Dynamically Announce, the preview of traffic prevailing state, event accident prejudges, the three-dimensional unlimited roaming of complete trails video-splicing is checked, event Position positions in real time, information summarizes upload for accident generation.
Further, every more element overall view monitoring detection devices of leading portion artificial intelligence use one group of varifocal or fixed-focus Video camera realizes 180 ° or 360 ° of panoramic mosaic fusions；The IPC video camera is used with temperature detection, regional assignment function Thermal infrared imaging camera.
Further, one group of variable-focus video camera joins Calibration Technology using intelligent level, wherein intelligent level joint debugging school includes To the focal length of video camera, aperture, shutter, white light balance, spectrum assignment, minimal illumination, wide dynamic, orientation, coded format parameter Adjustment；
When the parameter of any one video camera is by artificial adjustment, the parameter of other video cameras can follow automatic synchronization more Change, including carry out positive increase or reversed reduction according to preset program and parameter, to guarantee 180 ° or 360 ° of aphoramas The integrality of frequency image mosaic fusion.
Further, the camera shooting unit includes: 3 Zoom cameras and 1 dedicated IPC thermal infrared imaging camera, Wherein, the central control processing unit exports 5 groups of video flowings:
1st group: the video flowing of first Zoom camera；2nd group: the video flowing of second Zoom camera；3rd group: The video flowing of third Zoom camera；4th group: first 180 ° or the 360 ° of panoramic mosaics formed to third Zoom camera Video flowing；5th group: the video flowing of IPC thermal infrared imaging camera；
Wherein, in order to reduce the network bandwidth that equipment occupies, the 1st group to the 3rd group video flowing uses passive method of calling, is System default actively exports the 4th group of video flowing and the 5th group of video flowing, and third party system is when calling 1-3 group video flowing, guarantee the 4 groups and the 5th group of video flowing cannot interrupt.
Further, the interface unit includes: power supply interface and input/output interface, wherein
The power supply interface uses 48V POE power supply interface；The input/output interface includes: I/O interface, audio input Interface, audio output interface, CAN interface, RS485 interface and the adaptive RJ45 interface of 100/1000M.
Further, the integrated gas sensor is for acquiring sulfur dioxide, carbon dioxide, carbon monoxide, methane, first The gas concentration of aldehyde, natural gas, liquefied gas.
Further, the central control processing unit include: storage unit, it is clock unit, GPU graphics processing unit, more Core high speed arm processor, multicore high-speed dsp processor and central control logic operation and processing unit；The communication module is adopted With three kinds of wireless communication module, 4G communication module and the adaptive network interface communication module of 100/1000M.
Further, after by real-time image acquisition information and the data information of each sensor acquisition, system enables big data It analyzes and graphically simulates digital simulation obtained to monitoring center commanding and rescue and relief work personnel Basic guarantee, after this external system is by carrying out regular self-teaching and data summarization to Various types of data, most end form are provided At have five dimensions in real time dynamic present graphical for operator's decision, position, check, complete trails roaming, preview use, with three Tieing up map is bottom preview mode and the different periods, the different meteorological conditions, different traffic, real-time panoramic video figure that combine Shape splices fusion, different location, different extent of injury management strategy and periodical action scheme, once reach alarm critical point or When being in an emergency, system horse back alert, and watched in advance with five dimensional view exhibition methods to relevant staff It lookes at, to take corresponding rescue measure as soon as possible, life is saved in less damage.
Further, the central management device includes: management work station and privately owned Cloud Server, wherein the private clound Server setting is in monitoring branch center computer room, and execute following work: data exchange, system communication, is safeguarded, is store function The building of each function of uniting, the setting of parameter, concentrated alarm, scheme forming, artificial intelligence studies analysis in depth, linkage scheme executes It issues, three-dimensional map generates, five dimension graphic hotsopts, site environment data summarization, site environment analog simulation, big data macroscopic view fortune Calculation, video monitoring, image storage, alert event video recording is filed for reference, report produces, the secondary splicing of complete trails video image, complete trails Video image is checked, is roamed, preview generation, the calling of video image and third party link, and instruction sends, sends presupposed solution, day Often operation man-machine interface centralized alarm；The management work station setting executes following work: number on monitoring branch center operation bench Issue execution according to exchange, system communication, concentrated alarm, scheme forming, linkage scheme, five dimension figure real-time exhibitions, images are shown, Big data macroscopic view is shown, video monitoring, complete trails video image are checked, roamed, preview generation, the calling of video image, alarm Event record is filed for reference, report produces, linking with third party instructs transmission, transmission presupposed solution, regular job, man-machine interface to hand over Mutually, centralized alarm.
It is according to an embodiment of the present invention to tie up early warning systems based on the more element overall view monitoring detections five of artificial intelligence, have following The utility model has the advantages that
1) product can externally export 5 groups of video flowings by the gigabit network interface of itself, and every group of video flowing can support 5 Client accesses simultaneously；Including 3 independent camera video streams of monitoring different angle different directions, one 180 ° or 360 ° of panoramic seamless splice video flowing, a thermal infrared imaging camera video flowing.5 video flowings can work independently transmission Different Function detection or pattern analysis and storage, which are carried out, to different clients calls use.
2) 4 video cameras (3 variable-focus video cameras and 1 PLC thermal infrared imaging camera) are according to actual use situation Independent parameter setting modification can be carried out or receive the global revision plan of establishment in cascaded fashion, intelligence also may be implemented certainly Dynamic parameter linkage adjustment.
3) coding of video flowing and communication mode meet the coding and communication mode of International or National mainstream, can also be with According to user demand the scrambled format and communication mode exclusive using user, picture quality can be in 2,000,000 pixels to 2400 It arbitrarily switches or calls between ten thousand pixels and check.
4) 5 groups of video flowings all pass through a gigabit network interface and are exported, and each parameter can be by remotely carrying out pipe Reason, setting, modification.
5) equipment simultaneously have accident detection (pedestrian, vehicle violation stagnation of movement, traffic accident, drive in the wrong direction, shed object, Congestion, queuing), license plate capture (exceed the speed limit, go slowly, violating the regulations lane change, Path Recognition), dangerous suspect vehicle detection, fire detection, object The function such as the detection of body high/low temperature, the detection icy on road of dark ice, all kinds of anomalous weather disaster detections, pernicious gas, fuel gas detection Can, it can also be increased according to user demand based on image analysis processing other function such as face recognition, boundary defence etc..
6) the starlight grade that three video cameras are all made of that ultra-low illumination target surface is 1/1.8 " customizes image device, and effect is presented And dark situation backlight control；Long-range micro- focusing, accurate aperture regulatory function are realized, using specific physical hardware combinations and machinery Framework thoroughly solves the operating mode of single camera or multiple splicings video camera " black under lamp ".
7) keep splicing picture more smooth continuous and uninterrupted using seamless spliced mode.
It 8) can be by two or five dimension early warning system leading portion equipment of N number of continuous artificial intelligence more element overall view monitorings detection are led to Combination of network is crossed together, when meeting certain installation requirement (such as spacing distance, height), again to each leading portion equipment 180 ° sent or 360 ° of larger range of graphic joining fusions of full-view video images progress, to guarantee vehicle in tunnel Interior, road outfield is monitored in continuous regional scope without losing image information.Pass through this secondary splicing integration technology Long range, system-wide section, big region tracking and fortune without the continuous monitor and detection of blind angle and item, vehicle, pedestrian may be implemented The analysis of dynamic rail mark, it might even be possible to realize that whole scene 3D traces and monitors testing mechanism.
9) 180 ° of panoramic mosaic fusions are using multifocal away from compound eye connecting method, and 3 video cameras are using the variable of different focal length Zoom lens monitor the object of different distance, and equipment is being existed 3 video image splicing fusions by specific graphic joining algorithm Together, complete monitoring monitoring screen is formed.
10) 3 video cameras join focus technique using intelligent level, when the focal length of any one of 3 video cameras video camera is by people For adjustment when, the focal length of other two video cameras all can automatic synchronization change (pass through preset treatment mechanism and linkage Algorithm forward direction increases or reversed reduction), guarantee that the panoramic mosaic blending image of output is not affected.
11) 3 video cameras join Calibration Technology using intelligent level, when the color rendition degree of any one video camera, white balance, The important parameters such as ultra-low illumination, wide dynamic, exposure intensity, shutter speed, video code model, color uniformity are considered adjusting When, other two corresponding parameters of video camera all can automatic synchronization change (pass through preset treatment mechanism and linkage Algorithm forward direction increases or reversed reduction).
12) 3 video cameras will be as a complete whole appearance, it is necessary first to distort to the wide angle picture of three video cameras Carry out correction output；Exposure, white balance, color uniformity and color rendition are used is with center wide angle cameras (video camera 2) Refer-mechanisms, when wide angle cameras (video camera 2) image parameter in center adjusts, other two video cameras can synchronize automatic adjustment, Image mosaic is required to reach image mosaic optimum efficiency when coping with different light-inletting quantities.
13) when have in network cluster any leading portion equipment due to cause specific cause wire communication interrupt or wired confession After electricity interrupts, system horse back starting energy-saving mode and adhoc mode and the battery for relying on leading portion equipment itself to carry are carried out Work is maintained, is guaranteeing not go offline within the scope of 24 hours.Simultaneously by 4G, (future supports 5G mode or higher nothing to system Line transmission mode) mode to terminal user send warning message.
14) user can access online equipment state and event all in cluster net by cell phone application or computer real time inspection Barrier equipment position and fault condition are quickly repaired in turn.
15) when fire or explosion time occur in tunnel, when wherein an equipment or multiple equipment are damaged in tunnel, even When power supply system or communication system in tunnel can not work, fire fighter or rescue personnel can pass through pen in the entrance in tunnel Note is originally or in the wireless network of mobile phone access device, the equipment of communication disruption or power failure in tunnel, starts at once from group Net and energy-saving mode, in the case where continuing 24 hours low-power consumption modes for convenience of rescue personnel, fire fighter and leader are existing Command scheduling, live image (every 5-60 second of graphic form updates once, and the time is adjustable) feelings in real time inspection tunnel Condition, gives first aid to for personnel and robs calamity and recover and provide the quality time.
16) system passes through the various data such as collected more essential sensors and integrated gas sensor and itself work Make state (temperature, voltage, electric current, signal intelligence, each sensor online or damaged condition, mechanical breakdown situation) and compressed Video image or with thumbnail；By wireless network or 4G communication module, (future supports 5G mode or higher wireless transmission side Formula) be transferred to equipment management personnel or maintenance personnel and each leader, in this way these personnel can at any time with Equipment situation and field condition are grasped in ground, can easily realize online management mobile office demand, thus accomplish quickly to check, Quickly know, fast equipment malfunction elimination, quickly reparation and other effects.
17) device context maintenance personnel passes through the flashing mode or 4G of equipment indicating lamp in the case where keeping off equipment Communication (future supports 5G mode or higher wireless transmission method) tentatively can judge that equipment is detailed with cell phone application Fault condition, be even accurate to each sensor or the main informations such as mechanical part damaged condition.
18) comprehensive sensor and more essential sensors by collection in worksite to real time data divided by headend equipment Analyse, summarize, judging, form early warning scheme or warning message be transmitted to central server carry out the reduction of site environment analog simulation with simultaneously Goed deep into after manual analysis by private clound big data and five dimension early warning system display platforms is combined to carry out real-time exhibition, and issues report Alert starting is met an urgent need accordingly or rescue method.
19) mass data that cloud processing platform in center sends N number of headend equipment, and after studying in depth and analyzing, Really and accurately real-time environment five can be carried out to certain point, a certain region, a certain road, a certain city, a certain province and tie up mould Quasi- reduction emulation (three-dimensional map, real time video image, certain point, a certain region, a certain road, a certain city, a certain province day Vaporous condition is perfectly merged and is shown), provide congestion in road, traffic accident, boundary defence, natural calamity, rescue and relief work, Emergency accident treatment, command scheduling, pre-alarm and prevention, fire-fighting and rescue etc. provide basic data, graphical information, image information With detailed prediction scheme, strive for the quality time for related personnel and leader.
20) center management server can by remotely to headend equipment carry out the setting of parameter, revision, obtain, issue it is complete New departure etc..
21) since the equipment can pass through visible light camera, thermal infrared imaging camera and temperature sensor and gas Sensor comprehensive analysis, and provide more friendly visualized graphs alarm and check interface, this outer sensor can be to quilt The region that detection object and needs detect carries out regional assignment, greatly reduces traditional equipment and reports by mistake, fails to report, does not report, reports Alert not intuitive, position inaccurate, not visibleization lack the shortcomings of reference quantity, and improve to will be abnormal event Reaction time.And integrative solution such as high temp objects alarm temperature, cryogenic object report are proposed to more anomalous events Alert temperature, object to be detected temperature duration involve range, flame or dark ice feature etc., reduce repeated plant and not A large amount of investments of necessaries reduce the waste of a large amount of stealthy resources.Equipment can to in tunnel, road, bridge, perimeter region Domain, airport, workshop and specific region carry out open fire, high temp objects and dark ice and are measured in real time, and the sensor is in addition to tool Other than standby detection warning function, when fire occurring in tunnel or rising dense smoke common camera by blinding, perspective monitoring is played Effect.Accurate real-time video image on the other hand is provided for tunnel fire fighter and rescue worker and administrative staff.Work as equipment When being installed in outfield, perspective night vision is equally played when night, thick fog, haze, heavy snow, heavy rain common camera are by blinding and is made With.
22) equipment can also provide it is a kind of have no matter daytime or night and under dense smoke haze it is visual Fire, high temperature, low temperature, dark ice and early warning icy on road, alarm visibility solution
It 23) can be running on expressway since the equipment has the splicing of complete trails video whole process and following function Vehicles or pedestrians carry out accurate positioning and driving path identification and play back, effective guarantor can be provided for the charge of accurate path Card
24) after headend equipment detects anomalous event and the collected Various types of data of sensor is combined to analyse in depth, and The alarm plan that extent of injury priority mode automatically generates, and warning message is exported by IO, R485 or CAN interface and is sent to In local warning device or third party device, and central server is uploaded to by network interface and carries out summarizing alarm or alarm touching Hair, forms the integrative solution or mechanism of full-automatic unmanned intervention.
25) complete trails panoramic picture Video Events testing cost is the one third of common single camera cost；System-wide Diameter panoramic picture vehicle violation captures the one third that cost is common single camera cost.
The additional aspect of the present invention and advantage will be set forth in part in the description, and will partially become from the following description Obviously, or practice through the invention is recognized.
Detailed description of the invention
Above-mentioned and/or additional aspect of the invention and advantage will become from the description of the embodiment in conjunction with the following figures Obviously and it is readily appreciated that, in which:
Fig. 1 is the knot based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence according to the embodiment of the present invention Composition；
Fig. 2 be according to the embodiment of the present invention based on the more five dimension early warning systems of element overall view monitorings detection of artificial intelligence before The hardware logic architecture diagram of end device；
Fig. 3 be according to the embodiment of the present invention based on the more five dimension early warning systems of element overall view monitorings detection of artificial intelligence before The architecture diagram of end device；
Fig. 4 is to be filled according to the front end of the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence of the embodiment of the present invention It sets, one group of variable-focus video camera realizes 180 ° or 360 ° of full-view video images splicing automatic synchronizations cascade adjustment, focus technique Schematic diagram；
Fig. 5 is to be filled according to the leading portion of the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence of the embodiment of the present invention It sets and third party's fire alarm equipment connection schematic diagram；
Fig. 6 is the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence according to the embodiment of the present invention to vehicle row Sail accurate Path Recognition schematic diagram；
Fig. 7 is the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence according to the embodiment of the present invention to tunnel fire Calamity, smog, pernicious gas, fuel gas detection alarm, perspective or night vision function and link connection schematic diagram；
Fig. 8 is dark according to the more five dimension early warning system road pavements of element overall view monitoring detection of artificial intelligence of the embodiment of the present invention Ice, detection icy on road and the implementation night vision perspective function schematic diagram under mist, haze, dust inclement weather conditions；
Fig. 9 is to be filled according to the front end of the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence of the embodiment of the present invention It sets to the schematic diagram for covering bigger region or the super image tiled display function apart from farther road；
Figure 10 is the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence according to the embodiment of the present invention to scene The schematic diagram of environment, weather condition analog simulation restoring function；
Figure 11 is the front end according to the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence of the embodiment of the present invention Device, panoramic video event detection and violation vehicle capture the schematic diagram of function；
Figure 12 is the front end according to the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence of the embodiment of the present invention Device, the interface and main component chain graph of central control processing unit；
Figure 13 is the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence according to the embodiment of the present invention, artificial intelligence It can learning process figure；
Figure 14 is the front end according to the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence of the embodiment of the present invention The communication scheme of device and mobile client；
Figure 15 is the work according to the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence of the embodiment of the present invention Flow chart；
Figure 16 is the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence according to the embodiment of the present invention in fire Schematic diagram in monitoring.
Specific embodiment
The embodiment of the present invention is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached The embodiment of figure description is exemplary, it is intended to the methods and meaning of realization are used to explain the present invention, and in actual product Other modes can be used in or hardware configuration is achieved, and be not considered as limiting the invention.
The present invention proposes a kind of based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence, headend equipment entirety Using embedded system structure, main body, which uses, is not less than IP66 shell protection grade.Program hardware structure, which is built, to be passed through Various ways realize, comprising: RAM+DSP, RAM+GPU, RAM+DSP+GPU, RAM+FPGA, RAM+DSP+FPGA etc. or its His hardware structure combined treatment mode, but be not limited to these modes, framework or realize process.The present invention uses RAM+DSP hardware Description is unfolded for framework, this programme does not carry out product appearance, mechanical framework, transmission device and sensor parameters selection detailed Describe in detail bright, which will be described in detail in its special patent of invention.As shown in Figures 2 and 3, more essential sensors can To actually use demand and application environment (such as highway, tunnel, bridge, airport, city expressway, provincial highway, state according to user Road, circumference security protection, oil field, forest fire protection, frontier defense, workshop etc. important area or infrastructure) it is increased and decreased or replaces, it senses Device type is not limited to several.
As shown in Figure 1, the embodiment of the present invention ties up early warning systems, packet based on the more element overall view monitoring detections five of artificial intelligence Include: at least one fore device 1 and central management device (that is, five dimension early warning alarm management platforms) 2, each fore device 1 wraps Include central control processing unit, the camera shooting unit that is connected with central control processing unit (including 3 variable-focus video cameras, 1 IPC thermal infrared imaging camera), more essential sensors, communication module, interface unit, power supply unit.
Referring to figs. 2 and 3, more essential sensors can detecte ambient weather environment and integrated gas detection belongs to perception list Member.More essential sensors include: brightness light intensity sensor, Temperature Humidity Sensor, precipitation rain fall sensor, wind speed wind direction sensor, comprehensive Close gas sensor, wherein brightness light intensity sensor is used to acquire the brightness light intensity value of current environment；Temperature Humidity Sensor is used for The data of the Temperature and Humidity module of current environment is acquired, precipitation rain fall sensor is used to acquire the rainfall value of current environment, and wind speed wind direction sensor is used In the wind speed and direction data of acquisition current environment, integrated gas sensor is used to acquire the concentration value of all kinds of gases of current environment.
The more element overall view monitoring detection devices of every leading portion artificial intelligence are installed on the predetermined position in section, then will Collected all kinds of environmental data information are sent to central control processing unit, by central control unit by the artificial intelligence of each leading portion The more element overall view monitoring detection devices of energy upload to central management device, carry out analog simulation scene actual environment and are simultaneously dissolved into five Tie up real-time display in figure, checked for road conditions, roadside assistance, environmental hazard forecast assessment, emergency schemes generation provide it is basic according to According to.
In one embodiment of the invention, integrated gas sensor is for acquiring sulfur dioxide, carbon dioxide, an oxidation The gas concentration of carbon, methane, formaldehyde, natural gas, liquefied gas.
The present invention supports access: 1 road composite gas sensor (serial ports UART TTL 3.3v), 1 tunnel temperature and humidity pass Sensor (R485 interface), 1 road wind direction and wind velocity sensor (R485 interface), 1 road gas air quality sensor (serial ports UART TTL 3.3v), 1 tunnel brightness light intensity sensor (I2C interface).
Each sensor port data reported data information by the way of repeating query, local device data processing unit can incite somebody to action Uploaded data are summarized, then tie up early warning by the more element overall view monitoring detections five of artificial intelligence that network uploads to head center It is analyzed in real time in system, system is simulated imitative by way of generating real-time motion graphics after obtained various kinds of sensors data It is true to restore live weather condition, and be fused in three-dimensional map, splice fused completely new video with complete trails video image Image and real time data are completed to realize five dimension early warning system human-computer interaction interfaces jointly.Secondly local data processing processing unit is pressed Logical operation is carried out according to the various settings instruction that upper end center issues, when meeting preset Rule of judgment, by passing through IO Port and CAN port export warning message.
Freeway tunnel or city tunnel and the tunnel of other forms such as bomb shelter, power supply corridor etc. are all using envelope Closed type structure, majority are the current mode of one-in-and-one-out, and wherein the dedicated through tunnel of highway or city cross river mountain tunnel and be The safety of driver and conductor generally can all have including refuge chamber, fire fighting device, emergency communication, guarded drainage facility, ventilation equipment and Lighting installation, once but tunnel inside occur fire, such as without timely early warning and and alarm and adopt an effective measure into Row rescue takes refuge and will all will cause the economic loss that can not be estimated and a large amount of casualties, fire occur Shi Douhui with The pernicious gases such as high temperature, dense smoke, sulfur dioxide, carbon dioxide, carbon monoxide, volatile matter are exceeded, directly endanger the institute in tunnel There are personnel, is furthermore leaked (such as: methane, formaldehyde, natural gas, liquefied gas when dangerous vehicle drives into concurrent anger body in tunnel Fuel gas), it is easy to occur to explode when concentration over-standard to cause more calamity to tunnel or personnel.
The real time data that comprehensive sensor and more essential sensors arrive collection in worksite by central control processing unit into Row analyze, summarizes, judging, forms early warning scheme or warning message is transmitted to central server and carries out environmental simulation emulation and demonstrate, And issue the corresponding emergency of alarm starting or rescue method.Central management device 2 can be by remotely carrying out parameter to headend equipment Setting, revision, obtain, issue brand-new scheme etc..Central control processing unit passes through I/O interface, CAN interface or R485 interface It is connected with local fire-fighting system, alarm equipment and other third party's detection devices, and data or output switch parameter is given Local warning device or third party device.
N number of headend equipment can be cascaded and be associated by central management device 2 obtains front end data, at big data cloud The collected data of platform combination various kinds of sensors formed real-time dynamic cloud atlas and three-dimensional map, panoramic mosaic video image, Dynamic data carries out comprehensive fusion, carries out live actual environment analog simulation reduction, Lai Shixian five tie up forewarning management, check, Positioning, tracking etc. function, and manager and rescue personnel and fire fighter are informed with the form of figure and sound.And it can be with A variety of implementation rescue methods are proposed according to analog result.
Referring to figs. 2 and 3, every front end devices (realize 180 ° or 360 ° of panoramic mosaic function using one group of Zoom camera Can, it is possible to provide a wide range of video road conditions check, provide the various monitor and detection functions based on video and graphic analysis in real time), use IPC thermal infrared imaging camera (realizes high temp objects detection, the dark ice detection of road, fire alarm alarm detection, night vision function etc. Belong to sension unit).The more element overall view monitoring detection devices of every leading portion artificial intelligence are installed on the predetermined position in section, The image information of different location on section is acquired respectively, wherein every video camera is monitored using the Varifocal zoom lens of different focal length The object of different distance, and corresponding image information is acquired, acquired image information is then sent to central control and is handled The more element overall view monitoring detection devices of each leading portion artificial intelligence are uploaded to centre management dress by central control unit by unit It sets, carry out secondary video image mosaic and is dissolved into real-time display in five dimension figures, realize the alarm of anomalous event accident detection, determine Position, traffic behavior preview and assessment, complete trails video check the functions such as roaming.
In one embodiment of the invention, front end devices camera shooting unit includes: special including 3 Zoom cameras and 1 IPC thermal infrared imaging camera.That is, the more element overall view monitoring detection devices of every leading portion artificial intelligence are variable using one group Burnt or focusing video camera realizes 180 ° or 360 ° of panoramic mosaic fusions；IPC video camera, which uses, has temperature detection, regional assignment function The thermal infrared imaging camera of energy.Wherein, central control processing unit exports 5 groups of video flowings:
1st group: the video flowing of first Zoom camera；
2nd group: the video flowing of second Zoom camera；
3rd group: the video flowing of third Zoom camera；
4th group: first 180 ° or the 360 ° of panoramic mosaic video flowings formed to third Zoom camera；
5th group: the video flowing of IPC thermal infrared imaging camera；
Wherein, in order to reduce the network bandwidth that equipment occupies, the 1st group to the 3rd group video flowing uses passive method of calling, is System default actively exports the 4th group of video flowing and the 5th group of video flowing, and third party system is when calling 1-3 group video flowing, guarantee the 4 groups and the 5th group of video flowing cannot interrupt.
The more five dimension early warning system headend equipments of element overall view monitoring detection of artificial intelligence are installed on the predeterminated position in section Place acquires the image information on section, wherein every video camera monitors different distance using the Varifocal zoom lens of different focal length Object, and corresponding image information is acquired, acquired image information is then sent to central control processing unit.
The more five dimension each variable-focus video cameras of early warning system headend equipment of element overall view monitoring detection of artificial intelligence are all made of Intelligent level joint debugging school (including to video camera focal length, aperture, shutter, white light balance, spectrum assignment, minimal illumination, wide dynamic, The important parameters such as orientation, coded format) technology, when the parameter of any one video camera is by artificial adjustment, other video cameras Parameter can follow automatic synchronization change (carry out positive increase according to preset program and parameter or reversed reduce), guarantee The integrality of 180 ° or 360 ° full-view video image splicing fusions is, it can be achieved that continuously monitor big region, system-wide section without blind angle Control effect.
1) 5 groups of video flowings are exported by the gigabit network interface of central control processing unit, every group of video flowing can support 5 visitors Family end accesses simultaneously；
- the 1 group of 1 video flowing of Zoom camera；
- the 2 group of 2 video flowing of Zoom camera；
- the 3 group of 3 video flowing of Zoom camera；
Zoom camera 1, Zoom camera 2, Zoom camera 3, three video cameras carry out 180 ° or 360 ° of panoramic mosaics 4 groups of outputting video streams-the after fusion；
1-3 group video flowing is exported using passive method of calling；
3 Zoom cameras can be accessed individually and carry out parameter setting, and intelligent Automatic parameter linkage also may be implemented Adjustment；
It is directly logical not do any image procossing for-the 5 group of fixed-focus IPC camera video stream (IPC thermal infrared imaging camera) Onboard gigabit network interface output is crossed, but can be by remotely carrying out independent access and functional parameter setting to the video camera.
IPC thermal infrared imaging camera for realizing high temp objects are detected, the detection of road dark ice, fire alarm alarm inspection It surveys, night vision perspective function is provided, delimit the region for needing to detect first, then to the object in detected region, pedestrian, roadbed road Face etc. is measured in real time, and common camera night or environment it is dim by blinding when, play night vision perspective monitoring work With；The more element overall view monitoring detection devices of every leading portion artificial intelligence are installed on the predetermined position in section, IPC infrared photography Machine acquires the object of different location on section, pedestrian, subgrade and pavement data information and image information respectively, then will be collected Data information is sent to central control processing unit, by central control unit by the more element overall view monitorings of each leading portion artificial intelligence Detection device uploads to central management device, carries out concentrating Macro or mass analysis and is dissolved into real-time display in five dimension figures, realizes different The alarm of ordinary affair part accident detection, positioning, traffic behavior preview and assessment, night vision perspective function.
System default actively exports the 4th group of video flowing and the 5th group of video flowing, and third party system is calling 1-3 group video When stream, the 4th group of guarantee and the 5th group of video flowing cannot be interrupted, and video output frame number cannot be less than 30 frames.
2) video camera analysis detection function (central processing unit can carry out remote parameter setting and data report)
Video camera 1 has the function of parking, pedestrian's analysis detection, and video camera 3 has the function of license plate candid photograph.The above detection function Warning message, picture, video can be exported by gigabit network interface.
Three video cameras be all made of ultra-low illumination target surface be 1/1.8 " starlight grade customize image device, effect present with And dark situation backlight control；It realizes long-range micro- focusing, accurate aperture regulatory function, can solve single camera or multiple splicings The operating mode of video camera " black under lamp " keeps splicing picture more smooth continuous and uninterrupted using seamless spliced mode.This Invention can be by two or the more five dimension early warning system leading portion equipment of element overall view monitoring detection of N number of continuous artificial intelligence pass through network It combines, when meeting certain installation requirement (such as spacing distance, height), each leading portion equipment is sent again 180 ° or 360 ° of full-view video images carry out larger range of graphic joining fusions, to guarantee vehicle in tunnel, road Outfield is monitored in continuous regional scope without losing image information.It may be implemented by this secondary splicing integration technology Over long distances, system-wide section, big region are without the continuous monitor and detection of blind angle and item, vehicle, the tracking of pedestrian and motion profile Analysis, it might even be possible to realize that whole scene 3D traces and monitors testing mechanism.
Using multifocal away from compound eye connecting method, 3 video cameras use different cokes for 180 ° or 360 ° of panoramic mosaic amalgamation modes Away from distinguishable zoom lens monitoring different distance object, central control processing unit by specific graphic joining algorithm by 3 A video image splicing is fused together, and forms complete monitoring monitoring screen.
3 video cameras join focus technique using intelligent level, when the focal length of any one of 3 video cameras video camera is by artificial When adjustment, the focal length of other two video cameras all can automatic synchronization change (pass through preset treatment mechanism and linkage algorithm Forward direction increases or reversed reduction), guarantee that the panoramic mosaic blending image of output is not affected.
3 video cameras use intelligence cascade color renditions, white balance, exposure and color uniformity regulation technology three, 3 Video camera will be as a complete whole appearance, it is necessary first to carry out correction output to the wide angle picture distortion of three video cameras； Exposure, white balance, color uniformity and color rendition use centered on wide angle cameras (video camera 2), center camera or When other two camera review parameter adjustment, other two video cameras can synchronize automatic adjustment, when coping with different light-inletting quantities Image mosaic requires (as shown in Figure 4), to reach image mosaic optimum efficiency.
3) video camera code stream compress mode
Central processing unit coding module outputting video streams coded format and communication protocols meet international and national correlation mark Quasi- general format can also individually be customized according to project demands.4th group of code stream is 30 frames, 2,000,000~24,000,000 pixel ultra high-definitions Video.
IPC video camera is by carrying out regional assignment to object to be detected and the region for needing to detect, by IPC video camera pair Each type objects and dark ice are measured in real time, and carry out detection alarm, and when common camera is by blinding, play perspective monitoring Effect.IPC video camera realizes fire, high temperature, low temperature, detection icy on road alarm and perspective, night vision function.
IPC video camera forms an independent video flowing 5, which is infrared thermal imaging image sensor, first should Sensor is carrying out all kinds of alarms to the sensor by carrying out regional assignment to object to be detected and the region for needing to detect The setting of parameter such as high temp objects alarm temperature, cryogenic object alarm temperature, object to be detected temperature duration, involves model Enclose, flame or dark ice feature etc., after setting completed the sensor can in tunnel, road, bridge, perimeter region, machine Field, workshop and specific region carry out open fire, high temp objects and dark ice and are measured in real time, and the sensor is in addition to having detection Other than warning function, when fire occurring in tunnel or rising dense smoke common camera by blinding, play the role of perspective monitoring. Accurate real-time video image on the other hand is provided for tunnel fire fighter and rescue worker and administrative staff.When equipment is installed in When outfield, equally play the role of having an X-rayed night vision when night, thick fog, haze, heavy snow, heavy rain common camera are by blinding.
IPC video camera can also provide it is a kind of have no matter daytime or night and under dense smoke haze it is visual Fire, high temperature, low temperature, dark ice and early warning icy on road, alarm visibility solution.Central control processing unit passes through Gigabit network interface can independently export IPC camera video flow to server or management platform managed concentratedly
Center can individually be accessed the IPC video camera by central control processing unit and can carry out setting for all kinds of parameters It sets, obtain data, analysis result.
When central control processing unit detects IPC video camera alert, and collected in conjunction with local sensor Various types of data after, and the alarm plan automatically generated according to preset alarm parameters or central control unit, by IO, R485 or CAN interface output warning message are sent in local warning device or third party device, and are uploaded to by network interface Central server carries out summarizing alarm or alarm triggering.
Central control unit hardware interface characteristic and working method is further illustrated below, spy uses RAM+DSP hardware Description is unfolded for framework, but is not limited to mode in this, framework or realizes process.
Central control unit uses high-speed RAM plate, and high-speed RAM plate runs various algorithms, and control various kinds of sensors parameter is set Set, store, analyzing, warning output power-fail memory function, Power-On Self-Test, self-starting, data network interruption be locally stored, after network-in-dialing It is automatic to upload central management device.
For example, integrated gas sensor and environmental sensor by collection in worksite to real time data pass to ARM plate, ARM Data are analyzed, are summarized and are uploaded to central server (that is, central management device) by plate.High-speed RAM plate is judging data It is exceeded, when needing to alarm, warning message is exported by IO or RS232 interface and is sent to local warning device or third party device.
Shock sensor can by collection in worksite to real time data pass to ARM plate, ARM plate analyzed data, Summarize and is uploaded to central server.High-speed RAM plate is sent to local alarm by IO or RS232 interface output warning message and sets Standby or third party device.
High-speed RAM plate can independently export camera video by gigabit network interface and flow to server or management platform, center The video camera can be individually accessed by high-speed RAM plate and can carry out the setting acquisition data and analysis result of all kinds of parameters. High-speed RAM plate exports warning message by IO or 232 interfaces and is sent to local warning device or third party device.
The present invention is based on the AM5728 embeded processors of Texas Instruments, design and research and develop central control unit Hardware device.The hardware system technology is as follows:
1. supporting the communication of 2 road gigabit Ethernets, RJ45 interface；
Support network protocol: IPv4/v6, HTTP, HTTPS, FTP, CIFS/SMB, SMTP, DNS, DynDNS, NTP, RTSP, RTP, TCP, UDP, IGMP, RTCP, ICMP, DHCP, ARP and SOCKS；2.4 agreement of support standard ONVIF.
2. supporting 1 tunnel microphone input 3.5mm JACK MIC-IN；
3. supporting 1 tunnel audio output 3.5mm JACK Line-Out；
4. supporting 1 tunnel with address, (system factory is uniformly defaulted as a unified address code, which can be by soft Part is modified and is edited, and address code is not lost after power-off) CAN port, support 1 road dry contact IO (supporting 24V/1A) output, (by IPC output signal, trigger CAN port simultaneously through AM5728 plate level conversion and I/O port export)；
5. supporting 1 road RS485 serial ports；
6. supporting 1 tunnel wirelessly and 1 road 4G module；
7. exporting 5 groups of video flowings by AM5728 plate gigabit network interface, every group of video flowing can support 5 clients while visit It asks
- the 1 group of 1 video flowing of Zoom camera
- the 2 group of 2 video flowing of Zoom camera
- the 3 group of 3 video flowing of Zoom camera
Zoom camera 1, Zoom camera 2,180 ° of video camera, 4 groups of video flowing-the of the splicing of Zoom camera 3 three
1-3 group video flowing is exported using passive method of calling
3 Zoom cameras can individually access and carry out parameter setting
- the 5 group of 5 video flowing of focusing video camera (IPC video camera), does not do any image procossing directly by onboard gigabit Network interface output can carry out independent access to the video camera and functional parameter is arranged
System default actively exports the 4th group of video flowing and the 5th group of video flowing, and third party system is calling 1-3 group view When frequency flows, the 4th group of guarantee and the 5th group of video flowing cannot be interrupted, and video output frame number cannot be less than 25 frames.
8. executing self diagnosis state-detection, including 3 fixed video cameras, 4 sensors, 1 IPC video camera and board The important informations such as supply voltage, temperature, network transmission working condition, in real time or timing uploads to third party by gigabit network interface and puts down Platform needs to sound an alarm, and informs exceptional part information and damaged location once there is exceptional part to break down.It can also lead to Local wireless (wireless or bluetooth) connection is crossed, system autodiagnosis data are checked by APP, which only allows user to read number According to, do not allow modify or access equipment internal network.
9. equipment will do high/low temperature and lightning protection processing.It is required that clear high/low temperature work and memory range and lightning protection etc. Grade supports POE power supply power supply.
To sum up, central control unit can at least complete following functions: by central control unit by the artificial intelligence of each leading portion Can more element overall view monitoring detection devices upload to central management device, carry out analog simulation scene actual environment (such as: rain, snow, Mist, wind, sunshine etc.) and it is dissolved into real-time display in five dimension figures, for road conditions are checked, roadside assistance, environmental hazard are tested and assessed in advance Estimate, schemes generation of helping meet an urgent need provides important foundation foundation.The more element panoramas of each leading portion artificial intelligence are supervised by central control unit Control detection device uploads to central management device, carries out secondary video image mosaic and is dissolved into real-time display in five dimension figures, Realize that the alarm of anomalous event accident detection, positioning, traffic behavior preview and assessment, complete trails video check the functions such as roaming.By The more element overall view monitoring detection devices of each leading portion artificial intelligence are uploaded to central management device by central control unit, and (five dimensions are pre- Alert alarm management platform), carry out concentrating Macro or mass analysis and be dissolved into real-time display in five dimension figures, realize abnormal vehicle, object, The functions such as the alarm of the anomalous events accident detection such as pedestrian, subgrade and pavement, positioning, traffic behavior preview and assessment, night vision perspective
In one embodiment of the invention, central control processing unit includes: storage unit, clock unit, multicore height Fast arm processor, multicore high-speed dsp processor, high speed GPU processor and central control logic operation and processing unit；Communication Module uses three kinds of wireless communication module, 4G communication module and the adaptive network interface communication module of 100/1000M.At central control Reason unit is used to the image information received carrying out splicing fusion and data acquisition, logical operation and logic control by stitching algorithm System output, forms 180 degree or 360 degree of panoramic mosaic images and system-wide section without the super stitching image of the continuous surveillance monitor of blind angle, with And when receiving from the warning message of IPC video camera, in conjunction with all data that more essential sensors acquire, according to setting in advance The alarm plan that fixed alarm parameters or central control unit automatically generate exports warning message by interface unit, and sends To in local warning device or third party device, and upload to by network interface that central server carries out summarizing alarm or alarm is touched Hair；Central control processing unit acquires compressed panoramic mosaic image, super stitching image and more essential sensors Data and warning message are sent to mobile terminal by communication module, and user checks real time monitoring information by mobile terminal, It checks online equipment state and faulty equipment position and fault condition all in access local area network and then carries out quick It repairs.Specifically, the present invention supports that (equipment working state instruction and wireless/4G communicate (future to the inquiry of cell phone application remote status Support 5G communication pattern or higher wireless communications mode)).Central control processing unit passes through collected more essential sensors (temperature, voltage, electric current, signal intelligence, each sensor exist with the various data such as integrated gas sensor and itself working condition Line or damaged condition, mechanical breakdown situation) and compressed video image or with thumbnail；Mould is communicated by wireless network or 4G Block (future supports 5G communication pattern or higher wireless communications mode) is transferred to equipment management personnel or maintenance personnel and each neck Personnel are led, these personnel can grasp equipment situation and field condition whenever and wherever possible in this way, can easily realize Online management mobile office demand, thus accomplish quickly to check, quickly know, fast equipment malfunction elimination, quickly repair it is equivalent Fruit.Device context maintenance personnel is not in the case where tearing machine open, judgement that can be preliminary by the flashing mode of equipment indicating lamp The general fault condition of equipment out.
In addition, the present invention supports that adhoc mode may be implemented after wire communication interruption or wired power failure (wirelessly Communication).Specifically, there is an equipment to lead to wire communication interruption or wired power failure due to cause specific in network cluster Afterwards, the battery that system horse back starting energy-saving mode and adhoc mode and dependence carry itself carries out maintaining work, is protecting It demonstrate,proves and does not go offline within the scope of 24 hours.Simultaneously by 4G mode, (future supports 5G communication pattern or higher wireless communication to system Mode) to terminal user's transmission warning message, user can be accessed all in local area network by cell phone application or computer real time inspection Online equipment state and faulty equipment position and fault condition are quickly repaired in turn.
When fire or explosion time occur in tunnel, when wherein an equipment or multiple equipment are damaged in tunnel, even tunnel When power supply system or communication system in road can not work, fire fighter or rescue personnel can pass through notes in the entrance in tunnel In the wireless network of this access device, facilitates rescue personnel, fire fighter and the scheduling of leader's floor manager, look into real time Live video situation in tunnel is seen, as long as passing through mobile phone or notebook computer to access.
Central control processing unit acquires each sensing data, remote parameter is arranged, is locally stored, data analysis, data Summarize, warning output, periodically automatically generate early warning prediction scheme, power-fail memory function, Power-On Self-Test, power-up self-starting, execute self diagnosis, Start after power-off power saving function, start ad hoc network function after suspension, data breakpoint resumes, data image can be by wireless or 4G net Network (future supports 5G communication pattern or higher wireless communications mode) is pushed to terminal, network interruption data are locally stored, network Uploaded automatically after connection, run various algorithms include 180 ° of graphic joinings, event detection, license plate candid photograph, fire detection, dark ice and Detection icy on road with third party's warning device is connected, is connected with third-party platform, executes AI deep learning function etc..Figure 16 For signal of the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence in fire hazard monitoring according to the embodiment of the present invention Figure.
In one embodiment of the invention, interface unit includes: power supply interface and input/output interface.Power supply interface is adopted With 48V POE power supply interface.Input/output interface includes: that network interface, I/O port, audio input interface, audio output interface, CAN connect Mouth, RS485 interface and RJ45 interface.Figure 12 is the more element overall view monitoring detections five of artificial intelligence according to the embodiment of the present invention Tie up the fore device of early warning system, the interface and main component chain graph of central control processing unit.
The present invention uses Cadence16.x software development hardware circuit, with (SuSE) Linux OS and TI Processor SDK v3.3 is Software Development Platform；It is realized and is programmed using C/C++ programming language.The present invention uses the newest embeded processor of TI Scheme, the features such as possessing high-performance, low-power consumption, flexible configuration.H.264HighProfile, hardware supported encodes, and makes HD video Optimal compression ratio and video quality are obtained, to improve the performance of network transmission and hard-disc storage.In conjunction with a variety of embedded skills Art, including double-core ARM Cortex-A15 high-performance arm processor, double-core C66x Floating-point DSP digital signal processor are formed more The one chip solution of core, as shown in figure 12.
Board hardware configuration:
1) CORE57x core board:
CPU:TI Sitara AM5728SOC
Double-core Cortex-A15ARM core, dominant frequency highest 1.5GHz
Double-core C66x Floating-point DSP core, dominant frequency highest 750MHz
RAM:2GByte DDR3
FLASH:8GByte eMMC
Power: power source special management
Expansion interface: 2 road 160PIN mother daughter board connectors
1 road 40PIN high speed mother daughter board connector
2) interface bottom plate:
(3 road FFC36P-0.5mm connector video camera mould groups support BT.1120 interface, separate synchronization signal, output on 3 tunnels YUV422 format) input of winding displacement interface HD video, maximum support 1080P/30fps resolution ratio,
2 road 1000Mbps Ethernets, RJ45 interface, band lamp；
1 road kilomega network, for sending H.264 video flowing and data communication；
1 road kilomega network, for accessing IPC network camera；
1 road RS485, phoenix terminal；
1 tunnel I2C interface, 4pin connecting terminal (power supply of 5V containing VCC)；
2 road UART TTL 3.3v interfaces, 4pin connecting terminal (power supply of 5V containing VCC)；
2 road RS485 interfaces, 4pin connecting terminal (power supply of 5V containing VCC)；
1 road miniPCIE interface (extension 4G)
1 road UART TTL serial ports；
1 road USB2.0；
3 paths of LEDs status lamps, power supply indicator are green light, and (warning light is red, and status lamp is green) is realized by GPIO；
The dry node IO output (output of the IO alternative of IPC and AM5728) in 1 tunnel supports 24V, 1A load access；
1 tunnel CAN bus；
1 road is wireless & bluetooth module, TI WL1837MOD (double frequency WIFI+BT4.1)；
1 road RTC real-time clock, I2C interface charge stall；
1 tunnel TF card interface；
1 road UART console 3.3v Transistor-Transistor Logic level, onboard 3PIN contact pin；
1 road DC+48v power input or POE power supply, 3PIN contact pin
12V voltage needed for camera is provided by AM5728 board；
5V voltage needed for sensor is provided by AM5728 board；
Photosensitive electric control IPC power supply
Board size: 160mm x 120mm
3) video input
3 road FFC36P-0.5mm connector video camera mould groups support BT.1120 interface, separate synchronization signal, output YUV422 format inputs to the video port VIP of AM5728；Camera function parameter setting is realized by serial ports
1 road IPC network camera inputs H.264 video flowing by network interface；
4) data store
Onboard TF card interface, programming system firmware are used；
5) data communication:
5.1) serial communication:
1 road UART realizes 1 road UART console system debug mouth, onboard 3PIN contact pin；
2 road UART external sensor modules (air quality sensor and composite gas sensor)；
1 road I2C external sensor module (brightness light intensity sensor)；
2 road RS485 external sensor modules (Temperature Humidity Sensor and wind speed wind direction sensor)；
1 road RS485 interface is communicated with host computer；
1 tunnel CAN bus is exported for warning information；
3 road serial ports are communicated with the video camera mould group Zhi Jinhang of 3 road FFC36P-0.5mm connectors to camera function parameter It is set
5.2) network communication:
2 road gigabit Ethernets, RJ45 interface, band lamp；
5.3) usb communication:
1 road USB2.0, miniPCIE connector；
5.4) IO is controlled
1 railway digital exports (dry node IO)；
6) system status lights
3 paths of LEDs status indicator lamps: power supply status green；Warning light is red, status lamp green.
7) system start-up mode
System is booted up by eMMC, and programming firmware is booted up using TF.
8) real-time clock
1 tunnel independence RTC chip, i2c interface charge stall；Clock is kept after system is powered down；
9) system power supply
Board is powered using DC+48V power supply power supply or POE.
Holonomic system software and hardware architecture of the invention is as shown in table 1 below: top layer is functional module software, is for intermediate two layers Layer software is driven, lower two layers are hardware system.
Table 1
Software design of the invention is as follows:
It is hardware platform transplanting and driving exploitation, embedded U-boot transplanting, 4.4 Kernel Porting of built-in Linux, embedded Linux file system transplanting, hardware adaptor Driver Development.
Wherein, hardware adaptor Driver Development, comprising: the driving of BT.1120 high definition video collecting, IPC access acquisition are driven Dynamic, gigabit Ethernet driving, TF card driving, GPIO driving, RS232 driving, USB2.0 driving, the driving of RTC real-time clock, power supply Management driving, each sensor data acquisition, summarize, upload, alarming logic parameter setting, warning output, wireless device connection with Data send, video protocols transport protocol establishment: Pv4/v6, HTTP, HTTPS, FTP, CIFS/SMB, SMTP, DNS, DynDNS, NTP, RTSP, RTP, TCP, UDP, IGMP, RTCP, ICMP, DHCP, ARP and SOCKS；2.4 agreement of support standard ONVIF.
With reference to Fig. 5, central management device receives video, the image, data, more elements sensing that each fore device is sent The all data and warning message of device acquisition, N number of headend equipment is cascaded and is associated and obtains front end data, pass through big data It ties up figure and shows, the roaming of complete trails traffic behavior video preview, the simulation of actual environment, imitates in cloud processing platform progress scene five Very, it plays back, obtains environmental simulation as a result, and informing manager and rescue personnel and fire-fighting people by way of figure and sound Member, takes maintenance measure.Central management device carries out scene five by big data cloud processing platform and ties up figure real-time display, packet Include: five dimension graphical display of scene, practical weather perception environmental simulation Dynamically Announce, the preview of traffic prevailing state, event accident are pre- Sentence, the three-dimensional unlimited roaming of complete trails video-splicing is checked, position positions in real time, information summarizes upload for event accident generation.
Specifically, central management device includes: management work station and privately owned Cloud Server, analog simulation early warning alarms, refers to It waves, monitor monitoring management platform.Central management device includes: management work station and privately owned Cloud Server.
Privately owned Cloud Server setting is in monitoring branch center computer room, and execute following work: data exchange, is at store function System communication, maintenance, the building of each function of system, the setting of parameter, concentrated alarm, scheme forming, artificial intelligence are studied in depth point It analyses, the execution of linkage scheme issues, three-dimensional map generates, five dimension graphic hotsopts, site environment data summarization, site environment are simulated and imitated Very, the operation of big data macroscopic view, video monitoring, image storage, alert event video recording file for reference, report production, complete trails video image Instruction transmission that secondary splicing, complete trails video image are checked, roamed, preview generation, the calling of video image and third party link, Send presupposed solution, regular job man-machine interface centralized alarm；
Management work station setting executes following work: data exchange, system communication, collection on monitoring branch center operation bench Middle alarm, scheme forming, linkage scheme issue that execution, five dimension figure real-time exhibitions, image is shown, big data macroscopic view shows, regards Frequency monitoring, complete trails video image check, roam, preview generation, the calling of video image, alert event video recording file for reference, report Production interacts, centralized alarm with third party's linkage instruction transmission, transmission presupposed solution, regular job, man-machine interface.
Below with reference to Fig. 6 to Figure 15 to the pre- based on more five dimensions of element overall view monitoring detection of artificial intelligence of the embodiment of the present invention Alert system, the concrete application of different occasions are illustrated.
(1) the accurate route identification of vehicle
As shown in fig. 6, continuing through multiple more element panoramas of artificial intelligence for capturing identification with license plate according to vehicle When monitor and detection five ties up early warning system headend equipment, system can accurately judge vehicle row by way of punctuate line Sail actual path
(2) tunnel fire hazard, smog, pernicious gas, fuel gas detection, it is possible to provide perspective or night vision function
As shown in fig. 7, using the infrared thermal imaging imaging sensor and high definition panorama video camera of equipment to open fire flame, cigarette The detection of misty state carries out global analysis in conjunction with the collected all data of integrated gas sensor and Temperature Humidity Sensor institute, It can accurately detect that fire, dense smoke, pernicious gas, fuel gas etc. whether occur in tunnel and Realtime Alerts can be carried out And warning function, and perspective or night vision figure are provided inside the tunnel that dense smoke is full of or in the case that tunnel powered lighting fails Picture.
(3) the dark ice icing in road surface, mist, haze, dust and bad weather detection, it is possible to provide night vision perspective function
As shown in figure 8, using the infrared thermal imaging imaging sensor and high definition panorama video camera of equipment to dark ice and road surface Shape, temperature, reflective area, the picture contrast of icing, and the collected all data of Temperature Humidity Sensor institute is combined to carry out Global analysis can accurately detect to be detected whether region has dark ice and icy on road and road snow situation hair Realtime Alerts and warning function are given birth to and carry out, it can also be collected by integrated gas sensor, more element gas sensors Obtain the weather condition around care testing device after Various types of data analysis, and night or it is rather dark in the case where using red Outer thermal imaging camera provides night vision fluoroscopy images
(4) bigger region is covered or apart from farther super image tiled display function
As shown in figure 9, installation is examined according to N number of continuous more element overall view monitorings of artificial intelligence of certain distance and height The panoramic mosaic video image for surveying five dimension early warning system headend equipment outputs, is output on comprehensive management platform and carries out secondary fusion Splicing, so that it may which forming region is bigger, the farther super splicing monitor video image of coverage distance, uses for monitoring management person.
(5) site environment, weather condition analog simulation function
As shown in Figure 10, by installation according to N number of continuous more element integrated testing equipment composition collection of intelligence of certain distance Group is wanted sensor, the collected mass data of integrated gas sensor institute more by each equipment, is handled by administrative center's cloud Server, which carries out live actual environment simulation, can obtain really and accurately section or area weather situation, to rescue and relief work, Major accident is quickly handled and response provides advantageous guarantee.
(6) panoramic video event detection and violation vehicle capture function
As shown in figure 11, by installation according to N number of continuous more element integrated testing equipments of intelligence of certain distance and height Form cluster, by after carrying out secondary anastomosing and splicing to each equipment full-view video image, carry out large-scale Video Events inspection The function that 24 hours round the clock seamless coverages are monitored round the clock, monitored, detecting can be realized with violation vehicle candid photograph by surveying, and can more be passed through The mode of figure marks out the prevailing state of road in real time.
The embodiment of the present invention based on five dimension early warning systems of artificial intelligence more element overall view monitorings detection, can be applied to Lower field: the artificial intelligence more detection of element overall view monitoring five dimension early warning systems, the more element overall view monitoring detectors of artificial intelligence, people Intelligently more five dimension early warning system all-in-one machines of element overall view monitoring detection, more element monitor and detection early warning and alarming all-in-one machines (image work Machine, system, equipment or technology), more element panorama fire hazard monitorings detect early warning and alarming all-in-one machine (video camera, system, equipment or skill Art), it is more element panoramas dark ice monitor and detection early warning and alarming all-in-one machine (video camera, system, equipment or technology) icy on road, artificial The more element overall view monitorings of intelligence detect site environment analog simulation pre-alarm system (equipment or technology), equipment radio patrol checking skill Art, device powers down suspension Wireless Ad Hoc Networks, more element panorama comprehensively monitorings detection site environment analog simulation reduction technique, The super splicing of continuum panoramic camera video image, compound eye panoramic mosaic technology, more element panorama comprehensive video things Part detection monitoring all-in-one machine (video camera, system, equipment or technology), the comprehensive candid photograph monitor and detection all-in-one machine violating the regulations of more element panoramas (video camera, system, equipment or technology), (video camera, is set system more element panorama integration schedules identification monitor and detection all-in-one machines Standby or technology), more element panorama comprehensively monitorings detection all-in-one machine (video camera, system, equipment or technology) fire hazard aerosol fog detect skill Art, more element panoramas comprehensive dark ice icing monitor and detection all-in-one machine in road surface (video camera, system, equipment or technology), more elements are complete Comprehensive night vision monitoring detection all-in-one machine (video camera, system, equipment or technology) of scape, artificial intelligence analyse in depth more element panoramas Splice comprehensively monitoring detection early warning and alarming technology, artificial intelligence analyses in depth more element panoramic mosaic comprehensively monitorings and detects live ring Border imitation technology, tunnel rescue site environmental simulation emulation technology, bad weather circumstances analog simulation early warning and alarming technology, The more element site environment imitation technologies of intelligent transportation, more element environmental simulation emulation technologies, comprehensively monitoring detect all-in-one machine (video camera, system, equipment or technology), panoramic mosaic Video Events detection technique, panoramic mosaic vehicle violation capture technology, complete Scape splicing vehicle route identification technology, the continuously seamless spliced technology in N number of big region of panoramic mosaic equipment, panoramic mosaic video camera are certainly Dynamic Cascade control technology or scheme.
The embodiment of the present invention ties up early warning systems based on the more element overall view monitoring detections five of artificial intelligence, has artificial intelligence Study process function in depth.After real-time image acquisition information and the data information of each sensor acquisition, system enables big number According to analysis and graphically digital simulation obtained is simulated to monitoring center commanding and rescue and relief work people Member provides basic guarantee, after this external system is by carrying out regular self-teaching and data summarization to Various types of data, is formed Different periods, different meteorologies, different traffic, different extent of injury management strategies and periodical action scheme, once reach Alarm critical point or when being in an emergency, system horse back alert gives relevant staff, to take as soon as possible Life is saved in corresponding rescue measure, less damage.
The present invention is by the more element weather detectors and fire alarm detection device of customization, detection device icy on road Combine, acquired great amount of images data, meteorological data, environmental data, gas data etc. are taken together, is passing through AI It after artificial intelligence studies analysis in depth, and reports out with most proper real-time proposals, and combines image, figure, data, scene A variety of receipts means such as simulation are to user, it will provide end user and greatly help, a kind of a wide range of continuum is real When integrated supervision detection device, it is a kind of low cost have artificial intelligence analysis be proposed that the equipment of a variety of early warning schemes, Yi Zhongcao Make it is simple and fast, durable, reliable and stable, personalized customization, compact, the wide comprehensively monitoring of use scope may be implemented again It is maximum then to become present all trades and professions (including: highway, urban transportation, region security protection, airport circumference etc.) for detection device Demand.
Figure 13 is the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence according to the embodiment of the present invention, artificial intelligence It can learning process figure.
After real-time image acquisition information and the data information of each sensor acquisition, system enables big data analysis and is used in combination The mode of figure simulates digital simulation obtained to provide basis to monitoring center commanding and rescue and relief work personnel Guarantee, after this external system is by carrying out regular self-teaching and data summarization to Various types of data, ultimately forms with five Dimension in real time dynamic present graphical for operator's decision, position, check, complete trails roaming, preview use, be with three-dimensional map The bottom preview mode and different periods combined, different meteorological condition, different traffic, real-time panoramic video graphic joining melt Conjunction, different location, different extent of injury management strategies and periodical action scheme, once reach alarm critical point or occurs urgent When situation, system horse back alert, and preview is watched to relevant staff with five dimensional view exhibition methods, so as to the greatest extent Fast takes corresponding rescue measure, and life is saved in less damage.
Figure 14 is the front end according to the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence of the embodiment of the present invention The communication scheme of device and mobile client.
Mobile phone app or computer real time inspection access all devices state in local area network.Staff can be logical with cell phone application Cross system wireless network connection (user, password authentification) obtain local area network in all devices working status parameter such as: work electricity Pressure, operating current, various kinds of sensors working condition and fault condition, and see video image.It can be between equipment and equipment Interconnection, passes through cable network or wireless device.Two sections of tunnel are arranged in general wireless access, facilitate rescue personnel, fire-fighting people Member and leader's floor manager are dispatched, live video situation in real time inspection tunnel, as long as passing through mobile phone or notebook electricity Brain access.
Figure 15 is the work according to the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence of the embodiment of the present invention Flow chart.
Firstly, building system and that parameter is arranged is as follows:
(1) front-end sensor data is obtained, analog simulation site environment generates dynamic and attempts.Such as: rain, snow, mist, temperature Degree, wind direction, illumination etc.；
(2) 180 ° of front end panoramic mosaic image is obtained, is merged by secondary splicing and generates complete trails live preview video figure Picture, carries out anomalous event accident detection and license plate captures information extraction；
(3) front end IPC thermal infrared imaging camera image is obtained, realizes that high temp objects detection, the dark ice in road surface, freeze inspection Survey, fire detection, night vision, perspective function；
(4) front end latitude and longitude coordinates information is obtained, 3 D stereo coordinate map is generated.
Then, data in the process, audio, video, warning message, coordinate information, data sheet, license plate, alarm are remembered The important informations such as record, vehicle movement track are stored.
It should be noted that the above process can be studied in depth by artificial intelligence, prediction scheme is automatically generated.
Three-dimensional map, complete trails panoramic video preview image, the analog simulation site environment generated by process generates dynamic The fusions such as state attempts, data form the five dimension figures that there is audio, video, data, coordinate, three-dimensional map and warning message to be integrated Shape human-computer interaction interface.When detecting superscalar data, when needing to alarm, alarm signal is exported by fore device, while by third Method, apparatus linkage output alarm signal.
It is according to an embodiment of the present invention to tie up early warning systems based on the more element overall view monitoring detections five of artificial intelligence, have following The utility model has the advantages that
1) product can externally export 5 groups of video flowings by the gigabit network interface of itself, and every group of video flowing can support 5 Client accesses simultaneously；Including 3 independent camera video streams of monitoring different angle different directions, one 180 ° or 360 ° of panoramic seamless splice video flowing, a thermal infrared imaging camera video flowing.5 video flowings can work independently transmission Different Function detection or pattern analysis and storage, which are carried out, to different clients calls use.
2) 4 video cameras (3 variable-focus video cameras and 1 PLC thermal infrared imaging camera) are according to actual use situation Independent parameter setting modification can be carried out or receive the global revision plan of establishment in cascaded fashion, intelligence also may be implemented certainly Dynamic parameter linkage adjustment.
3) coding of video flowing and communication mode meet the coding and communication mode of International or National mainstream, can also be with According to user demand the scrambled format and communication mode exclusive using user, picture quality can be in 2,000,000 pixels to 2400 It arbitrarily switches or calls between ten thousand pixels and check.
4) 5 groups of video flowings all pass through a gigabit network interface and are exported, and each parameter can be by remotely carrying out pipe Reason, setting, modification.
5) equipment simultaneously have accident detection (pedestrian, vehicle violation stagnation of movement, traffic accident, drive in the wrong direction, shed object, Congestion, queuing), license plate capture (exceed the speed limit, go slowly, violating the regulations lane change, Path Recognition), dangerous suspect vehicle detection, fire detection, object The function such as the detection of body high/low temperature, the detection icy on road of dark ice, all kinds of anomalous weather disaster detections, pernicious gas, fuel gas detection Can, it can also be increased according to user demand based on image analysis processing other function such as face recognition, boundary defence etc..
6) the starlight grade that three video cameras are all made of that ultra-low illumination target surface is 1/1.8 " customizes image device, and effect is presented And dark situation backlight control；Long-range micro- focusing, accurate aperture regulatory function are realized, using specific physical hardware combinations and machinery Framework thoroughly solves the operating mode of single camera or multiple splicings video camera " black under lamp ".
7) keep splicing picture more smooth continuous and uninterrupted using seamless spliced mode.
It 8) can be by two or five dimension early warning system leading portion equipment of N number of continuous artificial intelligence more element overall view monitorings detection are led to Combination of network is crossed together, when meeting certain installation requirement (such as spacing distance, height), again to each leading portion equipment 180 ° sent or 360 ° of larger range of graphic joining fusions of full-view video images progress, to guarantee vehicle in tunnel Interior, road outfield is monitored in continuous regional scope without losing image information.Pass through this secondary splicing integration technology Long range, system-wide section, big region tracking and fortune without the continuous monitor and detection of blind angle and item, vehicle, pedestrian may be implemented The analysis of dynamic rail mark, it might even be possible to realize that whole scene 3D traces and monitors testing mechanism.
9) 180 ° of panoramic mosaic fusions are using multifocal away from compound eye connecting method, and 3 video cameras are using the variable of different focal length Zoom lens monitor the object of different distance, and equipment is being existed 3 video image splicing fusions by specific graphic joining algorithm Together, complete monitoring monitoring screen is formed.
10) 3 video cameras join focus technique using intelligent level, when the focal length of any one of 3 video cameras video camera is by people For adjustment when, the focal length of other two video cameras all can automatic synchronization change (pass through preset treatment mechanism and linkage Algorithm forward direction increases or reversed reduction), guarantee that the panoramic mosaic blending image of output is not affected.
11) 3 video cameras join Calibration Technology using intelligent level, when the color rendition degree of any one video camera, white balance, The important parameters such as ultra-low illumination, wide dynamic, exposure intensity, shutter speed, video code model, color uniformity are considered adjusting When, other two corresponding parameters of video camera all can automatic synchronization change (pass through preset treatment mechanism and linkage Algorithm forward direction increases or reversed reduction).
12) 3 video cameras will be as a complete whole appearance, it is necessary first to distort to the wide angle picture of three video cameras Carry out correction output；Exposure, white balance, color uniformity and color rendition are used is with center wide angle cameras (video camera 2) Refer-mechanisms, when wide angle cameras (video camera 2) image parameter in center adjusts, other two video cameras can synchronize automatic adjustment, Image mosaic is required to reach image mosaic optimum efficiency when coping with different light-inletting quantities.
13) when have in network cluster any leading portion equipment due to cause specific cause wire communication interrupt or wired confession After electricity interrupts, system horse back starting energy-saving mode and adhoc mode and the battery for relying on leading portion equipment itself to carry are carried out Work is maintained, is guaranteeing not go offline within the scope of 24 hours.Simultaneously by 4G, (future supports 5G mode or higher nothing to system Line transmission mode) mode to terminal user send warning message,
14) user can access online equipment state and event all in cluster net by cell phone application or computer real time inspection Barrier equipment position and fault condition are quickly repaired in turn.
15) when fire or explosion time occur in tunnel, when wherein an equipment or multiple equipment are damaged in tunnel, even When power supply system or communication system in tunnel can not work, fire fighter or rescue personnel can pass through pen in the entrance in tunnel Note is originally or in the wireless network of mobile phone access device, the equipment of communication disruption or power failure in tunnel, starts at once from group Net and energy-saving mode, in the case where continuing 24 hours low-power consumption modes for convenience of rescue personnel, fire fighter and leader are existing Command scheduling, live image (every 5-60 second of graphic form updates once, and the time is adjustable) feelings in real time inspection tunnel Condition, gives first aid to for personnel and robs calamity and recover and provide the quality time.
16) system passes through the various data such as collected more essential sensors and integrated gas sensor and itself work Make state (temperature, voltage, electric current, signal intelligence, each sensor online or damaged condition, mechanical breakdown situation) and compressed Video image or with thumbnail；By wireless network or 4G communication module, (future supports 5G mode or higher wireless transmission side Formula) be transferred to equipment management personnel or maintenance personnel and each leader, in this way these personnel can at any time with Equipment situation and field condition are grasped in ground, can easily realize online management mobile office demand, thus accomplish quickly to check, Quickly know, fast equipment malfunction elimination, quickly reparation and other effects.
17) device context maintenance personnel passes through the flashing mode or 4G of equipment indicating lamp in the case where keeping off equipment Communication (future supports 5G mode or higher wireless transmission method) tentatively can judge that equipment is detailed with cell phone application Fault condition, be even accurate to each sensor or the main informations such as mechanical part damaged condition.
18) comprehensive sensor and more essential sensors by collection in worksite to real time data divided by headend equipment Analyse, summarize, judging, form early warning scheme or warning message be transmitted to central server carry out the reduction of site environment analog simulation with simultaneously Goed deep into after manual analysis by private clound big data and five dimension early warning system display platforms is combined to carry out real-time exhibition, and issues report Alert starting is met an urgent need accordingly or rescue method.
19) mass data that cloud processing platform in center sends N number of headend equipment, and after studying in depth and analyzing, Really and accurately real-time environment five can be carried out to certain point, a certain region, a certain road, a certain city, a certain province and tie up mould Quasi- reduction emulation (three-dimensional map, real time video image, certain point, a certain region, a certain road, a certain city, a certain province day Vaporous condition is perfectly merged and is shown), provide congestion in road, traffic accident, boundary defence, natural calamity, rescue and relief work, Emergency accident treatment, command scheduling, pre-alarm and prevention, fire-fighting and rescue etc. provide basic data, graphical information, image information With detailed prediction scheme, strive for the quality time for related personnel and leader.
20) center management server can by remotely to headend equipment carry out the setting of parameter, revision, obtain, issue it is complete New departure etc..
21) since the equipment can pass through visible light camera, thermal infrared imaging camera and temperature sensor and gas Sensor comprehensive analysis, and provide more friendly visualized graphs alarm and check interface, this outer sensor can be to quilt The region that detection object and needs detect carries out regional assignment, greatly reduces traditional equipment and reports by mistake, fails to report, does not report, reports Alert not intuitive, position inaccurate, not visibleization lack the shortcomings of reference quantity, and improve to will be abnormal event Reaction time.And integrative solution such as high temp objects alarm temperature, cryogenic object report are proposed to more anomalous events Alert temperature, object to be detected temperature duration involve range, flame or dark ice feature etc., reduce repeated plant and not A large amount of investments of necessaries reduce the waste of a large amount of stealthy resources.Equipment can to in tunnel, road, bridge, perimeter region Domain, airport, workshop and specific region carry out open fire, high temp objects and dark ice and are measured in real time, and the sensor is in addition to tool Other than standby detection warning function, when fire occurring in tunnel or rising dense smoke common camera by blinding, perspective monitoring is played Effect.Accurate real-time video image on the other hand is provided for tunnel fire fighter and rescue worker and administrative staff.Work as equipment When being installed in outfield, perspective night vision is equally played when night, thick fog, haze, heavy snow, heavy rain common camera are by blinding and is made With.
22) equipment can also provide it is a kind of have no matter daytime or night and under dense smoke haze it is visual Fire, high temperature, low temperature, dark ice and early warning icy on road, alarm visibility solution
It 23) can be running on expressway since the equipment has the splicing of complete trails video whole process and following function Vehicles or pedestrians carry out accurate positioning and driving path identification and play back, effective guarantor can be provided for the charge of accurate path Card
24) after headend equipment detects anomalous event and the collected Various types of data of sensor is combined to analyse in depth, and The alarm plan that extent of injury priority mode automatically generates, and warning message is exported by IO, R485 or CAN interface and is sent to In local warning device or third party device, and central server is uploaded to by network interface and carries out summarizing alarm or alarm touching Hair, forms the integrative solution or mechanism of full-automatic unmanned intervention.
25) complete trails panoramic picture Video Events testing cost is the one third of common single camera cost；System-wide Diameter panoramic picture vehicle violation captures the one third that cost is common single camera cost.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example Point is included at least one embodiment or example of the invention.In the present specification, schematic expression of the above terms are not Centainly refer to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be any One or more embodiment or examples in can be combined in any suitable manner.
Although the embodiments of the present invention has been shown and described above, it is to be understood that above-described embodiment is example Property, it is not considered as limiting the invention, those skilled in the art is in the feelings for not departing from the principle of the present invention and objective It can make changes, modifications, alterations, and variations to the above described embodiments within the scope of the invention under condition.The scope of the present invention is by institute Attached claim and its equivalent restriction.

Claims (9)

1. one kind is based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence characterized by comprising at least one The more element overall view monitoring detection devices of front end artificial intelligence and central management device, each more elements of front end artificial intelligence are complete Scape monitor and detection device includes central control processing unit, one group of zoom camera being connected with the central control processing unit Machine, IPC thermal infrared imaging camera, more essential sensors, communication module and interface unit and power supply module, wherein
More essential sensors include: brightness light intensity sensor, Temperature Humidity Sensor, precipitation rain fall sensor, wind speed and direction sensing Device, integrated gas sensor, wherein the brightness light intensity sensor is used to acquire the brightness light intensity value of current environment；The temperature Humidity sensor is used to acquire the data of the Temperature and Humidity module of current environment, and the precipitation rain fall sensor is used to acquire the rainfall of current environment Value, the wind speed wind direction sensor are used to acquire the wind speed and direction data of current environment, and the integrated gas sensor is for adopting Collect the concentration value of all kinds of gases in current environment,
Wherein, every more element overall view monitoring detection devices of leading portion artificial intelligence are installed on the predetermined position in section, Then collected all kinds of environmental data information are sent to the central control processing unit, it will be each by central control unit The more element overall view monitoring detection devices of leading portion artificial intelligence upload to central management device five and tie up on early warning alarm management platform, into Row analog simulation scene actual environment is simultaneously dissolved into real-time display in five dimension figures, checks for road conditions, roadside assistance, environmental hazard Forecast assessment, emergency schemes generation provide basic basis；
The camera shooting unit includes more Zoom cameras, for realizing 180 ° or 360 ° of panoramic mosaic functions, and is provided real-time A wide range of video road conditions check, provide the various monitor and detection functions based on video and graphic analysis, wherein every leading portion people Intelligently more element overall view monitoring detection devices are installed on the predetermined position in section to work, acquire different location on section respectively Image information, wherein every video camera monitors the object of different distance using the Varifocal zoom lens of different focal length, and acquires corresponding Image information, acquired image information is then sent to the central control processing unit, by central control unit will Each more element overall view monitoring detection devices of leading portion artificial intelligence upload to central management device five and tie up early warning alarm management platform On, it carries out secondary video image mosaic and is dissolved into real-time display in five dimension figures, realize the alarm of anomalous event accident detection, determine Position, traffic behavior preview and assessment, complete trails video check roaming function；
The IPC thermal infrared imaging camera for realizing high temp objects are detected, the detection of road dark ice, fire alarm alarm inspection It surveys, night vision perspective function is provided, delimit the region for needing to detect first, then to the object in detected region, pedestrian, roadbed road Face etc. is measured in real time, and common camera night or environment it is dim by blinding when, play night vision perspective monitoring work With；Every more element overall view monitoring detection devices of leading portion artificial intelligence are installed on the predetermined position in section, and IPC is infrared Video camera acquires the object of different location on section, pedestrian, subgrade and pavement data information and image information respectively, then will acquisition To data information be sent to the central control processing unit, by central control unit by each more elements of leading portion artificial intelligence Overall view monitoring detection device uploads to central management device five and ties up on early warning alarm management platform, carries out concentrating Macro or mass analysis and melt Enter the real-time display into five dimension figures, realize the alarm of the anomalous events accident detections such as abnormal vehicle, object, pedestrian, subgrade and pavement, Positioning, traffic behavior preview and assessment, night vision perspective function；
The central control processing unit for will the above-mentioned one group of Zoom camera image information that receive by stitching algorithm into Row splicing fusion and data acquisition, logical operation and logic control output, upload after forming 180 ° or 360 ° of panoramic mosaic images Onto central management device, and when receiving from the warning message of the IPC thermal infrared imaging camera, in conjunction with described The all data of more essential sensor acquisitions, deeply divides according to preset alarm parameters or central control unit artificial intelligence The alarm plan automatically generated after analysis study exports warning message by the interface unit, and is sent to local warning device Or in third party device, and central server is uploaded to by network interface and carries out summarizing alarm or alarm triggering；The center control Processing unit processed by the upper surface of described in panoramic mosaic video or image, the warning message of IPC thermal infrared imaging camera, video, Image and the data and warning message of the acquisition of more essential sensors, by the communication module dispatching centre managing device or Mobile terminal, maintenance personnel check real time monitoring information by the mobile terminal back-end platform, check institute in access local area network Some online equipment states and faulty equipment position and fault condition are quickly repaired in turn；
The central management device receives video, image, data, the more essential sensors that each fore device is sent and acquires All data and warning message, N number of headend equipment cascades and associated obtain front end data, is handled by big data cloud flat Platform carries out scene five and ties up figure displaying, the roaming of complete trails traffic behavior video preview, the simulation of actual environment, emulation, playback, obtains To environmental simulation as a result, and manager and rescue personnel and fire fighter are informed by way of figure and sound, take dimension Shield measure；
Central management device carries out scene five by big data cloud processing platform and ties up figure real-time display, comprising: five dimension figure of scene Shape is shown, practical weather perceives environmental simulation Dynamically Announce, the preview of traffic prevailing state, event accident anticipation, complete trails video The three-dimensional unlimited roaming of splicing is checked, position positions in real time, information summarizes upload for event accident generation.
2. as described in claim 1 based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence, which is characterized in that Every more element overall view monitoring detection devices of leading portion artificial intelligence are using one group of varifocal or 180 ° of focusing video camera realization Or 360 ° of panoramic mosaic fusions；The IPC video camera uses the infrared thermal imaging camera shooting with temperature detection, regional assignment function Machine.
3. as claimed in claim 1 or 2 based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence, feature exists In one group of variable-focus video camera joins Calibration Technology using intelligent level, wherein intelligent level joint debugging school includes the coke to video camera Away from, the adjustment of aperture, shutter, white light balance, spectrum assignment, minimal illumination, wide dynamic, orientation, coded format parameter；
When the parameter of any one video camera is by artificial adjustment, the parameter of other video cameras can follow automatic synchronization to change, Including carrying out positive increase or reversed reduction according to preset program and parameter, to guarantee 180 ° or 360 ° of panoramic video figures As the integrality of splicing fusion.
4. as claimed in claim 2 based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence, which is characterized in that The camera shooting unit includes: 3 Zoom cameras and 1 dedicated IPC thermal infrared imaging camera, wherein the center control Processing unit processed exports 5 groups of video flowings:
1st group: the video flowing of first Zoom camera；
2nd group: the video flowing of second Zoom camera；
3rd group: the video flowing of third Zoom camera；
4th group: first 180 ° or the 360 ° of panoramic mosaic video flowings formed to third Zoom camera；
5th group: the video flowing of IPC thermal infrared imaging camera；
Wherein, in order to reduce the network bandwidth that equipment occupies, the 1st group to the 3rd group video flowing uses passive method of calling, and system is silent Recognize and actively export the 4th group of video flowing and the 5th group of video flowing, third party system guarantees the 4th group when calling 1-3 group video flowing It cannot be interrupted with the 5th group of video flowing.
5. as described in claim 1 based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence, which is characterized in that The interface unit includes: power supply interface and input/output interface, wherein
The power supply interface uses 48V POE power supply interface；
The input/output interface include: I/O interface, audio input interface, audio output interface, CAN interface, RS485 interface and The adaptive RJ45 interface of 100/1000M.
6. as described in claim 1 based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence, which is characterized in that The integrated gas sensor is for acquiring sulfur dioxide, carbon dioxide, carbon monoxide, methane, formaldehyde, natural gas, liquefied gas Gas concentration.
7. as described in claim 1 based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence, which is characterized in that The central control processing unit include: storage unit, clock unit, GPU graphics processing unit, multicore high speed arm processor, Multicore high-speed dsp processor and central control logic operation and processing unit；The communication module uses wireless communication module, 4G Three kinds of communication module and the adaptive network interface communication module of 100/1000M.
8. as described in claim 1 based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence, by obtaining in real time After the data information for taking image information and each sensor to acquire, system enables big data analysis and will graphically be obtained Digital simulation simulate and provide basic guarantee to monitoring center commanding and rescue and relief work personnel, this external system by pair After Various types of data carries out regular self-teaching and data summarization, ultimately forms and tie up dynamic present graphical in real time with five For operator's decision, position, check, complete trails roaming, preview uses, be bottom preview mode and combination using three-dimensional map Different periods, different meteorological conditions, different traffic, the fusion of real-time panoramic video graphic joining, different location, different harm Degree management strategy and periodical action scheme, when reaching alarm critical point or being in an emergency, system issues at once Warning message, and preview is watched to relevant staff with five dimensional view exhibition methods, to take corresponding rescue as soon as possible Life is saved in measure, less damage.
9. as described in claim 1 based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence, which is characterized in that The central management device includes: management work station and privately owned Cloud Server, wherein
The privately owned Cloud Server setting is in monitoring branch center computer room, and execute following work: data exchange, is at store function System communication, maintenance, the building of each function of system, the setting of parameter, concentrated alarm, scheme forming, artificial intelligence are studied in depth point It analyses, the execution of linkage scheme issues, three-dimensional map generates, five dimension graphic hotsopts, site environment data summarization, site environment are simulated and imitated Very, the operation of big data macroscopic view, video monitoring, image storage, alert event video recording file for reference, report production, complete trails video image Instruction transmission that secondary splicing, complete trails video image are checked, roamed, preview generation, the calling of video image and third party link, Send presupposed solution, regular job man-machine interface centralized alarm；
The management work station setting executes following work: data exchange, system communication, collection on monitoring branch center operation bench Middle alarm, scheme forming, linkage scheme issue that execution, five dimension figure real-time exhibitions, image is shown, big data macroscopic view shows, regards Frequency monitoring, complete trails video image check, roam, preview generation, the calling of video image, alert event video recording file for reference, report Production interacts, centralized alarm with third party's linkage instruction transmission, transmission presupposed solution, regular job, man-machine interface.
CN201810332637.9A 2018-04-13 2018-04-13 Five-dimensional early warning system based on artificial intelligence multi-element panoramic monitoring detection Active CN109640032B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810332637.9A CN109640032B (en) 2018-04-13 2018-04-13 Five-dimensional early warning system based on artificial intelligence multi-element panoramic monitoring detection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810332637.9A CN109640032B (en) 2018-04-13 2018-04-13 Five-dimensional early warning system based on artificial intelligence multi-element panoramic monitoring detection

Publications (2)

Publication Number Publication Date
CN109640032A true CN109640032A (en) 2019-04-16
CN109640032B CN109640032B (en) 2021-07-13

Family

ID=66066218

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810332637.9A Active CN109640032B (en) 2018-04-13 2018-04-13 Five-dimensional early warning system based on artificial intelligence multi-element panoramic monitoring detection

Country Status (1)

Country Link
CN (1) CN109640032B (en)

Cited By (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110795813A (en) * 2019-08-14 2020-02-14 腾讯科技（深圳）有限公司 Traffic simulation method and device
CN110889329A (en) * 2019-10-25 2020-03-17 浙江大华技术股份有限公司 Security check machine, security check machine inspection system, video stream processing method and storage medium
CN111078393A (en) * 2019-11-07 2020-04-28 河北德冠隆电子科技有限公司 Interactive edge computing server and control method thereof
CN111092408A (en) * 2020-01-20 2020-05-01 国网福建省电力有限公司宁德供电公司 Transformer substation monitoring method
CN111309151A (en) * 2020-02-28 2020-06-19 桂林电子科技大学 Control method of school monitoring equipment
CN111338298A (en) * 2020-02-12 2020-06-26 上海圣石生物医学科技有限公司 Intelligent production process monitoring system for health ring
CN111476192A (en) * 2020-04-15 2020-07-31 陈建 Intercepted image synthesis method based on intelligent traffic and big data cloud server
CN111614884A (en) * 2020-06-29 2020-09-01 北京百度网讯科技有限公司 Artificial intelligent camera and monitoring method
CN111800578A (en) * 2020-08-07 2020-10-20 马凯 Panoramic photography method for multi-azimuth synchronous shooting
RU200591U1 (en) * 2020-01-23 2020-10-30 Общество с ограниченной ответственностью "МорТех" EMERGENCY DETECTOR
CN111915853A (en) * 2020-06-15 2020-11-10 西安交通大学 Energy storage station safety situation assessment and early warning system and method with linkage characteristic
CN112217994A (en) * 2020-09-29 2021-01-12 国网浙江省电力有限公司嘉兴供电公司 Early warning method for safety operation around electric power high-voltage line
CN112380685A (en) * 2020-11-10 2021-02-19 北京石油化工学院 Visual display and evaluation system platform for explosion disasters
CN112446905A (en) * 2021-01-29 2021-03-05 中国科学院自动化研究所 Three-dimensional real-time panoramic monitoring method based on multi-degree-of-freedom sensing association
CN112527764A (en) * 2020-11-18 2021-03-19 上海科技网络通信有限公司 Big data machine room management system based on artificial intelligence and management method thereof
CN112653872A (en) * 2020-11-20 2021-04-13 宏力照明集团有限公司 Flow monitoring system based on high-definition infrared camera
CN112684517A (en) * 2021-03-19 2021-04-20 国网山东省电力公司昌邑市供电公司 Remote monitoring device for working environment of live working
CN112889271A (en) * 2019-05-29 2021-06-01 华为技术有限公司 Image processing method and device
CN112885081A (en) * 2021-01-11 2021-06-01 浙江海峡创新科技有限公司 Urban emergency safety protection early warning system
CN113076383A (en) * 2020-01-06 2021-07-06 阿里巴巴集团控股有限公司 Road data acquisition vehicle and data acquisition system thereof
US20210269174A1 (en) * 2020-02-27 2021-09-02 Greg Douglas Shuff Drone docking port and method of use
CN113393625A (en) * 2021-05-08 2021-09-14 中电海康集团有限公司 Anti-theft alarm evidence obtaining method and system for intelligent lamp pole
CN113419458A (en) * 2021-07-03 2021-09-21 山西省煤炭地质物探测绘院 Geological disaster monitoring system based on 5G communication
CN113466718A (en) * 2021-06-29 2021-10-01 广东工业大学 SOC correction method for mobile phone battery
CN113543418A (en) * 2021-07-13 2021-10-22 安徽艳阳电气集团有限公司 Intelligent emergency lamp for nuclear environment
CN113656123A (en) * 2021-07-28 2021-11-16 上海纽盾科技股份有限公司 Information evaluation method, device and system for equal protection evaluation
CN113727021A (en) * 2021-08-27 2021-11-30 维沃移动通信（杭州）有限公司 Shooting method and device and electronic equipment
CN113920744A (en) * 2021-12-15 2022-01-11 陕西易合交通科技有限公司 Tunnel portal traffic safety monitoring and early warning system based on Internet of things
CN113955131A (en) * 2021-12-21 2022-01-21 山东欧龙电子科技有限公司 Data intelligent monitoring processing platform for health state of manned aircraft
CN114023048A (en) * 2021-11-27 2022-02-08 安徽博达项目管理咨询有限公司 Engineering supervision system based on artificial intelligence data processing and visual analysis
CN114040003A (en) * 2022-01-10 2022-02-11 华北科技学院(中国煤矿安全技术培训中心) Emergency disposal system and method for emergency events in personnel dense area
CN114187721A (en) * 2021-08-26 2022-03-15 上海九周智能科技有限公司 Intelligent remote security monitoring system and management platform
CN114371745A (en) * 2021-12-29 2022-04-19 徐州捷科思网络科技有限公司 Temperature control system
CN114399899A (en) * 2021-12-01 2022-04-26 武汉微创光电股份有限公司 Method and system for realizing high-temperature vehicle track tracking in tunnel operation
CN115014445A (en) * 2022-08-10 2022-09-06 中国农业大学 Smart fishery multi-dimensional panoramic perception monitoring method, system and device
CN115051922A (en) * 2022-05-09 2022-09-13 中国联合网络通信集团有限公司 Link control method and device, electronic equipment and storage medium
CN115150590A (en) * 2022-07-01 2022-10-04 华能广西清洁能源有限公司 Wind-powered electricity generation field intelligent monitoring device
CN115604319A (en) * 2022-11-21 2023-01-13 青岛大学威海创新研究院（Cn） Intelligent community management platform based on multi-dimensional sensor
US11703820B2 (en) 2020-06-08 2023-07-18 Xiamen University Of Technology Monitoring management and control system based on panoramic big data
CN116518989A (en) * 2023-07-05 2023-08-01 新唐信通(浙江)科技有限公司 Method for vehicle navigation based on sound and thermal imaging
CN116562848A (en) * 2023-05-05 2023-08-08 江西意孚欧科技有限公司 Operation and maintenance management platform
CN116757437A (en) * 2023-07-07 2023-09-15 浙江警正安全科技有限公司 Intelligent fire emergency alarm system
CN116805401A (en) * 2023-05-30 2023-09-26 北京交通大学 Site management method, system, equipment and medium based on AR equipment
CN116935652A (en) * 2023-09-14 2023-10-24 四川国消云科技有限公司 Intelligent traffic information system integrated platform data management system
CN117094474A (en) * 2023-10-18 2023-11-21 济南瑞源智能城市开发有限公司 Intelligent tunnel risk perception method, device and medium based on holographic perception
CN117596386A (en) * 2023-12-06 2024-02-23 中云数科(广州)信息科技有限公司 Intelligent building safety monitoring system
CN117631730A (en) * 2024-01-25 2024-03-01 中建科工集团有限公司 Stadium energy-saving control method, device and equipment based on image dynamic identification

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105262987A (en) * 2015-09-24 2016-01-20 北京尚易德科技有限公司 Road full-covering panoramic intelligent video monitoring system and method based on Internet of Things
CN206117890U (en) * 2016-05-16 2017-04-19 深圳市小爱爱科技有限公司 360 degrees virtual reality imaging system in panorama
CN106781519A (en) * 2016-12-22 2017-05-31 天津渡科技有限公司 One kind can positioning intelligent preventing road monitoring system
CN107065730A (en) * 2017-05-26 2017-08-18 安徽皖通科技股份有限公司 Freeway tunnel safe operation intelligent monitor system
CN107194861A (en) * 2017-07-02 2017-09-22 四川藏区高速公路有限责任公司 A kind of road network operation comprehensive monitoring management platform and method based on 3DGIS+BIM

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105262987A (en) * 2015-09-24 2016-01-20 北京尚易德科技有限公司 Road full-covering panoramic intelligent video monitoring system and method based on Internet of Things
CN206117890U (en) * 2016-05-16 2017-04-19 深圳市小爱爱科技有限公司 360 degrees virtual reality imaging system in panorama
CN106781519A (en) * 2016-12-22 2017-05-31 天津渡科技有限公司 One kind can positioning intelligent preventing road monitoring system
CN107065730A (en) * 2017-05-26 2017-08-18 安徽皖通科技股份有限公司 Freeway tunnel safe operation intelligent monitor system
CN107194861A (en) * 2017-07-02 2017-09-22 四川藏区高速公路有限责任公司 A kind of road network operation comprehensive monitoring management platform and method based on 3DGIS+BIM

Cited By (60)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112889271A (en) * 2019-05-29 2021-06-01 华为技术有限公司 Image processing method and device
CN110795813A (en) * 2019-08-14 2020-02-14 腾讯科技（深圳）有限公司 Traffic simulation method and device
CN110889329A (en) * 2019-10-25 2020-03-17 浙江大华技术股份有限公司 Security check machine, security check machine inspection system, video stream processing method and storage medium
CN111078393A (en) * 2019-11-07 2020-04-28 河北德冠隆电子科技有限公司 Interactive edge computing server and control method thereof
CN113076383B (en) * 2020-01-06 2023-03-21 阿里巴巴集团控股有限公司 Road data acquisition vehicle and data acquisition system thereof
CN113076383A (en) * 2020-01-06 2021-07-06 阿里巴巴集团控股有限公司 Road data acquisition vehicle and data acquisition system thereof
CN111092408A (en) * 2020-01-20 2020-05-01 国网福建省电力有限公司宁德供电公司 Transformer substation monitoring method
RU200591U1 (en) * 2020-01-23 2020-10-30 Общество с ограниченной ответственностью "МорТех" EMERGENCY DETECTOR
CN111338298A (en) * 2020-02-12 2020-06-26 上海圣石生物医学科技有限公司 Intelligent production process monitoring system for health ring
US20210269174A1 (en) * 2020-02-27 2021-09-02 Greg Douglas Shuff Drone docking port and method of use
CN111309151A (en) * 2020-02-28 2020-06-19 桂林电子科技大学 Control method of school monitoring equipment
CN111476192A (en) * 2020-04-15 2020-07-31 陈建 Intercepted image synthesis method based on intelligent traffic and big data cloud server
US11703820B2 (en) 2020-06-08 2023-07-18 Xiamen University Of Technology Monitoring management and control system based on panoramic big data
CN111915853B (en) * 2020-06-15 2022-02-11 西安交通大学 Energy storage station safety situation assessment and early warning system and method with linkage characteristic
CN111915853A (en) * 2020-06-15 2020-11-10 西安交通大学 Energy storage station safety situation assessment and early warning system and method with linkage characteristic
CN111614884A (en) * 2020-06-29 2020-09-01 北京百度网讯科技有限公司 Artificial intelligent camera and monitoring method
CN111800578A (en) * 2020-08-07 2020-10-20 马凯 Panoramic photography method for multi-azimuth synchronous shooting
CN112217994A (en) * 2020-09-29 2021-01-12 国网浙江省电力有限公司嘉兴供电公司 Early warning method for safety operation around electric power high-voltage line
CN112380685A (en) * 2020-11-10 2021-02-19 北京石油化工学院 Visual display and evaluation system platform for explosion disasters
CN112527764A (en) * 2020-11-18 2021-03-19 上海科技网络通信有限公司 Big data machine room management system based on artificial intelligence and management method thereof
CN112653872A (en) * 2020-11-20 2021-04-13 宏力照明集团有限公司 Flow monitoring system based on high-definition infrared camera
CN112885081A (en) * 2021-01-11 2021-06-01 浙江海峡创新科技有限公司 Urban emergency safety protection early warning system
CN112446905B (en) * 2021-01-29 2021-05-11 中国科学院自动化研究所 Three-dimensional real-time panoramic monitoring method based on multi-degree-of-freedom sensing association
CN112446905A (en) * 2021-01-29 2021-03-05 中国科学院自动化研究所 Three-dimensional real-time panoramic monitoring method based on multi-degree-of-freedom sensing association
CN112684517A (en) * 2021-03-19 2021-04-20 国网山东省电力公司昌邑市供电公司 Remote monitoring device for working environment of live working
CN113393625A (en) * 2021-05-08 2021-09-14 中电海康集团有限公司 Anti-theft alarm evidence obtaining method and system for intelligent lamp pole
CN113466718A (en) * 2021-06-29 2021-10-01 广东工业大学 SOC correction method for mobile phone battery
CN113419458A (en) * 2021-07-03 2021-09-21 山西省煤炭地质物探测绘院 Geological disaster monitoring system based on 5G communication
CN113543418A (en) * 2021-07-13 2021-10-22 安徽艳阳电气集团有限公司 Intelligent emergency lamp for nuclear environment
CN113656123B (en) * 2021-07-28 2023-05-16 上海纽盾科技股份有限公司 Information evaluation method, device and system for equal-protection evaluation
CN113656123A (en) * 2021-07-28 2021-11-16 上海纽盾科技股份有限公司 Information evaluation method, device and system for equal protection evaluation
CN114187721A (en) * 2021-08-26 2022-03-15 上海九周智能科技有限公司 Intelligent remote security monitoring system and management platform
CN113727021A (en) * 2021-08-27 2021-11-30 维沃移动通信（杭州）有限公司 Shooting method and device and electronic equipment
CN114023048A (en) * 2021-11-27 2022-02-08 安徽博达项目管理咨询有限公司 Engineering supervision system based on artificial intelligence data processing and visual analysis
CN114399899A (en) * 2021-12-01 2022-04-26 武汉微创光电股份有限公司 Method and system for realizing high-temperature vehicle track tracking in tunnel operation
CN114399899B (en) * 2021-12-01 2022-12-30 武汉微创光电股份有限公司 Method and system for realizing high-temperature vehicle track tracking in tunnel operation
CN113920744A (en) * 2021-12-15 2022-01-11 陕西易合交通科技有限公司 Tunnel portal traffic safety monitoring and early warning system based on Internet of things
CN113955131A (en) * 2021-12-21 2022-01-21 山东欧龙电子科技有限公司 Data intelligent monitoring processing platform for health state of manned aircraft
CN114371745A (en) * 2021-12-29 2022-04-19 徐州捷科思网络科技有限公司 Temperature control system
CN114040003B (en) * 2022-01-10 2022-04-01 华北科技学院(中国煤矿安全技术培训中心) Emergency disposal system and method for emergency events in personnel dense area
CN114040003A (en) * 2022-01-10 2022-02-11 华北科技学院(中国煤矿安全技术培训中心) Emergency disposal system and method for emergency events in personnel dense area
CN115051922A (en) * 2022-05-09 2022-09-13 中国联合网络通信集团有限公司 Link control method and device, electronic equipment and storage medium
CN115051922B (en) * 2022-05-09 2023-07-18 中国联合网络通信集团有限公司 Link control method, device, electronic equipment and storage medium
CN115150590A (en) * 2022-07-01 2022-10-04 华能广西清洁能源有限公司 Wind-powered electricity generation field intelligent monitoring device
CN115014445A (en) * 2022-08-10 2022-09-06 中国农业大学 Smart fishery multi-dimensional panoramic perception monitoring method, system and device
CN115014445B (en) * 2022-08-10 2022-11-15 中国农业大学 Smart fishery multi-dimensional panoramic perception monitoring method, system and device
US11758887B1 (en) 2022-08-10 2023-09-19 China Agricultural University Method, system and apparatus for intelligently monitoring aquafarm with multi-dimensional panoramic perception
CN115604319A (en) * 2022-11-21 2023-01-13 青岛大学威海创新研究院（Cn） Intelligent community management platform based on multi-dimensional sensor
CN116562848A (en) * 2023-05-05 2023-08-08 江西意孚欧科技有限公司 Operation and maintenance management platform
CN116805401A (en) * 2023-05-30 2023-09-26 北京交通大学 Site management method, system, equipment and medium based on AR equipment
CN116518989B (en) * 2023-07-05 2023-09-12 新唐信通(浙江)科技有限公司 Method for vehicle navigation based on sound and thermal imaging
CN116518989A (en) * 2023-07-05 2023-08-01 新唐信通(浙江)科技有限公司 Method for vehicle navigation based on sound and thermal imaging
CN116757437A (en) * 2023-07-07 2023-09-15 浙江警正安全科技有限公司 Intelligent fire emergency alarm system
CN116757437B (en) * 2023-07-07 2024-01-30 浙江警正安全科技有限公司 Intelligent fire emergency alarm system
CN116935652A (en) * 2023-09-14 2023-10-24 四川国消云科技有限公司 Intelligent traffic information system integrated platform data management system
CN117094474A (en) * 2023-10-18 2023-11-21 济南瑞源智能城市开发有限公司 Intelligent tunnel risk perception method, device and medium based on holographic perception
CN117094474B (en) * 2023-10-18 2024-02-20 济南瑞源智能城市开发有限公司 Intelligent tunnel risk perception method, device and medium based on holographic perception
CN117596386A (en) * 2023-12-06 2024-02-23 中云数科(广州)信息科技有限公司 Intelligent building safety monitoring system
CN117631730A (en) * 2024-01-25 2024-03-01 中建科工集团有限公司 Stadium energy-saving control method, device and equipment based on image dynamic identification
CN117631730B (en) * 2024-01-25 2024-04-19 中建科工集团有限公司 Stadium energy-saving control method, device and equipment based on image dynamic identification

Also Published As

Publication number Publication date
CN109640032B (en) 2021-07-13

Similar Documents

Publication Publication Date Title
CN109640032A (en) Based on the more five dimension early warning systems of element overall view monitoring detection of artificial intelligence
CN108922188B (en) Radar tracking and positioning four-dimensional live-action traffic road condition perception early warning monitoring management system
CN112422783B (en) Unmanned aerial vehicle intelligent patrol system based on parking apron cluster
AU2021202430B2 (en) Smart city closed camera photocell and street lamp device
CN103676829B (en) Intelligent city based on video total management system and method thereof
CN115348247A (en) Forest fire detection early warning and decision-making system based on sky-ground integration technology
CN109724610A (en) A kind of method and device of full information real scene navigation
CN108961790A (en) Bad weather pre-warning management system and method based on four-dimensional outdoor scene traffic simulation
CN202434011U (en) Automatic monitoring and alarming system for forest fire
US20210071855A1 (en) Multifunction lighting control unit
CN110235188A (en) Video data and GIS for traffic monitoring, event detection and variation prediction map
CN102646311A (en) Intelligent smoke and fire detecting system using real-time dynamic cruising images
CN105389936A (en) Intelligent protection system for forest disasters
CN107590764A (en) A kind of municipal things safe early warning and emergency scheduling platform
KR102425732B1 (en) Disaster risk level notification board and disaster prediction/alarm system
CN105100751A (en) Safe city simple access system
CN114882676B (en) Intelligent monitoring and early warning method and system based on intelligent pole under multiple scenes
CN106097744A (en) A kind of expressway fog real-time monitoring system and method based on generalized information system
CN204291242U (en) A kind of intelligent monitoring for river drifting substances
CN115762192A (en) Smart city construction system based on big data
CN114419231A (en) Traffic facility vector identification, extraction and analysis system based on point cloud data and AI technology
CN111163246A (en) High-altitude falling object monitoring system
CN204929089U (en) Safe and sound simple and easy bayonet socket system in city
KR20210066296A (en) Apparatus and method for monitoring city condition
CN206975792U (en) Urban road Intelligent Monitoring System for Tunnel

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20190510

Address after: 050030 Block C 705, White Commercial Plaza, 105 Huaian East Road, Yuhua District, Shijiazhuang City, Hebei Province

Applicant after: HEBEI DEGURON ELECTRONIC TECHNOLOGY CO., LTD.

Address before: 050030 Xinhai Tiantian Residential Building, 295 Donggang Road, Yuhua District, Shijiazhuang City, Hebei Province, 15-3-1303

Applicant before: HEBEI DEGURON ELECTRONIC TECHNOLOGY CO., LTD.

Applicant before: Zhejiang Haolan Technology Co., Ltd.

GR01 Patent grant
GR01 Patent grant