CN104092993A - Street lamp controlling and security monitoring device, system and method based on video analysis - Google Patents
Street lamp controlling and security monitoring device, system and method based on video analysis Download PDFInfo
- Publication number
- CN104092993A CN104092993A CN201410336545.XA CN201410336545A CN104092993A CN 104092993 A CN104092993 A CN 104092993A CN 201410336545 A CN201410336545 A CN 201410336545A CN 104092993 A CN104092993 A CN 104092993A
- Authority
- CN
- China
- Prior art keywords
- information
- street lamp
- video
- video information
- public security
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000004458 analytical method Methods 0.000 title claims abstract description 35
- 238000012806 monitoring device Methods 0.000 title claims abstract description 19
- 238000012544 monitoring process Methods 0.000 claims abstract description 28
- 238000012545 processing Methods 0.000 claims abstract description 23
- 230000005540 biological transmission Effects 0.000 claims abstract description 12
- 230000006835 compression Effects 0.000 claims description 14
- 238000007906 compression Methods 0.000 claims description 14
- 238000012549 training Methods 0.000 claims description 9
- 230000003287 optical effect Effects 0.000 claims description 8
- 238000009825 accumulation Methods 0.000 claims description 6
- 238000001514 detection method Methods 0.000 claims description 6
- 230000002776 aggregation Effects 0.000 claims description 3
- 238000004220 aggregation Methods 0.000 claims description 3
- 238000011156 evaluation Methods 0.000 claims description 3
- 238000013209 evaluation strategy Methods 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 3
- 230000004927 fusion Effects 0.000 claims description 3
- 239000002245 particle Substances 0.000 claims description 3
- 230000006399 behavior Effects 0.000 abstract description 18
- 238000005286 illumination Methods 0.000 abstract description 7
- 238000004134 energy conservation Methods 0.000 abstract description 5
- 238000005516 engineering process Methods 0.000 description 7
- 230000002547 anomalous effect Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000001276 controlling effect Effects 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 239000010410 layer Substances 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 206010000117 Abnormal behaviour Diseases 0.000 description 1
- 206010017577 Gait disturbance Diseases 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000002902 bimodal effect Effects 0.000 description 1
- 230000036624 brainpower Effects 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 230000006854 communication Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000000505 pernicious effect Effects 0.000 description 1
- 238000010223 real-time analysis Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000284 resting effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 230000001932 seasonal effect Effects 0.000 description 1
- 239000002356 single layer Substances 0.000 description 1
- 238000012384 transportation and delivery Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Landscapes
- Alarm Systems (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention discloses a street lamp controlling and security monitoring device. The street lamp controlling and security monitoring device comprises a street lamp, a camera, a processor, a controller and a transmission module. The camera is used for collecting video information. The processor is connected with the camera and used for analyzing and processing the video information to obtain traffic information and public security information. The controller is connected with the processor and the street lamp and used for controlling the street lamp according to the traffic information. The transmission module is connected with the processor and used for transmitting the public security information and the video information corresponding to the public security information to a network monitoring center. Compared with the prior art, adjustment of light intensity and setting of the sleep state are carried out on the street lamp through video analysis, so that the purpose of energy conservation is achieved; meanwhile, street lamp illumination and video analysis are combined, events and behaviors are judged through analysis of scene changes, and the events and behaviors can be monitored by the network monitoring center in real time, so that the purpose of improving security monitoring capacity is improved. The invention further discloses a street lamp controlling and security monitoring system and method.
Description
Technical field
The present invention relates to road lamp energy-saving control and technical field of video monitoring, relate more specifically to a kind of street lamp control and security monitoring device, system and method thereof based on video analysis.
Background technology
Along with the continuous expansion of China's city size, in urban lighting system, the quantity of street lamp is also more and more, the ratio that street lighting power consumption accounts for city total electricity consumption also constantly increases, so bring into normal play in function ensureing street lamp, how to reduce to greatest extent the power consumption of street lamp, improve road lamp system intelligent level, become city managers' urgent need to solve the problem.At present, the main method that city street lamp illumination is controlled can be divided into two kinds of time control method and light-operated methods: time control method is taking the time as foundation, control the switch of street lamp according to the time point of darkness and daybreak, but along with seasonal variations, need manual intervention to carry out the adjustment time, and can not automatically adjust according to Changes in weather; Light-operated method is the switch that changes to control street lamp according to the power of illumination, but if street lamp midnight later or vehicle and unfrequented section still keep equal brightness, easily cause waste of energy.Above two kinds of traditional road lamp switch control methods time-consuming taking a lot of work that seem in review on management of modern cities.
Simultaneously, be widely used at present the camera supervised just simple video recording conventionally of general public place, for use in evidence obtaining afterwards, and the basic value (a dynamic and real-time medium) of video monitoring has been lost in such application, and most of so-called intelligent monitoring systems also rest on the conceptive of common Network Video Surveillance, higher to requirement for environmental conditions time, can only analyze comparatively simple abnormal behaviour, not reach the effect that user expects far away.Reaching its maturity of intelligent video analysis technology in recent years, as the line of stumbling passes through, warning, fire alarm etc. are left in crowd density analysis, article, for intelligent monitoring provides technical foundation, they can promote response speed in ensureing monitoring accuracy, simultaneously along with the fast development of wireless technology and related infrastructure and perfect, utilize wireless network to realize street lamp control and video brainpower watch and control is more flexible, can realize round-the-clock street lamp control and intelligent monitoring truly.
The intelligent degree of city street lamp system is not high at present in sum, in the urgent need to the intelligent control mode of one, for example process with Video Analysis Technology and can analyze the flow of the people of street lamp field of illumination, vehicle flowrate and environmental aspect by image, draw relevant information, and automatically regulate road lamp switch time and illumination intensity.Simultaneously, in city, some pernicious public order incidents are easily sent out in the section of some personnel's vehicle rarenesses, and conventional monitoring can leave dead angle or be limited to the lighting environment at night, and city street lamp system is distributed widely in the streets and lanes in city, if intelligent video monitoring and road lamp system are effectively combined, by effect more positive performance, for " safe city " provides sound assurance.
Summary of the invention
Technical problem to be solved by this invention is: a kind of street lamp control and security monitoring device, system and method thereof based on video analysis is provided, by video analysis, street lamp is carried out adjusting and the dormant setting of light power, to reach energy-conservation object, street lighting is combined with video analysis simultaneously, by the analysis of scene change being carried out to event behavior judgement, and this event behavior can be monitored in real time by network monitoring center, to reach the object that promotes security monitoring ability.
For solving the problems of the technologies described above, the technical solution used in the present invention is:
A kind of street lamp control and security monitoring device based on video analysis is provided, comprises:
Street lamp;
Camera, for gathering video information;
Processor, is connected with camera, for video information being carried out to analyzing and processing to obtain transport information and public security information;
Controller, is connected with processor and street lamp, for according to transport information control street lamp; And
Transport module, is connected with processor, for public security information and the corresponding video information of public security information are sent to network monitoring center.
Compared with prior art, supervising device of the present invention is first by camera collection video information, by processor, video information is carried out to analyzing and processing to obtain transport information and public security information again, controller can carry out according to this transport information adjusting and the dormant setting of light power to street lamp afterwards, thereby has reached energy-conservation object; Transport module can be sent to network monitoring center in real time by public security information and the corresponding video information of public security information simultaneously, utilized street lighting to be distributed in widely the situation in the streets and lanes in city, street lighting is combined with video analysis, by the analysis of scene change being carried out to event behavior judgement, this event behavior can be monitored in real time by network monitoring center, thereby win the time, preserved on-the-spot record for the processing of object event, reached the object that promotes security monitoring ability.
Particularly, processor comprises primary processor and from processor, primary processor is connected with camera with from processor, is connected with controller from processor.
Particularly, controller comprises power inverter and variable reactance converter, power inverter be connected from processor and variable reactance converter, variable reactance converter is connected with street lamp.
Particularly, this transport module comprises:
Multiple description coded unit, is connected with processor, for corresponding public security information video information is carried out multiple description coded;
Compression unit, is connected with multiple description coded unit, for adopting MPEG-4 video encoding standard to compress the video information after multiple description coded; And
Transmission unit, is connected with compression unit, for video information and public security information after compression being sent to network monitoring center by 3G network.
In a preferred embodiment of the present invention, this supervising device also comprises:
Optical sensor, for gathering the light signal of current environment;
Signal transmitting device, is connected with optical sensor, for converting light signal to the signal of telecommunication;
A/D converter, is connected with signal transmitting device, for converting the electrical signal to digital signal;
Microprocessor, is connected with A/D converter, for digital signal being processed to the control signal with controlled street lamp opening and closing; And
D/A converter, is connected with microprocessor and controller, for the control signal of controlling street lamp open and close is converted to analog signal, to make controller according to the opening and closing of analog signal control street lamp.
Particularly, public security information comprises the information of fighting, crowd massing information and flame information.
Correspondingly, the present invention also provides a kind of street lamp control and security monitoring system based on video analysis, comprises interconnective street lamp control and security monitoring device and network monitoring center, and wherein this street lamp control and security monitoring device are described above.
Correspondingly, the present invention also provides a kind of street lamp control and security monitoring method based on video analysis, comprising:
Adopt camera collection video information;
Video information is carried out to analyzing and processing to obtain transport information and public security information;
According to transport information control street lamp, or public security information and the corresponding video information of public security information are sent to network monitoring center.
Particularly, transport information is flow of the people/vehicle flowrate information, video information is carried out to analyzing and processing and specifically comprise to obtain transport information:
Extract the sport foreground region of the pedestrian/vehicle of motion by mixed Gaussian background modeling method;
Pedestrian/vehicle classification detector by off-line training carries out target detection to described foreground area, to determine the quantity of pedestrian/vehicle;
Adopting particle filter algorithm to detect target to each follows the tracks of;
The subregion of monitoring according to each camera is cut apart whole guarded region, to count the pedestrian/vehicle flow of each sub regions in arbitrary time period.
Particularly, video information being carried out to analyzing and processing comprises to obtain the information of fighting:
According to the motion vector field of moving target in video information and depth map, extract moving target human body;
Taking the motion vector field of human body as principal character, based on piece statistics accumulation motion vector direction histogram, calculate the entropy of accumulation histogram in a period of time, average motion vector intensity in statistics block;
Formulate motion severe degree Evaluation Strategy according to the depth information of target;
The confusion of combined block and severe degree evaluation score, obtain the fight probability of behavior of this piece;
Judgement is fought the probability of behavior while whether continuing to be greater than certain threshold value;
Confirm that according to judged result the behavior of fighting occurs.
Particularly, video information being carried out to analyzing and processing comprises to obtain crowd massing information:
Extract the moving target in video information according to background modeling;
Then the detector that adopts the HOG feature of linear SVM training human head and shoulder to obtain, detects to find human body (head shoulder) target to moving target;
Estimate the aggregation extent of crowd in guarded region according to human body (head shoulder) target.
Particularly, video information being carried out to analyzing and processing comprises to obtain flame information:
Adopt YCrCb color characteristic to be combined the fusion feature of generation with LBP textural characteristics and carry out the extraction of video frame images Flame place foreground area;
Find roughly flame region edge by Sobel arithmetic operators;
Increase the integrality of flame region by region-growing method;
Linear SVM by off-line training is differentiated candidate's flame region;
Judgement detects whether the frame number of the video image of flame appearance exceedes threshold value;
Confirm that according to judged result flame occurs.
Particularly, public security information and the corresponding video information of public security information being sent to network monitoring center specifically comprises:
Corresponding public security information video information is carried out multiple description coded;
Adopt MPEG-4 video encoding standard to compress the video information after multiple description coded;
By 3G network, video information and public security information after compression are sent to network monitoring center.
Preferably, adopt camera collection video information to comprise before:
Gather the light signal of current environment;
After converting light signal to the signal of telecommunication, convert again digital signal to;
Digital signal is processed with controlled signal;
According to the opening and closing of street lamp described in analog signal control
By following description also by reference to the accompanying drawings, it is more clear that the present invention will become, and these accompanying drawings are used for explaining embodiments of the invention.
Brief description of the drawings
Fig. 1 the present invention is based on the street lamp control of video analysis and the structured flowchart of security monitoring device one embodiment.
Fig. 2 is the structured flowchart of street lamp control of the present invention and another embodiment of security monitoring device.
Fig. 3 is the schematic diagram of Fig. 2 shown device.
Fig. 4 is the schematic diagram of another angle of Fig. 3 shown device.
Fig. 5 is the topology diagram of power inverter shown in Fig. 2.
Fig. 6 is the design principle figure of transport module shown in Fig. 2.
Fig. 7 the present invention is based on the street lamp control of video analysis and the structured flowchart of security monitoring system.
Fig. 8 be in the present invention based on ZigBee the structure chart to transmission of video algorithm and network topology.
Fig. 9 the present invention is based on the street lamp control of video analysis and the flow chart of security monitoring method.
Embodiment
With reference now to accompanying drawing, describe embodiments of the invention, in accompanying drawing, similarly element numbers represents similar element.
Please refer to Fig. 1, the street lamp control and the security monitoring device 100 that the present invention is based on video analysis comprise:
Street lamp 10, it should be noted that, the mentioned street lamp of embodiment of the present invention part is LED street lamp;
Camera 11, for gathering video information;
Processor 12, is connected with camera 10, for video information being carried out to analyzing and processing to obtain transport information and public security information;
Controller 13, is connected with processor 12 and street lamp 10, for according to transport information control street lamp 10; And
Transport module 14, is connected with processor 12, for public security information and the corresponding video information of public security information are sent to network monitoring center.
Compared with prior art, supervising device 100 of the present invention first gathers video information by camera 11, by processor 12, video information is carried out to analyzing and processing to obtain transport information and public security information again, controller 13 can carry out adjusting and the dormant setting of light power to street lamp 10 according to this transport information afterwards, thereby has reached energy-conservation object; Transport module 14 can be sent to network monitoring center in real time by public security information and the corresponding video information of public security information simultaneously, utilized street lighting to be distributed in widely the situation in the streets and lanes in city, street lighting is combined with video analysis, by the analysis of scene change being carried out to event behavior judgement, this event behavior can be monitored in real time by network monitoring center, thereby win the time, preserved on-the-spot record for the processing of object event, reached the object that promotes security monitoring ability.
Please refer to Fig. 2 to Fig. 4, street lamp control and security monitoring device 200 in the present embodiment comprise again:
Optical sensor 25, for gathering the light signal of current environment;
Signal transmitting device 26, is connected with optical sensor 25, for converting light signal to the signal of telecommunication;
A/D converter 27, is connected with signal transmitting device 26, for converting the electrical signal to digital signal;
Microprocessor 28, is connected with A/D converter 27, for digital signal being processed to the control signal with controlled street lamp 20 opening and closing; And
D/A converter 29, is connected with microprocessor 28 and controller 23, for the control signal of controlling street lamp 20 opening and closing is converted to analog signal, to make controller 23 according to the opening and closing of analog signal control street lamp 20;
Street lamp 20;
Camera 21, for gathering video information;
Processor 22, is connected with camera 20, for video information being carried out to analyzing and processing to obtain transport information and public security information; Wherein, transport information is flow of the people/vehicle flowrate information, and public security information comprises the information of fighting, crowd massing information, flame information, vehicle fault detection information and target following;
Controller 23, is connected with processor 22 and street lamp 20, for according to transport information control street lamp 20; And
Transport module 24, is connected with processor 22, for public security information and the corresponding video information of public security information are sent to network monitoring center.
It should be noted that, as shown in Figures 3 and 4, the outward appearance semicircular in shape of this device, middle is camera 20, around have LED street lamp around, all the other equipment are all packaged in inside chassis.The entirety of this device is covered by Transparent lamp shade and is fixed on chassis, Transparent lamp shade can ensure camera 20 can be normally, carry out more clearly the shooting of image.
Particularly, processor 22 comprises primary processor 221 and from processor 222, main control processor 221 is connected with camera 21 with from processor 222, connects from processor 222 and controller 23.
Particularly, controller 23 comprises power inverter 231 and variable reactance converter 232, power inverter 231 be connected from processor 222 and variable reactance converter 232, variable reactance converter 232 is connected with street lamp 20.Wherein, power inverter 231 is made up of electric power device, trigger, input and processor etc.Adjust thyristor control angle and can control the size of variable reactance converter 232 secondary coil electric currents, the terminal voltage of street lamp 20 is changed, thereby change the brightness of illumination of street lamp 20, the topological structure of power inverter 231 as shown in Figure 5.In addition, it should be noted that, the general video information that adopts primary processor 221 to gather camera 21 is processed, need control variable reactance converter 232 from 222 of processors, but in the time that primary processor 221 breaks down, can be by receiver, video information such as wireless sensing R-T units from processor 222, it is processed independently, thereby has improved widely adaptive ability and the robustness of this device.
Particularly, transport module 24 comprises:
Multiple description coded unit 241, is connected with processor 22, for corresponding public security information video information is carried out multiple description coded;
Compression unit 242, is connected with multiple description coded unit 241, for adopting MPEG-4 video encoding standard to compress the video information after multiple description coded; And
Transmission unit 243, is connected with compression unit 242, for video information and public security information after compression being sent to network monitoring center by 3G network.
Please refer to Fig. 6 so that the design of transport module 24 is described, in the drawings, left-half comprises multiple description coded (MDC) unit 241 and compression unit 242, this part is responsible for image to encode, compress to process and Rate Control; And right half part is Zigbee protocol stack, comprise ZigBee upper-layer protocol, media access control sublayer and radio frequency interface.
It should be noted that, in the present embodiment, gather the light signal of current environment by optical sensor 25, by signal transmitting device 26, A/D converter 27, this light signal is converted to the signal of telecommunication and is converted to again digital signal, by microprocessor 28, this digital signal is processed to the control signal with controlled street lamp 20 opening and closing afterwards, after being converted into analog signal by D/A converter 29 again, be sent to controller 23, realize the open and close of street lamp 20 by controller 23.And in the time that optical sensor 25 lost efficacy, can change Artificial Control pattern into, the signal that receives control centre by equipment such as wireless transceivers is to realize the open and close of street lamp 20.
After street lamp 20 is opened, camera 20 meeting Real-time Collection video informations (comprising all video informations of street lamp 20 environment of living in), by processor 22, this video information is processed, just can obtain people/vehicle flowrate information, thereby learn the uninterrupted of pedestrian and vehicle on traffic road now, by control algolithm and power inverter 231 and variable reactance converter 232, also can arrange sleep state thereby dynamically light regulating is strong and weak, and then realize energy-conservation again.Simultaneously, processor 22 is processed this video information, also can obtain public security information (as fights, crowd massing, flame etc.), by transport module 24, corresponding public security information video information is carried out multiple description coded, adopt MPEG-4 video encoding standard to compress the video information after multiple description coded by compression unit 242 again, finally by 3G network, video information and public security information after compression are sent to network monitoring center by transmission unit 243, utilized street lighting to be distributed in widely the situation in the streets and lanes in city, street lighting is combined with video analysis, by the analysis of scene change being carried out to event behavior judgement, and this event behavior can be monitored in real time by network monitoring center, thereby for the time has been won in the processing of object event, preserve on-the-spot record, reach the object that promotes security monitoring ability.
Correspondingly, as shown in Figure 7, the present invention also provides a kind of street lamp control and security monitoring system based on video analysis, comprises street lamp control and security monitoring device and network monitoring center.Wherein, street lamp control and security monitoring device are described above, therefore do not repeat them here.
It should be noted that, in view of Zigbee protocol stack have compact conformation, simple, realize and require the features such as low, can set it as the infrastructure network of slow network in system of the present invention.System of the present invention has adopted the Design Mode of client/server, comprises ZigBee monitor node and network monitoring center, and ZigBee monitor node is above-mentioned mentioned street lamp control and security monitoring device.
According to the difference in functionality of specific implementation, ZigBee-network equipment is divided into again terminal node, routing node and coordinator node three types.ZigBee-network layer is mainly supported three kinds of topological structures such as hub-and-spoke configuration, bunch tree structure and network structure, and the present invention adopts wireless network architecture that ZigBee technology and 3G technology combine as data transmission medium, as shown in Figure 7.Routing node can be arranged on the lamp stand of street lamp, plays road lamp energy-saving and the information relay effect for other nodes controlled.For special " long chain type " network topology of street lamp illumination system, and consider robustness and the reliability of system, the present invention adopts ZigBee-network topological structure, subnet just has built-in redundancy to ensure like this, cannot normally work if there is node to depart from network in network, node data is replaced node to ensure the reliable and stable of system by being routed automatically to one.In the time that a new node adds network, the existence of agreement to Web broadcast oneself simply found in new node utilization, join in wireless network, cognitive this new node of existing node, and reconfigure pellucidly and readjust network and hold this new node.In communication process, each node, according to signal strength signal intensity, throughput, mistake and the time delay received, frequently recalculates optimal path.ZigBee-network telegon is responsible for setting up network and supervising the network, forms a ZigBee substation, and remote control center is connected by 3G network and each ZigBee subnet, forms large Region control network.
Known according to foregoing description, ZigBee monitor node is mainly responsible for gathering vision signal, and it is carried out to real-time analysis.If monitor the generation of object event or certain anomalous event, can start the transfer function of ZigBee monitor node, carry out multiple description coded to video information, then compress by MPEG-4 encoder, and by 3G network, video data transmitting is delivered to network monitoring center and give the alarm and remind the generation of possible anomalous event.The personnel of network monitoring center are by after confirming, centring system starts video store and take appropriate measures, as reported to the police or notice patrol personnel, feed back to signal of node simultaneously, this node is by this information broadcasting being notified the node closing on open real time information and video upload function, so that near the road information situation that event node is can be checked by Surveillance center.If Surveillance center has denied this event, feed back to information of node, node is uploaded Stop message and video, to save bandwidth and storage resources.
It should be noted that, system requirements of the present invention sends by ZigBee-network in real time to the video image collecting, because the data volume of multimedia messages is large and low bandwidth and the unsteadiness of ZigBee mobile radio network, the coding method that transmits data becomes for realization and all vital somethings of delivery quality of transmitting.System of the present invention adopts MPEG-4 video encoding standard to carry out content-based processing to multi-medium data, adopt multiple description coded (MDC) for multi-channel transmission, it provides than the better error correcting capability of single layer coding based on multi-channel transmission; And ZigBee is proposed to new method for designing to transmission of video algorithm and network topology structure, as shown in Figure 8.
Correspondingly, as shown in Figure 9, the present invention also provides a kind of street lamp control and security monitoring method based on video analysis.It should be noted that, in the method, relate to multiple street lamps, the corresponding monitoring subregion of each street lamp, multiple monitoring subregions have formed whole guarded region.
As shown in Figure 9, the method specifically comprises:
S101, the light signal of collection current environment;
S102, converts digital signal to after converting light signal to the signal of telecommunication again;
S103, processes with controlled signal digital signal;
S104, according to the opening and closing of analog signal control street lamp;
S105, adopts camera collection video information;
S106, carries out analyzing and processing to obtain transport information and public security information to video information;
S107, according to transport information control street lamp, or is sent to network monitoring center by public security information and the corresponding video information of public security information.
It should be noted that, transport information is flow of the people/vehicle flowrate information, and public security information comprises the information of fighting, crowd massing information, flame information, vehicle fault detection information and target following etc.
To at length introduce respectively the process that obtains public security information after transport information according to video information below:
(1) flow of the people/vehicle flowrate:
First extract the sport foregrounds such as the pedestrian/vehicle of motion by mixed Gaussian background modeling method, by pedestrian/vehicle classification detector of off-line training, foreground area is carried out to target detection subsequently, determine pedestrian/vehicle etc. the quantity of target, finally adopt particle filter algorithm to detect target to each and follow the tracks of.Simultaneously, according to the camera head monitor subregion of each street lamp, whole guarded region is cut apart, add up the pedestrian/vehicle flow of each sub regions in the time period, and generate corresponding control signal and be transferred to controller: fixed time section one skilled in the art/vehicle flow suitably reduces street lamp brightness at least, otherwise keeps street lamp brightness constant.
(2) detection of fighting:
First according to the motion vector field of moving object in video sequences and depth map, extract moving target human body.Subsequently taking the motion vector field of human body as principal character, based on piece statistics accumulation motion vector direction histogram, calculate the entropy of accumulation histogram in a period of time, average motion vector intensity in statistics block, according to the depth information of target, formulate motion severe degree Evaluation Strategy.Confusion and the severe degree evaluation score of last combined block, obtain the fight probability of behavior of this piece, and elapsed time and spatial summation, in the time that the probability of the behavior of fighting continues to be greater than certain threshold value, confirm the behavior generation of fighting.In the time detecting that the behavior of fighting occurs, generate corresponding control signal and be transferred to controller, reported to the police by controller.
(3) crowd massing detects:
First extract the moving target in video foreground according to background modeling, then the detector that adopts the HOG feature of linear SVM training human head and shoulder to obtain, moving target is detected, find human body (head shoulder) target, finally estimate the aggregation extent of crowd in guarded region.The video image of continuous multiple frames is being carried out after above-mentioned processing, estimating crowd and whether exist the trend of gathering, whether the crowd density in guarded region presents the trend of increase, and generates corresponding early warning signal and be transferred to controller.
(4) flame detects:
First adopt YCrCb color characteristic be combined with LBP textural characteristics produce fusion feature carry out the extraction of video frame images Flame place foreground area, find roughly flame region edge by Sobel arithmetic operators subsequently, increase the integrality of flame region by region-growing method.Finally by the linear SVM of off-line training, candidate's flame region is differentiated, in continuous multiple frames video image, all detected the in the situation that flame occurring, generate early warning signal and be transferred to controller.
To sum up, known according to above description, the present invention proposes LED street lamp and camera is combined into one, the auxiliary light control method of video analysis and the intelligent video monitoring based on ZigBee Wireless Network and transmission method based on light sensor have been proposed, and intelligent video analysis method is applied in street lamp control and supervision of the cities control simultaneously, city street lamp control and the large system of supervision of the cities two are organically combined, improved the efficiency of overall supervision and management.
First this invention controls the switch of street lamp according to the time, after street lamp is opened, analyze current environment by intelligent video information, according to road surface pedestrian's number and vehicle flowrate, automatically reduce street lamp lamplight brightness, long-time unmanned through out-of-date, lighting apparatus enters resting state, has people or vehicle through out-of-date when bimodal camera captures in scene, and system is waken lighting apparatus automatically up, so just realize street lamp Based Intelligent Control, reached the object of a large amount of saves energy.
In addition, the intelligent video analysis of this invention is in the situation that not needing manual intervention, by the analysis of scene change being carried out to the behavior of event judgement, special scenes has been carried out to effective monitoring.In the time detecting that anomalous event occurs, can start transfer function, send real-time information and video to control centre by wireless network, and the generation of the possible anomalous event of prompting that gives the alarm.
In conjunction with most preferred embodiment, invention has been described above, but the present invention is not limited to the embodiment of above announcement, and should contain the various amendments of carrying out according to essence of the present invention, equivalent combinations.
Claims (15)
1. the street lamp control based on video analysis and a security monitoring device, is characterized in that, comprising:
Street lamp;
Camera, for gathering video information;
Processor, is connected with described camera, for described video information being carried out to analyzing and processing to obtain transport information and public security information;
Controller, is connected with described processor and described street lamp, for according to street lamp described in described transport information control; And
Transport module, is connected with described processor, for described public security information and the corresponding described video information of described public security information are sent to network monitoring center.
2. device as claimed in claim 1, is characterized in that, described processor comprises primary processor and from processor, and described primary processor is with described camera and be connected from processor, is describedly connected with described controller from processor.
3. device as claimed in claim 2, is characterized in that, described controller comprises power inverter and variable reactance converter, and described power inverter is connected from processor and variable reactance converter with described, and described variable reactance converter is connected with described street lamp.
4. device as claimed in claim 3, is characterized in that, described transport module comprises:
Multiple description coded unit, is connected with described processor, for corresponding described public security information described video information is carried out multiple description coded;
Compression unit, is connected with described multiple description coded unit, for adopting MPEG-4 video encoding standard to compress the described video information after multiple description coded; And
Transmission unit, is connected with described compression unit, for described video information and described public security information after compression being sent to described network monitoring center by 3G network.
5. the device as described in claim 1 to 4 any one, is characterized in that, also comprises:
Optical sensor, for gathering the light signal of current environment;
Signal transmitting device, is connected with described optical sensor, for converting described light signal to the signal of telecommunication;
A/D converter, is connected with described signal transmitting device, for converting the described signal of telecommunication to digital signal;
Microprocessor, is connected with described A/D converter, for described digital signal is processed to the control signal with controlled described street lamp opening and closing; And
D/A converter, is connected with described microprocessor and controller, for the control signal of controlling described street lamp opening and closing is converted to analog signal, to make described controller according to the opening and closing of street lamp described in described analog signal control.
6. device as claimed in claim 1, is characterized in that, described public security information comprises the information of fighting, crowd massing information and flame information.
7. the street lamp control based on video analysis and a security monitoring system, comprises interconnective street lamp control and security monitoring device and network monitoring center, it is characterized in that, described street lamp control and security monitoring device are as described in claim 1 to 6 any one.
8. the street lamp control based on video analysis and a security monitoring method, is characterized in that, comprising:
Adopt camera collection video information;
Described video information is carried out to analyzing and processing to obtain transport information and public security information;
According to street lamp described in described transport information control, or described public security information and the corresponding described video information of described public security information are sent to network monitoring center.
9. method as claimed in claim 8, is characterized in that, described transport information is flow of the people/vehicle flowrate information, described video information is carried out to analyzing and processing and specifically comprise to obtain described transport information:
Extract the sport foreground region of the pedestrian/vehicle of motion by mixed Gaussian background modeling method;
Pedestrian/vehicle classification detector by off-line training carries out target detection to described foreground area, to determine the quantity of pedestrian/vehicle;
Adopting particle filter algorithm to detect target to each follows the tracks of;
The subregion of monitoring according to camera described in each is cut apart whole guarded region, to count the pedestrian/vehicle flow of each sub regions in arbitrary time period.
10. method as claimed in claim 8, is characterized in that, described public security information comprises the information of fighting, crowd massing information and flame information.
11. methods as claimed in claim 10, is characterized in that, described video information is carried out to analyzing and processing and comprise with the information of fighting described in obtaining:
According to motion vector field and the depth map of moving target in described video information, extract moving target human body;
Taking the motion vector field of human body as principal character, based on piece statistics accumulation motion vector direction histogram, calculate the entropy of accumulation histogram in a period of time, average motion vector intensity in statistics block;
Formulate motion severe degree Evaluation Strategy according to the depth information of target;
The confusion of combined block and severe degree evaluation score, obtain the fight probability of behavior of this piece;
When whether the probability of behavior of fighting described in judgement continues to be greater than certain threshold value;
Confirm that according to judged result the behavior of fighting occurs.
12. methods as claimed in claim 10, is characterized in that, described video information is carried out to analyzing and processing and comprise to obtain described crowd massing information:
Extract the moving target in described video information according to background modeling;
Then the detector that adopts the HOG feature of linear SVM training human head and shoulder to obtain, detects to find human body (head shoulder) target to described moving target;
Estimate the aggregation extent of crowd in guarded region according to described human body (head shoulder) target.
13. methods as claimed in claim 10, is characterized in that, described video information is carried out to analyzing and processing and comprise to obtain described flame information:
Adopt YCrCb color characteristic to be combined the fusion feature of generation with LBP textural characteristics and carry out the extraction of video frame images Flame place foreground area;
Find roughly flame region edge by Sobel arithmetic operators;
Increase the integrality of flame region by region-growing method;
Linear SVM by off-line training is differentiated candidate's flame region;
Judgement detects whether the frame number of the video image of flame appearance exceedes threshold value;
Confirm that according to judged result flame occurs.
14. methods as claimed in claim 8, is characterized in that, described public security information and the corresponding described video information of described public security information are sent to network monitoring center and specifically comprise:
Corresponding described public security information described video information is carried out multiple description coded;
Adopt MPEG-4 video encoding standard to compress the described video information after multiple description coded;
By 3G network, described video information and described public security information after compression are sent to described network monitoring center.
15. methods as described in claim 8-14 any one, is characterized in that, comprise before adopting camera collection video information:
Gather the light signal of current environment;
After converting described light signal to the signal of telecommunication, convert again digital signal to;
Described digital signal is processed with controlled signal;
According to the opening and closing of street lamp described in described analog signal control.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410336545.XA CN104092993A (en) | 2014-07-15 | 2014-07-15 | Street lamp controlling and security monitoring device, system and method based on video analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410336545.XA CN104092993A (en) | 2014-07-15 | 2014-07-15 | Street lamp controlling and security monitoring device, system and method based on video analysis |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104092993A true CN104092993A (en) | 2014-10-08 |
Family
ID=51640670
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410336545.XA Pending CN104092993A (en) | 2014-07-15 | 2014-07-15 | Street lamp controlling and security monitoring device, system and method based on video analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104092993A (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104394637A (en) * | 2014-12-15 | 2015-03-04 | 杭庆永 | Wireless lighting control system based on solar panel |
| CN104411071A (en) * | 2014-12-15 | 2015-03-11 | 杭庆永 | Intelligent lighting control system |
| CN104470161A (en) * | 2015-01-08 | 2015-03-25 | 清华大学苏州汽车研究院（吴江） | Intelligent street lamp control system based on target recognition |
| CN104902235A (en) * | 2015-05-27 | 2015-09-09 | 国网山东临朐县供电公司 | Wireless network communication real-time monitoring system and monitoring method |
| CN105262983A (en) * | 2015-09-15 | 2016-01-20 | 上海图甲信息科技有限公司 | Road monitoring system and method based on internet of lamps |
| CN105323936A (en) * | 2015-12-07 | 2016-02-10 | 济南大学 | Video virtual coil based residential street lamp lighting system |
| CN105516652A (en) * | 2015-11-23 | 2016-04-20 | 杨明 | Intelligent LED street lamp |
| CN105592599A (en) * | 2016-03-27 | 2016-05-18 | 无锡智谷锐拓技术服务有限公司 | Street lamp switch control method based on distribution box |
| CN105657911A (en) * | 2016-03-27 | 2016-06-08 | 无锡智谷锐拓技术服务有限公司 | Streetlamp switch control platform based on distribution box |
| CN105873318A (en) * | 2016-02-04 | 2016-08-17 | 彭冬青 | Streetlamp management system based on control box |
| CN106341666A (en) * | 2016-10-13 | 2017-01-18 | 浪潮（苏州）金融技术服务有限公司 | Method for effectively reducing volume of video file through dynamic area capture technology |
| CN106954036A (en) * | 2016-01-07 | 2017-07-14 | 宁波舜宇光电信息有限公司 | Monitoring system and monitoring street lamp and its monitoring method based on 3D deep visions |
| JP2018106872A (en) * | 2016-12-26 | 2018-07-05 | 京セラ株式会社 | All-night light controller, all-night light control system and all-night light control method |
| CN108307568A (en) * | 2017-01-13 | 2018-07-20 | 上海三思电子工程有限公司 | Control device, wisdom lighting apparatus and intelligent lighting system |
| CN110366005A (en) * | 2019-07-23 | 2019-10-22 | 浙江大华技术股份有限公司 | Sending method and device, the display methods and device of analog composite video signal |
| US10616465B2 (en) | 2015-09-16 | 2020-04-07 | Microsoft Technology Licensing, Llc | Bandwidth efficient video surveillance system |
| CN111699679A (en) * | 2018-04-27 | 2020-09-22 | 上海趋视信息科技有限公司 | Traffic system monitoring and method |
| CN111784964A (en) * | 2020-07-03 | 2020-10-16 | 深圳爱克莱特科技股份有限公司 | Street lamp, street lamp system and street lamp fire alarm method |
| CN112218039A (en) * | 2020-08-21 | 2021-01-12 | 上海光俊科技股份有限公司 | Comprehensive pole intelligent management system and method based on Internet of things |
| CN113177712A (en) * | 2021-04-29 | 2021-07-27 | 重庆天智慧启科技有限公司 | Intelligent planning system for community patrol |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101770644A (en) * | 2010-01-19 | 2010-07-07 | 浙江林学院 | Forest-fire remote video monitoring firework identification method |
| CN201623802U (en) * | 2010-01-05 | 2010-11-03 | 武汉理工大学 | A remote viewing control system for street lamps |
| CN201629817U (en) * | 2009-12-11 | 2010-11-10 | 上海弘视通信技术有限公司 | Fighting detection system capable of carrying out audio and video combination analysis |
| CN102202443A (en) * | 2010-03-25 | 2011-09-28 | 鸿富锦精密工业（深圳）有限公司 | Street lamp power management system and method thereof |
| CN102665365A (en) * | 2012-05-29 | 2012-09-12 | 广州中国科学院软件应用技术研究所 | Coming vehicle video detection based streetlamp control and management system |
| CN102665071A (en) * | 2012-05-14 | 2012-09-12 | 安徽三联交通应用技术股份有限公司 | Intelligent processing and search method for social security video monitoring images |
| CN102867386A (en) * | 2012-09-10 | 2013-01-09 | 南京恩博科技有限公司 | Intelligent video analysis-based forest smoke and fire detection method and special system thereof |
| WO2013005127A1 (en) * | 2011-07-01 | 2013-01-10 | Koninklijke Philips Electronics N.V. | Lighting requirements generation system and method |
| CN203136283U (en) * | 2013-03-25 | 2013-08-14 | 常州新区爱立德电子有限公司 | Image identification-based controller for adjusting LED street lamp brightness |
| CN103428407A (en) * | 2012-05-25 | 2013-12-04 | 信帧电子技术（北京）有限公司 | Method for detecting fighting in video |
| CN103702485A (en) * | 2013-12-23 | 2014-04-02 | 北京光桥科技股份有限公司 | Intelligent video induction LED (Light Emitting Diode) roadway lighting system |
-
2014
- 2014-07-15 CN CN201410336545.XA patent/CN104092993A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201629817U (en) * | 2009-12-11 | 2010-11-10 | 上海弘视通信技术有限公司 | Fighting detection system capable of carrying out audio and video combination analysis |
| CN201623802U (en) * | 2010-01-05 | 2010-11-03 | 武汉理工大学 | A remote viewing control system for street lamps |
| CN101770644A (en) * | 2010-01-19 | 2010-07-07 | 浙江林学院 | Forest-fire remote video monitoring firework identification method |
| CN102202443A (en) * | 2010-03-25 | 2011-09-28 | 鸿富锦精密工业（深圳）有限公司 | Street lamp power management system and method thereof |
| WO2013005127A1 (en) * | 2011-07-01 | 2013-01-10 | Koninklijke Philips Electronics N.V. | Lighting requirements generation system and method |
| CN102665071A (en) * | 2012-05-14 | 2012-09-12 | 安徽三联交通应用技术股份有限公司 | Intelligent processing and search method for social security video monitoring images |
| CN103428407A (en) * | 2012-05-25 | 2013-12-04 | 信帧电子技术（北京）有限公司 | Method for detecting fighting in video |
| CN102665365A (en) * | 2012-05-29 | 2012-09-12 | 广州中国科学院软件应用技术研究所 | Coming vehicle video detection based streetlamp control and management system |
| CN102867386A (en) * | 2012-09-10 | 2013-01-09 | 南京恩博科技有限公司 | Intelligent video analysis-based forest smoke and fire detection method and special system thereof |
| CN203136283U (en) * | 2013-03-25 | 2013-08-14 | 常州新区爱立德电子有限公司 | Image identification-based controller for adjusting LED street lamp brightness |
| CN103702485A (en) * | 2013-12-23 | 2014-04-02 | 北京光桥科技股份有限公司 | Intelligent video induction LED (Light Emitting Diode) roadway lighting system |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104411071A (en) * | 2014-12-15 | 2015-03-11 | 杭庆永 | Intelligent lighting control system |
| CN104394637A (en) * | 2014-12-15 | 2015-03-04 | 杭庆永 | Wireless lighting control system based on solar panel |
| CN104470161B (en) * | 2015-01-08 | 2017-01-25 | 清华大学苏州汽车研究院（吴江） | Intelligent street lamp control system based on target recognition |
| CN104470161A (en) * | 2015-01-08 | 2015-03-25 | 清华大学苏州汽车研究院（吴江） | Intelligent street lamp control system based on target recognition |
| CN104902235A (en) * | 2015-05-27 | 2015-09-09 | 国网山东临朐县供电公司 | Wireless network communication real-time monitoring system and monitoring method |
| CN105262983A (en) * | 2015-09-15 | 2016-01-20 | 上海图甲信息科技有限公司 | Road monitoring system and method based on internet of lamps |
| US10616465B2 (en) | 2015-09-16 | 2020-04-07 | Microsoft Technology Licensing, Llc | Bandwidth efficient video surveillance system |
| CN105516652A (en) * | 2015-11-23 | 2016-04-20 | 杨明 | Intelligent LED street lamp |
| CN105323936A (en) * | 2015-12-07 | 2016-02-10 | 济南大学 | Video virtual coil based residential street lamp lighting system |
| CN106954036A (en) * | 2016-01-07 | 2017-07-14 | 宁波舜宇光电信息有限公司 | Monitoring system and monitoring street lamp and its monitoring method based on 3D deep visions |
| CN105873318A (en) * | 2016-02-04 | 2016-08-17 | 彭冬青 | Streetlamp management system based on control box |
| CN105592599A (en) * | 2016-03-27 | 2016-05-18 | 无锡智谷锐拓技术服务有限公司 | Street lamp switch control method based on distribution box |
| CN105657911A (en) * | 2016-03-27 | 2016-06-08 | 无锡智谷锐拓技术服务有限公司 | Streetlamp switch control platform based on distribution box |
| CN106341666A (en) * | 2016-10-13 | 2017-01-18 | 浪潮（苏州）金融技术服务有限公司 | Method for effectively reducing volume of video file through dynamic area capture technology |
| JP2018106872A (en) * | 2016-12-26 | 2018-07-05 | 京セラ株式会社 | All-night light controller, all-night light control system and all-night light control method |
| CN108307568A (en) * | 2017-01-13 | 2018-07-20 | 上海三思电子工程有限公司 | Control device, wisdom lighting apparatus and intelligent lighting system |
| CN111699679A (en) * | 2018-04-27 | 2020-09-22 | 上海趋视信息科技有限公司 | Traffic system monitoring and method |
| US11689697B2 (en) | 2018-04-27 | 2023-06-27 | Shanghai Truthvision Information Technology Co., Ltd. | System and method for traffic surveillance |
| CN111699679B (en) * | 2018-04-27 | 2023-08-01 | 上海趋视信息科技有限公司 | Traffic system monitoring and method |
| CN110366005A (en) * | 2019-07-23 | 2019-10-22 | 浙江大华技术股份有限公司 | Sending method and device, the display methods and device of analog composite video signal |
| WO2021012603A1 (en) * | 2019-07-23 | 2021-01-28 | Zhejiang Xinsheng Electronic Technology Co., Ltd. | Surveillance systems and methods |
| CN111784964A (en) * | 2020-07-03 | 2020-10-16 | 深圳爱克莱特科技股份有限公司 | Street lamp, street lamp system and street lamp fire alarm method |
| CN112218039A (en) * | 2020-08-21 | 2021-01-12 | 上海光俊科技股份有限公司 | Comprehensive pole intelligent management system and method based on Internet of things |
| CN113177712A (en) * | 2021-04-29 | 2021-07-27 | 重庆天智慧启科技有限公司 | Intelligent planning system for community patrol |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104092993A (en) | Street lamp controlling and security monitoring device, system and method based on video analysis | |
| CN103108159B (en) | Electric power intelligent video analyzing and monitoring system and method | |
| CN204717540U (en) | A kind of intelligent road-lamp and the Radio Network System set up by it | |
| CN206004950U (en) | A kind of smart city street lamp remote control system | |
| CN207820108U (en) | A kind of transmission line long-distance video monitoring system | |
| CN103957387B (en) | A kind of security protection channel sundries detection method and detection system | |
| CN103945179A (en) | Intelligent video monitoring system based on distributed wireless sensor network | |
| CN102638013A (en) | Target image identification transmission line state monitoring system based on visual attention mechanism | |
| CN106686808A (en) | Method and device for controlling street lighting | |
| CN102255385B (en) | Fire protection, perimeter protection and video monitoring linkage system for unattended transformer substation | |
| CN204442792U (en) | The Street Lamp Monitor System of multisensor | |
| CN103297754A (en) | Monitoring video self-adaption interesting area coding system | |
| CN205281720U (en) | Intelligence household security service robot system | |
| CN103281518B (en) | A kind of multi-network all-weather intelligent video supervisory control system | |
| CN107483536A (en) | A smart city IoT platform control system based on NB-IOT | |
| CN111131794A (en) | Edge intelligent terminal equipment with video AI analysis and 5G communication | |
| CN116362445B (en) | Multi-terminal-oriented intelligent city digital twin map management system | |
| CN108983718A (en) | A kind of intelligent lavatory management method based on the NB-IoT communication technology | |
| CN101789953A (en) | Remote monitoring node and management system in mobile communication system | |
| CN108200662A (en) | Urban track traffic civil engineering facility intelligent monitor system | |
| CN106657297A (en) | A real-time monitoring method and monitoring system for exhaust gas purification based on ARM | |
| CN201797552U (en) | Audible and visual alarm camera | |
| CN106657889A (en) | Intelligent dynamic environment and video monitoring cloud service system based on Internet of things | |
| CN203745933U (en) | Electricity consumption monitoring system | |
| CN208384752U (en) | A kind of community security system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20141008 |
|
| RJ01 | Rejection of invention patent application after publication |