CN101574566A - Monocular vision technique based fire monitor control method for adjusting relative positions of fire point and water-drop point - Google Patents
Monocular vision technique based fire monitor control method for adjusting relative positions of fire point and water-drop point Download PDFInfo
- Publication number
- CN101574566A CN101574566A CNA2009100330320A CN200910033032A CN101574566A CN 101574566 A CN101574566 A CN 101574566A CN A2009100330320 A CNA2009100330320 A CN A2009100330320A CN 200910033032 A CN200910033032 A CN 200910033032A CN 101574566 A CN101574566 A CN 101574566A
- Authority
- CN
- China
- Prior art keywords
- water
- fire
- point
- flame
- water channel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 24
- 239000007921 spray Substances 0.000 claims description 8
- 238000009434 installation Methods 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 abstract description 19
- 238000005516 engineering process Methods 0.000 description 8
- 238000007619 statistical method Methods 0.000 description 7
- 238000004458 analytical method Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000000630 rising effect Effects 0.000 description 4
- 238000000605 extraction Methods 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 230000008447 perception Effects 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 241000876443 Varanus salvator Species 0.000 description 1
- 230000008485 antagonism Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001066 destructive effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000002360 explosive Substances 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Landscapes
- Fire-Detection Mechanisms (AREA)
Abstract
The invention relates to a monocular vision technique based fire monitor control method for adjusting relative positions of a fire point and a water-drop point, which belongs to the technical field of fire monitoring and self-extinguishing. By using a method for controlling a pitching angle and a horizontal angle for a plurality of times respectively in sequence, the fire monitor control method solves the problem of adjusting the relative positions of the fire point and the water-drop point in a three-dimensional space by using a two-dimensional image so that the water-drop point of the fire monitor can track the changes of the position of the fire point in real time so as to provide a condition for the self-extinguishing in a large space.
Description
Technical field
Of the present invention based on the fire point of monocular vision technique and the fire monitor control method of water-drop point relative position adjustment, belong to fire monitoring and automatic fire extinguishing technology field.
Background technology
Fire is one of modal major disaster in the human society, and according to the fire statistics data of the recent years U.S., Japan and European Union, the fire direct economic loss of developed country accounts for 0.2%～0.3% of gross national product.The fire fatality rate of the U.S. is 0.0016%, and European Union is 0.0013%, and Japan is 0.0012%, comprising many fire disasters.For example nineteen ninety-five Japan the fire that causes of the big earthquakes in Osaka and Kobe, dead people more than 5200.The fire that takes place in the Holy City, Saudi Meccah during in the Islam Ramadan, 1997, dead people more than 1000.In June, 2002, the forest fire in U.S. Arizona state was out of hand, made the astronaut on the space shuttle also startling.In recent years, along with the progress of science and technology and the development of society, China is obtaining gratifying achievement aspect the antagonism fire.But simultaneous quickening of urbanization process and explosive growth of population, the frequency of China's fire, the loss that causes is in rising trend.According to statistics, 1997, surplus the breaking out of fire 14 ten thousand altogether in the whole nation, dead 2722 people hinder 4930 people, 15.4 hundred million yuan of direct property loss.88 of the above or wildfire of direct property loss more than 1,000,000 yuan in above or disaster-stricken 50 families of wherein once dead 10 people.
Countless examples prove that fire is that modern civilization society has one of disaster phenomenon of destructive power most.Therefore, the loss that fire be caused drops to minimum, and one of wherein effective method is exactly monitoring in real time, and before spreading it is put out.Therefore, all carried out the research of intelligent fire-pretection system both at home and abroad one after another.But the research of this respect at present mainly is the automatic monitoring of fire and mainly is at room area, sees patent 200710044936.Also few for the research of putting out automatically after the outdoor big regional fire discovery.In fact, in many outdoor large space environment, as chemical industry unit, oil tank and some fire prevention emphasis are to the real-time monitoring of fire and put out automatically and have sizable demand.One of difficulty of outdoor large space automatic fire protection system is: the water column track (hereinafter referred to as water channel) that fire monitor sprays is the pinpoint problem in position of water channel end (hereinafter referred to as water-drop point) particularly.Present many processing methods are at first to find fiery point, adopt the formula Calculation Method to draw the water column track of requirement then, control fire monitor in view of the above and carry out fire-fighting work.Under the large space environment, the position of point of origin and the distance of fire monitor are often at tens meters even reach more than hundred meters.Under remote range situation, the locus of fire monitor water-drop point is difficult to determine that particularly it also is subjected to Effect of Environmental such as wind direction easily, therefore, only according to fiery dot position information control fire monitor, is difficult to guarantee that the fire monitor water column beats on fire point.
Summary of the invention
The fire monitor control method that the object of the present invention is to provide a kind of fire point based on monocular vision technique and water-drop point relative position to adjust makes the variation that the fire monitor water-drop point can real-time tracking fire point position, for large-space automatic fire extinguishing provides condition.
A kind of fire disaster intelligently based on computer vision technique is surveyed, is put out method, it is characterized in that: may further comprise the steps:
(1), utilize the substation control module to carry out fire monitoring:
The control The Cloud Terrace moves, and drives thermal camera and moves, and its viewing area is scanned;
The control video capture processor carries out the real-time collection and the analysis of infrared image, the doubtful fiery point of the method rapid extraction that passing threshold is cut apart;
To doubtful fiery point, by distribution of color characteristic, flame variation characteristic, the area of flame of flame spread the body variation characteristic of rising characteristic, flame, the edge variation characteristic of flame is further carried out the judgement of flame;
(2), under the situation of confirming to have flame to exist, by the binocular parallax technology, flame is carried out the estimation of locus;
(3), open rule according to fire monitor, definite fire water monitor of being opened;
(4), utilize computer vision technique or image processing techniques to obtain the position of fire monitor shower end in ccd image, i.e. water-drop point position;
(5), according to water-drop point on the ccd image and flame relative position, adjust fire monitor, realize the closed-loop control of fire monitor is put out a fire;
(6), according to the surveillance map picture, judge that fire extinguishing finishes, and closes fire monitor.
System is surveyed, put out to a kind of fire disaster intelligently based on computer vision technique, it is characterized in that: comprising: server, connect into some substations of latticed form with server by bus, the substation comprises: fire monitor, can according to the relative position deviation of fire monitor water channel water-drop point and flame adjust the fire monitor angle of water embedded type control module, can control The Cloud Terrace, be installed on and can control a pair of on the The Cloud Terrace and be used for flame and monitoring of fire-fighting water channel and the two waveband ccd video camera of locating.
The recognition methods of a kind of fire monitor water channel and water channel end is characterized in that may further comprise the steps:
(1), be the fire monitor position from the water channel starting point, along fire monitor water outlet direction, hydrographic(al) map is pursued column scan as pixel column, seek every pixel column water channel track central point, the method that the searching of every pixel column water channel track central point adopts gray value statistic law and trajectory predictions method to combine, concrete grammar is as follows:
By determining next pixel column water channel orbit centre point position range of section water channel trajectory predictions;
Find this pixel column water channel track central point by the gray value statistical method simultaneously;
When central spot that the gray value statistical method finds in the central point error range that the trajectory predictions method obtains, then the central point that finds with this gray value statistical method is as this pixel column water channel track center;
When central point that the gray value statistical method finds not in the central point error range that the trajectory predictions method obtains, then cast out this time Search Results, continue to seek next pixel column water channel track central point.
(2), all pixel column water channel track central points are connected into the water channel curve, when continuous 10 row do not find the track central point, judge that then the pixel column water channel track central point that finds for the last time is the water channel terminal position.
A kind of based on the fire point of monocular vision technique and the fire monitor control method of water-drop point relative position adjustment, it is characterized in that may further comprise the steps:
(1), after finding the fire point, utilize the binocular parallax principle that the image of two waveband video camera is handled, obtain the depth distance information of flame, again in conjunction with fire monitor installation position information, utilize preset rules to determine the fire monitor water outlet initial water straight angle and the angle of pitch, and start the fire monitor water spray;
(2), utilize the common CCD camera to obtain the two dimensional image that has flame and water channel simultaneously concurrently in real time;
The differential location relation that (3), on two dimensional image, can only reflect fire monitor water channel water-drop point and flame, and can not reflect clearly that water channel implements under the situation about concerning about point and flame, concern according to far and near position, the fire monitor water outlet position of two dimensional image reflection apart from water channel water-drop point and flame, at first make water-drop point connect the periareon by the control fire monitor angle of pitch, concrete mode is: adjust the fire monitor angle of pitch and make the water channel starting point satisfy default error allowed band to water-drop point air line distance and water channel starting point to fire point air line distance difference;
(4), after angle of pitch adjustment is finished, the relative water channel starting point with flame location of water channel water-drop point can be considered equidistant, also makes simultaneously the pass, position, the left and right sides of water channel water-drop point and flame tie up in the two dimensional image and clearly reflects; Then further utilize position, the left and right sides relation of the water channel water-drop point and the flame of two dimensional image reflection, continuation makes water-drop point further connect the periareon by control fire monitor horizontal angle, concrete mode is: adjust the fire monitor horizontal angle and make the water channel starting point satisfy default error allowed band to the angle of water-drop point line and water channel starting point and fire point line, then the fire monitor adjustment is finished;
(5), with the change of flame kernel point position, repeat to adjust the angle of pitch and the horizontal angle of fire monitor, water-drop point can be followed the tracks of drops on the flame, put out until flame.
The present invention has following technique effect:
1, forms networked fire monitoring and fire extinguishing system by server and a plurality of substation, increased the zone of fire monitoring and fire extinguishing greatly, can realize the fire monitoring and the fire extinguishing in outdoor big zone;
2, utilize the location of binocular parallax realization by the two waveband ccd video camera, improved the accuracy of flame space location, for quick extinguishing provides condition to flame;
3, putting out of the monitoring of fire and flame is integrated in the middle of the system, improved the fire extinguishing real-time, can prevent spreading of flame effectively;
4, monitor the relative position of fire monitor water channel (water-drop point) and flame by computer vision in real time, realize the real-time closed-loop control of fire monitor, improved the accuracy of water cannon fire extinguishing;
5, the method for utilizing the gray-scale statistical method to combine with the trajectory predictions method from the fire monitor delivery port, handles image by the method for track following and to find water-drop point, overcome the shortcoming that the normal mode recognition methods can only be discerned the relative fixed shaped objects.For the closed-loop control of the needed fire monitor of large space fire monitor self-extinguishing provides condition.
6, based on the fire monitor control method of the fire point of monocular vision technique and the adjustment of water-drop point relative position by to the angle of pitch and horizontal angle according to the order of sequence respectively repeatedly the method for control solved the problem of utilizing two dimensional image to realize three dimensions moderate heat point and the adjustment of water-drop point relative position, make the fire monitor water-drop point can real-time tracking the variation of fire point position, for large-space automatic fire extinguishing provides condition.
Description of drawings
Fig. 1 fire disaster intelligently is surveyed and is put out the overall system flow chart.
Fig. 2 binocular imaging schematic diagram and x-z plane figure.Fig. 2 (a) is the binocular imaging schematic diagram, and Fig. 2 (b) is the x-z plane figure.
Fig. 3 water channel, fire point relative position simplified schematic diagram.
Rear channel, fire point position simplified schematic diagram are finished in the control of Fig. 4 water cannon angle of pitch.
Number in the figure title: 1. simulated fire point; 2. simulate fire monitor water channel curve; 3. initial water channel water-drop point; 4. water channel air line distance; 5. the water channel starting point is to fire point distance; 6. the fire monitor angle of pitch is adjusted the rear channel curve; 7. water-drop point after the adjustment of the fire monitor angle of pitch; 8. the fire monitor horizontal angle is adjusted direction; 9. starting point is put distance to fire after the adjustment of the fire monitor angle of pitch.
The specific embodiment
These two parts of the monitoring of fire and fire-fighting fire extinguishing all belong to the category of fire-fighting, and are associated each other.Therefore, the present invention utilizes computer vision technique that both are integrated into a system, realizes the closed-loop control of fire-fighting fire extinguishing, realizes intelligentized fire monitoring and fire extinguishing.
System is made up of a computer and some substations, by computer realization centralized management and distributed control.Connect by bus (or network) between computer and the substation, realize sharing of information.The quantity of substation and position be according to the characteristics of object in the area in fire monitoring zone and the zone (as equipment etc.) itself, and the easy position in point of origin No Fire Area territory.Also can increase the substation as required for the No Fire Area territory.Each substation is a control centre with the MPU flush bonding module, has autonomous control ability.Each substation can be controlled that fire monitor, one can be controlled The Cloud Terrace and an embedded type control module is formed by a pair of two waveband ccd video camera, one.Wherein the two waveband ccd video camera is formed comprising a thermal camera (by common CCD camera+infrared fileter) and a common CCD camera.The two waveband video camera is installed in and can controls on the The Cloud Terrace.Based on the embedded sub-station control module (hereinafter to be referred as the substation control module) of MPU mainly be responsible for two video cameras of control, control The Cloud Terrace, video acquisition, graphical analysis, fire monitor control and with the communication of server, carry out the work such as instruction of host computer server.
The monitoring of fire is finishing under main control in the substation control module mainly.The step that the substation control module is carried out fire monitoring is: 1, the control The Cloud Terrace moves, and thermal camera scans its viewing area; 2, the control video capture processor carries out the real-time collection and the analysis of infrared image, the doubtful fiery point of the method rapid extraction that passing threshold is cut apart; 3, in case find doubtful fiery point, by distribution of color characteristic, flame variation characteristic, the area of flame of flame spread the body variation characteristic of rising characteristic, flame, the edge variation characteristic of flame is further carried out the judgement of flame; 4, confirming have under the situation of flame existence, start another CCD common camera.The two waveband video camera carries out the estimation of locus to by the binocular parallax technology to flame.
Control module will find that flame warning message, area of flame and spatial positional information are uploaded to server by bus, and server is formulated the fire-fighting scheme by analysis automatically.And realize following operation: 1, start the interlock telephone call; 2, information on fire and point of origin positional information are sent to all substations, make each substation increase flame scanning density and frequency; 3,, will find that the substation of controlling under the fire monitor around the substation of flame and the flame forms fire extinguishing group, realizes centralized management and distributed control according to the fire-fighting scheme of formulating.
Closed-loop control is carried out to the fire monitor angle of water in fire extinguishing group substation under the centralized management pattern of server.Each substation starts the fire monitor water spray according to the default fire monitor angle of water of the spatial positional information of flame.The relative position of each water channel water-drop point and flame in the substation analysis surveillance map picture utilizes the fire-fighting water channel tracing flame control method of monocular vision location to adjust fire monitor control angle in real time, realizes that fire monitor puts out the tracking of flame.
The overview flow chart of system as shown in Figure 1.Real-time fire monitoring is realized in each substation.If find the condition of a fire, formulate the fire extinguishing scheme by server, specify the fire extinguishing substation.Closed-loop control is carried out to fire monitor in the fire extinguishing substation, realizes the tracking of fire monitor water channel water-drop point to flame, realizes self-extinguishing.Key technology wherein has:
One, fire monitoring and location
The monitoring of fire mainly drives thermal camera by substation control module control The Cloud Terrace and moves, and thermal camera scans its viewing area.The substation control module is controlled real-time collection and the analysis that video capture processor carries out infrared image again.The doubtful fiery point of the method rapid extraction that passing threshold is cut apart.In case find doubtful fiery point, further determine whether to be flame, (seeing patent 200810124425), concrete steps are: the principle that give prominence to according to the red component of flame infrared image infrared image (1), utilize computer system that infrared image is carried out handling based on the gray processing of red component, and the flame reference gray level value of getting fire carries out binary-state threshold to image and cuts apart as threshold value, extracts doubtful image and carries out filtering and handle; (2) utilize computer system that doubtful image is further analyzed, the distribution of color characteristic criterion, flame image variation characteristic criterion, the area of flame that obtain flame spread five criterions of body variation characteristic criterion of rising characteristic criterion, flame image circularity criterion, flame; (3) utilizing neutral net is input with criterion 1～criterion 5, comprehensively judges, obtains the whether final judgement of fire.Confirming have under the situation of flame existence, starting the logical ccd video camera of another Daepori.The a pair of two waveband video camera of being made up of thermal camera and common CCD camera passes through the binocular stereo vision ranging technology, flame is carried out the estimation of locus.
The binocular stereo vision ranging technology has the measurement of feeling to realize the solid space degree of depth of the degree of depth or distance when to be that simulation is biological observe object simultaneously with two eyes.Calculate hypothesis according to depth perception, people's depth perception ability is relatively calculated and is generated by parallax, and the calculating of parallax is based on the two-dimensional projection image information of resulting two eyes retinas of left and right two and half brains and implements.Stereoscopic vision just is being based on depth perception and is calculating hypothesis, goes to observe Same Scene from two or more viewpoints, obtains one group of image under different visual angles, then by the parallax between respective pixel in the different images, infers the position of target object in the scene.
The binocular imaging schematic diagram as shown in Figure 2, spatial point P (x among Fig. 2 (a)
w, y
w, z
w) be respectively P at the subpoint from two width of cloth images that diverse location obtained
lAnd P
r, the line of left and right cameras focus center line is to be made as x axle, P
lAnd P
rProjection on the x axle is respectively x
PlAnd x
PrThe optical axis of two video cameras is parallel, and is positioned on the x-z plane.Under this condition, video camera is called as the parallel alignment state.The z axle is parallel with the optical axis of two video cameras, and two focus of camera are f, and the distance between them is d.
Fig. 2 (b) is the perspective view of P point on the x-z plane, in the coordinate system shown in the figure, and spatial point P (x
w, y
w, z
w) projection coordinate on the x-z plane is (x
w, z
w), its image coordinate on the image of the left and right sides is (x
Pl, y
Pl), (x
Pr, y
Pr), as seen following relation is arranged:
Then binocular stereo vision records object and from the depth distance of video camera is: z
w-f
The projection of object on x, y direction of principal axis is respectively:
Utilize formula (1)～(3) can realize the space orientation of fire.
Two, fire monitor track and water-drop point are confirmed
Automatic fire extinguishing system of the present invention is that the relative position with fire monitor water-drop point and flame serves as according to fire monitor being carried out real-time closed-loop control.Therefore, the positioning accuracy of water-drop point directly has influence on the accuracy of fire extinguishing.But the water-drop point image of the fire monitor that obtains by ccd video camera is subjected to the influence of background image, and splashes the influence that spray is subjected to multiple uncertain factor.Therefore the water-drop point image is difficult to discern judgement with the method for common image model identification.
Because the installation site of fire monitor is fixed, therefore, the position of fire monitor in the image that ccd video camera obtains is known.It is the fire monitor position that the present invention proposes from the water channel starting point, and the method for utilizing water channel to follow the tracks of is carried out water-drop point identification.So the fire monitor track determine come down to according to the water channel starting point, seeking water channel track and track terminating point is the problem of water-drop point.
Equally, hydrographic(al) map looks like to be subjected to the influence of factors such as wind direction, fire monitor water spray angle, water cannon pressure, and its water channel picture shape also has very big uncertainty.Simultaneously, the gray value of water channel can be subjected to the influence of illumination and shooting angle, changes very big.Therefore, the method for utilizing threshold value to cut apart merely also is difficult to obtain water channel.But, in fact from seeing from the ccd image that obtains that visually water outlet part and background image have tangible border.
The water channel tracing is set out with the fire monitor position, along the water outlet direction, the image pixel row by column scan, is sought every pixel column water channel track central point.Water channel central point with all row connects into the water channel curve again, is defined as water channel water-drop point position with water channel curve final position.Therefore, the key of water channel identification is the searching of each pixel column of image for the hydrographic(al) map picture.The present invention utilizes gray value statistic law and two methods of trajectory predictions to combine in the water channel search to judge.Utilize earlier and determined that the water channel track finds water channel position in the next row by the method for gray value statistics, again by the predicted position of fixed this row water channel of water channel trajectory predictions.If the water channel predicted position of these row and location searching in certain error range, are then determined this row water channel, otherwise abandoned this row water channel position, search next column water channel track position with same method.If continuous 10 row be can not determine water channel and are thought that then the water channel track stops.
Suppose to determine i water channel tracing point, track central point pixel coordinate is respectively (x
1, y
1)～(x
i, y
i), the central point gray scale of i pixel column is G
i, channel width is k
iThen searching of gray-scale statistical method and trajectory predictions method predict that the method for next track central point is:
1, gray-scale statistical method
Information according to i row track central point scans the i+1 row, and the read pixel point coordinates is (x
i+ 1, y
i-k
i/ 2)～(x
i+ 1, y
i+ k
i/ 2) gray value is respectively G (x
i+ 1, y
i-k
i/ 2), G (x
i+ 1, y
i-k
i/ 2+1) ... G (x
i+ 1, y
i+ k
i/ 2).
Find the maximum of i+1 row gray scale to be:
Max (G (x
i+ 1, y
i-k
i/ 2), G (x
i+ 1, y
i-k
i/ 2+1) ..., G (x
i+ 1, y
i+ k
i/ 2-1), G (x
i+ 1, y
i+ k
i/ 2)), and the coordinate of maximum of points correspondence be (x
I+1, y '
I+1).For the width of determining that water channel lists at i+1, with (x
I+1, y '
I+1) be the center, to both direction, i.e. (x
I+1, y
I+1) mouthful (x
I+1, y
I+1-k
i/ 2-10) and (x
I+1, y
I+1) mouthful (x
I+1, y
I+1+ k
i/ 2+10) seek gray scale catastrophe point, the i.e. border of water channel.Because the water channel gray scale is gradual change, therefore list, from (x at i+1
I+1, y
I+1) gray scale is successively decreased on the both direction of y, sudden change can appear in gray value when to the water channel border, is the water channel border.
With the y positive direction is example, i.e. 3m1, m1 ∈ (y
I+1, y
I+1+ k
i+ 10], m1 ∈ Z is from (x
I+1, y
I+1+ 1)～(x
I+1, y
M1-1) judge non-boundary point one by one, work as y
M1Satisfy:
G (x
I+1, y
m)-G (x
I+1, y
M1-1)＞0, | G (x
I+1, y
M1)-G (x
I+1, y
M1-1) |＞| G (x
I+1, y
M1-1)-G (x
I+1, y
M1-2) | or G (x
I+1, y
m)-G (x
I+1, y
M1-1)＜0, | G (x
I+1, y
M1)-G (x
I+1, y
M1-1) |＞3|G (x
I+1, y
M1-1)-G (x
I+1, y
M1-2) | then determine (x
I+1, y
M1) be the coboundary of i+1 pixel column, determine that in like manner lower boundary is (x
I+1, y
M2).Then the width that lists of i+1 is m2-m1.
2, trajectory predictions method
Determined i water channel tracing point, track central point pixel coordinate is respectively (x
1, y
1)～(x
i, y
i), utilize this i point to carry out the curve match of water channel, with x by least square method
I+1Bring matched curve into, obtain the water channel trajectory predictions value y of i+1 point
I+1
Three, control based on the fire monitor of monocular image
When the system discovery fire, behind the startup fire monitor, it is most important for the efficient of putting out a fire whether the water channel track that water cannon sprays can be got on the point of origin.The present invention regulates fire monitor according to the flame of Image Acquisition and the relative position of water channel water-drop point, overlaps until both.
After finding the fire point, the depth distance information of the flame that obtains according to the imagery exploitation binocular parallax principle of two waveband video camera is provided with the fire monitor initial parameter and sprays.The image that the common CCD camera obtains has the image of flame and water channel simultaneously concurrently.Yet the image that common CCD camera obtains is a two dimensional image, and its reaction is three dimensions.Can't clearly judge the clear and definite relative position of water channel water-drop point and flame in the three dimensions by two dimensional image.Implement the position of putting with flame from the water channel that image reflects, the control of the fire monitor angle of pitch is clear and definite.But the control of its horizontal angle is difficult to determine, as shown in Figure 3.
Therefore, the present invention proposes the control of fire monitor is finished in two steps, finishes the control of the angle of pitch earlier, finishes the control of horizontal angle again.As shown in Figure 3, realize the adjusting of the angle of pitch to the size of fire point distance according to 4. water channel air line distances and 5. water channel starting points.Step-up error allowed band δ
d, work as d
1-d
2＞0 and | d
1-d
2|＞δ
d, then angle of pitch control is up worked as d
1-d
2＜0 and | d
1-d
2|＞δ
d, then angle of pitch control down.
After angle of pitch adjustment was finished, water-drop point and flame location and water cannon mounting points can be considered equidistant situation, and promptly 5. water channel starting points are put apart from d to fire among Fig. 4
2Put apart from d to fire with starting point after the adjustment of the 9. fire-fightings bubble angle of pitch
1' approximately equal.Then both relative positions are in the horizontal direction made clear, as shown in Figure 4 from two-dimension picture.Size control fire monitor horizontal direction according to θ angle among Fig. 4.Angular error allowed band δ is set
θ, when θ＞0, | θ |＞δ
θ, then horizontal angle is to control counterclockwise; When θ＜0, | θ |＞δ
θ, then horizontal angle is controlled to clockwise direction.
Claims (1)
1, a kind of based on the fire point of monocular vision technique and the fire monitor control method of water-drop point relative position adjustment, it is characterized in that may further comprise the steps:
(1) after finding the fire point, utilize the binocular parallax principle that the image of two waveband video camera is handled, obtain the depth distance information of flame, again in conjunction with fire monitor installation position information, utilize preset rules to determine the fire monitor water outlet initial water straight angle and the angle of pitch, and start the fire monitor water spray;
(2) utilize the common CCD camera to obtain the two dimensional image that has flame and water channel simultaneously concurrently in real time;
(3) on two dimensional image, can only reflect the differential location relation of fire monitor water channel water-drop point and flame, and can not reflect clearly that water channel implements under the situation about concerning about point and flame, concern according to far and near position, the fire monitor water outlet position of two dimensional image reflection apart from water channel water-drop point and flame, at first make water-drop point connect the periareon by the control fire monitor angle of pitch, concrete mode is: adjust the fire monitor angle of pitch and make the water channel starting point satisfy default error allowed band to water-drop point air line distance and water channel starting point to fire point air line distance difference;
(4) after angle of pitch adjustment is finished, the relative water channel starting point with flame location of water channel water-drop point can be considered equidistant, and the while also makes the position, the left and right sides of water channel water-drop point and flame close to tie up in the two dimensional image and clearly reflects; Then further utilize position, the left and right sides relation of the water channel water-drop point and the flame of two dimensional image reflection, continuation makes water-drop point further connect the periareon by control fire monitor horizontal angle, and concrete mode is: adjust the fire monitor horizontal angle and make the water channel starting point satisfy default error allowed band to the angle of water-drop point line and water channel starting point and fire point line.Then the fire monitor adjustment is finished;
(5) with the change of flame kernel point position, repeat to adjust the angle of pitch and the horizontal angle of fire monitor, water-drop point can be followed the tracks of drop on the flame, put out until flame.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009100330320A CN101574566B (en) | 2009-06-08 | 2009-06-08 | Monocular vision technique based fire monitor control method for adjusting relative positions of fire point and water-drop point |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009100330320A CN101574566B (en) | 2009-06-08 | 2009-06-08 | Monocular vision technique based fire monitor control method for adjusting relative positions of fire point and water-drop point |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101574566A true CN101574566A (en) | 2009-11-11 |
| CN101574566B CN101574566B (en) | 2011-07-27 |
Family
ID=41269721
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009100330320A Expired - Fee Related CN101574566B (en) | 2009-06-08 | 2009-06-08 | Monocular vision technique based fire monitor control method for adjusting relative positions of fire point and water-drop point |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101574566B (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102743832A (en) * | 2012-06-20 | 2012-10-24 | 中联重科股份有限公司 | Fire-fighting machinery fire-extinguishing operation control method, device and system |
| CN103285548A (en) * | 2013-05-16 | 2013-09-11 | 福州大学 | Method and device for positioning ground fire by monocular camera |
| CN103768748A (en) * | 2013-12-27 | 2014-05-07 | 合肥科大立安安全技术股份有限公司 | Method for calculating jet-flow pitch angle of automatically-tracked-positioned jet-flow extinguishing device |
| CN104096334A (en) * | 2014-07-17 | 2014-10-15 | 南京航空航天大学 | Jet-flow optical waveguide drop point brightness enhancing structure for fire monitor and brightness enhancing method thereof |
| CN104436501A (en) * | 2014-12-15 | 2015-03-25 | 中国科学技术大学 | Fire extinguishing control method, device and system based on fire monitor technology |
| CN104524731A (en) * | 2015-01-14 | 2015-04-22 | 南京国业科技有限公司 | Multi-information fusion intelligent water monitor extinguishing system based on electric-optic turret |
| CN104784852A (en) * | 2015-04-20 | 2015-07-22 | 公安部天津消防研究所 | Method for calculating jet flow pitching angle of compressed air foam smart gun |
| CN104941101A (en) * | 2014-03-26 | 2015-09-30 | 西华大学 | Method for improving fire-fighting precision of intelligent fire monitor |
| CN105031868A (en) * | 2015-07-03 | 2015-11-11 | 合肥科大立安安全技术股份有限公司 | Self-adaption fire extinguishing method based on fire scale |
| CN105056455A (en) * | 2015-07-29 | 2015-11-18 | 成都栖林测控科技有限责任公司 | Method and device for positioning fire monitor based on image recognition |
| CN105080023A (en) * | 2015-09-02 | 2015-11-25 | 南京航空航天大学 | Automatic tracking and positioning jet flow extinguishing method |
| CN108671453A (en) * | 2018-03-19 | 2018-10-19 | 北京领创拓展科技发展有限公司 | A kind of water cannon automatic control system |
| CN109939396A (en) * | 2019-03-26 | 2019-06-28 | 应急管理部天津消防研究所 | A kind of self-travel type big flow fire monitor with drop point debugging functions |
| CN111494853A (en) * | 2020-04-10 | 2020-08-07 | 中国矿业大学 | Multi-mode visual servo control fire-fighting system and working method thereof |
| CN112179210A (en) * | 2020-08-31 | 2021-01-05 | 河北汉光重工有限责任公司 | Method for correcting shot hit deviation of naval gun |
| CN112435298A (en) * | 2020-12-03 | 2021-03-02 | 武汉科技大学 | Jet flow closed-loop control method based on image processing and monocular vision |
| CN112807592A (en) * | 2021-03-08 | 2021-05-18 | 浙江中互网络科技有限公司 | Omnibearing intelligent fire extinguishing double-gun robot and working method thereof |
| CN114307016A (en) * | 2021-11-22 | 2022-04-12 | 中国矿业大学 | Fire extinguishing system based on unmanned aerial vehicle vision auxiliary fire monitor and control method |
| CN115337581A (en) * | 2022-10-14 | 2022-11-15 | 中国矿业大学 | Fire-fighting method based on multi-view vision fire-fighting system |
| CN116468797A (en) * | 2023-03-09 | 2023-07-21 | 北京航天众信科技有限公司 | Aiming method and device for rail-mounted robot and computer equipment |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101847304B (en) * | 2009-12-04 | 2012-05-23 | 四川川大智胜软件股份有限公司 | Image-based method of finding flames with large-space intelligent fire-fighting system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100522290C (en) * | 2003-09-30 | 2009-08-05 | 中国科学技术大学 | Automatic fire extinguishing cannon and its control method |
-
2009
- 2009-06-08 CN CN2009100330320A patent/CN101574566B/en not_active Expired - Fee Related
Cited By (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102743832B (en) * | 2012-06-20 | 2015-06-17 | 中联重科股份有限公司 | Fire-fighting machinery fire-extinguishing operation control method, device and system |
| CN102743832A (en) * | 2012-06-20 | 2012-10-24 | 中联重科股份有限公司 | Fire-fighting machinery fire-extinguishing operation control method, device and system |
| CN103285548A (en) * | 2013-05-16 | 2013-09-11 | 福州大学 | Method and device for positioning ground fire by monocular camera |
| CN103285548B (en) * | 2013-05-16 | 2015-07-01 | 福州大学 | Method and device for positioning ground fire by monocular camera |
| CN103768748B (en) * | 2013-12-27 | 2016-05-04 | 合肥科大立安安全技术股份有限公司 | Automatically the jet angle of pitch computational methods of track and localization jet extinguishing device |
| CN103768748A (en) * | 2013-12-27 | 2014-05-07 | 合肥科大立安安全技术股份有限公司 | Method for calculating jet-flow pitch angle of automatically-tracked-positioned jet-flow extinguishing device |
| CN104941101A (en) * | 2014-03-26 | 2015-09-30 | 西华大学 | Method for improving fire-fighting precision of intelligent fire monitor |
| CN104096334A (en) * | 2014-07-17 | 2014-10-15 | 南京航空航天大学 | Jet-flow optical waveguide drop point brightness enhancing structure for fire monitor and brightness enhancing method thereof |
| CN104436501A (en) * | 2014-12-15 | 2015-03-25 | 中国科学技术大学 | Fire extinguishing control method, device and system based on fire monitor technology |
| CN104436501B (en) * | 2014-12-15 | 2017-11-28 | 中国科学技术大学 | A kind of control extinguishing method, apparatus and system based on fire monitor technology |
| CN104524731A (en) * | 2015-01-14 | 2015-04-22 | 南京国业科技有限公司 | Multi-information fusion intelligent water monitor extinguishing system based on electric-optic turret |
| CN104784852B (en) * | 2015-04-20 | 2017-06-30 | 公安部天津消防研究所 | A kind of computational methods of the compressed-air foam intelligent cannon jet angle of pitch |
| CN104784852A (en) * | 2015-04-20 | 2015-07-22 | 公安部天津消防研究所 | Method for calculating jet flow pitching angle of compressed air foam smart gun |
| CN105031868A (en) * | 2015-07-03 | 2015-11-11 | 合肥科大立安安全技术股份有限公司 | Self-adaption fire extinguishing method based on fire scale |
| CN105031868B (en) * | 2015-07-03 | 2019-05-07 | 合肥科大立安安全技术股份有限公司 | Adaptive extinguishing method based on flame scale |
| CN105056455A (en) * | 2015-07-29 | 2015-11-18 | 成都栖林测控科技有限责任公司 | Method and device for positioning fire monitor based on image recognition |
| CN105056455B (en) * | 2015-07-29 | 2018-05-08 | 成都栖林测控科技有限责任公司 | A kind of fire monitor localization method and device based on image identification |
| CN105080023A (en) * | 2015-09-02 | 2015-11-25 | 南京航空航天大学 | Automatic tracking and positioning jet flow extinguishing method |
| CN108671453A (en) * | 2018-03-19 | 2018-10-19 | 北京领创拓展科技发展有限公司 | A kind of water cannon automatic control system |
| CN109939396A (en) * | 2019-03-26 | 2019-06-28 | 应急管理部天津消防研究所 | A kind of self-travel type big flow fire monitor with drop point debugging functions |
| CN111494853A (en) * | 2020-04-10 | 2020-08-07 | 中国矿业大学 | Multi-mode visual servo control fire-fighting system and working method thereof |
| CN111494853B (en) * | 2020-04-10 | 2021-05-11 | 中国矿业大学 | Multi-mode visual servo control fire-fighting system and working method thereof |
| CN112179210A (en) * | 2020-08-31 | 2021-01-05 | 河北汉光重工有限责任公司 | Method for correcting shot hit deviation of naval gun |
| CN112179210B (en) * | 2020-08-31 | 2022-09-02 | 河北汉光重工有限责任公司 | Method for correcting shot hit deviation of naval gun |
| CN112435298A (en) * | 2020-12-03 | 2021-03-02 | 武汉科技大学 | Jet flow closed-loop control method based on image processing and monocular vision |
| CN112435298B (en) * | 2020-12-03 | 2024-04-12 | 武汉科技大学 | Jet flow closed-loop control method based on image processing and monocular vision |
| CN112807592A (en) * | 2021-03-08 | 2021-05-18 | 浙江中互网络科技有限公司 | Omnibearing intelligent fire extinguishing double-gun robot and working method thereof |
| CN114307016A (en) * | 2021-11-22 | 2022-04-12 | 中国矿业大学 | Fire extinguishing system based on unmanned aerial vehicle vision auxiliary fire monitor and control method |
| CN115337581A (en) * | 2022-10-14 | 2022-11-15 | 中国矿业大学 | Fire-fighting method based on multi-view vision fire-fighting system |
| CN116468797A (en) * | 2023-03-09 | 2023-07-21 | 北京航天众信科技有限公司 | Aiming method and device for rail-mounted robot and computer equipment |
| CN116468797B (en) * | 2023-03-09 | 2023-11-24 | 北京航天众信科技有限公司 | Aiming method and device for rail-mounted robot and computer equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101574566B (en) | 2011-07-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101574567B (en) | Computer vision technique based method and system for detecting and extinguishing fire disaster intelligently | |
| CN101574566B (en) | Monocular vision technique based fire monitor control method for adjusting relative positions of fire point and water-drop point | |
| CN110782524B (en) | Indoor three-dimensional reconstruction method based on panoramic image | |
| US20180003498A1 (en) | Visual positioning system and method based on high reflective infrared identification | |
| CN109773783B (en) | Patrol intelligent robot based on space point cloud identification and police system thereof | |
| CN107909615A (en) | A kind of fire monitor localization method based on binocular vision | |
| CN107462217B (en) | Unmanned aerial vehicle binocular vision barrier sensing method for power inspection task | |
| CN107396037B (en) | Video monitoring method and device | |
| CN104966062A (en) | Video monitoring method and device | |
| CN109557918A (en) | Control method, device, equipment, vehicle and the storage medium of vehicle | |
| CN110322564A (en) | A kind of 3 D model construction method of the substation operation environment suitable for VR/AR | |
| CN107689060A (en) | Visual processing method, device and the equipment of view-based access control model processing of destination object | |
| CN111639825A (en) | Method and system for indicating escape path of forest fire based on A-Star algorithm | |
| WO2020135187A1 (en) | Unmanned aerial vehicle recognition and positioning system and method based on rgb_d and deep convolutional network | |
| KR101780929B1 (en) | Image surveillence system for moving object | |
| CN110940316A (en) | Navigation method and system for fire-fighting robot of transformer substation in complex environment | |
| KR20090051785A (en) | System for observing wether and thereof method | |
| CN103986905B (en) | Method for video space real-time roaming based on line characteristics in 3D environment | |
| CN110075449A (en) | A kind of intelligent monitoring extinguishing method for unmanned ship | |
| KR20190059395A (en) | Gis 3 cctv 3 cctv | |
| CN115797864A (en) | Safety management system applied to smart community | |
| WO2011129473A1 (en) | Automatic sky state observation system and method | |
| CN101574568B (en) | Fire monitor water way and method for recognizing tail end of water way | |
| KR101700651B1 (en) | Apparatus for tracking object using common route date based on position information | |
| Baudoin et al. | View-finder: robotics assistance to fire-fighting services and crisis management |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110727 Termination date: 20140608 |
|
| EXPY | Termination of patent right or utility model |