CN110501914A - A kind of method for safety monitoring, equipment and computer readable storage medium - Google Patents
A kind of method for safety monitoring, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN110501914A CN110501914A CN201810483407.2A CN201810483407A CN110501914A CN 110501914 A CN110501914 A CN 110501914A CN 201810483407 A CN201810483407 A CN 201810483407A CN 110501914 A CN110501914 A CN 110501914A
- Authority
- CN
- China
- Prior art keywords
- image
- heat source
- region
- flame
- source distributed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 126
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000003860 storage Methods 0.000 title claims abstract description 15
- 230000006399 behavior Effects 0.000 claims description 66
- 238000009826 distribution Methods 0.000 claims description 32
- 238000001228 spectrum Methods 0.000 claims description 30
- 238000004891 communication Methods 0.000 claims description 13
- 239000000779 smoke Substances 0.000 claims description 10
- 230000003595 spectral effect Effects 0.000 claims description 10
- 238000012790 confirmation Methods 0.000 claims description 7
- 230000002265 prevention Effects 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 31
- 238000010411 cooking Methods 0.000 description 11
- 239000007789 gas Substances 0.000 description 10
- 230000005540 biological transmission Effects 0.000 description 8
- 230000005611 electricity Effects 0.000 description 8
- 238000012545 processing Methods 0.000 description 8
- 238000005520 cutting process Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000005406 washing Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 238000010438 heat treatment Methods 0.000 description 4
- 238000012806 monitoring device Methods 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 238000005452 bending Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 230000018109 developmental process Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000003331 infrared imaging Methods 0.000 description 3
- 230000001788 irregular Effects 0.000 description 3
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 239000004744 fabric Substances 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- VNWKTOKETHGBQD-UHFFFAOYSA-N methane Chemical compound C VNWKTOKETHGBQD-UHFFFAOYSA-N 0.000 description 2
- UGFAIRIUMAVXCW-UHFFFAOYSA-N Carbon monoxide Chemical compound [O+]#[C-] UGFAIRIUMAVXCW-UHFFFAOYSA-N 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 239000008186 active pharmaceutical agent Substances 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000004380 ashing Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 229910002091 carbon monoxide Inorganic materials 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000001535 kindling effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000003345 natural gas Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000000505 pernicious effect Effects 0.000 description 1
- 238000005086 pumping Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000002341 toxic gas Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Fire-Detection Mechanisms (AREA)
- Alarm Systems (AREA)
Abstract
The embodiment of the invention discloses a kind of method for safety monitoring, wherein the described method includes: obtaining the monitoring information of destination home appliance；Judge whether monitoring information reaches early-warning conditions；If reaching early-warning conditions, security control operation is executed.The embodiment of the invention also discloses a kind of equipment and computer readable storage mediums.By implementing above scheme, a kind of solution for being able to ascend and carrying out the timeliness of safety prevention measure when occurring dangerous is provided.
Description
Technical field
The present invention relates to intelligent appliance field more particularly to a kind of method for safety monitoring, equipment and computer-readable storage
Medium.
Background technique
With the increasingly raising of people's living standard, safety problem becomes the problem of people increasingly pay close attention to.Some new
It hears in report, the danger being likely to occur in some home environments usually exposed, such as fire.Especially to there is old man and small
For the family of child, these danger being likely to occur in home environment how to be avoided to cause damages household and family's property, at
For the majority of consumers' shopping goods focus of attention.
Currently, consumer can usually choose monitoring camera product to be monitored to home environment.
Due to needing artificial checking monitoring image, this monitor mode can not carry out in time security protection when occurring dangerous
Measure.
Summary of the invention
In view of this, an embodiment of the present invention is intended to provide a kind of method for safety monitoring, equipment and computer-readable storage mediums
Matter provides a kind of security monitoring solution for being able to ascend and carrying out the timeliness of safety prevention measure when occurring dangerous.
The technical solution of the embodiment of the present invention is achieved in that
In a first aspect, the embodiment of the present invention provides a kind of method for safety monitoring, it is applied to control device, the method packet
It includes:
Obtain the monitoring information of destination home appliance；
Judge whether the monitoring information reaches early-warning conditions；
If reaching the early-warning conditions, security control operation is executed.
Second aspect, the embodiment of the present invention provide a kind of control device, and the control device includes at least: memory leads to
Believe bus and processor, in which:
The memory, for storing security monitor program；
The communication bus, for realizing the connection communication between processor and memory；
The processor, for executing the security monitor program stored in memory, to perform the steps of acquisition target
The monitoring information of household electrical appliance；
Judge whether the monitoring information reaches early-warning conditions；
If reaching the early-warning conditions, security control operation is executed.
The third aspect, the embodiment of the present invention provide a kind of computer readable storage medium, the computer-readable storage medium
It is stored with security monitor program in matter, is realized as described in above-mentioned first aspect when the security monitor program is executed by processor
The step of method for safety monitoring.
In embodiments of the present invention, using the above scheme for being applied to household electrical appliance, by obtaining destination home appliance
Monitoring information；Judge whether monitoring information reaches early-warning conditions；If reaching early-warning conditions, security control operation is executed.The present invention
The technical solution that embodiment provides is lifted at the timeliness that safety prevention measure is carried out when occurring dangerous.
Detailed description of the invention
Figure 1A is the flow diagram one of method for safety monitoring provided in an embodiment of the present invention；
Figure 1B is the schematic diagram one of thermodynamic chart；
Fig. 1 C is the schematic diagram two of thermodynamic chart；
Fig. 1 D is the schematic diagram one of flame；
Fig. 1 E is the pixel distribution schematic diagram one of heat source distributed image；
Fig. 1 F is the schematic diagram two of flame；
Fig. 1 G is the pixel distribution schematic diagram two of heat source distributed image；
Fig. 1 H is the schematic diagram three of thermodynamic chart.
Fig. 2 is the flow diagram two of security monitoring mode provided in an embodiment of the present invention；
Fig. 3 is the flow diagram three of method for safety monitoring provided in an embodiment of the present invention；
Fig. 4 is the system framework schematic diagram of method for safety monitoring provided in an embodiment of the present invention application；
Fig. 5 is the structural schematic diagram of safety monitoring device provided in an embodiment of the present invention；
Fig. 6 is the structural schematic diagram of control device provided in an embodiment of the present invention.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
Before introducing method for safety monitoring provided in an embodiment of the present invention, first safety provided in an embodiment of the present invention is supervised
The application scenarios of prosecutor method carry out general description.
With the development of artificial intelligence, big data, more and more technical application scenes start to focus on smart home neck
Domain.Household in the market, user start more and more pay close attention to smart homes for user privacy and household electrical appliances fire prevention aspect
The design of security monitoring.User wishes that smart home product is capable of providing effective security monitoring function much sooner, in addition, with
Family also wants to the intelligent monitoring scheme that smart home product is capable of providing multipath, to protect household safe, fire preventing.
It was discovered by researchers that the common cause that inside fire generates first is that since household electrical appliances power supply is on fire, also, many rooms
Interior fire is all due to caused by the kindling of kitchen.
For above-mentioned indoor security monitoring scene, the embodiment of the present invention provides the security monitoring side for being able to solve the problem
Method.Method for safety monitoring provided in an embodiment of the present invention is described in detail below.
The embodiment of the present invention provides a kind of method for safety monitoring, and the executing subject of the embodiment of the present invention can be control dress
It sets.In embodiments of the present invention, control device can be household electrical appliance, or server.For example, household electrical appliance can
Think cooking equipment, for example, electric cooker, electric pressure cooking saucepan, electric kettle, micro-wave oven, oven, electromagnetic oven etc., the present invention other
In embodiment, household electrical appliance are also possible to other living electric apparatus equipment, such as refrigerator, water heater, washing machine, television set, smoke pumping
Mechanical, electrical hot blanket etc..Figure 1A is the flow diagram one of method for safety monitoring provided in an embodiment of the present invention, as shown in Figure 1A, institute
The method of stating may comprise steps of:
S101 obtains the monitoring information of destination home appliance.
In embodiments of the present invention, destination home appliance can be the determining household electrical appliance for needing to obtain monitoring information.
The monitoring information of destination home appliance may include heat source distributed image, the concentration of object gas, in the temperature of target position extremely
A kind of few information.Wherein, heat source distributed image can be in electrical appliance heat source monitoring range in acquire heat source distribution map
Picture.For example, heat source distributed image may include at least one of thermodynamic chart, spectrogram image.
In one example, infrared sensor can be set in destination home appliance, it can be in household using infrared sensor
Within the scope of the infrared monitoring of electric appliance acquire thermodynamic chart, in other embodiments of the present invention, infrared sensor be also possible to it is infrared at
As sensor or infrared thermal imager.Thermodynamic chart can be used for acquiring the surface temperature of monitored target, the picture of different colours
Element can indicate the object with different temperatures.Illustratively, thermodynamic chart can be colored thermodynamic chart, gray scale thermodynamic chart etc..In
In practical application, destination home appliance can be between the color-values of the pixel in set temperature and thermodynamic chart when acquiring thermodynamic chart
Corresponding relationship.Illustratively, color-values can use RGB color canonical representation.Figure 1B is the schematic diagram one of thermodynamic chart.Such as figure
Shown in 1B, red pixel area, yellow pixel region and green pixel area successively indicate higher, medium, the lower range of temperature
The corresponding image information of object.In addition, destination home appliance can also set the temperature range of monitoring.It illustratively, can be with
The corresponding image of monitored target that temperature value is greater than flame minimum temperature is only presented in setting in thermodynamic chart.For example, target man
Electrical appliance can filter out the image for the monitored target that temperature is lower than 5 degree, and temperature is only presented on thermodynamic chart and is greater than or equal to
The image of 15 degree of monitored target, the part being filtered out can be white in the color-values of heating power chart display respective pixel,
It can refer to white pixel region shown in Figure 1B.In other embodiments of the present invention, the size of the R value of pixel can also reflect
The height of temperature, for example, R value is bigger, the color of pixel is more shallow, and temperature represented by pixel is lower, and R value is smaller, the face of pixel
Color is deeper, and temperature represented by pixel is higher, and Fig. 1 C is the schematic diagram two of thermodynamic chart, as shown in Figure 1 C, the picture that R color-values are 10
The corresponding temperature of element is higher than the corresponding temperature of pixel that R color-values are 200.
In another example, spectrum sensor can be set in destination home appliance, can be in using spectrum sensor
Spectrogram is acquired within the scope of the spectrum monitoring of electrical appliance.In other embodiments of the present invention, infrared monitoring range and spectrum monitoring
Range can be the same or different.It, can be according to thermodynamic chart and light when infrared monitoring range is identical with spectrum monitoring range
Spectrogram is made whether occur needing the judgement of early warning scene to same monitoring range.
In another example, smoke sensor device can be set in destination home appliance, can be in using smoke sensor device
The concentration of object gas within the scope of the gas-monitoring of electrical appliance.Illustratively, object gas can be natural gas or harmful gas
Body, for example, carbon monoxide etc..
In another example, temperature sensor can be set in destination home appliance, can be acquired using temperature sensor
The temperature of target monitoring position on household electrical appliance.In other embodiments of the present invention, target monitoring position for example can be in advance
What is be arranged is easy to happen fire or the position of security risk occurs, for example, heating element, power connection in household electrical appliance, top
Portion or bottom.
In other embodiments of the present invention, obtaining monitoring information can also include: the heat source monitoring in destination home appliance
Original heat source distributed image is acquired in range；The image that low-temperature region is removed from original heat source distributed image is distributed as heat source
Image.Wherein, low-temperature region can be the image-region that temperature in heat source distributed image is lower than preset flame minimum temperature, show
Example property, flame minimum temperature can be 65 degrees Celsius.
In embodiments of the present invention, above-mentioned acquisition destination home appliance monitoring information may include: acquisition target household electric
The monitoring information of device；Alternatively, receiving the monitoring information that destination home appliance is sent.In one example, control device can be family
Electrical appliance, for example, destination home appliance, then destination home appliance can use the various sensors acquisition monitoring letter of itself setting
Breath.In another example, control device may be server, then server can receive target household from destination home appliance
The monitoring information of electric appliance.
S102, judges whether monitoring information reaches early-warning conditions.
In embodiments of the present invention, judging whether monitoring information reaches early-warning conditions may include following at least one side
Formula:
Mode A1, if monitoring information is acquired including the use of the infrared sensor and/or spectrum sensor of destination home appliance
Heat source distributed image, judge that flame is special if it exists with the presence or absence of the image information of flame characteristic is met in heat source distributed image
The image information of sign, determination reach early-warning conditions.
Mode A2, if monitoring information including the use of destination home appliance smoke sensor device acquire object gas it is dense
Degree, judges whether target gas levels are greater than preset concentration threshold, and if more than concentration threshold, determination reaches early-warning conditions.
Mode A3, if the temperature for the target position that monitoring information is acquired including the use of the temperature sensor of destination home appliance
Degree, judges whether the temperature of target monitoring position is greater than preset temperature threshold, and if more than temperature threshold, determination reaches early warning item
Part.
In embodiments of the present invention, using infrared sensor, spectrum sensor, smoke sensor device, temperature sensor, to sentence
The disconnected mode for whether reaching early-warning conditions, since the information detected is the letter such as temperature, spectral band, gas concentration of object
Breath, rather than visual details thus, it is possible to which effectively fire preventing occurs, while protecting privacy of user.
In embodiments of the present invention, with the presence or absence of the image letter for meeting flame characteristic in above-mentioned judgement heat source distributed image
Breath may include following at least one embodiment.
Mode B1: judge with the presence or absence of the image information for meeting flame pixels distribution characteristics in heat source distributed image, if depositing
In the image information for meeting flame pixels distribution characteristics, the image for existing in the heat source distributed image and meeting flame characteristic is determined
Information.
In embodiments of the present invention, infrared sensor or spectrum sensor be can use, acquired in monitoring range in advance
There are heat source distributed images when flame scene, then, according to the R value of the pixel in image, determine the distribution characteristics of pixel, this
Kind monitors the distribution characteristics i.e. flame pixels distribution characteristics of the pixel in the heat source distributed image of flame.
It should be noted that if heat source distributed image be thermodynamic chart, i.e., the color-values of the pixel in heat source distributed image with
There are corresponding relationships for temperature value, pixel map can be drawn, that is, pixel map can reflect according to the difference of R value
The distributed intelligence of temperature value.In other embodiments of the present invention, if heat source distributed image is spectrogram, i.e., in heat source distributed image
Pixel color-values and spectral band value there are corresponding relationship, pixel map can be drawn according to the difference of R value, that is,
Pixel map can reflect the distributed intelligence of spectral band.Below by taking thermodynamic chart as an example, to judging to be in heat source distributed image
No the step of there is the image information for meeting flame pixels distribution characteristics, is illustrated.
Fig. 1 D is the schematic diagram one of flame, can acquire heat source distributed image for the scene.Fig. 1 E is heat source distribution map
The pixel distribution schematic diagram one of picture.The figure is to monitor that one kind of the corresponding pixel map of heat source distributed image of flame is shown
Meaning.As referring to figure 1E, X-axis is the R value of pixel, and Y-axis is the quantity of pixel.Illustratively, using the R of RGB color canonical representation
The range of value is 0 to 255.It can be found that flame pixels distribution characteristics may include following at least one according to Fig. 1 E.
Feature one: the bending features of pixel distribution curve.
Feature two: the quantity of the pixel in each section accounts for the ratio characteristic of total pixel number amount.
For feature one, as referring to figure 1E, the bending features of curve may include: that there are two peak values for curve tool, highest
It is 0 to 50 this section that first peak value, which appears in R value, and the second peak value appears in R value between 200 values 255, and the first peak value is wanted
Much higher than the second peak value；In addition, the curve between two peak values is very gentle, the picture in this section of the R value between 50 to 200
The quantity amplitude of variation very little of element, and first slowly decline slowly rises again with the increase of R value.
In practical applications, bending features can be compared with full section or segmentation.
In one example, firstly, obtaining first in the corresponding pixel map of heat source distributed image for monitoring flame
Pixel distribution curve, and, the second pixel distribution curve in the corresponding pixel map of heat source distributed image to be judged, so
Afterwards, the second pixel distribution curve is compared with the first pixel distribution curve, if the difference of the pixel quantity of each R value object
Less than pre-programmed curve discrepancy threshold, can determine in heat source distributed image to be judged exist meet flame pixels distribution characteristics
Image information.It should be noted that the total pixel number amount of heat source distributed image to be judged is distributed with the heat source for monitoring flame
The total pixel number amount of image answers equal or number differences to be less than preset total pixel number amount discrepancy threshold.
In another example, a kind of judgment mode of simplification can also be used, it can be determined that the pixel number peak of first interval
Value belongs to default first interval peak ranges, and the pixel number peak value of second interval belongs to second interval peak ranges, 3rd interval
Pixel number peak value belong to 3rd interval peak ranges, illustratively, first interval is that R value is 0 to 50, second interval be R value
It is 50 to 200,3rd interval is that R value is 200 to 255, and first interval peak ranges are 50000 to total pixel number amount, the secondth area
Between peak ranges be 0 to 10000,3rd interval peak ranges are 5000 to 60000, wherein total pixel number amount for example can be
500000。
For feature two, as referring to figure 1E, the ratio characteristic that the quantity of the pixel in each section accounts for total pixel number amount can be with
It include: in the corresponding pixel map of heat source distributed image for monitoring flame, R value belongs to 0 to 50 this first interval
It is very high that the quantity of pixel accounts for the first ratio in total pixel number amount, for example, the first ratio, which can be greater than 70%, R value, belongs to 200
To the quantity of the pixel of 255 this second interval, to account for the second ratio in total pixel number amount relatively low, for example, the second ratio can
Think 10%-20%, and the quantity that R value belongs to the pixel of 50 to 200 this 3rd interval accounts for the third ratio of total pixel number amount
To be minimum, for example, third ratio can be 0%-10%.
In practical applications, it can be determined that the quantity of the pixel in a certain section or all sections accounts for the ratio of total pixel number amount
Whether example belongs to the preset pixel accounting range in corresponding section, if belonging to, can determine that heat source distributed image to be judged exists
Meet the image information of flame pixels distribution characteristics.
For example, R value belongs to 0 to 50 for first interval, and R value belongs to 50 to 200 for second interval, R value belong to 200 to
255 be 3rd interval.
In one example, firstly, in heat source distributed image to be judged, determine that R value belongs to the pixel of first interval
Quantity is denoted as first interval pixel number, then, judges that first interval pixel number accounts for total pixel of heat source distributed image to be judged
The ratio of quantity, if be greater than preset first interval pixel accounting threshold value, such as 70%, if more than that can determine wait judge
Heat source distributed image in exist and meet the image information of flame pixels distribution characteristics.In other embodiments of the present invention, similar
, it can also judge that R value belongs to the corresponding second interval pixel number of pixel of second interval and whether belongs to preset second interval
Pixel accounting threshold value, alternatively, judge R value belong to 3rd interval the corresponding 3rd interval pixel number of pixel whether belong to it is preset
3rd interval pixel accounting threshold value, illustratively, second interval pixel accounting threshold value can be 0-10%, and 3rd interval pixel accounts for
It can be 10%-20% than threshold value.
In other embodiments of the present invention, the image information that meets flame characteristic can be to be made of flame pixels, fire
Flame pixel be corresponding temperature value belong to the pixel of preset flame temperature range or corresponding spectral band value belong to it is default
Flame spectrum wavelength band pixel.In other embodiments of the present invention, whether there is in above-mentioned judgement heat source distributed image
The step of meeting the pixel of flame characteristic, if can also include: the heat that heat source distributed image is obtained including the use of infrared sensor
Try hard to, determines the corresponding temperature value of the pixel according to the color-values of pixel each in thermodynamic chart, judge to whether there is in thermodynamic chart
Corresponding temperature value belongs to the pixel of flame temperature range, and if it exists, determines the pixel for existing and meeting flame characteristic；If heat source point
The spectrogram that cloth image is obtained including the use of spectrum sensor determines the pixel pair according to the color-values of pixel each in spectrogram
The spectral band value answered judges the picture for belonging to flame spectrum wavelength band in spectrogram with the presence or absence of corresponding spectral band value
Element, and if it exists, determine the pixel for existing and meeting flame characteristic.Illustratively, in other embodiments of the present invention, it can set in advance
It sets and the temperature value of monitored target that the pixel that R color-values belong to 0 to 50 indicates is belonged into flame temperature range, that is, can be with
Whether the R color-values of detection pixel belong to 0 to 50, to determine whether the corresponding temperature value of the pixel belongs to flame temperature range.
In other embodiments of the present invention, flame pixels distribution characteristics can also include following characteristics:
Feature three: in the heat source distributed image of at least two moment acquisition, the Secondary Heat Source distribution of the second moment acquisition
The quantity of the pixel in each section in image, greater than pair in the first heat source distributed image at the first moment before the second moment
Answer the quantity of the pixel in section.
Wherein, each section may include: R value belong to 0 to 50 first interval, R value belong to 50 to 200 the secondth area
Between, R value belong at least one section in 200 to 255 3rd interval.
For example, Fig. 1 F is the schematic diagram two of flame, and Fig. 1 G is the pixel distribution schematic diagram two of heat source distributed image.With
Fig. 1 E is compared, and Fig. 1 G is the corresponding pixel map of heat source distributed image in the lesser first moment acquisition of fire behavior, and Fig. 1 E is
The corresponding pixel map of heat source distributed image of the second moment acquisition when fire behavior is larger.Being compared to two figures can be with
It was found that the quantity of the pixel of first interval, second interval, 3rd interval compared with previous moment increase, and increased amplitude at than
Example.
In practical applications, also may determine that the variation of the pixel distribution of two or more heat source distributed images is
It is no to meet features described above to judge heat source distributed image with the presence or absence of the image information for meeting flame pixels distribution characteristics.
Mode B2: judge in heat source distributed image with the presence or absence of the image information for meeting flame forms feature.
In embodiments of the present invention, with the presence or absence of the image for meeting flame forms feature in above-mentioned judgement heat source distributed image
Information may include: to judge to meet flame-shaped if it exists with the presence or absence of the image information for meeting flame forms feature in thermodynamic chart
The image information of state feature, determination reach early-warning conditions；If heat source distributed image includes spectrogram, above-mentioned judgement heat source distribution map
The image information that whether there is flame forms feature as in may include judging to whether there is in spectrogram to meet flame forms spy
The image information of sign, meets the image information of flame forms feature if it exists, and determination reaches early-warning conditions.
In embodiments of the present invention, flame forms feature may include: that Gradient Features, broken edge feature, area are passed
Increase feature etc., any one flame forms feature, can determine and reach early-warning conditions if it exists.Below to flame forms feature into
Row explanation.
In one example, Gradient Features can refer to that flame includes flame core, middle flame and flame envelope, flame temperature from inside to outside according to
Secondary to increase, therefore, the flame in thermodynamic chart takes on the shape of multilayer nest, wherein the region at close nesting center
The color of pixel is red, and the color close to the pixel in the region of nested periphery is green, and closer to center, color is got over
Secretly, more shallow closer to peripheral color.In other embodiments of the present invention, the multilayer nest form in spectrogram and flame are in heating power
The shape of the multilayer nest presented in figure is similar.
In one example, broken edge feature can include at least two kinds of situations.
A kind of situation is that the shape for the figure that flame shows on the image is irregular.This broken edge
The shape of shape and the shape of the object with linear edge profile common in life, the object of symmetrical edge contour is obvious
Different.For example, the shape feature for the figure that flame is presented on the image can be for tiny wedge angle and curved edge
Figure.
Another situation is that the variation of the shape for the figure that flame shows on the image is also irregular.Citing comes
Say, the variation of the position, the form at edge of the figure that flame is presented on the image can be it is irregular, can be continuous increase
's.For example, position, the arc of the figure of more doubtful flame can be come by the heat source distributed image in two periods of acquisition
Whether the curvature at shape edge changes, can be true if position, the curvature of curved edge and position do not change
The image in the fixed region is not the image of flame, i.e. the image for meeting flame characteristic is not present in the region.
In one example, area increment feature can determine in the following manner, firstly, the heat at least two moment of acquisition
Source distribution image, for example, first monitoring information and second monitoring information at the second moment at the first moment of acquisition, the first monitoring letter
Breath includes the first heat source distributed image, and the second monitoring information includes Secondary Heat Source distributed image, extracts flame range therein
Image-region, for example, the temperature indicated in image can be belonged to preset flame using heat source distributed image as heating power illustrated example
The image in the region of temperature range is as image to be detected, then, the image to be detected in two periods is compared, if comparing
It was found that any at the area ratio of the corresponding image to be detected of heat source distributed image at the second moment rearward forward the first moment
The area of the corresponding image to be detected of distributed image is bigger, it is determined that meets and presents in area increment feature namely thermodynamic chart
Flame is just increasing.Fig. 1 H is the schematic diagram three of thermodynamic chart.Red pixel area compared with Figure 1B, in image to be detected
Domain, yellow pixel region, the region that green pixel area is the appearance of doubtful fire behavior, and the gross area in the region that doubtful fire behavior occurs
It is to increase.
In other embodiments of the present invention, thermodynamic chart can be cromogram, whether there is in carrying out above-mentioned determining image
When meeting the image of flame forms feature, ashing processing can be carried out to thermodynamic chart, obtain gray scale thermodynamic chart, wherein color is got over
Deep, the corresponding temperature of pixel is higher, and color is more shallow, and the corresponding temperature of pixel is lower, later, is made whether to deposit to gray scale thermodynamic chart
In the judgement for the image for meeting flame forms feature.
For example, heat source distributed image may include thermodynamic chart, if thermodynamic chart is cromogram, can carry out ash to thermodynamic chart
Change handles to obtain grayscale image, and the image for rejecting wherein low temperature image-region obtains mapping to be checked that is, after the image of white portion
Whether picture, detection image to be detected meet Gradient Features, broken edge feature, area increment feature.
In other embodiments of the present invention, it the step of whether above-mentioned determining monitoring information reaches early-warning conditions, can also adopt
Implement with the following methods.Illustratively, destination home appliance can send monitoring information to server；Monitoring is believed by server
Whether breath, which reaches early-warning conditions, is judged, later, destination home appliance can receive whether server reaches monitoring information
The judging result that early-warning conditions are judged.
In other embodiments of the present invention, if the determination of any of the above-described mode reaches early-warning conditions, monitoring letter can be determined
Breath reaches early-warning conditions.Using aforesaid way, since fire can be belonged to only for temperature in the monitoring range of destination home appliance
The image of the object of flame temperature range is judged, can take red to avoid using in the image of common camera shooting
Cryogenic object, such as distich, good fortune word, and the case where be accidentally determined as flame.Further, it is also possible to avoid the red monitoring pair of dynamic
As judging the case where being set to flame by accident.Such as the red pattern on curtain, on the one hand, curtain is cryogenic object, on the other hand, curtain
On the area of red pattern not will increase usually, alternatively, upward wedge angle is not present, alternatively, even if wedge angle can there are wedge angle
It can be downward, alternatively, the movement of the camber line of wedge angle two sides is as curtain rod moves, so that the red figure on curtain
Case will not be identified as flame.
S103 executes security control operation if reaching early-warning conditions.
In embodiments of the present invention, the step of above-mentioned execution security control operates may include: to send to power-supply controller of electric
Signal is controlled, control signal is used to indicate the corresponding electricity of household electrical appliance group belonging to power-supply controller of electric cutting destination home appliance
Source, the corresponding power supply of household electrical appliance group are the power supply in room or the electricity in house where each household electrical appliance in household electrical appliance group
Source.
In embodiments of the present invention, household electrical appliance group may include at least one household electrical appliance.Illustratively, household electrical appliance
Group may include obtaining the destination home appliance of monitoring information, alternatively, household electrical appliance group may include destination home appliance and its
His household electrical appliance.In other embodiments of the present invention, other household electrical appliance can be located in same house with destination home appliance
Same room or not chummery.Illustratively, destination home appliance can be electric cooker, other household electrical appliance can be electricity
Pressure cooker, washing machine etc..In other embodiments of the present invention, user can be set electric cooker, electric pressure cooking saucepan etc. and be located at kitchen
Household electrical appliance belong to same household electrical appliance group, for example, " kitchen appliance group " can be named as, and the corresponding electricity of kitchen appliance group are arranged
Source is the power supply in kitchen, while washing machine can also be arranged and belong to another household electrical appliance group, for example, " toilet electricity can be named as
Device group ", and the power supply that electric appliance group corresponding power supply in toilet is toilet is set；For another example, electric cooker, electricity also can be set in user
Pressure cooker, washing machine belong to same household electrical appliance group, for example, " family's electric appliance group " can be named as, and it is corresponding that an electric appliance group is arranged
Power supply be entire electric cooker, electric pressure cooking saucepan, house where washing machine power supply.
In other embodiments of the present invention, destination home appliance can be communicated by power line with power-supply controller of electric.
Illustratively, destination home appliance can be communicated by the power module of itself with power-supply controller of electric.The present invention other
In embodiment, it can also be communicated by other wired or wireless communication modes.
In embodiments of the present invention, power-supply controller of electric can be the power control in intelligent Building System, such as can
On the power switch of the total lock of power supply or breakout room to be mounted on house.
In other embodiments of the present invention, if having occurred and that fire, control device can accurately find the position of fire source,
Further, control device can suggest safest escape route to user.
In embodiments of the present invention, using the above scheme, pass through the monitoring information of acquisition destination home appliance；Judgement monitoring
Whether information reaches early-warning conditions；If reaching early-warning conditions, security control operation is executed.Technical side provided in an embodiment of the present invention
Case is lifted at the timeliness that safety prevention measure is carried out when occurring dangerous.
Embodiment two
On the basis of example 1, the embodiment of the present invention also provides a kind of method for safety monitoring, and Fig. 2 is that the present invention is implemented
The flow diagram two for the security monitoring mode that example provides.
In embodiments of the present invention, with the presence or absence of the image for meeting flame forms feature in above-mentioned judgement heat source distributed image
Information, the image information of flame forms feature, determines the step of reaching early-warning conditions if it exists, can also be made using following steps
For a kind of alternative embodiment.
S201 determines low-risk image-region in heat source distributed image.
Wherein, low-risk image-region can be by low temperature image-region, nonflame spectrum picture region, background image area
What at least one of domain region determined.
For example, low-risk image-region is determined in heat source distributed image, may include following at least one mode:
Mode C1 will if the thermodynamic chart that heat source distributed image is acquired including the use of the infrared sensor of destination home appliance
The temperature indicated in thermodynamic chart is determined as low temperature image-region lower than the region of flame temperature range, and low temperature image-region is added
It adds in low-risk image-region；
Mode C2 will if the spectrogram that heat source distributed image is acquired including the use of the spectrum sensor of destination home appliance
The region that the spectral band indicated in spectrogram is not belonging to flame spectrum wavelength band is determined as nonflame spectrum picture region, and
Nonflame spectrum picture region is added in low-risk image-region.
Mode C3 obtains non-fire behavior image set first；Then in heat source distributed image in determining and non-fire behavior image set
Image similarity be greater than preset similarity threshold background image region；Background image region is finally added to low wind
In dangerous image-region.
In other embodiments of the present invention, background image region can also be further divided into static background region and dynamic
Background area.
In embodiments of the present invention, non-fire behavior image set can also include: non-fire behavior thermodynamic chart image set, non-fire behavior spectrum
Figure image set.Corresponding non-fire behavior image set can be obtained according to the type for the image that thermal profile picture is included.
It should be noted that low temperature image-region, nonflame spectrum picture region and background that employing mode B1-B3 is determined
For the range of image-region there may be overlapping, low-risk image-region can be low temperature image-region, nonflame spectrum picture area
The intersection in domain and background image region.
S202, using the image after removal low-risk image-region in heat source distributed image as high risk image.
In embodiments of the present invention, the combination of high risk image corresponding high risk image-region and low-risk image-region
For the corresponding complete image region of heat source distributed image.
S203 is determined in high risk image with the presence or absence of the image information for meeting flame forms feature.
In embodiments of the present invention, with the presence or absence of the image letter for meeting flame forms feature in above-mentioned determining high risk image
The step of breath may include:
Obtain fire behavior image set, wherein fire behavior image set includes the image of flame forms feature；
It determines in high risk image with the presence or absence of similar to the image information of the flame forms feature in fire behavior image set
Degree is greater than the image of preset threshold；
Similarity is greater than the image of preset threshold if it exists, determines the image information for existing and meeting flame forms feature.
S204, meets the image information of flame forms feature if it exists, and determination reaches early-warning conditions.
Wherein, after determination reaches early-warning conditions, destination home appliance can execute security control operation.Safety control
System operation can be found in the description in embodiment one.
In other embodiments of the present invention, after determining whether monitoring information reaches early-warning conditions, the embodiment of the present invention
The method of offer can with the following steps are included:
If not up to early-warning conditions, non-fire behavior image set can be added in heat source distributed image by control device.
If reaching early-warning conditions, control device can send the doubtful fire behavior report for carrying heat source distributed image to terminal.
It should be noted that in terminal side, terminal can show heat source distributed image to user, so that user's confirmation should
The image information that heat source distributed image is shown indicates whether that fire behavior occurs.For example, terminal can be popped up selects for user
Button, for example, select button one " fire behavior does not occur ", " fire behavior occurs for select button two, cut off room power supply at once ".It
Afterwards, terminal can obtain the selection of user according to the clicking operation of user.Illustratively, if user's select button one, terminal can
Doubtful instruction is released to generate, and is sent to household electrical appliance, if user's select button two, terminal can be generated confirmation fire behavior and refer to
Show.In other embodiments of the present invention, terminal can also be after user's select button two, directly instruction power-supply controller of electric cutting
The corresponding power supply of household electrical appliance group belonging to destination home appliance, wherein the corresponding power supply of household electrical appliance group is household electrical appliance group
In all household electrical appliance where the power supply in room or the power supply in house.
It, can if control device receives the doubtful instruction of releasing of terminal transmission after sending the doubtful fire behavior report
Non- fire behavior image set is added in heat source distributed image；If control device receives the confirmation fire behavior instruction of terminal transmission, will be high
Fire behavior image set is added in risk image.
It in embodiments of the present invention, can be according to heat source distribution map when non-fire behavior image set is added in heat source distributed image
The non-fire behavior image set of corresponding types is added in the type of picture, and illustratively, heat source distributed image includes thermodynamic chart, then can incite somebody to action
Non- fire behavior thermodynamic chart image set is added in the thermodynamic chart.
In embodiments of the present invention, the non-fire behavior image set obtained using the doubtful instruction of the releasing sent according to terminal, with
Determine the mode of low-risk image, and, it is indicated using the confirmation fire behavior sent according to terminal, to determine the side of high risk image
Formula can establish the image data base based on big data, provide more accurate support for the judgement of fire behavior.
The other technologies solution details and technical effect of the embodiment of the present invention can be referring to the phases in other embodiments of the invention
It speaks on somebody's behalf bright.
Embodiment three
The embodiment of the present invention provides a kind of method for safety monitoring, and the executing subject of the embodiment of the present invention can be target household
Electric appliance, server.Fig. 3 is the flow diagram three of method for safety monitoring provided in an embodiment of the present invention, as shown in figure 3, described
Method may comprise steps of:
S301, destination home appliance acquire monitoring information using sensor.
In embodiments of the present invention, before destination home appliance can be found in using the embodiment of sensor acquisition monitoring information
State the explanation in embodiment.
S302, destination home appliance send monitoring information to server.
In embodiments of the present invention, destination home appliance can send monitoring information to server by wireless network, lift
For example, the mobile network that can be provided by the WLAN or mobile operator of family sends monitoring information.
S303, server judge whether monitoring information reaches early-warning conditions.
In embodiments of the present invention, server judges whether monitoring information reaches the embodiment of early-warning conditions, and aforementioned
Judge that the step of whether monitoring information reaches the embodiment of early-warning conditions is similar by control device in embodiment, reference can be made to aforementioned
Explanation in embodiment.
S304, server send judging result to destination home appliance.
In embodiments of the present invention, judging result can be sent to household electrical appliance by server so that household electrical appliance according to
Judging result executes corresponding operation.
S305, destination home appliance send control signal when reaching early-warning conditions, to power-supply controller of electric.
In embodiments of the present invention, control signal is used to indicate power-supply controller of electric instruction power-supply controller of electric and cuts off the household electric
The corresponding power supply of household electrical appliance group belonging to device, the corresponding power supply of household electrical appliance group are each household electrical appliance in household electrical appliance group
The power supply in house where place room person.Wherein, household electrical appliance group includes destination home appliance, alternatively, household electrical appliance group includes
Destination home appliance and other household electrical appliance.
In other embodiments of the present invention, if judging result is that not up to early-warning conditions, server can also be by heat sources point
Cloth image is added to the corresponding non-fire behavior image library of destination home appliance.If judging result is to reach early-warning conditions, server can
Heat source distributed image is sent to terminal, if server receives the doubtful instruction of releasing of terminal transmission, then heat source is distributed
Image is added to the corresponding non-fire behavior image library of destination home appliance, if the confirmation fire behavior that server receives terminal transmission refers to
Show, then the high risk image extracted in heat source distributed image or heat source distributed image is added to the corresponding fire of the household electrical appliance
Feelings image library.
In other embodiments of the present invention, destination home appliance can also safeguard one group of non-fire behavior image library and fire behavior image
Library, if destination home appliance self maintained non-fire behavior image library and fire behavior image library, destination home appliance can according to from
The non-fire behavior image library and fire behavior image library of body storage execute in previous embodiment, utilize non-fire behavior image library and fire behavior image library
The step of judging in heat source distributed image with the presence or absence of the image information for meeting flame forms feature, later, destination home appliance
It can be according to judging result, it is determined whether send control signal to power-supply controller of electric.
It should be noted that server can be directed to each household electrical appliance group, a non-fire behavior image library is established respectively, from
And the success rate of identification background image region can be improved.Server can also be directed to one fire behavior of multiple household electrical appliance group maintenances
Image library, so as to improve the recognition success rate of detection flame forms feature.In other embodiments of the present invention, server is also
It can be for the unified non-fire behavior image library of multiple household electrical appliance group maintenances and fire behavior image library, it is hereby achieved that multiple.
In one example, in not up to early-warning conditions, the heat source that destination home appliance reports can be distributed by server
Image is added to the corresponding non-fire behavior image library of destination home appliance, alternatively, being added to the corresponding non-fire behavior figure of household electrical appliance group
As library, alternatively, being added to unified non-fire behavior image library.
In another example, when reaching early-warning conditions, heat source distributed image can be sent to terminal by server, if connecing
The doubtful instruction of releasing for receiving terminal transmission, is added to the corresponding non-fire behavior image of destination home appliance for heat source distributed image
Library, alternatively, being added to the corresponding non-fire behavior image library of household electrical appliance group, alternatively, being added to unified non-fire behavior image library, if connecing
The confirmation fire behavior instruction for receiving terminal transmission, the high risk image extracted in heat source distributed image or heat source distributed image is added
It is added to the corresponding fire behavior image library of destination home appliance, alternatively, it is corresponding to be added to household electrical appliance group belonging to destination home appliance
Fire behavior image library, alternatively, being added to unified fire behavior image library.
For example, above-mentioned server receives the step of monitoring information that destination home appliance is sent, and may include: to receive
The second monitoring information that the first monitoring information and the second household electrical appliance that first household electrical appliance are sent are sent；Wherein, the first household
Electric appliance and the second household electrical appliance may belong to the same household electrical appliance group.
Correspondingly, above-mentioned to judge that the step of whether monitoring information reaches early-warning conditions include: to judge the first monitoring
Whether information and the second monitoring information reach early-warning conditions；If the first monitoring information reaches early-warning conditions, security control behaviour is executed
Make；Wherein, security control operation includes: that household electrical appliance group belonging to instruction power-supply controller of electric the first household electrical appliance of cutting is corresponding
Power supply, the corresponding power supply of household electrical appliance group is the power supply in room where the first household electrical appliance and the second household electrical appliance, alternatively, first
The power supply in house where household electrical appliance and the second household electrical appliance.
In other embodiments of the present invention, server can also be identified from the heat source distributed image of the first household electrical appliance
Position where the heat source that the second household electrical appliance in the monitoring range of the first household electrical appliance generate；And detect the second household electric
Whether the distance between position and the first household electrical appliance where the heat source that device generates are less than preset safe distance；If being less than peace
Full distance sends prompting message to the corresponding terminal of the first household electrical appliance, to remind user mobile or close the second household electric
Device, to avoid the damage to the first household electrical appliance.Illustratively, prompting message may include detecting the first household electrical appliance
The distance between the heat source that bottom and the second household electrical appliance generate is less than safe distance, please move or close the second household electrical appliance.
Using aforesaid way, the server positioned at cloud can collect the data of full room household electrical appliances, and statistics domestic consumer is in
There is a situation where can provide more reliable valuable data to accident for product design and development in terms of fire caused by electricity.
The other technologies solution details and technical effect of the embodiment of the present invention can be referring to the phases in other embodiments of the invention
It speaks on somebody's behalf bright.
Example IV
The embodiment of the present invention provides a kind of safety monitoring system.Fig. 4 is method for safety monitoring provided in an embodiment of the present invention
The system framework schematic diagram of application, as shown in figure 4, system provided in an embodiment of the present invention may include: that server 41, data connect
Receiving unit 42, household electrical appliance 43 and power-supply controller of electric 44.
Wherein, server 41 can be cloud server, and it is imitative with spectral energy that cloud server can have data parsing
True atlas analysis module.Household electrical appliance 43 can be located in house, for example, household electrical appliance 43 can be cooking equipment.Power supply control
Device 44 processed may include the total lock of power supply and/or power supply branch switch.Data receiver 42 can be the access devices such as router.
In embodiments of the present invention, household electrical appliance 43 may include smoke sensor device 431, infrared sensor 432, spectrum biography
Sensor 433, temperature sensor 434, AD/DS converter 435, communication module 436, controller 437, power module 438.Wherein,
Household electrical appliance 43 can be communicated by communication module 436 with data receiver 42.In addition, household electrical appliance 43 can also lead to
Communication module 436 is crossed to communicate with power-supply controller of electric 44.In one example, household electrical appliance 43 can also pass through controller 437 and electricity
Source module 438 is communicated with power supply control 44 by power line.
Above system frame can actually provide a kind of application scenarios of cooking equipment with safety precaution function
System framework.
Based on above system frame, the fire alarm workflow of cooking equipment be may comprise steps of:
Step 1, smoke sensor device 431, outer red sensor 432, spectrum sensor 433, temperature sensing in cooking equipment
The sensor devices such as device 434, can detecte equipment state and ambient condition, so that user checks equipment state and ambient condition.
Wherein, it may include that culinary art is set that equipment state, which may include information, the ambient conditions such as the temperature of cooking equipment own target position,
Standby surrounding with the presence or absence of around heat source, cooking equipment with the presence or absence of information such as object gas.
The analog data of sensor can be converted to the number of computer capacity identification by step 2, ad/da converter 435
Signal, by digital data transmission to communication module 436.
Step 3, the sensing data that communication module 436 will acquire are transmitted by network by data receiver 42
To cloud server 41.
Step 4, server 41 pass through the distribution situation of pixel after smog parameter, infrared imaging, or even pass through spectrum sensing
Device analyzes the spectrum figure simulated.
Step 5, the threshold values of the parameters such as preset fire, poison gas in the available service system of server 41, according to full room
The data of middle sensor, available corresponding decision scheme, and then assign control instruction.
Illustratively, the pixel in the image after infrared imaging can be colour element.
It is as follows to the principle of the system, effect and description of use below.
In cooking equipment side, smoke sensor device can detecte gas leakage situation, the concentration etc. of pernicious gas.Culinary art is set
The standby sensor for being above also integrated with spectrum data gathering, infrared imaging, the data acquired by sensor can be former by imaging
Reason obtains simulation result, judges image pixel situation.
Server-side beyond the clouds, data parsing on cloud server and spectral energy emulation atlas analysis module can be with
It analyses whether fire, so that response control occur, timely prevents and control the generation of fire.Data are parsed
Afterwards, if there is abnormality occur, can internet message push by way of, by data-pushing to user, meanwhile, control can be issued
System instruction can timely control power-supply controller of electric 44 to controller 437, such as branch's cutting or full room cutting.
In addition, server 41 can collect the data of full room household electrical appliances, domestic consumer is counted in terms of fire caused by household electrical appliances
There is a situation where can provide more reliable valuable data to accident for product design and development.
In other embodiments of the present invention, household electrical appliance 43 (can not also be shown by communication module 436 and terminal in figure
It is communicated out).
In other embodiments of the present invention, which can apply in electric cooker, pressure cooker, refrigerator, water heater, wash
, can be integrated on the housed devices such as the mechanical, electrical view machine of clothing, smoke exhaust ventilator, electromagnetic oven, hot-water bottle, electric blanket, timely locate
The generation of reason and control disaster, the loss for allowing disaster to occur are reduced to minimum.
The other technologies solution details and technical effect of the embodiment of the present invention can be referring to the phases in other embodiments of the invention
It speaks on somebody's behalf bright.
Embodiment five
On the basis of stating embodiment before this invention, the embodiment of the present invention proposes a kind of safety monitoring device.Fig. 5 is this
The structural schematic diagram of the safety monitoring device of inventive embodiments, as shown in figure 5, the device can be located on control device, the dress
Set may include: to obtain module 51, processing module 52, control module 53；Wherein,
Module 51 is obtained, can be used for obtaining the monitoring information of destination home appliance；
Processing module 52, can be used for judging whether monitoring information reaches early-warning conditions；
Control module 53 executes security control operation if can be used for reaching early-warning conditions.
In embodiments of the present invention, control module 53 can be used for sending control signal to power-supply controller of electric, control signal
It is used to indicate the corresponding power supply of household electrical appliance group belonging to power-supply controller of electric cutting household electrical appliance, the corresponding power supply of household electrical appliance group
For the power supply in room or house where each household electrical appliance in household electrical appliance group；Wherein, household electrical appliance group may include mesh
Household electrical appliance are marked, alternatively, household electrical appliance group includes destination home appliance and other household electrical appliance.Illustratively, control module 53
It can be communicated by power line with power-supply controller of electric.
Safety monitoring device provided in an embodiment of the present invention positioned at household electrical appliance side can be used for executing previous embodiment
In any control device execute method for safety monitoring the step of.
The embodiment of the present invention provides a kind of control device, and Fig. 6 is that the structure of control device provided in an embodiment of the present invention is shown
It is intended to, as shown in fig. 6, the control device 600 includes at least: processor 601, memory 602, interface 603 and bus 604,
Wherein:
Memory 602, for storing security monitor program；
Bus 604, for realizing the connection communication between processor and memory；
Processor 601, for executing the security monitor program stored in memory, to perform the steps of acquisition target
The monitoring information of household electrical appliance；Judge whether monitoring information reaches early-warning conditions；If reaching the early-warning conditions, safety control is executed
System operation.
In embodiments of the present invention, control device 600 can be destination home appliance or server.
In embodiments of the present invention, when control device 600 is destination home appliance, interface 603 can be used for obtaining benefit
The monitoring information obtained with various sensors.In other embodiments of the present invention, interface 603 can be also used for sending to server
Monitoring information, and receive and enter the judging result for whether reaching early-warning conditions to monitoring information.
In embodiments of the present invention, when control device 600 is server, interface 603 can be used for receiving target household
The monitoring information that electric appliance is sent.In other embodiments of the present invention, interface 603 can be also used for destination home appliance transmission pair
Monitoring information is entered the judging result for whether reaching early-warning conditions.
In other embodiments of the present invention, interface 603 can be also used for establishing with power-supply controller of electric logical based on power line
Letter connection.
It should be noted that with the description of upper controller embodiment, be with the description of above method embodiment it is similar,
With the similar beneficial effect of same embodiment of the method, therefore do not repeat them here.For not disclosed in present inventor's electrical appliance embodiment
Technical detail, please refer to the description of embodiment of the present invention method and understand.
The embodiment of the present invention provides a kind of computer readable storage medium, and the computer-readable recording medium storage has one
A or multiple programs, one or more of programs can be executed by one or more processor, to perform the steps of
Obtain the monitoring information of destination home appliance；Judge whether monitoring information reaches early-warning conditions；If reaching early-warning conditions, peace is executed
Complete controlled operation.
It should be noted that one or more program in the embodiment of the present invention can be in other embodiments and be pacified
The security monitor program used when full monitoring.
It should be noted that the description of the above computer readable storage medium, the description with above method embodiment is class
As, there is with embodiment of the method similar beneficial effect, therefore do not repeat them here.For computer readable storage medium of the present invention
Undisclosed technical detail in embodiment, please refers to the description of embodiment of the present invention method and understands.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or the device that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or device institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, method of element, article or device.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in a storage medium
In (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal device (can be mobile phone, computer, clothes
Business device, air conditioner or the network equipment etc.) execute method described in each embodiment of the present invention.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (12)
1. a kind of method for safety monitoring, which is characterized in that be applied to control device, which comprises
Obtain the monitoring information of destination home appliance；
Judge whether the monitoring information reaches early-warning conditions；
If reaching the early-warning conditions, security control operation is executed.
2. the method according to claim 1, wherein execution security control operation includes:
Control signal is sent to power-supply controller of electric, the control signal is used to indicate the power-supply controller of electric and cuts off the target man
The corresponding power supply of household electrical appliance group belonging to electrical appliance, the corresponding power supply of the household electrical appliance group are in the household electrical appliance group
The power supply in room or house where each household electrical appliance.
3. judging whether the monitoring information reaches early warning item the method according to claim 1, wherein described
Part, comprising:
If the heat that the monitoring information is acquired including the use of the infrared sensor and/or spectrum sensor of the destination home appliance
Source distribution image judges to meet fire if it exists with the presence or absence of the image information for meeting flame characteristic in the heat source distributed image
The image information of flame feature, determination reach early-warning conditions；
If the concentration for the object gas that the monitoring information is acquired including the use of the smoke sensor device of the destination home appliance, sentences
Whether the target gas levels that break are greater than preset concentration threshold, and if more than concentration threshold, determination reaches early-warning conditions；
If the temperature for the target monitoring position that the monitoring information is acquired including the use of the temperature sensor of the destination home appliance
Degree, judges whether the temperature of the target monitoring position is greater than preset temperature threshold, and if more than temperature threshold, determination reaches pre-
Alert condition.
4. according to the method described in claim 3, it is characterized in that, with the presence or absence of symbol in the judgement heat source distributed image
Close the image information of flame characteristic, comprising:
Judge to meet fire if it exists with the presence or absence of the image information for meeting flame pixels distribution characteristics in the heat source distributed image
The image information of flame pixel distribution feature determines the image information for existing in the heat source distributed image and meeting flame characteristic；
Alternatively,
Judge in the heat source distributed image with the presence or absence of the image information for meeting flame forms feature；Meet flame-shaped if it exists
The image information of state feature determines the image information for existing in the heat source distributed image and meeting flame characteristic.
5. according to the method described in claim 3, it is characterized in that, with the presence or absence of symbol in the judgement heat source distributed image
Close the image information of flame forms feature, comprising:
Low-risk image-region is determined in the heat source distributed image, wherein the low-risk image-region is by low temperature figure
As at least one of region, nonflame spectrum picture region, background image region region determine；
The image after the low-risk image-region will be removed in the heat source distributed image as high risk image；
It determines in the high risk image with the presence or absence of the image information for meeting flame forms feature；
Meet the image information of flame forms feature if it exists, determination reaches early-warning conditions.
6. according to the method described in claim 5, it is characterized in that, described determine low-risk figure in the heat source distributed image
As region, comprising:
It, will be described if the thermodynamic chart that the heat source distributed image is acquired including the use of the infrared sensor of the destination home appliance
The temperature indicated in thermodynamic chart is determined as the low temperature image-region lower than the region of flame temperature range, and by the low temperature figure
As region is added in the low-risk image-region；
It, will be described if the spectrogram that the heat source distributed image is acquired including the use of the spectrum sensor of the destination home appliance
The region that the spectral band indicated in spectrogram is not belonging to flame spectrum wavelength band is determined as nonflame spectrum picture region, and
Nonflame spectrum picture region is added in the low-risk image-region.
7. according to the method described in claim 5, it is characterized in that, described determine low-risk figure in the heat source distributed image
As region, comprising:
Obtain non-fire behavior image set；
It is determined in the heat source distributed image to the similarity of the image in the non-fire behavior image set greater than preset similar
Spend the background image region of threshold value；
The background image region is added in the low-risk image-region.
8. meeting the method according to the description of claim 7 is characterized in that whether there is in the determination high risk image
The image information of flame forms feature, comprising:
Obtain fire behavior image set, wherein the fire behavior image set includes the image information of flame forms feature；
Determining in the high risk image whether there is and the image information of the flame forms feature in the fire behavior image set
Similarity is greater than the image of preset threshold；
Similarity is greater than the image of preset threshold if it exists, determines the image information for existing and meeting flame forms feature.
9. according to the method described in claim 8, it is characterized in that, the method also includes:
If the not up to described early-warning conditions, the non-fire behavior image set is added in the heat source distributed image；
If reaching the early-warning conditions, the doubtful fire behavior report for carrying the heat source distributed image is sent to terminal；
After sending the doubtful fire behavior report, if the doubtful instruction of releasing that the terminal is sent is received, by the heat source
The non-fire behavior image set is added in distributed image, if the confirmation fire behavior instruction that the terminal is sent is received, by the high risk
The fire behavior image set is added in image.
10. the method according to claim 1, wherein the acquisition destination home appliance monitoring information, comprising:
Acquire the monitoring information of destination home appliance；Alternatively,
Receive the monitoring information that the destination home appliance is sent.
11. a kind of control device, which is characterized in that the control device includes at least: memory, communication bus and processor,
Wherein:
The memory, for storing security monitor program；
The communication bus, for realizing the connection communication between processor and memory；
The processor, for executing the security monitor program stored in memory, to realize any one of claims 1 to 10
The step of described method for safety monitoring.
12. a kind of computer readable storage medium, which is characterized in that be stored with safe prison on the computer readable storage medium
Program is controlled, the safety prison as described in any one of claims 1 to 10 is realized when the security monitor program is executed by processor
The step of prosecutor method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810483407.2A CN110501914B (en) | 2018-05-18 | 2018-05-18 | Security monitoring method, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810483407.2A CN110501914B (en) | 2018-05-18 | 2018-05-18 | Security monitoring method, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110501914A true CN110501914A (en) | 2019-11-26 |
| CN110501914B CN110501914B (en) | 2023-08-11 |
Family
ID=68584113
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810483407.2A Active CN110501914B (en) | 2018-05-18 | 2018-05-18 | Security monitoring method, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110501914B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111123791A (en) * | 2019-12-28 | 2020-05-08 | 深圳市九洲电器有限公司 | Temperature control method of household appliance and related product |
| CN111860324A (en) * | 2020-07-20 | 2020-10-30 | 北京华正明天信息技术股份有限公司 | High-frequency component detection and color identification fire early warning method based on wavelet transformation |
| CN113269760A (en) * | 2021-05-31 | 2021-08-17 | 北京明略昭辉科技有限公司 | Infrared image heat source area detection method and device, electronic device and storage medium |
| CN113990027A (en) * | 2021-09-17 | 2022-01-28 | 珠海格力电器股份有限公司 | Alarm method and device, electronic equipment, intelligent bed and storage medium |
| CN114442539A (en) * | 2022-02-18 | 2022-05-06 | 深圳市华思特科技有限公司 | Security protection monitored control system based on intelligent electronic product |
Citations (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007329823A (en) * | 2006-06-09 | 2007-12-20 | Fujifilm Corp | Equipment control system and equipment control method |
| CN101833838A (en) * | 2010-05-27 | 2010-09-15 | 王巍 | Large-range fire disaster analyzing and early warning system |
| WO2012064115A2 (en) * | 2010-11-10 | 2012-05-18 | (주)선인유니텍 | Real-time fire-monitoring system using a closed-circuit television camera, and method therefor |
| CN103150549A (en) * | 2013-02-05 | 2013-06-12 | 长安大学 | Highway tunnel fire detecting method based on smog early-stage motion features |
| CN103886598A (en) * | 2014-03-25 | 2014-06-25 | 北京邮电大学 | Tunnel smoke detecting device and method based on video image processing |
| CN104079872A (en) * | 2014-05-16 | 2014-10-01 | 大连理工大学 | Video image processing and human-computer interaction method based on content |
| CN104132733A (en) * | 2014-07-04 | 2014-11-05 | 国家电网公司 | Combined-type infrared thermal imager and temperature detection method thereof |
| CN104198752A (en) * | 2014-08-18 | 2014-12-10 | 浙江大学 | High temperature steel billet motion state multi-rate detection method based on machine vision |
| CN104581076A (en) * | 2015-01-14 | 2015-04-29 | 国网四川省电力公司电力科学研究院 | Mountain fire monitoring and recognizing method and device based on 360-degree panoramic infrared fisheye camera |
| CN104658162A (en) * | 2013-11-19 | 2015-05-27 | 西安奥赛福科技有限公司 | Fire alarm control system |
| CN104685540A (en) * | 2013-09-27 | 2015-06-03 | 华为技术有限公司 | Image semantic segmentation method and apparatus |
| CN105046868A (en) * | 2015-06-16 | 2015-11-11 | 苏州华启智能科技股份有限公司 | Fire early warning method based on infrared thermal imager in narrow environment |
| CN105740866A (en) * | 2016-01-22 | 2016-07-06 | 合肥工业大学 | Rotary kiln sintering state recognition method with artificial feedback regulation mechanism |
| CN105788142A (en) * | 2016-05-11 | 2016-07-20 | 中国计量大学 | Video image processing-based fire detection system and detection method |
| CN105956591A (en) * | 2016-04-28 | 2016-09-21 | 中山大学 | On-line high-temperature part infrared image spectrum sampling detection method |
| CN106065771A (en) * | 2016-07-25 | 2016-11-02 | 中国石油天然气股份有限公司 | A kind of hypotonic Water-bearing Gas Reservoir builds the method and device producing constituency |
| CN106228540A (en) * | 2016-07-12 | 2016-12-14 | 西安中科英特光谱科技有限公司 | A kind of multispectral video flame detecting method |
| WO2016203562A1 (en) * | 2015-06-17 | 2016-12-22 | 株式会社日立国際電気 | Image processing device |
| CN106846305A (en) * | 2017-01-11 | 2017-06-13 | 华北电力大学 | A kind of boiler combustion stability monitoring method based on many characteristics of image of flame |
| CN106897720A (en) * | 2017-01-11 | 2017-06-27 | 济南中维世纪科技有限公司 | A kind of firework detecting method and device based on video analysis |
| CN206421192U (en) * | 2017-01-18 | 2017-08-18 | 长沙理工大学 | A kind of domestic safety prevention system based on Internet of Things |
| CN107527466A (en) * | 2017-07-31 | 2017-12-29 | 努比亚技术有限公司 | A kind of fire alarm method, terminal and computer-readable recording medium |
| CN107909615A (en) * | 2017-12-18 | 2018-04-13 | 广东广业开元科技有限公司 | A kind of fire monitor localization method based on binocular vision |
-
2018
- 2018-05-18 CN CN201810483407.2A patent/CN110501914B/en active Active
Patent Citations (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007329823A (en) * | 2006-06-09 | 2007-12-20 | Fujifilm Corp | Equipment control system and equipment control method |
| CN101833838A (en) * | 2010-05-27 | 2010-09-15 | 王巍 | Large-range fire disaster analyzing and early warning system |
| WO2012064115A2 (en) * | 2010-11-10 | 2012-05-18 | (주)선인유니텍 | Real-time fire-monitoring system using a closed-circuit television camera, and method therefor |
| CN103150549A (en) * | 2013-02-05 | 2013-06-12 | 长安大学 | Highway tunnel fire detecting method based on smog early-stage motion features |
| CN104685540A (en) * | 2013-09-27 | 2015-06-03 | 华为技术有限公司 | Image semantic segmentation method and apparatus |
| CN104658162A (en) * | 2013-11-19 | 2015-05-27 | 西安奥赛福科技有限公司 | Fire alarm control system |
| CN103886598A (en) * | 2014-03-25 | 2014-06-25 | 北京邮电大学 | Tunnel smoke detecting device and method based on video image processing |
| CN104079872A (en) * | 2014-05-16 | 2014-10-01 | 大连理工大学 | Video image processing and human-computer interaction method based on content |
| CN104132733A (en) * | 2014-07-04 | 2014-11-05 | 国家电网公司 | Combined-type infrared thermal imager and temperature detection method thereof |
| CN104198752A (en) * | 2014-08-18 | 2014-12-10 | 浙江大学 | High temperature steel billet motion state multi-rate detection method based on machine vision |
| CN104581076A (en) * | 2015-01-14 | 2015-04-29 | 国网四川省电力公司电力科学研究院 | Mountain fire monitoring and recognizing method and device based on 360-degree panoramic infrared fisheye camera |
| CN105046868A (en) * | 2015-06-16 | 2015-11-11 | 苏州华启智能科技股份有限公司 | Fire early warning method based on infrared thermal imager in narrow environment |
| WO2016203562A1 (en) * | 2015-06-17 | 2016-12-22 | 株式会社日立国際電気 | Image processing device |
| CN105740866A (en) * | 2016-01-22 | 2016-07-06 | 合肥工业大学 | Rotary kiln sintering state recognition method with artificial feedback regulation mechanism |
| CN105956591A (en) * | 2016-04-28 | 2016-09-21 | 中山大学 | On-line high-temperature part infrared image spectrum sampling detection method |
| CN105788142A (en) * | 2016-05-11 | 2016-07-20 | 中国计量大学 | Video image processing-based fire detection system and detection method |
| CN106228540A (en) * | 2016-07-12 | 2016-12-14 | 西安中科英特光谱科技有限公司 | A kind of multispectral video flame detecting method |
| CN106065771A (en) * | 2016-07-25 | 2016-11-02 | 中国石油天然气股份有限公司 | A kind of hypotonic Water-bearing Gas Reservoir builds the method and device producing constituency |
| CN106846305A (en) * | 2017-01-11 | 2017-06-13 | 华北电力大学 | A kind of boiler combustion stability monitoring method based on many characteristics of image of flame |
| CN106897720A (en) * | 2017-01-11 | 2017-06-27 | 济南中维世纪科技有限公司 | A kind of firework detecting method and device based on video analysis |
| CN206421192U (en) * | 2017-01-18 | 2017-08-18 | 长沙理工大学 | A kind of domestic safety prevention system based on Internet of Things |
| CN107527466A (en) * | 2017-07-31 | 2017-12-29 | 努比亚技术有限公司 | A kind of fire alarm method, terminal and computer-readable recording medium |
| CN107909615A (en) * | 2017-12-18 | 2018-04-13 | 广东广业开元科技有限公司 | A kind of fire monitor localization method based on binocular vision |
Non-Patent Citations (1)
| Title |
|---|
| 王腾;卜乐平;杨忠林;刘崎峰;杨宣访;: "一种基于连续帧图像相似度的火焰识别方法", 海军工程大学学报, no. 04, pages 48 - 52 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111123791A (en) * | 2019-12-28 | 2020-05-08 | 深圳市九洲电器有限公司 | Temperature control method of household appliance and related product |
| CN111860324A (en) * | 2020-07-20 | 2020-10-30 | 北京华正明天信息技术股份有限公司 | High-frequency component detection and color identification fire early warning method based on wavelet transformation |
| CN113269760A (en) * | 2021-05-31 | 2021-08-17 | 北京明略昭辉科技有限公司 | Infrared image heat source area detection method and device, electronic device and storage medium |
| CN113990027A (en) * | 2021-09-17 | 2022-01-28 | 珠海格力电器股份有限公司 | Alarm method and device, electronic equipment, intelligent bed and storage medium |
| CN114442539A (en) * | 2022-02-18 | 2022-05-06 | 深圳市华思特科技有限公司 | Security protection monitored control system based on intelligent electronic product |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110501914B (en) | 2023-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110501914A (en) | A kind of method for safety monitoring, equipment and computer readable storage medium | |
| CN106385457B (en) | Cloud service platform kitchen work environment intelligent warning method and system | |
| Nawaratne et al. | Self-evolving intelligent algorithms for facilitating data interoperability in IoT environments | |
| CN108398886A (en) | Household appliance control method, household electrical appliance and gateway of internet of things | |
| CN105380513A (en) | Electric pressure cooker and heating control method and device thereof | |
| US20220065457A1 (en) | Monitoring Cooking Appliances | |
| CN207164541U (en) | Cooking utensil and data processing system thereof | |
| CN110517441A (en) | Based on the frame-embedded smog of deep learning and flame video alarming system and method | |
| CN107293082A (en) | Smart home detection combustion gas uses the method and apparatus of security alarm | |
| CN208334937U (en) | A kind of smart kitchen systems | |
| CN109426191A (en) | Cooking appliance, data processing method and system thereof, storage medium and processor | |
| CN103605296A (en) | A kitchen device intelligent interaction system and an interaction method | |
| CN107331100A (en) | A kind of fire alarm method and system based on Internet of Things | |
| CN108431711A (en) | Apparatus monitors and controls | |
| TWM633365U (en) | Disaster-prevention message alert system for object recognition | |
| EP4295085A1 (en) | Camera-enabled machine learning for device control in a kitchen environment | |
| CN113587150A (en) | Integrated cooker locking method and device, storage medium and integrated cooker | |
| CN111594881A (en) | Intelligent gas stove detection and control system based on big data | |
| CN113920671B (en) | Fire linkage control method, device and equipment | |
| CN106790631A (en) | A kind of safety control system of intelligentized Furniture | |
| US11127267B2 (en) | Smart fire detection system | |
| Tsai et al. | Implementation of intelligent home appliances based on IoT | |
| CN107842890A (en) | A kind of intelligent fume exhauster | |
| CN111754736A (en) | Dry combustion method early warning system based on Internet of things | |
| CN112863104A (en) | Method and device for detecting fire hazard |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |