CN104320605A - Intercom system and intercom method - Google Patents

Intercom system and intercom method Download PDF

Info

Publication number
CN104320605A
CN104320605A CN201410528960.5A CN201410528960A CN104320605A CN 104320605 A CN104320605 A CN 104320605A CN 201410528960 A CN201410528960 A CN 201410528960A CN 104320605 A CN104320605 A CN 104320605A
Authority
CN
China
Prior art keywords
master controller
mobile terminal
area
video
sends
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410528960.5A
Other languages
Chinese (zh)
Other versions
CN104320605B (en
Inventor
车全宏
仲崇亮
徐勇
林晓清
李彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Entropy Technology Co Ltd
Original Assignee
SHENZHEN ZHONGKONG BIOMETRICS TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHENZHEN ZHONGKONG BIOMETRICS TECHNOLOGY Co Ltd filed Critical SHENZHEN ZHONGKONG BIOMETRICS TECHNOLOGY Co Ltd
Priority to CN201410528960.5A priority Critical patent/CN104320605B/en
Publication of CN104320605A publication Critical patent/CN104320605A/en
Application granted granted Critical
Publication of CN104320605B publication Critical patent/CN104320605B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The embodiment of the invention discloses an intercom system, which is used for enabling a user to receive intercom signals conveniently and improving user experience. The system of the invention comprises a central controller, a mobile end connected with the central controller, an outdoor machine connected with the central controller and an indoor machine connected with the central controller, wherein the outdoor machine is used for sensing visible intercom signals to the central connector; the central controller is used for forwarding the received visible intercom signals to the indoor machine, and when the signals are not received in the preset time, the indoor machine sends a response corresponding to the intercom signals, the visible intercom signals are forwarded to the mobile end; and the mobile end is used for receiving the visible intercom signals forwarded by the central controller, judging whether conversation between the outdoor machine corresponding to the visible intercom signals and the mobile end is built, and sending the judgment result to the central controller.

Description

A kind of intercom system and intercommunication method
Technical field
The present invention relates to communication technical field, particularly relate to a kind of intercom system and intercommunication method.
Background technology
Along with people have more and more higher requirement to the fail safe of living environment, high efficiency and comfortableness, building conversational system has been widely used on all kinds of building construction, and simultaneously people also progressively improve along with the high speed development of building talkback industry for the requirement of building conversational system.
Existing visible dialogue system, the indoor set comprising off-premises station, the master controller be connected with this off-premises station and be connected with this master controller, video intercom signal is sent to master controller by this off-premises station, this video intercom signal is forwarded to indoor set by this master controller, indoor user accepts the intercommunication request in this video intercom signal by this indoor set, realizes the video intercom session with visitor.
But because the indoor set in existing visible dialogue system is fixedly mounted on certain position of premises, when user is not in indoor, user is inconvenient to receive this intercommunication signal, causes poor user experience.
Summary of the invention
Embodiments provide a kind of intercom system, for receiving intercommunication signal by mobile terminal, thus making user's convenient reception intercommunication signal, promoting Consumer's Experience.
A kind of intercom system that the embodiment of the present invention provides, comprising:
Master controller, the mobile terminal be connected with described master controller, the off-premises station be connected with described master controller and the indoor set be connected with described master controller;
Described off-premises station, for sending video intercom signal to described master controller;
Described master controller, for forwarding the described video intercom signal received to described indoor set, when not receiving in preset duration, during corresponding with the described intercommunication signal response that described indoor set sends, forward described video intercom signal to described mobile terminal;
Described mobile terminal, for receiving the described video intercom signal that described master controller forwards, and judges whether the session of setting up the described off-premises station corresponding with described video intercom signal and described mobile terminal, and will send judged result to described master controller.
Alternatively, described intercom system also comprises:
The alarm be connected with described master controller;
Described off-premises station, also for obtaining monitor video, and is sent to described master controller by after described monitor video uncompressed encoding;
Described master controller, also for carrying out anomalous event analysis to the described monitor video received, when the result analyzed is anomalous event, sends described analysis result to described mobile terminal;
Described mobile terminal, also for the described analysis result received, judges whether to send alarm request, and sends described judged result to described master controller;
Described master controller, also for when receiving described judged result and corresponding to transmission alarm request, sends alarm signal to described alarm;
Described alarm, for sending alarm according to receiving described alarm signal from described master controller.
Preferably, described master controller, specifically for obtaining the Optical-flow Feature of the human body target in monitor video, and calculate described Optical-flow Feature vector histograms, calculate moving region entropy, the maximum calculated in the entropy of described moving region by described vector histograms, when the maximum of described moving region entropy in preset duration exceed predetermined threshold value time, sending analysis result to described mobile terminal is plunder and the abnormal events information of fighting.
Preferably, the formula of the vector histograms of the described Optical-flow Feature of described calculating comprises: wherein B represents the number of the motion vector in the R of moving region, represent the weights of i-th motion vector direction, represent the direction histogram interval that i-th motion vector is corresponding, j is Direction interval, and δ is Kronecker function, C hfor normalized parameter;
The formula of described calculating moving region entropy comprises: wherein h j(R) be motion vector direction histogram based on amplitude weighting, E (H) is Region Entropy;
The formula of described calculating maximum region entropy comprises: wherein n is areal.
Preferably, described master controller, specifically for obtaining video pictures in described monitor video and background image, calculate foreground image by described video pictures and described background image, calculate foreground area block by described foreground image, detect the angle point area of described foreground area block, when the angle point area of described foreground area block is less than predetermined threshold value, sending analysis result to described mobile terminal is the abnormal events information of crowd massing.
Preferably, the formula of described calculating foreground image comprises:
F ( x , y ) = 1 if | I ( x , y , t ) - BI ( x , y ) | > Thresh 0 otherwise Wherein I (x, y, the t) video frame images that is t, BI (x, y) is video fixed background, the foreground image that F (x, y) calculates for Background difference, and 1 represents foreground point, and 0 represents background dot, and Thresh is prospect threshold value;
The formula of described calculating foreground area block comprises: B ( i , j ) = 0 , Area ( B ) < T area 1 , Area ( B ) &GreaterEqual; T area Wherein B (i, j) represents foreground area block, and Area (B) represents the connected domain area of foreground area block, T arearepresent area threshold.
Preferably, flame area-of-interest is calculated specifically for the foreground image by described monitor video, obtain the fusion feature of described flame area-of-interest, when determining that described fusion feature is 1, sending analysis result to described mobile terminal is the abnormal events information of setting on fire.
Preferably, the formula of described calculating flame area-of-interest comprises:
R ( i , j ) = I ( i , j ) ifF ( i , j ) = 1 0 otherwise Wherein F (i, j) is the pixel in the foreground image that extracts, and I (i, j) is pixel in primitive frame image, the pixel that R (i, j) is area-of-interest.
Alternatively, described intercom system also comprises:
The memory be connected with described master controller;
Described memory, for storing, described master controller sends, the record of the anomalous event analytic record that video intercom record, described master controller that the monitored picture that the video intercom data produced in the process that described off-premises station and described mobile terminal or described indoor set conversate, described off-premises station obtain, described off-premises station are initiated to described master controller send and the described memory of access that described mobile terminal is initiated;
Described mobile terminal, also for sending described memory access signals to described master controller;
Described master controller, also for receiving the described memory access signals that described mobile terminal sends, and judging that whether the identity of described mobile terminal is legal, if so, then setting up the connection between described mobile terminal and described memory.
Alternatively, described master controller, also for forwarding to described indoor set, from the identity verify signal that described off-premises station receives, when not receiving the response of the described identity verify signal of correspondence that described indoor set sends in described preset duration, forward described identity verify signal to described mobile terminal;
Described mobile terminal, also for judging whether the identity of the described visitor that described identity verify signal is corresponding is verified, and sends judged result to described master controller.
The embodiment of the present invention also provides a kind of intercommunication method, comprising:
Off-premises station sends video intercom signal to master controller;
Described master controller forwards the described video intercom signal received to described indoor set, when not receiving in preset duration, during corresponding with the described intercommunication signal response that described indoor set sends, forward described video intercom signal to mobile terminal;
Described mobile terminal receives the described video intercom signal that described master controller forwards, and judges whether the session of setting up the described off-premises station corresponding with described video intercom signal and described mobile terminal, and will send judged result to described control module.
Alternatively, it is characterized in that, also comprise:
Described off-premises station obtains monitor video, and is sent to described master controller by after described monitor video uncompressed encoding;
Described master controller carries out anomalous event analysis to the described monitor video received, and when analysis result is anomalous event, sends described analysis result to described mobile terminal;
Described mobile terminal, according to the described analysis result received, judges whether to send alarm request, and sends described judged result to described master controller;
When described master controller receive judged result correspond to send alarm request time, send to described alarm life signal of reporting to the police;
Described alarm sends alarm according to described alarm signal.
Preferably, described master controller carries out anomalous event analysis to the described monitor video received, and when analysis result is anomalous event, sends described analysis result comprise to described mobile terminal:
Described master controller obtains the Optical-flow Feature of the human body target in monitor video, and calculate described Optical-flow Feature vector histograms, calculate moving region entropy, the maximum calculated in the entropy of described moving region by described vector histograms, when the maximum of described moving region entropy in preset duration exceed predetermined threshold value time, then described analysis result is plunder and the abnormal events information of fighting, and sends described abnormal events information to described mobile terminal.
Preferably, the formula of the vector histograms of the described Optical-flow Feature of described calculating comprises: wherein B represents the number of the motion vector in the R of moving region, represent the weights of i-th motion vector direction, represent the direction histogram interval that i-th motion vector is corresponding, j is Direction interval, and δ is Kronecker function, C hfor normalized parameter;
The formula of described calculating moving region entropy comprises: wherein h j(R) be motion vector direction histogram based on amplitude weighting, E (H) is Region Entropy;
The formula of described calculating maximum region entropy comprises: wherein n is areal, E max(H) be maximum region entropy.
Preferably, described master controller carries out anomalous event analysis to the described monitor video received, and when analysis result is anomalous event, sends described analysis result comprise to described mobile terminal:
Described master controller obtains video pictures in described monitor video and background image, calculate foreground image by described video pictures and described background image, calculate foreground area block by described foreground image, detect the angle point area of described foreground area block, when the angle point area of described foreground area block is less than predetermined threshold value, then described analysis result is the abnormal events information of crowd massing, and sends described abnormal events information to described mobile terminal.
Preferably, the formula of described calculating foreground image comprises:
F ( x , y ) = 1 if | I ( x , y , t ) - BI ( x , y ) | > Thresh 0 otherwise Wherein I (x, y, the t) video frame images that is t, BI (x, y) is video fixed background, the foreground image that F (x, y) calculates for Background difference, and 1 represents foreground point, and 0 represents background dot, and Thresh is prospect threshold value;
The formula of described calculating foreground area block comprises: B ( i , j ) = 0 , Area ( B ) < T area 1 , Area ( B ) &GreaterEqual; T area Wherein B (i, j) represents foreground area block, and Area (B) represents the connected domain area of foreground area block, T arearepresent area threshold.
Preferably, described master controller carries out anomalous event analysis to the described monitor video received, and when analysis result is anomalous event, sends described analysis result comprise to described mobile terminal:
Described master controller calculates flame area-of-interest by the foreground image of described monitor video, obtain the fusion feature of described flame area-of-interest, when determining that described fusion feature is 1, then described analysis result is the abnormal events information of setting on fire, and sends described abnormal events information to described mobile terminal.
Preferably, the formula of described calculating flame area-of-interest comprises:
R ( i , j ) = I ( i , j ) ifF ( i , j ) = 1 0 otherwise Wherein F (i, j) is the pixel in the foreground image that extracts, and I (i, j) is pixel in primitive frame image, the pixel that R (i, j) is area-of-interest.
A kind of intercom system that the embodiment of the present invention provides and intercommunication method, when in the duration preset, when indoor set does not send the response corresponding to intercommunication signal, this intercommunication signal can be forwarded to mobile terminal, and judge whether the session of setting up the described off-premises station corresponding with described video intercom signal and described mobile terminal by this mobile terminal, and make user can receive intercommunication signal more easily, practical, promote Consumer's Experience, can user's request be better met.
Accompanying drawing explanation
Fig. 1 is the structural representation of a kind of intercom system in the embodiment of the present invention;
Fig. 2 is the structural representation of another kind of intercom system in the embodiment of the present invention;
Fig. 3 is the structural representation of another kind of intercom system in the embodiment of the present invention;
Fig. 4 is the structural representation of another kind of intercom system in the embodiment of the present invention;
Fig. 5 is an embodiment intention of a kind of intercommunication method in the embodiment of the present invention;
Fig. 6 is an embodiment intention of another kind of intercommunication method in the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those skilled in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Refer to Fig. 1, the structural representation of a kind of intercom system 100 that Fig. 1 provides for the embodiment of the present invention, wherein this intercom system 100 comprises:
Master controller 102, the mobile terminal 103 be connected with described master controller 102, the off-premises station 101 be connected with described master controller 102 and the indoor set 104 be connected with described master controller 102;
Described off-premises station 101, for sending video intercom signal to described master controller 102;
Be understandable that, described off-premises station is equipped with camera, this off-premises station is provided with called hole and some buttons, visitor sends video intercom signal by the button on off-premises station to master controller 102, it should be noted that, this off-premises station can also arrange other common function parts such as card reader, and the mode sending video intercom signal in addition specifically can also be not construed as limiting by other modes such as speech recognitions herein.
Master controller 102, for receiving the video intercom signal that described off-premises station 101 sends, and the described video intercom signal received is forwarded to described indoor set 104, when not receiving in preset duration, during corresponding with the described intercommunication signal response that described indoor set sends, forward described video intercom signal to described mobile terminal 103;
It should be noted that, in the present embodiment, master controller 102 is connected by 3G network with mobile terminal 103, and in actual applications, master controller 102 and mobile terminal 103, by being connected by 2G, 4G or wifi, are not construed as limiting herein.
Described mobile terminal 103, for receiving the described video intercom signal that described master controller 102 forwards, and judge whether to set up the described off-premises station 101 corresponding with described video intercom signal and the session of described mobile terminal 103, and judged result will be sent to described master controller 102.
Seen from the above description, a kind of intercom system 100 that the embodiment of the present invention provides, when in the duration preset, when indoor set 104 does not have to send the response corresponding to intercommunication signal, this intercommunication signal can be forwarded to mobile terminal 103 by master controller 102, and judge whether to set up the described off-premises station 101 corresponding with described video intercom signal and the session of described mobile terminal 103 by this mobile terminal 103, make user can receive intercommunication signal more easily, practicality is high, can better meet user's request.
Visible dialogue system in above-described embodiment can realize video intercom signal to be sent to mobile terminal by network, enhance operability and the convenience of this intercom system, in actual applications, alarm can also be comprised in visible dialogue system, when there is anomalous event, alarm is sent by this alarm, can Timeliness coverage perimeter security hidden danger, promote the safety of resident family, below another visible dialogue system in the embodiment of the present invention is described, refer to Fig. 2, the structural representation of another visible dialogue system 200 that the embodiment of the present invention provides, this visible dialogue system 200 specifically to comprise totally:
Master controller 202, the mobile terminal 203 be connected with described master controller 202, the off-premises station 201 be connected with described master controller 202, the indoor set 204 be connected with described master controller 202 and the alarm 205 be connected with described master controller 202;
Described off-premises station 201, for obtaining monitor video, and is sent to described master controller 202 by after described monitor video uncompressed encoding;
It should be noted that, off-premises station 201 described in the present embodiment is provided with infrared camera, this off-premises station 201 obtains monitor video by this infrared camera, this off-premises station 201 passes through wired connection with master controller 202, in actual applications, also can obtain monitor video by other watch-dogs be connected with off-premises station 201, be not construed as limiting herein, this off-premises station 201 also can be connected by wireless network with master controller 202 in addition, is not construed as limiting herein.
Described master controller 202, for carrying out anomalous event analysis to the described monitor video received, when the result analyzed is anomalous event, sends described analysis result to described mobile terminal 203.
It should be noted that, in the present embodiment, Embedded Hardware Platform is integrated with in master controller 202, by this Embedded Hardware Platform, the exception in monitor video is analyzed, and send described analysis result to mobile terminal 203, in actual applications, this master controller 202 can also send analysis result to indoor set, is not construed as limiting herein.
Described mobile terminal 203, for the described analysis result received, judges whether to send alarm request, and sends described judged result to described master controller 202.
What needs were said is, in the present embodiment, mobile terminal 203 can be mobile phone, panel computer or other mobile terminals, be not construed as limiting herein, the analysis result that this mobile terminal 203 receives can be the short message carrying anomalous event type that master controller sends, or the monitor video of anomalous event is defined as by master controller 202, be not construed as limiting herein, in addition in the present embodiment, after mobile terminal 203 receives analysis result, user judges this analysis result, and inputs judged result, and this mobile terminal 203 sends this judged result to master controller 202.
Described master controller 202, for when receiving judged result and corresponding to transmission alarm request, sends to described alarm 205 life signal of reporting to the police.
The judged result that master controller 202 sends for receiving mobile terminal 203, when this judged result corresponds to transmission alarm request, this master controller 202 sends alarm signal to described alarm 205.
Described alarm 205, for sending alarm according to described alarm signal.
Alarm 205 sends alarm after receiving the alarm signal of master controller 202.
Be understandable that, alarm can for loudspeaker, buzzer, electric bell or other can be used for report to the police equipment, be not construed as limiting herein.
A kind of intercom system 200 that the embodiment of the present invention provides, monitor video is obtained by the infrared camera of off-premises station 201, and send this monitor video to master controller 202, this master controller 202 pairs of monitor videos are analyzed, when analysis result is anomalous event, this analysis result is sent to mobile terminal 203, when mobile terminal 203 is judged as sending alarm request to this point of result, this judged result is sent to master controller 202, this center controls 202 and sends alarm signal according to the alarm request of mobile terminal transmission to alarm 205, this alarm 205 sends alarm according to alarm signal, it can thus be appreciated that, this intercom system 200 can make user receive abnormal information more easily, practicality is high, the analysis to anomalous event can also be realized in addition, and alarm can be sent by alarm, thus make the potential safety hazard of resident family's Timeliness coverage house periphery, be conducive to the fail safe promoting resident family's inhabitation.
Above in embodiment, the master controller of visible dialogue system can be analyzed the anomalous event in monitor video, in actual applications, this master controller specifically can be analyzed the robbery in monitor video and event of fighting, crowd massing event, the anomalous events such as event of setting on fire by corresponding algorithm, below another intercom system that the embodiment of the present invention provides is analyzed, refer to Fig. 3, embodiments provide the structural representation of another intercom system 300, this comprises system 300:
Master controller 302, the mobile phone 303 be connected with described master controller 302, the off-premises station 301 be connected with described master controller 302, the indoor set 304 be connected with described master controller 302 and the loudspeaker 305 be connected with described master controller 302;
Described off-premises station 301, for obtaining monitor video, and is sent to described master controller 302 by after described monitor video uncompressed encoding;
It should be noted that, off-premises station 301 described in the present embodiment is provided with infrared camera, this off-premises station 301 obtains monitor video by this infrared camera, this off-premises station 301 passes through wired connection with master controller 302, in actual applications, also can obtain monitor video by other watch-dogs be connected with off-premises station 301, be not construed as limiting herein, this off-premises station 301 also can be connected by wireless network with master controller 302 in addition, is not construed as limiting herein.
Described master controller 302, for carrying out anomalous event analysis to the described monitor video received, when the result analyzed is anomalous event, sends described analysis result to described mobile terminal 303.
Wherein, master controller 302 carries out anomalous event analysis specifically comprise following three kinds of situations to receiving monitor video:
One, center controls the analysis that 302 pairs of monitor videos carry out robbery and event of fighting:
Master controller 302 is for obtaining the Optical-flow Feature of the human body target in monitor video, with the Optical-flow Feature of movement human target for principal character, calculating kinematical vector direction histogram, and adopt motion vector magnitude to be weighted, weights on the motion vector direction that amplitude is larger are also corresponding larger, wherein, the mode calculating the vector histograms of described Optical-flow Feature is, first motion vector magnitude is normalized, as the weights of motion vector direction, then motion vector magnitude is sued for peace as the histogrammic size of motion vector direction; Calculate the histogrammic accumulation entropy of motion vector direction again, the histogrammic accumulation entropy of this motion vector direction is used for weighing confusion degree in moving region, and entropy is larger, and confusion degree is larger; Calculate in multiple moving region and get maximum Region Entropy:
Wherein, in the R of moving region, direction Histogram graph model is H (R)={ h j(R) } j=1,2,3 ..., m, m is the number of direction histogram, and the formula of calculating kinematical vector direction histogram is:
wherein B represents the number of the motion vector in the R of moving region, represent the weights of i-th motion vector direction, represent the direction histogram interval that i-th motion vector is corresponding, j is Direction interval, and δ is Kronecker function, C hfor normalized parameter;
The formula calculating moving region entropy is: wherein h j(R) be motion vector direction histogram based on amplitude weighting, E (H) is Region Entropy;
The formula calculating maximum region entropy is: wherein n is areal.
When the maximum of the moving region entropy calculated in preset duration exceed predetermined threshold value time, controller 302 show that analysis result is plunder and the anomalous event of fighting, and sends the information of the anomalous event that this is fought to mobile phone 303.
Two, master controller 302 pairs of monitor videos carry out the analysis of crowd massing event:
Described master controller 302, adopt foreground extraction algorithm from video image, extract movement human target, because camera is installed fixing, the monitoring background of camera is made also to have stationarity, so can first obtain fixing background, then Background difference subtracting background image from video image is used to obtain foreground area, then foreground image is calculated by described video pictures and described background image, can judge whether crowd assembles by the angle point area of foreground area block, concrete account form is: first calculate foreground image by video pictures and background image, foreground area block is calculated again by described foreground image, then the angle point area of described foreground area block is detected, wherein:
The formula calculating foreground image is: F ( x , y ) = 1 if | I ( x , y , t ) - BI ( x , y ) | > Thresh 0 otherwise Wherein I (x, y, the t) video frame images that is t, BI (x, y) is video fixed background, the foreground image that F (x, y) calculates for Background difference, and 1 represents foreground point, and 0 represents background dot, and Thresh is prospect threshold value;
The formula calculating foreground area block is: B ( i , j ) = 0 , Area ( B ) < T area 1 , Area ( B ) &GreaterEqual; T area Wherein B (i, j) represents foreground area block, and Area (B) represents the connected domain area of foreground area block, T arearepresent area threshold.
Wherein, the angle point area pattern detecting described foreground area block is, adopt Harris Corner Detection Algorithm to carry out Corner Detection to foreground area block, after the angle point getting foreground area block, calculate the angle point area of foreground area block by the value of the covariance matrix determinant of angular coordinate collection.
It should be noted that, when the angle point area of foreground area block is larger, illustrate that angle point is overstepping the bounds of propriety loose, crowd is also just overstepping the bounds of propriety loose; Otherwise the angle point area of foreground area block is less, illustrates that angle point is more intensive, and crowd is also more intensive; When the angle point area of foreground area block is from diminishing gradually greatly, illustrate that angle point is gathered from being distributed to, crowd assembles; Otherwise the angle point area of foreground area block is large from little change, and illustrate that angle point is from being brought to dispersion, crowd disperses; Finally, fluctuate up and down, and fluctuation range is very little if the angle point area of foreground area block maintains a specified level, explanation crowd in original place activity or may hover.
Finally, after above-mentioned process is carried out to the video image of continuous multiple frames, can analyze the motion conditions of crowd, and judge whether crowd exists the trend of gathering, if there is aggregation tendency, the abnormal information that controller 302 generates crowd massing event is transferred to mobile phone 303.
Three, master controller 302 pairs of monitor videos carry out people and to set on fire the analysis of event:
Master controller 302, first calculates foreground image by said method, obtains preliminary flame candidate region by this foreground image, is then increased the integrality of flame region by region-growing method.Then Utilization prospects image extracts the area-of-interest (ROI) of flame on primitive frame image as mask, that is, flame area-of-interest is calculated by the foreground image of described monitor video, after acquisition flame area-of-interest, under color difference signal (YCrCb) color space, utilize Digital Image Processing (LBP0) operator to obtain the textural characteristics of area-of-interest, and linear Fusion of Color feature and textural characteristics, thus obtain the fusion feature of described flame area-of-interest, wherein, LBP characteristic parameter surveys processing procedure: entire image is carried out 3 × 3 segmentations and obtain 9 sub-blocks, the LBP characteristic value that pixel in each sub-block carries out 3 × 3 neighborhoods calculates, uniform pattern is adopted to obtain 59 dimensional feature vectors, whole sub-block carries out Fusion Features, the LBP characteristic vector obtaining view picture sample image is 9 be multiplied by 59=531 dimension, differentiated by linear SVM (Linear-SVM) fusion feature to area-of-interest of off-line training again, if be 1, represent that this region may exist flame, otherwise there is not flame in this region.When all detecting that flame occurs in continuous multiple frames video image, the abnormal information that master controller 302 generates event of setting on fire is transferred to mobile phone 303.
Wherein, the formula calculating flame area-of-interest is: R ( i , j ) = I ( i , j ) ifF ( i , j ) = 1 0 otherwise Wherein F (i, j) is the pixel in the foreground image that extracts, and I (i, j) is pixel in primitive frame image, the pixel that R (i, j) is area-of-interest.
It should be noted that, in the embodiment of the present invention, the analysis mode that controller 302 pairs of monitor videos carry out anomalous event is above three types, in actual applications, controller 302 in conjunction with above three kinds of modes or can also be analyzed anomalous event by other means, is not construed as limiting herein.
Described mobile phone 303, for the above-mentioned analysis result received, judges whether to send alarm request, and to described master controller 302 these judged results.
What needs were said is, in the present embodiment, mobile terminal is mobile phone 303, the operating system of this mobile phone is Android system, in actual applications, this mobile terminal can also be panel computer or other mobile terminals, be not construed as limiting herein, the operating system of this mobile phone can also be Apple Macintosh operating system, Saipan operation system or other mobile phone operating systems, be not construed as limiting herein, the analysis result that this mobile phone 303 receives can be the short message carrying anomalous event type that master controller sends, or the monitor video of anomalous event is defined as by master controller 302, be not construed as limiting herein, in addition in the present embodiment, after mobile phone 303 receives analysis result, user is judged this analysis result by mobile phone 303, and input judged result, this mobile phone 303 sends this judged result to master controller 302.
Master controller 302, for when receiving judged result and corresponding to transmission alarm request, sends to loudspeaker 305 life signal of reporting to the police.
Loudspeaker 305, for reporting alarm sound according to described alarm signal.
Be understandable that, in the present embodiment, alarm is loudspeaker, in actual applications, this alarm can also for buzzer, electric bell or other can be used for report to the police equipment, be not construed as limiting herein.
A kind of intercom system 300 that the embodiment of the present invention provides, monitor video is obtained by the infrared camera of off-premises station 301, and send this monitor video to master controller 302, this master controller 302 pairs of monitor videos carry out plundering the analysis with event of fighting, the analysis of crowd massing event, during the analysis of event of setting on fire, this analysis result is sent to mobile phone 303, when mobile phone 303 is judged as sending alarm request to this analysis result, this judged result is sent to master controller 302, this center controls 302 and sends alarm signal according to the alarm request of mobile terminal transmission to loudspeaker 305, these loudspeaker 305 play alarm sound according to alarm signal, it can thus be appreciated that, this intercom system 300 can realize the analysis to anomalous event, and alarm can be sent by loudspeaker when confirming transmission anomalous event, be conducive to the fail safe promoting resident family's inhabitation, additionally by different algorithmic formulas, monitor video is carried out plundering the analysis with the analysis of event of fighting, the analysis of crowd massing event and event of setting on fire, the major safety risks of discovery house periphery that can be more correct, promote the residential security of resident family further.
Above in embodiment, visible dialogue system can realize analysis monitor video being carried out to anomalous event, and send alarm by the alarm in this visible dialogue system, actual should in, this visible dialogue system can also comprise memory, for storing data and the record of the generation of visible dialogue system running, and the mobile terminal in this visible dialogue system can the data of storage in this memory of remote access and record, below another visible dialogue system in the embodiment of the present invention is described, refer to Fig. 4, the schematic diagram of another visible dialogue system 400 that the embodiment of the present invention provides, this visible dialogue system 400 specifically comprises:
Master controller 402, the mobile terminal 403 be connected with described master controller 402, the off-premises station 401 be connected with described master controller 402, the indoor set 404 be connected with described master controller 402, the alarm 405 be connected with described master controller 402 and with described master controller 402 associative memory 406.
Described off-premises station 401, for sending video intercom signal to described master controller 402, also for obtaining monitor video, and is sent to described master controller 402 by after described monitor video uncompressed encoding;
Described master controller 402, for forwarding described intercommunication signal, also for carrying out anomalous event analysis to the described monitor video received, when the result analyzed is anomalous event, sends described analysis result to described mobile terminal 403.
Described mobile terminal 403, the video intercom session between the described mobile terminal corresponding with described intercommunication signal and described off-premises station is set up for judging whether the described intercommunication signal received, and send judged result to described master controller, also for the described analysis result received, judge whether to send alarm request, and send described judged result to described master controller 402, also for sending memory access signals to described master controller 402.
Described master controller 402, also for when receiving judged result and corresponding to transmission alarm request, sends to described alarm 405 life signal of reporting to the police.
Master controller 402, for receiving the judged result that mobile terminal 403 sends, when this judged result is that when setting up the video intercom session between described mobile terminal 403 and described off-premises station 401, the video intercom session between described mobile terminal and described off-premises station set up by shown master controller, when this judged result corresponds to transmission alarm request, this master controller 402 sends alarm signal to described alarm 405, when receiving reference to storage 406 and asking, authentication is carried out to described mobile terminal, when identity test pass through time, set up described mobile terminal 403 to be connected with between described memory, realize the access of the 403 pairs of memories 406 in mobile terminal, also for sending to described memory 406, the video intercom data produced in the process that described off-premises station 401 and described mobile terminal 403 or described indoor set 404 conversate, the monitored picture that described off-premises station 401 obtains, the video intercom record that described off-premises station 401 is initiated to described master controller 402, the anomalous event analytic record that described master controller 402 sends, and the record of the described memory 406 of access of described mobile terminal 403 initiation.
Described alarm 405, for sending alarm according to described alarm signal.
Alarm 405 sends alarm after receiving the alarm signal of master controller 402.
Memory 406, for storing, described master controller 402 sends, the record of the anomalous event analytic record that video intercom record, described master controller 402 that the monitored picture that the video intercom data produced in the process that described off-premises station 401 and described mobile terminal 403 or described indoor set 404 conversate, described off-premises station 401 obtain, described off-premises station 401 are initiated to described master controller 402 send and the described memory 406 of access that described mobile terminal 403 is initiated.
In the embodiment of the present invention, visible dialogue system 400 comprises memory 406, can store described master controller 402 send, the video intercom data produced in the process that described off-premises station 401 and described mobile terminal 403 or described indoor set 404 conversate, the monitored picture that described off-premises station 401 obtains, the video intercom record that described off-premises station 401 is initiated to described master controller 402, the anomalous event analytic record that described master controller 402 sends, and the record of the described memory 406 of access of described mobile terminal 403 initiation, can check for user, practical, by the data in the reference to storage of mobile terminal, user's Information at any time can be facilitated in addition.
In the visible dialogue system provided in embodiment above, master controller 402 is also for forwarding described identity verify signal to mobile terminal 403; Described mobile terminal 403 also can be used for judging whether the identity of the described visitor that described identity verify signal is corresponding is verified, and feed back described judged result to described master controller 402, described master controller 402, can also be used for when the judged result received correspond to authentication differentiate pass through time, open gate inhibition, thus make this intercom system 400 can by mobile terminal 403 convenient realize identity verify function, practical.
Above in embodiment, be described the intercom system of the embodiment of the present invention, be described below, refer to Fig. 5 to a kind of intercommunication method that the embodiment of the present invention provides, a kind of intercommunication method that the embodiment of the present invention provides comprises:
501, off-premises station sends video intercom signal to master controller.
Be understandable that, described off-premises station is equipped with camera, this off-premises station is provided with called hole and some buttons, visitor sends video intercom signal by the button on off-premises station to master controller 102, it should be noted that, this off-premises station can also arrange other common function parts such as card reader, and the mode sending video intercom signal in addition specifically can also be not construed as limiting by other modes such as speech recognitions herein.
502, master controller forwards the described video intercom signal received to described indoor set, when not receiving in preset duration, during corresponding with the described intercommunication signal response that described indoor set sends, forwards described video intercom signal to mobile terminal.
Be understandable that, described off-premises station is equipped with camera, this off-premises station is provided with called hole and some buttons, visitor sends video intercom signal by the button on off-premises station to master controller, it should be noted that, this off-premises station can also arrange other common function parts such as card reader, and the mode sending video intercom signal in addition specifically can also be not construed as limiting by other modes such as speech recognitions herein.
503, mobile terminal receives the described video intercom signal that described master controller forwards, and judges whether the session of setting up the described off-premises station corresponding with described video intercom signal and described mobile terminal, and will send judged result to described control module.
In the embodiment of the present invention, by master controller, this intercommunication signal is forwarded to mobile terminal, and judge whether the session of setting up the described off-premises station corresponding with described video intercom signal and described mobile terminal by this mobile terminal, make user can receive intercommunication signal more easily, practicality is high, can better meet user's request.
Above in embodiment, video intercom signal is sent to mobile terminal by network, enhance operability and the convenience of this intercom system, actual should in, monitor video can also be obtained by off-premises station, and by master controller, anomalous event analysis is carried out to this monitor video, thus perimeter security hidden danger can be found, promote the fail safe of resident family, below another the intercommunication method in the invention process is described, refer to Fig. 6, another intercommunication method that the embodiment of the present invention provides comprises:
601, off-premises station obtains monitor video, and is sent to described master controller by after described monitor video uncompressed encoding.
602, master controller carries out anomalous event analysis to the described monitor video received, and when the result analyzed is anomalous event, sends described analysis result to described mobile terminal.
Wherein, master controller carries out anomalous event analysis specifically comprise following three kinds of situations to receiving monitor video:
Master controller obtains the Optical-flow Feature of the human body target in monitor video, with the Optical-flow Feature of movement human target for principal character, calculating kinematical vector direction histogram, and adopt motion vector magnitude to be weighted, weights on the motion vector direction that amplitude is larger are also corresponding larger, wherein, the mode calculating the vector histograms of described Optical-flow Feature is, first motion vector magnitude is normalized, as the weights of motion vector direction, then motion vector magnitude is sued for peace as the histogrammic size of motion vector direction; Calculate the histogrammic accumulation entropy of motion vector direction again, the histogrammic accumulation entropy of this motion vector direction is used for weighing confusion degree in moving region, and entropy is larger, and confusion degree is larger; Calculate in multiple moving region and get maximum Region Entropy:
Wherein, in the R of moving region, direction Histogram graph model is H (R)={ h j(R) } j=1,2,3 ..., m, m is the number of direction histogram, and the formula of calculating kinematical vector direction histogram is:
wherein B represents the number of the motion vector in the R of moving region, represent the weights of i-th motion vector direction, represent the direction histogram interval that i-th motion vector is corresponding, j is Direction interval, and δ is Kronecker function, C hfor normalized parameter;
The formula calculating moving region entropy is: wherein h j(R) be motion vector direction histogram based on amplitude weighting, E (H) is Region Entropy;
The formula calculating maximum region entropy is: wherein n is areal.
When the maximum of the moving region entropy calculated in preset duration exceed predetermined threshold value time, controller show that analysis result is plunder and the anomalous event of fighting, and sends the information of the anomalous event that this is fought to mobile phone.
Two, master controller carries out the analysis of crowd massing event to monitor video:
Described master controller adopts foreground extraction algorithm from video image, extract movement human target, because camera is installed fixing, the monitoring background of camera is made also to have stationarity, so can first obtain fixing background, then Background difference subtracting background image from video image is used to obtain foreground area, then foreground image is calculated by described video pictures and described background image, can judge whether crowd assembles by the angle point area of foreground area block, concrete account form is: first calculate foreground image by video pictures and background image, foreground area block is calculated again by described foreground image, then the angle point area of described foreground area block is detected, wherein:
The formula calculating foreground image is: F ( x , y ) = 1 if | I ( x , y , t ) - BI ( x , y ) | > Thresh 0 otherwise Wherein I (x, y, the t) video frame images that is t, BI (x, y) is video fixed background, the foreground image that F (x, y) calculates for Background difference, and 1 represents foreground point, and 0 represents background dot, and Thresh is prospect threshold value;
The formula calculating foreground area block is: B ( i , j ) = 0 , Area ( B ) < T area 1 , Area ( B ) &GreaterEqual; T area Wherein B (i, j) represents foreground area block, and Area (B) represents the connected domain area of foreground area block, T arearepresent area threshold.
Wherein, the angle point area pattern detecting described foreground area block is, adopt Harris Corner Detection Algorithm to carry out Corner Detection to foreground area block, after the angle point getting foreground area block, calculate the angle point area of foreground area block by the value of the covariance matrix determinant of angular coordinate collection.
It should be noted that, when the angle point area of foreground area block is larger, illustrate that angle point is overstepping the bounds of propriety loose, crowd is also just overstepping the bounds of propriety loose; Otherwise the angle point area of foreground area block is less, illustrates that angle point is more intensive, and crowd is also more intensive; When the angle point area of foreground area block is from diminishing gradually greatly, illustrate that angle point is gathered from being distributed to, crowd assembles; Otherwise the angle point area of foreground area block is large from little change, and illustrate that angle point is from being brought to dispersion, crowd disperses; Finally, fluctuate up and down, and fluctuation range is very little if the angle point area of foreground area block maintains a specified level, explanation crowd in original place activity or may hover.
Finally, after carrying out above-mentioned process to the video image of continuous multiple frames, can analyze the motion conditions of crowd, and judge whether crowd exists the trend of gathering, if there is aggregation tendency, the abnormal information that controller generates crowd massing event is transferred to mobile phone.
Three, center controls to carry out people to monitor video and to set on fire the analysis of event:
First master controller calculates foreground image by said method, obtains preliminary flame candidate region by this foreground image, is then increased the integrality of flame region by region-growing method.Then Utilization prospects image extracts the area-of-interest (ROI) of flame on primitive frame image as mask, that is, flame area-of-interest is calculated by the foreground image of described monitor video, after acquisition flame area-of-interest, under color difference signal (YCrCb) color space, utilize Digital Image Processing (LBP0) operator to obtain the textural characteristics of area-of-interest, and linear Fusion of Color feature and textural characteristics, thus obtain the fusion feature of described flame area-of-interest, wherein, LBP characteristic parameter surveys processing procedure: entire image is carried out 3 × 3 segmentations and obtain 9 sub-blocks, the LBP characteristic value that pixel in each sub-block carries out 3 × 3 neighborhoods calculates, uniform pattern is adopted to obtain 59 dimensional feature vectors, whole sub-block carries out Fusion Features, the LBP characteristic vector obtaining view picture sample image is 9 be multiplied by 59=531 dimension, differentiated by linear SVM (Linear-SVM) fusion feature to area-of-interest of off-line training again, if be 1, represent that this region may exist flame, otherwise there is not flame in this region.When all detecting that flame occurs in continuous multiple frames video image, the abnormal information that master controller generates event of setting on fire is transferred to mobile phone.
Wherein, the formula calculating flame area-of-interest is: R ( i , j ) = I ( i , j ) ifF ( i , j ) = 1 0 otherwise Wherein F (i, j) is the pixel in the foreground image that extracts, and I (i, j) is pixel in primitive frame image, the pixel that R (i, j) is area-of-interest.
It should be noted that, in the embodiment of the present invention, the analysis mode of carrying out anomalous event to monitor video by controller is above three types, in actual applications, in conjunction with above three kinds of modes or can also analyze anomalous event by other means, be not construed as limiting herein.
603, mobile phone is to the above-mentioned analysis result received, and judges whether to send alarm request, and sends out this judged result to described master controller.
604, when master controller receive judged result correspond to send alarm request time, to loudspeaker send report to the police life signal.
The embodiment of the present invention obtains monitor video by off-premises station, and send this monitor video to master controller, this master controller carries out plundering the analysis with event of fighting to monitor video, the analysis of crowd massing event, during the analysis of event of setting on fire, and send this analysis result to mobile phone, when mobile phone is judged as sending alarm request to this analysis result, this judged result is sent to master controller, the alarm request that this master controller sends according to mobile terminal sends alarm signal to loudspeaker, these loudspeaker play alarm sound according to alarm signal, thus be conducive to the fail safe promoting resident family's inhabitation, additionally by different algorithmic formulas, monitor video is carried out plundering the analysis with the analysis of event of fighting, the analysis of crowd massing event and event of setting on fire, the major safety risks of discovery house periphery that can be more correct, promote the residential security of resident family further.
Those skilled in the art can be well understood to, and for convenience and simplicity of description, the system of foregoing description, the specific works process of device and unit, with reference to the corresponding process in preceding method embodiment, can not repeat them here.
In several embodiments that the application provides, should be understood that, disclosed system, apparatus and method, can realize by another way.Such as, device embodiment described above is only schematic, such as, the division of described unit, be only a kind of logic function to divide, actual can have other dividing mode when realizing, such as multiple unit or assembly can in conjunction with or another system can be integrated into, or some features can be ignored, or do not perform.Another point, shown or discussed coupling each other or direct-coupling or communication connection can be by some interfaces, and the indirect coupling of device or unit or communication connection can be electrical, machinery or other form.
The described unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location, namely can be positioned at a place, or also can be distributed in multiple network element.Some or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, also can be that the independent physics of unit exists, also can two or more unit in a unit integrated.Above-mentioned integrated unit both can adopt the form of hardware to realize, and the form of SFU software functional unit also can be adopted to realize.
If described integrated unit using the form of SFU software functional unit realize and as independently production marketing or use time, can be stored in a computer read/write memory medium.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words or all or part of of this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprising some instructions in order to make a computer equipment (can be personal computer, server, or the network equipment etc.) perform all or part of step of method described in each embodiment of the present invention.And aforesaid storage medium comprises: USB flash disk, portable hard drive, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. various can be program code stored medium.
The above, above embodiment only in order to technical scheme of the present invention to be described, is not intended to limit; Although with reference to previous embodiment to invention has been detailed description, those of ordinary skill in the art is to be understood that: it still can be modified to the technical scheme described in foregoing embodiments, or carries out equivalent replacement to wherein portion of techniques feature; And these amendments or replacement, do not make the essence of appropriate technical solution depart from the spirit and scope of various embodiments of the present invention technical scheme.

Claims (19)

1. an intercom system, is characterized in that, comprising:
Master controller, the mobile terminal be connected with described master controller, the off-premises station be connected with described master controller and the indoor set be connected with described master controller;
Described off-premises station, for sending video intercom signal to described master controller;
Described master controller, for forwarding the described video intercom signal received to described indoor set, when not receiving in preset duration, during corresponding with the described intercommunication signal response that described indoor set sends, forward described video intercom signal to described mobile terminal;
Described mobile terminal, for receiving the described video intercom signal that described master controller forwards, and judges whether the session of setting up the described off-premises station corresponding with described video intercom signal and described mobile terminal, and will send judged result to described master controller.
2. intercom system according to claim 1, is characterized in that, described intercom system also comprises:
The alarm be connected with described master controller;
Described off-premises station, also for obtaining monitor video, and is sent to described master controller by after described monitor video uncompressed encoding;
Described master controller, also for carrying out anomalous event analysis to the described monitor video received, when the result analyzed is anomalous event, sends described analysis result to described mobile terminal;
Described mobile terminal, also for the described analysis result received, judges whether to send alarm request, and sends described judged result to described master controller;
Described master controller, also for when receiving described judged result and corresponding to transmission alarm request, sends alarm signal to described alarm;
Described alarm, for sending alarm according to receiving described alarm signal from described master controller.
3. intercom system according to claim 2, it is characterized in that, described master controller, specifically for obtaining the Optical-flow Feature of the human body target in monitor video, and calculate described Optical-flow Feature vector histograms, calculate moving region entropy, the maximum calculated in the entropy of described moving region by described vector histograms, when the maximum of described moving region entropy in preset duration exceed predetermined threshold value time, sending analysis result to described mobile terminal is plunder and the abnormal events information of fighting.
4. intercom system according to claim 3, is characterized in that, the formula of the vector histograms of the described Optical-flow Feature of described calculating comprises: wherein B represents the number of the motion vector in the R of moving region, represent the weights of i-th motion vector direction, represent the direction histogram interval that i-th motion vector is corresponding, j is Direction interval, and δ is Kronecker function, C hfor normalized parameter;
The formula of described calculating moving region entropy comprises: wherein h j(R) be motion vector direction histogram based on amplitude weighting, E (H) is Region Entropy;
The formula of described calculating maximum region entropy comprises: wherein n is areal.
5. require the intercom system described in 2 according to claim, it is characterized in that, described master controller, specifically for obtaining video pictures in described monitor video and background image, calculate foreground image by described video pictures and described background image, calculate foreground area block by described foreground image, detect the angle point area of described foreground area block, when the angle point area of described foreground area block is less than predetermined threshold value, sending analysis result to described mobile terminal is the abnormal events information of crowd massing.
6. intercom system according to claim 5, is characterized in that, the formula of described calculating foreground image comprises: F ( x , y ) = 1 if | I ( x , y , t ) - BI ( x , y ) | > Thresh 0 otherwise Wherein I (x, y, the t) video frame images that is t, BI (x, y) is video fixed background, the foreground image that F (x, y) calculates for Background difference, and 1 represents foreground point, and 0 represents background dot, and Thresh is prospect threshold value;
The formula of described calculating foreground area block comprises: B ( i , j ) = 0 , Area ( B ) < T area 1 , Area ( B ) &GreaterEqual; T area Wherein B (i, j) represents foreground area block, and Area (B) represents the connected domain area of foreground area block, T arearepresent area threshold.
7. intercom system according to claim 5, it is characterized in that, described master controller, flame area-of-interest is calculated specifically for the foreground image by described monitor video, obtain the fusion feature of described flame area-of-interest, when determining that described fusion feature is 1, sending analysis result to described mobile terminal is the abnormal events information of setting on fire.
8. intercom system according to claim 7, is characterized in that, the formula of described calculating flame area-of-interest comprises: R ( i , j ) = I ( i , j ) ifF ( i , j ) = 1 0 otherwise Wherein F (i, j) is the pixel in the foreground image that extracts, and I (i, j) is pixel in primitive frame image, the pixel that R (i, j) is area-of-interest.
9. intercom system according to claim 8, is characterized in that, described intercom system also comprises:
The memory be connected with described master controller;
Described memory, for storing, described master controller sends, the record of the anomalous event analytic record that video intercom record, described master controller that the monitored picture that the video intercom data produced in the process that described off-premises station and described mobile terminal or described indoor set conversate, described off-premises station obtain, described off-premises station are initiated to described master controller send and the described memory of access that described mobile terminal is initiated;
Described mobile terminal, also for sending described memory access signals to described master controller;
Described master controller, also for receiving the described memory access signals that described mobile terminal sends, and judging that whether the identity of described mobile terminal is legal, if so, then setting up the connection between described mobile terminal and described memory.
10. intercom system according to claim 1, it is characterized in that, described master controller, also for forwarding to described indoor set, from the identity verify signal that described off-premises station receives, when not receiving the response of the described identity verify signal of correspondence that described indoor set sends in described preset duration, forward described identity verify signal to described mobile terminal;
Described mobile terminal, also for judging whether the identity of the described visitor that described identity verify signal is corresponding is verified, and sends judged result to described master controller.
11. intercom systems according to any one of claim 1 to 10, is characterized in that, described mobile terminal is mobile phone, and the operating system of described mobile phone is Android system; Or described mobile terminal is panel computer, the operating system of described dull and stereotyped electricity is Android system.
12. 1 kinds of intercommunication methods, is characterized in that, comprising:
Off-premises station sends video intercom signal to master controller;
Described master controller forwards the described video intercom signal received to described indoor set, when not receiving in preset duration, during corresponding with the described intercommunication signal response that described indoor set sends, forward described video intercom signal to mobile terminal;
Described mobile terminal receives the described video intercom signal that described master controller forwards, and judges whether the session of setting up the described off-premises station corresponding with described video intercom signal and described mobile terminal, and will send judged result to described control module.
13. methods according to claim 11, is characterized in that, also comprise:
Described off-premises station obtains monitor video, and is sent to described master controller by after described monitor video uncompressed encoding;
Described master controller carries out anomalous event analysis to the described monitor video received, and when analysis result is anomalous event, sends described analysis result to described mobile terminal;
Described mobile terminal, according to the described analysis result received, judges whether to send alarm request, and sends described judged result to described master controller;
When described master controller receive judged result correspond to send alarm request time, send to described alarm life signal of reporting to the police;
Described alarm sends alarm according to described alarm signal.
14. methods according to claim 12, is characterized in that, described master controller carries out anomalous event analysis to the described monitor video received, and when analysis result is anomalous event, sends described analysis result comprise to described mobile terminal:
Described master controller obtains the Optical-flow Feature of the human body target in monitor video, and calculate described Optical-flow Feature vector histograms, calculate moving region entropy, the maximum calculated in the entropy of described moving region by described vector histograms, when the maximum of described moving region entropy in preset duration exceed predetermined threshold value time, then described analysis result is plunder and the abnormal events information of fighting, and sends described abnormal events information to described mobile terminal.
15. methods according to claim 13, is characterized in that, the formula of the vector histograms of the described Optical-flow Feature of described calculating comprises: wherein B represents the number of the motion vector in the R of moving region, represent the weights of i-th motion vector direction, represent the direction histogram interval that i-th motion vector is corresponding, j is Direction interval, and δ is Kronecker function, C hfor normalized parameter;
The formula of described calculating moving region entropy comprises: wherein h j(R) be motion vector direction histogram based on amplitude weighting, E (H) is Region Entropy;
The formula of described calculating maximum region entropy comprises: wherein n is areal, E max(H) be maximum region entropy.
16. require method described in 12 according to claim, and it is characterized in that, described master controller carries out anomalous event analysis to the described monitor video received, and when analysis result is anomalous event, sends described analysis result comprise to described mobile terminal:
Described master controller obtains video pictures in described monitor video and background image, calculate foreground image by described video pictures and described background image, calculate foreground area block by described foreground image, detect the angle point area of described foreground area block, when the angle point area of described foreground area block is less than predetermined threshold value, then described analysis result is the abnormal events information of crowd massing, and sends described abnormal events information to described mobile terminal.
17. methods according to claim 15, is characterized in that, the formula of described calculating foreground image comprises: F ( x , y ) = 1 if | I ( x , y , t ) - BI ( x , y ) | > Thresh 0 otherwise Wherein I (x, y, the t) video frame images that is t, BI (x, y) is video fixed background, the foreground image that F (x, y) calculates for Background difference, and 1 represents foreground point, and 0 represents background dot, and Thresh is prospect threshold value;
The formula of described calculating foreground area block comprises: B ( i , j ) = 0 , Area ( B ) < T area 1 , Area ( B ) &GreaterEqual; T area Wherein B (i, j) represents foreground area block, and Area (B) represents the connected domain area of foreground area block, T arearepresent area threshold.
18., according to method described in claim 15, is characterized in that, described master controller carries out anomalous event analysis to the described monitor video received, and when analysis result is anomalous event, sends described analysis result comprise to described mobile terminal:
Described master controller calculates flame area-of-interest by the foreground image of described monitor video, obtain the fusion feature of described flame area-of-interest, when determining that described fusion feature is 1, then described analysis result is the abnormal events information of setting on fire, and sends described abnormal events information to described mobile terminal.
19. methods according to claim 17, is characterized in that, the formula of described calculating flame area-of-interest comprises: R ( i , j ) = I ( i , j ) ifF ( i , j ) = 1 0 otherwise Wherein F (i, j) is the pixel in the foreground image that extracts, and I (i, j) is pixel in primitive frame image, the pixel that R (i, j) is area-of-interest.
CN201410528960.5A 2014-10-09 2014-10-09 A kind of intercom system and intercommunication method Active CN104320605B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410528960.5A CN104320605B (en) 2014-10-09 2014-10-09 A kind of intercom system and intercommunication method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410528960.5A CN104320605B (en) 2014-10-09 2014-10-09 A kind of intercom system and intercommunication method

Publications (2)

Publication Number Publication Date
CN104320605A true CN104320605A (en) 2015-01-28
CN104320605B CN104320605B (en) 2018-08-21

Family

ID=52375768

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410528960.5A Active CN104320605B (en) 2014-10-09 2014-10-09 A kind of intercom system and intercommunication method

Country Status (1)

Country Link
CN (1) CN104320605B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110602572A (en) * 2019-07-29 2019-12-20 苏州安视讯通信设备有限公司 Intercom interconnection communication information transmission method and interphone interconnection communication system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202503627U (en) * 2012-03-16 2012-10-24 周振海 Wireless visible dialogue system
CN203025809U (en) * 2012-12-28 2013-06-26 上海精工科技有限公司 Face-recognition electronic lock circuit
CN103699087A (en) * 2013-12-20 2014-04-02 柳州市盛景科技有限公司 Intelligent comprehensive household service system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202503627U (en) * 2012-03-16 2012-10-24 周振海 Wireless visible dialogue system
CN203025809U (en) * 2012-12-28 2013-06-26 上海精工科技有限公司 Face-recognition electronic lock circuit
CN103699087A (en) * 2013-12-20 2014-04-02 柳州市盛景科技有限公司 Intelligent comprehensive household service system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
杜鉴豪: "监控视频中的人体异常行为检测研究", 《中国优秀硕士学位论文全文数据库》 *
胡全: "基于多特征相融合和支持向量机的森林火场识别技术的研究", 《安徽农业科学》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110602572A (en) * 2019-07-29 2019-12-20 苏州安视讯通信设备有限公司 Intercom interconnection communication information transmission method and interphone interconnection communication system

Also Published As

Publication number Publication date
CN104320605B (en) 2018-08-21

Similar Documents

Publication Publication Date Title
US11443498B2 (en) Target object recognition method and apparatus, storage medium, and electronic device
CN101872524B (en) Video monitoring method, system and device based on virtual wall
CN111050130B (en) Camera control method and device and storage medium
WO2016149938A1 (en) Video monitoring method, video monitoring system and computer program product
CN107592498B (en) Cell management method based on intelligent camera and related equipment
US20190130586A1 (en) Robust sleeping object detection in video analytics
CN110867046A (en) Intelligent car washer video monitoring and early warning system based on cloud computing
CN110209281B (en) Method, electronic device, and medium for processing motion signal
WO2023098287A1 (en) Message pushing method and apparatus, storage medium and electronic apparatus
CN104820834A (en) Fighting early warning method and device
CN112232211A (en) Intelligent video monitoring system based on deep learning
CN105763868A (en) Detection method and device of PTZ failure
CN104376619A (en) Monitoring method and equipment
CN112102574B (en) Intelligent alarm system for security room
CN113990101B (en) Method, system and processing device for detecting vehicles in no-parking area
TW201702917A (en) Monitoring method for region
CN104320605A (en) Intercom system and intercom method
US11875657B2 (en) Proactive loss prevention system
CN105450992A (en) Smart home monitoring method and system based on motion detection
CN111491258B (en) Object type detection method and device
CN105208337A (en) Image processing method and device based on joined screen
CN111400415A (en) Management method and related device for stability-related personnel
Yuan et al. Real-time human behavior recognition in intelligent environment
CN114511978B (en) Intrusion early warning method, device, vehicle and computer readable storage medium
KR101340287B1 (en) Intrusion detection system using mining based pattern analysis in smart home

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20180906

Address after: 523710 26 Pingshan 188 Industrial Avenue, Tangxia Town, Dongguan, Guangdong

Patentee after: Central Intelligence Polytron Technologies Inc

Address before: 518129 Guangdong Shenzhen Longgang District Bantian five and Xinhua new industrial zone, central control building 1 to nine floors.

Patentee before: Shenzhen Zhongkong Biometrics Technology Co., Ltd.

TR01 Transfer of patent right
CP01 Change in the name or title of a patent holder

Address after: 523710, 26, 188 Industrial Road, Pingshan Town, Guangdong, Dongguan, Tangxia

Patentee after: Entropy Technology Co., Ltd

Address before: 523710, 26, 188 Industrial Road, Pingshan Town, Guangdong, Dongguan, Tangxia

Patentee before: Zhongkong Smart Technology Co.,Ltd.

CP01 Change in the name or title of a patent holder
CP02 Change in the address of a patent holder

Address after: No.32, Pingshan Industrial Road, Tangxia Town, Dongguan City, Guangdong Province, 523710

Patentee after: Entropy Technology Co., Ltd

Address before: 523710 26 Pingshan 188 Industrial Avenue, Tangxia Town, Dongguan, Guangdong

Patentee before: Entropy Technology Co., Ltd

CP02 Change in the address of a patent holder