Summary of the invention
Embodiments provide a kind of intercom system, for receiving intercommunication signal by mobile terminal, thus making user's convenient reception intercommunication signal, promoting Consumer's Experience.
A kind of intercom system that the embodiment of the present invention provides, comprising:
Master controller, the mobile terminal be connected with described master controller, the off-premises station be connected with described master controller and the indoor set be connected with described master controller;
Described off-premises station, for sending video intercom signal to described master controller;
Described master controller, for forwarding the described video intercom signal received to described indoor set, when not receiving in preset duration, during corresponding with the described intercommunication signal response that described indoor set sends, forward described video intercom signal to described mobile terminal;
Described mobile terminal, for receiving the described video intercom signal that described master controller forwards, and judges whether the session of setting up the described off-premises station corresponding with described video intercom signal and described mobile terminal, and will send judged result to described master controller.
Alternatively, described intercom system also comprises:
The alarm be connected with described master controller;
Described off-premises station, also for obtaining monitor video, and is sent to described master controller by after described monitor video uncompressed encoding;
Described master controller, also for carrying out anomalous event analysis to the described monitor video received, when the result analyzed is anomalous event, sends described analysis result to described mobile terminal;
Described mobile terminal, also for the described analysis result received, judges whether to send alarm request, and sends described judged result to described master controller;
Described master controller, also for when receiving described judged result and corresponding to transmission alarm request, sends alarm signal to described alarm;
Described alarm, for sending alarm according to receiving described alarm signal from described master controller.
Preferably, described master controller, specifically for obtaining the Optical-flow Feature of the human body target in monitor video, and calculate described Optical-flow Feature vector histograms, calculate moving region entropy, the maximum calculated in the entropy of described moving region by described vector histograms, when the maximum of described moving region entropy in preset duration exceed predetermined threshold value time, sending analysis result to described mobile terminal is plunder and the abnormal events information of fighting.
Preferably, the formula of the vector histograms of the described Optical-flow Feature of described calculating comprises:
wherein B represents the number of the motion vector in the R of moving region,
represent the weights of i-th motion vector direction,
represent the direction histogram interval that i-th motion vector is corresponding, j is Direction interval, and δ is Kronecker function, C
hfor normalized parameter;
The formula of described calculating moving region entropy comprises:
wherein h
j(R) be motion vector direction histogram based on amplitude weighting, E (H) is Region Entropy;
The formula of described calculating maximum region entropy comprises:
wherein n is areal.
Preferably, described master controller, specifically for obtaining video pictures in described monitor video and background image, calculate foreground image by described video pictures and described background image, calculate foreground area block by described foreground image, detect the angle point area of described foreground area block, when the angle point area of described foreground area block is less than predetermined threshold value, sending analysis result to described mobile terminal is the abnormal events information of crowd massing.
Preferably, the formula of described calculating foreground image comprises:
Wherein I (x, y, the t) video frame images that is t, BI (x, y) is video fixed background, the foreground image that F (x, y) calculates for Background difference, and 1 represents foreground point, and 0 represents background dot, and Thresh is prospect threshold value;
The formula of described calculating foreground area block comprises:
Wherein B (i, j) represents foreground area block, and Area (B) represents the connected domain area of foreground area block, T
arearepresent area threshold.
Preferably, flame area-of-interest is calculated specifically for the foreground image by described monitor video, obtain the fusion feature of described flame area-of-interest, when determining that described fusion feature is 1, sending analysis result to described mobile terminal is the abnormal events information of setting on fire.
Preferably, the formula of described calculating flame area-of-interest comprises:
Wherein F (i, j) is the pixel in the foreground image that extracts, and I (i, j) is pixel in primitive frame image, the pixel that R (i, j) is area-of-interest.
Alternatively, described intercom system also comprises:
The memory be connected with described master controller;
Described memory, for storing, described master controller sends, the record of the anomalous event analytic record that video intercom record, described master controller that the monitored picture that the video intercom data produced in the process that described off-premises station and described mobile terminal or described indoor set conversate, described off-premises station obtain, described off-premises station are initiated to described master controller send and the described memory of access that described mobile terminal is initiated;
Described mobile terminal, also for sending described memory access signals to described master controller;
Described master controller, also for receiving the described memory access signals that described mobile terminal sends, and judging that whether the identity of described mobile terminal is legal, if so, then setting up the connection between described mobile terminal and described memory.
Alternatively, described master controller, also for forwarding to described indoor set, from the identity verify signal that described off-premises station receives, when not receiving the response of the described identity verify signal of correspondence that described indoor set sends in described preset duration, forward described identity verify signal to described mobile terminal;
Described mobile terminal, also for judging whether the identity of the described visitor that described identity verify signal is corresponding is verified, and sends judged result to described master controller.
The embodiment of the present invention also provides a kind of intercommunication method, comprising:
Off-premises station sends video intercom signal to master controller;
Described master controller forwards the described video intercom signal received to described indoor set, when not receiving in preset duration, during corresponding with the described intercommunication signal response that described indoor set sends, forward described video intercom signal to mobile terminal;
Described mobile terminal receives the described video intercom signal that described master controller forwards, and judges whether the session of setting up the described off-premises station corresponding with described video intercom signal and described mobile terminal, and will send judged result to described control module.
Alternatively, it is characterized in that, also comprise:
Described off-premises station obtains monitor video, and is sent to described master controller by after described monitor video uncompressed encoding;
Described master controller carries out anomalous event analysis to the described monitor video received, and when analysis result is anomalous event, sends described analysis result to described mobile terminal;
Described mobile terminal, according to the described analysis result received, judges whether to send alarm request, and sends described judged result to described master controller;
When described master controller receive judged result correspond to send alarm request time, send to described alarm life signal of reporting to the police;
Described alarm sends alarm according to described alarm signal.
Preferably, described master controller carries out anomalous event analysis to the described monitor video received, and when analysis result is anomalous event, sends described analysis result comprise to described mobile terminal:
Described master controller obtains the Optical-flow Feature of the human body target in monitor video, and calculate described Optical-flow Feature vector histograms, calculate moving region entropy, the maximum calculated in the entropy of described moving region by described vector histograms, when the maximum of described moving region entropy in preset duration exceed predetermined threshold value time, then described analysis result is plunder and the abnormal events information of fighting, and sends described abnormal events information to described mobile terminal.
Preferably, the formula of the vector histograms of the described Optical-flow Feature of described calculating comprises:
wherein B represents the number of the motion vector in the R of moving region,
represent the weights of i-th motion vector direction,
represent the direction histogram interval that i-th motion vector is corresponding, j is Direction interval, and δ is Kronecker function, C
hfor normalized parameter;
The formula of described calculating moving region entropy comprises:
wherein h
j(R) be motion vector direction histogram based on amplitude weighting, E (H) is Region Entropy;
The formula of described calculating maximum region entropy comprises:
wherein n is areal, E
max(H) be maximum region entropy.
Preferably, described master controller carries out anomalous event analysis to the described monitor video received, and when analysis result is anomalous event, sends described analysis result comprise to described mobile terminal:
Described master controller obtains video pictures in described monitor video and background image, calculate foreground image by described video pictures and described background image, calculate foreground area block by described foreground image, detect the angle point area of described foreground area block, when the angle point area of described foreground area block is less than predetermined threshold value, then described analysis result is the abnormal events information of crowd massing, and sends described abnormal events information to described mobile terminal.
Preferably, the formula of described calculating foreground image comprises:
Wherein I (x, y, the t) video frame images that is t, BI (x, y) is video fixed background, the foreground image that F (x, y) calculates for Background difference, and 1 represents foreground point, and 0 represents background dot, and Thresh is prospect threshold value;
The formula of described calculating foreground area block comprises:
Wherein B (i, j) represents foreground area block, and Area (B) represents the connected domain area of foreground area block, T
arearepresent area threshold.
Preferably, described master controller carries out anomalous event analysis to the described monitor video received, and when analysis result is anomalous event, sends described analysis result comprise to described mobile terminal:
Described master controller calculates flame area-of-interest by the foreground image of described monitor video, obtain the fusion feature of described flame area-of-interest, when determining that described fusion feature is 1, then described analysis result is the abnormal events information of setting on fire, and sends described abnormal events information to described mobile terminal.
Preferably, the formula of described calculating flame area-of-interest comprises:
Wherein F (i, j) is the pixel in the foreground image that extracts, and I (i, j) is pixel in primitive frame image, the pixel that R (i, j) is area-of-interest.
A kind of intercom system that the embodiment of the present invention provides and intercommunication method, when in the duration preset, when indoor set does not send the response corresponding to intercommunication signal, this intercommunication signal can be forwarded to mobile terminal, and judge whether the session of setting up the described off-premises station corresponding with described video intercom signal and described mobile terminal by this mobile terminal, and make user can receive intercommunication signal more easily, practical, promote Consumer's Experience, can user's request be better met.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those skilled in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Refer to Fig. 1, the structural representation of a kind of intercom system 100 that Fig. 1 provides for the embodiment of the present invention, wherein this intercom system 100 comprises:
Master controller 102, the mobile terminal 103 be connected with described master controller 102, the off-premises station 101 be connected with described master controller 102 and the indoor set 104 be connected with described master controller 102;
Described off-premises station 101, for sending video intercom signal to described master controller 102;
Be understandable that, described off-premises station is equipped with camera, this off-premises station is provided with called hole and some buttons, visitor sends video intercom signal by the button on off-premises station to master controller 102, it should be noted that, this off-premises station can also arrange other common function parts such as card reader, and the mode sending video intercom signal in addition specifically can also be not construed as limiting by other modes such as speech recognitions herein.
Master controller 102, for receiving the video intercom signal that described off-premises station 101 sends, and the described video intercom signal received is forwarded to described indoor set 104, when not receiving in preset duration, during corresponding with the described intercommunication signal response that described indoor set sends, forward described video intercom signal to described mobile terminal 103;
It should be noted that, in the present embodiment, master controller 102 is connected by 3G network with mobile terminal 103, and in actual applications, master controller 102 and mobile terminal 103, by being connected by 2G, 4G or wifi, are not construed as limiting herein.
Described mobile terminal 103, for receiving the described video intercom signal that described master controller 102 forwards, and judge whether to set up the described off-premises station 101 corresponding with described video intercom signal and the session of described mobile terminal 103, and judged result will be sent to described master controller 102.
Seen from the above description, a kind of intercom system 100 that the embodiment of the present invention provides, when in the duration preset, when indoor set 104 does not have to send the response corresponding to intercommunication signal, this intercommunication signal can be forwarded to mobile terminal 103 by master controller 102, and judge whether to set up the described off-premises station 101 corresponding with described video intercom signal and the session of described mobile terminal 103 by this mobile terminal 103, make user can receive intercommunication signal more easily, practicality is high, can better meet user's request.
Visible dialogue system in above-described embodiment can realize video intercom signal to be sent to mobile terminal by network, enhance operability and the convenience of this intercom system, in actual applications, alarm can also be comprised in visible dialogue system, when there is anomalous event, alarm is sent by this alarm, can Timeliness coverage perimeter security hidden danger, promote the safety of resident family, below another visible dialogue system in the embodiment of the present invention is described, refer to Fig. 2, the structural representation of another visible dialogue system 200 that the embodiment of the present invention provides, this visible dialogue system 200 specifically to comprise totally:
Master controller 202, the mobile terminal 203 be connected with described master controller 202, the off-premises station 201 be connected with described master controller 202, the indoor set 204 be connected with described master controller 202 and the alarm 205 be connected with described master controller 202;
Described off-premises station 201, for obtaining monitor video, and is sent to described master controller 202 by after described monitor video uncompressed encoding;
It should be noted that, off-premises station 201 described in the present embodiment is provided with infrared camera, this off-premises station 201 obtains monitor video by this infrared camera, this off-premises station 201 passes through wired connection with master controller 202, in actual applications, also can obtain monitor video by other watch-dogs be connected with off-premises station 201, be not construed as limiting herein, this off-premises station 201 also can be connected by wireless network with master controller 202 in addition, is not construed as limiting herein.
Described master controller 202, for carrying out anomalous event analysis to the described monitor video received, when the result analyzed is anomalous event, sends described analysis result to described mobile terminal 203.
It should be noted that, in the present embodiment, Embedded Hardware Platform is integrated with in master controller 202, by this Embedded Hardware Platform, the exception in monitor video is analyzed, and send described analysis result to mobile terminal 203, in actual applications, this master controller 202 can also send analysis result to indoor set, is not construed as limiting herein.
Described mobile terminal 203, for the described analysis result received, judges whether to send alarm request, and sends described judged result to described master controller 202.
What needs were said is, in the present embodiment, mobile terminal 203 can be mobile phone, panel computer or other mobile terminals, be not construed as limiting herein, the analysis result that this mobile terminal 203 receives can be the short message carrying anomalous event type that master controller sends, or the monitor video of anomalous event is defined as by master controller 202, be not construed as limiting herein, in addition in the present embodiment, after mobile terminal 203 receives analysis result, user judges this analysis result, and inputs judged result, and this mobile terminal 203 sends this judged result to master controller 202.
Described master controller 202, for when receiving judged result and corresponding to transmission alarm request, sends to described alarm 205 life signal of reporting to the police.
The judged result that master controller 202 sends for receiving mobile terminal 203, when this judged result corresponds to transmission alarm request, this master controller 202 sends alarm signal to described alarm 205.
Described alarm 205, for sending alarm according to described alarm signal.
Alarm 205 sends alarm after receiving the alarm signal of master controller 202.
Be understandable that, alarm can for loudspeaker, buzzer, electric bell or other can be used for report to the police equipment, be not construed as limiting herein.
A kind of intercom system 200 that the embodiment of the present invention provides, monitor video is obtained by the infrared camera of off-premises station 201, and send this monitor video to master controller 202, this master controller 202 pairs of monitor videos are analyzed, when analysis result is anomalous event, this analysis result is sent to mobile terminal 203, when mobile terminal 203 is judged as sending alarm request to this point of result, this judged result is sent to master controller 202, this center controls 202 and sends alarm signal according to the alarm request of mobile terminal transmission to alarm 205, this alarm 205 sends alarm according to alarm signal, it can thus be appreciated that, this intercom system 200 can make user receive abnormal information more easily, practicality is high, the analysis to anomalous event can also be realized in addition, and alarm can be sent by alarm, thus make the potential safety hazard of resident family's Timeliness coverage house periphery, be conducive to the fail safe promoting resident family's inhabitation.
Above in embodiment, the master controller of visible dialogue system can be analyzed the anomalous event in monitor video, in actual applications, this master controller specifically can be analyzed the robbery in monitor video and event of fighting, crowd massing event, the anomalous events such as event of setting on fire by corresponding algorithm, below another intercom system that the embodiment of the present invention provides is analyzed, refer to Fig. 3, embodiments provide the structural representation of another intercom system 300, this comprises system 300:
Master controller 302, the mobile phone 303 be connected with described master controller 302, the off-premises station 301 be connected with described master controller 302, the indoor set 304 be connected with described master controller 302 and the loudspeaker 305 be connected with described master controller 302;
Described off-premises station 301, for obtaining monitor video, and is sent to described master controller 302 by after described monitor video uncompressed encoding;
It should be noted that, off-premises station 301 described in the present embodiment is provided with infrared camera, this off-premises station 301 obtains monitor video by this infrared camera, this off-premises station 301 passes through wired connection with master controller 302, in actual applications, also can obtain monitor video by other watch-dogs be connected with off-premises station 301, be not construed as limiting herein, this off-premises station 301 also can be connected by wireless network with master controller 302 in addition, is not construed as limiting herein.
Described master controller 302, for carrying out anomalous event analysis to the described monitor video received, when the result analyzed is anomalous event, sends described analysis result to described mobile terminal 303.
Wherein, master controller 302 carries out anomalous event analysis specifically comprise following three kinds of situations to receiving monitor video:
One, center controls the analysis that 302 pairs of monitor videos carry out robbery and event of fighting:
Master controller 302 is for obtaining the Optical-flow Feature of the human body target in monitor video, with the Optical-flow Feature of movement human target for principal character, calculating kinematical vector direction histogram, and adopt motion vector magnitude to be weighted, weights on the motion vector direction that amplitude is larger are also corresponding larger, wherein, the mode calculating the vector histograms of described Optical-flow Feature is, first motion vector magnitude is normalized, as the weights of motion vector direction, then motion vector magnitude is sued for peace as the histogrammic size of motion vector direction; Calculate the histogrammic accumulation entropy of motion vector direction again, the histogrammic accumulation entropy of this motion vector direction is used for weighing confusion degree in moving region, and entropy is larger, and confusion degree is larger; Calculate in multiple moving region and get maximum Region Entropy:
Wherein, in the R of moving region, direction Histogram graph model is H (R)={ h
j(R) }
j=1,2,3 ..., m, m is the number of direction histogram, and the formula of calculating kinematical vector direction histogram is:
wherein B represents the number of the motion vector in the R of moving region,
represent the weights of i-th motion vector direction,
represent the direction histogram interval that i-th motion vector is corresponding, j is Direction interval, and δ is Kronecker function, C
hfor normalized parameter;
The formula calculating moving region entropy is:
wherein h
j(R) be motion vector direction histogram based on amplitude weighting, E (H) is Region Entropy;
The formula calculating maximum region entropy is:
wherein n is areal.
When the maximum of the moving region entropy calculated in preset duration exceed predetermined threshold value time, controller 302 show that analysis result is plunder and the anomalous event of fighting, and sends the information of the anomalous event that this is fought to mobile phone 303.
Two, master controller 302 pairs of monitor videos carry out the analysis of crowd massing event:
Described master controller 302, adopt foreground extraction algorithm from video image, extract movement human target, because camera is installed fixing, the monitoring background of camera is made also to have stationarity, so can first obtain fixing background, then Background difference subtracting background image from video image is used to obtain foreground area, then foreground image is calculated by described video pictures and described background image, can judge whether crowd assembles by the angle point area of foreground area block, concrete account form is: first calculate foreground image by video pictures and background image, foreground area block is calculated again by described foreground image, then the angle point area of described foreground area block is detected, wherein:
The formula calculating foreground image is:
Wherein I (x, y, the t) video frame images that is t, BI (x, y) is video fixed background, the foreground image that F (x, y) calculates for Background difference, and 1 represents foreground point, and 0 represents background dot, and Thresh is prospect threshold value;
The formula calculating foreground area block is:
Wherein B (i, j) represents foreground area block, and Area (B) represents the connected domain area of foreground area block, T
arearepresent area threshold.
Wherein, the angle point area pattern detecting described foreground area block is, adopt Harris Corner Detection Algorithm to carry out Corner Detection to foreground area block, after the angle point getting foreground area block, calculate the angle point area of foreground area block by the value of the covariance matrix determinant of angular coordinate collection.
It should be noted that, when the angle point area of foreground area block is larger, illustrate that angle point is overstepping the bounds of propriety loose, crowd is also just overstepping the bounds of propriety loose; Otherwise the angle point area of foreground area block is less, illustrates that angle point is more intensive, and crowd is also more intensive; When the angle point area of foreground area block is from diminishing gradually greatly, illustrate that angle point is gathered from being distributed to, crowd assembles; Otherwise the angle point area of foreground area block is large from little change, and illustrate that angle point is from being brought to dispersion, crowd disperses; Finally, fluctuate up and down, and fluctuation range is very little if the angle point area of foreground area block maintains a specified level, explanation crowd in original place activity or may hover.
Finally, after above-mentioned process is carried out to the video image of continuous multiple frames, can analyze the motion conditions of crowd, and judge whether crowd exists the trend of gathering, if there is aggregation tendency, the abnormal information that controller 302 generates crowd massing event is transferred to mobile phone 303.
Three, master controller 302 pairs of monitor videos carry out people and to set on fire the analysis of event:
Master controller 302, first calculates foreground image by said method, obtains preliminary flame candidate region by this foreground image, is then increased the integrality of flame region by region-growing method.Then Utilization prospects image extracts the area-of-interest (ROI) of flame on primitive frame image as mask, that is, flame area-of-interest is calculated by the foreground image of described monitor video, after acquisition flame area-of-interest, under color difference signal (YCrCb) color space, utilize Digital Image Processing (LBP0) operator to obtain the textural characteristics of area-of-interest, and linear Fusion of Color feature and textural characteristics, thus obtain the fusion feature of described flame area-of-interest, wherein, LBP characteristic parameter surveys processing procedure: entire image is carried out 3 × 3 segmentations and obtain 9 sub-blocks, the LBP characteristic value that pixel in each sub-block carries out 3 × 3 neighborhoods calculates, uniform pattern is adopted to obtain 59 dimensional feature vectors, whole sub-block carries out Fusion Features, the LBP characteristic vector obtaining view picture sample image is 9 be multiplied by 59=531 dimension, differentiated by linear SVM (Linear-SVM) fusion feature to area-of-interest of off-line training again, if be 1, represent that this region may exist flame, otherwise there is not flame in this region.When all detecting that flame occurs in continuous multiple frames video image, the abnormal information that master controller 302 generates event of setting on fire is transferred to mobile phone 303.
Wherein, the formula calculating flame area-of-interest is:
Wherein F (i, j) is the pixel in the foreground image that extracts, and I (i, j) is pixel in primitive frame image, the pixel that R (i, j) is area-of-interest.
It should be noted that, in the embodiment of the present invention, the analysis mode that controller 302 pairs of monitor videos carry out anomalous event is above three types, in actual applications, controller 302 in conjunction with above three kinds of modes or can also be analyzed anomalous event by other means, is not construed as limiting herein.
Described mobile phone 303, for the above-mentioned analysis result received, judges whether to send alarm request, and to described master controller 302 these judged results.
What needs were said is, in the present embodiment, mobile terminal is mobile phone 303, the operating system of this mobile phone is Android system, in actual applications, this mobile terminal can also be panel computer or other mobile terminals, be not construed as limiting herein, the operating system of this mobile phone can also be Apple Macintosh operating system, Saipan operation system or other mobile phone operating systems, be not construed as limiting herein, the analysis result that this mobile phone 303 receives can be the short message carrying anomalous event type that master controller sends, or the monitor video of anomalous event is defined as by master controller 302, be not construed as limiting herein, in addition in the present embodiment, after mobile phone 303 receives analysis result, user is judged this analysis result by mobile phone 303, and input judged result, this mobile phone 303 sends this judged result to master controller 302.
Master controller 302, for when receiving judged result and corresponding to transmission alarm request, sends to loudspeaker 305 life signal of reporting to the police.
Loudspeaker 305, for reporting alarm sound according to described alarm signal.
Be understandable that, in the present embodiment, alarm is loudspeaker, in actual applications, this alarm can also for buzzer, electric bell or other can be used for report to the police equipment, be not construed as limiting herein.
A kind of intercom system 300 that the embodiment of the present invention provides, monitor video is obtained by the infrared camera of off-premises station 301, and send this monitor video to master controller 302, this master controller 302 pairs of monitor videos carry out plundering the analysis with event of fighting, the analysis of crowd massing event, during the analysis of event of setting on fire, this analysis result is sent to mobile phone 303, when mobile phone 303 is judged as sending alarm request to this analysis result, this judged result is sent to master controller 302, this center controls 302 and sends alarm signal according to the alarm request of mobile terminal transmission to loudspeaker 305, these loudspeaker 305 play alarm sound according to alarm signal, it can thus be appreciated that, this intercom system 300 can realize the analysis to anomalous event, and alarm can be sent by loudspeaker when confirming transmission anomalous event, be conducive to the fail safe promoting resident family's inhabitation, additionally by different algorithmic formulas, monitor video is carried out plundering the analysis with the analysis of event of fighting, the analysis of crowd massing event and event of setting on fire, the major safety risks of discovery house periphery that can be more correct, promote the residential security of resident family further.
Above in embodiment, visible dialogue system can realize analysis monitor video being carried out to anomalous event, and send alarm by the alarm in this visible dialogue system, actual should in, this visible dialogue system can also comprise memory, for storing data and the record of the generation of visible dialogue system running, and the mobile terminal in this visible dialogue system can the data of storage in this memory of remote access and record, below another visible dialogue system in the embodiment of the present invention is described, refer to Fig. 4, the schematic diagram of another visible dialogue system 400 that the embodiment of the present invention provides, this visible dialogue system 400 specifically comprises:
Master controller 402, the mobile terminal 403 be connected with described master controller 402, the off-premises station 401 be connected with described master controller 402, the indoor set 404 be connected with described master controller 402, the alarm 405 be connected with described master controller 402 and with described master controller 402 associative memory 406.
Described off-premises station 401, for sending video intercom signal to described master controller 402, also for obtaining monitor video, and is sent to described master controller 402 by after described monitor video uncompressed encoding;
Described master controller 402, for forwarding described intercommunication signal, also for carrying out anomalous event analysis to the described monitor video received, when the result analyzed is anomalous event, sends described analysis result to described mobile terminal 403.
Described mobile terminal 403, the video intercom session between the described mobile terminal corresponding with described intercommunication signal and described off-premises station is set up for judging whether the described intercommunication signal received, and send judged result to described master controller, also for the described analysis result received, judge whether to send alarm request, and send described judged result to described master controller 402, also for sending memory access signals to described master controller 402.
Described master controller 402, also for when receiving judged result and corresponding to transmission alarm request, sends to described alarm 405 life signal of reporting to the police.
Master controller 402, for receiving the judged result that mobile terminal 403 sends, when this judged result is that when setting up the video intercom session between described mobile terminal 403 and described off-premises station 401, the video intercom session between described mobile terminal and described off-premises station set up by shown master controller, when this judged result corresponds to transmission alarm request, this master controller 402 sends alarm signal to described alarm 405, when receiving reference to storage 406 and asking, authentication is carried out to described mobile terminal, when identity test pass through time, set up described mobile terminal 403 to be connected with between described memory, realize the access of the 403 pairs of memories 406 in mobile terminal, also for sending to described memory 406, the video intercom data produced in the process that described off-premises station 401 and described mobile terminal 403 or described indoor set 404 conversate, the monitored picture that described off-premises station 401 obtains, the video intercom record that described off-premises station 401 is initiated to described master controller 402, the anomalous event analytic record that described master controller 402 sends, and the record of the described memory 406 of access of described mobile terminal 403 initiation.
Described alarm 405, for sending alarm according to described alarm signal.
Alarm 405 sends alarm after receiving the alarm signal of master controller 402.
Memory 406, for storing, described master controller 402 sends, the record of the anomalous event analytic record that video intercom record, described master controller 402 that the monitored picture that the video intercom data produced in the process that described off-premises station 401 and described mobile terminal 403 or described indoor set 404 conversate, described off-premises station 401 obtain, described off-premises station 401 are initiated to described master controller 402 send and the described memory 406 of access that described mobile terminal 403 is initiated.
In the embodiment of the present invention, visible dialogue system 400 comprises memory 406, can store described master controller 402 send, the video intercom data produced in the process that described off-premises station 401 and described mobile terminal 403 or described indoor set 404 conversate, the monitored picture that described off-premises station 401 obtains, the video intercom record that described off-premises station 401 is initiated to described master controller 402, the anomalous event analytic record that described master controller 402 sends, and the record of the described memory 406 of access of described mobile terminal 403 initiation, can check for user, practical, by the data in the reference to storage of mobile terminal, user's Information at any time can be facilitated in addition.
In the visible dialogue system provided in embodiment above, master controller 402 is also for forwarding described identity verify signal to mobile terminal 403; Described mobile terminal 403 also can be used for judging whether the identity of the described visitor that described identity verify signal is corresponding is verified, and feed back described judged result to described master controller 402, described master controller 402, can also be used for when the judged result received correspond to authentication differentiate pass through time, open gate inhibition, thus make this intercom system 400 can by mobile terminal 403 convenient realize identity verify function, practical.
Above in embodiment, be described the intercom system of the embodiment of the present invention, be described below, refer to Fig. 5 to a kind of intercommunication method that the embodiment of the present invention provides, a kind of intercommunication method that the embodiment of the present invention provides comprises:
501, off-premises station sends video intercom signal to master controller.
Be understandable that, described off-premises station is equipped with camera, this off-premises station is provided with called hole and some buttons, visitor sends video intercom signal by the button on off-premises station to master controller 102, it should be noted that, this off-premises station can also arrange other common function parts such as card reader, and the mode sending video intercom signal in addition specifically can also be not construed as limiting by other modes such as speech recognitions herein.
502, master controller forwards the described video intercom signal received to described indoor set, when not receiving in preset duration, during corresponding with the described intercommunication signal response that described indoor set sends, forwards described video intercom signal to mobile terminal.
Be understandable that, described off-premises station is equipped with camera, this off-premises station is provided with called hole and some buttons, visitor sends video intercom signal by the button on off-premises station to master controller, it should be noted that, this off-premises station can also arrange other common function parts such as card reader, and the mode sending video intercom signal in addition specifically can also be not construed as limiting by other modes such as speech recognitions herein.
503, mobile terminal receives the described video intercom signal that described master controller forwards, and judges whether the session of setting up the described off-premises station corresponding with described video intercom signal and described mobile terminal, and will send judged result to described control module.
In the embodiment of the present invention, by master controller, this intercommunication signal is forwarded to mobile terminal, and judge whether the session of setting up the described off-premises station corresponding with described video intercom signal and described mobile terminal by this mobile terminal, make user can receive intercommunication signal more easily, practicality is high, can better meet user's request.
Above in embodiment, video intercom signal is sent to mobile terminal by network, enhance operability and the convenience of this intercom system, actual should in, monitor video can also be obtained by off-premises station, and by master controller, anomalous event analysis is carried out to this monitor video, thus perimeter security hidden danger can be found, promote the fail safe of resident family, below another the intercommunication method in the invention process is described, refer to Fig. 6, another intercommunication method that the embodiment of the present invention provides comprises:
601, off-premises station obtains monitor video, and is sent to described master controller by after described monitor video uncompressed encoding.
602, master controller carries out anomalous event analysis to the described monitor video received, and when the result analyzed is anomalous event, sends described analysis result to described mobile terminal.
Wherein, master controller carries out anomalous event analysis specifically comprise following three kinds of situations to receiving monitor video:
Master controller obtains the Optical-flow Feature of the human body target in monitor video, with the Optical-flow Feature of movement human target for principal character, calculating kinematical vector direction histogram, and adopt motion vector magnitude to be weighted, weights on the motion vector direction that amplitude is larger are also corresponding larger, wherein, the mode calculating the vector histograms of described Optical-flow Feature is, first motion vector magnitude is normalized, as the weights of motion vector direction, then motion vector magnitude is sued for peace as the histogrammic size of motion vector direction; Calculate the histogrammic accumulation entropy of motion vector direction again, the histogrammic accumulation entropy of this motion vector direction is used for weighing confusion degree in moving region, and entropy is larger, and confusion degree is larger; Calculate in multiple moving region and get maximum Region Entropy:
Wherein, in the R of moving region, direction Histogram graph model is H (R)={ h
j(R) }
j=1,2,3 ..., m, m is the number of direction histogram, and the formula of calculating kinematical vector direction histogram is:
wherein B represents the number of the motion vector in the R of moving region,
represent the weights of i-th motion vector direction,
represent the direction histogram interval that i-th motion vector is corresponding, j is Direction interval, and δ is Kronecker function, C
hfor normalized parameter;
The formula calculating moving region entropy is:
wherein h
j(R) be motion vector direction histogram based on amplitude weighting, E (H) is Region Entropy;
The formula calculating maximum region entropy is:
wherein n is areal.
When the maximum of the moving region entropy calculated in preset duration exceed predetermined threshold value time, controller show that analysis result is plunder and the anomalous event of fighting, and sends the information of the anomalous event that this is fought to mobile phone.
Two, master controller carries out the analysis of crowd massing event to monitor video:
Described master controller adopts foreground extraction algorithm from video image, extract movement human target, because camera is installed fixing, the monitoring background of camera is made also to have stationarity, so can first obtain fixing background, then Background difference subtracting background image from video image is used to obtain foreground area, then foreground image is calculated by described video pictures and described background image, can judge whether crowd assembles by the angle point area of foreground area block, concrete account form is: first calculate foreground image by video pictures and background image, foreground area block is calculated again by described foreground image, then the angle point area of described foreground area block is detected, wherein:
The formula calculating foreground image is:
Wherein I (x, y, the t) video frame images that is t, BI (x, y) is video fixed background, the foreground image that F (x, y) calculates for Background difference, and 1 represents foreground point, and 0 represents background dot, and Thresh is prospect threshold value;
The formula calculating foreground area block is:
Wherein B (i, j) represents foreground area block, and Area (B) represents the connected domain area of foreground area block, T
arearepresent area threshold.
Wherein, the angle point area pattern detecting described foreground area block is, adopt Harris Corner Detection Algorithm to carry out Corner Detection to foreground area block, after the angle point getting foreground area block, calculate the angle point area of foreground area block by the value of the covariance matrix determinant of angular coordinate collection.
It should be noted that, when the angle point area of foreground area block is larger, illustrate that angle point is overstepping the bounds of propriety loose, crowd is also just overstepping the bounds of propriety loose; Otherwise the angle point area of foreground area block is less, illustrates that angle point is more intensive, and crowd is also more intensive; When the angle point area of foreground area block is from diminishing gradually greatly, illustrate that angle point is gathered from being distributed to, crowd assembles; Otherwise the angle point area of foreground area block is large from little change, and illustrate that angle point is from being brought to dispersion, crowd disperses; Finally, fluctuate up and down, and fluctuation range is very little if the angle point area of foreground area block maintains a specified level, explanation crowd in original place activity or may hover.
Finally, after carrying out above-mentioned process to the video image of continuous multiple frames, can analyze the motion conditions of crowd, and judge whether crowd exists the trend of gathering, if there is aggregation tendency, the abnormal information that controller generates crowd massing event is transferred to mobile phone.
Three, center controls to carry out people to monitor video and to set on fire the analysis of event:
First master controller calculates foreground image by said method, obtains preliminary flame candidate region by this foreground image, is then increased the integrality of flame region by region-growing method.Then Utilization prospects image extracts the area-of-interest (ROI) of flame on primitive frame image as mask, that is, flame area-of-interest is calculated by the foreground image of described monitor video, after acquisition flame area-of-interest, under color difference signal (YCrCb) color space, utilize Digital Image Processing (LBP0) operator to obtain the textural characteristics of area-of-interest, and linear Fusion of Color feature and textural characteristics, thus obtain the fusion feature of described flame area-of-interest, wherein, LBP characteristic parameter surveys processing procedure: entire image is carried out 3 × 3 segmentations and obtain 9 sub-blocks, the LBP characteristic value that pixel in each sub-block carries out 3 × 3 neighborhoods calculates, uniform pattern is adopted to obtain 59 dimensional feature vectors, whole sub-block carries out Fusion Features, the LBP characteristic vector obtaining view picture sample image is 9 be multiplied by 59=531 dimension, differentiated by linear SVM (Linear-SVM) fusion feature to area-of-interest of off-line training again, if be 1, represent that this region may exist flame, otherwise there is not flame in this region.When all detecting that flame occurs in continuous multiple frames video image, the abnormal information that master controller generates event of setting on fire is transferred to mobile phone.
Wherein, the formula calculating flame area-of-interest is:
Wherein F (i, j) is the pixel in the foreground image that extracts, and I (i, j) is pixel in primitive frame image, the pixel that R (i, j) is area-of-interest.
It should be noted that, in the embodiment of the present invention, the analysis mode of carrying out anomalous event to monitor video by controller is above three types, in actual applications, in conjunction with above three kinds of modes or can also analyze anomalous event by other means, be not construed as limiting herein.
603, mobile phone is to the above-mentioned analysis result received, and judges whether to send alarm request, and sends out this judged result to described master controller.
604, when master controller receive judged result correspond to send alarm request time, to loudspeaker send report to the police life signal.
The embodiment of the present invention obtains monitor video by off-premises station, and send this monitor video to master controller, this master controller carries out plundering the analysis with event of fighting to monitor video, the analysis of crowd massing event, during the analysis of event of setting on fire, and send this analysis result to mobile phone, when mobile phone is judged as sending alarm request to this analysis result, this judged result is sent to master controller, the alarm request that this master controller sends according to mobile terminal sends alarm signal to loudspeaker, these loudspeaker play alarm sound according to alarm signal, thus be conducive to the fail safe promoting resident family's inhabitation, additionally by different algorithmic formulas, monitor video is carried out plundering the analysis with the analysis of event of fighting, the analysis of crowd massing event and event of setting on fire, the major safety risks of discovery house periphery that can be more correct, promote the residential security of resident family further.
Those skilled in the art can be well understood to, and for convenience and simplicity of description, the system of foregoing description, the specific works process of device and unit, with reference to the corresponding process in preceding method embodiment, can not repeat them here.
In several embodiments that the application provides, should be understood that, disclosed system, apparatus and method, can realize by another way.Such as, device embodiment described above is only schematic, such as, the division of described unit, be only a kind of logic function to divide, actual can have other dividing mode when realizing, such as multiple unit or assembly can in conjunction with or another system can be integrated into, or some features can be ignored, or do not perform.Another point, shown or discussed coupling each other or direct-coupling or communication connection can be by some interfaces, and the indirect coupling of device or unit or communication connection can be electrical, machinery or other form.
The described unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location, namely can be positioned at a place, or also can be distributed in multiple network element.Some or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, also can be that the independent physics of unit exists, also can two or more unit in a unit integrated.Above-mentioned integrated unit both can adopt the form of hardware to realize, and the form of SFU software functional unit also can be adopted to realize.
If described integrated unit using the form of SFU software functional unit realize and as independently production marketing or use time, can be stored in a computer read/write memory medium.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words or all or part of of this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprising some instructions in order to make a computer equipment (can be personal computer, server, or the network equipment etc.) perform all or part of step of method described in each embodiment of the present invention.And aforesaid storage medium comprises: USB flash disk, portable hard drive, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. various can be program code stored medium.
The above, above embodiment only in order to technical scheme of the present invention to be described, is not intended to limit; Although with reference to previous embodiment to invention has been detailed description, those of ordinary skill in the art is to be understood that: it still can be modified to the technical scheme described in foregoing embodiments, or carries out equivalent replacement to wherein portion of techniques feature; And these amendments or replacement, do not make the essence of appropriate technical solution depart from the spirit and scope of various embodiments of the present invention technical scheme.